2023-10-08T15:50:28.397 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T15:50:28.397 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --verbose --name yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296 -- /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/orig.config.yaml 2023-10-08T15:50:28.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:50:28.531 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7418296' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-07-1508-quincy sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-07-1508-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPT663e9x64MqPNsDtBIeP4pQjApomtwEAEDjcOwK6uzLr+9Y8osJxUM98XN81R6pXv0j9ra7FxlKOo3luZSai0= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEUWLvO62dedOFoii/ylNqnMTpBeEXAKNz0y5yCs41erjFIXclQ94mg22jEaSKcbi8TdFd/3tQSo5CWFOrWkaQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-08_15:41:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T15:50:28.532 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa; will attempt to use it 2023-10-08T15:50:28.533 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks 2023-10-08T15:50:28.533 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T15:50:28.534 INFO:teuthology.task.internal:Checking packages... 2023-10-08T15:50:28.560 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T15:50:28.560 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T15:50:28.560 INFO:teuthology.packaging:ref: None 2023-10-08T15:50:28.560 INFO:teuthology.packaging:tag: None 2023-10-08T15:50:28.560 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:50:28.560 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:50:28.561 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:50:28.723 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-08T15:50:28.724 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T15:50:28.731 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T15:50:28.731 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T15:50:28.773 INFO:teuthology.task.internal:Saving configuration 2023-10-08T15:50:28.790 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T15:50:28.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:50:28.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:38.733444', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPT663e9x64MqPNsDtBIeP4pQjApomtwEAEDjcOwK6uzLr+9Y8osJxUM98XN81R6pXv0j9ra7FxlKOo3luZSai0='} 2023-10-08T15:50:28.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:38.731920', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEUWLvO62dedOFoii/ylNqnMTpBeEXAKNz0y5yCs41erjFIXclQ94mg22jEaSKcbi8TdFd/3tQSo5CWFOrWkaQ='} 2023-10-08T15:50:28.850 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T15:50:28.857 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T15:50:28.857 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T15:50:28.857 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T15:50:28.945 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff15d8cdb80>, signals=[15]) 2023-10-08T15:50:28.946 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T15:50:28.958 INFO:teuthology.task.internal:Opening connections... 2023-10-08T15:50:28.958 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T15:50:28.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:50:29.028 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T15:50:29.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:50:29.093 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T15:50:29.099 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-10-08T15:50:29.117 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-10-08T15:50:29.117 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-10-08T15:50:29.174 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T15:50:29.174 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T15:50:29.174 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-10-08T15:50:29.174 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-10-08T15:50:29.174 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.4" 2023-10-08T15:50:29.174 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T15:50:29.175 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T15:50:29.176 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-10-08T15:50:29.195 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-10-08T15:50:29.212 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-10-08T15:50:29.212 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-08T15:50:29.268 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T15:50:29.268 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T15:50:29.268 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-10-08T15:50:29.268 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-10-08T15:50:29.268 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.4" 2023-10-08T15:50:29.268 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T15:50:29.269 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T15:50:29.270 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-08T15:50:29.295 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T15:50:29.305 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T15:50:29.356 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T15:50:29.357 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:50:29.359 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:50:29.375 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T15:50:29.380 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T15:50:29.381 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:50:29.415 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:50:29.430 INFO:teuthology.orchestra.run.smithi060.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T15:50:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T15:50:29.432 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T15:50:29.484 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T15:50:29.498 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T15:50:29.498 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-08T15:50:29.498 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-08T15:50:29.499 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:50:29.499 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:50:29.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:50:29.515 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-10-08T15:50:29.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:50:29.516 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-08T15:50:29.572 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:50:29.573 INFO:teuthology.task.kernel:Running kernel on smithi144: 4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:50:29.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y kernel 2023-10-08T15:50:29.574 INFO:teuthology.orchestra.run.smithi060.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:50:29.574 INFO:teuthology.task.kernel:Running kernel on smithi060: 4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:50:29.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2023-10-08T15:50:31.033 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T15:50:31.034 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T15:50:31.053 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T15:50:31.054 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-08T15:50:32.463 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-08T15:50:32.474 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-10-08T15:50:33.062 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-08T15:50:33.289 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-08T15:50:36.539 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-08T15:50:36.594 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-08T15:50:37.302 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-08T15:50:37.303 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-08T15:50:37.303 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-08T15:50:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-08T15:50:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-08T15:50:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-08T15:50:37.457 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T15:50:37.458 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2023-10-08T15:50:37.458 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T15:50:37.511 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-08T15:50:37.512 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-08T15:50:37.512 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-08T15:50:37.558 DEBUG:teuthology.orchestra.run.smithi144:> echo no | sudo yum reinstall kernel || true 2023-10-08T15:50:37.665 DEBUG:teuthology.orchestra.run.smithi060:> echo no | sudo yum reinstall kernel || true 2023-10-08T15:50:37.901 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T15:50:37.902 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T15:50:38.031 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T15:50:38.031 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-08T15:50:38.194 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 03:50:36 PM UTC. 2023-10-08T15:50:38.336 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 03:50:36 PM UTC. 2023-10-08T15:50:38.348 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:50:38.348 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:38.348 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:38.367 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-08T15:50:38.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum reinstall -y kernel || true 2023-10-08T15:50:38.488 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:50:38.488 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:38.488 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:38.540 INFO:teuthology.orchestra.run.smithi060.stderr:Error: No packages marked for reinstall. 2023-10-08T15:50:38.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum reinstall -y kernel || true 2023-10-08T15:50:38.759 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T15:50:38.759 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T15:50:38.955 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T15:50:38.955 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-08T15:50:39.048 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 03:50:36 PM UTC. 2023-10-08T15:50:39.190 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:50:39.190 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:39.190 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:39.201 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-08T15:50:39.251 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:50:39.262 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 03:50:36 PM UTC. 2023-10-08T15:50:39.376 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.377 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.377 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.377 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:50:39.377 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:50:39.377 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-08T15:50:39.377 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:50:39.377 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:50:39.394 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:50:39.395 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:39.395 INFO:teuthology.orchestra.run.smithi060.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:50:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:Error: No packages marked for reinstall. 2023-10-08T15:50:39.455 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.502 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.02 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 99.el8_4.1 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Group : System Environment/Base 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 9264631 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2023-10-08T15:50:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Relocations : (not relocatable) 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : Red Hat, Inc. 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : Red Hat, Inc. 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2023-10-08T15:50:39.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2023-10-08T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T15:50:39.531 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T15:50:39.532 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T15:50:39.532 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T15:50:39.584 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.585 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.585 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.585 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:50:39.585 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:50:39.586 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-08T15:50:39.586 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:50:39.586 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:50:39.716 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.716 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2023-10-08T15:50:39.744 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2023-10-08T15:50:39.744 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2023-10-08T15:50:39.744 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.02 2023-10-08T15:50:39.744 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 99.el8_4.1 2023-10-08T15:50:39.744 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Group : System Environment/Base 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 9264631 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Relocations : (not relocatable) 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : Red Hat, Inc. 2023-10-08T15:50:39.745 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : Red Hat, Inc. 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T15:50:39.746 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T15:50:39.747 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T15:50:39.747 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:39.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T15:50:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2023-10-08T15:50:41.106 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2023-10-08T15:50:43.219 INFO:teuthology.orchestra.run.smithi144.stderr:done 2023-10-08T15:50:43.225 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-10-08T15:50:43.228 INFO:teuthology.orchestra.run.smithi060.stderr:done 2023-10-08T15:50:43.230 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2023-10-08T15:50:43.246 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.y6hCgg81FZ 2023-10-08T15:50:43.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.y6hCgg81FZ 2023-10-08T15:50:43.247 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.hZs4jk3vOZ 2023-10-08T15:50:43.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hZs4jk3vOZ 2023-10-08T15:50:43.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.y6hCgg81FZ 2023-10-08T15:50:43.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.hZs4jk3vOZ 2023-10-08T15:50:43.480 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.hZs4jk3vOZ is 6KB 2023-10-08T15:50:43.483 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.y6hCgg81FZ is 6KB 2023-10-08T15:50:43.528 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.hZs4jk3vOZ 2023-10-08T15:50:43.531 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.y6hCgg81FZ 2023-10-08T15:50:43.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T15:50:43.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T15:50:43.616 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T15:50:43.616 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T15:50:43.616 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T15:50:43.616 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T15:50:43.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:43.622 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T15:50:43.622 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T15:50:43.623 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T15:50:43.623 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T15:50:43.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:50:43.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2023-10-08T15:50:43.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2023-10-08T15:51:13.794 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-08T15:51:13.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T15:51:13.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:13.797 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T15:51:13.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T15:51:13.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:32.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-08T15:51:32.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-10-08T15:51:41.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T15:51:41.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:41.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T15:51:41.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:44.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-08T15:51:56.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T15:51:56.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:14.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-08T15:52:29.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T15:52:29.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:30.271 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-08T15:52:30.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T15:52:30.998 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-08T15:52:30.998 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-10-08T15:52:31.271 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-08T15:52:31.271 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:52:31.271 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:52:31.271 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T15:52:32.272 DEBUG:teuthology.parallel:result is None 2023-10-08T15:52:41.235 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T15:52:53.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T15:52:53.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:53.592 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-08T15:52:53.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T15:52:53.878 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-08T15:52:53.879 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-08T15:52:53.895 INFO:teuthology.orchestra.run.smithi060.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-08T15:52:53.895 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:52:53.895 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:52:53.895 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T15:52:54.897 DEBUG:teuthology.parallel:result is None 2023-10-08T15:52:54.897 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T15:52:54.908 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T15:52:54.909 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:52:54.911 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:52:54.929 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T15:52:54.936 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T15:52:54.979 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T15:52:54.980 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:52:54.982 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:52:55.017 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T15:52:55.024 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T15:52:55.024 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:52:55.051 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:52:55.130 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:52:55.135 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:52:55.145 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:52:55.151 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:52:55.153 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T15:52:55.161 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T15:52:55.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:52:55.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:52:55.189 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T15:52:55.199 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T15:52:55.199 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:52:55.232 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:52:55.247 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:52:55.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:52:55.383 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:52:55.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:52:55.508 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T15:52:55.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:52:55.574 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:52:55.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:52:55.696 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:52:55.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:52:55.779 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T15:52:55.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:52:55.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-10-08T15:52:55.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-10-08T15:52:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T15:52:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T15:52:56.369 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T15:52:56.378 INFO:teuthology.task.internal:Starting timer... 2023-10-08T15:52:56.379 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T15:52:56.402 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T15:52:56.434 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T15:52:56.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2023-10-08T15:52:56.495 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: [ OK ] 2023-10-08T15:52:56.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-10-08T15:52:56.554 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: [ OK ] 2023-10-08T15:52:56.556 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T15:52:56.556 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2023-10-08T15:52:56.584 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2023-10-08T15:52:56.584 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-10-08T15:52:56.603 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-10-08T15:52:56.603 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2023-10-08T15:52:56.604 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T15:52:56.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:52:56.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T15:52:56.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:52:56.676 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T15:52:56.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2023-10-08T15:52:56.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-10-08T15:52:56.741 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T15:52:56.751 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T15:52:56.751 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T15:52:56.767 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T15:52:56.768 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T16:01:52.442 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2023-10-08T16:01:52.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T16:01:52.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:01:52.515 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-08T16:01:52.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T16:01:52.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T16:01:52.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:01:52.649 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-08T16:01:52.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T16:01:52.713 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T16:01:52.723 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T16:01:52.723 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:01:52.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:01:52.725 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:01:52.726 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:01:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T16:01:52.767 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T16:01:52.781 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T16:01:52.795 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T16:01:52.804 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2023-10-08T16:01:52.814 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2023-10-08T16:01:52.828 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T16:01:52.833 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-10-08T16:01:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T16:01:52.844 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-10-08T16:01:52.857 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T16:01:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T16:01:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-08T16:01:52.918 INFO:teuthology.orchestra.run.smithi060.stdout:210 Number of sources = 4 2023-10-08T16:01:52.918 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T16:01:52.918 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-08T16:01:52.918 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.918 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.918 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.919 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.934 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-08T16:01:52.937 INFO:teuthology.orchestra.run.smithi144.stdout:210 Number of sources = 4 2023-10-08T16:01:52.937 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T16:01:52.937 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-08T16:01:52.937 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.937 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.937 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.938 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:01:52.938 INFO:teuthology.run_tasks:Running task install... 2023-10-08T16:01:52.945 DEBUG:teuthology.task.install:project ceph 2023-10-08T16:01:52.946 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T16:01:52.946 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T16:01:52.946 INFO:teuthology.task.install:Using flavor: default 2023-10-08T16:01:52.951 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T16:01:52.951 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T16:01:52.952 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T16:01:52.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:01:52.954 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T16:01:52.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:01:53.095 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T16:01:53.095 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T16:01:53.168 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T16:01:53.169 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T16:01:53.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T16:01:53.643 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:01:53.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T16:01:53.649 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T16:01:53.650 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:01:53.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T16:01:53.669 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T16:01:53.669 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T16:01:53.677 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T16:01:53.677 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T16:01:53.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T16:01:53.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T16:01:53.809 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T16:01:53.820 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T16:01:53.872 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-10-08T16:01:53.874 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-10-08T16:01:53.884 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2023-10-08T16:01:53.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2023-10-08T16:01:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T16:01:54.296 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T16:01:55.364 INFO:teuthology.orchestra.run.smithi060.stdout:44 files removed 2023-10-08T16:01:55.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T16:01:55.622 INFO:teuthology.orchestra.run.smithi144.stdout:44 files removed 2023-10-08T16:01:55.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T16:01:55.792 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T16:01:56.037 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T16:01:57.301 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 159 kB/s | 78 kB 00:00 2023-10-08T16:01:57.500 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 135 kB/s | 78 kB 00:00 2023-10-08T16:01:57.786 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 21 kB/s | 9.2 kB 00:00 2023-10-08T16:01:58.039 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 18 kB/s | 9.2 kB 00:00 2023-10-08T16:01:58.371 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 2.6 kB/s | 1.5 kB 00:00 2023-10-08T16:01:58.490 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 40 kB/s | 3.5 kB 00:00 2023-10-08T16:01:58.691 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-10-08T16:01:58.800 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-08T16:01:59.088 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-08T16:02:00.935 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 16 MB 00:02 2023-10-08T16:02:02.579 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-08T16:02:03.413 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 38 MB 00:00 2023-10-08T16:02:04.302 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 4.9 MB/s | 24 kB 00:00 2023-10-08T16:02:04.820 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 MB/s | 38 MB 00:00 2023-10-08T16:02:09.572 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 85 MB/s | 33 MB 00:00 2023-10-08T16:02:10.413 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 MB/s | 33 MB 00:00 2023-10-08T16:02:18.341 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:02:18.341 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:02:18.352 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T16:02:18.353 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T16:02:18.354 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T16:02:18.355 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T16:02:18.356 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T16:02:18.359 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T16:02:18.360 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T16:02:18.445 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:02:18.446 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:02:18.457 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T16:02:18.458 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T16:02:18.459 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T16:02:18.460 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T16:02:18.461 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T16:02:18.464 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T16:02:18.465 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T16:02:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================================== 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================================== 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T16:02:18.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T16:02:18.865 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T16:02:18.866 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T16:02:18.867 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T16:02:18.868 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T16:02:18.869 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T16:02:18.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:02:18.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T16:02:18.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T16:02:18.873 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================================== 2023-10-08T16:02:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:Install 118 Packages 2023-10-08T16:02:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 2 Packages 2023-10-08T16:02:18.875 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:02:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 202 M 2023-10-08T16:02:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-10-08T16:02:18.988 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================================================== 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================================================== 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T16:02:19.001 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T16:02:19.002 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T16:02:19.003 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T16:02:19.004 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T16:02:19.005 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T16:02:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T16:02:19.007 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T16:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T16:02:19.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================================================== 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout:Install 118 Packages 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2023-10-08T16:02:19.011 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:02:19.012 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 202 M 2023-10-08T16:02:19.012 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-08T16:02:19.194 INFO:teuthology.orchestra.run.smithi144.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-10-08T16:02:19.392 INFO:teuthology.orchestra.run.smithi060.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-08T16:02:20.210 INFO:teuthology.orchestra.run.smithi144.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 863 kB/s | 876 kB 00:01 2023-10-08T16:02:20.359 INFO:teuthology.orchestra.run.smithi144.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.1 MB/s | 162 kB 00:00 2023-10-08T16:02:20.487 INFO:teuthology.orchestra.run.smithi060.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 800 kB/s | 876 kB 00:01 2023-10-08T16:02:20.643 INFO:teuthology.orchestra.run.smithi060.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.0 MB/s | 162 kB 00:00 2023-10-08T16:02:22.087 INFO:teuthology.orchestra.run.smithi060.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-10-08T16:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-10-08T16:02:22.996 INFO:teuthology.orchestra.run.smithi060.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 1.7 MB/s | 1.6 MB 00:00 2023-10-08T16:02:23.915 INFO:teuthology.orchestra.run.smithi144.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 1.1 MB/s | 1.6 MB 00:01 2023-10-08T16:02:25.730 INFO:teuthology.orchestra.run.smithi060.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 1.4 MB/s | 3.9 MB 00:02 2023-10-08T16:02:26.825 INFO:teuthology.orchestra.run.smithi144.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 1.4 MB/s | 3.9 MB 00:02 2023-10-08T16:02:27.475 INFO:teuthology.orchestra.run.smithi060.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 631 kB/s | 5.2 MB 00:08 2023-10-08T16:02:27.492 INFO:teuthology.orchestra.run.smithi144.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 616 kB/s | 5.2 MB 00:08 2023-10-08T16:02:34.948 INFO:teuthology.orchestra.run.smithi060.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 1.8 MB/s | 17 MB 00:09 2023-10-08T16:02:35.016 INFO:teuthology.orchestra.run.smithi060.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 361 kB/s | 24 kB 00:00 2023-10-08T16:02:39.728 INFO:teuthology.orchestra.run.smithi144.stdout:(8/120): ceph-radosgw-17.2.6-1320.g08cac018.el8 1.4 MB/s | 17 MB 00:12 2023-10-08T16:02:39.780 INFO:teuthology.orchestra.run.smithi060.stdout:(10/120): ceph-common-17.2.6-1320.g08cac018.el8 1.1 MB/s | 23 MB 00:20 2023-10-08T16:02:39.816 INFO:teuthology.orchestra.run.smithi144.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 277 kB/s | 24 kB 00:00 2023-10-08T16:02:40.008 INFO:teuthology.orchestra.run.smithi060.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 1.1 MB/s | 255 kB 00:00 2023-10-08T16:02:40.089 INFO:teuthology.orchestra.run.smithi060.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 307 kB/s | 25 kB 00:00 2023-10-08T16:02:40.492 INFO:teuthology.orchestra.run.smithi144.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 1.2 MB/s | 17 MB 00:13 2023-10-08T16:02:40.646 INFO:teuthology.orchestra.run.smithi060.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 1.4 MB/s | 797 kB 00:00 2023-10-08T16:02:40.756 INFO:teuthology.orchestra.run.smithi144.stdout:(11/120): ceph-common-17.2.6-1320.g08cac018.el8 1.1 MB/s | 23 MB 00:21 2023-10-08T16:02:40.808 INFO:teuthology.orchestra.run.smithi060.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 1.1 MB/s | 174 kB 00:00 2023-10-08T16:02:40.818 INFO:teuthology.orchestra.run.smithi144.stdout:(12/120): cephfs-mirror-17.2.6-1320.g08cac018.e 786 kB/s | 255 kB 00:00 2023-10-08T16:02:40.848 INFO:teuthology.orchestra.run.smithi144.stdout:(13/120): libcephfs-devel-17.2.6-1320.g08cac018 269 kB/s | 25 kB 00:00 2023-10-08T16:02:41.069 INFO:teuthology.orchestra.run.smithi144.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 790 kB/s | 174 kB 00:00 2023-10-08T16:02:41.322 INFO:teuthology.orchestra.run.smithi060.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 253 kB/s | 130 kB 00:00 2023-10-08T16:02:41.390 INFO:teuthology.orchestra.run.smithi144.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 404 kB/s | 130 kB 00:00 2023-10-08T16:02:41.616 INFO:teuthology.orchestra.run.smithi144.stdout:(16/120): libcephfs2-17.2.6-1320.g08cac018.el8. 998 kB/s | 797 kB 00:00 2023-10-08T16:02:41.623 INFO:teuthology.orchestra.run.smithi060.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 1.6 MB/s | 507 kB 00:00 2023-10-08T16:02:41.995 INFO:teuthology.orchestra.run.smithi144.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 839 kB/s | 507 kB 00:00 2023-10-08T16:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 796 kB/s | 45 kB 00:00 2023-10-08T16:02:42.221 INFO:teuthology.orchestra.run.smithi144.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 682 kB/s | 115 kB 00:00 2023-10-08T16:02:42.447 INFO:teuthology.orchestra.run.smithi144.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 841 kB/s | 190 kB 00:00 2023-10-08T16:02:42.918 INFO:teuthology.orchestra.run.smithi144.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 788 kB/s | 371 kB 00:00 2023-10-08T16:02:43.298 INFO:teuthology.orchestra.run.smithi144.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 943 kB/s | 358 kB 00:00 2023-10-08T16:02:43.422 INFO:teuthology.orchestra.run.smithi144.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 860 kB/s | 107 kB 00:00 2023-10-08T16:02:43.546 INFO:teuthology.orchestra.run.smithi144.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 734 kB/s | 90 kB 00:00 2023-10-08T16:02:44.538 INFO:teuthology.orchestra.run.smithi144.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 1.9 MB/s | 5.6 MB 00:02 2023-10-08T16:02:44.658 INFO:teuthology.orchestra.run.smithi060.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 1.8 MB/s | 5.6 MB 00:03 2023-10-08T16:02:44.669 INFO:teuthology.orchestra.run.smithi144.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 1.3 MB/s | 173 kB 00:00 2023-10-08T16:02:44.714 INFO:teuthology.orchestra.run.smithi060.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 796 kB/s | 45 kB 00:00 2023-10-08T16:02:44.729 INFO:teuthology.orchestra.run.smithi144.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 384 kB/s | 23 kB 00:00 2023-10-08T16:02:44.777 INFO:teuthology.orchestra.run.smithi060.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 1.8 MB/s | 115 kB 00:00 2023-10-08T16:02:44.798 INFO:teuthology.orchestra.run.smithi144.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 1.7 MB/s | 121 kB 00:00 2023-10-08T16:02:44.911 INFO:teuthology.orchestra.run.smithi060.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 1.4 MB/s | 190 kB 00:00 2023-10-08T16:02:45.119 INFO:teuthology.orchestra.run.smithi060.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 1.7 MB/s | 371 kB 00:00 2023-10-08T16:02:45.329 INFO:teuthology.orchestra.run.smithi060.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 1.7 MB/s | 358 kB 00:00 2023-10-08T16:02:45.399 INFO:teuthology.orchestra.run.smithi060.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 1.5 MB/s | 107 kB 00:00 2023-10-08T16:02:45.469 INFO:teuthology.orchestra.run.smithi060.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.3 MB/s | 90 kB 00:00 2023-10-08T16:02:45.778 INFO:teuthology.orchestra.run.smithi144.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 1.7 MB/s | 1.7 MB 00:00 2023-10-08T16:02:45.993 INFO:teuthology.orchestra.run.smithi060.stdout:(25/120): ceph-radosgw-17.2.6-1320.g08cac018.el 928 kB/s | 17 MB 00:18 2023-10-08T16:02:46.225 INFO:teuthology.orchestra.run.smithi060.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 752 kB/s | 173 kB 00:00 2023-10-08T16:02:46.289 INFO:teuthology.orchestra.run.smithi060.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 361 kB/s | 23 kB 00:00 2023-10-08T16:02:46.419 INFO:teuthology.orchestra.run.smithi060.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 929 kB/s | 121 kB 00:00 2023-10-08T16:02:46.592 INFO:teuthology.orchestra.run.smithi144.stdout:(30/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 1.1 MB/s | 3.5 MB 00:03 2023-10-08T16:02:46.805 INFO:teuthology.orchestra.run.smithi144.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 1.1 MB/s | 238 kB 00:00 2023-10-08T16:02:46.877 INFO:teuthology.orchestra.run.smithi144.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 660 kB/s | 47 kB 00:00 2023-10-08T16:02:46.949 INFO:teuthology.orchestra.run.smithi144.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 202 kB/s | 14 kB 00:00 2023-10-08T16:02:47.148 INFO:teuthology.orchestra.run.smithi144.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 1.3 MB/s | 267 kB 00:00 2023-10-08T16:02:47.217 INFO:teuthology.orchestra.run.smithi144.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-08T16:02:47.285 INFO:teuthology.orchestra.run.smithi144.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 267 kB/s | 18 kB 00:00 2023-10-08T16:02:47.590 INFO:teuthology.orchestra.run.smithi060.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 1.6 MB/s | 3.5 MB 00:02 2023-10-08T16:02:47.857 INFO:teuthology.orchestra.run.smithi144.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 535 kB/s | 306 kB 00:00 2023-10-08T16:02:47.951 INFO:teuthology.orchestra.run.smithi144.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 629 kB/s | 59 kB 00:00 2023-10-08T16:02:48.032 INFO:teuthology.orchestra.run.smithi060.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 1.1 MB/s | 1.7 MB 00:01 2023-10-08T16:02:48.048 INFO:teuthology.orchestra.run.smithi144.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 772 kB/s | 75 kB 00:00 2023-10-08T16:02:48.245 INFO:teuthology.orchestra.run.smithi144.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-10-08T16:02:48.250 INFO:teuthology.orchestra.run.smithi060.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 1.1 MB/s | 238 kB 00:00 2023-10-08T16:02:48.322 INFO:teuthology.orchestra.run.smithi060.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 658 kB/s | 47 kB 00:00 2023-10-08T16:02:48.331 INFO:teuthology.orchestra.run.smithi144.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 509 kB/s | 44 kB 00:00 2023-10-08T16:02:48.395 INFO:teuthology.orchestra.run.smithi060.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 200 kB/s | 14 kB 00:00 2023-10-08T16:02:48.427 INFO:teuthology.orchestra.run.smithi144.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.9 MB/s | 185 kB 00:00 2023-10-08T16:02:48.512 INFO:teuthology.orchestra.run.smithi144.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 388 kB/s | 33 kB 00:00 2023-10-08T16:02:48.596 INFO:teuthology.orchestra.run.smithi144.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2023-10-08T16:02:48.686 INFO:teuthology.orchestra.run.smithi060.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 916 kB/s | 267 kB 00:00 2023-10-08T16:02:48.689 INFO:teuthology.orchestra.run.smithi144.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-08T16:02:48.761 INFO:teuthology.orchestra.run.smithi060.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.0 MB/s | 80 kB 00:00 2023-10-08T16:02:48.798 INFO:teuthology.orchestra.run.smithi144.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.4 MB/s | 384 kB 00:00 2023-10-08T16:02:48.836 INFO:teuthology.orchestra.run.smithi060.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 242 kB/s | 18 kB 00:00 2023-10-08T16:02:48.886 INFO:teuthology.orchestra.run.smithi144.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 928 kB/s | 81 kB 00:00 2023-10-08T16:02:48.948 INFO:teuthology.orchestra.run.smithi060.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.7 MB/s | 306 kB 00:00 2023-10-08T16:02:48.969 INFO:teuthology.orchestra.run.smithi060.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 2.8 MB/s | 59 kB 00:00 2023-10-08T16:02:48.969 INFO:teuthology.orchestra.run.smithi144.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 134 kB/s | 11 kB 00:00 2023-10-08T16:02:48.989 INFO:teuthology.orchestra.run.smithi060.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 3.6 MB/s | 75 kB 00:00 2023-10-08T16:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 212 kB/s | 18 kB 00:00 2023-10-08T16:02:49.058 INFO:teuthology.orchestra.run.smithi060.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 6.8 MB/s | 476 kB 00:00 2023-10-08T16:02:49.080 INFO:teuthology.orchestra.run.smithi060.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.0 MB/s | 44 kB 00:00 2023-10-08T16:02:49.101 INFO:teuthology.orchestra.run.smithi060.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 8.5 MB/s | 185 kB 00:00 2023-10-08T16:02:49.122 INFO:teuthology.orchestra.run.smithi060.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2023-10-08T16:02:49.142 INFO:teuthology.orchestra.run.smithi060.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 813 kB/s | 16 kB 00:00 2023-10-08T16:02:49.165 INFO:teuthology.orchestra.run.smithi060.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.6 MB/s | 173 kB 00:00 2023-10-08T16:02:49.189 INFO:teuthology.orchestra.run.smithi060.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 16 MB/s | 384 kB 00:00 2023-10-08T16:02:49.211 INFO:teuthology.orchestra.run.smithi060.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 3.7 MB/s | 81 kB 00:00 2023-10-08T16:02:49.219 INFO:teuthology.orchestra.run.smithi144.stdout:(50/120): ceph-mgr-diskprediction-local-17.2.6- 2.2 MB/s | 7.4 MB 00:03 2023-10-08T16:02:49.224 INFO:teuthology.orchestra.run.smithi144.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 6.8 MB/s | 1.2 MB 00:00 2023-10-08T16:02:49.230 INFO:teuthology.orchestra.run.smithi060.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 571 kB/s | 11 kB 00:00 2023-10-08T16:02:49.250 INFO:teuthology.orchestra.run.smithi060.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 907 kB/s | 18 kB 00:00 2023-10-08T16:02:49.296 INFO:teuthology.orchestra.run.smithi060.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 26 MB/s | 1.2 MB 00:00 2023-10-08T16:02:49.309 INFO:teuthology.orchestra.run.smithi144.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 687 kB/s | 59 kB 00:00 2023-10-08T16:02:49.316 INFO:teuthology.orchestra.run.smithi060.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2023-10-08T16:02:49.394 INFO:teuthology.orchestra.run.smithi060.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 758 kB/s | 59 kB 00:00 2023-10-08T16:02:49.396 INFO:teuthology.orchestra.run.smithi144.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 699 kB/s | 60 kB 00:00 2023-10-08T16:02:49.436 INFO:teuthology.orchestra.run.smithi060.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-08T16:02:49.494 INFO:teuthology.orchestra.run.smithi144.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-10-08T16:02:49.506 INFO:teuthology.orchestra.run.smithi060.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 4.0 MB/s | 283 kB 00:00 2023-10-08T16:02:49.526 INFO:teuthology.orchestra.run.smithi060.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 798 kB/s | 16 kB 00:00 2023-10-08T16:02:49.548 INFO:teuthology.orchestra.run.smithi060.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.5 MB/s | 34 kB 00:00 2023-10-08T16:02:49.559 INFO:teuthology.orchestra.run.smithi144.stdout:(55/120): python3-logutils-0.3.5-11.el8.noarch. 143 kB/s | 49 kB 00:00 2023-10-08T16:02:49.572 INFO:teuthology.orchestra.run.smithi060.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 8.0 MB/s | 196 kB 00:00 2023-10-08T16:02:49.576 INFO:teuthology.orchestra.run.smithi144.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 189 kB/s | 16 kB 00:00 2023-10-08T16:02:49.593 INFO:teuthology.orchestra.run.smithi060.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 3.1 MB/s | 64 kB 00:00 2023-10-08T16:02:49.613 INFO:teuthology.orchestra.run.smithi060.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 954 kB/s | 19 kB 00:00 2023-10-08T16:02:49.633 INFO:teuthology.orchestra.run.smithi060.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2023-10-08T16:02:49.654 INFO:teuthology.orchestra.run.smithi060.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2023-10-08T16:02:49.669 INFO:teuthology.orchestra.run.smithi144.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2023-10-08T16:02:49.672 INFO:teuthology.orchestra.run.smithi144.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 296 kB/s | 34 kB 00:00 2023-10-08T16:02:49.674 INFO:teuthology.orchestra.run.smithi060.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2023-10-08T16:02:49.697 INFO:teuthology.orchestra.run.smithi060.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 11 MB/s | 255 kB 00:00 2023-10-08T16:02:49.720 INFO:teuthology.orchestra.run.smithi060.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi144.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 752 kB/s | 64 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi144.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 193 kB/s | 19 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi144.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 282 kB/s | 24 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi144.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 271 kB/s | 29 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi060.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi060.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi060.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi060.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 40 MB/s | 1.7 MB 00:00 2023-10-08T16:02:49.896 INFO:teuthology.orchestra.run.smithi060.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-10-08T16:02:49.923 INFO:teuthology.orchestra.run.smithi144.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 328 kB/s | 27 kB 00:00 2023-10-08T16:02:49.965 INFO:teuthology.orchestra.run.smithi060.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 136 kB/s | 19 kB 00:00 2023-10-08T16:02:50.018 INFO:teuthology.orchestra.run.smithi144.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.6 MB/s | 251 kB 00:00 2023-10-08T16:02:50.064 INFO:teuthology.orchestra.run.smithi060.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 432 kB/s | 43 kB 00:00 2023-10-08T16:02:50.091 INFO:teuthology.orchestra.run.smithi060.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.6 MB/s | 155 kB 00:00 2023-10-08T16:02:50.104 INFO:teuthology.orchestra.run.smithi144.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 712 kB/s | 61 kB 00:00 2023-10-08T16:02:50.150 INFO:teuthology.orchestra.run.smithi144.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 938 kB/s | 255 kB 00:00 2023-10-08T16:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 986 kB/s | 85 kB 00:00 2023-10-08T16:02:50.233 INFO:teuthology.orchestra.run.smithi060.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-08T16:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 266 kB/s | 23 kB 00:00 2023-10-08T16:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-08T16:02:50.365 INFO:teuthology.orchestra.run.smithi144.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-08T16:02:50.387 INFO:teuthology.orchestra.run.smithi144.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 129 kB/s | 19 kB 00:00 2023-10-08T16:02:50.394 INFO:teuthology.orchestra.run.smithi060.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 298 kB/s | 48 kB 00:00 2023-10-08T16:02:50.474 INFO:teuthology.orchestra.run.smithi060.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.8 MB/s | 229 kB 00:00 2023-10-08T16:02:50.484 INFO:teuthology.orchestra.run.smithi144.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-10-08T16:02:50.492 INFO:teuthology.orchestra.run.smithi144.stdout:(73/120): python3-jwt-1.6.1-2.el8.noarch.rpm 335 kB/s | 43 kB 00:00 2023-10-08T16:02:50.588 INFO:teuthology.orchestra.run.smithi060.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 377 kB/s | 43 kB 00:00 2023-10-08T16:02:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 394 kB/s | 48 kB 00:00 2023-10-08T16:02:50.693 INFO:teuthology.orchestra.run.smithi144.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-10-08T16:02:50.724 INFO:teuthology.orchestra.run.smithi144.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.0 MB/s | 229 kB 00:00 2023-10-08T16:02:50.732 INFO:teuthology.orchestra.run.smithi060.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 16 MB/s | 2.3 MB 00:00 2023-10-08T16:02:50.785 INFO:teuthology.orchestra.run.smithi144.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 465 kB/s | 43 kB 00:00 2023-10-08T16:02:50.835 INFO:teuthology.orchestra.run.smithi060.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 174 kB/s | 18 kB 00:00 2023-10-08T16:02:50.876 INFO:teuthology.orchestra.run.smithi144.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 198 kB/s | 18 kB 00:00 2023-10-08T16:02:50.887 INFO:teuthology.orchestra.run.smithi060.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 11 MB/s | 605 kB 00:00 2023-10-08T16:02:50.949 INFO:teuthology.orchestra.run.smithi144.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 10 MB/s | 2.3 MB 00:00 2023-10-08T16:02:51.003 INFO:teuthology.orchestra.run.smithi060.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 717 kB/s | 83 kB 00:00 2023-10-08T16:02:51.040 INFO:teuthology.orchestra.run.smithi144.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 911 kB/s | 83 kB 00:00 2023-10-08T16:02:51.075 INFO:teuthology.orchestra.run.smithi144.stdout:(81/120): pcre2-devel-10.32-2.el8.x86_64.rpm 3.0 MB/s | 605 kB 00:00 2023-10-08T16:02:51.084 INFO:teuthology.orchestra.run.smithi060.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 725 kB/s | 59 kB 00:00 2023-10-08T16:02:51.130 INFO:teuthology.orchestra.run.smithi144.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 651 kB/s | 59 kB 00:00 2023-10-08T16:02:51.192 INFO:teuthology.orchestra.run.smithi144.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.4 MB/s | 169 kB 00:00 2023-10-08T16:02:51.196 INFO:teuthology.orchestra.run.smithi060.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.5 MB/s | 169 kB 00:00 2023-10-08T16:02:51.274 INFO:teuthology.orchestra.run.smithi144.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 265 kB/s | 38 kB 00:00 2023-10-08T16:02:51.307 INFO:teuthology.orchestra.run.smithi144.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 747 kB/s | 86 kB 00:00 2023-10-08T16:02:51.315 INFO:teuthology.orchestra.run.smithi060.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 321 kB/s | 38 kB 00:00 2023-10-08T16:02:51.357 INFO:teuthology.orchestra.run.smithi144.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 697 kB/s | 58 kB 00:00 2023-10-08T16:02:51.372 INFO:teuthology.orchestra.run.smithi144.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 722 kB/s | 47 kB 00:00 2023-10-08T16:02:51.374 INFO:teuthology.orchestra.run.smithi060.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2023-10-08T16:02:51.416 INFO:teuthology.orchestra.run.smithi144.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 9.3 MB/s | 559 kB 00:00 2023-10-08T16:02:51.430 INFO:teuthology.orchestra.run.smithi144.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 11 MB/s | 639 kB 00:00 2023-10-08T16:02:51.440 INFO:teuthology.orchestra.run.smithi060.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 875 kB/s | 58 kB 00:00 2023-10-08T16:02:51.440 INFO:teuthology.orchestra.run.smithi144.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.9 MB/s | 70 kB 00:00 2023-10-08T16:02:51.461 INFO:teuthology.orchestra.run.smithi144.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 6.3 MB/s | 200 kB 00:00 2023-10-08T16:02:51.462 INFO:teuthology.orchestra.run.smithi060.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.0 MB/s | 47 kB 00:00 2023-10-08T16:02:51.493 INFO:teuthology.orchestra.run.smithi060.stdout:(87/120): ceph-mgr-diskprediction-local-17.2.6- 1.9 MB/s | 7.4 MB 00:03 2023-10-08T16:02:51.493 INFO:teuthology.orchestra.run.smithi144.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 1.8 MB/s | 97 kB 00:00 2023-10-08T16:02:51.502 INFO:teuthology.orchestra.run.smithi060.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 14 MB/s | 559 kB 00:00 2023-10-08T16:02:51.528 INFO:teuthology.orchestra.run.smithi144.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 1.2 MB/s | 44 kB 00:00 2023-10-08T16:02:51.531 INFO:teuthology.orchestra.run.smithi060.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 2.3 MB/s | 70 kB 00:00 2023-10-08T16:02:51.557 INFO:teuthology.orchestra.run.smithi060.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 9.8 MB/s | 639 kB 00:00 2023-10-08T16:02:51.565 INFO:teuthology.orchestra.run.smithi144.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 727 kB/s | 27 kB 00:00 2023-10-08T16:02:51.577 INFO:teuthology.orchestra.run.smithi060.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 4.3 MB/s | 200 kB 00:00 2023-10-08T16:02:51.590 INFO:teuthology.orchestra.run.smithi060.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 2.9 MB/s | 97 kB 00:00 2023-10-08T16:02:51.598 INFO:teuthology.orchestra.run.smithi144.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2023-10-08T16:02:51.645 INFO:teuthology.orchestra.run.smithi060.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 790 kB/s | 44 kB 00:00 2023-10-08T16:02:51.678 INFO:teuthology.orchestra.run.smithi060.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 828 kB/s | 27 kB 00:00 2023-10-08T16:02:51.700 INFO:teuthology.orchestra.run.smithi060.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 7.1 MB/s | 161 kB 00:00 2023-10-08T16:02:51.709 INFO:teuthology.orchestra.run.smithi144.stdout:(96/120): python3-scipy-1.0.0-20.module+el8.1.0 59 MB/s | 15 MB 00:00 2023-10-08T16:02:51.713 INFO:teuthology.orchestra.run.smithi144.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2023-10-08T16:02:51.730 INFO:teuthology.orchestra.run.smithi060.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2023-10-08T16:02:51.759 INFO:teuthology.orchestra.run.smithi144.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-08T16:02:51.790 INFO:teuthology.orchestra.run.smithi144.stdout:(99/120): python3-babel-2.5.1-5.el8.noarch.rpm 63 MB/s | 4.8 MB 00:00 2023-10-08T16:02:51.790 INFO:teuthology.orchestra.run.smithi144.stdout:(100/120): python3-markupsafe-0.23-19.el8.x86_6 1.2 MB/s | 39 kB 00:00 2023-10-08T16:02:51.817 INFO:teuthology.orchestra.run.smithi144.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-08T16:02:51.826 INFO:teuthology.orchestra.run.smithi144.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.2 MB/s | 259 kB 00:00 2023-10-08T16:02:51.841 INFO:teuthology.orchestra.run.smithi144.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.2 MB/s | 225 kB 00:00 2023-10-08T16:02:51.856 INFO:teuthology.orchestra.run.smithi144.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.2 MB/s | 126 kB 00:00 2023-10-08T16:02:51.900 INFO:teuthology.orchestra.run.smithi144.stdout:(105/120): python3-numpy-1.14.3-9.el8.x86_64.rp 64 MB/s | 3.7 MB 00:00 2023-10-08T16:02:51.902 INFO:teuthology.orchestra.run.smithi144.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 3.9 MB/s | 187 kB 00:00 2023-10-08T16:02:51.934 INFO:teuthology.orchestra.run.smithi144.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 16 MB/s | 538 kB 00:00 2023-10-08T16:02:51.941 INFO:teuthology.orchestra.run.smithi144.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 7.7 MB/s | 302 kB 00:00 2023-10-08T16:02:51.973 INFO:teuthology.orchestra.run.smithi144.stdout:(109/120): python3-pyasn1-modules-0.3.7-6.el8.n 3.4 MB/s | 110 kB 00:00 2023-10-08T16:02:51.975 INFO:teuthology.orchestra.run.smithi144.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-08T16:02:51.998 INFO:teuthology.orchestra.run.smithi144.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 14 MB/s | 353 kB 00:00 2023-10-08T16:02:52.073 INFO:teuthology.orchestra.run.smithi144.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 204 kB/s | 20 kB 00:00 2023-10-08T16:02:52.156 INFO:teuthology.orchestra.run.smithi060.stdout:(97/120): ceph-test-17.2.6-1320.g08cac018.el8.x 3.0 MB/s | 52 MB 00:17 2023-10-08T16:02:52.157 INFO:teuthology.orchestra.run.smithi144.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-08T16:02:52.165 INFO:teuthology.orchestra.run.smithi060.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 1.0 MB/s | 457 kB 00:00 2023-10-08T16:02:52.207 INFO:teuthology.orchestra.run.smithi060.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 939 kB/s | 39 kB 00:00 2023-10-08T16:02:52.218 INFO:teuthology.orchestra.run.smithi144.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 373 kB/s | 54 kB 00:00 2023-10-08T16:02:52.311 INFO:teuthology.orchestra.run.smithi060.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 20 MB/s | 15 MB 00:00 2023-10-08T16:02:52.324 INFO:teuthology.orchestra.run.smithi144.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 28 MB/s | 4.7 MB 00:00 2023-10-08T16:02:52.383 INFO:teuthology.orchestra.run.smithi060.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-10-08T16:02:52.392 INFO:teuthology.orchestra.run.smithi060.stdout:(102/120): bison-3.0.4-10.el8.x86_64.rpm 3.6 MB/s | 688 kB 00:00 2023-10-08T16:02:52.418 INFO:teuthology.orchestra.run.smithi144.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 23 MB/s | 4.6 MB 00:00 2023-10-08T16:02:52.451 INFO:teuthology.orchestra.run.smithi060.stdout:(103/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-10-08T16:02:52.458 INFO:teuthology.orchestra.run.smithi144.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-10-08T16:02:52.521 INFO:teuthology.orchestra.run.smithi060.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 981 kB/s | 126 kB 00:00 2023-10-08T16:02:52.524 INFO:teuthology.orchestra.run.smithi060.stdout:(105/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-10-08T16:02:52.649 INFO:teuthology.orchestra.run.smithi060.stdout:(106/120): python3-numpy-1.14.3-9.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2023-10-08T16:02:52.652 INFO:teuthology.orchestra.run.smithi060.stdout:(107/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-10-08T16:02:52.662 INFO:teuthology.orchestra.run.smithi060.stdout:(108/120): python3-jinja2-2.10.1-2.el8_0.noarch 3.8 MB/s | 538 kB 00:00 2023-10-08T16:02:52.754 INFO:teuthology.orchestra.run.smithi060.stdout:(109/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.8 MB/s | 302 kB 00:00 2023-10-08T16:02:52.794 INFO:teuthology.orchestra.run.smithi060.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-10-08T16:02:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 661 kB/s | 110 kB 00:00 2023-10-08T16:02:52.880 INFO:teuthology.orchestra.run.smithi060.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 2.8 MB/s | 353 kB 00:00 2023-10-08T16:02:52.902 INFO:teuthology.orchestra.run.smithi060.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 186 kB/s | 20 kB 00:00 2023-10-08T16:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 8.8 MB/s | 709 kB 00:00 2023-10-08T16:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2023-10-08T16:02:52.968 INFO:teuthology.orchestra.run.smithi060.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2023-10-08T16:02:52.998 INFO:teuthology.orchestra.run.smithi060.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 49 MB/s | 4.7 MB 00:00 2023-10-08T16:02:53.058 INFO:teuthology.orchestra.run.smithi060.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 31 MB/s | 4.6 MB 00:00 2023-10-08T16:02:54.069 INFO:teuthology.orchestra.run.smithi144.stdout:(118/120): librados2-17.2.6-1320.g08cac018.el8. 2.1 MB/s | 3.5 MB 00:01 2023-10-08T16:02:54.771 INFO:teuthology.orchestra.run.smithi060.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 1.9 MB/s | 3.5 MB 00:01 2023-10-08T16:02:54.839 INFO:teuthology.orchestra.run.smithi144.stdout:(119/120): librbd1-17.2.6-1320.g08cac018.el8.x8 1.5 MB/s | 3.6 MB 00:02 2023-10-08T16:02:55.649 INFO:teuthology.orchestra.run.smithi060.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 1.4 MB/s | 3.6 MB 00:02 2023-10-08T16:02:55.653 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-08T16:02:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:Total 5.5 MB/s | 202 MB 00:36 2023-10-08T16:02:55.713 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-08T16:02:55.841 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-08T16:02:55.842 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-08T16:02:57.560 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-08T16:02:57.565 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-08T16:03:02.430 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-08T16:03:02.674 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T16:03:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T16:03:03.005 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T16:03:03.216 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T16:03:03.608 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T16:03:03.875 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:03:04.334 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:03:04.574 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:03:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:03:04.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:03:05.059 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:03:05.272 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:03:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T16:03:06.335 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T16:03:06.533 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 1.9 MB/s | 52 MB 00:26 2023-10-08T16:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-10-08T16:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout:Total 4.2 MB/s | 202 MB 00:47 2023-10-08T16:03:06.636 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:03:06.670 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-10-08T16:03:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-10-08T16:03:06.787 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-10-08T16:03:06.896 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T16:03:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T16:03:07.291 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:03:07.427 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:03:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:03:07.704 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:03:07.914 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T16:03:08.177 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T16:03:08.403 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T16:03:08.491 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-10-08T16:03:08.495 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-10-08T16:03:08.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T16:03:08.749 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T16:03:08.885 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T16:03:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T16:03:09.655 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T16:03:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T16:03:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T16:03:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T16:03:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T16:03:11.662 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T16:03:11.939 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T16:03:12.222 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T16:03:12.422 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T16:03:12.593 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T16:03:12.863 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T16:03:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-10-08T16:03:13.098 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T16:03:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T16:03:13.397 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T16:03:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T16:03:13.542 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T16:03:13.606 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T16:03:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T16:03:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T16:03:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:03:14.776 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:03:15.000 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:03:15.129 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:03:15.383 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:03:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:03:15.680 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:03:15.795 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T16:03:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T16:03:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T16:03:16.670 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T16:03:16.808 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:03:16.921 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:03:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T16:03:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T16:03:17.340 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T16:03:17.549 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:03:17.603 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T16:03:17.657 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:03:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:03:17.896 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T16:03:17.926 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:03:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T16:03:18.165 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T16:03:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T16:03:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T16:03:18.604 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T16:03:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T16:03:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T16:03:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T16:03:18.882 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T16:03:19.019 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T16:03:19.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T16:03:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T16:03:19.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T16:03:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T16:03:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T16:03:19.816 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T16:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T16:03:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T16:03:20.181 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T16:03:20.260 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T16:03:20.419 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T16:03:20.457 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T16:03:20.607 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T16:03:20.643 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T16:03:20.810 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T16:03:21.003 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T16:03:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T16:03:21.315 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T16:03:21.342 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T16:03:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T16:03:21.569 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T16:03:21.750 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T16:03:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T16:03:21.903 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T16:03:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T16:03:22.263 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T16:03:22.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T16:03:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T16:03:22.527 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T16:03:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T16:03:22.776 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T16:03:22.930 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T16:03:23.052 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T16:03:23.181 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T16:03:23.240 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T16:03:23.431 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T16:03:23.445 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T16:03:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T16:03:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T16:03:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T16:03:24.400 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T16:03:24.602 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T16:03:24.814 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T16:03:25.024 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T16:03:25.248 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T16:03:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T16:03:25.493 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T16:03:25.663 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T16:03:25.863 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T16:03:26.363 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T16:03:26.611 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T16:03:26.863 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T16:03:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T16:03:27.161 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T16:03:27.220 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T16:03:27.422 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T16:03:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T16:03:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T16:03:27.695 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T16:03:27.888 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T16:03:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T16:03:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T16:03:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T16:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T16:03:28.830 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T16:03:29.013 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T16:03:29.118 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T16:03:29.202 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T16:03:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T16:03:29.464 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T16:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T16:03:29.674 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T16:03:29.733 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T16:03:29.855 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T16:03:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T16:03:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T16:03:30.212 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T16:03:30.391 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T16:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T16:03:30.573 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T16:03:30.716 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T16:03:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T16:03:30.858 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T16:03:31.040 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T16:03:31.052 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T16:03:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T16:03:31.232 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T16:03:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T16:03:31.527 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T16:03:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T16:03:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T16:03:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T16:03:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T16:03:32.626 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T16:03:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T16:03:33.121 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T16:03:33.320 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T16:03:33.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T16:03:33.633 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T16:03:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T16:03:34.000 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T16:03:34.190 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T16:03:34.391 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T16:03:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T16:03:34.766 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T16:03:35.016 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T16:03:35.226 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T16:03:35.507 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T16:03:35.728 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T16:03:35.945 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T16:03:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T16:03:36.920 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:03:37.313 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:03:37.327 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T16:03:37.644 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T16:03:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T16:03:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:03:38.229 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:03:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T16:03:38.322 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:03:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T16:03:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:03:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T16:03:39.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T16:03:39.263 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T16:03:39.554 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T16:03:44.697 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:03:45.370 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:03:45.955 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:03:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:03:46.324 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:03:46.469 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:03:57.070 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:03:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /run 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-08T16:03:57.071 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:03:57.459 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:03:59.038 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:03:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:03:59.469 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:03:59.633 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:04:00.047 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:04:00.184 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:04:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:04:03.539 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:04:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:04:03.957 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T16:04:04.122 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T16:04:04.333 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-10-08T16:04:04.407 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-10-08T16:04:04.408 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-10-08T16:04:04.408 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-08T16:04:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:04.560 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:04:04.774 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:04:04.792 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:04:05.823 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:04:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:04:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:04:06.269 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:04:06.425 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:04:06.506 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T16:04:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:04:06.717 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:04:06.758 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:04:06.832 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:04:06.966 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:04:06.978 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:04:07.220 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:04:07.407 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:04:07.424 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:04:08.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T16:04:08.952 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:04:09.034 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:04:09.208 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:04:09.254 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:04:09.417 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:04:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:04:09.950 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:04:10.262 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:04:10.453 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:04:10.613 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T16:04:10.813 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T16:04:10.998 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:04:11.213 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:04:11.432 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:04:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:04:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:04:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:04:13.054 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T16:04:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:04:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:04:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:04:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:04:15.082 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T16:04:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:04:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:04:15.414 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:04:15.565 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:04:15.607 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:04:15.806 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:04:16.154 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:04:16.275 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T16:04:16.323 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:04:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T16:04:16.818 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T16:04:17.074 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T16:04:17.265 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T16:04:17.278 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T16:04:17.429 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T16:04:17.604 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T16:04:17.791 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T16:04:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T16:04:18.227 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T16:04:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T16:04:18.489 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T16:04:18.698 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T16:04:18.708 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T16:04:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T16:04:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:04:19.094 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:04:19.094 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T16:04:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T16:04:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T16:04:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T16:04:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T16:04:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T16:04:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T16:04:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T16:04:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T16:04:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T16:04:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T16:04:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T16:04:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T16:04:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T16:04:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T16:04:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T16:04:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T16:04:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T16:04:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T16:04:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T16:04:21.247 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:04:22.229 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T16:04:22.234 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:04:22.234 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:13 ago on Sun 08 Oct 2023 04:02:09 PM UTC. 2023-10-08T16:04:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T16:04:22.749 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T16:04:23.016 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T16:04:23.187 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T16:04:23.199 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T16:04:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T16:04:23.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T16:04:23.696 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T16:04:23.879 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T16:04:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T16:04:24.362 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T16:04:24.429 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T16:04:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T16:04:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T16:04:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-08T16:04:24.764 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T16:04:24.765 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:04:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:24.864 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-10-08T16:04:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: jq-1.5-12.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T16:04:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T16:04:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T16:04:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T16:04:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T16:04:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T16:04:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T16:04:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T16:04:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T16:04:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:24.875 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-08T16:04:24.990 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:04:24.991 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:04:25.146 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:25.885 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T16:04:25.887 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T16:04:25.888 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T16:04:25.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T16:04:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T16:04:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T16:04:25.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T16:04:25.901 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T16:04:25.902 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T16:04:25.903 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T16:04:25.904 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T16:04:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:04:28.051 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:18 ago on Sun 08 Oct 2023 04:02:10 PM UTC. 2023-10-08T16:04:30.110 INFO:teuthology.orchestra.run.smithi144.stdout:Installed products updated. 2023-10-08T16:04:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:30.262 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-10-08T16:04:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.262 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.262 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.263 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.264 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.5-12.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T16:04:30.265 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T16:04:30.266 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T16:04:30.267 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T16:04:30.268 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T16:04:30.269 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T16:04:30.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.271 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T16:04:30.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:30.273 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T16:04:30.578 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:30.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:04:30.722 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T16:04:30.748 INFO:teuthology.orchestra.run.smithi060.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T16:04:30.749 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T16:04:30.749 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T16:04:30.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:04:30.900 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T16:04:30.921 INFO:teuthology.orchestra.run.smithi144.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T16:04:30.921 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T16:04:30.921 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T16:04:30.921 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T16:04:30.922 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:30.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:04:30.969 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:30.969 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:04:31.007 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T16:04:31.007 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:31.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:04:31.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:04:31.104 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:31.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:04:31.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:04:31.193 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T16:04:31.193 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:31.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:04:31.221 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:04:31.288 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:31.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:04:31.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:04:31.376 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T16:04:31.376 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:31.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:04:31.402 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:04:31.468 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:31.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:04:31.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:04:31.555 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T16:04:31.613 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T16:04:31.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2023-10-08T16:04:31.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-10-08T16:04:31.639 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T16:04:31.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:04:31.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:04:31.705 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T16:04:31.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:04:31.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:04:31.776 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T16:04:31.776 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T16:04:31.776 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T16:04:31.776 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:31.776 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:04:31.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:31.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:31.961 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:31.962 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:04:31.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:32.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:32.117 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T16:04:32.117 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T16:04:32.117 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7418296', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006', 'targets': {'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPT663e9x64MqPNsDtBIeP4pQjApomtwEAEDjcOwK6uzLr+9Y8osJxUM98XN81R6pXv0j9ra7FxlKOo3luZSai0=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEUWLvO62dedOFoii/ylNqnMTpBeEXAKNz0y5yCs41erjFIXclQ94mg22jEaSKcbi8TdFd/3tQSo5CWFOrWkaQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-08_15:41:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T16:04:32.118 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:04:32.120 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:04:32.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:04:32.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:04:32.230 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:32.230 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:04:32.255 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:04:32.255 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-10-08T16:04:32.310 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:04:32.310 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:32.310 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 220447 Links: 1 2023-10-08T16:04:32.310 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:32.311 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:32.311 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 16:04:19.552331060 +0000 2023-10-08T16:04:32.311 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 16:01:22.523690305 +0000 2023-10-08T16:04:32.311 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 16:01:22.523690305 +0000 2023-10-08T16:04:32.311 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T16:04:32.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:04:32.374 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T16:04:32.374 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T16:04:32.374 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000112468 s, 4.6 MB/s 2023-10-08T16:04:32.375 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:04:32.431 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 218747 Links: 1 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 16:04:19.552331060 +0000 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 16:01:23.020685630 +0000 2023-10-08T16:04:32.486 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 16:01:23.020685630 +0000 2023-10-08T16:04:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T16:04:32.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:04:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T16:04:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T16:04:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000114047 s, 4.5 MB/s 2023-10-08T16:04:32.551 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:04:32.606 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-10-08T16:04:32.661 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:04:32.661 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:32.661 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 217458 Links: 1 2023-10-08T16:04:32.661 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:32.661 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:32.662 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 16:04:19.552331060 +0000 2023-10-08T16:04:32.662 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 16:01:23.513680993 +0000 2023-10-08T16:04:32.662 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 16:01:23.513680993 +0000 2023-10-08T16:04:32.662 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T16:04:32.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:04:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T16:04:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T16:04:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00011135 s, 4.6 MB/s 2023-10-08T16:04:32.725 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:04:32.781 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-10-08T16:04:32.837 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:04:32.837 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:32.837 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 223401 Links: 1 2023-10-08T16:04:32.837 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:32.837 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:32.837 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 16:04:19.552331060 +0000 2023-10-08T16:04:32.838 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 16:01:23.998676431 +0000 2023-10-08T16:04:32.838 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 16:01:23.998676431 +0000 2023-10-08T16:04:32.838 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T16:04:32.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:04:32.902 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T16:04:32.902 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T16:04:32.902 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000112715 s, 4.5 MB/s 2023-10-08T16:04:32.903 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:04:32.959 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:32.959 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:32.959 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:04:32.975 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:04:32.975 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-10-08T16:04:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:04:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:33.032 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 221454 Links: 1 2023-10-08T16:04:33.033 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:33.033 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:33.033 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 16:04:25.486985213 +0000 2023-10-08T16:04:33.033 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 16:01:06.441070830 +0000 2023-10-08T16:04:33.033 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 16:01:06.441070830 +0000 2023-10-08T16:04:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T16:04:33.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:04:33.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T16:04:33.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T16:04:33.097 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000281438 s, 1.8 MB/s 2023-10-08T16:04:33.098 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:04:33.155 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-10-08T16:04:33.210 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 218011 Links: 1 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 16:04:25.486985213 +0000 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 16:01:06.948062394 +0000 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 16:01:06.948062394 +0000 2023-10-08T16:04:33.211 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T16:04:33.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:04:33.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T16:04:33.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T16:04:33.275 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000264494 s, 1.9 MB/s 2023-10-08T16:04:33.276 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:04:33.332 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-10-08T16:04:33.387 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:04:33.387 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:33.387 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 222423 Links: 1 2023-10-08T16:04:33.387 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:33.388 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:33.388 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 16:04:25.486985213 +0000 2023-10-08T16:04:33.388 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 16:01:07.424054473 +0000 2023-10-08T16:04:33.388 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 16:01:07.424054473 +0000 2023-10-08T16:04:33.388 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T16:04:33.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:04:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T16:04:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T16:04:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000246632 s, 2.1 MB/s 2023-10-08T16:04:33.451 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:04:33.508 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-10-08T16:04:33.563 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:04:33.563 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:04:33.563 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 223385 Links: 1 2023-10-08T16:04:33.563 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:04:33.563 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:04:33.563 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 16:04:25.486985213 +0000 2023-10-08T16:04:33.564 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 16:01:07.925046134 +0000 2023-10-08T16:04:33.564 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 16:01:07.925046134 +0000 2023-10-08T16:04:33.564 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T16:04:33.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:04:33.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T16:04:33.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T16:04:33.626 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000196387 s, 2.6 MB/s 2023-10-08T16:04:33.627 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:04:33.683 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:33.683 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:04:33.683 INFO:tasks.ceph:Generating config... 2023-10-08T16:04:33.684 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T16:04:33.684 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T16:04:33.684 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T16:04:33.684 INFO:tasks.ceph:[client] pid file = 2023-10-08T16:04:33.684 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T16:04:33.684 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T16:04:33.685 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-08T16:04:33.685 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T16:04:33.685 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T16:04:33.685 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T16:04:33.685 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T16:04:33.685 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-08T16:04:33.686 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T16:04:33.687 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T16:04:33.688 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T16:04:33.688 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-08T16:04:33.688 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-08T16:04:33.688 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-08T16:04:33.688 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T16:04:33.688 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T16:04:33.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T16:04:33.748 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T16:04:33.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T16:04:33.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:04:33.861 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.144'), ('mon.c', '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]')] 2023-10-08T16:04:33.861 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T16:04:33.862 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:33.862 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:04:33.917 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.144 --addv c '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:34.002 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid 3b329f4b-ad99-45f4-afa4-bcf45c7e9d39 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = octopus 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 3b329f4b-ad99-45f4-afa4-bcf45c7e9d39 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2023-10-08T16:04:34.003169+0000 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:created 2023-10-08T16:04:34.003169+0000 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 15 (octopus) 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.b 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2023-10-08T16:04:34.003 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T16:04:34.004 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:04:34.019 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3b329f4b-ad99-45f4-afa4-bcf45c7e9d39... 2023-10-08T16:04:34.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:04:34.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:04:34.104 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2023-10-08T16:04:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2023-10-08T16:04:34.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2023-10-08T16:04:34.107 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on skipped message = False 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 3b329f4b-ad99-45f4-afa4-bcf45c7e9d39 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.108 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2023-10-08T16:04:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2023-10-08T16:04:34.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore allocator = bitmap 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: memstore device bytes = 200000000 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:04:34.111 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 1.0 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: osd mon report interval = 5 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = memstore 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:04:34.112 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2023-10-08T16:04:34.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:04:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull ratio = 0.6 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.7 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.6 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:04:34.115 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = "" 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-10-08T16:04:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug objectcacher = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug objecter = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug objectcacher = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug objecter = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-08T16:04:34.117 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2023-10-08T16:04:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2023-10-08T16:04:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2023-10-08T16:04:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2023-10-08T16:04:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-10-08T16:04:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-10-08T16:04:34.118 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-10-08T16:04:34.119 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-10-08T16:04:34.120 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-10-08T16:04:34.121 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.60,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 3b329f4b-ad99-45f4-afa4-bcf45c7e9d39 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-10-08T16:04:34.123 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-10-08T16:04:34.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2023-10-08T16:04:34.125 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: memstore device bytes = 200000000 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-10-08T16:04:34.126 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 1.0 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: osd mon report interval = 5 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = memstore 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:04:34.127 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-10-08T16:04:34.128 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.129 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull ratio = 0.6 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.7 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.6 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:04:34.130 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-10-08T16:04:34.131 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug objectcacher = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug objecter = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug objectcacher = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug objecter = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2023-10-08T16:04:34.132 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2023-10-08T16:04:34.133 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-10-08T16:04:34.133 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-10-08T16:04:34.133 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-10-08T16:04:34.133 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T16:04:34.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T16:04:34.212 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T16:04:34.212 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:34.212 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T16:04:34.227 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:34.227 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T16:04:34.282 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:04:34.282 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:34.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:04:34.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:04:34.357 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:34.357 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:34.412 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:04:34.412 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:34.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:04:34.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:04:34.446 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:34.446 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:34.501 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T16:04:34.501 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T16:04:34.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:04:34.550 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:04:34.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:04:34.607 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:04:34.610 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T16:04:34.610 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:04:34.659 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:04:34.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T16:04:34.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T16:04:34.776 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T16:04:34.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T16:04:34.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:04:34.851 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:04:34.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T16:04:34.877 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T16:04:34.965 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T16:04:34.967 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T16:04:34.991 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T16:04:34.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T16:04:35.031 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T16:04:35.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T16:04:35.123 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T16:04:35.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T16:04:35.173 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T16:04:35.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T16:04:35.262 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T16:04:35.275 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T16:04:35.275 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:04:35.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T16:04:35.299 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:35.299 INFO:tasks.ceph:role: osd.0 2023-10-08T16:04:35.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:04:35.300 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:35.365 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:35.390 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-08T16:04:35.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-08T16:04:35.391 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T16:04:35.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T16:04:35.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T16:04:35.605 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:35.605 INFO:tasks.ceph:role: osd.1 2023-10-08T16:04:35.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:04:35.605 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:04:35.669 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:35.669 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:35.669 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:35.670 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:35.696 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-08T16:04:35.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-08T16:04:35.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T16:04:35.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T16:04:35.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T16:04:35.910 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:35.910 INFO:tasks.ceph:role: osd.2 2023-10-08T16:04:35.910 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:04:35.910 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:04:35.974 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:35.975 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:35.999 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-08T16:04:36.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-08T16:04:36.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T16:04:36.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T16:04:36.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T16:04:36.213 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:36.213 INFO:tasks.ceph:role: osd.3 2023-10-08T16:04:36.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:04:36.213 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:04:36.277 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:36.277 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:36.277 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:36.278 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:36.302 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-08T16:04:36.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-08T16:04:36.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T16:04:36.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T16:04:36.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.550+0000 7f208654f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T16:04:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.550+0000 7f208654f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T16:04:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.551+0000 7f208654f540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-08T16:04:36.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T16:04:36.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:36.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.661+0000 7fcc72cb4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T16:04:36.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.662+0000 7fcc72cb4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T16:04:36.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.662+0000 7fcc72cb4540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-08T16:04:36.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T16:04:36.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:36.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.814+0000 7fa94df34540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T16:04:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.814+0000 7fa94df34540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T16:04:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.814+0000 7fa94df34540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-08T16:04:36.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T16:04:36.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.966+0000 7fb79dd8c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T16:04:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.966+0000 7fb79dd8c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T16:04:36.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:36.967+0000 7fb79dd8c540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-08T16:04:36.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T16:04:37.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T16:04:37.066 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:37.066 INFO:tasks.ceph:role: osd.4 2023-10-08T16:04:37.066 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:04:37.066 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:37.142 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:37.143 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:37.143 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:37.576 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-08T16:04:37.577 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-08T16:04:37.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T16:04:37.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T16:04:37.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T16:04:37.859 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:37.860 INFO:tasks.ceph:role: osd.5 2023-10-08T16:04:37.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:04:37.860 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:04:37.934 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-08T16:04:37.934 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:37.935 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:37.935 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:37.935 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:38.355 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-08T16:04:38.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-08T16:04:38.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T16:04:38.463 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T16:04:38.494 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T16:04:38.560 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:38.560 INFO:tasks.ceph:role: osd.6 2023-10-08T16:04:38.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:04:38.560 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:04:38.633 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:38.634 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:39.075 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-08T16:04:39.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-08T16:04:39.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T16:04:39.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T16:04:39.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T16:04:39.325 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:04:39.326 INFO:tasks.ceph:role: osd.7 2023-10-08T16:04:39.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:04:39.326 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:04:39.398 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:04:39.398 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:04:39.398 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:04:39.398 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-08T16:04:39.399 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:04:39.399 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:04:39.399 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:04:39.399 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:04:39.399 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:04:39.399 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:04:39.845 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-08T16:04:39.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-08T16:04:39.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T16:04:40.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T16:04:40.052 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.190+0000 7f481d1da540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T16:04:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.190+0000 7f481d1da540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T16:04:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.191+0000 7f481d1da540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-08T16:04:40.201 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T16:04:40.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.306+0000 7f19f0c8c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T16:04:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.307+0000 7f19f0c8c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T16:04:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.307+0000 7f19f0c8c540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-08T16:04:40.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T16:04:40.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:40.457 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.456+0000 7fcd80850540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T16:04:40.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.457+0000 7fcd80850540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T16:04:40.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.457+0000 7fcd80850540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-08T16:04:40.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T16:04:40.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:40.610 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.610+0000 7ff8b630a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T16:04:40.610 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.610+0000 7ff8b630a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T16:04:40.610 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:40.610+0000 7ff8b630a540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-08T16:04:40.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T16:04:40.680 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T16:04:40.680 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:40.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T16:04:40.709 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:40.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T16:04:40.776 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:40.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T16:04:40.844 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:40.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T16:04:40.911 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:40.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T16:04:40.977 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:40.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T16:04:41.043 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:41.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T16:04:41.108 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T16:04:41.133 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T16:04:41.197 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.197 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T16:04:41.261 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T16:04:41.325 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T16:04:41.389 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T16:04:41.453 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T16:04:41.517 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:41.517 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T16:04:41.533 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:41.534 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T16:04:41.590 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.591 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T16:04:41.605 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:41.605 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T16:04:41.659 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T16:04:41.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:04:41.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:04:41.702 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2023-10-08T16:04:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A== 2023-10-08T16:04:41.702 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-10-08T16:04:41.702 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q== 2023-10-08T16:04:41.702 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg== 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow== 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg== 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg== 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q== 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg== 2023-10-08T16:04:41.703 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg== 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw== 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ== 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww== 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg== 2023-10-08T16:04:41.704 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw== 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og== 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout:[client.2] 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA== 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A== 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout:[client.3] 2023-10-08T16:04:41.705 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ== 2023-10-08T16:04:41.721 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2023-10-08T16:04:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A== 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q== 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg== 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow== 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg== 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg== 2023-10-08T16:04:41.722 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q== 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg== 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg== 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw== 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ== 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww== 2023-10-08T16:04:41.723 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg== 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw== 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og== 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2023-10-08T16:04:41.724 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA== 2023-10-08T16:04:41.725 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2023-10-08T16:04:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A== 2023-10-08T16:04:41.725 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2023-10-08T16:04:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ== 2023-10-08T16:04:41.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:04:41.749 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:04:41.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:41.816 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:41.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:41.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:41.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:41.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:41.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:41.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.065 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.114 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:04:42.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:04:42.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:42.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:42.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:42.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:04:42.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.316 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.368 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.415 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:04:42.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:04:42.676 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T16:04:42.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T16:04:42.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:04:42.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T16:04:42.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T16:04:42.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:04:42.933 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T16:04:42.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T16:04:43.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:04:43.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T16:04:43.136 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:43.138 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:04:43.190 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T16:04:43.190 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T16:04:43.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T16:04:43.193 INFO:tasks.ceph.mon.a:Started 2023-10-08T16:04:43.193 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T16:04:43.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T16:04:43.232 INFO:tasks.ceph.mon.b:Started 2023-10-08T16:04:43.233 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T16:04:43.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T16:04:43.235 INFO:tasks.ceph.mon.c:Started 2023-10-08T16:04:43.235 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T16:04:43.235 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T16:04:43.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T16:04:43.237 INFO:tasks.ceph.mgr.y:Started 2023-10-08T16:04:43.237 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T16:04:43.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T16:04:43.239 INFO:tasks.ceph.mgr.x:Started 2023-10-08T16:04:43.240 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T16:04:43.240 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T16:04:43.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.358+0000 7f231f15e700 1 Processor -- start 2023-10-08T16:04:43.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.358+0000 7f231f15e700 1 -- start start 2023-10-08T16:04:43.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.358+0000 7f231f15e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 0x7f231815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231f15e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231815ea90 con 0x7f23180697c0 2023-10-08T16:04:43.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231f15e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180b3100 con 0x7f231815a230 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231f15e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180d1cf0 con 0x7f2318159e60 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231d6fb700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f23180697c0 0x7f23180af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42382/0 (socket says 172.21.15.60:42382) 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231d6fb700 1 -- 172.21.15.60:0/2013203756 learned_addr learned my addr 172.21.15.60:0/2013203756 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231cefa700 1 --2- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 0x7f231815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231cefa700 1 -- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 msgr2=0x7f231815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231cefa700 1 -- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 msgr2=0x7f231815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231cefa700 1 --2- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 0x7f231815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:04:43.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.359+0000 7f231cefa700 1 --2- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 0x7f231815e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:04:43.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134583047 0 0) 0x7f231815ea90 con 0x7f23180697c0 2023-10-08T16:04:43.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2300003570 con 0x7f23180697c0 2023-10-08T16:04:43.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451569148 0 0) 0x7f23180b3100 con 0x7f231815a230 2023-10-08T16:04:43.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231815ea90 con 0x7f231815a230 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637295319 0 0) 0x7f231815ea90 con 0x7f231815a230 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 msgr2=0x7f231815e550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 --2- 172.21.15.60:0/2013203756 >> v2:172.21.15.144:3300/0 conn(0x7f2318159e60 0x7f231815e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.540+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 >> v1:172.21.15.60:6789/0 conn(0x7f23180697c0 legacy=0x7f23180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180d10e0 con 0x7f231815a230 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.1 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f230c001470 con 0x7f231815a230 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 >> v1:172.21.15.144:6789/0 conn(0x7f231815a230 legacy=0x7f23180690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2300003c40 0x7f2300004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2300004810 0x7f2300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000052e0 0x7f230000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180d1cf0 con 0x7f23000052e0 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230000c1b0 con 0x7f2300003c40 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230000c370 con 0x7f2300004810 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231cefa700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2300003c40 0x7f2300004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f2317fff700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2300004810 0x7f2300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000052e0 0x7f230000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 -- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2300004810 msgr2=0x7f2300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2300004810 0x7f2300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 -- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2300003c40 msgr2=0x7f2300004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2300003c40 0x7f2300004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 -- 172.21.15.60:0/2013203756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231815ea90 con 0x7f23000052e0 2023-10-08T16:04:43.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231cefa700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2300003c40 0x7f2300004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:43.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 -- 172.21.15.60:0/2013203756 reap_dead start 2023-10-08T16:04:43.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f2317fff700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2300004810 0x7f2300004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:43.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.541+0000 7f231d6fb700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000052e0 0x7f230000ba60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23180b6c10 tx=0x7f2310001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af7b4044cb91696 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:43.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000ccb0 con 0x7f23000052e0 2023-10-08T16:04:43.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000ce10 con 0x7f23000052e0 2023-10-08T16:04:43.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f23177fe700 1 -- 172.21.15.60:0/2013203756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310007320 con 0x7f23000052e0 2023-10-08T16:04:43.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f231f15e700 1 -- 172.21.15.60:0/2013203756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000052e0 msgr2=0x7f230000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:43.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f231f15e700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000052e0 0x7f230000ba60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23180b6c10 tx=0x7f2310001bd0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f231f15e700 1 -- 172.21.15.60:0/2013203756 shutdown_connections 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f231f15e700 1 --2- 172.21.15.60:0/2013203756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000052e0 0x7f230000ba60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.543+0000 7f231f15e700 1 -- 172.21.15.60:0/2013203756 >> 172.21.15.60:0/2013203756 conn(0x7f2318070700 msgr2=0x7f2318070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.544+0000 7f231f15e700 1 -- 172.21.15.60:0/2013203756 shutdown_connections 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.544+0000 7f231f15e700 1 -- 172.21.15.60:0/2013203756 wait complete. 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.545+0000 7f231f15e700 1 Processor -- start 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.545+0000 7f231f15e700 1 -- start start 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231f15e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23000052e0 0x7f23180c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231f15e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 0x7f23181468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231f15e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2318146df0 0x7f231816dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:43.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231f15e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c5390 con 0x7f23180c7960 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231f15e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181587f0 con 0x7f2318146df0 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231f15e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231816e690 con 0x7f23000052e0 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f2317fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 0x7f23181468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231cefa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23000052e0 0x7f23180c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f2317fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 0x7f23181468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54994/0 (socket says 172.21.15.60:54994) 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f2317fff700 1 -- 172.21.15.60:0/923020892 learned_addr learned my addr 172.21.15.60:0/923020892 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231cefa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23000052e0 0x7f23180c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:42458/0 (socket says 172.21.15.60:42458) 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.546+0000 7f231d6fb700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2318146df0 0x7f231816dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2317fff700 1 -- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23000052e0 msgr2=0x7f23180c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2317fff700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23000052e0 0x7f23180c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2317fff700 1 -- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2318146df0 msgr2=0x7f231816dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2317fff700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2318146df0 0x7f231816dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2317fff700 1 -- 172.21.15.60:0/923020892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231816e970 con 0x7f23180c7960 2023-10-08T16:04:43.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2317fff700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 0x7f23181468b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f230c00ffd0 tx=0x7f23180cbca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:43.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00d850 con 0x7f23180c7960 2023-10-08T16:04:43.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c00d9b0 con 0x7f23180c7960 2023-10-08T16:04:43.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00dd50 con 0x7f23180c7960 2023-10-08T16:04:43.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23180c6940 con 0x7f23180c7960 2023-10-08T16:04:43.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.547+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23180c6f80 con 0x7f23180c7960 2023-10-08T16:04:43.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.548+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f230c014900 con 0x7f23180c7960 2023-10-08T16:04:43.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.548+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f230c01d8d0 con 0x7f23180c7960 2023-10-08T16:04:43.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.548+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180c7110 con 0x7f23180c7960 2023-10-08T16:04:43.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.551+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f230c03c6d0 con 0x7f23180c7960 2023-10-08T16:04:43.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.626+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f231804c3c0 con 0x7f23180c7960 2023-10-08T16:04:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.628+0000 7f2314ff9700 1 -- 172.21.15.60:0/923020892 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f230c02b020 con 0x7f23180c7960 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 msgr2=0x7f23181468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 0x7f23181468b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f230c00ffd0 tx=0x7f23180cbca0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 shutdown_connections 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23000052e0 0x7f23180c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2318146df0 0x7f231816dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 --2- 172.21.15.60:0/923020892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180c7960 0x7f23181468b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:43.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 >> 172.21.15.60:0/923020892 conn(0x7f2318070700 msgr2=0x7f23180690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:43.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.629+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 shutdown_connections 2023-10-08T16:04:43.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:43.630+0000 7f231f15e700 1 -- 172.21.15.60:0/923020892 wait complete. 2023-10-08T16:04:43.631 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2023-10-08T16:04:43.642 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T16:04:43.642 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:43.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T16:04:43.667 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:43.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T16:04:43.732 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:43.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T16:04:43.797 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T16:04:43.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T16:04:43.863 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:43.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T16:04:43.888 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:43.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T16:04:43.952 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:43.952 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T16:04:44.016 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T16:04:44.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T16:04:44.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-08T16:04:44.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.237+0000 7f9d6517d700 1 Processor -- start 2023-10-08T16:04:44.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.237+0000 7f9d6517d700 1 -- start start 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d6517d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 0x7f9d6015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d6517d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d600cbf10 0x7f9d6015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d6517d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600cae70 con 0x7f9d600c9390 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d6517d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600cb150 con 0x7f9d600cbf10 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d6517d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600cb430 con 0x7f9d600678b0 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 0x7f9d6015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 0x7f9d6015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58746/0 (socket says 172.21.15.144:58746) 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 -- 172.21.15.144:0/1278003722 learned_addr learned my addr 172.21.15.144:0/1278003722 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5f59e700 1 --1- 172.21.15.144:0/1278003722 >> v1:172.21.15.144:6789/0 conn(0x7f9d600c9390 0x7f9d6006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54354/0 (socket says 172.21.15.144:54354) 2023-10-08T16:04:44.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 -- 172.21.15.144:0/1278003722 >> v2:172.21.15.60:3300/0 conn(0x7f9d600cbf10 msgr2=0x7f9d6015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 --2- 172.21.15.144:0/1278003722 >> v2:172.21.15.60:3300/0 conn(0x7f9d600cbf10 0x7f9d6015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5dd9b700 1 -- 172.21.15.144:0/1278003722 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837324039 0 0) 0x7f9d600cae70 con 0x7f9d600c9390 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 -- 172.21.15.144:0/1278003722 >> v1:172.21.15.144:6789/0 conn(0x7f9d600c9390 legacy=0x7f9d6006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 -- 172.21.15.144:0/1278003722 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600cb710 con 0x7f9d600678b0 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.238+0000 7f9d5ed9d700 1 --2- 172.21.15.144:0/1278003722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 0x7f9d6015db80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d540099b0 tx=0x7f9d54009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2079a1ab20e3e10a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d5dd9b700 1 -- 172.21.15.144:0/1278003722 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400b860 con 0x7f9d600678b0 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d5dd9b700 1 -- 172.21.15.144:0/1278003722 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400b9c0 con 0x7f9d600678b0 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d5dd9b700 1 -- 172.21.15.144:0/1278003722 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400bd60 con 0x7f9d600678b0 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 -- 172.21.15.144:0/1278003722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 msgr2=0x7f9d6015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1278003722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 0x7f9d6015db80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d540099b0 tx=0x7f9d54009250 comp rx=0 tx=0).stop 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 -- 172.21.15.144:0/1278003722 shutdown_connections 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1278003722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600678b0 0x7f9d6015db80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1278003722 >> v2:172.21.15.60:3300/0 conn(0x7f9d600cbf10 0x7f9d6015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 -- 172.21.15.144:0/1278003722 >> 172.21.15.144:0/1278003722 conn(0x7f9d60069870 msgr2=0x7f9d60069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 -- 172.21.15.144:0/1278003722 shutdown_connections 2023-10-08T16:04:44.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.239+0000 7f9d6517d700 1 -- 172.21.15.144:0/1278003722 wait complete. 2023-10-08T16:04:44.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 Processor -- start 2023-10-08T16:04:44.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 -- start start 2023-10-08T16:04:44.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d600678b0 0x7f9d6015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 0x7f9d6016ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600cbf10 0x7f9d6016e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015ee90 con 0x7f9d600678b0 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015e210 con 0x7f9d600cbf10 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d6517d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015e4f0 con 0x7f9d600c9390 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d5e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 0x7f9d6016ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d5e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 0x7f9d6016ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58750/0 (socket says 172.21.15.144:58750) 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d5e59c700 1 -- 172.21.15.144:0/1705492523 learned_addr learned my addr 172.21.15.144:0/1705492523 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d5f59e700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600cbf10 0x7f9d6016e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.241+0000 7f9d5ed9d700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d600678b0 0x7f9d6015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d5e59c700 1 -- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600cbf10 msgr2=0x7f9d6016e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d5e59c700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600cbf10 0x7f9d6016e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d5e59c700 1 -- 172.21.15.144:0/1705492523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d600678b0 msgr2=0x7f9d6015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d5e59c700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d600678b0 0x7f9d6015d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d5e59c700 1 -- 172.21.15.144:0/1705492523 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540094f0 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d5e59c700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 0x7f9d6016ddb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b810 tx=0x7f9d500091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000f510 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5000f670 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000fa30 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6015e7d0 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6015d690 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9d5001a400 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.242+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9d50011750 con 0x7f9d600c9390 2023-10-08T16:04:44.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.243+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6015efd0 con 0x7f9d600c9390 2023-10-08T16:04:44.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.245+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9d6015efd0 con 0x7f9d600c9390 2023-10-08T16:04:44.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.327+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f9d600b4830 con 0x7f9d600c9390 2023-10-08T16:04:44.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.330+0000 7f9d46ffd700 1 -- 172.21.15.144:0/1705492523 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d500290b0 con 0x7f9d600c9390 2023-10-08T16:04:44.331 INFO:teuthology.orchestra.run.smithi144.stdout:0 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 msgr2=0x7f9d6016ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 0x7f9d6016ddb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b810 tx=0x7f9d500091d0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 shutdown_connections 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600cbf10 0x7f9d6016e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d600678b0 0x7f9d6015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 --2- 172.21.15.144:0/1705492523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d600c9390 0x7f9d6016ddb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 >> 172.21.15.144:0/1705492523 conn(0x7f9d60069870 msgr2=0x7f9d6006d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 shutdown_connections 2023-10-08T16:04:44.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.331+0000 7f9d6517d700 1 -- 172.21.15.144:0/1705492523 wait complete. 2023-10-08T16:04:44.343 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-08T16:04:44.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.458+0000 7f74337a2700 1 Processor -- start 2023-10-08T16:04:44.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.458+0000 7f74337a2700 1 -- start start 2023-10-08T16:04:44.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f74337a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 0x7f742c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f74337a2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f742c06da60 0x7f742c15e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f74337a2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c15a250 con 0x7f742c0cdf70 2023-10-08T16:04:44.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f74337a2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c0cbfd0 con 0x7f742c06da60 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f74337a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15e940 con 0x7f742c06d690 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f743153e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 0x7f742c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f742c06da60 0x7f742c15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f742c06da60 0x7f742c15e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53718/0 (socket says 172.21.15.144:53718) 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f743153e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 0x7f742c067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58756/0 (socket says 172.21.15.144:58756) 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 -- 172.21.15.144:0/1914299567 learned_addr learned my addr 172.21.15.144:0/1914299567 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 -- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 msgr2=0x7f742c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 --2- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 0x7f742c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 -- 172.21.15.144:0/1914299567 >> v1:172.21.15.144:6789/0 conn(0x7f742c0cdf70 legacy=0x7f742c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f7430d3d700 1 -- 172.21.15.144:0/1914299567 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c067c40 con 0x7f742c06da60 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.459+0000 7f743153e700 1 --2- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 0x7f742c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:44.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f7430d3d700 1 --2- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c06da60 0x7f742c15e400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74280099b0 tx=0x7f7428009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab311d619e3e1f79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f7423fff700 1 -- 172.21.15.144:0/1914299567 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428009ea0 con 0x7f742c06da60 2023-10-08T16:04:44.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f7423fff700 1 -- 172.21.15.144:0/1914299567 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800b860 con 0x7f742c06da60 2023-10-08T16:04:44.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f7423fff700 1 -- 172.21.15.144:0/1914299567 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800bc00 con 0x7f742c06da60 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 -- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c06da60 msgr2=0x7f742c15e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 --2- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c06da60 0x7f742c15e400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74280099b0 tx=0x7f7428009250 comp rx=0 tx=0).stop 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 -- 172.21.15.144:0/1914299567 shutdown_connections 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 --2- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c06d690 0x7f742c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 --2- 172.21.15.144:0/1914299567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c06da60 0x7f742c15e400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 -- 172.21.15.144:0/1914299567 >> 172.21.15.144:0/1914299567 conn(0x7f742c069870 msgr2=0x7f742c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.460+0000 7f74337a2700 1 -- 172.21.15.144:0/1914299567 shutdown_connections 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.461+0000 7f74337a2700 1 -- 172.21.15.144:0/1914299567 wait complete. 2023-10-08T16:04:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 Processor -- start 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 -- start start 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f742c06d690 0x7f742c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 0x7f742c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c15bba0 0x7f742c15c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c16a990 con 0x7f742c06d690 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0b3da0 con 0x7f742c15bba0 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.462+0000 7f74337a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15c1d0 con 0x7f742c0cdf70 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 0x7f742c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 0x7f742c15b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58764/0 (socket says 172.21.15.144:58764) 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 -- 172.21.15.144:0/3317420668 learned_addr learned my addr 172.21.15.144:0/3317420668 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7431d3f700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c15bba0 0x7f742c15c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f743153e700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f742c06d690 0x7f742c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 -- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c15bba0 msgr2=0x7f742c15c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c15bba0 0x7f742c15c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 -- 172.21.15.144:0/3317420668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f742c06d690 msgr2=0x7f742c14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f742c06d690 0x7f742c14f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 -- 172.21.15.144:0/3317420668 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c009420 con 0x7f742c0cdf70 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7431d3f700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c15bba0 0x7f742c15c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f7430d3d700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 0x7f742c15b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7428006fd0 tx=0x7f7428017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800bbe0 con 0x7f742c0cdf70 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428000c90 con 0x7f742c0cdf70 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74280094f0 con 0x7f742c0cdf70 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428011650 con 0x7f742c0cdf70 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c0b3470 con 0x7f742c0cdf70 2023-10-08T16:04:44.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7428011c80 con 0x7f742c0cdf70 2023-10-08T16:04:44.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.463+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f742802ecb0 con 0x7f742c0cdf70 2023-10-08T16:04:44.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.464+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c15bfa0 con 0x7f742c0cdf70 2023-10-08T16:04:44.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.468+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7428033060 con 0x7f742c0cdf70 2023-10-08T16:04:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.552+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f742c0b0ae0 con 0x7f742c0cdf70 2023-10-08T16:04:44.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.554+0000 7f74217fa700 1 -- 172.21.15.144:0/3317420668 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f742803c0b0 con 0x7f742c0cdf70 2023-10-08T16:04:44.555 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:04:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 msgr2=0x7f742c15b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 0x7f742c15b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7428006fd0 tx=0x7f7428017000 comp rx=0 tx=0).stop 2023-10-08T16:04:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 shutdown_connections 2023-10-08T16:04:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f742c15bba0 0x7f742c15c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f742c06d690 0x7f742c14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 --2- 172.21.15.144:0/3317420668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f742c0cdf70 0x7f742c15b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.555+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 >> 172.21.15.144:0/3317420668 conn(0x7f742c069870 msgr2=0x7f742c069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.556+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 shutdown_connections 2023-10-08T16:04:44.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.556+0000 7f74337a2700 1 -- 172.21.15.144:0/3317420668 wait complete. 2023-10-08T16:04:44.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-08T16:04:44.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.684+0000 7fb2fde68700 1 Processor -- start 2023-10-08T16:04:44.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.684+0000 7fb2fde68700 1 -- start start 2023-10-08T16:04:44.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2fde68700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb2f80cc2e0 0x7fb2f806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2fde68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f806f890 0x7fb2f80aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2fde68700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f806e5e0 con 0x7fb2f80cc6b0 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2fde68700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f806efb0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2fde68700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f806d9d0 con 0x7fb2f806f890 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb2f80cc2e0 0x7fb2f806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f806f890 0x7fb2f80aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb2f80cc2e0 0x7fb2f806ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53740/0 (socket says 172.21.15.144:53740) 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 -- 172.21.15.144:0/925769243 learned_addr learned my addr 172.21.15.144:0/925769243 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 -- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f806f890 msgr2=0x7fb2f80aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 --2- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f806f890 0x7fb2f80aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 -- 172.21.15.144:0/925769243 >> v1:172.21.15.60:6789/0 conn(0x7fb2f80cc6b0 legacy=0x7fb2f806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f77fe700 1 -- 172.21.15.144:0/925769243 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f806dcb0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.685+0000 7fb2f7fff700 1 --2- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f806f890 0x7fb2f80aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2f77fe700 1 --2- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f806ea70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80099b0 tx=0x7fb2e8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b28e9274922f96e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2f6ffd700 1 -- 172.21.15.144:0/925769243 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8009ea0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2f6ffd700 1 -- 172.21.15.144:0/925769243 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800b860 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2f6ffd700 1 -- 172.21.15.144:0/925769243 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800bc00 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2fde68700 1 -- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 msgr2=0x7fb2f806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2fde68700 1 --2- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f806ea70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80099b0 tx=0x7fb2e8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2fde68700 1 -- 172.21.15.144:0/925769243 shutdown_connections 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2fde68700 1 --2- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f806f890 0x7fb2f80aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2fde68700 1 --2- 172.21.15.144:0/925769243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f806ea70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.686+0000 7fb2fde68700 1 -- 172.21.15.144:0/925769243 >> 172.21.15.144:0/925769243 conn(0x7fb2f8068170 msgr2=0x7fb2f80cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.687+0000 7fb2fde68700 1 -- 172.21.15.144:0/925769243 shutdown_connections 2023-10-08T16:04:44.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.687+0000 7fb2fde68700 1 -- 172.21.15.144:0/925769243 wait complete. 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 Processor -- start 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 -- start start 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f806f890 0x7fb2f8098410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f80c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f80cc6b0 0x7fb2f81558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80c87f0 con 0x7fb2f806f890 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8098950 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2fde68700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80c8e70 con 0x7fb2f80cc6b0 2023-10-08T16:04:44.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2effff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f80c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f80cc6b0 0x7fb2f81558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2effff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f80c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53742/0 (socket says 172.21.15.144:53742) 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f80cc6b0 0x7fb2f81558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58772/0 (socket says 172.21.15.144:58772) 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2effff700 1 -- 172.21.15.144:0/670869216 learned_addr learned my addr 172.21.15.144:0/670869216 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.688+0000 7fb2f77fe700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f806f890 0x7fb2f8098410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2effff700 1 -- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f80cc6b0 msgr2=0x7fb2f81558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2effff700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f80cc6b0 0x7fb2f81558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2effff700 1 -- 172.21.15.144:0/670869216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f806f890 msgr2=0x7fb2f8098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2effff700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f806f890 0x7fb2f8098410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2effff700 1 -- 172.21.15.144:0/670869216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0009a20 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2effff700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f80c63d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000c590 tx=0x7fb2e0007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0011590 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e0011710 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0011ad0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e80094f0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f80c7d20 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb2e0006aa0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.689+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fb2e00075e0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.690+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f804c3c0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.692+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb2e0017070 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.726 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:44.725+0000 7f557783c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:04:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.775+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7fb2f806df90 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.778+0000 7fb2ef7fe700 1 -- 172.21.15.144:0/670869216 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb2e00071b0 con 0x7fb2f80cc2e0 2023-10-08T16:04:44.779 INFO:teuthology.orchestra.run.smithi144.stdout:2 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 msgr2=0x7fb2f80c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f80c63d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000c590 tx=0x7fb2e0007f50 comp rx=0 tx=0).stop 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 shutdown_connections 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2f80cc6b0 0x7fb2f81558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f806f890 0x7fb2f8098410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 --2- 172.21.15.144:0/670869216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2f80cc2e0 0x7fb2f80c63d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 >> 172.21.15.144:0/670869216 conn(0x7fb2f8068170 msgr2=0x7fb2f806b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 shutdown_connections 2023-10-08T16:04:44.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.779+0000 7fb2fde68700 1 -- 172.21.15.144:0/670869216 wait complete. 2023-10-08T16:04:44.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-08T16:04:44.865 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:44.864+0000 7f557783c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:04:44.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.907+0000 7f74a7732700 1 Processor -- start 2023-10-08T16:04:44.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.908+0000 7f74a7732700 1 -- start start 2023-10-08T16:04:44.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.908+0000 7f74a7732700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74a0154480 0x7f74a0157b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.908+0000 7f74a7732700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a00b2030 0x7f74a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.908+0000 7f74a7732700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a015b410 con 0x7f74a0068960 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.908+0000 7f74a7732700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a015a800 con 0x7f74a0154480 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.908+0000 7f74a7732700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a015aae0 con 0x7f74a00b2030 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a4ccd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f74a0068960 0x7f74a00b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54368/0 (socket says 172.21.15.144:54368) 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a4ccd700 1 -- 172.21.15.144:0/4018276614 learned_addr learned my addr 172.21.15.144:0/4018276614 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a5ccf700 1 --2- 172.21.15.144:0/4018276614 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a00b2030 0x7f74a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a54ce700 1 --2- 172.21.15.144:0/4018276614 >> v2:172.21.15.60:3300/0 conn(0x7f74a0154480 0x7f74a0157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f7497fff700 1 -- 172.21.15.144:0/4018276614 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555323462 0 0) 0x7f74a015b410 con 0x7f74a0068960 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f7497fff700 1 -- 172.21.15.144:0/4018276614 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c003570 con 0x7f74a0068960 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a5ccf700 1 -- 172.21.15.144:0/4018276614 >> v2:172.21.15.60:3300/0 conn(0x7f74a0154480 msgr2=0x7f74a0157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a5ccf700 1 --2- 172.21.15.144:0/4018276614 >> v2:172.21.15.60:3300/0 conn(0x7f74a0154480 0x7f74a0157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a5ccf700 1 -- 172.21.15.144:0/4018276614 >> v1:172.21.15.144:6789/0 conn(0x7f74a0068960 legacy=0x7f74a00b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a5ccf700 1 -- 172.21.15.144:0/4018276614 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a015adc0 con 0x7f74a00b2030 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f74a5ccf700 1 --2- 172.21.15.144:0/4018276614 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a00b2030 0x7f74a006e320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7498009e60 tx=0x7f7498009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79fadeca2287cb67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f7497fff700 1 -- 172.21.15.144:0/4018276614 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800e070 con 0x7f74a00b2030 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f7497fff700 1 -- 172.21.15.144:0/4018276614 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800bab0 con 0x7f74a00b2030 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.909+0000 7f7497fff700 1 -- 172.21.15.144:0/4018276614 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800be70 con 0x7f74a00b2030 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 -- 172.21.15.144:0/4018276614 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a00b2030 msgr2=0x7f74a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 --2- 172.21.15.144:0/4018276614 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a00b2030 0x7f74a006e320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7498009e60 tx=0x7f7498009780 comp rx=0 tx=0).stop 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 -- 172.21.15.144:0/4018276614 shutdown_connections 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 --2- 172.21.15.144:0/4018276614 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a00b2030 0x7f74a006e320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 --2- 172.21.15.144:0/4018276614 >> v2:172.21.15.60:3300/0 conn(0x7f74a0154480 0x7f74a0157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 -- 172.21.15.144:0/4018276614 >> 172.21.15.144:0/4018276614 conn(0x7f74a00ce580 msgr2=0x7f74a00af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:44.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 -- 172.21.15.144:0/4018276614 shutdown_connections 2023-10-08T16:04:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.910+0000 7f74a7732700 1 -- 172.21.15.144:0/4018276614 wait complete. 2023-10-08T16:04:44.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.911+0000 7f74a7732700 1 Processor -- start 2023-10-08T16:04:44.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.911+0000 7f74a7732700 1 -- start start 2023-10-08T16:04:44.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a7732700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 0x7f74a01662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a7732700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a00b2030 0x7f74a0167240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a7732700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74a0154480 0x7f74a0164f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a7732700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0168af0 con 0x7f74a00b2030 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a7732700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0168660 con 0x7f74a0154480 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a7732700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0167780 con 0x7f74a0068960 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 0x7f74a01662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 0x7f74a01662a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58794/0 (socket says 172.21.15.144:58794) 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 -- 172.21.15.144:0/1074927259 learned_addr learned my addr 172.21.15.144:0/1074927259 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a5ccf700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74a0154480 0x7f74a0164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a4ccd700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a00b2030 0x7f74a0167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 -- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74a0154480 msgr2=0x7f74a0164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74a0154480 0x7f74a0164f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 -- 172.21.15.144:0/1074927259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a00b2030 msgr2=0x7f74a0167240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a00b2030 0x7f74a0167240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.912+0000 7f74a54ce700 1 -- 172.21.15.144:0/1074927259 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498009a20 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74a54ce700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 0x7f74a01662a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f749000ec80 tx=0x7f7490009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000c850 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000c9b0 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a0167a50 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000cd30 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a0168010 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7490013900 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.913+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f749001ca30 con 0x7f74a0068960 2023-10-08T16:04:44.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.914+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a004c3c0 con 0x7f74a0068960 2023-10-08T16:04:44.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.916+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f749003b6d0 con 0x7f74a0068960 2023-10-08T16:04:44.945 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:44.945+0000 7f557783c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:04:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:44.999+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f74a015b0a0 con 0x7f74a0068960 2023-10-08T16:04:45.001 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.001+0000 7f0cb7f37180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:04:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.002+0000 7f74957fa700 1 -- 172.21.15.144:0/1074927259 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f749002a030 con 0x7f74a0068960 2023-10-08T16:04:45.002 INFO:teuthology.orchestra.run.smithi144.stdout:3 2023-10-08T16:04:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 msgr2=0x7f74a01662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 0x7f74a01662a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f749000ec80 tx=0x7f7490009120 comp rx=0 tx=0).stop 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 shutdown_connections 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74a0068960 0x7f74a01662a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74a0154480 0x7f74a0164f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 --2- 172.21.15.144:0/1074927259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a00b2030 0x7f74a0167240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 >> 172.21.15.144:0/1074927259 conn(0x7f74a00ce580 msgr2=0x7f74a006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 shutdown_connections 2023-10-08T16:04:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.003+0000 7f74a7732700 1 -- 172.21.15.144:0/1074927259 wait complete. 2023-10-08T16:04:45.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-08T16:04:45.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.131+0000 7fc23ef16700 1 Processor -- start 2023-10-08T16:04:45.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.131+0000 7fc23ef16700 1 -- start start 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23ef16700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc238154270 0x7fc2380affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23ef16700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc238068670 0x7fc238068b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23ef16700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23815a270 con 0x7fc23815d8b0 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23ef16700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc238069050 con 0x7fc238068670 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23ef16700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2380b0500 con 0x7fc238154270 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc238154270 0x7fc2380affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc238154270 0x7fc2380affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53770/0 (socket says 172.21.15.144:53770) 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 -- 172.21.15.144:0/1407263046 learned_addr learned my addr 172.21.15.144:0/1407263046 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23e715700 1 --2- 172.21.15.144:0/1407263046 >> v2:172.21.15.60:3300/0 conn(0x7fc238068670 0x7fc238068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 -- 172.21.15.144:0/1407263046 >> v2:172.21.15.60:3300/0 conn(0x7fc238068670 msgr2=0x7fc238068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 --2- 172.21.15.144:0/1407263046 >> v2:172.21.15.60:3300/0 conn(0x7fc238068670 0x7fc238068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 -- 172.21.15.144:0/1407263046 >> v1:172.21.15.60:6789/0 conn(0x7fc23815d8b0 legacy=0x7fc2380aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.132+0000 7fc23df14700 1 -- 172.21.15.144:0/1407263046 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380ad5b0 con 0x7fc238154270 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23df14700 1 --2- 172.21.15.144:0/1407263046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380affc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc23806dbe0 tx=0x7fc228009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47cff286ab383ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23cf12700 1 -- 172.21.15.144:0/1407263046 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228009e70 con 0x7fc238154270 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23cf12700 1 -- 172.21.15.144:0/1407263046 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800b860 con 0x7fc238154270 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23cf12700 1 -- 172.21.15.144:0/1407263046 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800bc00 con 0x7fc238154270 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 -- 172.21.15.144:0/1407263046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 msgr2=0x7fc2380affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1407263046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380affc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc23806dbe0 tx=0x7fc228009250 comp rx=0 tx=0).stop 2023-10-08T16:04:45.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 -- 172.21.15.144:0/1407263046 shutdown_connections 2023-10-08T16:04:45.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1407263046 >> v2:172.21.15.60:3300/0 conn(0x7fc238068670 0x7fc238068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1407263046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380affc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 -- 172.21.15.144:0/1407263046 >> 172.21.15.144:0/1407263046 conn(0x7fc23806a070 msgr2=0x7fc23806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 -- 172.21.15.144:0/1407263046 shutdown_connections 2023-10-08T16:04:45.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.133+0000 7fc23ef16700 1 -- 172.21.15.144:0/1407263046 wait complete. 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 Processor -- start 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 -- start start 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 0x7fc238150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc23815d8b0 0x7fc2380aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2381508c0 con 0x7fc23815d8b0 2023-10-08T16:04:45.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23816d860 con 0x7fc238154270 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23ef16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc238154b40 con 0x7fc238068670 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23df14700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 0x7fc238150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23df14700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 0x7fc238150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58802/0 (socket says 172.21.15.144:58802) 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23df14700 1 -- 172.21.15.144:0/1663834303 learned_addr learned my addr 172.21.15.144:0/1663834303 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23d713700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.135+0000 7fc23e715700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc23815d8b0 0x7fc2380aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23df14700 1 -- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 msgr2=0x7fc2380cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23df14700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23df14700 1 -- 172.21.15.144:0/1663834303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc23815d8b0 msgr2=0x7fc2380aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23df14700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc23815d8b0 0x7fc2380aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23df14700 1 -- 172.21.15.144:0/1663834303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280094f0 con 0x7fc238068670 2023-10-08T16:04:45.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23df14700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 0x7fc238150380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2380b0640 tx=0x7fc228017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800bbe0 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228011420 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23816db00 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2280117e0 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23816e0c0 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc22802e3f0 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.136+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc228025900 con 0x7fc238068670 2023-10-08T16:04:45.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.137+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23816e2e0 con 0x7fc238068670 2023-10-08T16:04:45.141 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.139+0000 7f0cb7f37180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:04:45.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.139+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc228033060 con 0x7fc238068670 2023-10-08T16:04:45.141 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:45.141+0000 7f557783c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:04:45.218 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.218+0000 7f0cb7f37180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:04:45.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.223+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fc23806d130 con 0x7fc238068670 2023-10-08T16:04:45.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.225+0000 7fc22dffb700 1 -- 172.21.15.144:0/1663834303 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc228015020 con 0x7fc238068670 2023-10-08T16:04:45.226 INFO:teuthology.orchestra.run.smithi144.stdout:4 2023-10-08T16:04:45.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.226+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 msgr2=0x7fc238150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.226+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 0x7fc238150380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2380b0640 tx=0x7fc228017000 comp rx=0 tx=0).stop 2023-10-08T16:04:45.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.226+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 shutdown_connections 2023-10-08T16:04:45.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.226+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc238068670 0x7fc238150380 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.226+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc23815d8b0 0x7fc2380aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.227+0000 7fc23ef16700 1 --2- 172.21.15.144:0/1663834303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc238154270 0x7fc2380cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.227+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 >> 172.21.15.144:0/1663834303 conn(0x7fc23806a070 msgr2=0x7fc238151830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.227+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 shutdown_connections 2023-10-08T16:04:45.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.227+0000 7fc23ef16700 1 -- 172.21.15.144:0/1663834303 wait complete. 2023-10-08T16:04:45.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-08T16:04:45.322 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:45.322+0000 7f557783c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:04:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.355+0000 7fe909d27700 1 Processor -- start 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.355+0000 7fe909d27700 1 -- start start 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe909d27700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe90406ca90 0x7fe904164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe909d27700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe904067e30 con 0x7fe904159dc0 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe909d27700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90406f8e0 con 0x7fe90415a190 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe909d27700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9040cba70 con 0x7fe90406ca90 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe903fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe90415a190 0x7fe90406ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54382/0 (socket says 172.21.15.144:54382) 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe903fff700 1 -- 172.21.15.144:0/1201334587 learned_addr learned my addr 172.21.15.144:0/1201334587 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe909526700 1 --2- 172.21.15.144:0/1201334587 >> v2:172.21.15.60:3300/0 conn(0x7fe90406ca90 0x7fe904164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060259177 0 0) 0x7fe90406f8e0 con 0x7fe90415a190 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.356+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f4003570 con 0x7fe90415a190 2023-10-08T16:04:45.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678148522 0 0) 0x7fe904067e30 con 0x7fe904159dc0 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90406f8e0 con 0x7fe904159dc0 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe909526700 1 -- 172.21.15.144:0/1201334587 >> v1:172.21.15.144:6789/0 conn(0x7fe90415a190 legacy=0x7fe90406ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757260631 0 0) 0x7fe8f4003570 con 0x7fe90415a190 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe909526700 1 -- 172.21.15.144:0/1201334587 >> v1:172.21.15.60:6789/0 conn(0x7fe904159dc0 legacy=0x7fe90406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe909526700 1 -- 172.21.15.144:0/1201334587 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9040677e0 con 0x7fe90406ca90 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe909526700 1 --2- 172.21.15.144:0/1201334587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90406ca90 0x7fe904164ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009de0 tx=0x7fe8fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a309f0af378a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00e070 con 0x7fe90406ca90 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00b820 con 0x7fe90406ca90 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.357+0000 7fe9037fe700 1 -- 172.21.15.144:0/1201334587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0001470 con 0x7fe90406ca90 2023-10-08T16:04:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 -- 172.21.15.144:0/1201334587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90406ca90 msgr2=0x7fe904164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 --2- 172.21.15.144:0/1201334587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90406ca90 0x7fe904164ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009de0 tx=0x7fe8fc009780 comp rx=0 tx=0).stop 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 -- 172.21.15.144:0/1201334587 shutdown_connections 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 --2- 172.21.15.144:0/1201334587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90406ca90 0x7fe904164ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 -- 172.21.15.144:0/1201334587 >> 172.21.15.144:0/1201334587 conn(0x7fe9040cb0a0 msgr2=0x7fe90406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 -- 172.21.15.144:0/1201334587 shutdown_connections 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.358+0000 7fe909d27700 1 -- 172.21.15.144:0/1201334587 wait complete. 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.359+0000 7fe909d27700 1 Processor -- start 2023-10-08T16:04:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.360+0000 7fe909d27700 1 -- start start 2023-10-08T16:04:45.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909d27700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 0x7fe904154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909d27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe904159dc0 0x7fe90416b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909d27700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe90415a190 0x7fe9041569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909d27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9041579c0 con 0x7fe904159dc0 2023-10-08T16:04:45.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909d27700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9041582e0 con 0x7fe90406ca90 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909d27700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe904157400 con 0x7fe90415a190 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 0x7fe904154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909526700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe90415a190 0x7fe9041569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 0x7fe904154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53792/0 (socket says 172.21.15.144:53792) 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 -- 172.21.15.144:0/2401142170 learned_addr learned my addr 172.21.15.144:0/2401142170 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe903fff700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe904159dc0 0x7fe90416b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 -- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe90415a190 msgr2=0x7fe9041569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe90415a190 0x7fe9041569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 -- 172.21.15.144:0/2401142170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe904159dc0 msgr2=0x7fe90416b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe904159dc0 0x7fe90416b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe908d25700 1 -- 172.21.15.144:0/2401142170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc009a20 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.361+0000 7fe909526700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe90415a190 0x7fe9041569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe908d25700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 0x7fe904154b20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c790 tx=0x7fe8f8007e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8010510 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f8010670 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9041576e0 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8010a10 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe904156290 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe8f801c6c0 con 0x7fe90406ca90 2023-10-08T16:04:45.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.362+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fe8f8010e00 con 0x7fe90406ca90 2023-10-08T16:04:45.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.363+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe904157dd0 con 0x7fe90406ca90 2023-10-08T16:04:45.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.365+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe904157dd0 con 0x7fe90406ca90 2023-10-08T16:04:45.405 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:45.405+0000 7f557783c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:04:45.411 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.410+0000 7f0cb7f37180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:04:45.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.448+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fe9040685b0 con 0x7fe90406ca90 2023-10-08T16:04:45.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.451+0000 7fe900ff9700 1 -- 172.21.15.144:0/2401142170 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8f8017070 con 0x7fe90406ca90 2023-10-08T16:04:45.451 INFO:teuthology.orchestra.run.smithi144.stdout:5 2023-10-08T16:04:45.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 msgr2=0x7fe904154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 0x7fe904154b20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c790 tx=0x7fe8f8007e10 comp rx=0 tx=0).stop 2023-10-08T16:04:45.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 shutdown_connections 2023-10-08T16:04:45.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe90415a190 0x7fe9041569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe90406ca90 0x7fe904154b20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 --2- 172.21.15.144:0/2401142170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe904159dc0 0x7fe90416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 >> 172.21.15.144:0/2401142170 conn(0x7fe9040cb0a0 msgr2=0x7fe904155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 shutdown_connections 2023-10-08T16:04:45.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.452+0000 7fe909d27700 1 -- 172.21.15.144:0/2401142170 wait complete. 2023-10-08T16:04:45.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-08T16:04:45.550 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:45.549+0000 7f557783c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:04:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.583+0000 7fcf3b38c700 1 Processor -- start 2023-10-08T16:04:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.583+0000 7fcf3b38c700 1 -- start start 2023-10-08T16:04:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf3b38c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf3415cec0 0x7fcf340cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf3b38c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340cc760 con 0x7fcf3415a300 2023-10-08T16:04:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf3b38c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3415b460 con 0x7fcf3415ade0 2023-10-08T16:04:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf3b38c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3415ba20 con 0x7fcf3415cec0 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf3ab8b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf3415ade0 0x7fcf340cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54392/0 (socket says 172.21.15.144:54392) 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf3ab8b700 1 -- 172.21.15.144:0/804918468 learned_addr learned my addr 172.21.15.144:0/804918468 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39b89700 1 --2- 172.21.15.144:0/804918468 >> v2:172.21.15.60:3300/0 conn(0x7fcf3415cec0 0x7fcf340cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39388700 1 -- 172.21.15.144:0/804918468 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563018481 0 0) 0x7fcf3415b460 con 0x7fcf3415ade0 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39388700 1 -- 172.21.15.144:0/804918468 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf20003570 con 0x7fcf3415ade0 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39b89700 1 -- 172.21.15.144:0/804918468 >> v1:172.21.15.144:6789/0 conn(0x7fcf3415ade0 legacy=0x7fcf340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39b89700 1 -- 172.21.15.144:0/804918468 >> v1:172.21.15.60:6789/0 conn(0x7fcf3415a300 legacy=0x7fcf3415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39388700 1 -- 172.21.15.144:0/804918468 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244799953 0 0) 0x7fcf340cc760 con 0x7fcf3415a300 2023-10-08T16:04:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.584+0000 7fcf39b89700 1 -- 172.21.15.144:0/804918468 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340cc1a0 con 0x7fcf3415cec0 2023-10-08T16:04:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf39b89700 1 --2- 172.21.15.144:0/804918468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415cec0 0x7fcf340cb430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcf300098e0 tx=0x7fcf300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af75b403f326d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf39388700 1 -- 172.21.15.144:0/804918468 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000b640 con 0x7fcf3415cec0 2023-10-08T16:04:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf39388700 1 -- 172.21.15.144:0/804918468 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3000b7a0 con 0x7fcf3415cec0 2023-10-08T16:04:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf39388700 1 -- 172.21.15.144:0/804918468 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000bb40 con 0x7fcf3415cec0 2023-10-08T16:04:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 -- 172.21.15.144:0/804918468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415cec0 msgr2=0x7fcf340cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 --2- 172.21.15.144:0/804918468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415cec0 0x7fcf340cb430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcf300098e0 tx=0x7fcf300091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 -- 172.21.15.144:0/804918468 shutdown_connections 2023-10-08T16:04:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 --2- 172.21.15.144:0/804918468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415cec0 0x7fcf340cb430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 -- 172.21.15.144:0/804918468 >> 172.21.15.144:0/804918468 conn(0x7fcf34099f50 msgr2=0x7fcf34067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 -- 172.21.15.144:0/804918468 shutdown_connections 2023-10-08T16:04:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.585+0000 7fcf3b38c700 1 -- 172.21.15.144:0/804918468 wait complete. 2023-10-08T16:04:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.586+0000 7fcf3b38c700 1 Processor -- start 2023-10-08T16:04:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 -- start start 2023-10-08T16:04:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3415a300 0x7fcf340ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415ade0 0x7fcf340b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 0x7fcf340c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340b5350 con 0x7fcf3415ade0 2023-10-08T16:04:45.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340b5630 con 0x7fcf3415cec0 2023-10-08T16:04:45.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3b38c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340b5910 con 0x7fcf3415a300 2023-10-08T16:04:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3ab8b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 0x7fcf340c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3a38a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3415a300 0x7fcf340ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3ab8b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 0x7fcf340c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53806/0 (socket says 172.21.15.144:53806) 2023-10-08T16:04:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3ab8b700 1 -- 172.21.15.144:0/3812638243 learned_addr learned my addr 172.21.15.144:0/3812638243 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf3a38a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3415a300 0x7fcf340ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:58818/0 (socket says 172.21.15.144:58818) 2023-10-08T16:04:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.587+0000 7fcf39b89700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415ade0 0x7fcf340b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3ab8b700 1 -- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3415a300 msgr2=0x7fcf340ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3ab8b700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3415a300 0x7fcf340ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3ab8b700 1 -- 172.21.15.144:0/3812638243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415ade0 msgr2=0x7fcf340b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3ab8b700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415ade0 0x7fcf340b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3ab8b700 1 -- 172.21.15.144:0/3812638243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009420 con 0x7fcf3415cec0 2023-10-08T16:04:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3ab8b700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 0x7fcf340c7c70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c001460 tx=0x7fcf2c001ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00a890 con 0x7fcf3415cec0 2023-10-08T16:04:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00a9f0 con 0x7fcf3415cec0 2023-10-08T16:04:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00ad70 con 0x7fcf3415cec0 2023-10-08T16:04:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf340b5bf0 con 0x7fcf3415cec0 2023-10-08T16:04:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf340cab40 con 0x7fcf3415cec0 2023-10-08T16:04:45.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcf2c007300 con 0x7fcf3415cec0 2023-10-08T16:04:45.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.588+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fcf2c01ba00 con 0x7fcf3415cec0 2023-10-08T16:04:45.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.589+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3406ada0 con 0x7fcf3415cec0 2023-10-08T16:04:45.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.591+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcf2c007790 con 0x7fcf3415cec0 2023-10-08T16:04:45.599 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.592+0000 7f0cb7f37180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:04:45.650 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:45.650+0000 7f557783c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:04:45.672 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.672+0000 7f0cb7f37180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:04:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.674+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fcf340cc480 con 0x7fcf3415cec0 2023-10-08T16:04:45.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.677+0000 7fcf2a7fc700 1 -- 172.21.15.144:0/3812638243 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf2c02a0b0 con 0x7fcf3415cec0 2023-10-08T16:04:45.678 INFO:teuthology.orchestra.run.smithi144.stdout:6 2023-10-08T16:04:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 msgr2=0x7fcf340c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 0x7fcf340c7c70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c001460 tx=0x7fcf2c001ae0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 shutdown_connections 2023-10-08T16:04:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3415a300 0x7fcf340ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3415cec0 0x7fcf340c7c70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 --2- 172.21.15.144:0/3812638243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf3415ade0 0x7fcf340b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 >> 172.21.15.144:0/3812638243 conn(0x7fcf34099f50 msgr2=0x7fcf340d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.678+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 shutdown_connections 2023-10-08T16:04:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.679+0000 7fcf3b38c700 1 -- 172.21.15.144:0/3812638243 wait complete. 2023-10-08T16:04:45.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-08T16:04:45.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.807+0000 7ff29ff75700 1 Processor -- start 2023-10-08T16:04:45.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.808+0000 7ff29ff75700 1 -- start start 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.808+0000 7ff29ff75700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff29815b9a0 0x7ff2980caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.808+0000 7ff29ff75700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29815c8d0 con 0x7ff298152300 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.808+0000 7ff29ff75700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980c9370 con 0x7ff29806d370 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.808+0000 7ff29ff75700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980b1400 con 0x7ff29815b9a0 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.808+0000 7ff29e512700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff29806d370 0x7ff29806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54406/0 (socket says 172.21.15.144:54406) 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29e512700 1 -- 172.21.15.144:0/3981268121 learned_addr learned my addr 172.21.15.144:0/3981268121 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29d510700 1 --2- 172.21.15.144:0/3981268121 >> v2:172.21.15.60:3300/0 conn(0x7ff29815b9a0 0x7ff2980caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29cd0f700 1 -- 172.21.15.144:0/3981268121 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351746768 0 0) 0x7ff2980c9370 con 0x7ff29806d370 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29cd0f700 1 -- 172.21.15.144:0/3981268121 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff284003570 con 0x7ff29806d370 2023-10-08T16:04:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29d510700 1 -- 172.21.15.144:0/3981268121 >> v1:172.21.15.144:6789/0 conn(0x7ff29806d370 legacy=0x7ff29806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29d510700 1 -- 172.21.15.144:0/3981268121 >> v1:172.21.15.60:6789/0 conn(0x7ff298152300 legacy=0x7ff298158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29d510700 1 -- 172.21.15.144:0/3981268121 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29815c030 con 0x7ff29815b9a0 2023-10-08T16:04:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29d510700 1 --2- 172.21.15.144:0/3981268121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29815b9a0 0x7ff2980caaf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2880098e0 tx=0x7ff2880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e87d3d514ab4640 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29cd0f700 1 -- 172.21.15.144:0/3981268121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800b640 con 0x7ff29815b9a0 2023-10-08T16:04:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29cd0f700 1 -- 172.21.15.144:0/3981268121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800b7a0 con 0x7ff29815b9a0 2023-10-08T16:04:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.809+0000 7ff29cd0f700 1 -- 172.21.15.144:0/3981268121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800bb40 con 0x7ff29815b9a0 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 -- 172.21.15.144:0/3981268121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29815b9a0 msgr2=0x7ff2980caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 --2- 172.21.15.144:0/3981268121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29815b9a0 0x7ff2980caaf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2880098e0 tx=0x7ff2880091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 -- 172.21.15.144:0/3981268121 shutdown_connections 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 --2- 172.21.15.144:0/3981268121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29815b9a0 0x7ff2980caaf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 -- 172.21.15.144:0/3981268121 >> 172.21.15.144:0/3981268121 conn(0x7ff298069870 msgr2=0x7ff298069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 -- 172.21.15.144:0/3981268121 shutdown_connections 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.810+0000 7ff29ff75700 1 -- 172.21.15.144:0/3981268121 wait complete. 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.811+0000 7ff29ff75700 1 Processor -- start 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.811+0000 7ff29ff75700 1 -- start start 2023-10-08T16:04:45.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29806d370 0x7ff298151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 0x7ff298168620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29815b9a0 0x7ff2981536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c91a0 con 0x7ff29806d370 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c8d10 con 0x7ff298152300 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff298151d90 con 0x7ff29815b9a0 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 0x7ff298168620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 0x7ff298168620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53818/0 (socket says 172.21.15.144:53818) 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29e512700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29815b9a0 0x7ff2981536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 -- 172.21.15.144:0/527756286 learned_addr learned my addr 172.21.15.144:0/527756286 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29dd11700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29806d370 0x7ff298151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 -- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29815b9a0 msgr2=0x7ff2981536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29815b9a0 0x7ff2981536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 -- 172.21.15.144:0/527756286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29806d370 msgr2=0x7ff298151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29806d370 0x7ff298151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 -- 172.21.15.144:0/527756286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009420 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29d510700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 0x7ff298168620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff288009f80 tx=0x7ff288017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288000d10 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800bb20 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff298168b60 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.812+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288011650 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.813+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2980c83e0 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.813+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff288011c40 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.813+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7ff28802d3f0 con 0x7ff298152300 2023-10-08T16:04:45.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.813+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29804c3c0 con 0x7ff298152300 2023-10-08T16:04:45.817 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.812+0000 7f0cb7f37180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:04:45.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.815+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff288029070 con 0x7ff298152300 2023-10-08T16:04:45.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.895+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7ff2980c8e50 con 0x7ff298152300 2023-10-08T16:04:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.899+0000 7ff28dffb700 1 -- 172.21.15.144:0/527756286 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2880340b0 con 0x7ff298152300 2023-10-08T16:04:45.900 INFO:teuthology.orchestra.run.smithi144.stdout:7 2023-10-08T16:04:45.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 msgr2=0x7ff298168620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 0x7ff298168620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff288009f80 tx=0x7ff288017000 comp rx=0 tx=0).stop 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 shutdown_connections 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29815b9a0 0x7ff2981536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff29806d370 0x7ff298151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 --2- 172.21.15.144:0/527756286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff298152300 0x7ff298168620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 >> 172.21.15.144:0/527756286 conn(0x7ff298069870 msgr2=0x7ff2980caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 shutdown_connections 2023-10-08T16:04:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T16:04:45.900+0000 7ff29ff75700 1 -- 172.21.15.144:0/527756286 wait complete. 2023-10-08T16:04:45.912 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T16:04:45.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T16:04:45.912 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:45.912+0000 7f0cb7f37180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:04:45.914 INFO:tasks.ceph.osd.0:Started 2023-10-08T16:04:45.914 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T16:04:45.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T16:04:45.916 INFO:tasks.ceph.osd.1:Started 2023-10-08T16:04:45.917 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T16:04:45.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T16:04:45.919 INFO:tasks.ceph.osd.2:Started 2023-10-08T16:04:45.919 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T16:04:45.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T16:04:45.921 INFO:tasks.ceph.osd.3:Started 2023-10-08T16:04:45.921 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T16:04:45.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T16:04:45.923 INFO:tasks.ceph.osd.4:Started 2023-10-08T16:04:45.923 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T16:04:45.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T16:04:45.925 INFO:tasks.ceph.osd.5:Started 2023-10-08T16:04:45.925 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T16:04:45.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T16:04:45.927 INFO:tasks.ceph.osd.6:Started 2023-10-08T16:04:45.927 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T16:04:45.928 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T16:04:45.929 INFO:tasks.ceph.osd.7:Started 2023-10-08T16:04:45.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:46.003 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-08T16:04:46.003+0000 7f475ec56540 -1 Falling back to public interface 2023-10-08T16:04:46.004 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-08T16:04:46.003+0000 7fab41cb1540 -1 Falling back to public interface 2023-10-08T16:04:46.004 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-08T16:04:46.003+0000 7fb7c8ad0540 -1 Falling back to public interface 2023-10-08T16:04:46.004 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:46.003+0000 7f92c1e51540 -1 Falling back to public interface 2023-10-08T16:04:46.005 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-08T16:04:46.003+0000 7f475907f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-08T16:04:46.005 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:46.003+0000 7f92bc27a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-08T16:04:46.005 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-08T16:04:46.003+0000 7fab3c0da700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-10-08T16:04:46.005 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-08T16:04:46.003+0000 7f475907f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2023-10-08T16:04:46.006 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-08T16:04:46.003+0000 7fb7c2ef9700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2023-10-08T16:04:46.006 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:46.003+0000 7f92bc27a700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6803/0: (98) Address already in use 2023-10-08T16:04:46.006 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-08T16:04:46.004+0000 7fb7c2ef9700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6812/0: (98) Address already in use 2023-10-08T16:04:46.007 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:46.004+0000 7f92bc27a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-10-08T16:04:46.010 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-08T16:04:46.010+0000 7f4bf6008540 -1 Falling back to public interface 2023-10-08T16:04:46.019 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-08T16:04:46.019+0000 7fab41cb1540 -1 osd.5 0 log_to_monitors true 2023-10-08T16:04:46.019 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:46.019+0000 7f92c1e51540 -1 osd.7 0 log_to_monitors true 2023-10-08T16:04:46.020 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-08T16:04:46.019+0000 7f475ec56540 -1 osd.4 0 log_to_monitors true 2023-10-08T16:04:46.020 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-08T16:04:46.019+0000 7fb7c8ad0540 -1 osd.6 0 log_to_monitors true 2023-10-08T16:04:46.023 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-08T16:04:46.022+0000 7f54913bc540 -1 Falling back to public interface 2023-10-08T16:04:46.024 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-08T16:04:46.024+0000 7fb71d475540 -1 Falling back to public interface 2023-10-08T16:04:46.025 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-08T16:04:46.025+0000 7f548b7e5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6812/0: (98) Address already in use 2023-10-08T16:04:46.027 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-08T16:04:46.027+0000 7f4bf6008540 -1 osd.2 0 log_to_monitors true 2023-10-08T16:04:46.029 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-08T16:04:46.029+0000 7f04d4d2a540 -1 Falling back to public interface 2023-10-08T16:04:46.044 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-08T16:04:46.044+0000 7f04d4d2a540 -1 osd.3 0 log_to_monitors true 2023-10-08T16:04:46.044 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-08T16:04:46.044+0000 7fb71d475540 -1 osd.0 0 log_to_monitors true 2023-10-08T16:04:46.045 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-08T16:04:46.045+0000 7f54913bc540 -1 osd.1 0 log_to_monitors true 2023-10-08T16:04:46.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.089+0000 7fcae660a700 1 Processor -- start 2023-10-08T16:04:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.089+0000 7fcae660a700 1 -- start start 2023-10-08T16:04:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae660a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00afd90 0x7fcae00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae660a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcae006f1a0 0x7fcae015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae660a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcae00b0160 0x7fcae0070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae660a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00ca270 con 0x7fcae006f1a0 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae660a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00c87c0 con 0x7fcae00b0160 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae660a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae015b770 con 0x7fcae00afd90 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcae006f1a0 0x7fcae015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcae006f1a0 0x7fcae015b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55066/0 (socket says 172.21.15.60:55066) 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 -- 172.21.15.60:0/1323144318 learned_addr learned my addr 172.21.15.60:0/1323144318 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae4ba7700 1 --2- 172.21.15.60:0/1323144318 >> v2:172.21.15.144:3300/0 conn(0x7fcae00b0160 0x7fcae0070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadffff700 1 --2- 172.21.15.60:0/1323144318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00afd90 0x7fcae00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 -- 172.21.15.60:0/1323144318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00afd90 msgr2=0x7fcae00c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 --2- 172.21.15.60:0/1323144318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00afd90 0x7fcae00c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 -- 172.21.15.60:0/1323144318 >> v2:172.21.15.144:3300/0 conn(0x7fcae00b0160 msgr2=0x7fcae0070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 --2- 172.21.15.60:0/1323144318 >> v2:172.21.15.144:3300/0 conn(0x7fcae00b0160 0x7fcae0070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 -- 172.21.15.60:0/1323144318 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae006e3e0 con 0x7fcae006f1a0 2023-10-08T16:04:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcae4ba7700 1 --2- 172.21.15.60:0/1323144318 >> v2:172.21.15.144:3300/0 conn(0x7fcae00b0160 0x7fcae0070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadf7fe700 1 --2- 172.21.15.60:0/1323144318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae015b230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcae0063c80 tx=0x7fcad4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76b3d9ea58b9a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadeffd700 1 -- 172.21.15.60:0/1323144318 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400b860 con 0x7fcae006f1a0 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadeffd700 1 -- 172.21.15.60:0/1323144318 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400b9c0 con 0x7fcae006f1a0 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.090+0000 7fcadeffd700 1 -- 172.21.15.60:0/1323144318 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400bd60 con 0x7fcae006f1a0 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 -- 172.21.15.60:0/1323144318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 msgr2=0x7fcae015b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 --2- 172.21.15.60:0/1323144318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae015b230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcae0063c80 tx=0x7fcad4009250 comp rx=0 tx=0).stop 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 -- 172.21.15.60:0/1323144318 shutdown_connections 2023-10-08T16:04:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 --2- 172.21.15.60:0/1323144318 >> v2:172.21.15.144:3300/0 conn(0x7fcae00b0160 0x7fcae0070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 --2- 172.21.15.60:0/1323144318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00afd90 0x7fcae00c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 --2- 172.21.15.60:0/1323144318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae015b230 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 -- 172.21.15.60:0/1323144318 >> 172.21.15.60:0/1323144318 conn(0x7fcae00ca4f0 msgr2=0x7fcae00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 -- 172.21.15.60:0/1323144318 shutdown_connections 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.091+0000 7fcae660a700 1 -- 172.21.15.60:0/1323144318 wait complete. 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.092+0000 7fcae660a700 1 Processor -- start 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.092+0000 7fcae660a700 1 -- start start 2023-10-08T16:04:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae660a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae00b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae660a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcae00afd90 0x7fcae0155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae660a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00b0160 0x7fcae0159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae660a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00b0e90 con 0x7fcae006f1a0 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae660a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00b0880 con 0x7fcae00afd90 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae660a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae015a350 con 0x7fcae00b0160 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae00b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae00b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55080/0 (socket says 172.21.15.60:55080) 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 -- 172.21.15.60:0/957995763 learned_addr learned my addr 172.21.15.60:0/957995763 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcae4ba7700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00b0160 0x7fcae0159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadf7fe700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcae00afd90 0x7fcae0155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 -- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00b0160 msgr2=0x7fcae0159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00b0160 0x7fcae0159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 -- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcae00afd90 msgr2=0x7fcae0155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcae00afd90 0x7fcae0155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.093+0000 7fcadffff700 1 -- 172.21.15.60:0/957995763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40094f0 con 0x7fcae006f1a0 2023-10-08T16:04:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcadffff700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae00b1320 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcad000d890 tx=0x7fcad0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad00125f0 con 0x7fcae006f1a0 2023-10-08T16:04:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0012770 con 0x7fcae006f1a0 2023-10-08T16:04:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae015a630 con 0x7fcae006f1a0 2023-10-08T16:04:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0012b30 con 0x7fcae006f1a0 2023-10-08T16:04:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae0156150 con 0x7fcae006f1a0 2023-10-08T16:04:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcad001e460 con 0x7fcae006f1a0 2023-10-08T16:04:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.094+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fcad0014b10 con 0x7fcae006f1a0 2023-10-08T16:04:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.095+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae00b1170 con 0x7fcae006f1a0 2023-10-08T16:04:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.097+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcad0014d60 con 0x7fcae006f1a0 2023-10-08T16:04:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.166+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcae004c3c0 con 0x7fcae006f1a0 2023-10-08T16:04:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcac7fff700 1 -- 172.21.15.60:0/957995763 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fcad002d090 con 0x7fcae006f1a0 2023-10-08T16:04:46.167 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:46.167 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:04:45.897271+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 msgr2=0x7fcae00b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae00b1320 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcad000d890 tx=0x7fcad0008040 comp rx=0 tx=0).stop 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 shutdown_connections 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcae00b0160 0x7fcae0159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae006f1a0 0x7fcae00b1320 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 --2- 172.21.15.60:0/957995763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcae00afd90 0x7fcae0155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.167+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 >> 172.21.15.60:0/957995763 conn(0x7fcae00ca4f0 msgr2=0x7fcae015ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.168+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 shutdown_connections 2023-10-08T16:04:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:46.168+0000 7fcae660a700 1 -- 172.21.15.60:0/957995763 wait complete. 2023-10-08T16:04:46.180 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T16:04:46.180 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T16:04:46.480 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:46.480+0000 7f0cb7f37180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:04:46.561 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:46.560+0000 7f0cb7f37180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:04:46.641 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:46.641+0000 7f0cb7f37180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:04:46.986 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:46.987 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:46.987+0000 7f557783c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:04:47.064 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:47.064+0000 7f557783c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:04:47.103 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.103+0000 7fdeda648700 1 Processor -- start 2023-10-08T16:04:47.107 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.103+0000 7fdeda648700 1 -- start start 2023-10-08T16:04:47.107 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fdeda648700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:47.107 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fdeda648700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded4068e50 con 0x7fded40cbef0 2023-10-08T16:04:47.107 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fdeda648700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40699d0 con 0x7fded40cc2c0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fdeda648700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c7530 con 0x7fded4155ed0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fded9646700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fded40cbef0 0x7fded40c6e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42412/0 (socket says 172.21.15.60:42412) 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fded9646700 1 -- 172.21.15.60:0/2913357105 learned_addr learned my addr 172.21.15.60:0/2913357105 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.105+0000 7fded9e47700 1 --2- 172.21.15.60:0/2913357105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290893389 0 0) 0x7fded4068e50 con 0x7fded40cbef0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec0003570 con 0x7fded40cbef0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061560877 0 0) 0x7fded40699d0 con 0x7fded40cc2c0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded4068e50 con 0x7fded40cc2c0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fded9e47700 1 -- 172.21.15.60:0/2913357105 >> v1:172.21.15.144:6789/0 conn(0x7fded40cc2c0 legacy=0x7fded41557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fded9e47700 1 -- 172.21.15.60:0/2913357105 >> v1:172.21.15.60:6789/0 conn(0x7fded40cbef0 legacy=0x7fded40c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fded9e47700 1 -- 172.21.15.60:0/2913357105 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40690a0 con 0x7fded4155ed0 2023-10-08T16:04:47.108 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fded9e47700 1 --2- 172.21.15.60:0/2913357105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded4160a60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdec4007320 tx=0x7fdec400abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353a9df361c5fcc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:47.109 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4007d70 con 0x7fded4155ed0 2023-10-08T16:04:47.109 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400a170 con 0x7fded4155ed0 2023-10-08T16:04:47.109 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.106+0000 7fdecbfff700 1 -- 172.21.15.60:0/2913357105 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400a4f0 con 0x7fded4155ed0 2023-10-08T16:04:47.109 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.108+0000 7fdeda648700 1 -- 172.21.15.60:0/2913357105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 msgr2=0x7fded4160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:47.109 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.108+0000 7fdeda648700 1 --2- 172.21.15.60:0/2913357105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded4160a60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdec4007320 tx=0x7fdec400abc0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.112 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.111+0000 7fdeda648700 1 -- 172.21.15.60:0/2913357105 shutdown_connections 2023-10-08T16:04:47.112 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.111+0000 7fdeda648700 1 --2- 172.21.15.60:0/2913357105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded4160a60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.112 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.111+0000 7fdeda648700 1 -- 172.21.15.60:0/2913357105 >> 172.21.15.60:0/2913357105 conn(0x7fded4067660 msgr2=0x7fded4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:47.112 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.111+0000 7fdeda648700 1 -- 172.21.15.60:0/2913357105 shutdown_connections 2023-10-08T16:04:47.112 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.112+0000 7fdeda648700 1 -- 172.21.15.60:0/2913357105 wait complete. 2023-10-08T16:04:47.114 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.114+0000 7fdeda648700 1 Processor -- start 2023-10-08T16:04:47.117 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.114+0000 7fdeda648700 1 -- start start 2023-10-08T16:04:47.117 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fdeda648700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 0x7fded4151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fdeda648700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded40cc2c0 0x7fded40af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fdeda648700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded417a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fdeda648700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded41571e0 con 0x7fded40cbef0 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fdeda648700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4156610 con 0x7fded40cc2c0 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fdeda648700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded41568b0 con 0x7fded4155ed0 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9646700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 0x7fded4151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9e47700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded417a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9646700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 0x7fded4151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55086/0 (socket says 172.21.15.60:55086) 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9646700 1 -- 172.21.15.60:0/3658188992 learned_addr learned my addr 172.21.15.60:0/3658188992 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded8e45700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded40cc2c0 0x7fded40af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:47.118 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9e47700 1 -- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded40cc2c0 msgr2=0x7fded40af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9e47700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded40cc2c0 0x7fded40af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9e47700 1 -- 172.21.15.60:0/3658188992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 msgr2=0x7fded4151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9e47700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 0x7fded4151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9e47700 1 -- 172.21.15.60:0/3658188992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4156b90 con 0x7fded4155ed0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.116+0000 7fded9646700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 0x7fded4151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fded9e47700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded417a4c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdec4015000 tx=0x7fdec4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400a2e0 con 0x7fded4155ed0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400a480 con 0x7fded4155ed0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec40266b0 con 0x7fded4155ed0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded4156e70 con 0x7fded4155ed0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded417aa00 con 0x7fded4155ed0 2023-10-08T16:04:47.119 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.117+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdec400ad00 con 0x7fded4155ed0 2023-10-08T16:04:47.120 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.119+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7fdec4026ca0 con 0x7fded4155ed0 2023-10-08T16:04:47.120 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.119+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded4157350 con 0x7fded4155ed0 2023-10-08T16:04:47.121 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.121+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdec4021070 con 0x7fded4155ed0 2023-10-08T16:04:47.143 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:47.142+0000 7f557783c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:04:47.219 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.219+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fded41569f0 con 0x7fded4155ed0 2023-10-08T16:04:47.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.220+0000 7fdec97fa700 1 -- 172.21.15.60:0/3658188992 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fded41569f0 con 0x7fded4155ed0 2023-10-08T16:04:47.220 INFO:teuthology.misc.health.smithi060.stdout: 2023-10-08T16:04:47.220 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":11,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:04:46.898247+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:47.221 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.220+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 msgr2=0x7fded417a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:47.221 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.220+0000 7fdeda648700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded417a4c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdec4015000 tx=0x7fdec4016000 comp rx=0 tx=0).stop 2023-10-08T16:04:47.221 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 shutdown_connections 2023-10-08T16:04:47.221 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fded4155ed0 0x7fded417a4c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fded40cbef0 0x7fded4151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 --2- 172.21.15.60:0/3658188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded40cc2c0 0x7fded40af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:47.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 >> 172.21.15.60:0/3658188992 conn(0x7fded4067660 msgr2=0x7fded4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:47.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 shutdown_connections 2023-10-08T16:04:47.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:47.221+0000 7fdeda648700 1 -- 172.21.15.60:0/3658188992 wait complete. 2023-10-08T16:04:47.232 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:04:47.276 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:47.276+0000 7f0cb7f37180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:04:47.420 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:47.420+0000 7f0cb7f37180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:04:47.523 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:47.523+0000 7f0cb7f37180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:04:47.735 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:47.735+0000 7f557783c180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:04:47.781 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:47.780+0000 7f0cb7f37180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:04:47.862 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:47.862+0000 7f0cb7f37180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:04:47.873 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:47.873+0000 7f557783c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:04:47.917 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-08T16:04:47.917+0000 7f54887df700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T16:04:47.919 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-08T16:04:47.919+0000 7f54825d8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.919 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-08T16:04:47.919+0000 7f4756079700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T16:04:47.920 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-08T16:04:47.920+0000 7fb7bfef3700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T16:04:47.921 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-08T16:04:47.920+0000 7f474fe72700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.921 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-08T16:04:47.921+0000 7fb7b9cec700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.926 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-08T16:04:47.926+0000 7fb714898700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T16:04:47.927 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-08T16:04:47.926+0000 7f4bed42b700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T16:04:47.927 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-08T16:04:47.926+0000 7f04cc14d700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T16:04:47.928 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-08T16:04:47.928+0000 7f4be7224700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.928 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-08T16:04:47.928+0000 7f04c5f46700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.929 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-08T16:04:47.928+0000 7fb70e691700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.930 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-08T16:04:47.930+0000 7fab390d4700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T16:04:47.931 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:47.930+0000 7f92b9a75700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T16:04:47.932 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-08T16:04:47.931+0000 7f92b306d700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.932 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-08T16:04:47.931+0000 7fab32ecd700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:47.964 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:47.964+0000 7f557783c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:04:48.213 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:48.212+0000 7f557783c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:04:48.290 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:48.290+0000 7f557783c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:04:48.736 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:48.736+0000 7f0cb7f37180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:04:48.813 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:48.813+0000 7f0cb7f37180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:04:48.895 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:48.895+0000 7f0cb7f37180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:04:49.038 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:49.038+0000 7f0cb7f37180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:04:49.119 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.119+0000 7f557783c180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:04:49.142 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:49.142+0000 7f0cb7f37180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:04:49.192 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.192+0000 7f557783c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:04:49.266 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.265+0000 7f557783c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:04:49.301 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:49.300+0000 7f0cb7f37180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:04:49.381 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:49.381+0000 7f0cb7f37180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:04:49.397 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.397+0000 7f557783c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:04:49.460 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:49.460+0000 7f0cb7f37180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:04:49.482 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.481+0000 7f557783c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:04:49.540 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:49.539+0000 7f0cb7f37180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:04:49.639 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.639+0000 7f557783c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:04:49.715 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.715+0000 7f557783c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:04:49.790 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.790+0000 7f557783c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:04:49.864 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-08T16:04:49.864+0000 7f557783c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:04:50.568 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:50.567+0000 7f0c71338700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T16:04:50.568 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-08T16:04:50.568+0000 7f0c71338700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T16:04:54.036 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:54.158 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.158+0000 7f74e89aa700 1 Processor -- start 2023-10-08T16:04:54.158 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.158+0000 7f74e89aa700 1 -- start start 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e89aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74e41523e0 0x7f74e406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e89aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74e4158e50 0x7f74e40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e89aa700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e406c010 con 0x7f74e4152010 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e89aa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e406bd10 con 0x7f74e41523e0 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e89aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e415c060 con 0x7f74e4158e50 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74e41523e0 0x7f74e406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74e41523e0 0x7f74e406c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42564/0 (socket says 172.21.15.60:42564) 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 -- 172.21.15.60:0/1557436305 learned_addr learned my addr 172.21.15.60:0/1557436305 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:54.160 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e2d9d700 1 --2- 172.21.15.60:0/1557436305 >> v2:172.21.15.144:3300/0 conn(0x7f74e4158e50 0x7f74e40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 -- 172.21.15.60:0/1557436305 >> v2:172.21.15.144:3300/0 conn(0x7f74e4158e50 msgr2=0x7f74e40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 --2- 172.21.15.60:0/1557436305 >> v2:172.21.15.144:3300/0 conn(0x7f74e4158e50 0x7f74e40cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 -- 172.21.15.60:0/1557436305 >> v1:172.21.15.144:6789/0 conn(0x7f74e4152010 legacy=0x7f74e415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 -- 172.21.15.60:0/1557436305 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e415c340 con 0x7f74e41523e0 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.159+0000 7f74e1d9b700 1 --2- 172.21.15.60:0/1557436305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e41523e0 0x7f74e406c4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74e406f170 tx=0x7f74d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cca0bccb672b609 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e159a700 1 -- 172.21.15.60:0/1557436305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800b860 con 0x7f74e41523e0 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e159a700 1 -- 172.21.15.60:0/1557436305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800b9c0 con 0x7f74e41523e0 2023-10-08T16:04:54.161 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e159a700 1 -- 172.21.15.60:0/1557436305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800bd60 con 0x7f74e41523e0 2023-10-08T16:04:54.163 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 -- 172.21.15.60:0/1557436305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e41523e0 msgr2=0x7f74e406c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1557436305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e41523e0 0x7f74e406c4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74e406f170 tx=0x7f74d8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 -- 172.21.15.60:0/1557436305 shutdown_connections 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1557436305 >> v2:172.21.15.144:3300/0 conn(0x7f74e4158e50 0x7f74e40cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1557436305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e41523e0 0x7f74e406c4a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 -- 172.21.15.60:0/1557436305 >> 172.21.15.60:0/1557436305 conn(0x7f74e4069870 msgr2=0x7f74e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 -- 172.21.15.60:0/1557436305 shutdown_connections 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.160+0000 7f74e89aa700 1 -- 172.21.15.60:0/1557436305 wait complete. 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.161+0000 7f74e89aa700 1 Processor -- start 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.161+0000 7f74e89aa700 1 -- start start 2023-10-08T16:04:54.164 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e89aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 0x7f74e4141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e89aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e41523e0 0x7f74e40b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e89aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74e4158e50 0x7f74e40c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e89aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40c6000 con 0x7f74e4152010 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e89aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40b2bd0 con 0x7f74e41523e0 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e89aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40b2eb0 con 0x7f74e4158e50 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 0x7f74e4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 0x7f74e4141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42566/0 (socket says 172.21.15.60:42566) 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e259c700 1 -- 172.21.15.60:0/1130771253 learned_addr learned my addr 172.21.15.60:0/1130771253 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e1d9b700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e41523e0 0x7f74e40b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.162+0000 7f74e2d9d700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74e4158e50 0x7f74e40c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e259c700 1 -- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74e4158e50 msgr2=0x7f74e40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.165 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e259c700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74e4158e50 0x7f74e40c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e259c700 1 -- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e41523e0 msgr2=0x7f74e40b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e259c700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e41523e0 0x7f74e40b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e259c700 1 -- 172.21.15.60:0/1130771253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80094f0 con 0x7f74e4152010 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e1d9b700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e41523e0 0x7f74e40b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e259c700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 0x7f74e4141490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74d400c4e0 tx=0x7f74d400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4011590 con 0x7f74e4152010 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d4011710 con 0x7f74e4152010 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e40b3190 con 0x7f74e4152010 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4011ad0 con 0x7f74e4152010 2023-10-08T16:04:54.166 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.163+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e41419d0 con 0x7f74e4152010 2023-10-08T16:04:54.167 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.164+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e406d800 con 0x7f74e4152010 2023-10-08T16:04:54.167 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.164+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74d4001020 con 0x7f74e4152010 2023-10-08T16:04:54.167 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.165+0000 7f74d27fc700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74c4066f30 0x7f74c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.167 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.165+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f74d4083610 con 0x7f74e4152010 2023-10-08T16:04:54.167 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.165+0000 7f74e1d9b700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74c4066f30 0x7f74c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.167 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.165+0000 7f74e1d9b700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74c4066f30 0x7f74c40693e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f74e406f170 tx=0x7f74d8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.170 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.170+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74d4050bd0 con 0x7f74e4152010 2023-10-08T16:04:54.363 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.362+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e404c3c0 con 0x7f74e4152010 2023-10-08T16:04:54.363 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.363+0000 7f74d27fc700 1 -- 172.21.15.60:0/1130771253 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f74d4017020 con 0x7f74e4152010 2023-10-08T16:04:54.364 INFO:teuthology.misc.health.smithi060.stdout: 2023-10-08T16:04:54.364 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":16,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:04:51.930878+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:54.365 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74c4066f30 msgr2=0x7f74c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.366 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74c4066f30 0x7f74c40693e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f74e406f170 tx=0x7f74d8017000 comp rx=0 tx=0).stop 2023-10-08T16:04:54.366 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 msgr2=0x7f74e4141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.366 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 0x7f74e4141490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f74d400c4e0 tx=0x7f74d400c8a0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.366 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 shutdown_connections 2023-10-08T16:04:54.366 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74c4066f30 0x7f74c40693e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.366 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74e4158e50 0x7f74e40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.367 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74e4152010 0x7f74e4141490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.367 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 --2- 172.21.15.60:0/1130771253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e41523e0 0x7f74e40b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.367 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 >> 172.21.15.60:0/1130771253 conn(0x7f74e4069870 msgr2=0x7f74e4150760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:54.367 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 shutdown_connections 2023-10-08T16:04:54.367 INFO:teuthology.misc.health.smithi060.stderr:2023-10-08T16:04:54.365+0000 7f74e89aa700 1 -- 172.21.15.60:0/1130771253 wait complete. 2023-10-08T16:04:54.376 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T16:04:54.376 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T16:04:54.377 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:04:54.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:04:54.379 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:04:54.379 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:04:54.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:04:54.381 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:04:54.381 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:04:54.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:04:54.384 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:04:54.384 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:04:54.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:04:54.386 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:04:54.387 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T16:04:54.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:54.456 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:04:54.456 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:04:54.467 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:04:54.467 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:04:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 Processor -- start 2023-10-08T16:04:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 -- start start 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc0afff0 0x7f3edc15e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3edc069e20 0x7f3edc06a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0b03c0 con 0x7f3edc070700 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc06a870 con 0x7f3edc069e20 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.514+0000 7f3ee1e1b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc06ab50 con 0x7f3edc0afff0 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edaffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3edc069e20 0x7f3edc06a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edb7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc0afff0 0x7f3edc15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edbfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3edc070700 0x7f3edc06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:41066/0 (socket says 172.21.15.60:41066) 2023-10-08T16:04:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edbfff700 1 -- 172.21.15.60:0/3737669611 learned_addr learned my addr 172.21.15.60:0/3737669611 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:04:54.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3eda7fc700 1 -- 172.21.15.60:0/3737669611 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115370948 0 0) 0x7f3edc0b03c0 con 0x7f3edc070700 2023-10-08T16:04:54.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3eda7fc700 1 -- 172.21.15.60:0/3737669611 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec4003570 con 0x7f3edc070700 2023-10-08T16:04:54.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edb7fe700 1 -- 172.21.15.60:0/3737669611 >> v2:172.21.15.144:3300/0 conn(0x7f3edc069e20 msgr2=0x7f3edc06a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edb7fe700 1 --2- 172.21.15.60:0/3737669611 >> v2:172.21.15.144:3300/0 conn(0x7f3edc069e20 0x7f3edc06a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edb7fe700 1 -- 172.21.15.60:0/3737669611 >> v1:172.21.15.144:6789/0 conn(0x7f3edc070700 legacy=0x7f3edc06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edb7fe700 1 -- 172.21.15.60:0/3737669611 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc15da60 con 0x7f3edc0afff0 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edaffd700 1 --2- 172.21.15.60:0/3737669611 >> v2:172.21.15.144:3300/0 conn(0x7f3edc069e20 0x7f3edc06a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.515+0000 7f3edb7fe700 1 --2- 172.21.15.60:0/3737669611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc0afff0 0x7f3edc15e540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098e0 tx=0x7f3ecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c465be2ad5c1746 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3eda7fc700 1 -- 172.21.15.60:0/3737669611 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc011630 con 0x7f3edc0afff0 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3eda7fc700 1 -- 172.21.15.60:0/3737669611 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc011790 con 0x7f3edc0afff0 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3eda7fc700 1 -- 172.21.15.60:0/3737669611 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc011b10 con 0x7f3edc0afff0 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3737669611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc0afff0 msgr2=0x7f3edc15e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3737669611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc0afff0 0x7f3edc15e540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098e0 tx=0x7f3ecc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3737669611 shutdown_connections 2023-10-08T16:04:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3737669611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc0afff0 0x7f3edc15e540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3737669611 >> v2:172.21.15.144:3300/0 conn(0x7f3edc069e20 0x7f3edc06a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3737669611 >> 172.21.15.60:0/3737669611 conn(0x7f3edc0cda50 msgr2=0x7f3edc0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:54.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3737669611 shutdown_connections 2023-10-08T16:04:54.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.516+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3737669611 wait complete. 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.517+0000 7f3ee1e1b700 1 Processor -- start 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 -- start start 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3edc069e20 0x7f3edc158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc070700 0x7f3edc0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 0x7f3edc0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc16a040 con 0x7f3edc0afff0 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0b1c40 con 0x7f3edc069e20 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3ee1e1b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0b1f20 con 0x7f3edc070700 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 0x7f3edc0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 0x7f3edc0c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42616/0 (socket says 172.21.15.60:42616) 2023-10-08T16:04:54.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.518+0000 7f3edbfff700 1 -- 172.21.15.60:0/3555842564 learned_addr learned my addr 172.21.15.60:0/3555842564 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edb7fe700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3edc069e20 0x7f3edc158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edaffd700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc070700 0x7f3edc0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edbfff700 1 -- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc070700 msgr2=0x7f3edc0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edbfff700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc070700 0x7f3edc0b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edbfff700 1 -- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3edc069e20 msgr2=0x7f3edc158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edbfff700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3edc069e20 0x7f3edc158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edbfff700 1 -- 172.21.15.60:0/3555842564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009420 con 0x7f3edc0afff0 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3edbfff700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 0x7f3edc0c6410 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4001460 tx=0x7f3ed4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400a890 con 0x7f3edc0afff0 2023-10-08T16:04:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400a9f0 con 0x7f3edc0afff0 2023-10-08T16:04:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc009420 con 0x7f3edc0afff0 2023-10-08T16:04:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400ad70 con 0x7f3edc0afff0 2023-10-08T16:04:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.519+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc0b24e0 con 0x7f3edc0afff0 2023-10-08T16:04:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.520+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc04c3c0 con 0x7f3edc0afff0 2023-10-08T16:04:54.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.521+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ed4007300 con 0x7f3edc0afff0 2023-10-08T16:04:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.521+0000 7f3ec37fe700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3ec8066f30 0x7f3ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.521+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3ed4084660 con 0x7f3edc0afff0 2023-10-08T16:04:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.521+0000 7f3edb7fe700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3ec8066f30 0x7f3ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.521+0000 7f3edb7fe700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3ec8066f30 0x7f3ec80693e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0091e0 tx=0x7f3ecc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.525+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ed4051c10 con 0x7f3edc0afff0 2023-10-08T16:04:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.721+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3edc16a180 con 0x7f3edc0afff0 2023-10-08T16:04:54.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.722+0000 7f3ec37fe700 1 -- 172.21.15.60:0/3555842564 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f3ed4055230 con 0x7f3edc0afff0 2023-10-08T16:04:54.722 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:54.722 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:04:51.930878+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3ec8066f30 msgr2=0x7f3ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3ec8066f30 0x7f3ec80693e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0091e0 tx=0x7f3ecc017000 comp rx=0 tx=0).stop 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 msgr2=0x7f3edc0c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 0x7f3edc0c6410 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4001460 tx=0x7f3ed4001ae0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 shutdown_connections 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3ec8066f30 0x7f3ec80693e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3edc0afff0 0x7f3edc0c6410 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3edc069e20 0x7f3edc158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 --2- 172.21.15.60:0/3555842564 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3edc070700 0x7f3edc0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 >> 172.21.15.60:0/3555842564 conn(0x7f3edc0cda50 msgr2=0x7f3edc070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 shutdown_connections 2023-10-08T16:04:54.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.724+0000 7f3ee1e1b700 1 -- 172.21.15.60:0/3555842564 wait complete. 2023-10-08T16:04:54.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:04:54.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:04:54.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.858+0000 7f3d3f59e700 1 Processor -- start 2023-10-08T16:04:54.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.858+0000 7f3d3f59e700 1 -- start start 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d400cce30 0x7f3d4015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d4006aa00 0x7f3d400b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3f59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400b4d70 con 0x7f3d400b6580 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400cd8d0 con 0x7f3d4006aa00 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400b4440 con 0x7f3d400cce30 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d4006aa00 0x7f3d400b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d4006aa00 0x7f3d400b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42624/0 (socket says 172.21.15.60:42624) 2023-10-08T16:04:54.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/2808181276 learned_addr learned my addr 172.21.15.60:0/2808181276 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3e59c700 1 --2- 172.21.15.60:0/2808181276 >> v2:172.21.15.144:3300/0 conn(0x7f3d400cce30 0x7f3d4015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/2808181276 >> v2:172.21.15.144:3300/0 conn(0x7f3d400cce30 msgr2=0x7f3d4015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 --2- 172.21.15.60:0/2808181276 >> v2:172.21.15.144:3300/0 conn(0x7f3d400cce30 0x7f3d4015aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/2808181276 >> v1:172.21.15.144:6789/0 conn(0x7f3d400b6580 legacy=0x7f3d4006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/2808181276 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400b4720 con 0x7f3d4006aa00 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.859+0000 7f3d3ed9d700 1 --2- 172.21.15.60:0/2808181276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4006aa00 0x7f3d400b5200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d400b3770 tx=0x7f3d38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50702ace265522a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3d59a700 1 -- 172.21.15.60:0/2808181276 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38009e70 con 0x7f3d4006aa00 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3d59a700 1 -- 172.21.15.60:0/2808181276 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3800b860 con 0x7f3d4006aa00 2023-10-08T16:04:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3d59a700 1 -- 172.21.15.60:0/2808181276 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800bc00 con 0x7f3d4006aa00 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 -- 172.21.15.60:0/2808181276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4006aa00 msgr2=0x7f3d400b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/2808181276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4006aa00 0x7f3d400b5200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d400b3770 tx=0x7f3d38009250 comp rx=0 tx=0).stop 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 -- 172.21.15.60:0/2808181276 shutdown_connections 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/2808181276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4006aa00 0x7f3d400b5200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/2808181276 >> v2:172.21.15.144:3300/0 conn(0x7f3d400cce30 0x7f3d4015aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 -- 172.21.15.60:0/2808181276 >> 172.21.15.60:0/2808181276 conn(0x7f3d40068cb0 msgr2=0x7f3d400690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 -- 172.21.15.60:0/2808181276 shutdown_connections 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.860+0000 7f3d3f59e700 1 -- 172.21.15.60:0/2808181276 wait complete. 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.861+0000 7f3d3f59e700 1 Processor -- start 2023-10-08T16:04:54.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.861+0000 7f3d3f59e700 1 -- start start 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d4006aa00 0x7f3d4015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d400b6580 0x7f3d401496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 0x7f3d40169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4016aca0 con 0x7f3d400cce30 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400cf1d0 con 0x7f3d400b6580 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40151390 con 0x7f3d4006aa00 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 0x7f3d40169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 0x7f3d40169d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42636/0 (socket says 172.21.15.60:42636) 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/1598488855 learned_addr learned my addr 172.21.15.60:0/1598488855 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3e59c700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d4006aa00 0x7f3d4015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3dd9b700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d400b6580 0x7f3d401496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d4006aa00 msgr2=0x7f3d4015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.862+0000 7f3d3ed9d700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d4006aa00 0x7f3d4015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d400b6580 msgr2=0x7f3d401496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3ed9d700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d400b6580 0x7f3d401496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3ed9d700 1 -- 172.21.15.60:0/1598488855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380094f0 con 0x7f3d400cce30 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3e59c700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d4006aa00 0x7f3d4015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3ed9d700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 0x7f3d40169d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009290 tx=0x7f3d38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011420 con 0x7f3d400cce30 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d380115a0 con 0x7f3d400cce30 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d40151950 con 0x7f3d400cce30 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011960 con 0x7f3d400cce30 2023-10-08T16:04:54.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.863+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401603c0 con 0x7f3d400cce30 2023-10-08T16:04:54.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.864+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d40089550 con 0x7f3d400cce30 2023-10-08T16:04:54.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.864+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d38011cd0 con 0x7f3d400cce30 2023-10-08T16:04:54.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.865+0000 7f3d367fc700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3d20066f30 0x7f3d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:54.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.865+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d38085bc0 con 0x7f3d400cce30 2023-10-08T16:04:54.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.865+0000 7f3d3e59c700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3d20066f30 0x7f3d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:54.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.865+0000 7f3d3e59c700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3d20066f30 0x7f3d200693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d30007620 tx=0x7f3d3000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:54.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:54.869+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d38053180 con 0x7f3d400cce30 2023-10-08T16:04:55.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.060+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d400b4a00 con 0x7f3d400cce30 2023-10-08T16:04:55.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.060+0000 7f3d367fc700 1 -- 172.21.15.60:0/1598488855 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d380150a0 con 0x7f3d400cce30 2023-10-08T16:04:55.061 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:04:55.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3d20066f30 msgr2=0x7f3d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3d20066f30 0x7f3d200693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d30007620 tx=0x7f3d3000b040 comp rx=0 tx=0).stop 2023-10-08T16:04:55.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 msgr2=0x7f3d40169d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 0x7f3d40169d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009290 tx=0x7f3d38017000 comp rx=0 tx=0).stop 2023-10-08T16:04:55.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 shutdown_connections 2023-10-08T16:04:55.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3d20066f30 0x7f3d200693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d4006aa00 0x7f3d4015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cce30 0x7f3d40169d70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 --2- 172.21.15.60:0/1598488855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d400b6580 0x7f3d401496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 >> 172.21.15.60:0/1598488855 conn(0x7f3d40068cb0 msgr2=0x7f3d400b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:55.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.062+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 shutdown_connections 2023-10-08T16:04:55.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.063+0000 7f3d3f59e700 1 -- 172.21.15.60:0/1598488855 wait complete. 2023-10-08T16:04:55.075 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:55.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.194+0000 7f7797dc2700 1 Processor -- start 2023-10-08T16:04:55.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.194+0000 7f7797dc2700 1 -- start start 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7797dc2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7790157870 0x7f779015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7797dc2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f7790158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7797dc2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779015cbb0 con 0x7f779015a620 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7797dc2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779015bfa0 con 0x7f7790157870 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7797dc2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779015c280 con 0x7f7790157c40 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7795b5e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7790157870 0x7f779015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f779635f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f7790158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7795b5e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7790157870 0x7f779015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:39318/0 (socket says 172.21.15.60:39318) 2023-10-08T16:04:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f779635f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f7790158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:38040/0 (socket says 172.21.15.60:38040) 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f7795b5e700 1 -- 172.21.15.60:0/844823146 learned_addr learned my addr 172.21.15.60:0/844823146 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.195+0000 7f779535d700 1 --1- 172.21.15.60:0/844823146 >> v1:172.21.15.144:6789/0 conn(0x7f779015a620 0x7f779015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:41082/0 (socket says 172.21.15.60:41082) 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7795b5e700 1 -- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 msgr2=0x7f7790158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7795b5e700 1 --2- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f7790158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7795b5e700 1 -- 172.21.15.60:0/844823146 >> v1:172.21.15.144:6789/0 conn(0x7f779015a620 legacy=0x7f779015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7795b5e700 1 -- 172.21.15.60:0/844823146 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779015c560 con 0x7f7790157870 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f779635f700 1 --2- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f7790158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7794b5c700 1 -- 172.21.15.60:0/844823146 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541343702 0 0) 0x7f779015cbb0 con 0x7f779015a620 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7795b5e700 1 --2- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f779015b6a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7780009f20 tx=0x7f7780009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c17ce72e586ab441 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:55.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7794b5c700 1 -- 172.21.15.60:0/844823146 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000e070 con 0x7f7790157870 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7794b5c700 1 -- 172.21.15.60:0/844823146 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778000b9d0 con 0x7f7790157870 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7794b5c700 1 -- 172.21.15.60:0/844823146 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800092e0 con 0x7f7790157870 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7797dc2700 1 -- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 msgr2=0x7f779015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7797dc2700 1 --2- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f779015b6a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7780009f20 tx=0x7f7780009840 comp rx=0 tx=0).stop 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7797dc2700 1 -- 172.21.15.60:0/844823146 shutdown_connections 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7797dc2700 1 --2- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f7790158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7797dc2700 1 --2- 172.21.15.60:0/844823146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f779015b6a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.196+0000 7f7797dc2700 1 -- 172.21.15.60:0/844823146 >> 172.21.15.60:0/844823146 conn(0x7f7790068ce0 msgr2=0x7f77900690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.197+0000 7f7797dc2700 1 -- 172.21.15.60:0/844823146 shutdown_connections 2023-10-08T16:04:55.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.197+0000 7f7797dc2700 1 -- 172.21.15.60:0/844823146 wait complete. 2023-10-08T16:04:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 Processor -- start 2023-10-08T16:04:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 -- start start 2023-10-08T16:04:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f7790156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f77900b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 0x7f77900a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900b2e50 con 0x7f779015a620 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779016b700 con 0x7f7790157870 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f7797dc2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900a7d00 con 0x7f7790157c40 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f779635f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 0x7f77900a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f779635f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 0x7f77900a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42644/0 (socket says 172.21.15.60:42644) 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.198+0000 7f779635f700 1 -- 172.21.15.60:0/4026743103 learned_addr learned my addr 172.21.15.60:0/4026743103 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f7795b5e700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f7790156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779535d700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f77900b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779635f700 1 -- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 msgr2=0x7f77900b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779635f700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f77900b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779635f700 1 -- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 msgr2=0x7f7790156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779635f700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f7790156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779635f700 1 -- 172.21.15.60:0/4026743103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009420 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f779635f700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 0x7f77900a9310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f778800ec50 tx=0x7f77880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800c850 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800c9b0 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7780009ae0 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800cd30 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.199+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77900a76b0 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.200+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77900a7e70 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.201+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7788013680 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.201+0000 7f778dffb700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f777c066f30 0x7f777c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.201+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7788084400 con 0x7f779015a620 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.201+0000 7f7795b5e700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f777c066f30 0x7f777c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:55.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.202+0000 7f7795b5e700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f777c066f30 0x7f777c0693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7780009880 tx=0x7f7780018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.206+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77880519c0 con 0x7f779015a620 2023-10-08T16:04:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.441+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f779004c3c0 con 0x7f779015a620 2023-10-08T16:04:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.442+0000 7f778dffb700 1 -- 172.21.15.60:0/4026743103 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f7788054fe0 con 0x7f779015a620 2023-10-08T16:04:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:55.442 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-08T16:04:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f777c066f30 msgr2=0x7f777c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f777c066f30 0x7f777c0693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7780009880 tx=0x7f7780018000 comp rx=0 tx=0).stop 2023-10-08T16:04:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 msgr2=0x7f77900a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 0x7f77900a9310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f778800ec50 tx=0x7f77880091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 shutdown_connections 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f777c066f30 0x7f777c0693e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779015a620 0x7f77900a9310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7790157870 0x7f7790156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 --2- 172.21.15.60:0/4026743103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7790157c40 0x7f77900b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 >> 172.21.15.60:0/4026743103 conn(0x7f7790068ce0 msgr2=0x7f77900b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 shutdown_connections 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:55.444+0000 7f7797dc2700 1 -- 172.21.15.60:0/4026743103 wait complete. 2023-10-08T16:04:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 2 2023-10-08T16:04:57.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:57.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.589+0000 7f8f30b4d700 1 Processor -- start 2023-10-08T16:04:57.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.589+0000 7f8f30b4d700 1 -- start start 2023-10-08T16:04:57.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.590+0000 7f8f30b4d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f2c157870 0x7f8f2c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.590+0000 7f8f30b4d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f2c157c40 0x7f8f2c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.590+0000 7f8f30b4d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c15cbb0 con 0x7f8f2c15a620 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.590+0000 7f8f30b4d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c15bfa0 con 0x7f8f2c157c40 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.590+0000 7f8f30b4d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c15c280 con 0x7f8f2c157870 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f2c157c40 0x7f8f2c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f2c157c40 0x7f8f2c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42660/0 (socket says 172.21.15.60:42660) 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 -- 172.21.15.60:0/3403554552 learned_addr learned my addr 172.21.15.60:0/3403554552 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2a59c700 1 --2- 172.21.15.60:0/3403554552 >> v2:172.21.15.144:3300/0 conn(0x7f8f2c157870 0x7f8f2c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 -- 172.21.15.60:0/3403554552 >> v2:172.21.15.144:3300/0 conn(0x7f8f2c157870 msgr2=0x7f8f2c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 --2- 172.21.15.60:0/3403554552 >> v2:172.21.15.144:3300/0 conn(0x7f8f2c157870 0x7f8f2c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 -- 172.21.15.60:0/3403554552 >> v1:172.21.15.144:6789/0 conn(0x7f8f2c15a620 legacy=0x7f8f2c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 -- 172.21.15.60:0/3403554552 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c15c560 con 0x7f8f2c157c40 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2ad9d700 1 --2- 172.21.15.60:0/3403554552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157c40 0x7f8f2c158110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c069d80 tx=0x7f8f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48be2bacd7533693 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2959a700 1 -- 172.21.15.60:0/3403554552 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24009e70 con 0x7f8f2c157c40 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2959a700 1 -- 172.21.15.60:0/3403554552 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400b860 con 0x7f8f2c157c40 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.591+0000 7f8f2959a700 1 -- 172.21.15.60:0/3403554552 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400bc00 con 0x7f8f2c157c40 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3403554552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157c40 msgr2=0x7f8f2c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3403554552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157c40 0x7f8f2c158110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c069d80 tx=0x7f8f24009250 comp rx=0 tx=0).stop 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3403554552 shutdown_connections 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3403554552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157c40 0x7f8f2c158110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3403554552 >> v2:172.21.15.144:3300/0 conn(0x7f8f2c157870 0x7f8f2c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3403554552 >> 172.21.15.60:0/3403554552 conn(0x7f8f2c068ce0 msgr2=0x7f8f2c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3403554552 shutdown_connections 2023-10-08T16:04:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.592+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3403554552 wait complete. 2023-10-08T16:04:57.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.593+0000 7f8f30b4d700 1 Processor -- start 2023-10-08T16:04:57.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.593+0000 7f8f30b4d700 1 -- start start 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f30b4d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 0x7f8f2c13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f30b4d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f2c157c40 0x7f8f2c14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f30b4d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c15a620 0x7f8f2c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f30b4d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0b1400 con 0x7f8f2c157870 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f30b4d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0b07f0 con 0x7f8f2c157c40 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f30b4d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0b0ad0 con 0x7f8f2c15a620 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 0x7f8f2c13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 0x7f8f2c13f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42674/0 (socket says 172.21.15.60:42674) 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 -- 172.21.15.60:0/3876354247 learned_addr learned my addr 172.21.15.60:0/3876354247 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2ad9d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c15a620 0x7f8f2c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f29d9b700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f2c157c40 0x7f8f2c14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 -- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c15a620 msgr2=0x7f8f2c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c15a620 0x7f8f2c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 -- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f2c157c40 msgr2=0x7f8f2c14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f2c157c40 0x7f8f2c14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 -- 172.21.15.60:0/3876354247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240094f0 con 0x7f8f2c157870 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f29d9b700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f2c157c40 0x7f8f2c14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.594+0000 7f8f2a59c700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 0x7f8f2c13f920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009ef0 tx=0x7f8f1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.595+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00cc20 con 0x7f8f2c157870 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.595+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00f040 con 0x7f8f2c157870 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.595+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c0b0db0 con 0x7f8f2c157870 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.595+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c014480 con 0x7f8f2c157870 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.595+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c14ff20 con 0x7f8f2c157870 2023-10-08T16:04:57.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.596+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c04c3c0 con 0x7f8f2c157870 2023-10-08T16:04:57.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.596+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f1c0147f0 con 0x7f8f2c157870 2023-10-08T16:04:57.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.596+0000 7f8f227fc700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f0c066f30 0x7f8f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.596+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8f1c084e90 con 0x7f8f2c157870 2023-10-08T16:04:57.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.596+0000 7f8f29d9b700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f0c066f30 0x7f8f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.597+0000 7f8f29d9b700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f0c066f30 0x7f8f0c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007fd0 tx=0x7f8f14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:57.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.601+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f1c052450 con 0x7f8f2c157870 2023-10-08T16:04:57.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.838+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f2c15c840 con 0x7f8f2c157870 2023-10-08T16:04:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.838+0000 7f8f227fc700 1 -- 172.21.15.60:0/3876354247 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f8f1c055a70 con 0x7f8f2c157870 2023-10-08T16:04:57.840 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:57.840 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-08T16:04:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.840+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f0c066f30 msgr2=0x7f8f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.840+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f0c066f30 0x7f8f0c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007fd0 tx=0x7f8f14009040 comp rx=0 tx=0).stop 2023-10-08T16:04:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.840+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 msgr2=0x7f8f2c13f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.840+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 0x7f8f2c13f920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009ef0 tx=0x7f8f1c00b040 comp rx=0 tx=0).stop 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 shutdown_connections 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f0c066f30 0x7f8f0c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f2c15a620 0x7f8f2c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c157870 0x7f8f2c13f920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 --2- 172.21.15.60:0/3876354247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f2c157c40 0x7f8f2c14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 >> 172.21.15.60:0/3876354247 conn(0x7f8f2c068ce0 msgr2=0x7f8f2c0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 shutdown_connections 2023-10-08T16:04:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.841+0000 7f8f30b4d700 1 -- 172.21.15.60:0/3876354247 wait complete. 2023-10-08T16:04:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 3 2023-10-08T16:04:57.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.972+0000 7f3300c51700 1 Processor -- start 2023-10-08T16:04:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.972+0000 7f3300c51700 1 -- start start 2023-10-08T16:04:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f3300c51700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32fc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f3300c51700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32fc15cbd0 0x7f32fc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f3300c51700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc0cb7c0 con 0x7f32fc0cdab0 2023-10-08T16:04:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f3300c51700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc15e850 con 0x7f32fc15cbd0 2023-10-08T16:04:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f3300c51700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0cd030 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f32faffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f32fc0cdab0 0x7f32fc15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47120/0 (socket says 172.21.15.60:47120) 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f32faffd700 1 -- 172.21.15.60:0/2319260452 learned_addr learned my addr 172.21.15.60:0/2319260452 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32fc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f32fbfff700 1 --2- 172.21.15.60:0/2319260452 >> v2:172.21.15.144:3300/0 conn(0x7f32fc15cbd0 0x7f32fc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757905301 0 0) 0x7f32fc0cb7c0 con 0x7f32fc0cdab0 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.973+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e4003570 con 0x7f32fc0cdab0 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3113824074 0 0) 0x7f32e4003570 con 0x7f32fc0cdab0 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 msgr2=0x7f32fc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32fc0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 >> v2:172.21.15.144:3300/0 conn(0x7f32fc15cbd0 msgr2=0x7f32fc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 --2- 172.21.15.60:0/2319260452 >> v2:172.21.15.144:3300/0 conn(0x7f32fc15cbd0 0x7f32fc15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15e290 con 0x7f32fc0cdab0 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f32f0001470 con 0x7f32fc0cdab0 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 >> v1:172.21.15.60:6789/0 conn(0x7f32fc0cdab0 legacy=0x7f32fc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32e4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e4003fe0 0x7f32e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4004d50 0x7f32e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15e850 con 0x7f32e4004d50 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0cd030 con 0x7f32e4003fe0 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e400ba90 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fbfff700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4004d50 0x7f32e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32e4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32faffd700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e4003fe0 0x7f32e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 -- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e4003fe0 msgr2=0x7f32e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e4003fe0 0x7f32e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 -- 172.21.15.60:0/2319260452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4004d50 msgr2=0x7f32e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4004d50 0x7f32e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 -- 172.21.15.60:0/2319260452 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4003570 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fbfff700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4004d50 0x7f32e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.974+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32e4003a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009c00 tx=0x7f32ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5119c1df9fac186 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00e6b0 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec00e810 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f32fa7fc700 1 -- 172.21.15.60:0/2319260452 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00ebd0 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f3300c51700 1 -- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 msgr2=0x7f32e4003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f3300c51700 1 --2- 172.21.15.60:0/2319260452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0cd6e0 0x7f32e4003a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009c00 tx=0x7f32ec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f32fbfff700 1 -- 172.21.15.60:0/2319260452 reap_dead start 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f3300c51700 1 -- 172.21.15.60:0/2319260452 shutdown_connections 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f3300c51700 1 -- 172.21.15.60:0/2319260452 >> 172.21.15.60:0/2319260452 conn(0x7f32fc067660 msgr2=0x7f32fc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f3300c51700 1 -- 172.21.15.60:0/2319260452 shutdown_connections 2023-10-08T16:04:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.975+0000 7f3300c51700 1 -- 172.21.15.60:0/2319260452 wait complete. 2023-10-08T16:04:57.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.976+0000 7f3300c51700 1 Processor -- start 2023-10-08T16:04:57.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.976+0000 7f3300c51700 1 -- start start 2023-10-08T16:04:57.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f3300c51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 0x7f32fc16b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f3300c51700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0b5f50 0x7f32fc0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f3300c51700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32fc0c8260 0x7f32fc0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f3300c51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc16be00 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f3300c51700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0c86d0 con 0x7f32fc0c8260 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f3300c51700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b6730 con 0x7f32fc0b5f50 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 0x7f32fc16b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 0x7f32fc16b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42682/0 (socket says 172.21.15.60:42682) 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f32fb7fe700 1 -- 172.21.15.60:0/3553517373 learned_addr learned my addr 172.21.15.60:0/3553517373 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f32fbfff700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32fc0c8260 0x7f32fc0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.977+0000 7f32faffd700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0b5f50 0x7f32fc0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fb7fe700 1 -- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0b5f50 msgr2=0x7f32fc0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0b5f50 0x7f32fc0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fb7fe700 1 -- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32fc0c8260 msgr2=0x7f32fc0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32fc0c8260 0x7f32fc0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:57.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fb7fe700 1 -- 172.21.15.60:0/3553517373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0b3a10 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fbfff700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32fc0c8260 0x7f32fc0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32fb7fe700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 0x7f32fc16b8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00e4b0 tx=0x7f32ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec022070 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec00e980 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc0b3cf0 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec027470 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.978+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc0b42b0 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.979+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc16be00 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.979+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32ec0278a0 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.980+0000 7f32e37fe700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f32e8066f30 0x7f32e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.980+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f32ec085cd0 con 0x7f32fc0cd6e0 2023-10-08T16:04:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.980+0000 7f32faffd700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f32e8066f30 0x7f32e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:57.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.980+0000 7f32faffd700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f32e8066f30 0x7f32e80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001620 tx=0x7f32f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:57.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:57.984+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32ec053340 con 0x7f32fc0cd6e0 2023-10-08T16:04:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.177+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32fc15e570 con 0x7f32fc0cd6e0 2023-10-08T16:04:58.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.177+0000 7f32e37fe700 1 -- 172.21.15.60:0/3553517373 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f32ec056960 con 0x7f32fc0cd6e0 2023-10-08T16:04:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:58.179 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:04:51.930878+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f32e8066f30 msgr2=0x7f32e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f32e8066f30 0x7f32e80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001620 tx=0x7f32f0009040 comp rx=0 tx=0).stop 2023-10-08T16:04:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 msgr2=0x7f32fc16b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 0x7f32fc16b8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00e4b0 tx=0x7f32ec01a000 comp rx=0 tx=0).stop 2023-10-08T16:04:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 shutdown_connections 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f32e8066f30 0x7f32e80693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32fc0c8260 0x7f32fc0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32fc0cd6e0 0x7f32fc16b8c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 --2- 172.21.15.60:0/3553517373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32fc0b5f50 0x7f32fc0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.179+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 >> 172.21.15.60:0/3553517373 conn(0x7f32fc067660 msgr2=0x7f32fc06a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.180+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 shutdown_connections 2023-10-08T16:04:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.180+0000 7f3300c51700 1 -- 172.21.15.60:0/3553517373 wait complete. 2023-10-08T16:04:58.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:04:58.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:04:58.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.316+0000 7f4972270700 1 Processor -- start 2023-10-08T16:04:58.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.316+0000 7f4972270700 1 -- start start 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.316+0000 7f4972270700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c159ec0 0x7f496c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.316+0000 7f4972270700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f496c06acb0 0x7f496c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.316+0000 7f4972270700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0b0790 con 0x7f496c15a290 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.316+0000 7f4972270700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0ce1f0 con 0x7f496c06acb0 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f4972270700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0b0b20 con 0x7f496c159ec0 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f496c06acb0 0x7f496c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f496c06acb0 0x7f496c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42694/0 (socket says 172.21.15.60:42694) 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 -- 172.21.15.60:0/2411177385 learned_addr learned my addr 172.21.15.60:0/2411177385 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f496bfff700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c159ec0 0x7f496c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 -- 172.21.15.60:0/2411177385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c159ec0 msgr2=0x7f496c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c159ec0 0x7f496c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 -- 172.21.15.60:0/2411177385 >> v1:172.21.15.144:6789/0 conn(0x7f496c15a290 legacy=0x7f496c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 -- 172.21.15.60:0/2411177385 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0b04b0 con 0x7f496c06acb0 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f496bfff700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c159ec0 0x7f496c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f497080d700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c06acb0 0x7f496c0afe80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4964009f20 tx=0x7f4964009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d3d85bd92d233 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f496affd700 1 -- 172.21.15.60:0/2411177385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400e070 con 0x7f496c06acb0 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f496affd700 1 -- 172.21.15.60:0/2411177385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496400ba80 con 0x7f496c06acb0 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.317+0000 7f496affd700 1 -- 172.21.15.60:0/2411177385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49640092e0 con 0x7f496c06acb0 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 -- 172.21.15.60:0/2411177385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c06acb0 msgr2=0x7f496c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c06acb0 0x7f496c0afe80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4964009f20 tx=0x7f4964009840 comp rx=0 tx=0).stop 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 -- 172.21.15.60:0/2411177385 shutdown_connections 2023-10-08T16:04:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c06acb0 0x7f496c0afe80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 --2- 172.21.15.60:0/2411177385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c159ec0 0x7f496c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 -- 172.21.15.60:0/2411177385 >> 172.21.15.60:0/2411177385 conn(0x7f496c0d1880 msgr2=0x7f496c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 -- 172.21.15.60:0/2411177385 shutdown_connections 2023-10-08T16:04:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.318+0000 7f4972270700 1 -- 172.21.15.60:0/2411177385 wait complete. 2023-10-08T16:04:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.319+0000 7f4972270700 1 Processor -- start 2023-10-08T16:04:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.319+0000 7f4972270700 1 -- start start 2023-10-08T16:04:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f4972270700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c06acb0 0x7f496c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f4972270700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 0x7f496c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f4972270700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f496c15a290 0x7f496c0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f4972270700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c8e30 con 0x7f496c159ec0 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f4972270700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c8220 con 0x7f496c15a290 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f4972270700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c8500 con 0x7f496c06acb0 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 0x7f496c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 0x7f496c158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42708/0 (socket says 172.21.15.60:42708) 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 -- 172.21.15.60:0/657665706 learned_addr learned my addr 172.21.15.60:0/657665706 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496bfff700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c06acb0 0x7f496c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f497080d700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f496c15a290 0x7f496c0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 -- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c06acb0 msgr2=0x7f496c1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c06acb0 0x7f496c1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 -- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f496c15a290 msgr2=0x7f496c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f496c15a290 0x7f496c0b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 -- 172.21.15.60:0/657665706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964009ae0 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496bfff700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c06acb0 0x7f496c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.320+0000 7f496b7fe700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 0x7f496c158c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f496000c4e0 tx=0x7f496000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.321+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960011590 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.321+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960011710 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.321+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960011ad0 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.321+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c0c87e0 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.321+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c0c7e60 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.322+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c04c3c0 con 0x7f496c159ec0 2023-10-08T16:04:58.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.322+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f496001b3b0 con 0x7f496c159ec0 2023-10-08T16:04:58.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.322+0000 7f4953fff700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4958066f30 0x7f49580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.323+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4960083650 con 0x7f496c159ec0 2023-10-08T16:04:58.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.323+0000 7f496bfff700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4958066f30 0x7f49580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.323+0000 7f496bfff700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4958066f30 0x7f49580693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f495c006f00 tx=0x7f495c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.327+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4960050c10 con 0x7f496c159ec0 2023-10-08T16:04:58.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.520+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f496c0ceab0 con 0x7f496c159ec0 2023-10-08T16:04:58.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.521+0000 7f4953fff700 1 -- 172.21.15.60:0/657665706 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4960017020 con 0x7f496c159ec0 2023-10-08T16:04:58.523 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:04:58.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4958066f30 msgr2=0x7f49580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4958066f30 0x7f49580693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f495c006f00 tx=0x7f495c008040 comp rx=0 tx=0).stop 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 msgr2=0x7f496c158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 0x7f496c158c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f496000c4e0 tx=0x7f496000c7f0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 shutdown_connections 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4958066f30 0x7f49580693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f496c06acb0 0x7f496c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f496c15a290 0x7f496c0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 --2- 172.21.15.60:0/657665706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496c159ec0 0x7f496c158c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 >> 172.21.15.60:0/657665706 conn(0x7f496c0d1880 msgr2=0x7f496c15f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:58.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 shutdown_connections 2023-10-08T16:04:58.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.523+0000 7f4972270700 1 -- 172.21.15.60:0/657665706 wait complete. 2023-10-08T16:04:58.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:04:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.653+0000 7f9be2f31700 1 Processor -- start 2023-10-08T16:04:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.653+0000 7f9be2f31700 1 -- start start 2023-10-08T16:04:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2f31700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cdab0 0x7f9bdc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2f31700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bdc15dda0 0x7f9bdc15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2f31700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bdc0cb7c0 con 0x7f9bdc0cd6e0 2023-10-08T16:04:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2f31700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bdc15e850 con 0x7f9bdc15dda0 2023-10-08T16:04:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2f31700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc0cc360 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be1f2f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9bdc0cd6e0 0x7f9bdc0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47126/0 (socket says 172.21.15.60:47126) 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be1f2f700 1 -- 172.21.15.60:0/2684179998 learned_addr learned my addr 172.21.15.60:0/2684179998 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2730700 1 --2- 172.21.15.60:0/2684179998 >> v2:172.21.15.60:3300/0 conn(0x7f9bdc15dda0 0x7f9bdc15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be172e700 1 --2- 172.21.15.60:0/2684179998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cdab0 0x7f9bdc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be0f2d700 1 -- 172.21.15.60:0/2684179998 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775577966 0 0) 0x7f9bdc0cb7c0 con 0x7f9bdc0cd6e0 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be0f2d700 1 -- 172.21.15.60:0/2684179998 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc4003570 con 0x7f9bdc0cd6e0 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2730700 1 -- 172.21.15.60:0/2684179998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cdab0 msgr2=0x7f9bdc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2730700 1 --2- 172.21.15.60:0/2684179998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cdab0 0x7f9bdc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2730700 1 -- 172.21.15.60:0/2684179998 >> v1:172.21.15.60:6789/0 conn(0x7f9bdc0cd6e0 legacy=0x7f9bdc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.654+0000 7f9be2730700 1 -- 172.21.15.60:0/2684179998 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc15e290 con 0x7f9bdc15dda0 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2730700 1 --2- 172.21.15.60:0/2684179998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc15cbd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40098e0 tx=0x7f9bd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426dffa57d9ee114 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be0f2d700 1 -- 172.21.15.60:0/2684179998 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4011630 con 0x7f9bdc15dda0 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be0f2d700 1 -- 172.21.15.60:0/2684179998 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd4011790 con 0x7f9bdc15dda0 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be0f2d700 1 -- 172.21.15.60:0/2684179998 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4011b30 con 0x7f9bdc15dda0 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 -- 172.21.15.60:0/2684179998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc15dda0 msgr2=0x7f9bdc15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 --2- 172.21.15.60:0/2684179998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc15cbd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40098e0 tx=0x7f9bd40091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 -- 172.21.15.60:0/2684179998 shutdown_connections 2023-10-08T16:04:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 --2- 172.21.15.60:0/2684179998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc15cbd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 --2- 172.21.15.60:0/2684179998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cdab0 0x7f9bdc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 -- 172.21.15.60:0/2684179998 >> 172.21.15.60:0/2684179998 conn(0x7f9bdc067660 msgr2=0x7f9bdc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 -- 172.21.15.60:0/2684179998 shutdown_connections 2023-10-08T16:04:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.655+0000 7f9be2f31700 1 -- 172.21.15.60:0/2684179998 wait complete. 2023-10-08T16:04:58.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.656+0000 7f9be2f31700 1 Processor -- start 2023-10-08T16:04:58.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.656+0000 7f9be2f31700 1 -- start start 2023-10-08T16:04:58.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2f31700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cd6e0 0x7f9bdc0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2f31700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 0x7f9bdc1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2f31700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2f31700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc154790 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2f31700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc16aca0 con 0x7f9bdc15dda0 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2f31700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc16af80 con 0x7f9bdc0cd6e0 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be172e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 0x7f9bdc1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be172e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 0x7f9bdc1562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42728/0 (socket says 172.21.15.60:42728) 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be172e700 1 -- 172.21.15.60:0/3665846931 learned_addr learned my addr 172.21.15.60:0/3665846931 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be1f2f700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cd6e0 0x7f9bdc0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.657+0000 7f9be2730700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be172e700 1 -- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cd6e0 msgr2=0x7f9bdc0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be172e700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cd6e0 0x7f9bdc0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be172e700 1 -- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc15dda0 msgr2=0x7f9bdc0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be172e700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be172e700 1 -- 172.21.15.60:0/3665846931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd4009420 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be172e700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 0x7f9bdc1562e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000ec80 tx=0x7f9bd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000c9d0 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd000cb30 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc16b260 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0013470 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.658+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc0b1360 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.659+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc089280 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.659+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bd0013820 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.660+0000 7f9bd9ffb700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bc8066f30 0x7f9bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.660+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9bd0084660 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.660+0000 7f9be1f2f700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bc8066f30 0x7f9bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.660+0000 7f9be1f2f700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bc8066f30 0x7f9bc80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc005c50 tx=0x7f9bcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.664+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bd0051c20 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.857+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9bdc1548d0 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.858+0000 7f9bd9ffb700 1 -- 172.21.15.60:0/3665846931 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9bd0055240 con 0x7f9bdc0cdab0 2023-10-08T16:04:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:04:58.859 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:04:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:04:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:04:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:04:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:04:58.860 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:04:58.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bc8066f30 msgr2=0x7f9bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bc8066f30 0x7f9bc80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc005c50 tx=0x7f9bcc009040 comp rx=0 tx=0).stop 2023-10-08T16:04:58.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 msgr2=0x7f9bdc1562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 0x7f9bdc1562e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000ec80 tx=0x7f9bd00091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 shutdown_connections 2023-10-08T16:04:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bc8066f30 0x7f9bc80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bdc0cd6e0 0x7f9bdc0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc15dda0 0x7f9bdc0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 --2- 172.21.15.60:0/3665846931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bdc0cdab0 0x7f9bdc1562e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 >> 172.21.15.60:0/3665846931 conn(0x7f9bdc067660 msgr2=0x7f9bdc0c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 shutdown_connections 2023-10-08T16:04:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.860+0000 7f9be2f31700 1 -- 172.21.15.60:0/3665846931 wait complete. 2023-10-08T16:04:58.873 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:04:58.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:04:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.995+0000 7f63f7d9c700 1 Processor -- start 2023-10-08T16:04:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.995+0000 7f63f7d9c700 1 -- start start 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f7d9c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f7d9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63f00b6a10 0x7f63f00b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f7d9c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f00b1a60 con 0x7f63f00b15e0 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f7d9c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f00b1d40 con 0x7f63f00b6a10 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f7d9c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00b2020 con 0x7f63f0159ef0 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63f00b6a10 0x7f63f00b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63f00b6a10 0x7f63f00b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42732/0 (socket says 172.21.15.60:42732) 2023-10-08T16:04:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 -- 172.21.15.60:0/93698798 learned_addr learned my addr 172.21.15.60:0/93698798 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5b38700 1 --2- 172.21.15.60:0/93698798 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 -- 172.21.15.60:0/93698798 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 msgr2=0x7f63f015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 --2- 172.21.15.60:0/93698798 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 -- 172.21.15.60:0/93698798 >> v1:172.21.15.144:6789/0 conn(0x7f63f00b15e0 legacy=0x7f63f00b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 -- 172.21.15.60:0/93698798 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00b2300 con 0x7f63f00b6a10 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f5337700 1 --2- 172.21.15.60:0/93698798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f00b6a10 0x7f63f00b10a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63e40099b0 tx=0x7f63e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f607132fbce0ea60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f4b36700 1 -- 172.21.15.60:0/93698798 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4009ea0 con 0x7f63f00b6a10 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f4b36700 1 -- 172.21.15.60:0/93698798 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400b860 con 0x7f63f00b6a10 2023-10-08T16:04:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.996+0000 7f63f4b36700 1 -- 172.21.15.60:0/93698798 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400bc00 con 0x7f63f00b6a10 2023-10-08T16:04:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 -- 172.21.15.60:0/93698798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f00b6a10 msgr2=0x7f63f00b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/93698798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f00b6a10 0x7f63f00b10a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63e40099b0 tx=0x7f63e4009250 comp rx=0 tx=0).stop 2023-10-08T16:04:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 -- 172.21.15.60:0/93698798 shutdown_connections 2023-10-08T16:04:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/93698798 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/93698798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f00b6a10 0x7f63f00b10a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 -- 172.21.15.60:0/93698798 >> 172.21.15.60:0/93698798 conn(0x7f63f009a0a0 msgr2=0x7f63f0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 -- 172.21.15.60:0/93698798 shutdown_connections 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.997+0000 7f63f7d9c700 1 -- 172.21.15.60:0/93698798 wait complete. 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.998+0000 7f63f7d9c700 1 Processor -- start 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.998+0000 7f63f7d9c700 1 -- start start 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f7d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63f00b6a10 0x7f63f016dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f7d9c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f00aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f7d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 0x7f63f00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f7d9c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00af8e0 con 0x7f63f014bba0 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f7d9c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00afdf0 con 0x7f63f00b6a10 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f7d9c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00abf90 con 0x7f63f0159ef0 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 0x7f63f00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 0x7f63f00af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42736/0 (socket says 172.21.15.60:42736) 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 -- 172.21.15.60:0/1789555678 learned_addr learned my addr 172.21.15.60:0/1789555678 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f5b38700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63f00b6a10 0x7f63f016dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f5337700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f00aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 -- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 msgr2=0x7f63f00aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f00aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 -- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63f00b6a10 msgr2=0x7f63f016dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63f00b6a10 0x7f63f016dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 -- 172.21.15.60:0/1789555678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40094f0 con 0x7f63f014bba0 2023-10-08T16:04:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:58.999+0000 7f63f6339700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 0x7f63f00af3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c910 tx=0x7f63e00016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.000+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0012630 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.000+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e00127b0 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.000+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0012b70 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.000+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f00afb10 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.000+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f00ac510 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.001+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f00ac730 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.001+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63e000a3b0 con 0x7f63f014bba0 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.001+0000 7f63edffb700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f63dc066f30 0x7f63dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.002+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f63e0084460 con 0x7f63f014bba0 2023-10-08T16:04:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.002+0000 7f63f5b38700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f63dc066f30 0x7f63dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.002+0000 7f63f5b38700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f63dc066f30 0x7f63dc0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009d00 tx=0x7f63e8009120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.006+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63e0051980 con 0x7f63f014bba0 2023-10-08T16:04:59.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.199+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f63f004c3c0 con 0x7f63f014bba0 2023-10-08T16:04:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.485+0000 7f63edffb700 1 -- 172.21.15.60:0/1789555678 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f63e0054fa0 con 0x7f63f014bba0 2023-10-08T16:04:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f63dc066f30 msgr2=0x7f63dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f63dc066f30 0x7f63dc0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009d00 tx=0x7f63e8009120 comp rx=0 tx=0).stop 2023-10-08T16:04:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 msgr2=0x7f63f00af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 0x7f63f00af3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c910 tx=0x7f63e00016f0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 shutdown_connections 2023-10-08T16:04:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f63dc066f30 0x7f63dc0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63f014bba0 0x7f63f00af3a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63f00b6a10 0x7f63f016dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 --2- 172.21.15.60:0/1789555678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63f0159ef0 0x7f63f00aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 >> 172.21.15.60:0/1789555678 conn(0x7f63f009a0a0 msgr2=0x7f63f00b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:59.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 shutdown_connections 2023-10-08T16:04:59.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.489+0000 7f63f7d9c700 1 -- 172.21.15.60:0/1789555678 wait complete. 2023-10-08T16:04:59.493 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:04:59.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:04:59.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.628+0000 7f90de1cd700 1 Processor -- start 2023-10-08T16:04:59.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.628+0000 7f90de1cd700 1 -- start start 2023-10-08T16:04:59.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90de1cd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90d8159ec0 0x7f90d80af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90de1cd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90d815a290 0x7f90d80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90de1cd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d80b0790 con 0x7f90d806a5a0 2023-10-08T16:04:59.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90de1cd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80ce1f0 con 0x7f90d815a290 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90de1cd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80b0b20 con 0x7f90d8159ec0 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90d6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90d815a290 0x7f90d80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90d7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f90d806a5a0 0x7f90d815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47132/0 (socket says 172.21.15.60:47132) 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90d7fff700 1 -- 172.21.15.60:0/2632877313 learned_addr learned my addr 172.21.15.60:0/2632877313 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.629+0000 7f90d77fe700 1 --2- 172.21.15.60:0/2632877313 >> v2:172.21.15.144:3300/0 conn(0x7f90d8159ec0 0x7f90d80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d6ffd700 1 -- 172.21.15.60:0/2632877313 >> v2:172.21.15.144:3300/0 conn(0x7f90d8159ec0 msgr2=0x7f90d80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d6ffd700 1 --2- 172.21.15.60:0/2632877313 >> v2:172.21.15.144:3300/0 conn(0x7f90d8159ec0 0x7f90d80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d6ffd700 1 -- 172.21.15.60:0/2632877313 >> v1:172.21.15.60:6789/0 conn(0x7f90d806a5a0 legacy=0x7f90d815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d6ffd700 1 -- 172.21.15.60:0/2632877313 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80b04b0 con 0x7f90d815a290 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d67fc700 1 -- 172.21.15.60:0/2632877313 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019715178 0 0) 0x7f90d80b0790 con 0x7f90d806a5a0 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d77fe700 1 --2- 172.21.15.60:0/2632877313 >> v2:172.21.15.144:3300/0 conn(0x7f90d8159ec0 0x7f90d80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:59.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d6ffd700 1 --2- 172.21.15.60:0/2632877313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d815a290 0x7f90d80afe80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90d80898e0 tx=0x7f90cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84bd19a922f7064 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d67fc700 1 -- 172.21.15.60:0/2632877313 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00b6b0 con 0x7f90d815a290 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d67fc700 1 -- 172.21.15.60:0/2632877313 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc00b810 con 0x7f90d815a290 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90d67fc700 1 -- 172.21.15.60:0/2632877313 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00bbb0 con 0x7f90d815a290 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 -- 172.21.15.60:0/2632877313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d815a290 msgr2=0x7f90d80afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 --2- 172.21.15.60:0/2632877313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d815a290 0x7f90d80afe80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90d80898e0 tx=0x7f90cc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 -- 172.21.15.60:0/2632877313 shutdown_connections 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 --2- 172.21.15.60:0/2632877313 >> v2:172.21.15.144:3300/0 conn(0x7f90d8159ec0 0x7f90d80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 --2- 172.21.15.60:0/2632877313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d815a290 0x7f90d80afe80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 -- 172.21.15.60:0/2632877313 >> 172.21.15.60:0/2632877313 conn(0x7f90d80d1880 msgr2=0x7f90d80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 -- 172.21.15.60:0/2632877313 shutdown_connections 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.630+0000 7f90de1cd700 1 -- 172.21.15.60:0/2632877313 wait complete. 2023-10-08T16:04:59.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 Processor -- start 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 -- start start 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 0x7f90d80b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90d8159ec0 0x7f90d8156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90d815a290 0x7f90d816ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8155da0 con 0x7f90d806a5a0 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8156770 con 0x7f90d815a290 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90de1cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d816b190 con 0x7f90d8159ec0 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90d77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 0x7f90d80b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90d77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 0x7f90d80b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42766/0 (socket says 172.21.15.60:42766) 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.632+0000 7f90d77fe700 1 -- 172.21.15.60:0/4226053202 learned_addr learned my addr 172.21.15.60:0/4226053202 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:04:59.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d7fff700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90d815a290 0x7f90d816ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d77fe700 1 -- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90d8159ec0 msgr2=0x7f90d8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d77fe700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90d8159ec0 0x7f90d8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d77fe700 1 -- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90d815a290 msgr2=0x7f90d816ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d77fe700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90d815a290 0x7f90d816ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d77fe700 1 -- 172.21.15.60:0/4226053202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc009420 con 0x7f90d806a5a0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90d77fe700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 0x7f90d80b6620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c860 tx=0x7f90c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8011600 con 0x7f90d806a5a0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8011760 con 0x7f90d806a5a0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d8155190 con 0x7f90d806a5a0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8011b00 con 0x7f90d806a5a0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.633+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8155750 con 0x7f90d806a5a0 2023-10-08T16:04:59.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.634+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d804c3c0 con 0x7f90d806a5a0 2023-10-08T16:04:59.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.635+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90c800a3e0 con 0x7f90d806a5a0 2023-10-08T16:04:59.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.635+0000 7f90bf7fe700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f90c4066f30 0x7f90c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:59.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.635+0000 7f90d6ffd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f90c4066f30 0x7f90c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:59.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.635+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f90c80843e0 con 0x7f90d806a5a0 2023-10-08T16:04:59.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.636+0000 7f90d6ffd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f90c4066f30 0x7f90c40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cb6c0 tx=0x7f90cc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:59.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.640+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90c8051830 con 0x7f90d806a5a0 2023-10-08T16:04:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:04:59.831+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f90d80ceab0 con 0x7f90d806a5a0 2023-10-08T16:05:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.492+0000 7f90bf7fe700 1 -- 172.21.15.60:0/4226053202 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f90c8054e50 con 0x7f90d806a5a0 2023-10-08T16:05:00.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f90c4066f30 msgr2=0x7f90c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f90c4066f30 0x7f90c40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cb6c0 tx=0x7f90cc017000 comp rx=0 tx=0).stop 2023-10-08T16:05:00.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 msgr2=0x7f90d80b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 0x7f90d80b6620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c860 tx=0x7f90c8008040 comp rx=0 tx=0).stop 2023-10-08T16:05:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 shutdown_connections 2023-10-08T16:05:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f90c4066f30 0x7f90c40693e0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cb6c0 tx=0x7f90cc017000 comp rx=0 tx=0).stop 2023-10-08T16:05:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90d815a290 0x7f90d816ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d806a5a0 0x7f90d80b6620 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c860 tx=0x7f90c8008040 comp rx=0 tx=0).stop 2023-10-08T16:05:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 --2- 172.21.15.60:0/4226053202 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90d8159ec0 0x7f90d8156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.503+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 >> 172.21.15.60:0/4226053202 conn(0x7f90d80d1880 msgr2=0x7f90d81542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.505+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 shutdown_connections 2023-10-08T16:05:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.506+0000 7f90de1cd700 1 -- 172.21.15.60:0/4226053202 wait complete. 2023-10-08T16:05:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:05:00.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:05:00.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.649+0000 7f0002775700 1 Processor -- start 2023-10-08T16:05:00.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.649+0000 7f0002775700 1 -- start start 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7f0002775700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efffc0b4860 0x7efffc0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7f0002775700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0b14f0 con 0x7efffc0b3570 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7f0002775700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0b17d0 con 0x7efffc0b4c30 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7f0002775700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc0b1ab0 con 0x7efffc0b4860 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7f0000d12700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efffc0b3570 0x7efffc0cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47142/0 (socket says 172.21.15.60:47142) 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7f0000d12700 1 -- 172.21.15.60:0/2605963736 learned_addr learned my addr 172.21.15.60:0/2605963736 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:00.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.650+0000 7efffbfff700 1 --2- 172.21.15.60:0/2605963736 >> v2:172.21.15.144:3300/0 conn(0x7efffc0b4860 0x7efffc0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208622223 0 0) 0x7efffc0b14f0 con 0x7efffc0b3570 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4003570 con 0x7efffc0b3570 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432743773 0 0) 0x7efffc0b17d0 con 0x7efffc0b4c30 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efffc0b14f0 con 0x7efffc0b4c30 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060347997 0 0) 0x7effe4003570 con 0x7efffc0b3570 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 >> v2:172.21.15.144:3300/0 conn(0x7efffc0b4860 msgr2=0x7efffc0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 --2- 172.21.15.60:0/2605963736 >> v2:172.21.15.144:3300/0 conn(0x7efffc0b4860 0x7efffc0b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 >> v1:172.21.15.144:6789/0 conn(0x7efffc0b4c30 legacy=0x7efffc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0b1d90 con 0x7efffc0b3570 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7efff40017f0 con 0x7efffc0b3570 2023-10-08T16:05:00.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 >> v1:172.21.15.60:6789/0 conn(0x7efffc0b3570 legacy=0x7efffc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4003c40 0x7effe4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe4004810 0x7effe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe4005210 0x7effe400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0b1ab0 con 0x7effe4004810 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe400c130 con 0x7effe4005210 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe400c2c0 con 0x7effe4003c40 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffb7fe700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe4004810 0x7effe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffbfff700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4003c40 0x7effe4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7f0000d12700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe4005210 0x7effe400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffb7fe700 1 -- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4003c40 msgr2=0x7effe4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffb7fe700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4003c40 0x7effe4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffb7fe700 1 -- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe4005210 msgr2=0x7effe400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffb7fe700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe4005210 0x7effe400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7efffb7fe700 1 -- 172.21.15.60:0/2605963736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4003570 con 0x7effe4004810 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.651+0000 7f0000d12700 1 -- 172.21.15.60:0/2605963736 reap_dead start 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7efffb7fe700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe4004810 0x7effe4004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efff0001a80 tx=0x7efff0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5754c1501d6d314d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000c590 con 0x7effe4004810 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000c6f0 con 0x7effe4004810 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7efffaffd700 1 -- 172.21.15.60:0/2605963736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000ca90 con 0x7effe4004810 2023-10-08T16:05:00.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 -- 172.21.15.60:0/2605963736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe4004810 msgr2=0x7effe4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe4004810 0x7effe4004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efff0001a80 tx=0x7efff0007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 -- 172.21.15.60:0/2605963736 shutdown_connections 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 --2- 172.21.15.60:0/2605963736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe4004810 0x7effe4004c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 -- 172.21.15.60:0/2605963736 >> 172.21.15.60:0/2605963736 conn(0x7efffc09a0f0 msgr2=0x7efffc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 -- 172.21.15.60:0/2605963736 shutdown_connections 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.652+0000 7f0002775700 1 -- 172.21.15.60:0/2605963736 wait complete. 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.653+0000 7f0002775700 1 Processor -- start 2023-10-08T16:05:00.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 -- start start 2023-10-08T16:05:00.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4004810 0x7efffc16c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efffc09cb10 0x7efffc157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 0x7efffc15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0aebf0 con 0x7efffc0aa8f0 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc16c830 con 0x7efffc09cb10 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0002775700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc16cb10 con 0x7effe4004810 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0000d12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 0x7efffc15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0000d12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 0x7efffc15fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42790/0 (socket says 172.21.15.60:42790) 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.654+0000 7f0000d12700 1 -- 172.21.15.60:0/2222157412 learned_addr learned my addr 172.21.15.60:0/2222157412 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:00.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7efffbfff700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4004810 0x7efffc16c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7efffb7fe700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efffc09cb10 0x7efffc157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0000d12700 1 -- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4004810 msgr2=0x7efffc16c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0000d12700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4004810 0x7efffc16c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0000d12700 1 -- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efffc09cb10 msgr2=0x7efffc157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0000d12700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efffc09cb10 0x7efffc157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0000d12700 1 -- 172.21.15.60:0/2222157412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc16cdf0 con 0x7efffc0aa8f0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0000d12700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 0x7efffc15fff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efffc08b2d0 tx=0x7efff40020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400ac90 con 0x7efffc0aa8f0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400ae30 con 0x7efffc0aa8f0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4013640 con 0x7efffc0aa8f0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc16d0d0 con 0x7efffc0aa8f0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.655+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc09cf80 con 0x7efffc0aa8f0 2023-10-08T16:05:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.656+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc04c3c0 con 0x7efffc0aa8f0 2023-10-08T16:05:00.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.656+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efff40139f0 con 0x7efffc0aa8f0 2023-10-08T16:05:00.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.657+0000 7effe3fff700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:00.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.657+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7efff4084d80 con 0x7efffc0aa8f0 2023-10-08T16:05:00.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.657+0000 7efffbfff700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:00.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.657+0000 7efffbfff700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effec006d00 tx=0x7effec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:00.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.661+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efff4052050 con 0x7efffc0aa8f0 2023-10-08T16:05:00.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:00.899+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efffc0ae9c0 con 0x7efffc0aa8f0 2023-10-08T16:05:01.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.498+0000 7effe3fff700 1 -- 172.21.15.60:0/2222157412 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7efff4055670 con 0x7efffc0aa8f0 2023-10-08T16:05:01.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.510+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 msgr2=0x7effe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.510+0000 7f0002775700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effec006d00 tx=0x7effec008040 comp rx=0 tx=0).stop 2023-10-08T16:05:01.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.510+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 msgr2=0x7efffc15fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.510+0000 7f0002775700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 0x7efffc15fff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efffc08b2d0 tx=0x7efff40020a0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 shutdown_connections 2023-10-08T16:05:01.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effe4004810 0x7efffc16c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efffc0aa8f0 0x7efffc15fff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 --2- 172.21.15.60:0/2222157412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efffc09cb10 0x7efffc157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 >> 172.21.15.60:0/2222157412 conn(0x7efffc09a0f0 msgr2=0x7efffc15cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:01.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 shutdown_connections 2023-10-08T16:05:01.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.512+0000 7f0002775700 1 -- 172.21.15.60:0/2222157412 wait complete. 2023-10-08T16:05:01.514 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T16:05:01.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.647+0000 7fd31ad43700 1 Processor -- start 2023-10-08T16:05:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.647+0000 7fd31ad43700 1 -- start start 2023-10-08T16:05:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd31ad43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd314159e10 0x7fd3140b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd31ad43700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31415db80 con 0x7fd31415a1e0 2023-10-08T16:05:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd31ad43700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31415de60 con 0x7fd3140cde50 2023-10-08T16:05:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd31ad43700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31415e800 con 0x7fd314159e10 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd318adf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd314159e10 0x7fd3140b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd313fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd31415a1e0 0x7fd3140cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47148/0 (socket says 172.21.15.60:47148) 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.648+0000 7fd313fff700 1 -- 172.21.15.60:0/1862806415 learned_addr learned my addr 172.21.15.60:0/1862806415 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd318adf700 1 -- 172.21.15.60:0/1862806415 >> v1:172.21.15.144:6789/0 conn(0x7fd3140cde50 legacy=0x7fd3140cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd318adf700 1 -- 172.21.15.60:0/1862806415 >> v1:172.21.15.60:6789/0 conn(0x7fd31415a1e0 legacy=0x7fd3140cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd318adf700 1 -- 172.21.15.60:0/1862806415 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31415e140 con 0x7fd314159e10 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd3137fe700 1 -- 172.21.15.60:0/1862806415 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115797453 0 0) 0x7fd31415db80 con 0x7fd31415a1e0 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd318adf700 1 --2- 172.21.15.60:0/1862806415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd314159e10 0x7fd3140b2d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0098e0 tx=0x7fd30c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c32a6b61215493 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd3137fe700 1 -- 172.21.15.60:0/1862806415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c009e80 con 0x7fd314159e10 2023-10-08T16:05:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd3137fe700 1 -- 172.21.15.60:0/1862806415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00b820 con 0x7fd314159e10 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd3137fe700 1 -- 172.21.15.60:0/1862806415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00bba0 con 0x7fd314159e10 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 -- 172.21.15.60:0/1862806415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd314159e10 msgr2=0x7fd3140b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 --2- 172.21.15.60:0/1862806415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd314159e10 0x7fd3140b2d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0098e0 tx=0x7fd30c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 -- 172.21.15.60:0/1862806415 shutdown_connections 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 --2- 172.21.15.60:0/1862806415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd314159e10 0x7fd3140b2d20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 -- 172.21.15.60:0/1862806415 >> 172.21.15.60:0/1862806415 conn(0x7fd314067660 msgr2=0x7fd314067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 -- 172.21.15.60:0/1862806415 shutdown_connections 2023-10-08T16:05:01.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.649+0000 7fd31ad43700 1 -- 172.21.15.60:0/1862806415 wait complete. 2023-10-08T16:05:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.650+0000 7fd31ad43700 1 Processor -- start 2023-10-08T16:05:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 -- start start 2023-10-08T16:05:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3140cde50 0x7fd3141590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd314159e10 0x7fd31416ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 0x7fd314155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140d04f0 con 0x7fd31415a1e0 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31416b2a0 con 0x7fd314159e10 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd31ad43700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140cf8e0 con 0x7fd3140cde50 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.651+0000 7fd3192e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 0x7fd314155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 0x7fd314155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42800/0 (socket says 172.21.15.60:42800) 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 -- 172.21.15.60:0/2418568697 learned_addr learned my addr 172.21.15.60:0/2418568697 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd313fff700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd314159e10 0x7fd31416ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd318adf700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3140cde50 0x7fd3141590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 -- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3140cde50 msgr2=0x7fd3141590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3140cde50 0x7fd3141590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 -- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd314159e10 msgr2=0x7fd31416ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd314159e10 0x7fd31416ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 -- 172.21.15.60:0/2418568697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009420 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd3192e0700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 0x7fd314155950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c510 tx=0x7fd2fc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011590 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc0116f0 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3140cfbc0 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011ab0 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.652+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3140d0180 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.653+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31404c3c0 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.653+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2fc01c460 con 0x7fd31415a1e0 2023-10-08T16:05:01.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.654+0000 7fd310ff9700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2f4066f30 0x7fd2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.654+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2fc084220 con 0x7fd31415a1e0 2023-10-08T16:05:01.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.654+0000 7fd318adf700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2f4066f30 0x7fd2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:01.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.654+0000 7fd318adf700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2f4066f30 0x7fd2f40693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0030c0 tx=0x7fd30c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:01.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.658+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2fc051490 con 0x7fd31415a1e0 2023-10-08T16:05:01.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.854+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3140d0630 con 0x7fd31415a1e0 2023-10-08T16:05:01.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.855+0000 7fd310ff9700 1 -- 172.21.15.60:0/2418568697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fd2fc054ab0 con 0x7fd31415a1e0 2023-10-08T16:05:01.857 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:01.857 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":19,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:00.901463+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2f4066f30 msgr2=0x7fd2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2f4066f30 0x7fd2f40693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0030c0 tx=0x7fd30c016000 comp rx=0 tx=0).stop 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 msgr2=0x7fd314155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 0x7fd314155950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c510 tx=0x7fd2fc007f30 comp rx=0 tx=0).stop 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 shutdown_connections 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2f4066f30 0x7fd2f40693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3140cde50 0x7fd3141590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd31415a1e0 0x7fd314155950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 --2- 172.21.15.60:0/2418568697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd314159e10 0x7fd31416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:01.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 >> 172.21.15.60:0/2418568697 conn(0x7fd314067660 msgr2=0x7fd31415a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:01.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 shutdown_connections 2023-10-08T16:05:01.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.857+0000 7fd31ad43700 1 -- 172.21.15.60:0/2418568697 wait complete. 2023-10-08T16:05:01.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.989+0000 7f17b14e0700 1 Processor -- start 2023-10-08T16:05:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.989+0000 7f17b14e0700 1 -- start start 2023-10-08T16:05:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17b14e0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06a530 0x7f17ac0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17b14e0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17ac0ad9b0 0x7f17ac0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17b14e0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac067ba0 con 0x7f17ac1568d0 2023-10-08T16:05:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17b14e0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac15aa90 con 0x7f17ac0ad9b0 2023-10-08T16:05:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17b14e0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac067870 con 0x7f17ac06a530 2023-10-08T16:05:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17aaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f17ac1568d0 0x7f17ac069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47158/0 (socket says 172.21.15.60:47158) 2023-10-08T16:05:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17aaffd700 1 -- 172.21.15.60:0/2017364045 learned_addr learned my addr 172.21.15.60:0/2017364045 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17ab7fe700 1 --2- 172.21.15.60:0/2017364045 >> v2:172.21.15.60:3300/0 conn(0x7f17ac0ad9b0 0x7f17ac0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.990+0000 7f17aa7fc700 1 --2- 172.21.15.60:0/2017364045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06a530 0x7f17ac0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17a9ffb700 1 -- 172.21.15.60:0/2017364045 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382639943 0 0) 0x7f17ac067ba0 con 0x7f17ac1568d0 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17a9ffb700 1 -- 172.21.15.60:0/2017364045 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1798003570 con 0x7f17ac1568d0 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17ab7fe700 1 -- 172.21.15.60:0/2017364045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06a530 msgr2=0x7f17ac0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17ab7fe700 1 --2- 172.21.15.60:0/2017364045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06a530 0x7f17ac0c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17ab7fe700 1 -- 172.21.15.60:0/2017364045 >> v1:172.21.15.60:6789/0 conn(0x7f17ac1568d0 legacy=0x7f17ac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17ab7fe700 1 -- 172.21.15.60:0/2017364045 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0c8ca0 con 0x7f17ac0ad9b0 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17ab7fe700 1 --2- 172.21.15.60:0/2017364045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c85d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f179c009e60 tx=0x7f179c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c605381469380f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17a9ffb700 1 -- 172.21.15.60:0/2017364045 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00e070 con 0x7f17ac0ad9b0 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17a9ffb700 1 -- 172.21.15.60:0/2017364045 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c00bab0 con 0x7f17ac0ad9b0 2023-10-08T16:05:02.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17a9ffb700 1 -- 172.21.15.60:0/2017364045 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00be70 con 0x7f17ac0ad9b0 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17b14e0700 1 -- 172.21.15.60:0/2017364045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac0ad9b0 msgr2=0x7f17ac0c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17b14e0700 1 --2- 172.21.15.60:0/2017364045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c85d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f179c009e60 tx=0x7f179c009780 comp rx=0 tx=0).stop 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17b14e0700 1 -- 172.21.15.60:0/2017364045 shutdown_connections 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17b14e0700 1 --2- 172.21.15.60:0/2017364045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c85d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17b14e0700 1 --2- 172.21.15.60:0/2017364045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06a530 0x7f17ac0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.991+0000 7f17b14e0700 1 -- 172.21.15.60:0/2017364045 >> 172.21.15.60:0/2017364045 conn(0x7f17ac0cda50 msgr2=0x7f17ac0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.992+0000 7f17b14e0700 1 -- 172.21.15.60:0/2017364045 shutdown_connections 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.992+0000 7f17b14e0700 1 -- 172.21.15.60:0/2017364045 wait complete. 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.993+0000 7f17b14e0700 1 Processor -- start 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.993+0000 7f17b14e0700 1 -- start start 2023-10-08T16:05:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.993+0000 7f17b14e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 0x7f17ac1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac1568d0 0x7f17ac156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac1571e0 con 0x7f17ac06a530 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac158020 con 0x7f17ac0ad9b0 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac157410 con 0x7f17ac1568d0 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 0x7f17ac1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 0x7f17ac1584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42826/0 (socket says 172.21.15.60:42826) 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 -- 172.21.15.60:0/1445833261 learned_addr learned my addr 172.21.15.60:0/1445833261 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17ab7fe700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac1568d0 0x7f17ac156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aa7fc700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 -- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac1568d0 msgr2=0x7f17ac156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac1568d0 0x7f17ac156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 -- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac0ad9b0 msgr2=0x7f17ac0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 -- 172.21.15.60:0/1445833261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c009a20 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17aaffd700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 0x7f17ac1584b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17a400c7c0 tx=0x7f17a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4005cd0 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a4005e30 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4007320 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac1576f0 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.994+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac157cb0 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.995+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac04c3c0 con 0x7f17ac06a530 2023-10-08T16:05:02.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.996+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17a401b3b0 con 0x7f17ac06a530 2023-10-08T16:05:02.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.996+0000 7f17a2ffd700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f178c066f30 0x7f178c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.996+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17a4083ba0 con 0x7f17ac06a530 2023-10-08T16:05:02.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.996+0000 7f17aa7fc700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f178c066f30 0x7f178c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:01.996+0000 7f17aa7fc700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f178c066f30 0x7f178c0693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f17ac16b140 tx=0x7f17940091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:02.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.000+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17a4050e10 con 0x7f17ac06a530 2023-10-08T16:05:02.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:02.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:02.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.195+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17ac0c8f80 con 0x7f17ac06a530 2023-10-08T16:05:02.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.196+0000 7f17a2ffd700 1 -- 172.21.15.60:0/1445833261 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f17a4017070 con 0x7f17ac06a530 2023-10-08T16:05:02.198 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:02.199 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":19,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:00.901463+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:02.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f178c066f30 msgr2=0x7f178c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f178c066f30 0x7f178c0693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f17ac16b140 tx=0x7f17940091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 msgr2=0x7f17ac1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 0x7f17ac1584b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17a400c7c0 tx=0x7f17a4007e00 comp rx=0 tx=0).stop 2023-10-08T16:05:02.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 shutdown_connections 2023-10-08T16:05:02.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f178c066f30 0x7f178c0693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac1568d0 0x7f17ac156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17ac06a530 0x7f17ac1584b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 --2- 172.21.15.60:0/1445833261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac0ad9b0 0x7f17ac0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 >> 172.21.15.60:0/1445833261 conn(0x7f17ac0cda50 msgr2=0x7f17ac06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:02.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 shutdown_connections 2023-10-08T16:05:02.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.199+0000 7f17b14e0700 1 -- 172.21.15.60:0/1445833261 wait complete. 2023-10-08T16:05:02.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:05:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.373+0000 7f42a4900700 1 Processor -- start 2023-10-08T16:05:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.373+0000 7f42a4900700 1 -- start start 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f42a4900700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42a006aa00 0x7f42a0164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f42a4900700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00b4d70 con 0x7f42a00cce30 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f42a4900700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a015b3b0 con 0x7f42a00b6580 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f42a4900700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00cd8d0 con 0x7f42a006aa00 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f42a00cce30 0x7f42a015aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43680/0 (socket says 172.21.15.60:43680) 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429ed9d700 1 -- 172.21.15.60:0/818152779 learned_addr learned my addr 172.21.15.60:0/818152779 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396335925 0 0) 0x7f42a00b4d70 con 0x7f42a00cce30 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f428c003570 con 0x7f42a00cce30 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429f59e700 1 --2- 172.21.15.60:0/818152779 >> v2:172.21.15.144:3300/0 conn(0x7f42a006aa00 0x7f42a0164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503466156 0 0) 0x7f428c003570 con 0x7f42a00cce30 2023-10-08T16:05:02.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 >> v2:172.21.15.144:3300/0 conn(0x7f42a006aa00 msgr2=0x7f42a0164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 --2- 172.21.15.60:0/818152779 >> v2:172.21.15.144:3300/0 conn(0x7f42a006aa00 0x7f42a0164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 >> v1:172.21.15.144:6789/0 conn(0x7f42a00b6580 legacy=0x7f42a006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00b4440 con 0x7f42a00cce30 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.374+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f4298001470 con 0x7f42a00cce30 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 >> v1:172.21.15.60:6789/0 conn(0x7f42a00cce30 legacy=0x7f42a015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00cd8d0 con 0x7f428c003a60 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c160 con 0x7f428c004810 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c320 con 0x7f428c0051c0 2023-10-08T16:05:02.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429e59c700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429f59e700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 -- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0051c0 msgr2=0x7f428c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 -- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c004810 msgr2=0x7f428c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 -- 172.21.15.60:0/818152779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c003570 con 0x7f428c003a60 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429f59e700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0051c0 0x7f428c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429f59e700 1 -- 172.21.15.60:0/818152779 reap_dead start 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429ed9d700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c003a60 0x7f428c003e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f429800c3c0 tx=0x7f4298001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13ab8ca278cc34 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800cc90 con 0x7f428c003a60 2023-10-08T16:05:02.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800cdf0 con 0x7f428c003a60 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.375+0000 7f429dd9b700 1 -- 172.21.15.60:0/818152779 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298005b50 con 0x7f428c003a60 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 -- 172.21.15.60:0/818152779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c003a60 msgr2=0x7f428c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c003a60 0x7f428c003e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f429800c3c0 tx=0x7f4298001e50 comp rx=0 tx=0).stop 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 -- 172.21.15.60:0/818152779 shutdown_connections 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 --2- 172.21.15.60:0/818152779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 -- 172.21.15.60:0/818152779 >> 172.21.15.60:0/818152779 conn(0x7f42a0068cb0 msgr2=0x7f42a00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 -- 172.21.15.60:0/818152779 shutdown_connections 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.376+0000 7f42a4900700 1 -- 172.21.15.60:0/818152779 wait complete. 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.377+0000 7f42a4900700 1 Processor -- start 2023-10-08T16:05:02.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.377+0000 7f42a4900700 1 -- start start 2023-10-08T16:05:02.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f42a4900700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c003a60 0x7f42a016dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f42a4900700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 0x7f42a014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f42a4900700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a00b24b0 0x7f42a0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f42a4900700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a016d2f0 con 0x7f42a00af840 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f42a4900700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a016e240 con 0x7f428c003a60 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f42a4900700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00b2e00 con 0x7f42a00b24b0 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 0x7f42a014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 0x7f42a014fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40170/0 (socket says 172.21.15.60:40170) 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 -- 172.21.15.60:0/3441519306 learned_addr learned my addr 172.21.15.60:0/3441519306 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429ed9d700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c003a60 0x7f42a016dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429f59e700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a00b24b0 0x7f42a0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 -- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a00b24b0 msgr2=0x7f42a0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a00b24b0 0x7f42a0158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 -- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c003a60 msgr2=0x7f42a016dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c003a60 0x7f42a016dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 -- 172.21.15.60:0/3441519306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00b30e0 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.378+0000 7f429e59c700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 0x7f42a014fae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4288002950 tx=0x7f4288007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.379+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800f6a0 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.379+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428800f800 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.379+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a016d500 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.379+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800fba0 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.379+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a0150020 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.379+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a0089550 con 0x7f42a00af840 2023-10-08T16:05:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.380+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f428801c400 con 0x7f42a00af840 2023-10-08T16:05:02.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.380+0000 7f4296ffd700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:02.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.380+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42880849e0 con 0x7f42a00af840 2023-10-08T16:05:02.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.380+0000 7f429ed9d700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:02.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.381+0000 7f429ed9d700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4280066f30 0x7f42800693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4298007cd0 tx=0x7f4298015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:02.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.385+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4288051d00 con 0x7f42a00af840 2023-10-08T16:05:02.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:02.624+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f42a00b32d0 con 0x7f42a00af840 2023-10-08T16:05:03.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.504+0000 7f4296ffd700 1 -- 172.21.15.60:0/3441519306 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f42a00b32d0 con 0x7f42a00af840 2023-10-08T16:05:03.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4280066f30 msgr2=0x7f42800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:03.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4280066f30 0x7f42800693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4298007cd0 tx=0x7f4298015000 comp rx=0 tx=0).stop 2023-10-08T16:05:03.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 msgr2=0x7f42a014fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:03.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 0x7f42a014fae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4288002950 tx=0x7f4288007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 shutdown_connections 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a00b24b0 0x7f42a0158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c003a60 0x7f42a016dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 --2- 172.21.15.60:0/3441519306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00af840 0x7f42a014fae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 >> 172.21.15.60:0/3441519306 conn(0x7f42a0068cb0 msgr2=0x7f42a00d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 shutdown_connections 2023-10-08T16:05:03.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.507+0000 7f42a4900700 1 -- 172.21.15.60:0/3441519306 wait complete. 2023-10-08T16:05:03.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:05:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.651+0000 7f1d5f2d2700 1 Processor -- start 2023-10-08T16:05:03.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.651+0000 7f1d5f2d2700 1 -- start start 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5f2d2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 0x7f1d5806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5f2d2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 0x7f1d580cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5f2d2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d580b0790 con 0x7f1d58159ec0 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5f2d2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5806af60 con 0x7f1d5806aae0 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5f2d2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580ce1f0 con 0x7f1d5815a290 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5c86d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 0x7f1d5806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5d86f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 0x7f1d580cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5c86d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 0x7f1d5806a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50706/0 (socket says 172.21.15.60:50706) 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5c86d700 1 -- 172.21.15.60:0/3277795459 learned_addr learned my addr 172.21.15.60:0/3277795459 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5d86f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 0x7f1d580cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56594/0 (socket says 172.21.15.60:56594) 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.652+0000 7f1d5d06e700 1 --1- 172.21.15.60:0/3277795459 >> v1:172.21.15.144:6789/0 conn(0x7f1d58159ec0 0x7f1d580af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:33940/0 (socket says 172.21.15.60:33940) 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5c86d700 1 -- 172.21.15.60:0/3277795459 >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 msgr2=0x7f1d580cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5c86d700 1 --2- 172.21.15.60:0/3277795459 >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 0x7f1d580cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5c86d700 1 -- 172.21.15.60:0/3277795459 >> v1:172.21.15.144:6789/0 conn(0x7f1d58159ec0 legacy=0x7f1d580af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5c86d700 1 -- 172.21.15.60:0/3277795459 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d580b0b20 con 0x7f1d5815a290 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d57fff700 1 -- 172.21.15.60:0/3277795459 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745067334 0 0) 0x7f1d580b0790 con 0x7f1d58159ec0 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5d86f700 1 --2- 172.21.15.60:0/3277795459 >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 0x7f1d580cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d5c86d700 1 --2- 172.21.15.60:0/3277795459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 0x7f1d5806a5a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0099b0 tx=0x7f1d4c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6f5b81080581df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d57fff700 1 -- 172.21.15.60:0/3277795459 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c009ea0 con 0x7f1d5815a290 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d57fff700 1 -- 172.21.15.60:0/3277795459 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c00b860 con 0x7f1d5815a290 2023-10-08T16:05:03.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.653+0000 7f1d57fff700 1 -- 172.21.15.60:0/3277795459 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00bc00 con 0x7f1d5815a290 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3277795459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 msgr2=0x7f1d5806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3277795459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 0x7f1d5806a5a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0099b0 tx=0x7f1d4c009250 comp rx=0 tx=0).stop 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3277795459 shutdown_connections 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3277795459 >> v2:172.21.15.144:3300/0 conn(0x7f1d5806aae0 0x7f1d580cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3277795459 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5815a290 0x7f1d5806a5a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3277795459 >> 172.21.15.60:0/3277795459 conn(0x7f1d580d1880 msgr2=0x7f1d580cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3277795459 shutdown_connections 2023-10-08T16:05:03.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.654+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3277795459 wait complete. 2023-10-08T16:05:03.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.655+0000 7f1d5f2d2700 1 Processor -- start 2023-10-08T16:05:03.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.655+0000 7f1d5f2d2700 1 -- start start 2023-10-08T16:05:03.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5f2d2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5806aae0 0x7f1d5816ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5f2d2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d58159ec0 0x7f1d580b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5f2d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 0x7f1d580b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5f2d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58160df0 con 0x7f1d5815a290 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5f2d2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580b66b0 con 0x7f1d58159ec0 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5f2d2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580b4e70 con 0x7f1d5806aae0 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 0x7f1d580b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 0x7f1d580b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40174/0 (socket says 172.21.15.60:40174) 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 -- 172.21.15.60:0/3335110816 learned_addr learned my addr 172.21.15.60:0/3335110816 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5c86d700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d58159ec0 0x7f1d580b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d06e700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5806aae0 0x7f1d5816ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 -- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5806aae0 msgr2=0x7f1d5816ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5806aae0 0x7f1d5816ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 -- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d58159ec0 msgr2=0x7f1d580b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d58159ec0 0x7f1d580b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.656+0000 7f1d5d86f700 1 -- 172.21.15.60:0/3335110816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48009a20 con 0x7f1d5815a290 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.657+0000 7f1d5d86f700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 0x7f1d580b6170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009fc0 tx=0x7f1d4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.657+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800cbd0 con 0x7f1d5815a290 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.657+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4800f040 con 0x7f1d5815a290 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.657+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0094f0 con 0x7f1d5815a290 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.657+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48014480 con 0x7f1d5815a290 2023-10-08T16:05:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.657+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d580b5430 con 0x7f1d5815a290 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.658+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5804c3c0 con 0x7f1d5815a290 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.658+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d48003020 con 0x7f1d5815a290 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.659+0000 7f1d557fa700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d44066f60 0x7f1d44069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.659+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d48084ec0 con 0x7f1d5815a290 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.659+0000 7f1d5d06e700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d44066f60 0x7f1d44069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.659+0000 7f1d5d06e700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d44066f60 0x7f1d44069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d50007fd0 tx=0x7f1d50007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.663+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d48052090 con 0x7f1d5815a290 2023-10-08T16:05:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:03.902+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d580b04b0 con 0x7f1d5815a290 2023-10-08T16:05:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.511+0000 7f1d557fa700 1 -- 172.21.15.60:0/3335110816 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d480556b0 con 0x7f1d5815a290 2023-10-08T16:05:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.513+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d44066f60 msgr2=0x7f1d44069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.513+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d44066f60 0x7f1d44069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d50007fd0 tx=0x7f1d50007d50 comp rx=0 tx=0).stop 2023-10-08T16:05:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.513+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 msgr2=0x7f1d580b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.513+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 0x7f1d580b6170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009fc0 tx=0x7f1d4800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 shutdown_connections 2023-10-08T16:05:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d44066f60 0x7f1d44069410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d5806aae0 0x7f1d5816ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d5815a290 0x7f1d580b6170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 --2- 172.21.15.60:0/3335110816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d58159ec0 0x7f1d580b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 >> 172.21.15.60:0/3335110816 conn(0x7f1d580d1880 msgr2=0x7f1d580cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 shutdown_connections 2023-10-08T16:05:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.514+0000 7f1d5f2d2700 1 -- 172.21.15.60:0/3335110816 wait complete. 2023-10-08T16:05:04.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:04.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.648+0000 7fb0b02ec700 1 Processor -- start 2023-10-08T16:05:04.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.648+0000 7fb0b02ec700 1 -- start start 2023-10-08T16:05:04.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0b02ec700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb0a815e540 0x7fb0a8070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:04.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0b02ec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a8070c40 0x7fb0a806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:04.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0b02ec700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a815e9b0 con 0x7fb0a80afff0 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0b02ec700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80710c0 con 0x7fb0a815e540 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0b02ec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80b03c0 con 0x7fb0a8070c40 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0ae088700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb0a80afff0 0x7fb0a8069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43690/0 (socket says 172.21.15.60:43690) 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0ae088700 1 -- 172.21.15.60:0/1298728695 learned_addr learned my addr 172.21.15.60:0/1298728695 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0ae889700 1 --2- 172.21.15.60:0/1298728695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a8070c40 0x7fb0a806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0ad887700 1 --2- 172.21.15.60:0/1298728695 >> v2:172.21.15.144:3300/0 conn(0x7fb0a815e540 0x7fb0a8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0ad086700 1 -- 172.21.15.60:0/1298728695 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229703829 0 0) 0x7fb0a815e9b0 con 0x7fb0a80afff0 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.649+0000 7fb0ad086700 1 -- 172.21.15.60:0/1298728695 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb090003570 con 0x7fb0a80afff0 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ae889700 1 -- 172.21.15.60:0/1298728695 >> v2:172.21.15.144:3300/0 conn(0x7fb0a815e540 msgr2=0x7fb0a8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ae889700 1 --2- 172.21.15.60:0/1298728695 >> v2:172.21.15.144:3300/0 conn(0x7fb0a815e540 0x7fb0a8070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ad086700 1 -- 172.21.15.60:0/1298728695 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135993409 0 0) 0x7fb090003570 con 0x7fb0a80afff0 2023-10-08T16:05:04.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ae889700 1 -- 172.21.15.60:0/1298728695 >> v1:172.21.15.60:6789/0 conn(0x7fb0a80afff0 legacy=0x7fb0a8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ae889700 1 -- 172.21.15.60:0/1298728695 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a806a870 con 0x7fb0a8070c40 2023-10-08T16:05:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ae889700 1 --2- 172.21.15.60:0/1298728695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a8070c40 0x7fb0a806ea90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb098009e60 tx=0x7fb098009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b4c93a333e978c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ad086700 1 -- 172.21.15.60:0/1298728695 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800e070 con 0x7fb0a8070c40 2023-10-08T16:05:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ad086700 1 -- 172.21.15.60:0/1298728695 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800b7a0 con 0x7fb0a8070c40 2023-10-08T16:05:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.650+0000 7fb0ad086700 1 -- 172.21.15.60:0/1298728695 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0001470 con 0x7fb0a8070c40 2023-10-08T16:05:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 -- 172.21.15.60:0/1298728695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a8070c40 msgr2=0x7fb0a806ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/1298728695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a8070c40 0x7fb0a806ea90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb098009e60 tx=0x7fb098009780 comp rx=0 tx=0).stop 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 -- 172.21.15.60:0/1298728695 shutdown_connections 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/1298728695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a8070c40 0x7fb0a806ea90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/1298728695 >> v2:172.21.15.144:3300/0 conn(0x7fb0a815e540 0x7fb0a8070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 -- 172.21.15.60:0/1298728695 >> 172.21.15.60:0/1298728695 conn(0x7fb0a80cda50 msgr2=0x7fb0a80cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 -- 172.21.15.60:0/1298728695 shutdown_connections 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.651+0000 7fb0b02ec700 1 -- 172.21.15.60:0/1298728695 wait complete. 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 Processor -- start 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 -- start start 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0a8070c40 0x7fb0a80c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 0x7fb0a816d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a815e540 0x7fb0a80b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a815eba0 con 0x7fb0a80afff0 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.652+0000 7fb0b02ec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80c2fd0 con 0x7fb0a8070c40 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0b02ec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80b1cf0 con 0x7fb0a815e540 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 0x7fb0a816d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 0x7fb0a816d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40180/0 (socket says 172.21.15.60:40180) 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 -- 172.21.15.60:0/3640693901 learned_addr learned my addr 172.21.15.60:0/3640693901 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ae088700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0a8070c40 0x7fb0a80c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ae889700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a815e540 0x7fb0a80b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 -- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a815e540 msgr2=0x7fb0a80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a815e540 0x7fb0a80b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 -- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0a8070c40 msgr2=0x7fb0a80c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0a8070c40 0x7fb0a80c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 -- 172.21.15.60:0/3640693901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009a20 con 0x7fb0a80afff0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0ad887700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 0x7fb0a816d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ec80 tx=0x7fb09c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00c850 con 0x7fb0a80afff0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00c9b0 con 0x7fb0a80afff0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a815edf0 con 0x7fb0a80afff0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00cd50 con 0x7fb0a80afff0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.653+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a815f3b0 con 0x7fb0a80afff0 2023-10-08T16:05:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.654+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a804c3c0 con 0x7fb0a80afff0 2023-10-08T16:05:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.655+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09c013680 con 0x7fb0a80afff0 2023-10-08T16:05:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.655+0000 7fb0a67fc700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.655+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb09c0847b0 con 0x7fb0a80afff0 2023-10-08T16:05:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.655+0000 7fb0ae088700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.656+0000 7fb0ae088700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb094066f30 0x7fb0940693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0004e60 tx=0x7fb0a0001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.659+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb09c051a20 con 0x7fb0a80afff0 2023-10-08T16:05:04.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.894+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0a806ab50 con 0x7fb0a80afff0 2023-10-08T16:05:04.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.895+0000 7fb0a67fc700 1 -- 172.21.15.60:0/3640693901 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fb09c055040 con 0x7fb0a80afff0 2023-10-08T16:05:04.896 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:04.896 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb094066f30 msgr2=0x7fb0940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb094066f30 0x7fb0940693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0004e60 tx=0x7fb0a0001a10 comp rx=0 tx=0).stop 2023-10-08T16:05:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 msgr2=0x7fb0a816d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 0x7fb0a816d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ec80 tx=0x7fb09c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 shutdown_connections 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0a815e540 0x7fb0a80b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0a8070c40 0x7fb0a80c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 --2- 172.21.15.60:0/3640693901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a80afff0 0x7fb0a816d1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 >> 172.21.15.60:0/3640693901 conn(0x7fb0a80cda50 msgr2=0x7fb0a8069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 shutdown_connections 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:04.897+0000 7fb0b02ec700 1 -- 172.21.15.60:0/3640693901 wait complete. 2023-10-08T16:05:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:04.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:05.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.027+0000 7ff39bd8e700 1 Processor -- start 2023-10-08T16:05:05.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.027+0000 7ff39bd8e700 1 -- start start 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff39bd8e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3940d1c30 0x7ff3940ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff39bd8e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a680 0x7ff3940cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff39bd8e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940c5d80 con 0x7ff39415a2b0 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff39bd8e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff394068470 con 0x7ff3940d1c30 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff39bd8e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c6060 con 0x7ff39415a680 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff399329700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3940d1c30 0x7ff3940ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff399329700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3940d1c30 0x7ff3940ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40196/0 (socket says 172.21.15.60:40196) 2023-10-08T16:05:05.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff399329700 1 -- 172.21.15.60:0/3449683355 learned_addr learned my addr 172.21.15.60:0/3449683355 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.028+0000 7ff39a32b700 1 --2- 172.21.15.60:0/3449683355 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a680 0x7ff3940cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff399329700 1 -- 172.21.15.60:0/3449683355 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a680 msgr2=0x7ff3940cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff399329700 1 --2- 172.21.15.60:0/3449683355 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a680 0x7ff3940cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff399329700 1 -- 172.21.15.60:0/3449683355 >> v1:172.21.15.144:6789/0 conn(0x7ff39415a2b0 legacy=0x7ff3940b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff399329700 1 -- 172.21.15.60:0/3449683355 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940c6340 con 0x7ff3940d1c30 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff399329700 1 --2- 172.21.15.60:0/3449683355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff3940ccdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3880099b0 tx=0x7ff388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593609eff0b6117b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff398b28700 1 -- 172.21.15.60:0/3449683355 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388009ea0 con 0x7ff3940d1c30 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff398b28700 1 -- 172.21.15.60:0/3449683355 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800b860 con 0x7ff3940d1c30 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff398b28700 1 -- 172.21.15.60:0/3449683355 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800bc00 con 0x7ff3940d1c30 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff39bd8e700 1 -- 172.21.15.60:0/3449683355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 msgr2=0x7ff3940ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.029+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/3449683355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff3940ccdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3880099b0 tx=0x7ff388009250 comp rx=0 tx=0).stop 2023-10-08T16:05:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.030+0000 7ff39bd8e700 1 -- 172.21.15.60:0/3449683355 shutdown_connections 2023-10-08T16:05:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.030+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/3449683355 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a680 0x7ff3940cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.030+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/3449683355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff3940ccdd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.030+0000 7ff39bd8e700 1 -- 172.21.15.60:0/3449683355 >> 172.21.15.60:0/3449683355 conn(0x7ff394067e40 msgr2=0x7ff3940d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.030+0000 7ff39bd8e700 1 -- 172.21.15.60:0/3449683355 shutdown_connections 2023-10-08T16:05:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.030+0000 7ff39bd8e700 1 -- 172.21.15.60:0/3449683355 wait complete. 2023-10-08T16:05:05.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.031+0000 7ff39bd8e700 1 Processor -- start 2023-10-08T16:05:05.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.031+0000 7ff39bd8e700 1 -- start start 2023-10-08T16:05:05.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.031+0000 7ff39bd8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff39409c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.031+0000 7ff39bd8e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a2b0 0x7ff39415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39bd8e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff39415a680 0x7ff39415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39bd8e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415c150 con 0x7ff3940d1c30 2023-10-08T16:05:05.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39bd8e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941473d0 con 0x7ff39415a680 2023-10-08T16:05:05.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39bd8e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415b540 con 0x7ff39415a2b0 2023-10-08T16:05:05.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff39409c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff39409c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40200/0 (socket says 172.21.15.60:40200) 2023-10-08T16:05:05.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 -- 172.21.15.60:0/4038934877 learned_addr learned my addr 172.21.15.60:0/4038934877 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:05.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39a32b700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff39415a680 0x7ff39415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399329700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a2b0 0x7ff39415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 -- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a2b0 msgr2=0x7ff39415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a2b0 0x7ff39415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 -- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff39415a680 msgr2=0x7ff39415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff39415a680 0x7ff39415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 -- 172.21.15.60:0/4038934877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880094f0 con 0x7ff3940d1c30 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff399b2a700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff39409c320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c540 tx=0x7ff38c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011590 con 0x7ff3940d1c30 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c0116f0 con 0x7ff3940d1c30 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39415b820 con 0x7ff3940d1c30 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011ab0 con 0x7ff3940d1c30 2023-10-08T16:05:05.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.032+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39415bde0 con 0x7ff3940d1c30 2023-10-08T16:05:05.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.033+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3940d09f0 con 0x7ff3940d1c30 2023-10-08T16:05:05.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.034+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff38c01b3b0 con 0x7ff3940d1c30 2023-10-08T16:05:05.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.034+0000 7ff391ffb700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff380066f30 0x7ff3800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.034+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff38c083810 con 0x7ff3940d1c30 2023-10-08T16:05:05.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.034+0000 7ff399329700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff380066f30 0x7ff3800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.035+0000 7ff399329700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff380066f30 0x7ff3800693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff3880099b0 tx=0x7ff388017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.038+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff38c050b30 con 0x7ff3940d1c30 2023-10-08T16:05:05.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.232+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff39404c3c0 con 0x7ff3940d1c30 2023-10-08T16:05:05.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.233+0000 7ff391ffb700 1 -- 172.21.15.60:0/4038934877 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff38c017070 con 0x7ff3940d1c30 2023-10-08T16:05:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:05.235 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff380066f30 msgr2=0x7ff3800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff380066f30 0x7ff3800693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff3880099b0 tx=0x7ff388017000 comp rx=0 tx=0).stop 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 msgr2=0x7ff39409c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff39409c320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c540 tx=0x7ff38c001070 comp rx=0 tx=0).stop 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 shutdown_connections 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff380066f30 0x7ff3800693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff39415a680 0x7ff39415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3940d1c30 0x7ff39409c320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 --2- 172.21.15.60:0/4038934877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff39415a2b0 0x7ff39415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 >> 172.21.15.60:0/4038934877 conn(0x7ff394067e40 msgr2=0x7ff394158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:05.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 shutdown_connections 2023-10-08T16:05:05.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.235+0000 7ff39bd8e700 1 -- 172.21.15.60:0/4038934877 wait complete. 2023-10-08T16:05:05.248 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:05:05.249 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.365+0000 7f6d8cd4b700 1 Processor -- start 2023-10-08T16:05:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.365+0000 7f6d8cd4b700 1 -- start start 2023-10-08T16:05:05.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.366+0000 7f6d8cd4b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d880b1220 0x7f6d880c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.366+0000 7f6d8cd4b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 0x7f6d880cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.366+0000 7f6d8cd4b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8815de60 con 0x7f6d880b0e50 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.366+0000 7f6d8cd4b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880cbed0 con 0x7f6d880b1220 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.366+0000 7f6d8cd4b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815e140 con 0x7f6d880cb4f0 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 0x7f6d880cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d85d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d880b1220 0x7f6d880c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 0x7f6d880cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50740/0 (socket says 172.21.15.60:50740) 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d85d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d880b1220 0x7f6d880c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56630/0 (socket says 172.21.15.60:56630) 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 -- 172.21.15.60:0/3673400271 learned_addr learned my addr 172.21.15.60:0/3673400271 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 -- 172.21.15.60:0/3673400271 >> v2:172.21.15.144:3300/0 conn(0x7f6d880b1220 msgr2=0x7f6d880c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:05.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 --2- 172.21.15.60:0/3673400271 >> v2:172.21.15.144:3300/0 conn(0x7f6d880b1220 0x7f6d880c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 -- 172.21.15.60:0/3673400271 >> v1:172.21.15.144:6789/0 conn(0x7f6d880b0e50 legacy=0x7f6d8806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 -- 172.21.15.60:0/3673400271 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8815e420 con 0x7f6d880cb4f0 2023-10-08T16:05:05.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d86d9d700 1 --2- 172.21.15.60:0/3673400271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 0x7f6d880cb990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d780099b0 tx=0x7f6d78009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffb4282f9aa8064d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d8559a700 1 -- 172.21.15.60:0/3673400271 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78009ea0 con 0x7f6d880cb4f0 2023-10-08T16:05:05.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d8559a700 1 -- 172.21.15.60:0/3673400271 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7800b860 con 0x7f6d880cb4f0 2023-10-08T16:05:05.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.367+0000 7f6d8559a700 1 -- 172.21.15.60:0/3673400271 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7800bc20 con 0x7f6d880cb4f0 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/3673400271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 msgr2=0x7f6d880cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/3673400271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 0x7f6d880cb990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d780099b0 tx=0x7f6d78009250 comp rx=0 tx=0).stop 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/3673400271 shutdown_connections 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/3673400271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880cb4f0 0x7f6d880cb990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/3673400271 >> v2:172.21.15.144:3300/0 conn(0x7f6d880b1220 0x7f6d880c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/3673400271 >> 172.21.15.60:0/3673400271 conn(0x7f6d88069870 msgr2=0x7f6d88069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/3673400271 shutdown_connections 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.368+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/3673400271 wait complete. 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.369+0000 7f6d8cd4b700 1 Processor -- start 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.369+0000 7f6d8cd4b700 1 -- start start 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8cd4b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880b0e50 0x7f6d88153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8cd4b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d880b1220 0x7f6d88155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8cd4b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 0x7f6d881563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8cd4b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815a4f0 con 0x7f6d880cb4f0 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8cd4b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880b2590 con 0x7f6d880b1220 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8cd4b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881569e0 con 0x7f6d880b0e50 2023-10-08T16:05:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 0x7f6d881563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 0x7f6d881563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40204/0 (socket says 172.21.15.60:40204) 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 -- 172.21.15.60:0/1737457573 learned_addr learned my addr 172.21.15.60:0/1737457573 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d85d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d880b1220 0x7f6d88155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d8659c700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880b0e50 0x7f6d88153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 -- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880b0e50 msgr2=0x7f6d88153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880b0e50 0x7f6d88153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 -- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d880b1220 msgr2=0x7f6d88155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d880b1220 0x7f6d88155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 -- 172.21.15.60:0/1737457573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780094f0 con 0x7f6d880cb4f0 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d86d9d700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 0x7f6d881563b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d78006fd0 tx=0x7f6d78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.370+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78020070 con 0x7f6d880cb4f0 2023-10-08T16:05:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.371+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7800bbe0 con 0x7f6d880cb4f0 2023-10-08T16:05:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.371+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d88156cc0 con 0x7f6d880cb4f0 2023-10-08T16:05:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.371+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011630 con 0x7f6d880cb4f0 2023-10-08T16:05:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.371+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88157280 con 0x7f6d880cb4f0 2023-10-08T16:05:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.372+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8815a660 con 0x7f6d880cb4f0 2023-10-08T16:05:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.372+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d78011a20 con 0x7f6d880cb4f0 2023-10-08T16:05:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.372+0000 7f6d7e7fc700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d68066f30 0x7f6d680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.372+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d78085990 con 0x7f6d880cb4f0 2023-10-08T16:05:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.372+0000 7f6d8659c700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d68066f30 0x7f6d680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.373+0000 7f6d8659c700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d68066f30 0x7f6d680693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d80007fd0 tx=0x7f6d80001650 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.377+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d8815a660 con 0x7f6d880cb4f0 2023-10-08T16:05:05.479 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-10-08T16:05:05.478+0000 7f47ffd01700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:05:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.565+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d8815a630 con 0x7f6d68066f30 2023-10-08T16:05:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.573+0000 7f6d7e7fc700 1 -- 172.21.15.60:0/1737457573 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257332 (secure 0 0 0) 0x7f6d8815a630 con 0x7f6d68066f30 2023-10-08T16:05:05.578 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d68066f30 msgr2=0x7f6d680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d68066f30 0x7f6d680693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d80007fd0 tx=0x7f6d80001650 comp rx=0 tx=0).stop 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 msgr2=0x7f6d881563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 0x7f6d881563b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d78006fd0 tx=0x7f6d78017000 comp rx=0 tx=0).stop 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 shutdown_connections 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d68066f30 0x7f6d680693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d880b0e50 0x7f6d88153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880cb4f0 0x7f6d881563b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 --2- 172.21.15.60:0/1737457573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d880b1220 0x7f6d88155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 >> 172.21.15.60:0/1737457573 conn(0x7f6d88069870 msgr2=0x7f6d88069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:05.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 shutdown_connections 2023-10-08T16:05:05.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.577+0000 7f6d8cd4b700 1 -- 172.21.15.60:0/1737457573 wait complete. 2023-10-08T16:05:05.581 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:05.590 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T16:05:05.561540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560947,"statfs":{"total":1600000000,"available":1598409824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001004"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497556+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500930+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496976+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501553+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500651+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500928+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500078+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502439+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498975+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495972+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496806+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493953+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502025+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499988+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500576+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497059+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498617+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505057+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:00.505057+0000","last_peered":"2023-10-08T16:05:00.505057+0000","last_clean":"2023-10-08T16:05:00.505057+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:00.505057+0000","last_undegraded":"2023-10-08T16:05:00.505057+0000","last_fullsized":"2023-10-08T16:05:00.505057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.505777+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507202+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:00.507202+0000","last_peered":"2023-10-08T16:05:00.507202+0000","last_clean":"2023-10-08T16:05:00.507202+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:00.507202+0000","last_undegraded":"2023-10-08T16:05:00.507202+0000","last_fullsized":"2023-10-08T16:05:00.507202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503801+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:00.503801+0000","last_peered":"2023-10-08T16:05:00.503801+0000","last_clean":"2023-10-08T16:05:00.503801+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:00.503801+0000","last_undegraded":"2023-10-08T16:05:00.503801+0000","last_fullsized":"2023-10-08T16:05:00.503801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497813+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504293+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:00.504293+0000","last_peered":"2023-10-08T16:05:00.504293+0000","last_clean":"2023-10-08T16:05:00.504293+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:00.504293+0000","last_undegraded":"2023-10-08T16:05:00.504293+0000","last_fullsized":"2023-10-08T16:05:00.504293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497038+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504995+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:00.504995+0000","last_peered":"2023-10-08T16:05:00.504995+0000","last_clean":"2023-10-08T16:05:00.504995+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:00.504995+0000","last_undegraded":"2023-10-08T16:05:00.504995+0000","last_fullsized":"2023-10-08T16:05:00.504995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493408+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505226+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:00.505226+0000","last_peered":"2023-10-08T16:05:00.505226+0000","last_clean":"2023-10-08T16:05:00.505226+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:00.505226+0000","last_undegraded":"2023-10-08T16:05:00.505226+0000","last_fullsized":"2023-10-08T16:05:00.505226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507367+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:00.507367+0000","last_peered":"2023-10-08T16:05:00.507367+0000","last_clean":"2023-10-08T16:05:00.507367+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:00.507367+0000","last_undegraded":"2023-10-08T16:05:00.507367+0000","last_fullsized":"2023-10-08T16:05:00.507367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499502+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505047+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:00.505047+0000","last_peered":"2023-10-08T16:05:00.505047+0000","last_clean":"2023-10-08T16:05:00.505047+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:00.505047+0000","last_undegraded":"2023-10-08T16:05:00.505047+0000","last_fullsized":"2023-10-08T16:05:00.505047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498428+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500519+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:00.500519+0000","last_peered":"2023-10-08T16:05:00.500519+0000","last_clean":"2023-10-08T16:05:00.500519+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:00.500519+0000","last_undegraded":"2023-10-08T16:05:00.500519+0000","last_fullsized":"2023-10-08T16:05:00.500519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496311+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501225+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:00.501225+0000","last_peered":"2023-10-08T16:05:00.501225+0000","last_clean":"2023-10-08T16:05:00.501225+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:00.501225+0000","last_undegraded":"2023-10-08T16:05:00.501225+0000","last_fullsized":"2023-10-08T16:05:00.501225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498283+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502084+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:00.502084+0000","last_peered":"2023-10-08T16:05:00.502084+0000","last_clean":"2023-10-08T16:05:00.502084+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:00.502084+0000","last_undegraded":"2023-10-08T16:05:00.502084+0000","last_fullsized":"2023-10-08T16:05:00.502084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494454+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508257+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:00.508257+0000","last_peered":"2023-10-08T16:05:00.508257+0000","last_clean":"2023-10-08T16:05:00.508257+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:00.508257+0000","last_undegraded":"2023-10-08T16:05:00.508257+0000","last_fullsized":"2023-10-08T16:05:00.508257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496551+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505739+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:00.505739+0000","last_peered":"2023-10-08T16:05:00.505739+0000","last_clean":"2023-10-08T16:05:00.505739+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:00.505739+0000","last_undegraded":"2023-10-08T16:05:00.505739+0000","last_fullsized":"2023-10-08T16:05:00.505739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495226+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499397+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:00.499397+0000","last_peered":"2023-10-08T16:05:00.499397+0000","last_clean":"2023-10-08T16:05:00.499397+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:00.499397+0000","last_undegraded":"2023-10-08T16:05:00.499397+0000","last_fullsized":"2023-10-08T16:05:00.499397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498264+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506081+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:00.506081+0000","last_peered":"2023-10-08T16:05:00.506081+0000","last_clean":"2023-10-08T16:05:00.506081+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:00.506081+0000","last_undegraded":"2023-10-08T16:05:00.506081+0000","last_fullsized":"2023-10-08T16:05:00.506081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496592+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500864+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:00.500864+0000","last_peered":"2023-10-08T16:05:00.500864+0000","last_clean":"2023-10-08T16:05:00.500864+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:00.500864+0000","last_undegraded":"2023-10-08T16:05:00.500864+0000","last_fullsized":"2023-10-08T16:05:00.500864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498980+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502071+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:00.502071+0000","last_peered":"2023-10-08T16:05:00.502071+0000","last_clean":"2023-10-08T16:05:00.502071+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:00.502071+0000","last_undegraded":"2023-10-08T16:05:00.502071+0000","last_fullsized":"2023-10-08T16:05:00.502071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497346+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502386+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:00.502386+0000","last_peered":"2023-10-08T16:05:00.502386+0000","last_clean":"2023-10-08T16:05:00.502386+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:00.502386+0000","last_undegraded":"2023-10-08T16:05:00.502386+0000","last_fullsized":"2023-10-08T16:05:00.502386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495503+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499218+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:00.499218+0000","last_peered":"2023-10-08T16:05:00.499218+0000","last_clean":"2023-10-08T16:05:00.499218+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:00.499218+0000","last_undegraded":"2023-10-08T16:05:00.499218+0000","last_fullsized":"2023-10-08T16:05:00.499218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493134+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.190986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497995+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.497630+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:00.497630+0000","last_peered":"2023-10-08T16:05:00.497630+0000","last_clean":"2023-10-08T16:05:00.497630+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:00.497630+0000","last_undegraded":"2023-10-08T16:05:00.497630+0000","last_fullsized":"2023-10-08T16:05:00.497630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498784+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507753+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:00.507753+0000","last_peered":"2023-10-08T16:05:00.507753+0000","last_clean":"2023-10-08T16:05:00.507753+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:00.507753+0000","last_undegraded":"2023-10-08T16:05:00.507753+0000","last_fullsized":"2023-10-08T16:05:00.507753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T16:04:59.487151+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:04:59.487151+0000","last_peered":"2023-10-08T16:04:59.487151+0000","last_clean":"2023-10-08T16:04:59.487151+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:04:59.487151+0000","last_undegraded":"2023-10-08T16:04:59.487151+0000","last_fullsized":"2023-10-08T16:04:59.487151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494859+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505073+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:00.505073+0000","last_peered":"2023-10-08T16:05:00.505073+0000","last_clean":"2023-10-08T16:05:00.505073+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:00.505073+0000","last_undegraded":"2023-10-08T16:05:00.505073+0000","last_fullsized":"2023-10-08T16:05:00.505073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507413+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:00.507413+0000","last_peered":"2023-10-08T16:05:00.507413+0000","last_clean":"2023-10-08T16:05:00.507413+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:00.507413+0000","last_undegraded":"2023-10-08T16:05:00.507413+0000","last_fullsized":"2023-10-08T16:05:00.507413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497941+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501771+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:00.501771+0000","last_peered":"2023-10-08T16:05:00.501771+0000","last_clean":"2023-10-08T16:05:00.501771+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:00.501771+0000","last_undegraded":"2023-10-08T16:05:00.501771+0000","last_fullsized":"2023-10-08T16:05:00.501771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499209+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503946+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:00.503946+0000","last_peered":"2023-10-08T16:05:00.503946+0000","last_clean":"2023-10-08T16:05:00.503946+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:00.503946+0000","last_undegraded":"2023-10-08T16:05:00.503946+0000","last_fullsized":"2023-10-08T16:05:00.503946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496145+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507066+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:00.507066+0000","last_peered":"2023-10-08T16:05:00.507066+0000","last_clean":"2023-10-08T16:05:00.507066+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:00.507066+0000","last_undegraded":"2023-10-08T16:05:00.507066+0000","last_fullsized":"2023-10-08T16:05:00.507066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493566+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504446+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:00.504446+0000","last_peered":"2023-10-08T16:05:00.504446+0000","last_clean":"2023-10-08T16:05:00.504446+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:00.504446+0000","last_undegraded":"2023-10-08T16:05:00.504446+0000","last_fullsized":"2023-10-08T16:05:00.504446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498865+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508562+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:00.508562+0000","last_peered":"2023-10-08T16:05:00.508562+0000","last_clean":"2023-10-08T16:05:00.508562+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:00.508562+0000","last_undegraded":"2023-10-08T16:05:00.508562+0000","last_fullsized":"2023-10-08T16:05:00.508562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500850+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506058+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:00.506058+0000","last_peered":"2023-10-08T16:05:00.506058+0000","last_clean":"2023-10-08T16:05:00.506058+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:00.506058+0000","last_undegraded":"2023-10-08T16:05:00.506058+0000","last_fullsized":"2023-10-08T16:05:00.506058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497102+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504216+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:00.504216+0000","last_peered":"2023-10-08T16:05:00.504216+0000","last_clean":"2023-10-08T16:05:00.504216+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:00.504216+0000","last_undegraded":"2023-10-08T16:05:00.504216+0000","last_fullsized":"2023-10-08T16:05:00.504216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497107+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499292+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:00.499292+0000","last_peered":"2023-10-08T16:05:00.499292+0000","last_clean":"2023-10-08T16:05:00.499292+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:00.499292+0000","last_undegraded":"2023-10-08T16:05:00.499292+0000","last_fullsized":"2023-10-08T16:05:00.499292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495157+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.496605+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:00.496605+0000","last_peered":"2023-10-08T16:05:00.496605+0000","last_clean":"2023-10-08T16:05:00.496605+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:00.496605+0000","last_undegraded":"2023-10-08T16:05:00.496605+0000","last_fullsized":"2023-10-08T16:05:00.496605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497371+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499337+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495647+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497473+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495823+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501265+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498861+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495629+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499903+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496366+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501657+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500175+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499938+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495474+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:05.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:05.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.748+0000 7f7f5622c700 1 Processor -- start 2023-10-08T16:05:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.748+0000 7f7f5622c700 1 -- start start 2023-10-08T16:05:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f5622c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f50158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f5622c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5015cbb0 con 0x7f7f50157870 2023-10-08T16:05:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f5622c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5015bfa0 con 0x7f7f5015a620 2023-10-08T16:05:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f5622c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5015bdb0 con 0x7f7f50157c40 2023-10-08T16:05:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f4f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7f50157870 0x7f7f5015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43702/0 (socket says 172.21.15.60:43702) 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f4f7fe700 1 -- 172.21.15.60:0/574192417 learned_addr learned my addr 172.21.15.60:0/574192417 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f4ffff700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f50158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127681563 0 0) 0x7f7f5015cbb0 con 0x7f7f50157870 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.749+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f38003570 con 0x7f7f50157870 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072486617 0 0) 0x7f7f5015bfa0 con 0x7f7f5015a620 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f5015cbb0 con 0x7f7f5015a620 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488086970 0 0) 0x7f7f38003570 con 0x7f7f50157870 2023-10-08T16:05:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 msgr2=0x7f7f50158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f50158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 >> v1:172.21.15.144:6789/0 conn(0x7f7f5015a620 legacy=0x7f7f5015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5015c280 con 0x7f7f50157870 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f7f40001470 con 0x7f7f50157870 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 >> v1:172.21.15.60:6789/0 conn(0x7f7f50157870 legacy=0x7f7f5015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f38003c20 0x7f7f38004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38004810 0x7f7f38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3800bb10 con 0x7f7f38003c20 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3800bc80 con 0x7f7f38004810 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3800be40 con 0x7f7f50157c40 2023-10-08T16:05:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f38003c20 0x7f7f38004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4ffff700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4effd700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38004810 0x7f7f38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 -- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 msgr2=0x7f7f380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 -- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38004810 msgr2=0x7f7f38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38004810 0x7f7f38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 -- 172.21.15.60:0/574192417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38003570 con 0x7f7f38003c20 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4ffff700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f50157c40 0x7f7f380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4effd700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38004810 0x7f7f38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f38003c20 0x7f7f38004010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000c2d0 tx=0x7f7f40001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59adb871d1c4115 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000cba0 con 0x7f7f38003c20 2023-10-08T16:05:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000cd00 con 0x7f7f38003c20 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.750+0000 7f7f4e7fc700 1 -- 172.21.15.60:0/574192417 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40005b70 con 0x7f7f38003c20 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f5622c700 1 -- 172.21.15.60:0/574192417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f38003c20 msgr2=0x7f7f38004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f5622c700 1 --2- 172.21.15.60:0/574192417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f38003c20 0x7f7f38004010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000c2d0 tx=0x7f7f40001e10 comp rx=0 tx=0).stop 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f4ffff700 1 -- 172.21.15.60:0/574192417 reap_dead start 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f5622c700 1 -- 172.21.15.60:0/574192417 shutdown_connections 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f5622c700 1 -- 172.21.15.60:0/574192417 >> 172.21.15.60:0/574192417 conn(0x7f7f50068ce0 msgr2=0x7f7f500690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f5622c700 1 -- 172.21.15.60:0/574192417 shutdown_connections 2023-10-08T16:05:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.751+0000 7f7f5622c700 1 -- 172.21.15.60:0/574192417 wait complete. 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.752+0000 7f7f5622c700 1 Processor -- start 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.752+0000 7f7f5622c700 1 -- start start 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f5622c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38003c20 0x7f7f50153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f5622c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 0x7f7f501515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f5622c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f500b1820 0x7f7f500b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f5622c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50151b10 con 0x7f7f50151160 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f5622c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50154520 con 0x7f7f38003c20 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f5622c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500b2550 con 0x7f7f500b1820 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 0x7f7f501515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 0x7f7f501515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40222/0 (socket says 172.21.15.60:40222) 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4effd700 1 -- 172.21.15.60:0/963751961 learned_addr learned my addr 172.21.15.60:0/963751961 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4ffff700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f500b1820 0x7f7f500b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38003c20 0x7f7f50153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4effd700 1 -- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f500b1820 msgr2=0x7f7f500b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.753+0000 7f7f4effd700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f500b1820 0x7f7f500b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f4effd700 1 -- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38003c20 msgr2=0x7f7f50153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f4effd700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38003c20 0x7f7f50153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f4effd700 1 -- 172.21.15.60:0/963751961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500b2830 con 0x7f7f50151160 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f4effd700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 0x7f7f501515d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7f44000f60 tx=0x7f7f44009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44012590 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f440126f0 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f500b2b10 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44012a90 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.754+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f500b21b0 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.755+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5004c3c0 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.755+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f44013420 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.756+0000 7f7f377fe700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7f3c066f30 0x7f7f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.756+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f44084200 con 0x7f7f50151160 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.756+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7f3c066f30 0x7f7f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.756+0000 7f7f4f7fe700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7f3c066f30 0x7f7f3c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f40007c90 tx=0x7f7f40015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.760+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f44051470 con 0x7f7f50151160 2023-10-08T16:05:05.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.948+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f5015c560 con 0x7f7f3c066f30 2023-10-08T16:05:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.955+0000 7f7f377fe700 1 -- 172.21.15.60:0/963751961 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257332 (secure 0 0 0) 0x7f7f5015c560 con 0x7f7f3c066f30 2023-10-08T16:05:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7f3c066f30 msgr2=0x7f7f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7f3c066f30 0x7f7f3c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f40007c90 tx=0x7f7f40015000 comp rx=0 tx=0).stop 2023-10-08T16:05:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 msgr2=0x7f7f501515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 0x7f7f501515d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7f44000f60 tx=0x7f7f44009040 comp rx=0 tx=0).stop 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 shutdown_connections 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7f3c066f30 0x7f7f3c0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f500b1820 0x7f7f500b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f38003c20 0x7f7f50153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 --2- 172.21.15.60:0/963751961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f50151160 0x7f7f501515d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 >> 172.21.15.60:0/963751961 conn(0x7f7f50068ce0 msgr2=0x7f7f500b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 shutdown_connections 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:05.959+0000 7f7f5622c700 1 -- 172.21.15.60:0/963751961 wait complete. 2023-10-08T16:05:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:05.972 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T16:05:05.561540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560947,"statfs":{"total":1600000000,"available":1598409824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001004"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497556+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500930+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496976+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501553+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500651+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500928+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500078+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502439+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498975+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495972+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496806+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493953+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502025+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499988+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500576+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497059+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498617+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505057+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:00.505057+0000","last_peered":"2023-10-08T16:05:00.505057+0000","last_clean":"2023-10-08T16:05:00.505057+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:00.505057+0000","last_undegraded":"2023-10-08T16:05:00.505057+0000","last_fullsized":"2023-10-08T16:05:00.505057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.505777+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507202+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:00.507202+0000","last_peered":"2023-10-08T16:05:00.507202+0000","last_clean":"2023-10-08T16:05:00.507202+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:00.507202+0000","last_undegraded":"2023-10-08T16:05:00.507202+0000","last_fullsized":"2023-10-08T16:05:00.507202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503801+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:00.503801+0000","last_peered":"2023-10-08T16:05:00.503801+0000","last_clean":"2023-10-08T16:05:00.503801+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:00.503801+0000","last_undegraded":"2023-10-08T16:05:00.503801+0000","last_fullsized":"2023-10-08T16:05:00.503801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497813+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504293+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:00.504293+0000","last_peered":"2023-10-08T16:05:00.504293+0000","last_clean":"2023-10-08T16:05:00.504293+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:00.504293+0000","last_undegraded":"2023-10-08T16:05:00.504293+0000","last_fullsized":"2023-10-08T16:05:00.504293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497038+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504995+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:00.504995+0000","last_peered":"2023-10-08T16:05:00.504995+0000","last_clean":"2023-10-08T16:05:00.504995+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:00.504995+0000","last_undegraded":"2023-10-08T16:05:00.504995+0000","last_fullsized":"2023-10-08T16:05:00.504995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493408+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505226+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:00.505226+0000","last_peered":"2023-10-08T16:05:00.505226+0000","last_clean":"2023-10-08T16:05:00.505226+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:00.505226+0000","last_undegraded":"2023-10-08T16:05:00.505226+0000","last_fullsized":"2023-10-08T16:05:00.505226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507367+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:00.507367+0000","last_peered":"2023-10-08T16:05:00.507367+0000","last_clean":"2023-10-08T16:05:00.507367+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:00.507367+0000","last_undegraded":"2023-10-08T16:05:00.507367+0000","last_fullsized":"2023-10-08T16:05:00.507367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499502+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505047+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:00.505047+0000","last_peered":"2023-10-08T16:05:00.505047+0000","last_clean":"2023-10-08T16:05:00.505047+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:00.505047+0000","last_undegraded":"2023-10-08T16:05:00.505047+0000","last_fullsized":"2023-10-08T16:05:00.505047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498428+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500519+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:00.500519+0000","last_peered":"2023-10-08T16:05:00.500519+0000","last_clean":"2023-10-08T16:05:00.500519+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:00.500519+0000","last_undegraded":"2023-10-08T16:05:00.500519+0000","last_fullsized":"2023-10-08T16:05:00.500519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496311+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501225+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:00.501225+0000","last_peered":"2023-10-08T16:05:00.501225+0000","last_clean":"2023-10-08T16:05:00.501225+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:00.501225+0000","last_undegraded":"2023-10-08T16:05:00.501225+0000","last_fullsized":"2023-10-08T16:05:00.501225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498283+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502084+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:00.502084+0000","last_peered":"2023-10-08T16:05:00.502084+0000","last_clean":"2023-10-08T16:05:00.502084+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:00.502084+0000","last_undegraded":"2023-10-08T16:05:00.502084+0000","last_fullsized":"2023-10-08T16:05:00.502084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494454+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508257+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:00.508257+0000","last_peered":"2023-10-08T16:05:00.508257+0000","last_clean":"2023-10-08T16:05:00.508257+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:00.508257+0000","last_undegraded":"2023-10-08T16:05:00.508257+0000","last_fullsized":"2023-10-08T16:05:00.508257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496551+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505739+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:00.505739+0000","last_peered":"2023-10-08T16:05:00.505739+0000","last_clean":"2023-10-08T16:05:00.505739+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:00.505739+0000","last_undegraded":"2023-10-08T16:05:00.505739+0000","last_fullsized":"2023-10-08T16:05:00.505739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495226+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499397+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:00.499397+0000","last_peered":"2023-10-08T16:05:00.499397+0000","last_clean":"2023-10-08T16:05:00.499397+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:00.499397+0000","last_undegraded":"2023-10-08T16:05:00.499397+0000","last_fullsized":"2023-10-08T16:05:00.499397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498264+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506081+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:00.506081+0000","last_peered":"2023-10-08T16:05:00.506081+0000","last_clean":"2023-10-08T16:05:00.506081+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:00.506081+0000","last_undegraded":"2023-10-08T16:05:00.506081+0000","last_fullsized":"2023-10-08T16:05:00.506081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496592+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500864+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:00.500864+0000","last_peered":"2023-10-08T16:05:00.500864+0000","last_clean":"2023-10-08T16:05:00.500864+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:00.500864+0000","last_undegraded":"2023-10-08T16:05:00.500864+0000","last_fullsized":"2023-10-08T16:05:00.500864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498980+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502071+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:00.502071+0000","last_peered":"2023-10-08T16:05:00.502071+0000","last_clean":"2023-10-08T16:05:00.502071+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:00.502071+0000","last_undegraded":"2023-10-08T16:05:00.502071+0000","last_fullsized":"2023-10-08T16:05:00.502071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497346+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502386+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:00.502386+0000","last_peered":"2023-10-08T16:05:00.502386+0000","last_clean":"2023-10-08T16:05:00.502386+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:00.502386+0000","last_undegraded":"2023-10-08T16:05:00.502386+0000","last_fullsized":"2023-10-08T16:05:00.502386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495503+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499218+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:00.499218+0000","last_peered":"2023-10-08T16:05:00.499218+0000","last_clean":"2023-10-08T16:05:00.499218+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:00.499218+0000","last_undegraded":"2023-10-08T16:05:00.499218+0000","last_fullsized":"2023-10-08T16:05:00.499218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493134+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.190986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497995+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.497630+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:00.497630+0000","last_peered":"2023-10-08T16:05:00.497630+0000","last_clean":"2023-10-08T16:05:00.497630+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:00.497630+0000","last_undegraded":"2023-10-08T16:05:00.497630+0000","last_fullsized":"2023-10-08T16:05:00.497630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498784+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507753+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:00.507753+0000","last_peered":"2023-10-08T16:05:00.507753+0000","last_clean":"2023-10-08T16:05:00.507753+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:00.507753+0000","last_undegraded":"2023-10-08T16:05:00.507753+0000","last_fullsized":"2023-10-08T16:05:00.507753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T16:04:59.487151+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:04:59.487151+0000","last_peered":"2023-10-08T16:04:59.487151+0000","last_clean":"2023-10-08T16:04:59.487151+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:04:59.487151+0000","last_undegraded":"2023-10-08T16:04:59.487151+0000","last_fullsized":"2023-10-08T16:04:59.487151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494859+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505073+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:00.505073+0000","last_peered":"2023-10-08T16:05:00.505073+0000","last_clean":"2023-10-08T16:05:00.505073+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:00.505073+0000","last_undegraded":"2023-10-08T16:05:00.505073+0000","last_fullsized":"2023-10-08T16:05:00.505073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507413+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:00.507413+0000","last_peered":"2023-10-08T16:05:00.507413+0000","last_clean":"2023-10-08T16:05:00.507413+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:00.507413+0000","last_undegraded":"2023-10-08T16:05:00.507413+0000","last_fullsized":"2023-10-08T16:05:00.507413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497941+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501771+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:00.501771+0000","last_peered":"2023-10-08T16:05:00.501771+0000","last_clean":"2023-10-08T16:05:00.501771+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:00.501771+0000","last_undegraded":"2023-10-08T16:05:00.501771+0000","last_fullsized":"2023-10-08T16:05:00.501771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499209+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503946+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:00.503946+0000","last_peered":"2023-10-08T16:05:00.503946+0000","last_clean":"2023-10-08T16:05:00.503946+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:00.503946+0000","last_undegraded":"2023-10-08T16:05:00.503946+0000","last_fullsized":"2023-10-08T16:05:00.503946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496145+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507066+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:00.507066+0000","last_peered":"2023-10-08T16:05:00.507066+0000","last_clean":"2023-10-08T16:05:00.507066+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:00.507066+0000","last_undegraded":"2023-10-08T16:05:00.507066+0000","last_fullsized":"2023-10-08T16:05:00.507066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493566+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504446+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:00.504446+0000","last_peered":"2023-10-08T16:05:00.504446+0000","last_clean":"2023-10-08T16:05:00.504446+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:00.504446+0000","last_undegraded":"2023-10-08T16:05:00.504446+0000","last_fullsized":"2023-10-08T16:05:00.504446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498865+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508562+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:00.508562+0000","last_peered":"2023-10-08T16:05:00.508562+0000","last_clean":"2023-10-08T16:05:00.508562+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:00.508562+0000","last_undegraded":"2023-10-08T16:05:00.508562+0000","last_fullsized":"2023-10-08T16:05:00.508562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500850+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506058+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:00.506058+0000","last_peered":"2023-10-08T16:05:00.506058+0000","last_clean":"2023-10-08T16:05:00.506058+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:00.506058+0000","last_undegraded":"2023-10-08T16:05:00.506058+0000","last_fullsized":"2023-10-08T16:05:00.506058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497102+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504216+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:00.504216+0000","last_peered":"2023-10-08T16:05:00.504216+0000","last_clean":"2023-10-08T16:05:00.504216+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:00.504216+0000","last_undegraded":"2023-10-08T16:05:00.504216+0000","last_fullsized":"2023-10-08T16:05:00.504216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497107+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499292+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:00.499292+0000","last_peered":"2023-10-08T16:05:00.499292+0000","last_clean":"2023-10-08T16:05:00.499292+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:00.499292+0000","last_undegraded":"2023-10-08T16:05:00.499292+0000","last_fullsized":"2023-10-08T16:05:00.499292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495157+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.496605+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:00.496605+0000","last_peered":"2023-10-08T16:05:00.496605+0000","last_clean":"2023-10-08T16:05:00.496605+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:00.496605+0000","last_undegraded":"2023-10-08T16:05:00.496605+0000","last_fullsized":"2023-10-08T16:05:00.496605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497371+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499337+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495647+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497473+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495823+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501265+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498861+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495629+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499903+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496366+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501657+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500175+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499938+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495474+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:05.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:06.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.130+0000 7f00416dc700 1 Processor -- start 2023-10-08T16:05:06.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.130+0000 7f00416dc700 1 -- start start 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f00416dc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f003c159850 0x7f003c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f00416dc700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c0cbaa0 con 0x7f003c069220 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f00416dc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c0cbd80 con 0x7f003c0b2be0 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f00416dc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003c0cc060 con 0x7f003c159850 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f003b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f003c069220 0x7f003c0ccb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43718/0 (socket says 172.21.15.60:43718) 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f003b7fe700 1 -- 172.21.15.60:0/1280865277 learned_addr learned my addr 172.21.15.60:0/1280865277 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603367705 0 0) 0x7f003c0cbaa0 con 0x7f003c069220 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0028003570 con 0x7f003c069220 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.131+0000 7f003affd700 1 --2- 172.21.15.60:0/1280865277 >> v2:172.21.15.144:3300/0 conn(0x7f003c159850 0x7f003c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555434517 0 0) 0x7f0028003570 con 0x7f003c069220 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 >> v2:172.21.15.144:3300/0 conn(0x7f003c159850 msgr2=0x7f003c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 --2- 172.21.15.60:0/1280865277 >> v2:172.21.15.144:3300/0 conn(0x7f003c159850 0x7f003c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 >> v1:172.21.15.144:6789/0 conn(0x7f003c0b2be0 legacy=0x7f003c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0cc340 con 0x7f003c069220 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f0034001470 con 0x7f003c069220 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 >> v1:172.21.15.60:6789/0 conn(0x7f003c069220 legacy=0x7f003c0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0028003a60 0x7f0028003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0028004810 0x7f0028004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00280051c0 0x7f002800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0cc060 con 0x7f0028003a60 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002800c0e0 con 0x7f00280051c0 2023-10-08T16:05:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002800c2a0 con 0x7f0028004810 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0028003a60 0x7f0028003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003a7fc700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0028004810 0x7f0028004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003b7fe700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00280051c0 0x7f002800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 -- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0028004810 msgr2=0x7f0028004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0028004810 0x7f0028004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 -- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00280051c0 msgr2=0x7f002800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00280051c0 0x7f002800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 -- 172.21.15.60:0/1280865277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0028003570 con 0x7f0028003a60 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003b7fe700 1 -- 172.21.15.60:0/1280865277 reap_dead start 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.132+0000 7f003affd700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0028003a60 0x7f0028003e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f002c00e210 tx=0x7f002c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631ef644fefa2cdd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00eac0 con 0x7f0028003a60 2023-10-08T16:05:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00f040 con 0x7f0028003a60 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f0039ffb700 1 -- 172.21.15.60:0/1280865277 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00ee70 con 0x7f0028003a60 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 -- 172.21.15.60:0/1280865277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0028003a60 msgr2=0x7f0028003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0028003a60 0x7f0028003e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f002c00e210 tx=0x7f002c00b040 comp rx=0 tx=0).stop 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 -- 172.21.15.60:0/1280865277 shutdown_connections 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 --2- 172.21.15.60:0/1280865277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0028003a60 0x7f0028003e30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 -- 172.21.15.60:0/1280865277 >> 172.21.15.60:0/1280865277 conn(0x7f003c067660 msgr2=0x7f003c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 -- 172.21.15.60:0/1280865277 shutdown_connections 2023-10-08T16:05:06.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.133+0000 7f00416dc700 1 -- 172.21.15.60:0/1280865277 wait complete. 2023-10-08T16:05:06.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.134+0000 7f00416dc700 1 Processor -- start 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.134+0000 7f00416dc700 1 -- start start 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f00416dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0028003a60 0x7f003c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f00416dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f003c15adf0 0x7f003c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f00416dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 0x7f003c0cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f00416dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0d00c0 con 0x7f003c0cf700 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f00416dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0c4ef0 con 0x7f0028003a60 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f00416dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0c51d0 con 0x7f003c15adf0 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f003b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 0x7f003c0cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f003b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 0x7f003c0cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40228/0 (socket says 172.21.15.60:40228) 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f003b7fe700 1 -- 172.21.15.60:0/1680155881 learned_addr learned my addr 172.21.15.60:0/1680155881 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:06.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f003affd700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0028003a60 0x7f003c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.135+0000 7f003a7fc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f003c15adf0 0x7f003c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f003b7fe700 1 -- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f003c15adf0 msgr2=0x7f003c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f003b7fe700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f003c15adf0 0x7f003c151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f003b7fe700 1 -- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0028003a60 msgr2=0x7f003c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f003b7fe700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0028003a60 0x7f003c0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f003b7fe700 1 -- 172.21.15.60:0/1680155881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0c54b0 con 0x7f003c0cf700 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f003b7fe700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 0x7f003c0cfb80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b1ba0 tx=0x7f0034001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034001b00 con 0x7f003c0cf700 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003400f630 con 0x7f003c0cf700 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c0c5790 con 0x7f003c0cf700 2023-10-08T16:05:06.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400f9d0 con 0x7f003c0cf700 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.136+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c0c4ac0 con 0x7f003c0cf700 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.137+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c0c4cb0 con 0x7f003c0cf700 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.137+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f003401d460 con 0x7f003c0cf700 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.138+0000 7f0032ffd700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f001c066f30 0x7f001c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.138+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00340844e0 con 0x7f003c0cf700 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.138+0000 7f003affd700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f001c066f30 0x7f001c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.138+0000 7f003affd700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f001c066f30 0x7f001c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f002c00afd0 tx=0x7f002c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.142+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f003c0c4cb0 con 0x7f003c0cf700 2023-10-08T16:05:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.328+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f003c0c4cb0 con 0x7f001c066f30 2023-10-08T16:05:06.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.336+0000 7f0032ffd700 1 -- 172.21.15.60:0/1680155881 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257332 (secure 0 0 0) 0x7f003c0c4cb0 con 0x7f001c066f30 2023-10-08T16:05:06.340 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f001c066f30 msgr2=0x7f001c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f001c066f30 0x7f001c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f002c00afd0 tx=0x7f002c01a000 comp rx=0 tx=0).stop 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 msgr2=0x7f003c0cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 0x7f003c0cfb80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b1ba0 tx=0x7f0034001e70 comp rx=0 tx=0).stop 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 shutdown_connections 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f001c066f30 0x7f001c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c0cf700 0x7f003c0cfb80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0028003a60 0x7f003c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 --2- 172.21.15.60:0/1680155881 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f003c15adf0 0x7f003c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 >> 172.21.15.60:0/1680155881 conn(0x7f003c067660 msgr2=0x7f003c1584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:06.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 shutdown_connections 2023-10-08T16:05:06.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.339+0000 7f00416dc700 1 -- 172.21.15.60:0/1680155881 wait complete. 2023-10-08T16:05:06.343 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:06.352 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T16:05:05.561540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560947,"statfs":{"total":1600000000,"available":1598409824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001004"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497556+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500930+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496976+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501553+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500651+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500928+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500078+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502439+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498975+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495972+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496806+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493953+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502025+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499988+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500576+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497059+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498617+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505057+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:00.505057+0000","last_peered":"2023-10-08T16:05:00.505057+0000","last_clean":"2023-10-08T16:05:00.505057+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:00.505057+0000","last_undegraded":"2023-10-08T16:05:00.505057+0000","last_fullsized":"2023-10-08T16:05:00.505057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.505777+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507202+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:00.507202+0000","last_peered":"2023-10-08T16:05:00.507202+0000","last_clean":"2023-10-08T16:05:00.507202+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:00.507202+0000","last_undegraded":"2023-10-08T16:05:00.507202+0000","last_fullsized":"2023-10-08T16:05:00.507202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503801+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:00.503801+0000","last_peered":"2023-10-08T16:05:00.503801+0000","last_clean":"2023-10-08T16:05:00.503801+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:00.503801+0000","last_undegraded":"2023-10-08T16:05:00.503801+0000","last_fullsized":"2023-10-08T16:05:00.503801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497813+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504293+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:00.504293+0000","last_peered":"2023-10-08T16:05:00.504293+0000","last_clean":"2023-10-08T16:05:00.504293+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:00.504293+0000","last_undegraded":"2023-10-08T16:05:00.504293+0000","last_fullsized":"2023-10-08T16:05:00.504293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497038+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504995+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:00.504995+0000","last_peered":"2023-10-08T16:05:00.504995+0000","last_clean":"2023-10-08T16:05:00.504995+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:00.504995+0000","last_undegraded":"2023-10-08T16:05:00.504995+0000","last_fullsized":"2023-10-08T16:05:00.504995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493408+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505226+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:00.505226+0000","last_peered":"2023-10-08T16:05:00.505226+0000","last_clean":"2023-10-08T16:05:00.505226+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:00.505226+0000","last_undegraded":"2023-10-08T16:05:00.505226+0000","last_fullsized":"2023-10-08T16:05:00.505226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507367+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:00.507367+0000","last_peered":"2023-10-08T16:05:00.507367+0000","last_clean":"2023-10-08T16:05:00.507367+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:00.507367+0000","last_undegraded":"2023-10-08T16:05:00.507367+0000","last_fullsized":"2023-10-08T16:05:00.507367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499502+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505047+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:00.505047+0000","last_peered":"2023-10-08T16:05:00.505047+0000","last_clean":"2023-10-08T16:05:00.505047+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:00.505047+0000","last_undegraded":"2023-10-08T16:05:00.505047+0000","last_fullsized":"2023-10-08T16:05:00.505047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498428+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500519+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:00.500519+0000","last_peered":"2023-10-08T16:05:00.500519+0000","last_clean":"2023-10-08T16:05:00.500519+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:00.500519+0000","last_undegraded":"2023-10-08T16:05:00.500519+0000","last_fullsized":"2023-10-08T16:05:00.500519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496311+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501225+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:00.501225+0000","last_peered":"2023-10-08T16:05:00.501225+0000","last_clean":"2023-10-08T16:05:00.501225+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:00.501225+0000","last_undegraded":"2023-10-08T16:05:00.501225+0000","last_fullsized":"2023-10-08T16:05:00.501225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498283+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502084+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:00.502084+0000","last_peered":"2023-10-08T16:05:00.502084+0000","last_clean":"2023-10-08T16:05:00.502084+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:00.502084+0000","last_undegraded":"2023-10-08T16:05:00.502084+0000","last_fullsized":"2023-10-08T16:05:00.502084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494454+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508257+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:00.508257+0000","last_peered":"2023-10-08T16:05:00.508257+0000","last_clean":"2023-10-08T16:05:00.508257+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:00.508257+0000","last_undegraded":"2023-10-08T16:05:00.508257+0000","last_fullsized":"2023-10-08T16:05:00.508257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496551+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505739+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:00.505739+0000","last_peered":"2023-10-08T16:05:00.505739+0000","last_clean":"2023-10-08T16:05:00.505739+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:00.505739+0000","last_undegraded":"2023-10-08T16:05:00.505739+0000","last_fullsized":"2023-10-08T16:05:00.505739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495226+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499397+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:00.499397+0000","last_peered":"2023-10-08T16:05:00.499397+0000","last_clean":"2023-10-08T16:05:00.499397+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:00.499397+0000","last_undegraded":"2023-10-08T16:05:00.499397+0000","last_fullsized":"2023-10-08T16:05:00.499397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498264+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506081+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:00.506081+0000","last_peered":"2023-10-08T16:05:00.506081+0000","last_clean":"2023-10-08T16:05:00.506081+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:00.506081+0000","last_undegraded":"2023-10-08T16:05:00.506081+0000","last_fullsized":"2023-10-08T16:05:00.506081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496592+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500864+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:00.500864+0000","last_peered":"2023-10-08T16:05:00.500864+0000","last_clean":"2023-10-08T16:05:00.500864+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:00.500864+0000","last_undegraded":"2023-10-08T16:05:00.500864+0000","last_fullsized":"2023-10-08T16:05:00.500864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498980+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502071+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:00.502071+0000","last_peered":"2023-10-08T16:05:00.502071+0000","last_clean":"2023-10-08T16:05:00.502071+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:00.502071+0000","last_undegraded":"2023-10-08T16:05:00.502071+0000","last_fullsized":"2023-10-08T16:05:00.502071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497346+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502386+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:00.502386+0000","last_peered":"2023-10-08T16:05:00.502386+0000","last_clean":"2023-10-08T16:05:00.502386+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:00.502386+0000","last_undegraded":"2023-10-08T16:05:00.502386+0000","last_fullsized":"2023-10-08T16:05:00.502386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495503+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499218+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:00.499218+0000","last_peered":"2023-10-08T16:05:00.499218+0000","last_clean":"2023-10-08T16:05:00.499218+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:00.499218+0000","last_undegraded":"2023-10-08T16:05:00.499218+0000","last_fullsized":"2023-10-08T16:05:00.499218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493134+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.190986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497995+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.497630+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:00.497630+0000","last_peered":"2023-10-08T16:05:00.497630+0000","last_clean":"2023-10-08T16:05:00.497630+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:00.497630+0000","last_undegraded":"2023-10-08T16:05:00.497630+0000","last_fullsized":"2023-10-08T16:05:00.497630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498784+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507753+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:00.507753+0000","last_peered":"2023-10-08T16:05:00.507753+0000","last_clean":"2023-10-08T16:05:00.507753+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:00.507753+0000","last_undegraded":"2023-10-08T16:05:00.507753+0000","last_fullsized":"2023-10-08T16:05:00.507753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T16:04:59.487151+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:04:59.487151+0000","last_peered":"2023-10-08T16:04:59.487151+0000","last_clean":"2023-10-08T16:04:59.487151+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:04:59.487151+0000","last_undegraded":"2023-10-08T16:04:59.487151+0000","last_fullsized":"2023-10-08T16:04:59.487151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494859+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505073+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:00.505073+0000","last_peered":"2023-10-08T16:05:00.505073+0000","last_clean":"2023-10-08T16:05:00.505073+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:00.505073+0000","last_undegraded":"2023-10-08T16:05:00.505073+0000","last_fullsized":"2023-10-08T16:05:00.505073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507413+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:00.507413+0000","last_peered":"2023-10-08T16:05:00.507413+0000","last_clean":"2023-10-08T16:05:00.507413+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:00.507413+0000","last_undegraded":"2023-10-08T16:05:00.507413+0000","last_fullsized":"2023-10-08T16:05:00.507413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497941+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501771+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:00.501771+0000","last_peered":"2023-10-08T16:05:00.501771+0000","last_clean":"2023-10-08T16:05:00.501771+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:00.501771+0000","last_undegraded":"2023-10-08T16:05:00.501771+0000","last_fullsized":"2023-10-08T16:05:00.501771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499209+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503946+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:00.503946+0000","last_peered":"2023-10-08T16:05:00.503946+0000","last_clean":"2023-10-08T16:05:00.503946+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:00.503946+0000","last_undegraded":"2023-10-08T16:05:00.503946+0000","last_fullsized":"2023-10-08T16:05:00.503946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496145+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507066+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:00.507066+0000","last_peered":"2023-10-08T16:05:00.507066+0000","last_clean":"2023-10-08T16:05:00.507066+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:00.507066+0000","last_undegraded":"2023-10-08T16:05:00.507066+0000","last_fullsized":"2023-10-08T16:05:00.507066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493566+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504446+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:00.504446+0000","last_peered":"2023-10-08T16:05:00.504446+0000","last_clean":"2023-10-08T16:05:00.504446+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:00.504446+0000","last_undegraded":"2023-10-08T16:05:00.504446+0000","last_fullsized":"2023-10-08T16:05:00.504446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498865+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508562+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:00.508562+0000","last_peered":"2023-10-08T16:05:00.508562+0000","last_clean":"2023-10-08T16:05:00.508562+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:00.508562+0000","last_undegraded":"2023-10-08T16:05:00.508562+0000","last_fullsized":"2023-10-08T16:05:00.508562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500850+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506058+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:00.506058+0000","last_peered":"2023-10-08T16:05:00.506058+0000","last_clean":"2023-10-08T16:05:00.506058+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:00.506058+0000","last_undegraded":"2023-10-08T16:05:00.506058+0000","last_fullsized":"2023-10-08T16:05:00.506058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497102+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504216+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:00.504216+0000","last_peered":"2023-10-08T16:05:00.504216+0000","last_clean":"2023-10-08T16:05:00.504216+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:00.504216+0000","last_undegraded":"2023-10-08T16:05:00.504216+0000","last_fullsized":"2023-10-08T16:05:00.504216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497107+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499292+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:00.499292+0000","last_peered":"2023-10-08T16:05:00.499292+0000","last_clean":"2023-10-08T16:05:00.499292+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:00.499292+0000","last_undegraded":"2023-10-08T16:05:00.499292+0000","last_fullsized":"2023-10-08T16:05:00.499292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495157+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.496605+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:00.496605+0000","last_peered":"2023-10-08T16:05:00.496605+0000","last_clean":"2023-10-08T16:05:00.496605+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:00.496605+0000","last_undegraded":"2023-10-08T16:05:00.496605+0000","last_fullsized":"2023-10-08T16:05:00.496605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497371+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499337+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495647+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497473+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495823+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501265+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498861+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495629+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499903+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496366+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501657+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500175+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499938+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495474+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497556+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500930+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496976+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-08T16:05:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.501553+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500651+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500928+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500078+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.502439+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498975+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495972+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496806+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.493953+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-08T16:05:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.502025+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495317+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.499988+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500561+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500576+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-08T16:05:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497059+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498617+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.505777+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496561+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-08T16:05:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497813+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-08T16:05:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497038+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-08T16:05:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.493408+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:05:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-08T16:05:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.494317+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-08T16:05:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.499502+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-08T16:05:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498428+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:05:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-08T16:05:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496311+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498283+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.494454+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496551+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-08T16:05:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495226+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498264+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496592+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498980+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497346+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495503+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.493134+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:03:23.190986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497995+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498784+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.494859+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497941+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.499209+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496145+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.493566+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-08T16:05:06.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498865+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500850+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497102+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497107+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495157+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-08T16:05:06.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497371+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.499337+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495647+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.497473+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495823+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.501265+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.498861+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495629+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.499903+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.496366+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.501657+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.500175+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.499938+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-08T16:05:06.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:05:00.486151+0000', 'last_change': '2023-10-08T16:05:00.495474+0000', 'last_active': '2023-10-08T16:05:00.486151+0000', 'last_peered': '2023-10-08T16:05:00.486151+0000', 'last_clean': '2023-10-08T16:05:00.486151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:05:00.486151+0000', 'last_undegraded': '2023-10-08T16:05:00.486151+0000', 'last_fullsized': '2023-10-08T16:05:00.486151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'last_clean_scrub_stamp': '2023-10-08T16:05:00.486151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:05:06.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:05:06.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.510+0000 7f6eeea8d700 1 Processor -- start 2023-10-08T16:05:06.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.510+0000 7f6eeea8d700 1 -- start start 2023-10-08T16:05:06.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eeea8d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ee8157c40 0x7f6ee8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eeea8d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee815cbb0 con 0x7f6ee815a620 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eeea8d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee815bfa0 con 0x7f6ee8157870 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eeea8d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee815bdb0 con 0x7f6ee8157c40 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6ee7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6ee815a620 0x7f6ee815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43726/0 (socket says 172.21.15.60:43726) 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6ee7fff700 1 -- 172.21.15.60:0/330774977 learned_addr learned my addr 172.21.15.60:0/330774977 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eec829700 1 --1- 172.21.15.60:0/330774977 >> v1:172.21.15.144:6789/0 conn(0x7f6ee8157870 0x7f6ee815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:33974/0 (socket says 172.21.15.60:33974) 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eed02a700 1 --2- 172.21.15.60:0/330774977 >> v2:172.21.15.144:3300/0 conn(0x7f6ee8157c40 0x7f6ee8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eed02a700 1 -- 172.21.15.60:0/330774977 >> v1:172.21.15.144:6789/0 conn(0x7f6ee8157870 legacy=0x7f6ee815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eed02a700 1 -- 172.21.15.60:0/330774977 >> v1:172.21.15.60:6789/0 conn(0x7f6ee815a620 legacy=0x7f6ee815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.511+0000 7f6eed02a700 1 -- 172.21.15.60:0/330774977 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee815c280 con 0x7f6ee8157c40 2023-10-08T16:05:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.512+0000 7f6eed02a700 1 --2- 172.21.15.60:0/330774977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee8158110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009e60 tx=0x7f6ee0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd30f57a3dc87ac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.513+0000 7f6ee77fe700 1 -- 172.21.15.60:0/330774977 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000e070 con 0x7f6ee8157c40 2023-10-08T16:05:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.513+0000 7f6ee77fe700 1 -- 172.21.15.60:0/330774977 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee000bc30 con 0x7f6ee8157c40 2023-10-08T16:05:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.513+0000 7f6ee77fe700 1 -- 172.21.15.60:0/330774977 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0012430 con 0x7f6ee8157c40 2023-10-08T16:05:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 -- 172.21.15.60:0/330774977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 msgr2=0x7f6ee8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/330774977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee8158110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009e60 tx=0x7f6ee0009780 comp rx=0 tx=0).stop 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 -- 172.21.15.60:0/330774977 shutdown_connections 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/330774977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee8158110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 -- 172.21.15.60:0/330774977 >> 172.21.15.60:0/330774977 conn(0x7f6ee8068ce0 msgr2=0x7f6ee80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 -- 172.21.15.60:0/330774977 shutdown_connections 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.514+0000 7f6eeea8d700 1 -- 172.21.15.60:0/330774977 wait complete. 2023-10-08T16:05:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.515+0000 7f6eeea8d700 1 Processor -- start 2023-10-08T16:05:06.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.515+0000 7f6eeea8d700 1 -- start start 2023-10-08T16:05:06.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eeea8d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ee8157870 0x7f6ee814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eeea8d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee813f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eeea8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 0x7f6ee816a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eeea8d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee814f3e0 con 0x7f6ee815a620 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eeea8d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee814f6c0 con 0x7f6ee8157c40 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eeea8d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee814f9a0 con 0x7f6ee8157870 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 0x7f6ee816a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 0x7f6ee816a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40244/0 (socket says 172.21.15.60:40244) 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 -- 172.21.15.60:0/3358777775 learned_addr learned my addr 172.21.15.60:0/3358777775 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6ee7fff700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee813f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eec829700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ee8157870 0x7f6ee814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 -- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ee8157870 msgr2=0x7f6ee814ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ee8157870 0x7f6ee814ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 -- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 msgr2=0x7f6ee813f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee813f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.516+0000 7f6eed02a700 1 -- 172.21.15.60:0/3358777775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009a20 con 0x7f6ee815a620 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.517+0000 7f6eed02a700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 0x7f6ee816a830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0013000 tx=0x7f6ee0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.517+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0012e10 con 0x7f6ee815a620 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.517+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee001e630 con 0x7f6ee815a620 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.517+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee814fc80 con 0x7f6ee815a620 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.517+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee001e9f0 con 0x7f6ee815a620 2023-10-08T16:05:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.517+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee814f0f0 con 0x7f6ee815a620 2023-10-08T16:05:06.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.518+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee81501a0 con 0x7f6ee815a620 2023-10-08T16:05:06.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.518+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ee0024070 con 0x7f6ee815a620 2023-10-08T16:05:06.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.518+0000 7f6ee4ff9700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ed4066f30 0x7f6ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.519+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ee0086d20 con 0x7f6ee815a620 2023-10-08T16:05:06.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.519+0000 7f6eec829700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ed4066f30 0x7f6ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.519+0000 7f6eec829700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ed4066f30 0x7f6ed40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.523+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ee81501a0 con 0x7f6ee815a620 2023-10-08T16:05:06.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.797+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6ee81501a0 con 0x7f6ee815a620 2023-10-08T16:05:06.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.797+0000 7f6ee4ff9700 1 -- 172.21.15.60:0/3358777775 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1027 (secure 0 0 0) 0x7f6ee81501a0 con 0x7f6ee815a620 2023-10-08T16:05:06.799 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:06.799 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781088,"num_in_osds":8,"osd_in_since":1696781085,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1590176,"bytes_avail":1598409824,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4269}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-08T16:04:43.527684+0000","services":{}},"progress_events":{}} 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ed4066f30 msgr2=0x7f6ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ed4066f30 0x7f6ed40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8007e70 comp rx=0 tx=0).stop 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 msgr2=0x7f6ee816a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 0x7f6ee816a830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0013000 tx=0x7f6ee0019000 comp rx=0 tx=0).stop 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 shutdown_connections 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ed4066f30 0x7f6ed40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ee8157870 0x7f6ee814ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee815a620 0x7f6ee816a830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 --2- 172.21.15.60:0/3358777775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8157c40 0x7f6ee813f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 >> 172.21.15.60:0/3358777775 conn(0x7f6ee8068ce0 msgr2=0x7f6ee80b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 shutdown_connections 2023-10-08T16:05:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.799+0000 7f6eeea8d700 1 -- 172.21.15.60:0/3358777775 wait complete. 2023-10-08T16:05:06.812 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:05:06.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.930+0000 7ff60f27b700 1 Processor -- start 2023-10-08T16:05:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.930+0000 7ff60f27b700 1 -- start start 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.930+0000 7ff60f27b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff60815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60f27b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6080cca20 con 0x7ff60815a0c0 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60f27b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60815ea40 con 0x7ff6080cf1c0 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60f27b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff608067660 con 0x7ff608159cf0 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60c816700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff60815a0c0 0x7ff6080ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43734/0 (socket says 172.21.15.60:43734) 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60c816700 1 -- 172.21.15.60:0/476782847 learned_addr learned my addr 172.21.15.60:0/476782847 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60d017700 1 --2- 172.21.15.60:0/476782847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff60815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601219562 0 0) 0x7ff6080cca20 con 0x7ff60815a0c0 2023-10-08T16:05:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f0003570 con 0x7ff60815a0c0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797292157 0 0) 0x7ff600001490 con 0x7ff6080cf1c0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6080cca20 con 0x7ff6080cf1c0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60d017700 1 -- 172.21.15.60:0/476782847 >> v1:172.21.15.144:6789/0 conn(0x7ff6080cf1c0 legacy=0x7ff608068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60d017700 1 -- 172.21.15.60:0/476782847 >> v1:172.21.15.60:6789/0 conn(0x7ff60815a0c0 legacy=0x7ff6080ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60d017700 1 -- 172.21.15.60:0/476782847 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608067f00 con 0x7ff608159cf0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.931+0000 7ff60d017700 1 --2- 172.21.15.60:0/476782847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff60815e500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009910 tx=0x7ff5f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53f9e7d7281d67a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8011630 con 0x7ff608159cf0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f8011790 con 0x7ff608159cf0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff607fff700 1 -- 172.21.15.60:0/476782847 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8011b30 con 0x7ff608159cf0 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 -- 172.21.15.60:0/476782847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 msgr2=0x7ff60815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 --2- 172.21.15.60:0/476782847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff60815e500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009910 tx=0x7ff5f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 -- 172.21.15.60:0/476782847 shutdown_connections 2023-10-08T16:05:06.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 --2- 172.21.15.60:0/476782847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff60815e500 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 -- 172.21.15.60:0/476782847 >> 172.21.15.60:0/476782847 conn(0x7ff60806c6e0 msgr2=0x7ff608069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:06.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 -- 172.21.15.60:0/476782847 shutdown_connections 2023-10-08T16:05:06.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.932+0000 7ff60f27b700 1 -- 172.21.15.60:0/476782847 wait complete. 2023-10-08T16:05:06.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.933+0000 7ff60f27b700 1 Processor -- start 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.933+0000 7ff60f27b700 1 -- start start 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60f27b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6080cf1c0 0x7ff6080c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60f27b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff6080b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60f27b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 0x7ff60816a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60f27b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080b2960 con 0x7ff60815a0c0 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60f27b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080b2c40 con 0x7ff6080cf1c0 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60f27b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080b2f20 con 0x7ff608159cf0 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60d818700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 0x7ff60816a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60d818700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 0x7ff60816a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40248/0 (socket says 172.21.15.60:40248) 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.934+0000 7ff60d818700 1 -- 172.21.15.60:0/1936237930 learned_addr learned my addr 172.21.15.60:0/1936237930 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:06.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60c816700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff6080b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d017700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6080cf1c0 0x7ff6080c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d818700 1 -- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 msgr2=0x7ff6080b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d818700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff6080b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d818700 1 -- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6080cf1c0 msgr2=0x7ff6080c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d818700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6080cf1c0 0x7ff6080c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d818700 1 -- 172.21.15.60:0/1936237930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009420 con 0x7ff60815a0c0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60d818700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 0x7ff60816a2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c8e0 tx=0x7ff60000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60000a7e0 con 0x7ff60815a0c0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60000a960 con 0x7ff60815a0c0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6080b3200 con 0x7ff60815a0c0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60000ad20 con 0x7ff60815a0c0 2023-10-08T16:05:06.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.935+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60816a820 con 0x7ff60815a0c0 2023-10-08T16:05:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.936+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6080b3420 con 0x7ff60815a0c0 2023-10-08T16:05:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.936+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff600012630 con 0x7ff60815a0c0 2023-10-08T16:05:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.937+0000 7ff6057fa700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5f4066f60 0x7ff5f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.937+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6000846f0 con 0x7ff60815a0c0 2023-10-08T16:05:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.937+0000 7ff60d017700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5f4066f60 0x7ff5f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:06.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.937+0000 7ff60d017700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5f4066f60 0x7ff5f4069410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009860 tx=0x7ff5f8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:06.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:06.941+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff600051960 con 0x7ff60815a0c0 2023-10-08T16:05:07.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.132+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff60815ea40 con 0x7ff5f4066f60 2023-10-08T16:05:07.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.140+0000 7ff6057fa700 1 -- 172.21.15.60:0/1936237930 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257332 (secure 0 0 0) 0x7ff60815ea40 con 0x7ff5f4066f60 2023-10-08T16:05:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:07.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5f4066f60 msgr2=0x7ff5f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:07.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5f4066f60 0x7ff5f4069410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009860 tx=0x7ff5f8017000 comp rx=0 tx=0).stop 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 msgr2=0x7ff60816a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 0x7ff60816a2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c8e0 tx=0x7ff60000cca0 comp rx=0 tx=0).stop 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 shutdown_connections 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5f4066f60 0x7ff5f4069410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff60815a0c0 0x7ff60816a2e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6080cf1c0 0x7ff6080c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 --2- 172.21.15.60:0/1936237930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff608159cf0 0x7ff6080b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 >> 172.21.15.60:0/1936237930 conn(0x7ff60806c6e0 msgr2=0x7ff6080c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 shutdown_connections 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:07.143+0000 7ff60f27b700 1 -- 172.21.15.60:0/1936237930 wait complete. 2023-10-08T16:05:07.147 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:07.156 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T16:05:05.561540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560947,"statfs":{"total":1600000000,"available":1598409824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001004"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497556+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500930+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496976+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501553+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500651+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500928+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500078+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502439+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498975+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495972+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496806+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493953+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.502025+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499988+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500576+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497059+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498617+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505057+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:00.505057+0000","last_peered":"2023-10-08T16:05:00.505057+0000","last_clean":"2023-10-08T16:05:00.505057+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:00.505057+0000","last_undegraded":"2023-10-08T16:05:00.505057+0000","last_fullsized":"2023-10-08T16:05:00.505057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.505777+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507202+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:00.507202+0000","last_peered":"2023-10-08T16:05:00.507202+0000","last_clean":"2023-10-08T16:05:00.507202+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:00.507202+0000","last_undegraded":"2023-10-08T16:05:00.507202+0000","last_fullsized":"2023-10-08T16:05:00.507202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496561+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503801+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:00.503801+0000","last_peered":"2023-10-08T16:05:00.503801+0000","last_clean":"2023-10-08T16:05:00.503801+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:00.503801+0000","last_undegraded":"2023-10-08T16:05:00.503801+0000","last_fullsized":"2023-10-08T16:05:00.503801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497813+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504293+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:00.504293+0000","last_peered":"2023-10-08T16:05:00.504293+0000","last_clean":"2023-10-08T16:05:00.504293+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:00.504293+0000","last_undegraded":"2023-10-08T16:05:00.504293+0000","last_fullsized":"2023-10-08T16:05:00.504293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497038+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504995+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:00.504995+0000","last_peered":"2023-10-08T16:05:00.504995+0000","last_clean":"2023-10-08T16:05:00.504995+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:00.504995+0000","last_undegraded":"2023-10-08T16:05:00.504995+0000","last_fullsized":"2023-10-08T16:05:00.504995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493408+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505226+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:00.505226+0000","last_peered":"2023-10-08T16:05:00.505226+0000","last_clean":"2023-10-08T16:05:00.505226+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:00.505226+0000","last_undegraded":"2023-10-08T16:05:00.505226+0000","last_fullsized":"2023-10-08T16:05:00.505226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494317+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:37.536758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507367+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:00.507367+0000","last_peered":"2023-10-08T16:05:00.507367+0000","last_clean":"2023-10-08T16:05:00.507367+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:00.507367+0000","last_undegraded":"2023-10-08T16:05:00.507367+0000","last_fullsized":"2023-10-08T16:05:00.507367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499502+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505047+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:00.505047+0000","last_peered":"2023-10-08T16:05:00.505047+0000","last_clean":"2023-10-08T16:05:00.505047+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:00.505047+0000","last_undegraded":"2023-10-08T16:05:00.505047+0000","last_fullsized":"2023-10-08T16:05:00.505047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498428+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500519+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:00.500519+0000","last_peered":"2023-10-08T16:05:00.500519+0000","last_clean":"2023-10-08T16:05:00.500519+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:00.500519+0000","last_undegraded":"2023-10-08T16:05:00.500519+0000","last_fullsized":"2023-10-08T16:05:00.500519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496311+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501225+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:00.501225+0000","last_peered":"2023-10-08T16:05:00.501225+0000","last_clean":"2023-10-08T16:05:00.501225+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:00.501225+0000","last_undegraded":"2023-10-08T16:05:00.501225+0000","last_fullsized":"2023-10-08T16:05:00.501225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498283+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502084+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:00.502084+0000","last_peered":"2023-10-08T16:05:00.502084+0000","last_clean":"2023-10-08T16:05:00.502084+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:00.502084+0000","last_undegraded":"2023-10-08T16:05:00.502084+0000","last_fullsized":"2023-10-08T16:05:00.502084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494454+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508257+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:00.508257+0000","last_peered":"2023-10-08T16:05:00.508257+0000","last_clean":"2023-10-08T16:05:00.508257+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:00.508257+0000","last_undegraded":"2023-10-08T16:05:00.508257+0000","last_fullsized":"2023-10-08T16:05:00.508257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496551+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505739+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:00.505739+0000","last_peered":"2023-10-08T16:05:00.505739+0000","last_clean":"2023-10-08T16:05:00.505739+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:00.505739+0000","last_undegraded":"2023-10-08T16:05:00.505739+0000","last_fullsized":"2023-10-08T16:05:00.505739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495226+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:37.637594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499397+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:00.499397+0000","last_peered":"2023-10-08T16:05:00.499397+0000","last_clean":"2023-10-08T16:05:00.499397+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:00.499397+0000","last_undegraded":"2023-10-08T16:05:00.499397+0000","last_fullsized":"2023-10-08T16:05:00.499397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498264+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506081+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:00.506081+0000","last_peered":"2023-10-08T16:05:00.506081+0000","last_clean":"2023-10-08T16:05:00.506081+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:00.506081+0000","last_undegraded":"2023-10-08T16:05:00.506081+0000","last_fullsized":"2023-10-08T16:05:00.506081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496592+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.500864+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:00.500864+0000","last_peered":"2023-10-08T16:05:00.500864+0000","last_clean":"2023-10-08T16:05:00.500864+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:00.500864+0000","last_undegraded":"2023-10-08T16:05:00.500864+0000","last_fullsized":"2023-10-08T16:05:00.500864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498980+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502071+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:00.502071+0000","last_peered":"2023-10-08T16:05:00.502071+0000","last_clean":"2023-10-08T16:05:00.502071+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:00.502071+0000","last_undegraded":"2023-10-08T16:05:00.502071+0000","last_fullsized":"2023-10-08T16:05:00.502071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497346+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.502386+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:00.502386+0000","last_peered":"2023-10-08T16:05:00.502386+0000","last_clean":"2023-10-08T16:05:00.502386+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:00.502386+0000","last_undegraded":"2023-10-08T16:05:00.502386+0000","last_fullsized":"2023-10-08T16:05:00.502386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495503+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499218+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:00.499218+0000","last_peered":"2023-10-08T16:05:00.499218+0000","last_clean":"2023-10-08T16:05:00.499218+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:00.499218+0000","last_undegraded":"2023-10-08T16:05:00.499218+0000","last_fullsized":"2023-10-08T16:05:00.499218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493134+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.190986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497995+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.497630+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:00.497630+0000","last_peered":"2023-10-08T16:05:00.497630+0000","last_clean":"2023-10-08T16:05:00.497630+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:00.497630+0000","last_undegraded":"2023-10-08T16:05:00.497630+0000","last_fullsized":"2023-10-08T16:05:00.497630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498784+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:00.480403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507753+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:00.507753+0000","last_peered":"2023-10-08T16:05:00.507753+0000","last_clean":"2023-10-08T16:05:00.507753+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:00.507753+0000","last_undegraded":"2023-10-08T16:05:00.507753+0000","last_fullsized":"2023-10-08T16:05:00.507753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T16:04:59.487151+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:04:59.487151+0000","last_peered":"2023-10-08T16:04:59.487151+0000","last_clean":"2023-10-08T16:04:59.487151+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:04:59.487151+0000","last_undegraded":"2023-10-08T16:04:59.487151+0000","last_fullsized":"2023-10-08T16:04:59.487151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.494859+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.505073+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:00.505073+0000","last_peered":"2023-10-08T16:05:00.505073+0000","last_clean":"2023-10-08T16:05:00.505073+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:00.505073+0000","last_undegraded":"2023-10-08T16:05:00.505073+0000","last_fullsized":"2023-10-08T16:05:00.505073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507413+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:00.507413+0000","last_peered":"2023-10-08T16:05:00.507413+0000","last_clean":"2023-10-08T16:05:00.507413+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:00.507413+0000","last_undegraded":"2023-10-08T16:05:00.507413+0000","last_fullsized":"2023-10-08T16:05:00.507413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497941+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.501771+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:00.501771+0000","last_peered":"2023-10-08T16:05:00.501771+0000","last_clean":"2023-10-08T16:05:00.501771+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:00.501771+0000","last_undegraded":"2023-10-08T16:05:00.501771+0000","last_fullsized":"2023-10-08T16:05:00.501771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499209+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.503946+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:00.503946+0000","last_peered":"2023-10-08T16:05:00.503946+0000","last_clean":"2023-10-08T16:05:00.503946+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:00.503946+0000","last_undegraded":"2023-10-08T16:05:00.503946+0000","last_fullsized":"2023-10-08T16:05:00.503946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496145+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.507066+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:00.507066+0000","last_peered":"2023-10-08T16:05:00.507066+0000","last_clean":"2023-10-08T16:05:00.507066+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:00.507066+0000","last_undegraded":"2023-10-08T16:05:00.507066+0000","last_fullsized":"2023-10-08T16:05:00.507066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.493566+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:51.805468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504446+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:00.504446+0000","last_peered":"2023-10-08T16:05:00.504446+0000","last_clean":"2023-10-08T16:05:00.504446+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:00.504446+0000","last_undegraded":"2023-10-08T16:05:00.504446+0000","last_fullsized":"2023-10-08T16:05:00.504446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498865+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.508562+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:00.508562+0000","last_peered":"2023-10-08T16:05:00.508562+0000","last_clean":"2023-10-08T16:05:00.508562+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:00.508562+0000","last_undegraded":"2023-10-08T16:05:00.508562+0000","last_fullsized":"2023-10-08T16:05:00.508562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500850+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.506058+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:00.506058+0000","last_peered":"2023-10-08T16:05:00.506058+0000","last_clean":"2023-10-08T16:05:00.506058+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:00.506058+0000","last_undegraded":"2023-10-08T16:05:00.506058+0000","last_fullsized":"2023-10-08T16:05:00.506058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497102+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.504216+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:00.504216+0000","last_peered":"2023-10-08T16:05:00.504216+0000","last_clean":"2023-10-08T16:05:00.504216+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:00.504216+0000","last_undegraded":"2023-10-08T16:05:00.504216+0000","last_fullsized":"2023-10-08T16:05:00.504216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497107+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.499292+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:00.499292+0000","last_peered":"2023-10-08T16:05:00.499292+0000","last_clean":"2023-10-08T16:05:00.499292+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:00.499292+0000","last_undegraded":"2023-10-08T16:05:00.499292+0000","last_fullsized":"2023-10-08T16:05:00.499292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495157+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T16:05:00.496605+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:00.496605+0000","last_peered":"2023-10-08T16:05:00.496605+0000","last_clean":"2023-10-08T16:05:00.496605+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:00.496605+0000","last_undegraded":"2023-10-08T16:05:00.496605+0000","last_fullsized":"2023-10-08T16:05:00.496605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497371+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499337+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495647+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.497473+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495823+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501265+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.498861+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495629+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499903+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.496366+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.501657+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.500175+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.499938+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:05:00.486151+0000","last_change":"2023-10-08T16:05:00.495474+0000","last_active":"2023-10-08T16:05:00.486151+0000","last_peered":"2023-10-08T16:05:00.486151+0000","last_clean":"2023-10-08T16:05:00.486151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:05:00.486151+0000","last_undegraded":"2023-10-08T16:05:00.486151+0000","last_fullsized":"2023-10-08T16:05:00.486151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:10.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:10.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.295+0000 7fd4bb93d700 1 Processor -- start 2023-10-08T16:05:10.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.295+0000 7fd4bb93d700 1 -- start start 2023-10-08T16:05:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4bb93d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 0x7fd4b40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4bb93d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40b2890 con 0x7fd4b40af1e0 2023-10-08T16:05:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4bb93d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40b1c80 con 0x7fd4b40af5b0 2023-10-08T16:05:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4bb93d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b1f60 con 0x7fd4b415a260 2023-10-08T16:05:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4b96d9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4b40af1e0 0x7fd4b406f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43750/0 (socket says 172.21.15.60:43750) 2023-10-08T16:05:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4b96d9700 1 -- 172.21.15.60:0/1262765681 learned_addr learned my addr 172.21.15.60:0/1262765681 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506977446 0 0) 0x7fd4b40b2890 con 0x7fd4b40af1e0 2023-10-08T16:05:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a0003570 con 0x7fd4b40af1e0 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 0x7fd4b40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 54862914 0 0) 0x7fd4a0003570 con 0x7fd4b40af1e0 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 msgr2=0x7fd4b40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 0x7fd4b40b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 >> v1:172.21.15.144:6789/0 conn(0x7fd4b40af5b0 legacy=0x7fd4b4159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40b2240 con 0x7fd4b40af1e0 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.296+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fd4b0001470 con 0x7fd4b40af1e0 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 >> v1:172.21.15.60:6789/0 conn(0x7fd4b40af1e0 legacy=0x7fd4b406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4a0003a90 0x7fd4a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 0x7fd4a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0004d50 0x7fd4a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b1f60 con 0x7fd4a0004d50 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a000bba0 con 0x7fd4a0003a90 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a000bd60 con 0x7fd4b415a260 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0004d50 0x7fd4a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b8ed8700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 0x7fd4a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b96d9700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4a0003a90 0x7fd4a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 -- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 msgr2=0x7fd4a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4b415a260 0x7fd4a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 -- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4a0003a90 msgr2=0x7fd4a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4a0003a90 0x7fd4a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 -- 172.21.15.60:0/1262765681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0003570 con 0x7fd4a0004d50 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b96d9700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4a0003a90 0x7fd4a0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0004d50 0x7fd4a00051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00e210 tx=0x7fd4ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66df03ccdb6a7060 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00eac0 con 0x7fd4a0004d50 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00f040 con 0x7fd4a0004d50 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.297+0000 7fd4abfff700 1 -- 172.21.15.60:0/1262765681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00ee70 con 0x7fd4a0004d50 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4bb93d700 1 -- 172.21.15.60:0/1262765681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0004d50 msgr2=0x7fd4a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/1262765681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0004d50 0x7fd4a00051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00e210 tx=0x7fd4ac00b040 comp rx=0 tx=0).stop 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4b9eda700 1 -- 172.21.15.60:0/1262765681 reap_dead start 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4bb93d700 1 -- 172.21.15.60:0/1262765681 shutdown_connections 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4bb93d700 1 -- 172.21.15.60:0/1262765681 >> 172.21.15.60:0/1262765681 conn(0x7fd4b40cd1e0 msgr2=0x7fd4b40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4bb93d700 1 -- 172.21.15.60:0/1262765681 shutdown_connections 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.298+0000 7fd4bb93d700 1 -- 172.21.15.60:0/1262765681 wait complete. 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.299+0000 7fd4bb93d700 1 Processor -- start 2023-10-08T16:05:10.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.299+0000 7fd4bb93d700 1 -- start start 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4bb93d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4a0004d50 0x7fd4b406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4bb93d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4b415e3c0 0x7fd4b41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4bb93d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 0x7fd4b415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4bb93d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4098b00 con 0x7fd4b415a630 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4bb93d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b415e830 con 0x7fd4b415e3c0 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4bb93d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b415afe0 con 0x7fd4a0004d50 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 0x7fd4b415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 0x7fd4b415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40264/0 (socket says 172.21.15.60:40264) 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 -- 172.21.15.60:0/3158538155 learned_addr learned my addr 172.21.15.60:0/3158538155 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:10.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b8ed8700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4b415e3c0 0x7fd4b41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b96d9700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4a0004d50 0x7fd4b406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 -- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4a0004d50 msgr2=0x7fd4b406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4a0004d50 0x7fd4b406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 -- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4b415e3c0 msgr2=0x7fd4b41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4b415e3c0 0x7fd4b41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b9eda700 1 -- 172.21.15.60:0/3158538155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4155de0 con 0x7fd4b415a630 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b96d9700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4a0004d50 0x7fd4b406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.300+0000 7fd4b8ed8700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4b415e3c0 0x7fd4b41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.301+0000 7fd4b9eda700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 0x7fd4b415aaa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00afd0 tx=0x7fd4ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.301+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00eec0 con 0x7fd4b415a630 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.301+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac022070 con 0x7fd4b415a630 2023-10-08T16:05:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.301+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b406eda0 con 0x7fd4b415a630 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.301+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac01e870 con 0x7fd4b415a630 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.301+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b415cb40 con 0x7fd4b415a630 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.302+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b404c3c0 con 0x7fd4b415a630 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.302+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4ac003040 con 0x7fd4b415a630 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.303+0000 7fd4a97fa700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.303+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4ac024070 con 0x7fd4b415a630 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.303+0000 7fd4b96d9700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.303+0000 7fd4b96d9700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00015a0 tx=0x7fd4b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.307+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4ac053c80 con 0x7fd4b415a630 2023-10-08T16:05:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.494+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4b40cd780 con 0x7fd498066f30 2023-10-08T16:05:10.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.501+0000 7fd4a97fa700 1 -- 172.21.15.60:0/3158538155 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260132 (secure 0 0 0) 0x7fd4b40cd780 con 0x7fd498066f30 2023-10-08T16:05:10.505 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd498066f30 msgr2=0x7fd4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00015a0 tx=0x7fd4b0009040 comp rx=0 tx=0).stop 2023-10-08T16:05:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 msgr2=0x7fd4b415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 0x7fd4b415aaa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00afd0 tx=0x7fd4ac01a000 comp rx=0 tx=0).stop 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 shutdown_connections 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4a0004d50 0x7fd4b406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b415a630 0x7fd4b415aaa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 --2- 172.21.15.60:0/3158538155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4b415e3c0 0x7fd4b41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 >> 172.21.15.60:0/3158538155 conn(0x7fd4b40cd1e0 msgr2=0x7fd4b40695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 shutdown_connections 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.504+0000 7fd4bb93d700 1 -- 172.21.15.60:0/3158538155 wait complete. 2023-10-08T16:05:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:10.517 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T16:05:09.562452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.073560"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507701+0000","last_change":"2023-10-08T16:05:01.507178+0000","last_active":"2023-10-08T16:05:01.507701+0000","last_peered":"2023-10-08T16:05:01.507701+0000","last_clean":"2023-10-08T16:05:01.507701+0000","last_became_active":"2023-10-08T16:05:01.506717+0000","last_became_peered":"2023-10-08T16:05:01.506717+0000","last_unstale":"2023-10-08T16:05:01.507701+0000","last_undegraded":"2023-10-08T16:05:01.507701+0000","last_fullsized":"2023-10-08T16:05:01.507701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507683+0000","last_change":"2023-10-08T16:05:01.507616+0000","last_active":"2023-10-08T16:05:01.507683+0000","last_peered":"2023-10-08T16:05:01.507683+0000","last_clean":"2023-10-08T16:05:01.507683+0000","last_became_active":"2023-10-08T16:05:01.507382+0000","last_became_peered":"2023-10-08T16:05:01.507382+0000","last_unstale":"2023-10-08T16:05:01.507683+0000","last_undegraded":"2023-10-08T16:05:01.507683+0000","last_fullsized":"2023-10-08T16:05:01.507683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506637+0000","last_change":"2023-10-08T16:05:01.506392+0000","last_active":"2023-10-08T16:05:01.506637+0000","last_peered":"2023-10-08T16:05:01.506637+0000","last_clean":"2023-10-08T16:05:01.506637+0000","last_became_active":"2023-10-08T16:05:01.506200+0000","last_became_peered":"2023-10-08T16:05:01.506200+0000","last_unstale":"2023-10-08T16:05:01.506637+0000","last_undegraded":"2023-10-08T16:05:01.506637+0000","last_fullsized":"2023-10-08T16:05:01.506637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498484+0000","last_change":"2023-10-08T16:05:01.498364+0000","last_active":"2023-10-08T16:05:01.498484+0000","last_peered":"2023-10-08T16:05:01.498484+0000","last_clean":"2023-10-08T16:05:01.498484+0000","last_became_active":"2023-10-08T16:05:01.497861+0000","last_became_peered":"2023-10-08T16:05:01.497861+0000","last_unstale":"2023-10-08T16:05:01.498484+0000","last_undegraded":"2023-10-08T16:05:01.498484+0000","last_fullsized":"2023-10-08T16:05:01.498484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:20.479447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509670+0000","last_change":"2023-10-08T16:05:01.509062+0000","last_active":"2023-10-08T16:05:01.509670+0000","last_peered":"2023-10-08T16:05:01.509670+0000","last_clean":"2023-10-08T16:05:01.509670+0000","last_became_active":"2023-10-08T16:05:01.508813+0000","last_became_peered":"2023-10-08T16:05:01.508813+0000","last_unstale":"2023-10-08T16:05:01.509670+0000","last_undegraded":"2023-10-08T16:05:01.509670+0000","last_fullsized":"2023-10-08T16:05:01.509670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509852+0000","last_change":"2023-10-08T16:05:01.509649+0000","last_active":"2023-10-08T16:05:01.509852+0000","last_peered":"2023-10-08T16:05:01.509852+0000","last_clean":"2023-10-08T16:05:01.509852+0000","last_became_active":"2023-10-08T16:05:01.509280+0000","last_became_peered":"2023-10-08T16:05:01.509280+0000","last_unstale":"2023-10-08T16:05:01.509852+0000","last_undegraded":"2023-10-08T16:05:01.509852+0000","last_fullsized":"2023-10-08T16:05:01.509852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:18.844965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507684+0000","last_change":"2023-10-08T16:05:01.507170+0000","last_active":"2023-10-08T16:05:01.507684+0000","last_peered":"2023-10-08T16:05:01.507684+0000","last_clean":"2023-10-08T16:05:01.507684+0000","last_became_active":"2023-10-08T16:05:01.506530+0000","last_became_peered":"2023-10-08T16:05:01.506530+0000","last_unstale":"2023-10-08T16:05:01.507684+0000","last_undegraded":"2023-10-08T16:05:01.507684+0000","last_fullsized":"2023-10-08T16:05:01.507684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498327+0000","last_change":"2023-10-08T16:05:01.497784+0000","last_active":"2023-10-08T16:05:01.498327+0000","last_peered":"2023-10-08T16:05:01.498327+0000","last_clean":"2023-10-08T16:05:01.498327+0000","last_became_active":"2023-10-08T16:05:01.497369+0000","last_became_peered":"2023-10-08T16:05:01.497369+0000","last_unstale":"2023-10-08T16:05:01.498327+0000","last_undegraded":"2023-10-08T16:05:01.498327+0000","last_fullsized":"2023-10-08T16:05:01.498327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505808+0000","last_change":"2023-10-08T16:05:01.505512+0000","last_active":"2023-10-08T16:05:01.505808+0000","last_peered":"2023-10-08T16:05:01.505808+0000","last_clean":"2023-10-08T16:05:01.505808+0000","last_became_active":"2023-10-08T16:05:01.505293+0000","last_became_peered":"2023-10-08T16:05:01.505293+0000","last_unstale":"2023-10-08T16:05:01.505808+0000","last_undegraded":"2023-10-08T16:05:01.505808+0000","last_fullsized":"2023-10-08T16:05:01.505808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:04.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509383+0000","last_change":"2023-10-08T16:05:01.509035+0000","last_active":"2023-10-08T16:05:01.509383+0000","last_peered":"2023-10-08T16:05:01.509383+0000","last_clean":"2023-10-08T16:05:01.509383+0000","last_became_active":"2023-10-08T16:05:01.508838+0000","last_became_peered":"2023-10-08T16:05:01.508838+0000","last_unstale":"2023-10-08T16:05:01.509383+0000","last_undegraded":"2023-10-08T16:05:01.509383+0000","last_fullsized":"2023-10-08T16:05:01.509383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508474+0000","last_change":"2023-10-08T16:05:01.508376+0000","last_active":"2023-10-08T16:05:01.508474+0000","last_peered":"2023-10-08T16:05:01.508474+0000","last_clean":"2023-10-08T16:05:01.508474+0000","last_became_active":"2023-10-08T16:05:01.508137+0000","last_became_peered":"2023-10-08T16:05:01.508137+0000","last_unstale":"2023-10-08T16:05:01.508474+0000","last_undegraded":"2023-10-08T16:05:01.508474+0000","last_fullsized":"2023-10-08T16:05:01.508474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508632+0000","last_change":"2023-10-08T16:05:01.506227+0000","last_active":"2023-10-08T16:05:01.508632+0000","last_peered":"2023-10-08T16:05:01.508632+0000","last_clean":"2023-10-08T16:05:01.508632+0000","last_became_active":"2023-10-08T16:05:01.506000+0000","last_became_peered":"2023-10-08T16:05:01.506000+0000","last_unstale":"2023-10-08T16:05:01.508632+0000","last_undegraded":"2023-10-08T16:05:01.508632+0000","last_fullsized":"2023-10-08T16:05:01.508632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503841+0000","last_change":"2023-10-08T16:05:01.503731+0000","last_active":"2023-10-08T16:05:01.503841+0000","last_peered":"2023-10-08T16:05:01.503841+0000","last_clean":"2023-10-08T16:05:01.503841+0000","last_became_active":"2023-10-08T16:05:01.503403+0000","last_became_peered":"2023-10-08T16:05:01.503403+0000","last_unstale":"2023-10-08T16:05:01.503841+0000","last_undegraded":"2023-10-08T16:05:01.503841+0000","last_fullsized":"2023-10-08T16:05:01.503841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507670+0000","last_change":"2023-10-08T16:05:01.507379+0000","last_active":"2023-10-08T16:05:01.507670+0000","last_peered":"2023-10-08T16:05:01.507670+0000","last_clean":"2023-10-08T16:05:01.507670+0000","last_became_active":"2023-10-08T16:05:01.506542+0000","last_became_peered":"2023-10-08T16:05:01.506542+0000","last_unstale":"2023-10-08T16:05:01.507670+0000","last_undegraded":"2023-10-08T16:05:01.507670+0000","last_fullsized":"2023-10-08T16:05:01.507670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494393+0000","last_change":"2023-10-08T16:05:01.494332+0000","last_active":"2023-10-08T16:05:01.494393+0000","last_peered":"2023-10-08T16:05:01.494393+0000","last_clean":"2023-10-08T16:05:01.494393+0000","last_became_active":"2023-10-08T16:05:01.494145+0000","last_became_peered":"2023-10-08T16:05:01.494145+0000","last_unstale":"2023-10-08T16:05:01.494393+0000","last_undegraded":"2023-10-08T16:05:01.494393+0000","last_fullsized":"2023-10-08T16:05:01.494393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509836+0000","last_change":"2023-10-08T16:05:01.509492+0000","last_active":"2023-10-08T16:05:01.509836+0000","last_peered":"2023-10-08T16:05:01.509836+0000","last_clean":"2023-10-08T16:05:01.509836+0000","last_became_active":"2023-10-08T16:05:01.508987+0000","last_became_peered":"2023-10-08T16:05:01.508987+0000","last_unstale":"2023-10-08T16:05:01.509836+0000","last_undegraded":"2023-10-08T16:05:01.509836+0000","last_fullsized":"2023-10-08T16:05:01.509836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:34.471207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505387+0000","last_change":"2023-10-08T16:05:01.505059+0000","last_active":"2023-10-08T16:05:01.505387+0000","last_peered":"2023-10-08T16:05:01.505387+0000","last_clean":"2023-10-08T16:05:01.505387+0000","last_became_active":"2023-10-08T16:05:01.504334+0000","last_became_peered":"2023-10-08T16:05:01.504334+0000","last_unstale":"2023-10-08T16:05:01.505387+0000","last_undegraded":"2023-10-08T16:05:01.505387+0000","last_fullsized":"2023-10-08T16:05:01.505387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:04.832356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503012+0000","last_change":"2023-10-08T16:05:01.502941+0000","last_active":"2023-10-08T16:05:01.503012+0000","last_peered":"2023-10-08T16:05:01.503012+0000","last_clean":"2023-10-08T16:05:01.503012+0000","last_became_active":"2023-10-08T16:05:01.502711+0000","last_became_peered":"2023-10-08T16:05:01.502711+0000","last_unstale":"2023-10-08T16:05:01.503012+0000","last_undegraded":"2023-10-08T16:05:01.503012+0000","last_fullsized":"2023-10-08T16:05:01.503012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501162+0000","last_change":"2023-10-08T16:05:01.501012+0000","last_active":"2023-10-08T16:05:01.501162+0000","last_peered":"2023-10-08T16:05:01.501162+0000","last_clean":"2023-10-08T16:05:01.501162+0000","last_became_active":"2023-10-08T16:05:01.500370+0000","last_became_peered":"2023-10-08T16:05:01.500370+0000","last_unstale":"2023-10-08T16:05:01.501162+0000","last_undegraded":"2023-10-08T16:05:01.501162+0000","last_fullsized":"2023-10-08T16:05:01.501162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512078+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:01.512078+0000","last_peered":"2023-10-08T16:05:01.512078+0000","last_clean":"2023-10-08T16:05:01.512078+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:01.512078+0000","last_undegraded":"2023-10-08T16:05:01.512078+0000","last_fullsized":"2023-10-08T16:05:01.512078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505034+0000","last_change":"2023-10-08T16:05:01.504888+0000","last_active":"2023-10-08T16:05:01.505034+0000","last_peered":"2023-10-08T16:05:01.505034+0000","last_clean":"2023-10-08T16:05:01.505034+0000","last_became_active":"2023-10-08T16:05:01.504494+0000","last_became_peered":"2023-10-08T16:05:01.504494+0000","last_unstale":"2023-10-08T16:05:01.505034+0000","last_undegraded":"2023-10-08T16:05:01.505034+0000","last_fullsized":"2023-10-08T16:05:01.505034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507845+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:01.507845+0000","last_peered":"2023-10-08T16:05:01.507845+0000","last_clean":"2023-10-08T16:05:01.507845+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:01.507845+0000","last_undegraded":"2023-10-08T16:05:01.507845+0000","last_fullsized":"2023-10-08T16:05:01.507845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506603+0000","last_change":"2023-10-08T16:05:01.505919+0000","last_active":"2023-10-08T16:05:01.506603+0000","last_peered":"2023-10-08T16:05:01.506603+0000","last_clean":"2023-10-08T16:05:01.506603+0000","last_became_active":"2023-10-08T16:05:01.505736+0000","last_became_peered":"2023-10-08T16:05:01.505736+0000","last_unstale":"2023-10-08T16:05:01.506603+0000","last_undegraded":"2023-10-08T16:05:01.506603+0000","last_fullsized":"2023-10-08T16:05:01.506603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510937+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:01.510937+0000","last_peered":"2023-10-08T16:05:01.510937+0000","last_clean":"2023-10-08T16:05:01.510937+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:01.510937+0000","last_undegraded":"2023-10-08T16:05:01.510937+0000","last_fullsized":"2023-10-08T16:05:01.510937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496343+0000","last_change":"2023-10-08T16:05:01.496116+0000","last_active":"2023-10-08T16:05:01.496343+0000","last_peered":"2023-10-08T16:05:01.496343+0000","last_clean":"2023-10-08T16:05:01.496343+0000","last_became_active":"2023-10-08T16:05:01.495442+0000","last_became_peered":"2023-10-08T16:05:01.495442+0000","last_unstale":"2023-10-08T16:05:01.496343+0000","last_undegraded":"2023-10-08T16:05:01.496343+0000","last_fullsized":"2023-10-08T16:05:01.496343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:04.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511859+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:01.511859+0000","last_peered":"2023-10-08T16:05:01.511859+0000","last_clean":"2023-10-08T16:05:01.511859+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:01.511859+0000","last_undegraded":"2023-10-08T16:05:01.511859+0000","last_fullsized":"2023-10-08T16:05:01.511859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494727+0000","last_change":"2023-10-08T16:05:01.494609+0000","last_active":"2023-10-08T16:05:01.494727+0000","last_peered":"2023-10-08T16:05:01.494727+0000","last_clean":"2023-10-08T16:05:01.494727+0000","last_became_active":"2023-10-08T16:05:01.494359+0000","last_became_peered":"2023-10-08T16:05:01.494359+0000","last_unstale":"2023-10-08T16:05:01.494727+0000","last_undegraded":"2023-10-08T16:05:01.494727+0000","last_fullsized":"2023-10-08T16:05:01.494727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508726+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:01.508726+0000","last_peered":"2023-10-08T16:05:01.508726+0000","last_clean":"2023-10-08T16:05:01.508726+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:01.508726+0000","last_undegraded":"2023-10-08T16:05:01.508726+0000","last_fullsized":"2023-10-08T16:05:01.508726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493937+0000","last_change":"2023-10-08T16:05:01.493822+0000","last_active":"2023-10-08T16:05:01.493937+0000","last_peered":"2023-10-08T16:05:01.493937+0000","last_clean":"2023-10-08T16:05:01.493937+0000","last_became_active":"2023-10-08T16:05:01.493538+0000","last_became_peered":"2023-10-08T16:05:01.493538+0000","last_unstale":"2023-10-08T16:05:01.493937+0000","last_undegraded":"2023-10-08T16:05:01.493937+0000","last_fullsized":"2023-10-08T16:05:01.493937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508815+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:01.508815+0000","last_peered":"2023-10-08T16:05:01.508815+0000","last_clean":"2023-10-08T16:05:01.508815+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:01.508815+0000","last_undegraded":"2023-10-08T16:05:01.508815+0000","last_fullsized":"2023-10-08T16:05:01.508815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506621+0000","last_change":"2023-10-08T16:05:01.506208+0000","last_active":"2023-10-08T16:05:01.506621+0000","last_peered":"2023-10-08T16:05:01.506621+0000","last_clean":"2023-10-08T16:05:01.506621+0000","last_became_active":"2023-10-08T16:05:01.505983+0000","last_became_peered":"2023-10-08T16:05:01.505983+0000","last_unstale":"2023-10-08T16:05:01.506621+0000","last_undegraded":"2023-10-08T16:05:01.506621+0000","last_fullsized":"2023-10-08T16:05:01.506621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495445+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:01.495445+0000","last_peered":"2023-10-08T16:05:01.495445+0000","last_clean":"2023-10-08T16:05:01.495445+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:01.495445+0000","last_undegraded":"2023-10-08T16:05:01.495445+0000","last_fullsized":"2023-10-08T16:05:01.495445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.497518+0000","last_change":"2023-10-08T16:05:01.496538+0000","last_active":"2023-10-08T16:05:01.497518+0000","last_peered":"2023-10-08T16:05:01.497518+0000","last_clean":"2023-10-08T16:05:01.497518+0000","last_became_active":"2023-10-08T16:05:01.496309+0000","last_became_peered":"2023-10-08T16:05:01.496309+0000","last_unstale":"2023-10-08T16:05:01.497518+0000","last_undegraded":"2023-10-08T16:05:01.497518+0000","last_fullsized":"2023-10-08T16:05:01.497518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493207+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:01.493207+0000","last_peered":"2023-10-08T16:05:01.493207+0000","last_clean":"2023-10-08T16:05:01.493207+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:01.493207+0000","last_undegraded":"2023-10-08T16:05:01.493207+0000","last_fullsized":"2023-10-08T16:05:01.493207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501613+0000","last_change":"2023-10-08T16:05:01.501537+0000","last_active":"2023-10-08T16:05:01.501613+0000","last_peered":"2023-10-08T16:05:01.501613+0000","last_clean":"2023-10-08T16:05:01.501613+0000","last_became_active":"2023-10-08T16:05:01.501301+0000","last_became_peered":"2023-10-08T16:05:01.501301+0000","last_unstale":"2023-10-08T16:05:01.501613+0000","last_undegraded":"2023-10-08T16:05:01.501613+0000","last_fullsized":"2023-10-08T16:05:01.501613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504104+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:01.504104+0000","last_peered":"2023-10-08T16:05:01.504104+0000","last_clean":"2023-10-08T16:05:01.504104+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:01.504104+0000","last_undegraded":"2023-10-08T16:05:01.504104+0000","last_fullsized":"2023-10-08T16:05:01.504104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504852+0000","last_change":"2023-10-08T16:05:01.504760+0000","last_active":"2023-10-08T16:05:01.504852+0000","last_peered":"2023-10-08T16:05:01.504852+0000","last_clean":"2023-10-08T16:05:01.504852+0000","last_became_active":"2023-10-08T16:05:01.501487+0000","last_became_peered":"2023-10-08T16:05:01.501487+0000","last_unstale":"2023-10-08T16:05:01.504852+0000","last_undegraded":"2023-10-08T16:05:01.504852+0000","last_fullsized":"2023-10-08T16:05:01.504852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494597+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:01.494597+0000","last_peered":"2023-10-08T16:05:01.494597+0000","last_clean":"2023-10-08T16:05:01.494597+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:01.494597+0000","last_undegraded":"2023-10-08T16:05:01.494597+0000","last_fullsized":"2023-10-08T16:05:01.494597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510032+0000","last_change":"2023-10-08T16:05:01.509969+0000","last_active":"2023-10-08T16:05:01.510032+0000","last_peered":"2023-10-08T16:05:01.510032+0000","last_clean":"2023-10-08T16:05:01.510032+0000","last_became_active":"2023-10-08T16:05:01.509066+0000","last_became_peered":"2023-10-08T16:05:01.509066+0000","last_unstale":"2023-10-08T16:05:01.510032+0000","last_undegraded":"2023-10-08T16:05:01.510032+0000","last_fullsized":"2023-10-08T16:05:01.510032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508522+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:01.508522+0000","last_peered":"2023-10-08T16:05:01.508522+0000","last_clean":"2023-10-08T16:05:01.508522+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:01.508522+0000","last_undegraded":"2023-10-08T16:05:01.508522+0000","last_fullsized":"2023-10-08T16:05:01.508522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500882+0000","last_change":"2023-10-08T16:05:01.500764+0000","last_active":"2023-10-08T16:05:01.500882+0000","last_peered":"2023-10-08T16:05:01.500882+0000","last_clean":"2023-10-08T16:05:01.500882+0000","last_became_active":"2023-10-08T16:05:01.500549+0000","last_became_peered":"2023-10-08T16:05:01.500549+0000","last_unstale":"2023-10-08T16:05:01.500882+0000","last_undegraded":"2023-10-08T16:05:01.500882+0000","last_fullsized":"2023-10-08T16:05:01.500882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512754+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:01.512754+0000","last_peered":"2023-10-08T16:05:01.512754+0000","last_clean":"2023-10-08T16:05:01.512754+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:01.512754+0000","last_undegraded":"2023-10-08T16:05:01.512754+0000","last_fullsized":"2023-10-08T16:05:01.512754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504533+0000","last_change":"2023-10-08T16:05:01.501290+0000","last_active":"2023-10-08T16:05:01.504533+0000","last_peered":"2023-10-08T16:05:01.504533+0000","last_clean":"2023-10-08T16:05:01.504533+0000","last_became_active":"2023-10-08T16:05:01.500767+0000","last_became_peered":"2023-10-08T16:05:01.500767+0000","last_unstale":"2023-10-08T16:05:01.504533+0000","last_undegraded":"2023-10-08T16:05:01.504533+0000","last_fullsized":"2023-10-08T16:05:01.504533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:04.832356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511189+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:01.511189+0000","last_peered":"2023-10-08T16:05:01.511189+0000","last_clean":"2023-10-08T16:05:01.511189+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:01.511189+0000","last_undegraded":"2023-10-08T16:05:01.511189+0000","last_fullsized":"2023-10-08T16:05:01.511189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510169+0000","last_change":"2023-10-08T16:05:01.510111+0000","last_active":"2023-10-08T16:05:01.510169+0000","last_peered":"2023-10-08T16:05:01.510169+0000","last_clean":"2023-10-08T16:05:01.510169+0000","last_became_active":"2023-10-08T16:05:01.509382+0000","last_became_peered":"2023-10-08T16:05:01.509382+0000","last_unstale":"2023-10-08T16:05:01.510169+0000","last_undegraded":"2023-10-08T16:05:01.510169+0000","last_fullsized":"2023-10-08T16:05:01.510169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.492941+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:01.492941+0000","last_peered":"2023-10-08T16:05:01.492941+0000","last_clean":"2023-10-08T16:05:01.492941+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:01.492941+0000","last_undegraded":"2023-10-08T16:05:01.492941+0000","last_fullsized":"2023-10-08T16:05:01.492941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500489+0000","last_change":"2023-10-08T16:05:01.500264+0000","last_active":"2023-10-08T16:05:01.500489+0000","last_peered":"2023-10-08T16:05:01.500489+0000","last_clean":"2023-10-08T16:05:01.500489+0000","last_became_active":"2023-10-08T16:05:01.499718+0000","last_became_peered":"2023-10-08T16:05:01.499718+0000","last_unstale":"2023-10-08T16:05:01.500489+0000","last_undegraded":"2023-10-08T16:05:01.500489+0000","last_fullsized":"2023-10-08T16:05:01.500489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:43.184261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503566+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:01.503566+0000","last_peered":"2023-10-08T16:05:01.503566+0000","last_clean":"2023-10-08T16:05:01.503566+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:01.503566+0000","last_undegraded":"2023-10-08T16:05:01.503566+0000","last_fullsized":"2023-10-08T16:05:01.503566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509365+0000","last_change":"2023-10-08T16:05:01.508722+0000","last_active":"2023-10-08T16:05:01.509365+0000","last_peered":"2023-10-08T16:05:01.509365+0000","last_clean":"2023-10-08T16:05:01.509365+0000","last_became_active":"2023-10-08T16:05:01.508485+0000","last_became_peered":"2023-10-08T16:05:01.508485+0000","last_unstale":"2023-10-08T16:05:01.509365+0000","last_undegraded":"2023-10-08T16:05:01.509365+0000","last_fullsized":"2023-10-08T16:05:01.509365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512255+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:01.512255+0000","last_peered":"2023-10-08T16:05:01.512255+0000","last_clean":"2023-10-08T16:05:01.512255+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:01.512255+0000","last_undegraded":"2023-10-08T16:05:01.512255+0000","last_fullsized":"2023-10-08T16:05:01.512255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.502649+0000","last_change":"2023-10-08T16:05:01.501281+0000","last_active":"2023-10-08T16:05:01.502649+0000","last_peered":"2023-10-08T16:05:01.502649+0000","last_clean":"2023-10-08T16:05:01.502649+0000","last_became_active":"2023-10-08T16:05:01.500771+0000","last_became_peered":"2023-10-08T16:05:01.500771+0000","last_unstale":"2023-10-08T16:05:01.502649+0000","last_undegraded":"2023-10-08T16:05:01.502649+0000","last_fullsized":"2023-10-08T16:05:01.502649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:20.479447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508044+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:01.508044+0000","last_peered":"2023-10-08T16:05:01.508044+0000","last_clean":"2023-10-08T16:05:01.508044+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:01.508044+0000","last_undegraded":"2023-10-08T16:05:01.508044+0000","last_fullsized":"2023-10-08T16:05:01.508044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500511+0000","last_change":"2023-10-08T16:05:01.500421+0000","last_active":"2023-10-08T16:05:01.500511+0000","last_peered":"2023-10-08T16:05:01.500511+0000","last_clean":"2023-10-08T16:05:01.500511+0000","last_became_active":"2023-10-08T16:05:01.500040+0000","last_became_peered":"2023-10-08T16:05:01.500040+0000","last_unstale":"2023-10-08T16:05:01.500511+0000","last_undegraded":"2023-10-08T16:05:01.500511+0000","last_fullsized":"2023-10-08T16:05:01.500511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:18.844965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490001+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:01.490001+0000","last_peered":"2023-10-08T16:05:01.490001+0000","last_clean":"2023-10-08T16:05:01.490001+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:01.490001+0000","last_undegraded":"2023-10-08T16:05:01.490001+0000","last_fullsized":"2023-10-08T16:05:01.490001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498470+0000","last_change":"2023-10-08T16:05:01.498224+0000","last_active":"2023-10-08T16:05:01.498470+0000","last_peered":"2023-10-08T16:05:01.498470+0000","last_clean":"2023-10-08T16:05:01.498470+0000","last_became_active":"2023-10-08T16:05:01.497185+0000","last_became_peered":"2023-10-08T16:05:01.497185+0000","last_unstale":"2023-10-08T16:05:01.498470+0000","last_undegraded":"2023-10-08T16:05:01.498470+0000","last_fullsized":"2023-10-08T16:05:01.498470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494662+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:01.494662+0000","last_peered":"2023-10-08T16:05:01.494662+0000","last_clean":"2023-10-08T16:05:01.494662+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:01.494662+0000","last_undegraded":"2023-10-08T16:05:01.494662+0000","last_fullsized":"2023-10-08T16:05:01.494662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509204+0000","last_change":"2023-10-08T16:05:01.509136+0000","last_active":"2023-10-08T16:05:01.509204+0000","last_peered":"2023-10-08T16:05:01.509204+0000","last_clean":"2023-10-08T16:05:01.509204+0000","last_became_active":"2023-10-08T16:05:01.508906+0000","last_became_peered":"2023-10-08T16:05:01.508906+0000","last_unstale":"2023-10-08T16:05:01.509204+0000","last_undegraded":"2023-10-08T16:05:01.509204+0000","last_fullsized":"2023-10-08T16:05:01.509204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495347+0000","last_change":"2023-10-08T16:05:01.495063+0000","last_active":"2023-10-08T16:05:01.495347+0000","last_peered":"2023-10-08T16:05:01.495347+0000","last_clean":"2023-10-08T16:05:01.495347+0000","last_became_active":"2023-10-08T16:05:01.494843+0000","last_became_peered":"2023-10-08T16:05:01.494843+0000","last_unstale":"2023-10-08T16:05:01.495347+0000","last_undegraded":"2023-10-08T16:05:01.495347+0000","last_fullsized":"2023-10-08T16:05:01.495347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493042+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:01.493042+0000","last_peered":"2023-10-08T16:05:01.493042+0000","last_clean":"2023-10-08T16:05:01.493042+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:01.493042+0000","last_undegraded":"2023-10-08T16:05:01.493042+0000","last_fullsized":"2023-10-08T16:05:01.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498357+0000","last_change":"2023-10-08T16:05:01.498232+0000","last_active":"2023-10-08T16:05:01.498357+0000","last_peered":"2023-10-08T16:05:01.498357+0000","last_clean":"2023-10-08T16:05:01.498357+0000","last_became_active":"2023-10-08T16:05:01.497760+0000","last_became_peered":"2023-10-08T16:05:01.497760+0000","last_unstale":"2023-10-08T16:05:01.498357+0000","last_undegraded":"2023-10-08T16:05:01.498357+0000","last_fullsized":"2023-10-08T16:05:01.498357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493029+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:01.493029+0000","last_peered":"2023-10-08T16:05:01.493029+0000","last_clean":"2023-10-08T16:05:01.493029+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:01.493029+0000","last_undegraded":"2023-10-08T16:05:01.493029+0000","last_fullsized":"2023-10-08T16:05:01.493029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499365+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:05:01.499365+0000","last_peered":"2023-10-08T16:05:01.499365+0000","last_clean":"2023-10-08T16:05:01.499365+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:05:01.499365+0000","last_undegraded":"2023-10-08T16:05:01.499365+0000","last_fullsized":"2023-10-08T16:05:01.499365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507652+0000","last_change":"2023-10-08T16:05:01.507288+0000","last_active":"2023-10-08T16:05:01.507652+0000","last_peered":"2023-10-08T16:05:01.507652+0000","last_clean":"2023-10-08T16:05:01.507652+0000","last_became_active":"2023-10-08T16:05:01.506922+0000","last_became_peered":"2023-10-08T16:05:01.506922+0000","last_unstale":"2023-10-08T16:05:01.507652+0000","last_undegraded":"2023-10-08T16:05:01.507652+0000","last_fullsized":"2023-10-08T16:05:01.507652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498601+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:01.498601+0000","last_peered":"2023-10-08T16:05:01.498601+0000","last_clean":"2023-10-08T16:05:01.498601+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:01.498601+0000","last_undegraded":"2023-10-08T16:05:01.498601+0000","last_fullsized":"2023-10-08T16:05:01.498601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498696+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:01.498696+0000","last_peered":"2023-10-08T16:05:01.498696+0000","last_clean":"2023-10-08T16:05:01.498696+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:01.498696+0000","last_undegraded":"2023-10-08T16:05:01.498696+0000","last_fullsized":"2023-10-08T16:05:01.498696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495311+0000","last_change":"2023-10-08T16:05:01.494801+0000","last_active":"2023-10-08T16:05:01.495311+0000","last_peered":"2023-10-08T16:05:01.495311+0000","last_clean":"2023-10-08T16:05:01.495311+0000","last_became_active":"2023-10-08T16:05:01.494548+0000","last_became_peered":"2023-10-08T16:05:01.494548+0000","last_unstale":"2023-10-08T16:05:01.495311+0000","last_undegraded":"2023-10-08T16:05:01.495311+0000","last_fullsized":"2023-10-08T16:05:01.495311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:05:02.494819+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:02.494819+0000","last_peered":"2023-10-08T16:05:02.494819+0000","last_clean":"2023-10-08T16:05:02.494819+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:02.494819+0000","last_undegraded":"2023-10-08T16:05:02.494819+0000","last_fullsized":"2023-10-08T16:05:02.494819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499126+0000","last_change":"2023-10-08T16:05:01.498976+0000","last_active":"2023-10-08T16:05:01.499126+0000","last_peered":"2023-10-08T16:05:01.499126+0000","last_clean":"2023-10-08T16:05:01.499126+0000","last_became_active":"2023-10-08T16:05:01.498743+0000","last_became_peered":"2023-10-08T16:05:01.498743+0000","last_unstale":"2023-10-08T16:05:01.499126+0000","last_undegraded":"2023-10-08T16:05:01.499126+0000","last_fullsized":"2023-10-08T16:05:01.499126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510000+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:01.510000+0000","last_peered":"2023-10-08T16:05:01.510000+0000","last_clean":"2023-10-08T16:05:01.510000+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:01.510000+0000","last_undegraded":"2023-10-08T16:05:01.510000+0000","last_fullsized":"2023-10-08T16:05:01.510000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509969+0000","last_change":"2023-10-08T16:05:01.509864+0000","last_active":"2023-10-08T16:05:01.509969+0000","last_peered":"2023-10-08T16:05:01.509969+0000","last_clean":"2023-10-08T16:05:01.509969+0000","last_became_active":"2023-10-08T16:05:01.509420+0000","last_became_peered":"2023-10-08T16:05:01.509420+0000","last_unstale":"2023-10-08T16:05:01.509969+0000","last_undegraded":"2023-10-08T16:05:01.509969+0000","last_fullsized":"2023-10-08T16:05:01.509969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495044+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:01.495044+0000","last_peered":"2023-10-08T16:05:01.495044+0000","last_clean":"2023-10-08T16:05:01.495044+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:01.495044+0000","last_undegraded":"2023-10-08T16:05:01.495044+0000","last_fullsized":"2023-10-08T16:05:01.495044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496403+0000","last_change":"2023-10-08T16:05:01.496181+0000","last_active":"2023-10-08T16:05:01.496403+0000","last_peered":"2023-10-08T16:05:01.496403+0000","last_clean":"2023-10-08T16:05:01.496403+0000","last_became_active":"2023-10-08T16:05:01.495966+0000","last_became_peered":"2023-10-08T16:05:01.495966+0000","last_unstale":"2023-10-08T16:05:01.496403+0000","last_undegraded":"2023-10-08T16:05:01.496403+0000","last_fullsized":"2023-10-08T16:05:01.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490079+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:01.490079+0000","last_peered":"2023-10-08T16:05:01.490079+0000","last_clean":"2023-10-08T16:05:01.490079+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:01.490079+0000","last_undegraded":"2023-10-08T16:05:01.490079+0000","last_fullsized":"2023-10-08T16:05:01.490079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498311+0000","last_change":"2023-10-08T16:05:01.497738+0000","last_active":"2023-10-08T16:05:01.498311+0000","last_peered":"2023-10-08T16:05:01.498311+0000","last_clean":"2023-10-08T16:05:01.498311+0000","last_became_active":"2023-10-08T16:05:01.497501+0000","last_became_peered":"2023-10-08T16:05:01.497501+0000","last_unstale":"2023-10-08T16:05:01.498311+0000","last_undegraded":"2023-10-08T16:05:01.498311+0000","last_fullsized":"2023-10-08T16:05:01.498311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490084+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:01.490084+0000","last_peered":"2023-10-08T16:05:01.490084+0000","last_clean":"2023-10-08T16:05:01.490084+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:01.490084+0000","last_undegraded":"2023-10-08T16:05:01.490084+0000","last_fullsized":"2023-10-08T16:05:01.490084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508493+0000","last_change":"2023-10-08T16:05:01.508325+0000","last_active":"2023-10-08T16:05:01.508493+0000","last_peered":"2023-10-08T16:05:01.508493+0000","last_clean":"2023-10-08T16:05:01.508493+0000","last_became_active":"2023-10-08T16:05:01.508104+0000","last_became_peered":"2023-10-08T16:05:01.508104+0000","last_unstale":"2023-10-08T16:05:01.508493+0000","last_undegraded":"2023-10-08T16:05:01.508493+0000","last_fullsized":"2023-10-08T16:05:01.508493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511308+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:01.511308+0000","last_peered":"2023-10-08T16:05:01.511308+0000","last_clean":"2023-10-08T16:05:01.511308+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:01.511308+0000","last_undegraded":"2023-10-08T16:05:01.511308+0000","last_fullsized":"2023-10-08T16:05:01.511308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503900+0000","last_change":"2023-10-08T16:05:01.503800+0000","last_active":"2023-10-08T16:05:01.503900+0000","last_peered":"2023-10-08T16:05:01.503900+0000","last_clean":"2023-10-08T16:05:01.503900+0000","last_became_active":"2023-10-08T16:05:01.503436+0000","last_became_peered":"2023-10-08T16:05:01.503436+0000","last_unstale":"2023-10-08T16:05:01.503900+0000","last_undegraded":"2023-10-08T16:05:01.503900+0000","last_fullsized":"2023-10-08T16:05:01.503900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.492352+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:01.492352+0000","last_peered":"2023-10-08T16:05:01.492352+0000","last_clean":"2023-10-08T16:05:01.492352+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:01.492352+0000","last_undegraded":"2023-10-08T16:05:01.492352+0000","last_fullsized":"2023-10-08T16:05:01.492352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498383+0000","last_change":"2023-10-08T16:05:01.497066+0000","last_active":"2023-10-08T16:05:01.498383+0000","last_peered":"2023-10-08T16:05:01.498383+0000","last_clean":"2023-10-08T16:05:01.498383+0000","last_became_active":"2023-10-08T16:05:01.496839+0000","last_became_peered":"2023-10-08T16:05:01.496839+0000","last_unstale":"2023-10-08T16:05:01.498383+0000","last_undegraded":"2023-10-08T16:05:01.498383+0000","last_fullsized":"2023-10-08T16:05:01.498383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505139+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:01.505139+0000","last_peered":"2023-10-08T16:05:01.505139+0000","last_clean":"2023-10-08T16:05:01.505139+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:01.505139+0000","last_undegraded":"2023-10-08T16:05:01.505139+0000","last_fullsized":"2023-10-08T16:05:01.505139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504767+0000","last_change":"2023-10-08T16:05:01.504578+0000","last_active":"2023-10-08T16:05:01.504767+0000","last_peered":"2023-10-08T16:05:01.504767+0000","last_clean":"2023-10-08T16:05:01.504767+0000","last_became_active":"2023-10-08T16:05:01.501061+0000","last_became_peered":"2023-10-08T16:05:01.501061+0000","last_unstale":"2023-10-08T16:05:01.504767+0000","last_undegraded":"2023-10-08T16:05:01.504767+0000","last_fullsized":"2023-10-08T16:05:01.504767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508879+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:01.508879+0000","last_peered":"2023-10-08T16:05:01.508879+0000","last_clean":"2023-10-08T16:05:01.508879+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:01.508879+0000","last_undegraded":"2023-10-08T16:05:01.508879+0000","last_fullsized":"2023-10-08T16:05:01.508879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501242+0000","last_change":"2023-10-08T16:05:01.501159+0000","last_active":"2023-10-08T16:05:01.501242+0000","last_peered":"2023-10-08T16:05:01.501242+0000","last_clean":"2023-10-08T16:05:01.501242+0000","last_became_active":"2023-10-08T16:05:01.500711+0000","last_became_peered":"2023-10-08T16:05:01.500711+0000","last_unstale":"2023-10-08T16:05:01.501242+0000","last_undegraded":"2023-10-08T16:05:01.501242+0000","last_fullsized":"2023-10-08T16:05:01.501242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:34.471207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510349+0000","last_change":"2023-10-08T16:05:01.510144+0000","last_active":"2023-10-08T16:05:01.510349+0000","last_peered":"2023-10-08T16:05:01.510349+0000","last_clean":"2023-10-08T16:05:01.510349+0000","last_became_active":"2023-10-08T16:05:01.509633+0000","last_became_peered":"2023-10-08T16:05:01.509633+0000","last_unstale":"2023-10-08T16:05:01.510349+0000","last_undegraded":"2023-10-08T16:05:01.510349+0000","last_fullsized":"2023-10-08T16:05:01.510349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496004+0000","last_change":"2023-10-08T16:05:01.495936+0000","last_active":"2023-10-08T16:05:01.496004+0000","last_peered":"2023-10-08T16:05:01.496004+0000","last_clean":"2023-10-08T16:05:01.496004+0000","last_became_active":"2023-10-08T16:05:01.495683+0000","last_became_peered":"2023-10-08T16:05:01.495683+0000","last_unstale":"2023-10-08T16:05:01.496004+0000","last_undegraded":"2023-10-08T16:05:01.496004+0000","last_fullsized":"2023-10-08T16:05:01.496004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498422+0000","last_change":"2023-10-08T16:05:01.496960+0000","last_active":"2023-10-08T16:05:01.498422+0000","last_peered":"2023-10-08T16:05:01.498422+0000","last_clean":"2023-10-08T16:05:01.498422+0000","last_became_active":"2023-10-08T16:05:01.496720+0000","last_became_peered":"2023-10-08T16:05:01.496720+0000","last_unstale":"2023-10-08T16:05:01.498422+0000","last_undegraded":"2023-10-08T16:05:01.498422+0000","last_fullsized":"2023-10-08T16:05:01.498422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507685+0000","last_change":"2023-10-08T16:05:01.507536+0000","last_active":"2023-10-08T16:05:01.507685+0000","last_peered":"2023-10-08T16:05:01.507685+0000","last_clean":"2023-10-08T16:05:01.507685+0000","last_became_active":"2023-10-08T16:05:01.507028+0000","last_became_peered":"2023-10-08T16:05:01.507028+0000","last_unstale":"2023-10-08T16:05:01.507685+0000","last_undegraded":"2023-10-08T16:05:01.507685+0000","last_fullsized":"2023-10-08T16:05:01.507685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498292+0000","last_change":"2023-10-08T16:05:01.497598+0000","last_active":"2023-10-08T16:05:01.498292+0000","last_peered":"2023-10-08T16:05:01.498292+0000","last_clean":"2023-10-08T16:05:01.498292+0000","last_became_active":"2023-10-08T16:05:01.497068+0000","last_became_peered":"2023-10-08T16:05:01.497068+0000","last_unstale":"2023-10-08T16:05:01.498292+0000","last_undegraded":"2023-10-08T16:05:01.498292+0000","last_fullsized":"2023-10-08T16:05:01.498292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495329+0000","last_change":"2023-10-08T16:05:01.494815+0000","last_active":"2023-10-08T16:05:01.495329+0000","last_peered":"2023-10-08T16:05:01.495329+0000","last_clean":"2023-10-08T16:05:01.495329+0000","last_became_active":"2023-10-08T16:05:01.494588+0000","last_became_peered":"2023-10-08T16:05:01.494588+0000","last_unstale":"2023-10-08T16:05:01.495329+0000","last_undegraded":"2023-10-08T16:05:01.495329+0000","last_fullsized":"2023-10-08T16:05:01.495329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505789+0000","last_change":"2023-10-08T16:05:01.505706+0000","last_active":"2023-10-08T16:05:01.505789+0000","last_peered":"2023-10-08T16:05:01.505789+0000","last_clean":"2023-10-08T16:05:01.505789+0000","last_became_active":"2023-10-08T16:05:01.505486+0000","last_became_peered":"2023-10-08T16:05:01.505486+0000","last_unstale":"2023-10-08T16:05:01.505789+0000","last_undegraded":"2023-10-08T16:05:01.505789+0000","last_fullsized":"2023-10-08T16:05:01.505789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.497536+0000","last_change":"2023-10-08T16:05:01.497102+0000","last_active":"2023-10-08T16:05:01.497536+0000","last_peered":"2023-10-08T16:05:01.497536+0000","last_clean":"2023-10-08T16:05:01.497536+0000","last_became_active":"2023-10-08T16:05:01.496760+0000","last_became_peered":"2023-10-08T16:05:01.496760+0000","last_unstale":"2023-10-08T16:05:01.497536+0000","last_undegraded":"2023-10-08T16:05:01.497536+0000","last_fullsized":"2023-10-08T16:05:01.497536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498454+0000","last_change":"2023-10-08T16:05:01.498081+0000","last_active":"2023-10-08T16:05:01.498454+0000","last_peered":"2023-10-08T16:05:01.498454+0000","last_clean":"2023-10-08T16:05:01.498454+0000","last_became_active":"2023-10-08T16:05:01.496861+0000","last_became_peered":"2023-10-08T16:05:01.496861+0000","last_unstale":"2023-10-08T16:05:01.498454+0000","last_undegraded":"2023-10-08T16:05:01.498454+0000","last_fullsized":"2023-10-08T16:05:01.498454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499735+0000","last_change":"2023-10-08T16:05:01.499621+0000","last_active":"2023-10-08T16:05:01.499735+0000","last_peered":"2023-10-08T16:05:01.499735+0000","last_clean":"2023-10-08T16:05:01.499735+0000","last_became_active":"2023-10-08T16:05:01.499401+0000","last_became_peered":"2023-10-08T16:05:01.499401+0000","last_unstale":"2023-10-08T16:05:01.499735+0000","last_undegraded":"2023-10-08T16:05:01.499735+0000","last_fullsized":"2023-10-08T16:05:01.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505149+0000","last_change":"2023-10-08T16:05:01.504917+0000","last_active":"2023-10-08T16:05:01.505149+0000","last_peered":"2023-10-08T16:05:01.505149+0000","last_clean":"2023-10-08T16:05:01.505149+0000","last_became_active":"2023-10-08T16:05:01.501765+0000","last_became_peered":"2023-10-08T16:05:01.501765+0000","last_unstale":"2023-10-08T16:05:01.505149+0000","last_undegraded":"2023-10-08T16:05:01.505149+0000","last_fullsized":"2023-10-08T16:05:01.505149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510856+0000","last_change":"2023-10-08T16:05:01.510328+0000","last_active":"2023-10-08T16:05:01.510856+0000","last_peered":"2023-10-08T16:05:01.510856+0000","last_clean":"2023-10-08T16:05:01.510856+0000","last_became_active":"2023-10-08T16:05:01.509693+0000","last_became_peered":"2023-10-08T16:05:01.509693+0000","last_unstale":"2023-10-08T16:05:01.510856+0000","last_undegraded":"2023-10-08T16:05:01.510856+0000","last_fullsized":"2023-10-08T16:05:01.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504190+0000","last_change":"2023-10-08T16:05:01.504127+0000","last_active":"2023-10-08T16:05:01.504190+0000","last_peered":"2023-10-08T16:05:01.504190+0000","last_clean":"2023-10-08T16:05:01.504190+0000","last_became_active":"2023-10-08T16:05:01.503128+0000","last_became_peered":"2023-10-08T16:05:01.503128+0000","last_unstale":"2023-10-08T16:05:01.504190+0000","last_undegraded":"2023-10-08T16:05:01.504190+0000","last_fullsized":"2023-10-08T16:05:01.504190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:10.523 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:05:10.523 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T16:05:10.523 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T16:05:10.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T16:05:10.524 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T16:05:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.676+0000 7f123a274700 1 Processor -- start 2023-10-08T16:05:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.676+0000 7f123a274700 1 -- start start 2023-10-08T16:05:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f123a274700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1234157870 0x7f123415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f123a274700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415cbb0 con 0x7f1234157c40 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f123a274700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415bfa0 con 0x7f123415a620 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f123a274700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123415c280 con 0x7f1234157870 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f1233fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1234157870 0x7f123415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f1238811700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1234157c40 0x7f1234158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43752/0 (socket says 172.21.15.60:43752) 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.677+0000 7f1238811700 1 -- 172.21.15.60:0/306519906 learned_addr learned my addr 172.21.15.60:0/306519906 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1233fff700 1 -- 172.21.15.60:0/306519906 >> v1:172.21.15.144:6789/0 conn(0x7f123415a620 legacy=0x7f123415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1233fff700 1 -- 172.21.15.60:0/306519906 >> v1:172.21.15.60:6789/0 conn(0x7f1234157c40 legacy=0x7f1234158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1233fff700 1 -- 172.21.15.60:0/306519906 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123415c560 con 0x7f1234157870 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1232ffd700 1 -- 172.21.15.60:0/306519906 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979529077 0 0) 0x7f123415cbb0 con 0x7f1234157c40 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1233fff700 1 --2- 172.21.15.60:0/306519906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f123415b6a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12240098e0 tx=0x7f12240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d55e34a0e47ad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1232ffd700 1 -- 172.21.15.60:0/306519906 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224009e80 con 0x7f1234157870 2023-10-08T16:05:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1232ffd700 1 -- 172.21.15.60:0/306519906 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400b860 con 0x7f1234157870 2023-10-08T16:05:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.678+0000 7f1232ffd700 1 -- 172.21.15.60:0/306519906 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400bbe0 con 0x7f1234157870 2023-10-08T16:05:10.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 -- 172.21.15.60:0/306519906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 msgr2=0x7f123415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 --2- 172.21.15.60:0/306519906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f123415b6a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12240098e0 tx=0x7f12240091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 -- 172.21.15.60:0/306519906 shutdown_connections 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 --2- 172.21.15.60:0/306519906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f123415b6a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 -- 172.21.15.60:0/306519906 >> 172.21.15.60:0/306519906 conn(0x7f1234068ce0 msgr2=0x7f12340690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 -- 172.21.15.60:0/306519906 shutdown_connections 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.679+0000 7f123a274700 1 -- 172.21.15.60:0/306519906 wait complete. 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.680+0000 7f123a274700 1 Processor -- start 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.680+0000 7f123a274700 1 -- start start 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f12341456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234157c40 0x7f1234160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f123415a620 0x7f1234160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123415edd0 con 0x7f1234157870 2023-10-08T16:05:10.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123416b940 con 0x7f1234157c40 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123416bc20 con 0x7f123415a620 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f12341456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f12341456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40278/0 (socket says 172.21.15.60:40278) 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 -- 172.21.15.60:0/1142189441 learned_addr learned my addr 172.21.15.60:0/1142189441 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f12337fe700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234157c40 0x7f1234160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1238811700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f123415a620 0x7f1234160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 -- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f123415a620 msgr2=0x7f1234160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f123415a620 0x7f1234160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 -- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234157c40 msgr2=0x7f1234160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234157c40 0x7f1234160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 -- 172.21.15.60:0/1142189441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009420 con 0x7f1234157870 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f12337fe700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234157c40 0x7f1234160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1238811700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f123415a620 0x7f1234160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f1233fff700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f12341456b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f123406b530 tx=0x7f1224017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011420 con 0x7f1234157870 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224011580 con 0x7f1234157870 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.681+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123416bf00 con 0x7f1234157870 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.682+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011940 con 0x7f1234157870 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.682+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1234145bf0 con 0x7f1234157870 2023-10-08T16:05:10.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.682+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404c3c0 con 0x7f1234157870 2023-10-08T16:05:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.683+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1224011cf0 con 0x7f1234157870 2023-10-08T16:05:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.683+0000 7f121bfff700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1220066f30 0x7f12200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.683+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1224085d70 con 0x7f1234157870 2023-10-08T16:05:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.683+0000 7f12337fe700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1220066f30 0x7f12200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:10.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.684+0000 7f12337fe700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1220066f30 0x7f12200693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1228007fd0 tx=0x7f1228009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:10.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.687+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1224052fe0 con 0x7f1234157870 2023-10-08T16:05:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.936+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f123415c840 con 0x7f1234157870 2023-10-08T16:05:10.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.939+0000 7f121bfff700 1 -- 172.21.15.60:0/1142189441 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+163698 (secure 0 0 0) 0x7f1224056600 con 0x7f1234157870 2023-10-08T16:05:10.943 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1220066f30 msgr2=0x7f12200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1220066f30 0x7f12200693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1228007fd0 tx=0x7f1228009040 comp rx=0 tx=0).stop 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 msgr2=0x7f12341456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f12341456b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f123406b530 tx=0x7f1224017000 comp rx=0 tx=0).stop 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 shutdown_connections 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1220066f30 0x7f12200693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f123415a620 0x7f1234160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1234157870 0x7f12341456b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 --2- 172.21.15.60:0/1142189441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1234157c40 0x7f1234160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:10.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 >> 172.21.15.60:0/1142189441 conn(0x7f1234068ce0 msgr2=0x7f12341580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:10.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 shutdown_connections 2023-10-08T16:05:10.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:10.942+0000 7f123a274700 1 -- 172.21.15.60:0/1142189441 wait complete. 2023-10-08T16:05:10.955 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":4,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":86121},{"type":"v1","addr":"172.21.15.60:6833","nonce":86121}]},"active_addr":"172.21.15.60:6833/86121","active_change":"2023-10-08T16:04:49.553587+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":1688863228}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2664297410}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2527989034}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":855258606}]}]} 2023-10-08T16:05:10.959 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T16:05:10.959 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T16:05:10.959 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:11.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.077+0000 7fe249283700 1 Processor -- start 2023-10-08T16:05:11.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.077+0000 7fe249283700 1 -- start start 2023-10-08T16:05:11.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.077+0000 7fe249283700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 0x7fe24415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.077+0000 7fe249283700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 0x7fe244158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe249283700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24415cbb0 con 0x7fe24415a620 2023-10-08T16:05:11.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe249283700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24415bfa0 con 0x7fe244157870 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe249283700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24415c280 con 0x7fe244157c40 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe242ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 0x7fe24415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 0x7fe244158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe242ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 0x7fe24415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56788/0 (socket says 172.21.15.60:56788) 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 0x7fe244158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50836/0 (socket says 172.21.15.60:50836) 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe242ffd700 1 -- 172.21.15.60:0/1114251167 learned_addr learned my addr 172.21.15.60:0/1114251167 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2427fc700 1 --1- 172.21.15.60:0/1114251167 >> v1:172.21.15.144:6789/0 conn(0x7fe24415a620 0x7fe24415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34014/0 (socket says 172.21.15.60:34014) 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 -- 172.21.15.60:0/1114251167 >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 msgr2=0x7fe24415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 --2- 172.21.15.60:0/1114251167 >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 0x7fe24415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 -- 172.21.15.60:0/1114251167 >> v1:172.21.15.144:6789/0 conn(0x7fe24415a620 legacy=0x7fe24415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe241ffb700 1 -- 172.21.15.60:0/1114251167 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14085292 0 0) 0x7fe24415cbb0 con 0x7fe24415a620 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 -- 172.21.15.60:0/1114251167 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24415c560 con 0x7fe244157c40 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe242ffd700 1 --2- 172.21.15.60:0/1114251167 >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 0x7fe24415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.078+0000 7fe2437fe700 1 --2- 172.21.15.60:0/1114251167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 0x7fe244158110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e60 tx=0x7fe23c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc188c8f6f43d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe241ffb700 1 -- 172.21.15.60:0/1114251167 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00e070 con 0x7fe244157c40 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe241ffb700 1 -- 172.21.15.60:0/1114251167 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00bb60 con 0x7fe244157c40 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe241ffb700 1 -- 172.21.15.60:0/1114251167 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c012430 con 0x7fe244157c40 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 -- 172.21.15.60:0/1114251167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 msgr2=0x7fe244158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 --2- 172.21.15.60:0/1114251167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 0x7fe244158110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e60 tx=0x7fe23c009780 comp rx=0 tx=0).stop 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 -- 172.21.15.60:0/1114251167 shutdown_connections 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 --2- 172.21.15.60:0/1114251167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157c40 0x7fe244158110 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 --2- 172.21.15.60:0/1114251167 >> v2:172.21.15.144:3300/0 conn(0x7fe244157870 0x7fe24415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 -- 172.21.15.60:0/1114251167 >> 172.21.15.60:0/1114251167 conn(0x7fe244068ce0 msgr2=0x7fe2440690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 -- 172.21.15.60:0/1114251167 shutdown_connections 2023-10-08T16:05:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.079+0000 7fe249283700 1 -- 172.21.15.60:0/1114251167 wait complete. 2023-10-08T16:05:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.080+0000 7fe249283700 1 Processor -- start 2023-10-08T16:05:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.080+0000 7fe249283700 1 -- start start 2023-10-08T16:05:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe249283700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157870 0x7fe24414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe249283700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 0x7fe244153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe249283700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe24415a620 0x7fe24414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe249283700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24414e590 con 0x7fe244157c40 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe249283700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe244151920 con 0x7fe24415a620 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe249283700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24414f3b0 con 0x7fe244157870 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe2427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 0x7fe244153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe2427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 0x7fe244153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40290/0 (socket says 172.21.15.60:40290) 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe2427fc700 1 -- 172.21.15.60:0/1054787183 learned_addr learned my addr 172.21.15.60:0/1054787183 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.081+0000 7fe2437fe700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe24415a620 0x7fe24414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe242ffd700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157870 0x7fe24414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe2427fc700 1 -- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157870 msgr2=0x7fe24414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe2427fc700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157870 0x7fe24414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe2427fc700 1 -- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe24415a620 msgr2=0x7fe24414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe2427fc700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe24415a620 0x7fe24414f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe2427fc700 1 -- 172.21.15.60:0/1054787183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340094f0 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe242ffd700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157870 0x7fe24414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe2427fc700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 0x7fe244153750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c540 tx=0x7fe22c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c005a70 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c005bf0 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c009a20 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0070d0 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.082+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24414ea80 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.083+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24404c3c0 con 0x7fe244157c40 2023-10-08T16:05:11.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.083+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe22c007480 con 0x7fe244157c40 2023-10-08T16:05:11.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.084+0000 7fe23affd700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe224066f30 0x7fe2240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.084+0000 7fe242ffd700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe224066f30 0x7fe2240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.084+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe22c083af0 con 0x7fe244157c40 2023-10-08T16:05:11.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.084+0000 7fe242ffd700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe224066f30 0x7fe2240693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2340094c0 tx=0x7fe234008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.088+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe22c050d60 con 0x7fe244157c40 2023-10-08T16:05:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.279+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe24414f4f0 con 0x7fe244157c40 2023-10-08T16:05:11.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.280+0000 7fe23affd700 1 -- 172.21.15.60:0/1054787183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe22c017070 con 0x7fe244157c40 2023-10-08T16:05:11.281 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:11.282 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe224066f30 msgr2=0x7fe2240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe224066f30 0x7fe2240693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2340094c0 tx=0x7fe234008040 comp rx=0 tx=0).stop 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 msgr2=0x7fe244153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 0x7fe244153750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c540 tx=0x7fe22c00c900 comp rx=0 tx=0).stop 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 shutdown_connections 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe224066f30 0x7fe2240693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe244157870 0x7fe24414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe24415a620 0x7fe24414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 --2- 172.21.15.60:0/1054787183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe244157c40 0x7fe244153750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 >> 172.21.15.60:0/1054787183 conn(0x7fe244068ce0 msgr2=0x7fe2440d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 shutdown_connections 2023-10-08T16:05:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.282+0000 7fe249283700 1 -- 172.21.15.60:0/1054787183 wait complete. 2023-10-08T16:05:11.295 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T16:05:11.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.412+0000 7fb55b8cf700 1 Processor -- start 2023-10-08T16:05:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb55b8cf700 1 -- start start 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb55b8cf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb554070e10 0x7fb5540c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb55b8cf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540ca270 con 0x7fb55406f1a0 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb55b8cf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540c87c0 con 0x7fb5540afd90 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb55b8cf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55406e3e0 con 0x7fb554070e10 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb559e6c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb554070e10 0x7fb5540c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb559e6c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb554070e10 0x7fb5540c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40294/0 (socket says 172.21.15.60:40294) 2023-10-08T16:05:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb559e6c700 1 -- 172.21.15.60:0/2827101360 learned_addr learned my addr 172.21.15.60:0/2827101360 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.413+0000 7fb558e6a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb55406f1a0 0x7fb554070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43754/0 (socket says 172.21.15.60:43754) 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb559e6c700 1 -- 172.21.15.60:0/2827101360 >> v1:172.21.15.144:6789/0 conn(0x7fb5540afd90 legacy=0x7fb55415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb559e6c700 1 -- 172.21.15.60:0/2827101360 >> v1:172.21.15.60:6789/0 conn(0x7fb55406f1a0 legacy=0x7fb554070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb553fff700 1 -- 172.21.15.60:0/2827101360 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804936360 0 0) 0x7fb5540ca270 con 0x7fb55406f1a0 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb559e6c700 1 -- 172.21.15.60:0/2827101360 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55406e6c0 con 0x7fb554070e10 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb559e6c700 1 --2- 172.21.15.60:0/2827101360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb5540c9c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb544009f20 tx=0x7fb544009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0eece9738caa8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb553fff700 1 -- 172.21.15.60:0/2827101360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400e070 con 0x7fb554070e10 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb553fff700 1 -- 172.21.15.60:0/2827101360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400ba80 con 0x7fb554070e10 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.414+0000 7fb553fff700 1 -- 172.21.15.60:0/2827101360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440092e0 con 0x7fb554070e10 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 -- 172.21.15.60:0/2827101360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 msgr2=0x7fb5540c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/2827101360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb5540c9c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb544009f20 tx=0x7fb544009840 comp rx=0 tx=0).stop 2023-10-08T16:05:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 -- 172.21.15.60:0/2827101360 shutdown_connections 2023-10-08T16:05:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/2827101360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb5540c9c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 -- 172.21.15.60:0/2827101360 >> 172.21.15.60:0/2827101360 conn(0x7fb5540ca4f0 msgr2=0x7fb5540ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 -- 172.21.15.60:0/2827101360 shutdown_connections 2023-10-08T16:05:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.415+0000 7fb55b8cf700 1 -- 172.21.15.60:0/2827101360 wait complete. 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.416+0000 7fb55b8cf700 1 Processor -- start 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.416+0000 7fb55b8cf700 1 -- start start 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb55406f1a0 0x7fb55416ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb554154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540afd90 0x7fb5540b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540b3970 con 0x7fb554070e10 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55416b060 con 0x7fb5540afd90 2023-10-08T16:05:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5541554e0 con 0x7fb55406f1a0 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb554154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb554154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40298/0 (socket says 172.21.15.60:40298) 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 -- 172.21.15.60:0/3627439365 learned_addr learned my addr 172.21.15.60:0/3627439365 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb559e6c700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540afd90 0x7fb5540b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 -- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb55406f1a0 msgr2=0x7fb55416ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55966b700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb55406f1a0 0x7fb55416ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb55406f1a0 0x7fb55416ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 -- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540afd90 msgr2=0x7fb5540b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540afd90 0x7fb5540b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 -- 172.21.15.60:0/3627439365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009ae0 con 0x7fb554070e10 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb559e6c700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540afd90 0x7fb5540b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb558e6a700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb554154fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c5e0 tx=0x7fb548007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548005a70 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548005bd0 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5540b36b0 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480070d0 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.417+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5540c2d20 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.418+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55404c3c0 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.419+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb548007440 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.419+0000 7fb5517fa700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.419+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb548083a80 con 0x7fb554070e10 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.419+0000 7fb55966b700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.420+0000 7fb55966b700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5540c8680 tx=0x7fb54c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.423+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb548050cf0 con 0x7fb554070e10 2023-10-08T16:05:11.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.618+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb55406b620 con 0x7fb554070e10 2023-10-08T16:05:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.619+0000 7fb5517fa700 1 -- 172.21.15.60:0/3627439365 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb548017020 con 0x7fb554070e10 2023-10-08T16:05:11.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:11.620 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 msgr2=0x7fb5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5540c8680 tx=0x7fb54c009040 comp rx=0 tx=0).stop 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 msgr2=0x7fb554154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb554154fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c5e0 tx=0x7fb548007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 shutdown_connections 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb55406f1a0 0x7fb55416ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540afd90 0x7fb5540b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 --2- 172.21.15.60:0/3627439365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb554070e10 0x7fb554154fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 >> 172.21.15.60:0/3627439365 conn(0x7fb5540ca4f0 msgr2=0x7fb554157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 shutdown_connections 2023-10-08T16:05:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.621+0000 7fb55b8cf700 1 -- 172.21.15.60:0/3627439365 wait complete. 2023-10-08T16:05:11.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T16:05:11.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T16:05:11.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T16:05:11.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T16:05:11.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T16:05:11.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T16:05:11.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T16:05:11.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T16:05:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.841+0000 7fa405bd0700 1 Processor -- start 2023-10-08T16:05:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.841+0000 7fa405bd0700 1 -- start start 2023-10-08T16:05:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa405bd0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa40015e2b0 0x7fa4000affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa405bd0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4000b2e00 0x7fa400162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa405bd0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4000af3f0 con 0x7fa40015e680 2023-10-08T16:05:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa405bd0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4000af6d0 con 0x7fa4000b2e00 2023-10-08T16:05:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa405bd0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000af9b0 con 0x7fa40015e2b0 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa3fffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4000b2e00 0x7fa400162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa3feffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa40015e680 0x7fa400161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43770/0 (socket says 172.21.15.60:43770) 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa3feffd700 1 -- 172.21.15.60:0/642849446 learned_addr learned my addr 172.21.15.60:0/642849446 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.842+0000 7fa3fffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4000b2e00 0x7fa400162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40304/0 (socket says 172.21.15.60:40304) 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.843+0000 7fa3fffff700 1 -- 172.21.15.60:0/642849446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa40015e2b0 msgr2=0x7fa4000affa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.843+0000 7fa3fffff700 1 --2- 172.21.15.60:0/642849446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa40015e2b0 0x7fa4000affa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.843+0000 7fa3fffff700 1 -- 172.21.15.60:0/642849446 >> v1:172.21.15.60:6789/0 conn(0x7fa40015e680 legacy=0x7fa400161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.843+0000 7fa3fffff700 1 -- 172.21.15.60:0/642849446 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4000b2600 con 0x7fa4000b2e00 2023-10-08T16:05:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.843+0000 7fa3fffff700 1 --2- 172.21.15.60:0/642849446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4000b2e00 0x7fa400162670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009e60 tx=0x7fa3f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a2bf5028f1e707 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.844+0000 7fa3fe7fc700 1 -- 172.21.15.60:0/642849446 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800e070 con 0x7fa4000b2e00 2023-10-08T16:05:11.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.844+0000 7fa3fe7fc700 1 -- 172.21.15.60:0/642849446 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f800bc30 con 0x7fa4000b2e00 2023-10-08T16:05:11.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.844+0000 7fa3fe7fc700 1 -- 172.21.15.60:0/642849446 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8012430 con 0x7fa4000b2e00 2023-10-08T16:05:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.845+0000 7fa28ff51700 1 Processor -- start 2023-10-08T16:05:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.845+0000 7fa405bd0700 1 -- 172.21.15.60:0/642849446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4000b2e00 msgr2=0x7fa400162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.845+0000 7fa405bd0700 1 --2- 172.21.15.60:0/642849446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4000b2e00 0x7fa400162670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009e60 tx=0x7fa3f8009780 comp rx=0 tx=0).stop 2023-10-08T16:05:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa405bd0700 1 -- 172.21.15.60:0/642849446 shutdown_connections 2023-10-08T16:05:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa405bd0700 1 --2- 172.21.15.60:0/642849446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4000b2e00 0x7fa400162670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa405bd0700 1 --2- 172.21.15.60:0/642849446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa40015e2b0 0x7fa4000affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa405bd0700 1 -- 172.21.15.60:0/642849446 >> 172.21.15.60:0/642849446 conn(0x7fa4000cd1e0 msgr2=0x7fa4000cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa28ff51700 1 -- start start 2023-10-08T16:05:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7efcfdf2d700 1 Processor -- start 2023-10-08T16:05:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa6e80f7700 1 Processor -- start 2023-10-08T16:05:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7f53ad366700 1 Processor -- start 2023-10-08T16:05:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7f53ad366700 1 -- start start 2023-10-08T16:05:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7efcfdf2d700 1 -- start start 2023-10-08T16:05:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.846+0000 7fa6e80f7700 1 -- start start 2023-10-08T16:05:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28ff51700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa288156270 0x7fa288160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28ff51700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880c8760 con 0x7fa2880c75c0 2023-10-08T16:05:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28ff51700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880af6e0 con 0x7fa28806d2e0 2023-10-08T16:05:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28ff51700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2880c7b50 con 0x7fa288156270 2023-10-08T16:05:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f53ad366700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80cd3a0 0x7f53a80af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f53ad366700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80b00c0 con 0x7f53a80bfbe0 2023-10-08T16:05:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f53ad366700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80b0380 con 0x7f53a80afc20 2023-10-08T16:05:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f53ad366700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815e9c0 con 0x7f53a80cd3a0 2023-10-08T16:05:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28d4ec700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa2880c75c0 0x7fa288155b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43772/0 (socket says 172.21.15.60:43772) 2023-10-08T16:05:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28d4ec700 1 -- 172.21.15.60:0/3873526415 learned_addr learned my addr 172.21.15.60:0/3873526415 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f5ce41f3700 1 Processor -- start 2023-10-08T16:05:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa6e80f7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa6e00a7b20 0x7fa6e00b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa6e80f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 0x7fa6e006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa6e80f7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00990a0 con 0x7fa6e006eff0 2023-10-08T16:05:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa6e80f7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e006f470 con 0x7fa6e00a7b20 2023-10-08T16:05:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa6e80f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0064120 con 0x7fa6e0063cf0 2023-10-08T16:05:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 0x7fa6e006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 0x7fa6e006eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50876/0 (socket says 172.21.15.60:50876) 2023-10-08T16:05:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 -- 172.21.15.60:0/1317593817 learned_addr learned my addr 172.21.15.60:0/1317593817 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5e93700 1 --2- 172.21.15.60:0/1317593817 >> v2:172.21.15.60:3300/0 conn(0x7fa6e00a7b20 0x7fa6e00b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 -- 172.21.15.60:0/1317593817 >> v2:172.21.15.60:3300/0 conn(0x7fa6e00a7b20 msgr2=0x7fa6e00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 --2- 172.21.15.60:0/1317593817 >> v2:172.21.15.60:3300/0 conn(0x7fa6e00a7b20 0x7fa6e00b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 -- 172.21.15.60:0/1317593817 >> v1:172.21.15.60:6789/0 conn(0x7fa6e006eff0 legacy=0x7fa6e00b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 -- 172.21.15.60:0/1317593817 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00984b0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa6e5692700 1 --2- 172.21.15.60:0/1317593817 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 0x7fa6e006eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0099b0 tx=0x7fa6dc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99d2316f066770 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f53a77fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f53a80afc20 0x7f53a80b1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34050/0 (socket says 172.21.15.60:34050) 2023-10-08T16:05:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f53a77fe700 1 -- 172.21.15.60:0/1900255899 learned_addr learned my addr 172.21.15.60:0/1900255899 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217587570 0 0) 0x7f53a80b0380 con 0x7f53a80afc20 2023-10-08T16:05:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f539e7fc700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80cd3a0 0x7f53a80af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5394003570 con 0x7f53a80afc20 2023-10-08T16:05:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071129939 0 0) 0x7f53a80b00c0 con 0x7f53a80bfbe0 2023-10-08T16:05:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a80b0380 con 0x7f53a80bfbe0 2023-10-08T16:05:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3530960485 0 0) 0x7f5394003570 con 0x7f53a80afc20 2023-10-08T16:05:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80cd3a0 msgr2=0x7f53a80af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80cd3a0 0x7f53a80af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 >> v1:172.21.15.60:6789/0 conn(0x7f53a80bfbe0 legacy=0x7f53a80ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80b0660 con 0x7f53a80afc20 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.1 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f53a00017f0 con 0x7f53a80afc20 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 >> v1:172.21.15.144:6789/0 conn(0x7f53a80afc20 legacy=0x7f53a80b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5394003bf0 0x7f5394003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5394004810 0x7f5394004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f539400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815e9c0 con 0x7f5394003bf0 2023-10-08T16:05:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a6ffd700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5394003bf0 0x7f5394003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539400c0b0 con 0x7f53940051c0 2023-10-08T16:05:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539400c270 con 0x7f5394004810 2023-10-08T16:05:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7f53a77fe700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f539400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7f5ce41f3700 1 -- start start 2023-10-08T16:05:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28e4ee700 1 --2- 172.21.15.60:0/3873526415 >> v2:172.21.15.144:3300/0 conn(0x7fa288156270 0x7fa288160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28cceb700 1 -- 172.21.15.60:0/3873526415 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979788258 0 0) 0x7fa2880af6e0 con 0x7fa28806d2e0 2023-10-08T16:05:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28cceb700 1 -- 172.21.15.60:0/3873526415 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa274003570 con 0x7fa28806d2e0 2023-10-08T16:05:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28e4ee700 1 -- 172.21.15.60:0/3873526415 >> v1:172.21.15.144:6789/0 conn(0x7fa28806d2e0 legacy=0x7fa2880c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7fa28e4ee700 1 -- 172.21.15.60:0/3873526415 >> v1:172.21.15.60:6789/0 conn(0x7fa2880c75c0 legacy=0x7fa288155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7fa28e4ee700 1 -- 172.21.15.60:0/3873526415 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880c7e30 con 0x7fa288156270 2023-10-08T16:05:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcfdf2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf80cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcfdf2d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcf80d18d0 0x7efcf8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcfdf2d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80cb810 con 0x7efcf80afe40 2023-10-08T16:05:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcfdf2d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80b0f80 con 0x7efcf80d18d0 2023-10-08T16:05:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcfdf2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80b0370 con 0x7efcf80afa70 2023-10-08T16:05:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcf6ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efcf80afe40 0x7efcf80b2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34060/0 (socket says 172.21.15.60:34060) 2023-10-08T16:05:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcf6ffd700 1 -- 172.21.15.60:0/2873503053 learned_addr learned my addr 172.21.15.60:0/2873503053 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcf7fff700 1 --2- 172.21.15.60:0/2873503053 >> v2:172.21.15.144:3300/0 conn(0x7efcf80d18d0 0x7efcf8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.847+0000 7efcf77fe700 1 --2- 172.21.15.60:0/2873503053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf80cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf77fe700 1 -- 172.21.15.60:0/2873503053 >> v2:172.21.15.144:3300/0 conn(0x7efcf80d18d0 msgr2=0x7efcf8068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf77fe700 1 --2- 172.21.15.60:0/2873503053 >> v2:172.21.15.144:3300/0 conn(0x7efcf80d18d0 0x7efcf8068cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf77fe700 1 -- 172.21.15.60:0/2873503053 >> v1:172.21.15.144:6789/0 conn(0x7efcf80afe40 legacy=0x7efcf80b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf67fc700 1 -- 172.21.15.60:0/2873503053 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221210250 0 0) 0x7efcf80cb810 con 0x7efcf80afe40 2023-10-08T16:05:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf77fe700 1 -- 172.21.15.60:0/2873503053 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80b0650 con 0x7efcf80afa70 2023-10-08T16:05:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf7fff700 1 --2- 172.21.15.60:0/2873503053 >> v2:172.21.15.144:3300/0 conn(0x7efcf80d18d0 0x7efcf8068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.848+0000 7efcf77fe700 1 --2- 172.21.15.60:0/2873503053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf80cb2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098e0 tx=0x7efcec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c715e3e1c015386 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa405bd0700 1 -- 172.21.15.60:0/642849446 shutdown_connections 2023-10-08T16:05:11.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa6e4e91700 1 -- 172.21.15.60:0/1317593817 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00b860 con 0x7fa6e0063cf0 2023-10-08T16:05:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa6e4e91700 1 -- 172.21.15.60:0/1317593817 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00b9c0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa6e4e91700 1 -- 172.21.15.60:0/1317593817 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00bd60 con 0x7fa6e0063cf0 2023-10-08T16:05:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f539e7fc700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5394004810 0x7f5394004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a77fe700 1 -- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5394004810 msgr2=0x7f5394004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a77fe700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5394004810 0x7f5394004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a77fe700 1 -- 172.21.15.60:0/1900255899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5394003bf0 msgr2=0x7f5394003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a77fe700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5394003bf0 0x7f5394003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a77fe700 1 -- 172.21.15.60:0/1900255899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80b0660 con 0x7f53940051c0 2023-10-08T16:05:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce41f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc0a7da0 0x7f5cdc162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce41f3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0b0420 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce41f3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0b0140 con 0x7f5cdc15e1d0 2023-10-08T16:05:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce41f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b2bf0 con 0x7f5cdc0a7da0 2023-10-08T16:05:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa405bd0700 1 -- 172.21.15.60:0/642849446 wait complete. 2023-10-08T16:05:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7efcf67fc700 1 -- 172.21.15.60:0/2873503053 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00b640 con 0x7efcf80afa70 2023-10-08T16:05:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7efcf67fc700 1 -- 172.21.15.60:0/2873503053 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00b7a0 con 0x7efcf80afa70 2023-10-08T16:05:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7efcf67fc700 1 -- 172.21.15.60:0/2873503053 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00bb60 con 0x7efcf80afa70 2023-10-08T16:05:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce1f8f700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5cdc15e1d0 0x7f5cdc161ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34074/0 (socket says 172.21.15.60:34074) 2023-10-08T16:05:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce1f8f700 1 -- 172.21.15.60:0/2325826350 learned_addr learned my addr 172.21.15.60:0/2325826350 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce178e700 1 --2- 172.21.15.60:0/2325826350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc0a7da0 0x7f5cdc162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa28e4ee700 1 --2- 172.21.15.60:0/3873526415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa288156270 0x7fa288160fd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa280009e60 tx=0x7fa280009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4614f928fd93dfe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa28cceb700 1 -- 172.21.15.60:0/3873526415 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28000e070 con 0x7fa288156270 2023-10-08T16:05:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa28cceb700 1 -- 172.21.15.60:0/3873526415 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28000bb20 con 0x7fa288156270 2023-10-08T16:05:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7fa28cceb700 1 -- 172.21.15.60:0/3873526415 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280012430 con 0x7fa288156270 2023-10-08T16:05:11.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a77fe700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f539400ba60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53a000a9b0 tx=0x7f53a00021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83022326f69d7033 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f5ce178e700 1 -- 172.21.15.60:0/2325826350 >> v1:172.21.15.144:6789/0 conn(0x7f5cdc15e1d0 legacy=0x7f5cdc161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f78d30c6700 1 Processor -- start 2023-10-08T16:05:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.849+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00070d0 con 0x7f53940051c0 2023-10-08T16:05:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a0007230 con 0x7f53940051c0 2023-10-08T16:05:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f53a67fc700 1 -- 172.21.15.60:0/1900255899 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00075f0 con 0x7f53940051c0 2023-10-08T16:05:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 -- 172.21.15.60:0/1317593817 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 msgr2=0x7fa6e006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 --2- 172.21.15.60:0/1317593817 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 0x7fa6e006eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0099b0 tx=0x7fa6dc009250 comp rx=0 tx=0).stop 2023-10-08T16:05:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 -- 172.21.15.60:0/1317593817 shutdown_connections 2023-10-08T16:05:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 --2- 172.21.15.60:0/1317593817 >> v2:172.21.15.60:3300/0 conn(0x7fa6e00a7b20 0x7fa6e00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 --2- 172.21.15.60:0/1317593817 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e0063cf0 0x7fa6e006eab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 -- 172.21.15.60:0/1317593817 >> 172.21.15.60:0/1317593817 conn(0x7fa6e00cd1e0 msgr2=0x7fa6e00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 -- 172.21.15.60:0/2873503053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 msgr2=0x7efcf80cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/2873503053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf80cb2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098e0 tx=0x7efcec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 -- 172.21.15.60:0/1317593817 shutdown_connections 2023-10-08T16:05:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 -- 172.21.15.60:0/2873503053 shutdown_connections 2023-10-08T16:05:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/2873503053 >> v2:172.21.15.144:3300/0 conn(0x7efcf80d18d0 0x7efcf8068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/2873503053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf80cb2d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 -- 172.21.15.60:0/2873503053 >> 172.21.15.60:0/2873503053 conn(0x7efcf8068130 msgr2=0x7efcf80d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa6e80f7700 1 -- 172.21.15.60:0/1317593817 wait complete. 2023-10-08T16:05:11.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 -- 172.21.15.60:0/2873503053 shutdown_connections 2023-10-08T16:05:11.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7efcfdf2d700 1 -- 172.21.15.60:0/2873503053 wait complete. 2023-10-08T16:05:11.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa28ff51700 1 -- 172.21.15.60:0/3873526415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa288156270 msgr2=0x7fa288160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa28ff51700 1 --2- 172.21.15.60:0/3873526415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa288156270 0x7fa288160fd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa280009e60 tx=0x7fa280009780 comp rx=0 tx=0).stop 2023-10-08T16:05:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa28ff51700 1 -- 172.21.15.60:0/3873526415 shutdown_connections 2023-10-08T16:05:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa28ff51700 1 --2- 172.21.15.60:0/3873526415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa288156270 0x7fa288160fd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7fa28ff51700 1 -- 172.21.15.60:0/3873526415 >> 172.21.15.60:0/3873526415 conn(0x7fa288070700 msgr2=0x7fa288070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f53ad366700 1 -- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 msgr2=0x7f539400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f53ad366700 1 --2- 172.21.15.60:0/1900255899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f539400ba60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53a000a9b0 tx=0x7f53a00021e0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f53a77fe700 1 -- 172.21.15.60:0/1900255899 reap_dead start 2023-10-08T16:05:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7fa405bd0700 1 Processor -- start 2023-10-08T16:05:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7fa28ff51700 1 -- 172.21.15.60:0/3873526415 shutdown_connections 2023-10-08T16:05:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7fa405bd0700 1 -- start start 2023-10-08T16:05:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f53ad366700 1 -- 172.21.15.60:0/1900255899 shutdown_connections 2023-10-08T16:05:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f53ad366700 1 -- 172.21.15.60:0/1900255899 >> 172.21.15.60:0/1900255899 conn(0x7f53a8070700 msgr2=0x7f53a8070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f53ad366700 1 -- 172.21.15.60:0/1900255899 shutdown_connections 2023-10-08T16:05:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f53ad366700 1 -- 172.21.15.60:0/1900255899 wait complete. 2023-10-08T16:05:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa28ff51700 1 -- 172.21.15.60:0/3873526415 wait complete. 2023-10-08T16:05:11.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7efcfdf2d700 1 Processor -- start 2023-10-08T16:05:11.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7fa6e80f7700 1 Processor -- start 2023-10-08T16:05:11.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7fa6e80f7700 1 -- start start 2023-10-08T16:05:11.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa405bd0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4000b2e00 0x7fa400150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa405bd0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa40015e2b0 0x7fa400152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa405bd0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40015e680 0x7fa400098bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa405bd0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000aeca0 con 0x7fa40015e680 2023-10-08T16:05:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa405bd0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400098740 con 0x7fa40015e2b0 2023-10-08T16:05:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa405bd0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa400097b30 con 0x7fa4000b2e00 2023-10-08T16:05:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa40015e2b0 0x7fa400152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa40015e2b0 0x7fa400152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56840/0 (socket says 172.21.15.60:56840) 2023-10-08T16:05:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa3feffd700 1 -- 172.21.15.60:0/4272852518 learned_addr learned my addr 172.21.15.60:0/4272852518 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3fffff700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40015e680 0x7fa400098bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3feffd700 1 -- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4000b2e00 msgr2=0x7fa400150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3feffd700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4000b2e00 0x7fa400150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3feffd700 1 -- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40015e680 msgr2=0x7fa400098bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3feffd700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40015e680 0x7fa400098bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3feffd700 1 -- 172.21.15.60:0/4272852518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8009a20 con 0x7fa40015e2b0 2023-10-08T16:05:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa28ff51700 1 Processor -- start 2023-10-08T16:05:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f53ad366700 1 Processor -- start 2023-10-08T16:05:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f53ad366700 1 -- start start 2023-10-08T16:05:11.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f5ce0f8d700 1 -- 172.21.15.60:0/2325826350 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377095264 0 0) 0x7f5cdc0b0140 con 0x7f5cdc15e1d0 2023-10-08T16:05:11.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f5ce178e700 1 -- 172.21.15.60:0/2325826350 >> v1:172.21.15.60:6789/0 conn(0x7f5cdc15e5a0 legacy=0x7f5cdc097bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f5ce178e700 1 -- 172.21.15.60:0/2325826350 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0b2530 con 0x7f5cdc0a7da0 2023-10-08T16:05:11.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f5ce178e700 1 --2- 172.21.15.60:0/2325826350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc0a7da0 0x7f5cdc162600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009910 tx=0x7f5cd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f7bde533c9af14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f5ce0f8d700 1 -- 172.21.15.60:0/2325826350 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800b760 con 0x7f5cdc0a7da0 2023-10-08T16:05:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f5ce0f8d700 1 -- 172.21.15.60:0/2325826350 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800b8c0 con 0x7f5cdc0a7da0 2023-10-08T16:05:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.851+0000 7f5ce0f8d700 1 -- 172.21.15.60:0/2325826350 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800bc60 con 0x7f5cdc0a7da0 2023-10-08T16:05:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f5ce41f3700 1 -- 172.21.15.60:0/2325826350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc0a7da0 msgr2=0x7f5cdc162600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f5ce41f3700 1 --2- 172.21.15.60:0/2325826350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc0a7da0 0x7f5cdc162600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009910 tx=0x7f5cd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa28ff51700 1 -- start start 2023-10-08T16:05:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa3feffd700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa40015e2b0 0x7fa400152bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c7c0 tx=0x7fa3f0007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7efcfdf2d700 1 -- start start 2023-10-08T16:05:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7efcfdf2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf8172580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7efcfdf2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf80d18d0 0x7efcf80b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7efcfdf2d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf816e4c0 0x7efcf80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7efcfdf2d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8172ac0 con 0x7efcf80d18d0 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7efcfdf2d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80b6760 con 0x7efcf816e4c0 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7efcfdf2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf815c620 con 0x7efcf80afa70 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf8172580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf816e4c0 0x7efcf80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf816e4c0 0x7efcf80b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56860/0 (socket says 172.21.15.60:56860) 2023-10-08T16:05:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 -- 172.21.15.60:0/3530339343 learned_addr learned my addr 172.21.15.60:0/3530339343 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf6ffd700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf80d18d0 0x7efcf80b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa6e80f7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0063cf0 0x7fa6e0140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7fa6e80f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006eff0 0x7fa6e0143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e80f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6e00a7b20 0x7fa6e0143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e80f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0150f30 con 0x7fa6e00a7b20 2023-10-08T16:05:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e80f7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0141460 con 0x7fa6e0063cf0 2023-10-08T16:05:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e80f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0141740 con 0x7fa6e006eff0 2023-10-08T16:05:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0063cf0 0x7fa6e0140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0063cf0 0x7fa6e0140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56848/0 (socket says 172.21.15.60:56848) 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 -- 172.21.15.60:0/606425365 learned_addr learned my addr 172.21.15.60:0/606425365 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 -- 172.21.15.60:0/606425365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006eff0 msgr2=0x7fa6e0143620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006eff0 0x7fa6e0143620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 -- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6e00a7b20 msgr2=0x7fa6e0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6e00a7b20 0x7fa6e0143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7fa6e5e93700 1 -- 172.21.15.60:0/606425365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0094f0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa6e5e93700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0063cf0 0x7fa6e0140a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000d890 tx=0x7fa6d0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000b600 con 0x7fa6e0063cf0 2023-10-08T16:05:11.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d000b760 con 0x7fa6e0063cf0 2023-10-08T16:05:11.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000bae0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.850+0000 7f78d30c6700 1 -- start start 2023-10-08T16:05:11.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d30c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78cc153b50 0x7f78cc0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d30c6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78cc069d00 0x7f78cc06a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d30c6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc069870 con 0x7f78cc156ea0 2023-10-08T16:05:11.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d30c6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0c8610 con 0x7f78cc069d00 2023-10-08T16:05:11.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d30c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0c7d70 con 0x7f78cc153b50 2023-10-08T16:05:11.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d1663700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78cc069d00 0x7f78cc06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d1663700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78cc069d00 0x7f78cc06a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40338/0 (socket says 172.21.15.60:40338) 2023-10-08T16:05:11.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.852+0000 7f78d1663700 1 -- 172.21.15.60:0/2601850434 learned_addr learned my addr 172.21.15.60:0/2601850434 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995280448 0 0) 0x7f78cc069870 con 0x7f78cc156ea0 2023-10-08T16:05:11.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b4003570 con 0x7f78cc156ea0 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930101060 0 0) 0x7f78b4003570 con 0x7f78cc156ea0 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78cc153b50 msgr2=0x7f78cc0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78cc153b50 0x7f78cc0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 >> v2:172.21.15.60:3300/0 conn(0x7f78cc069d00 msgr2=0x7f78cc06a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 --2- 172.21.15.60:0/2601850434 >> v2:172.21.15.60:3300/0 conn(0x7f78cc069d00 0x7f78cc06a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0c8050 con 0x7f78cc156ea0 2023-10-08T16:05:11.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f78bc001470 con 0x7f78cc156ea0 2023-10-08T16:05:11.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 >> v1:172.21.15.60:6789/0 conn(0x7f78cc156ea0 legacy=0x7f78cc0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4003ae0 0x7f78b4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78b4004810 0x7f78b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4005230 0x7f78b402da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0c8610 con 0x7f78b4003ae0 2023-10-08T16:05:11.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0c7d70 con 0x7f78b4005230 2023-10-08T16:05:11.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.853+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b402e270 con 0x7f78b4004810 2023-10-08T16:05:11.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78cbfff700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78b4004810 0x7f78b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78d1663700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4005230 0x7f78b402da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78d0e62700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4003ae0 0x7f78b4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f53ad366700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f53a8164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 -- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 msgr2=0x7efcf8172580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcf80afa70 0x7efcf8172580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 -- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf80d18d0 msgr2=0x7efcf80b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf80d18d0 0x7efcf80b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7efcf7fff700 1 -- 172.21.15.60:0/3530339343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009a20 con 0x7efcf816e4c0 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f53ad366700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80c6550 0x7f53a80c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f53ad366700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a80c3920 0x7f53a80c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f53ad366700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8162980 con 0x7f53a80c3920 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f53ad366700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8162c60 con 0x7f53940051c0 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f53ad366700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8162f40 con 0x7f53a80c6550 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78cbfff700 1 -- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4005230 msgr2=0x7f78b402da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78cbfff700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b4005230 0x7f78b402da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78cbfff700 1 -- 172.21.15.60:0/2601850434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4003ae0 msgr2=0x7f78b4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78cbfff700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4003ae0 0x7f78b4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7f78cbfff700 1 -- 172.21.15.60:0/2601850434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0c8050 con 0x7f78b4004810 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa28ff51700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa28806d2e0 0x7fa28814ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa28ff51700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2880c75c0 0x7fa2880afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa28ff51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa288156270 0x7fa2880b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa28ff51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880c2d00 con 0x7fa288156270 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa28ff51700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880c2130 con 0x7fa2880c75c0 2023-10-08T16:05:11.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa28ff51700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880c23d0 con 0x7fa28806d2e0 2023-10-08T16:05:11.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7efcf7fff700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf816e4c0 0x7efcf80b5330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009f20 tx=0x7efcf000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e0141a20 con 0x7fa6e0063cf0 2023-10-08T16:05:11.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.854+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0005b30 con 0x7fa40015e2b0 2023-10-08T16:05:11.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0005c90 con 0x7fa40015e2b0 2023-10-08T16:05:11.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0004a80 con 0x7fa40015e2b0 2023-10-08T16:05:11.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28e4ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa288156270 0x7fa2880b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f78cbfff700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78b4004810 0x7f78b4004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f78bc007c70 tx=0x7f78bc0078c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af847a2f06d41fd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28e4ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa288156270 0x7fa2880b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40392/0 (socket says 172.21.15.60:40392) 2023-10-08T16:05:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28e4ee700 1 -- 172.21.15.60:0/1176412450 learned_addr learned my addr 172.21.15.60:0/1176412450 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28dced700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa28806d2e0 0x7fa28814ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e0141fe0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa400097e10 con 0x7fa40015e2b0 2023-10-08T16:05:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4000983d0 con 0x7fa40015e2b0 2023-10-08T16:05:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0102e0 con 0x7f78b4004810 2023-10-08T16:05:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000cb70 con 0x7efcf816e4c0 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf000f040 con 0x7efcf816e4c0 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec009420 con 0x7efcf816e4c0 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf816f0d0 con 0x7efcf816e4c0 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f53a6ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f53a8164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f539e7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80c6550 0x7f53a80c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f539e7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80c6550 0x7f53a80c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50954/0 (socket says 172.21.15.60:50954) 2023-10-08T16:05:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f539e7fc700 1 -- 172.21.15.60:0/3280646922 learned_addr learned my addr 172.21.15.60:0/3280646922 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28dced700 1 -- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2880c75c0 msgr2=0x7fa2880afc10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28dced700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2880c75c0 0x7fa2880afc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28dced700 1 -- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa288156270 msgr2=0x7fa2880b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28dced700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa288156270 0x7fa2880b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7fa28dced700 1 -- 172.21.15.60:0/1176412450 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280009a20 con 0x7fa28806d2e0 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7fa28dced700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa28806d2e0 0x7fa28814ac70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c490 tx=0x7fa284007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3e0000fd0 con 0x7fa40015e2b0 2023-10-08T16:05:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f5ce41f3700 1 -- 172.21.15.60:0/2325826350 shutdown_connections 2023-10-08T16:05:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f5ce41f3700 1 --2- 172.21.15.60:0/2325826350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc0a7da0 0x7f5cdc162600 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f5ce41f3700 1 -- 172.21.15.60:0/2325826350 >> 172.21.15.60:0/2325826350 conn(0x7f5cdc0cd1e0 msgr2=0x7f5cdc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f53a77fe700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a80c3920 0x7f53a80c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f539e7fc700 1 -- 172.21.15.60:0/3280646922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 msgr2=0x7f53a8164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f539e7fc700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53940051c0 0x7f53a8164e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f539e7fc700 1 -- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a80c3920 msgr2=0x7f53a80c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f539e7fc700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a80c3920 0x7f53a80c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f539e7fc700 1 -- 172.21.15.60:0/3280646922 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a8163220 con 0x7f53a80c6550 2023-10-08T16:05:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f5ce41f3700 1 -- 172.21.15.60:0/2325826350 shutdown_connections 2023-10-08T16:05:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f5ce41f3700 1 -- 172.21.15.60:0/2325826350 wait complete. 2023-10-08T16:05:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f539e7fc700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80c6550 0x7f53a80c5a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f539800f660 tx=0x7f5398008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6e004c3c0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc00cb70 con 0x7f78b4004810 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.855+0000 7f78cb7fe700 1 -- 172.21.15.60:0/2601850434 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc014880 con 0x7f78b4004810 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f78d30c6700 1 -- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78b4004810 msgr2=0x7f78b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f78d30c6700 1 --2- 172.21.15.60:0/2601850434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78b4004810 0x7f78b4004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f78bc007c70 tx=0x7f78bc0078c0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f78d1663700 1 -- 172.21.15.60:0/2601850434 reap_dead start 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f78d30c6700 1 -- 172.21.15.60:0/2601850434 shutdown_connections 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7f78d30c6700 1 -- 172.21.15.60:0/2601850434 >> 172.21.15.60:0/2601850434 conn(0x7f78cc067660 msgr2=0x7f78cc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3f00070f0 con 0x7fa40015e2b0 2023-10-08T16:05:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398014670 con 0x7f53a80c6550 2023-10-08T16:05:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980147d0 con 0x7f53a80c6550 2023-10-08T16:05:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398014b50 con 0x7f53a80c6550 2023-10-08T16:05:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa3e77fe700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa3ec067000 0x7fa3ec0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3f00836d0 con 0x7fa40015e2b0 2023-10-08T16:05:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.856+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0014480 con 0x7efcf816e4c0 2023-10-08T16:05:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcf0003020 con 0x7efcf816e4c0 2023-10-08T16:05:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7efcdf7fe700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efce4066f30 0x7efce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcf0084d90 con 0x7efcf816e4c0 2023-10-08T16:05:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7fa3e77fe700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7fa3ec06f210 0x7fa3ec071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 --> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3ec071cd0 con 0x7fa3ec06f210 2023-10-08T16:05:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7fa3ff7fe700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa3ec067000 0x7fa3ec0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3f0085d60 con 0x7fa40015e2b0 2023-10-08T16:05:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7efcf77fe700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efce4066f30 0x7efce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7f5ce41f3700 1 Processor -- start 2023-10-08T16:05:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7f78d30c6700 1 -- 172.21.15.60:0/2601850434 shutdown_connections 2023-10-08T16:05:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284011590 con 0x7fa28806d2e0 2023-10-08T16:05:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284011710 con 0x7fa28806d2e0 2023-10-08T16:05:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284011ad0 con 0x7fa28806d2e0 2023-10-08T16:05:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2880c26b0 con 0x7fa28806d2e0 2023-10-08T16:05:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.857+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28814b1b0 con 0x7fa28806d2e0 2023-10-08T16:05:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7efcd80015f0 0x7efcd8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 --> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcd8006b90 con 0x7efcd80015f0 2023-10-08T16:05:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7efcf77fe700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efce4066f30 0x7efce40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcec0093f0 tx=0x7efcec017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7efcf6ffd700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7efcd80015f0 0x7efcd8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.858+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6d001e460 con 0x7fa6e0063cf0 2023-10-08T16:05:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7f78d30c6700 1 -- 172.21.15.60:0/2601850434 wait complete. 2023-10-08T16:05:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa268000fd0 con 0x7fa28806d2e0 2023-10-08T16:05:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a8163500 con 0x7f53a80c6550 2023-10-08T16:05:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a80c5f70 con 0x7f53a80c6550 2023-10-08T16:05:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7efcf6ffd700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7efcd80015f0 0x7efcd8003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7f5ce41f3700 1 -- start start 2023-10-08T16:05:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa3fffff700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7fa3ec06f210 0x7fa3ec071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa6d5ffb700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6c4067080 0x7fa6c4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6d00856a0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa6d5ffb700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7fa6c406f290 0x7fa6c40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 --> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6c4071d50 con 0x7fa6c406f290 2023-10-08T16:05:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6d00859d0 con 0x7fa6e0063cf0 2023-10-08T16:05:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7fa3ff7fe700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa3ec067000 0x7fa3ec0694b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40097c0 tx=0x7fa3f4006ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7fa6e6694700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7fa6c406f290 0x7fa6c40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53a804c3c0 con 0x7f53a80c6550 2023-10-08T16:05:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7f96cc5f7700 1 Processor -- start 2023-10-08T16:05:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.859+0000 7f96cc5f7700 1 -- start start 2023-10-08T16:05:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== osd.6 v2:172.21.15.144:6805/86601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7efcd8006b90 con 0x7efcd80015f0 2023-10-08T16:05:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa28401b3b0 con 0x7fa28806d2e0 2023-10-08T16:05:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7fa6e6694700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7fa6c406f290 0x7fa6c40716a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f78d30c6700 1 Processor -- start 2023-10-08T16:05:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7fa279ffb700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa26c067000 0x7fa26c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa284083f80 con 0x7fa28806d2e0 2023-10-08T16:05:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f5ce41f3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0a7da0 0x7f5cdc1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f5ce41f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cdc15e1d0 0x7f5cdc0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f5ce41f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc15e5a0 0x7f5cdc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f5ce41f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0af970 con 0x7f5cdc15e1d0 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f5ce41f3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15fa80 con 0x7f5cdc0a7da0 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.860+0000 7f5ce41f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15ee70 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa279ffb700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7fa26c06f210 0x7fa26c071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa28d4ec700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa26c067000 0x7fa26c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 --> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa26c071cd0 con 0x7fa26c06f210 2023-10-08T16:05:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa284084350 con 0x7fa28806d2e0 2023-10-08T16:05:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa6e5692700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6c4067080 0x7fa6c4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f5ce2790700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc15e5a0 0x7f5cdc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f5ce2790700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc15e5a0 0x7f5cdc06eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50968/0 (socket says 172.21.15.60:50968) 2023-10-08T16:05:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f5ce2790700 1 -- 172.21.15.60:0/536419037 learned_addr learned my addr 172.21.15.60:0/536419037 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa3fffff700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7fa3ec06f210 0x7fa3ec071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa28e4ee700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7fa26c06f210 0x7fa26c071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f539801d400 con 0x7f53a80c6550 2023-10-08T16:05:11.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f5ce1f8f700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0a7da0 0x7f5cdc1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== osd.0 v2:172.21.15.60:6808/86354 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fa6c4071d50 con 0x7fa6c406f290 2023-10-08T16:05:11.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7fa6e5692700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6c4067080 0x7fa6c4069530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0099b0 tx=0x7fa6dc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96cc5f7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f96c40bf970 0x7f96c40bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96cc5f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40ac730 0x7f96c40ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96cc5f7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40acd50 con 0x7f96c40cc880 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96cc5f7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c415ec10 con 0x7f96c40bf970 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96cc5f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40acb70 con 0x7f96c40ac730 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96c9b92700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f96c40cc880 0x7f96c40ac020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34078/0 (socket says 172.21.15.60:34078) 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96cab94700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40ac730 0x7f96c40ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f96c9b92700 1 -- 172.21.15.60:0/392608877 learned_addr learned my addr 172.21.15.60:0/392608877 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96c9391700 1 -- 172.21.15.60:0/392608877 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167167142 0 0) 0x7f96c40acd50 con 0x7f96c40cc880 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96c9391700 1 -- 172.21.15.60:0/392608877 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b0003570 con 0x7f96c40cc880 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce2790700 1 -- 172.21.15.60:0/536419037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0a7da0 msgr2=0x7f5cdc1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce2790700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cdc0a7da0 0x7f5cdc1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce2790700 1 -- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cdc15e1d0 msgr2=0x7f5cdc0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce2790700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cdc15e1d0 0x7f5cdc0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce2790700 1 -- 172.21.15.60:0/536419037 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009420 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7fa28d4ec700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa26c067000 0x7fa26c0694b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0058d0 tx=0x7fa27c007ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96cab94700 1 -- 172.21.15.60:0/392608877 >> v2:172.21.15.60:3300/0 conn(0x7f96c40bf970 msgr2=0x7f96c40bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96cab94700 1 --2- 172.21.15.60:0/392608877 >> v2:172.21.15.60:3300/0 conn(0x7f96c40bf970 0x7f96c40bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96cab94700 1 -- 172.21.15.60:0/392608877 >> v1:172.21.15.144:6789/0 conn(0x7f96c40cc880 legacy=0x7f96c40ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96cab94700 1 -- 172.21.15.60:0/392608877 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40ad030 con 0x7f96c40ac730 2023-10-08T16:05:11.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7fa28e4ee700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7fa26c06f210 0x7fa26c071620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f539f7fe700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5388067080 0x7f5388069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce2790700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc15e5a0 0x7f5cdc06eaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400c960 tx=0x7f5cd4001740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96cab94700 1 --2- 172.21.15.60:0/392608877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40ac730 0x7f96c40ccd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009e60 tx=0x7f96bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8188958d5604b22b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5398085130 con 0x7f53a80c6550 2023-10-08T16:05:11.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== osd.4 v2:172.21.15.144:6803/86599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fa3ec071cd0 con 0x7fa3ec06f210 2023-10-08T16:05:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4012630 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd4012790 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f539f7fe700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f538806f290 0x7f53880716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 --> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5388071d50 con 0x7f538806f290 2023-10-08T16:05:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5398085460 con 0x7f53a80c6550 2023-10-08T16:05:11.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc15f150 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4012b50 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc15f710 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.861+0000 7f78d30c6700 1 -- start start 2023-10-08T16:05:11.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f78d30c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4004810 0x7f78cc0c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f78d30c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78cc0c0920 0x7f78cc14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f78d30c6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78cc14f0a0 0x7f78cc14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f78d30c6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0c28e0 con 0x7f78b4004810 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f78d30c6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0c3700 con 0x7f78cc14f0a0 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f78d30c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc14fa30 con 0x7f78cc0c0920 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4004810 0x7f78cc0c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4004810 0x7f78cc0c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40430/0 (socket says 172.21.15.60:40430) 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 -- 172.21.15.60:0/4144222132 learned_addr learned my addr 172.21.15.60:0/4144222132 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f53a77fe700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f538806f290 0x7f53880716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 -- 172.21.15.60:0/4144222132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78cc0c0920 msgr2=0x7f78cc14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78cc0c0920 0x7f78cc14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 -- 172.21.15.60:0/4144222132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78cc14f0a0 msgr2=0x7f78cc14f4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:05:11.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78cc14f0a0 0x7f78cc14f4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f78d0e62700 1 -- 172.21.15.60:0/4144222132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0c2af0 con 0x7f78b4004810 2023-10-08T16:05:11.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== osd.5 v2:172.21.15.144:6800/86600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fa26c071cd0 con 0x7fa26c06f210 2023-10-08T16:05:11.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f53a6ffd700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5388067080 0x7f5388069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f53a77fe700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f538806f290 0x7f53880716a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f53a6ffd700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5388067080 0x7f5388069530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5390001b10 tx=0x7f5390009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== osd.1 v2:172.21.15.60:6809/86353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5388071d50 con 0x7f538806f290 2023-10-08T16:05:11.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cdc04c3c0 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cd4003030 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f78d0e62700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4004810 0x7f78cc0c23a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b440 tx=0x7f78c40098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4013520 con 0x7f78b4004810 2023-10-08T16:05:11.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4013680 con 0x7f78b4004810 2023-10-08T16:05:11.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4013a40 con 0x7f78b4004810 2023-10-08T16:05:11.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc0c2dd0 con 0x7f78b4004810 2023-10-08T16:05:11.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc0c3410 con 0x7f78b4004810 2023-10-08T16:05:11.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f5cd1ffb700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5cc0067000 0x7f5cc00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.865+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5cd40845e0 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f5cd1ffb700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7f5cc006f210 0x7f5cc0071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 --> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc0071cd0 con 0x7f5cc006f210 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cd4086b40 con 0x7f5cdc15e5a0 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f5ce1f8f700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5cc0067000 0x7f5cc00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f5ce1f8f700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5cc0067000 0x7f5cc00694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc007110 tx=0x7f5ccc0011e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f5ce178e700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7f5cc006f210 0x7f5cc0071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78cc0c3b90 con 0x7f78b4004810 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f5ce178e700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7f5cc006f210 0x7f5cc0071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78c4028430 con 0x7f78b4004810 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f78c8ff9700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78b8067080 0x7f78b8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78c4085f50 con 0x7f78b4004810 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f78c8ff9700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f78b806f290 0x7f78b80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 --> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78b8071d50 con 0x7f78b806f290 2023-10-08T16:05:11.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c4086280 con 0x7f78b4004810 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.870+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== osd.2 v2:172.21.15.60:6800/86352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5cc0071cd0 con 0x7f5cc006f210 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96c9391700 1 -- 172.21.15.60:0/392608877 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00e070 con 0x7f96c40ac730 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96c9391700 1 -- 172.21.15.60:0/392608877 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00b8e0 con 0x7f96c40ac730 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.862+0000 7f96c9391700 1 -- 172.21.15.60:0/392608877 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4001470 con 0x7f96c40ac730 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f96cc5f7700 1 -- 172.21.15.60:0/392608877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40ac730 msgr2=0x7f96c40ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.863+0000 7f96cc5f7700 1 --2- 172.21.15.60:0/392608877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40ac730 0x7f96c40ccd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009e60 tx=0x7f96bc009780 comp rx=0 tx=0).stop 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f96cc5f7700 1 -- 172.21.15.60:0/392608877 shutdown_connections 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f96cc5f7700 1 --2- 172.21.15.60:0/392608877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40ac730 0x7f96c40ccd00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f96cc5f7700 1 --2- 172.21.15.60:0/392608877 >> v2:172.21.15.60:3300/0 conn(0x7f96c40bf970 0x7f96c40bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f96cc5f7700 1 -- 172.21.15.60:0/392608877 >> 172.21.15.60:0/392608877 conn(0x7f96c4070700 msgr2=0x7f96c4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f96cc5f7700 1 -- 172.21.15.60:0/392608877 shutdown_connections 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.864+0000 7f96cc5f7700 1 -- 172.21.15.60:0/392608877 wait complete. 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.866+0000 7f96cc5f7700 1 Processor -- start 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.867+0000 7f96cc5f7700 1 -- start start 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96cc5f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c40ac730 0x7f96c40bbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96cc5f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40bf970 0x7f96c417f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96cc5f7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c40cc880 0x7f96c4179170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96cc5f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4088b90 con 0x7f96c40ac730 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96cc5f7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c417f940 con 0x7f96c40cc880 2023-10-08T16:05:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96cc5f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c417fc20 con 0x7f96c40bf970 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96ca393700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c40ac730 0x7f96c40bbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96ca393700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c40ac730 0x7f96c40bbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40442/0 (socket says 172.21.15.60:40442) 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96ca393700 1 -- 172.21.15.60:0/2677074270 learned_addr learned my addr 172.21.15.60:0/2677074270 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.868+0000 7f96c9b92700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40bf970 0x7f96c417f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f96ca393700 1 -- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40bf970 msgr2=0x7f96c417f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f96ca393700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c40bf970 0x7f96c417f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f96ca393700 1 -- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c40cc880 msgr2=0x7f96c4179170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f96ca393700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c40cc880 0x7f96c4179170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f96ca393700 1 -- 172.21.15.60:0/2677074270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009a20 con 0x7f96c40ac730 2023-10-08T16:05:11.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.869+0000 7f96ca393700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c40ac730 0x7f96c40bbe70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009f50 tx=0x7f96c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.871+0000 7f78d1663700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f78b806f290 0x7f78b80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.871+0000 7f78d1663700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f78b806f290 0x7f78b80716a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.872+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== osd.3 v2:172.21.15.60:6823/86357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f78b8071d50 con 0x7f78b806f290 2023-10-08T16:05:11.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.873+0000 7f78cbfff700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78b8067080 0x7f78b8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.879+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0053600 con 0x7f96c40ac730 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.879+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0053760 con 0x7f96c40ac730 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.879+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0053b20 con 0x7f96c40ac730 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.883+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 --> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6e0098770 con 0x7fa6c406f290 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.883+0000 7fa6d5ffb700 1 -- 172.21.15.60:0/606425365 <== osd.0 v2:172.21.15.60:6808/86354 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6e0098770 con 0x7fa6c406f290 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.887+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7fa6c406f290 msgr2=0x7fa6c40716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.887+0000 7fa6e80f7700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7fa6c406f290 0x7fa6c40716a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.881+0000 7f78cbfff700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78b8067080 0x7f78b8069530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c00 tx=0x7f78bc01b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.880+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c417ff00 con 0x7f96c40ac730 2023-10-08T16:05:11.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.880+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40bd8d0 con 0x7f96c40ac730 2023-10-08T16:05:11.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.881+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96c40bd730 con 0x7f96c40ac730 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.887+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96c005c400 con 0x7f96c40ac730 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.887+0000 7f96ba7fc700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96a8067080 0x7f96a8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.887+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96c00c8aa0 con 0x7f96c40ac730 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7f96c9b92700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96a8067080 0x7f96a8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7f96ba7fc700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f96a806f290 0x7f96a80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 --> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96a8071d50 con 0x7f96a806f290 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96c00c8dd0 con 0x7f96c40ac730 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7f96cab94700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f96a806f290 0x7f96a80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7f96c9b92700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96a8067080 0x7f96a8069530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96b40011e0 tx=0x7f96b4001950 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 --> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcd8005c80 con 0x7efcd80015f0 2023-10-08T16:05:11.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 --> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3e0002d30 con 0x7fa3ec06f210 2023-10-08T16:05:11.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6c4067080 msgr2=0x7fa6c4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7fa6e80f7700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6c4067080 0x7fa6c4069530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0099b0 tx=0x7fa6dc017000 comp rx=0 tx=0).stop 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0063cf0 msgr2=0x7fa6e0140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.888+0000 7fa6e80f7700 1 --2- 172.21.15.60:0/606425365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0063cf0 0x7fa6e0140a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000d890 tx=0x7fa6d0008040 comp rx=0 tx=0).stop 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7fa6e6694700 1 -- 172.21.15.60:0/606425365 reap_dead start 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 shutdown_connections 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 >> 172.21.15.60:0/606425365 conn(0x7fa6e00cd1e0 msgr2=0x7fa6e006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 shutdown_connections 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7fa6e80f7700 1 -- 172.21.15.60:0/606425365 wait complete. 2023-10-08T16:05:11.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7fa3e77fe700 1 -- 172.21.15.60:0/4272852518 <== osd.4 v2:172.21.15.144:6803/86599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3e0002d30 con 0x7fa3ec06f210 2023-10-08T16:05:11.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7f96cab94700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f96a806f290 0x7f96a80716a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:11.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.889+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== osd.7 v2:172.21.15.144:6801/86602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f96a8071d50 con 0x7f96a806f290 2023-10-08T16:05:11.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.891+0000 7efcdf7fe700 1 -- 172.21.15.60:0/3530339343 <== osd.6 v2:172.21.15.144:6805/86601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efcd8005c80 con 0x7efcd80015f0 2023-10-08T16:05:11.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.892+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 --> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53a8163080 con 0x7f538806f290 2023-10-08T16:05:11.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f539f7fe700 1 -- 172.21.15.60:0/3280646922 <== osd.1 v2:172.21.15.60:6809/86353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53a8163080 con 0x7f538806f290 2023-10-08T16:05:11.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f538806f290 msgr2=0x7f53880716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f538806f290 0x7f53880716a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5388067080 msgr2=0x7f5388069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5388067080 0x7f5388069530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5390001b10 tx=0x7f5390009040 comp rx=0 tx=0).stop 2023-10-08T16:05:11.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80c6550 msgr2=0x7f53a80c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 --2- 172.21.15.60:0/3280646922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a80c6550 0x7f53a80c5a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f539800f660 tx=0x7f5398008040 comp rx=0 tx=0).stop 2023-10-08T16:05:11.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 --> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa268002d30 con 0x7fa26c06f210 2023-10-08T16:05:11.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53a77fe700 1 -- 172.21.15.60:0/3280646922 reap_dead start 2023-10-08T16:05:11.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 shutdown_connections 2023-10-08T16:05:11.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.893+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 >> 172.21.15.60:0/3280646922 conn(0x7f53a8070700 msgr2=0x7f53a80c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.894+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 shutdown_connections 2023-10-08T16:05:11.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.894+0000 7f53ad366700 1 -- 172.21.15.60:0/3280646922 wait complete. 2023-10-08T16:05:11.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7efcd80015f0 msgr2=0x7efcd8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7efcd80015f0 0x7efcd8003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efce4066f30 msgr2=0x7efce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efce4066f30 0x7efce40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcec0093f0 tx=0x7efcec017000 comp rx=0 tx=0).stop 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf816e4c0 msgr2=0x7efcf80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcfdf2d700 1 --2- 172.21.15.60:0/3530339343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcf816e4c0 0x7efcf80b5330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009f20 tx=0x7efcf000b040 comp rx=0 tx=0).stop 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.895+0000 7efcf7fff700 1 -- 172.21.15.60:0/3530339343 reap_dead start 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.896+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 --> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78cc0c2f60 con 0x7f78b806f290 2023-10-08T16:05:11.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.896+0000 7f78c8ff9700 1 -- 172.21.15.60:0/4144222132 <== osd.3 v2:172.21.15.60:6823/86357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f78cc0c2f60 con 0x7f78b806f290 2023-10-08T16:05:11.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 --> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cdc0b2810 con 0x7f5cc006f210 2023-10-08T16:05:11.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 shutdown_connections 2023-10-08T16:05:11.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 >> 172.21.15.60:0/3530339343 conn(0x7efcf8068130 msgr2=0x7efcf8154250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 shutdown_connections 2023-10-08T16:05:11.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7efcfdf2d700 1 -- 172.21.15.60:0/3530339343 wait complete. 2023-10-08T16:05:11.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7f5cd1ffb700 1 -- 172.21.15.60:0/536419037 <== osd.2 v2:172.21.15.60:6800/86352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5cdc0b2810 con 0x7f5cc006f210 2023-10-08T16:05:11.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7fa279ffb700 1 -- 172.21.15.60:0/1176412450 <== osd.5 v2:172.21.15.144:6800/86600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa268002d30 con 0x7fa26c06f210 2023-10-08T16:05:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7f5cc006f210 msgr2=0x7f5cc0071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.897+0000 7f5ce41f3700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7f5cc006f210 0x7f5cc0071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f78b806f290 msgr2=0x7f78b80716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f78b806f290 0x7f78b80716a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5cc0067000 msgr2=0x7f5cc00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f5ce41f3700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5cc0067000 0x7f5cc00694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc007110 tx=0x7f5ccc0011e0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc15e5a0 msgr2=0x7f5cdc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f5ce41f3700 1 --2- 172.21.15.60:0/536419037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5cdc15e5a0 0x7f5cdc06eaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400c960 tx=0x7f5cd4001740 comp rx=0 tx=0).stop 2023-10-08T16:05:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f5ce2790700 1 -- 172.21.15.60:0/536419037 reap_dead start 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78b8067080 msgr2=0x7f78b8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78b8067080 0x7f78b8069530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c00 tx=0x7f78bc01b000 comp rx=0 tx=0).stop 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4004810 msgr2=0x7f78cc0c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 --2- 172.21.15.60:0/4144222132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78b4004810 0x7f78cc0c23a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b440 tx=0x7f78c40098b0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d1663700 1 -- 172.21.15.60:0/4144222132 reap_dead start 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 shutdown_connections 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 >> 172.21.15.60:0/4144222132 conn(0x7f78cc067660 msgr2=0x7f78cc154390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 shutdown_connections 2023-10-08T16:05:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.898+0000 7f78d30c6700 1 -- 172.21.15.60:0/4144222132 wait complete. 2023-10-08T16:05:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7fa3ec06f210 msgr2=0x7fa3ec071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7fa3ec06f210 0x7fa3ec071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa3ec067000 msgr2=0x7fa3ec0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa3ec067000 0x7fa3ec0694b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40097c0 tx=0x7fa3f4006ce0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa40015e2b0 msgr2=0x7fa400152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 --2- 172.21.15.60:0/4272852518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa40015e2b0 0x7fa400152bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c7c0 tx=0x7fa3f0007f70 comp rx=0 tx=0).stop 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa3fffff700 1 -- 172.21.15.60:0/4272852518 reap_dead start 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 shutdown_connections 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.900+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 >> 172.21.15.60:0/4272852518 conn(0x7fa4000cd1e0 msgr2=0x7fa400069860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.901+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 shutdown_connections 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.901+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 >> 172.21.15.60:0/536419037 conn(0x7f5cdc0cd1e0 msgr2=0x7f5cdc097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 shutdown_connections 2023-10-08T16:05:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7f5ce41f3700 1 -- 172.21.15.60:0/536419037 wait complete. 2023-10-08T16:05:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 shutdown_connections 2023-10-08T16:05:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa405bd0700 1 -- 172.21.15.60:0/4272852518 wait complete. 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7fa26c06f210 msgr2=0x7fa26c071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa28ff51700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7fa26c06f210 0x7fa26c071620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa26c067000 msgr2=0x7fa26c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa28ff51700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa26c067000 0x7fa26c0694b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0058d0 tx=0x7fa27c007ac0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa28806d2e0 msgr2=0x7fa28814ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.906+0000 7fa28ff51700 1 --2- 172.21.15.60:0/1176412450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa28806d2e0 0x7fa28814ac70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c490 tx=0x7fa284007ea0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7fa28e4ee700 1 -- 172.21.15.60:0/1176412450 reap_dead start 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 shutdown_connections 2023-10-08T16:05:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 >> 172.21.15.60:0/1176412450 conn(0x7fa288070700 msgr2=0x7fa2880cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 --> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96c404c3c0 con 0x7f96a806f290 2023-10-08T16:05:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 shutdown_connections 2023-10-08T16:05:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7fa28ff51700 1 -- 172.21.15.60:0/1176412450 wait complete. 2023-10-08T16:05:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.907+0000 7f96ba7fc700 1 -- 172.21.15.60:0/2677074270 <== osd.7 v2:172.21.15.144:6801/86602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96c404c3c0 con 0x7f96a806f290 2023-10-08T16:05:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f96a806f290 msgr2=0x7f96a80716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f96a806f290 0x7f96a80716a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96a8067080 msgr2=0x7f96a8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96a8067080 0x7f96a8069530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96b40011e0 tx=0x7f96b4001950 comp rx=0 tx=0).stop 2023-10-08T16:05:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c40ac730 msgr2=0x7f96c40bbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 --2- 172.21.15.60:0/2677074270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c40ac730 0x7f96c40bbe70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009f50 tx=0x7f96c0009250 comp rx=0 tx=0).stop 2023-10-08T16:05:11.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cab94700 1 -- 172.21.15.60:0/2677074270 reap_dead start 2023-10-08T16:05:11.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 shutdown_connections 2023-10-08T16:05:11.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.908+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 >> 172.21.15.60:0/2677074270 conn(0x7f96c4070700 msgr2=0x7f96c40cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:11.966 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:05:11.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.916+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 shutdown_connections 2023-10-08T16:05:11.968 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:05:11.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:11.918+0000 7f96cc5f7700 1 -- 172.21.15.60:0/2677074270 wait complete. 2023-10-08T16:05:11.969 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:05:11.970 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:05:11.974 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:05:11.975 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:05:11.976 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:05:11.977 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:11.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:05:12.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.199+0000 7f4828b6b700 1 Processor -- start 2023-10-08T16:05:12.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.199+0000 7f4828b6b700 1 -- start start 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4828b6b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48240bf970 0x7f48240bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4828b6b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48240cc880 0x7f48240ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4828b6b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48240acb20 con 0x7f48240ac020 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4828b6b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482415ec10 con 0x7f48240cc880 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4828b6b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240cd240 con 0x7f48240bf970 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4822d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f48240ac020 0x7f48240ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43812/0 (socket says 172.21.15.60:43812) 2023-10-08T16:05:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4822d9d700 1 -- 172.21.15.60:0/1424431959 learned_addr learned my addr 172.21.15.60:0/1424431959 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.201+0000 7f4821d9b700 1 --2- 172.21.15.60:0/1424431959 >> v2:172.21.15.60:3300/0 conn(0x7f48240cc880 0x7f48240ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.202+0000 7f482259c700 1 --2- 172.21.15.60:0/1424431959 >> v2:172.21.15.144:3300/0 conn(0x7f48240bf970 0x7f48240bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.202+0000 7f4821d9b700 1 -- 172.21.15.60:0/1424431959 >> v2:172.21.15.144:3300/0 conn(0x7f48240bf970 msgr2=0x7f48240bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.202+0000 7f4821d9b700 1 --2- 172.21.15.60:0/1424431959 >> v2:172.21.15.144:3300/0 conn(0x7f48240bf970 0x7f48240bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.202+0000 7f4821d9b700 1 -- 172.21.15.60:0/1424431959 >> v1:172.21.15.60:6789/0 conn(0x7f48240ac020 legacy=0x7f48240ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.202+0000 7f4821d9b700 1 -- 172.21.15.60:0/1424431959 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48240acd50 con 0x7f48240cc880 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.202+0000 7f4821d9b700 1 --2- 172.21.15.60:0/1424431959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f48240ccd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4824071230 tx=0x7f48140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4955ec26aaaf4873 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.205+0000 7f482159a700 1 -- 172.21.15.60:0/1424431959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814009e80 con 0x7f48240cc880 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.205+0000 7f482159a700 1 -- 172.21.15.60:0/1424431959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481400b760 con 0x7f48240cc880 2023-10-08T16:05:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.205+0000 7f482159a700 1 -- 172.21.15.60:0/1424431959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481400bb20 con 0x7f48240cc880 2023-10-08T16:05:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.209+0000 7f4828b6b700 1 -- 172.21.15.60:0/1424431959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 msgr2=0x7f48240ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.209+0000 7f4828b6b700 1 --2- 172.21.15.60:0/1424431959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f48240ccd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4824071230 tx=0x7f48140091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7fcb09746700 1 Processor -- start 2023-10-08T16:05:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7fcb09746700 1 -- start start 2023-10-08T16:05:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7f4828b6b700 1 -- 172.21.15.60:0/1424431959 shutdown_connections 2023-10-08T16:05:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7f4828b6b700 1 --2- 172.21.15.60:0/1424431959 >> v2:172.21.15.144:3300/0 conn(0x7f48240bf970 0x7f48240bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7f4828b6b700 1 --2- 172.21.15.60:0/1424431959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f48240ccd00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7f4828b6b700 1 -- 172.21.15.60:0/1424431959 >> 172.21.15.60:0/1424431959 conn(0x7f4824070700 msgr2=0x7f4824070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7f4828b6b700 1 -- 172.21.15.60:0/1424431959 shutdown_connections 2023-10-08T16:05:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.214+0000 7f4828b6b700 1 -- 172.21.15.60:0/1424431959 wait complete. 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb09746700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb04156ea0 0x7fcb040c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb09746700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcb04157270 0x7fcb0406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb09746700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb040c42b0 con 0x7fcb0406e2b0 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb09746700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb040c36a0 con 0x7fcb04156ea0 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb09746700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb040c3980 con 0x7fcb04157270 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb04156ea0 0x7fcb040c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb04156ea0 0x7fcb040c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40456/0 (socket says 172.21.15.60:40456) 2023-10-08T16:05:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 -- 172.21.15.60:0/703497331 learned_addr learned my addr 172.21.15.60:0/703497331 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7f621509b700 1 Processor -- start 2023-10-08T16:05:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 -- 172.21.15.60:0/703497331 >> v2:172.21.15.144:3300/0 conn(0x7fcb04157270 msgr2=0x7fcb0406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 --2- 172.21.15.60:0/703497331 >> v2:172.21.15.144:3300/0 conn(0x7fcb04157270 0x7fcb0406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 -- 172.21.15.60:0/703497331 >> v1:172.21.15.60:6789/0 conn(0x7fcb0406e2b0 legacy=0x7fcb0406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7fcb02ffd700 1 -- 172.21.15.60:0/703497331 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040c3c60 con 0x7fcb04156ea0 2023-10-08T16:05:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7fcb02ffd700 1 --2- 172.21.15.60:0/703497331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb04156ea0 0x7fcb040c30c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406dd30 tx=0x7fcaf400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d8cf152ea3f114 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f4828b6b700 1 Processor -- start 2023-10-08T16:05:12.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f4828b6b700 1 -- start start 2023-10-08T16:05:12.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.215+0000 7f621509b700 1 -- start start 2023-10-08T16:05:12.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7fcb01ffb700 1 -- 172.21.15.60:0/703497331 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400dc10 con 0x7fcb04156ea0 2023-10-08T16:05:12.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7fcb01ffb700 1 -- 172.21.15.60:0/703497331 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf400dd70 con 0x7fcb04156ea0 2023-10-08T16:05:12.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7fcb01ffb700 1 -- 172.21.15.60:0/703497331 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40106a0 con 0x7fcb04156ea0 2023-10-08T16:05:12.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f621509b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100cc450 0x7f621006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f621509b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62100c75c0 0x7f6210155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f621509b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100c8760 con 0x7f621006d250 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f621509b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100af6e0 con 0x7f62100c75c0 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.216+0000 7f621509b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100c7b50 con 0x7f62100cc450 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f620ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f621006d250 0x7f62100c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43832/0 (socket says 172.21.15.60:43832) 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f620ed9d700 1 -- 172.21.15.60:0/2934121700 learned_addr learned my addr 172.21.15.60:0/2934121700 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f620f59e700 1 --2- 172.21.15.60:0/2934121700 >> v2:172.21.15.144:3300/0 conn(0x7f62100c75c0 0x7f6210155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4828b6b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48240ac020 0x7f4824158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4828b6b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48240bf970 0x7f4824159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4828b6b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f4824159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4828b6b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c2c50 con 0x7f48240cc880 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4828b6b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c2040 con 0x7f48240ac020 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4828b6b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c2320 con 0x7f48240bf970 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4821d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48240bf970 0x7f4824159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4822d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f4824159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f620e59c700 1 --2- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100cc450 0x7f621006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4821d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48240bf970 0x7f4824159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:51024/0 (socket says 172.21.15.60:51024) 2023-10-08T16:05:12.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4821d9b700 1 -- 172.21.15.60:0/3847142711 learned_addr learned my addr 172.21.15.60:0/3847142711 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f4822d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f4824159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40462/0 (socket says 172.21.15.60:40462) 2023-10-08T16:05:12.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.217+0000 7f482259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48240ac020 0x7f4824158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcb09746700 1 -- 172.21.15.60:0/703497331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb04156ea0 msgr2=0x7fcb040c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcb09746700 1 --2- 172.21.15.60:0/703497331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb04156ea0 0x7fcb040c30c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406dd30 tx=0x7fcaf400b4f0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f620dd9b700 1 -- 172.21.15.60:0/2934121700 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868983394 0 0) 0x7f62100c8760 con 0x7f621006d250 2023-10-08T16:05:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f620dd9b700 1 -- 172.21.15.60:0/2934121700 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f8003570 con 0x7f621006d250 2023-10-08T16:05:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f482259c700 1 -- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48240bf970 msgr2=0x7f4824159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f482259c700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48240bf970 0x7f4824159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f482259c700 1 -- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 msgr2=0x7f4824159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f482259c700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f4824159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f482259c700 1 -- 172.21.15.60:0/3847142711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4814009420 con 0x7f48240ac020 2023-10-08T16:05:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcb09746700 1 -- 172.21.15.60:0/703497331 shutdown_connections 2023-10-08T16:05:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcb09746700 1 --2- 172.21.15.60:0/703497331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb04156ea0 0x7fcb040c30c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcb09746700 1 --2- 172.21.15.60:0/703497331 >> v2:172.21.15.144:3300/0 conn(0x7fcb04157270 0x7fcb0406f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcb09746700 1 -- 172.21.15.60:0/703497331 >> 172.21.15.60:0/703497331 conn(0x7fcb040ca4f0 msgr2=0x7fcb040ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f482259c700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48240ac020 0x7f4824158000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f480c00d890 tx=0x7f480c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f620f59e700 1 -- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100cc450 msgr2=0x7f621006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f620f59e700 1 --2- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100cc450 0x7f621006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f620f59e700 1 -- 172.21.15.60:0/2934121700 >> v1:172.21.15.60:6789/0 conn(0x7f621006d250 legacy=0x7f62100c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7ff86c9bf700 1 Processor -- start 2023-10-08T16:05:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7ff86c9bf700 1 -- start start 2023-10-08T16:05:12.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f620f59e700 1 -- 172.21.15.60:0/2934121700 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100c7e30 con 0x7f62100c75c0 2023-10-08T16:05:12.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcc16032700 1 Processor -- start 2023-10-08T16:05:12.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0125f0 con 0x7f48240ac020 2023-10-08T16:05:12.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7fcc16032700 1 -- start start 2023-10-08T16:05:12.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c012770 con 0x7f48240ac020 2023-10-08T16:05:12.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c012b30 con 0x7f48240ac020 2023-10-08T16:05:12.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.218+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48240c2600 con 0x7f48240ac020 2023-10-08T16:05:12.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.219+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4824158540 con 0x7f48240ac020 2023-10-08T16:05:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86c9bf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff86806ee30 0x7ff8680ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86c9bf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8680adac0 0x7ff8680adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86c9bf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86816d4b0 con 0x7ff8680cc8a0 2023-10-08T16:05:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86c9bf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86806e950 con 0x7ff86806ee30 2023-10-08T16:05:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86c9bf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680cd1b0 con 0x7ff8680adac0 2023-10-08T16:05:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc16032700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c9a10 0x7fcc100bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc16032700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100c7960 con 0x7fcc100bf970 2023-10-08T16:05:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc16032700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100c7c40 con 0x7fcc1006d4c0 2023-10-08T16:05:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc16032700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100c7f20 con 0x7fcc100c9a10 2023-10-08T16:05:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcb09746700 1 -- 172.21.15.60:0/703497331 shutdown_connections 2023-10-08T16:05:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86659c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff8680cc8a0 0x7ff86806da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34086/0 (socket says 172.21.15.60:34086) 2023-10-08T16:05:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff86659c700 1 -- 172.21.15.60:0/4115558888 learned_addr learned my addr 172.21.15.60:0/4115558888 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcb09746700 1 -- 172.21.15.60:0/703497331 wait complete. 2023-10-08T16:05:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7f620f59e700 1 --2- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62100c75c0 0x7f6210155b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62000098e0 tx=0x7f62000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a1a6f0d12781d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff865d9b700 1 --2- 172.21.15.60:0/4115558888 >> v2:172.21.15.60:3300/0 conn(0x7ff86806ee30 0x7ff8680ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff866d9d700 1 --2- 172.21.15.60:0/4115558888 >> v2:172.21.15.144:3300/0 conn(0x7ff8680adac0 0x7ff8680adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff865d9b700 1 -- 172.21.15.60:0/4115558888 >> v2:172.21.15.144:3300/0 conn(0x7ff8680adac0 msgr2=0x7ff8680adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff865d9b700 1 --2- 172.21.15.60:0/4115558888 >> v2:172.21.15.144:3300/0 conn(0x7ff8680adac0 0x7ff8680adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff865d9b700 1 -- 172.21.15.60:0/4115558888 >> v1:172.21.15.144:6789/0 conn(0x7ff8680cc8a0 legacy=0x7ff86806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7ff865d9b700 1 -- 172.21.15.60:0/4115558888 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86806f330 con 0x7ff86806ee30 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7f620dd9b700 1 -- 172.21.15.60:0/2934121700 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204001470 con 0x7f62100c75c0 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7f620dd9b700 1 -- 172.21.15.60:0/2934121700 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200011420 con 0x7f62100c75c0 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7f620dd9b700 1 -- 172.21.15.60:0/2934121700 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62000117c0 con 0x7f62100c75c0 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc0f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcc100bf970 0x7fcc1006ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43838/0 (socket says 172.21.15.60:43838) 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc0f7fe700 1 -- 172.21.15.60:0/2017014168 learned_addr learned my addr 172.21.15.60:0/2017014168 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc0ffff700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c9a10 0x7fcc100bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581436150 0 0) 0x7fcc100c7960 con 0x7fcc100bf970 2023-10-08T16:05:12.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf8003570 con 0x7fcc100bf970 2023-10-08T16:05:12.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.220+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48240bf770 con 0x7f48240ac020 2023-10-08T16:05:12.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871315932 0 0) 0x7fcbf8003570 con 0x7fcc100bf970 2023-10-08T16:05:12.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c9a10 msgr2=0x7fcc100bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c9a10 0x7fcc100bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 >> v1:172.21.15.144:6789/0 conn(0x7fcc1006d4c0 legacy=0x7fcc100ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100c8200 con 0x7fcc100bf970 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fcc04001470 con 0x7fcc100bf970 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 >> v1:172.21.15.60:6789/0 conn(0x7fcc100bf970 legacy=0x7fcc1006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbf8003b10 0x7fcbf8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf8004810 0x7fcbf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf80053c0 0x7fcbf800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100c7f20 con 0x7fcbf8003b10 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800c230 con 0x7fcbf80053c0 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800c3f0 con 0x7fcbf8004810 2023-10-08T16:05:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7ff865d9b700 1 --2- 172.21.15.60:0/4115558888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680ccc70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff86806cfe0 tx=0x7ff860009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b246d16ac5a50dfd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0effd700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf8004810 0x7fcbf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7ff86559a700 1 -- 172.21.15.60:0/4115558888 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000e070 con 0x7ff86806ee30 2023-10-08T16:05:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7ff86559a700 1 -- 172.21.15.60:0/4115558888 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86000bbf0 con 0x7ff86806ee30 2023-10-08T16:05:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7ff86559a700 1 -- 172.21.15.60:0/4115558888 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860012430 con 0x7ff86806ee30 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7fcc0f7fe700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbf8003b10 0x7fcbf8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7f621509b700 1 -- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62100c75c0 msgr2=0x7f6210155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.221+0000 7f621509b700 1 --2- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62100c75c0 0x7f6210155b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62000098e0 tx=0x7f62000091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0effd700 1 -- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf80053c0 msgr2=0x7fcbf800ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0effd700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbf80053c0 0x7fcbf800ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0effd700 1 -- 172.21.15.60:0/2017014168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbf8003b10 msgr2=0x7fcbf8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0effd700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbf8003b10 0x7fcbf8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0effd700 1 -- 172.21.15.60:0/2017014168 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100c8200 con 0x7fcbf8004810 2023-10-08T16:05:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f621509b700 1 -- 172.21.15.60:0/2934121700 shutdown_connections 2023-10-08T16:05:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f621509b700 1 --2- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62100c75c0 0x7f6210155b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f621509b700 1 --2- 172.21.15.60:0/2934121700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100cc450 0x7f621006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f621509b700 1 -- 172.21.15.60:0/2934121700 >> 172.21.15.60:0/2934121700 conn(0x7f6210070700 msgr2=0x7f6210070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0effd700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf8004810 0x7fcbf8004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc000027c0 tx=0x7fcc00007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856bcb2dba23580d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f480c013480 con 0x7f48240ac020 2023-10-08T16:05:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcb09746700 1 Processor -- start 2023-10-08T16:05:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcb09746700 1 -- start start 2023-10-08T16:05:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7ff86c9bf700 1 -- 172.21.15.60:0/4115558888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 msgr2=0x7ff8680ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/4115558888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680ccc70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff86806cfe0 tx=0x7ff860009780 comp rx=0 tx=0).stop 2023-10-08T16:05:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f481a7fc700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4804067000 0x7f48040694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f480c0848a0 con 0x7f48240ac020 2023-10-08T16:05:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00006820 con 0x7fcbf8004810 2023-10-08T16:05:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000069a0 con 0x7fcbf8004810 2023-10-08T16:05:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.222+0000 7fcc0e7fc700 1 -- 172.21.15.60:0/2017014168 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00006d60 con 0x7fcbf8004810 2023-10-08T16:05:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7f621509b700 1 -- 172.21.15.60:0/2934121700 shutdown_connections 2023-10-08T16:05:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcc16032700 1 -- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf8004810 msgr2=0x7fcbf8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcc16032700 1 --2- 172.21.15.60:0/2017014168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbf8004810 0x7fcbf8004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc000027c0 tx=0x7fcc00007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb09746700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0406e2b0 0x7fcb040c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb09746700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb04156ea0 0x7fcb041443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb09746700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb04157270 0x7fcb04166c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb09746700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b2a60 con 0x7fcb0406e2b0 2023-10-08T16:05:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb09746700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b1e90 con 0x7fcb04156ea0 2023-10-08T16:05:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb09746700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b2130 con 0x7fcb04157270 2023-10-08T16:05:12.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7f621509b700 1 -- 172.21.15.60:0/2934121700 wait complete. 2023-10-08T16:05:12.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb027fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb04156ea0 0x7fcb041443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.223+0000 7fcb037fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb04157270 0x7fcb04166c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb027fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb04156ea0 0x7fcb041443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56942/0 (socket says 172.21.15.60:56942) 2023-10-08T16:05:12.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb027fc700 1 -- 172.21.15.60:0/506874913 learned_addr learned my addr 172.21.15.60:0/506874913 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7f4821d9b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4804067000 0x7f48040694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb037fe700 1 -- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb04156ea0 msgr2=0x7fcb041443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb037fe700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb04156ea0 0x7fcb041443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb037fe700 1 -- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0406e2b0 msgr2=0x7fcb040c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb037fe700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0406e2b0 0x7fcb040c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7fcb037fe700 1 -- 172.21.15.60:0/506874913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf400b790 con 0x7fcb04157270 2023-10-08T16:05:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.224+0000 7f4821d9b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4804067000 0x7f48040694b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f482415e4b0 tx=0x7f4814027000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7ff86c9bf700 1 -- 172.21.15.60:0/4115558888 shutdown_connections 2023-10-08T16:05:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/4115558888 >> v2:172.21.15.144:3300/0 conn(0x7ff8680adac0 0x7ff8680adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/4115558888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680ccc70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7ff86c9bf700 1 -- 172.21.15.60:0/4115558888 >> 172.21.15.60:0/4115558888 conn(0x7ff868070700 msgr2=0x7ff868070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7f621509b700 1 Processor -- start 2023-10-08T16:05:12.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7ff86c9bf700 1 -- 172.21.15.60:0/4115558888 shutdown_connections 2023-10-08T16:05:12.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7ff86c9bf700 1 -- 172.21.15.60:0/4115558888 wait complete. 2023-10-08T16:05:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7f621509b700 1 -- start start 2023-10-08T16:05:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcc0ffff700 1 -- 172.21.15.60:0/2017014168 reap_dead start 2023-10-08T16:05:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7f14a502a700 1 Processor -- start 2023-10-08T16:05:12.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcc16032700 1 -- 172.21.15.60:0/2017014168 shutdown_connections 2023-10-08T16:05:12.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcc16032700 1 -- 172.21.15.60:0/2017014168 >> 172.21.15.60:0/2017014168 conn(0x7fcc10067660 msgr2=0x7fcc10067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcc16032700 1 -- 172.21.15.60:0/2017014168 shutdown_connections 2023-10-08T16:05:12.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcb037fe700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb04157270 0x7fcb04166c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00bb00 tx=0x7fcafc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00c840 con 0x7fcb04157270 2023-10-08T16:05:12.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00c9c0 con 0x7fcb04157270 2023-10-08T16:05:12.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00cd80 con 0x7fcb04157270 2023-10-08T16:05:12.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f621509b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621006d250 0x7f6210155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f621509b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100c75c0 0x7f621014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f621509b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62100cc450 0x7f6210156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f621509b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210150100 con 0x7f62100cc450 2023-10-08T16:05:12.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f621509b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100c0e20 con 0x7f621006d250 2023-10-08T16:05:12.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f621509b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100c1090 con 0x7f62100c75c0 2023-10-08T16:05:12.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7ff86c9bf700 1 Processor -- start 2023-10-08T16:05:12.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f620e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100c75c0 0x7f621014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f620f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62100cc450 0x7f6210156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f620f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62100cc450 0x7f6210156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40482/0 (socket says 172.21.15.60:40482) 2023-10-08T16:05:12.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7f620f59e700 1 -- 172.21.15.60:0/3834557163 learned_addr learned my addr 172.21.15.60:0/3834557163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb040b2410 con 0x7fcb04157270 2023-10-08T16:05:12.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0414bce0 con 0x7fcb04157270 2023-10-08T16:05:12.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f620e59c700 1 -- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621006d250 msgr2=0x7f6210155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f620e59c700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621006d250 0x7f6210155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f620e59c700 1 -- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62100cc450 msgr2=0x7f6210156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f620e59c700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62100cc450 0x7f6210156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f620e59c700 1 -- 172.21.15.60:0/3834557163 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6200009420 con 0x7f62100c75c0 2023-10-08T16:05:12.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7fcc16032700 1 -- 172.21.15.60:0/2017014168 wait complete. 2023-10-08T16:05:12.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f620e59c700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100c75c0 0x7f621014fbc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f620800ed60 tx=0x7f620800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7fcc16032700 1 Processor -- start 2023-10-08T16:05:12.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.226+0000 7ff86c9bf700 1 -- start start 2023-10-08T16:05:12.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86c9bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86c9bf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8680adac0 0x7ff8680c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86c9bf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8680cc8a0 0x7ff868182ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86c9bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c0860 con 0x7ff86806ee30 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86c9bf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c8d20 con 0x7ff8680cc8a0 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86c9bf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c8380 con 0x7ff8680adac0 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40486/0 (socket says 172.21.15.60:40486) 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff86659c700 1 -- 172.21.15.60:0/624134809 learned_addr learned my addr 172.21.15.60:0/624134809 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7ff866d9d700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8680cc8a0 0x7ff868182ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f480c051af0 con 0x7f48240ac020 2023-10-08T16:05:12.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7ff865d9b700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8680adac0 0x7ff8680c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800eec0 con 0x7f62100c75c0 2023-10-08T16:05:12.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.225+0000 7f14a502a700 1 -- start start 2023-10-08T16:05:12.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f14a502a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14a00b0530 0x7f14a00b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f14a502a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a00b2310 con 0x7f14a00b0160 2023-10-08T16:05:12.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f14a502a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a00b1fe0 con 0x7f14a00af810 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7f14a502a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a00b0970 con 0x7f14a00b0530 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7ff866d9d700 1 -- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8680adac0 msgr2=0x7ff8680c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7ff866d9d700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8680adac0 0x7ff8680c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7ff866d9d700 1 -- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 msgr2=0x7ff8680c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7ff866d9d700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7ff866d9d700 1 -- 172.21.15.60:0/624134809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860009a20 con 0x7ff8680cc8a0 2023-10-08T16:05:12.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0404c3c0 con 0x7fcb04157270 2023-10-08T16:05:12.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f149e59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f14a00af810 0x7f14a00acaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34096/0 (socket says 172.21.15.60:34096) 2023-10-08T16:05:12.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f149e59c700 1 -- 172.21.15.60:0/4193528344 learned_addr learned my addr 172.21.15.60:0/4193528344 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7f149f59e700 1 --2- 172.21.15.60:0/4193528344 >> v2:172.21.15.60:3300/0 conn(0x7f14a00b0530 0x7f14a00b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7ff866d9d700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8680cc8a0 0x7ff868182ec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00d860 tx=0x7ff85c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0125f0 con 0x7ff8680cc8a0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c012750 con 0x7ff8680cc8a0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c012af0 con 0x7ff8680cc8a0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8680c8660 con 0x7ff8680cc8a0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8680c7e00 con 0x7ff8680cc8a0 2023-10-08T16:05:12.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800f040 con 0x7f62100c75c0 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800cd80 con 0x7f62100c75c0 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100c1370 con 0x7f62100c75c0 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6210158ac0 con 0x7f62100c75c0 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.227+0000 7fcc16032700 1 -- start start 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcc16032700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc100c2690 0x7fcc100bec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcc16032700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c0750 0x7fcc1015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcc16032700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc100c2a60 0x7fcc1015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcc16032700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100c17d0 con 0x7fcc100c2a60 2023-10-08T16:05:12.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcc16032700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100c0bc0 con 0x7fcc100c2690 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.228+0000 7fcc16032700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100c0ea0 con 0x7fcc100c0750 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c0750 0x7fcc1015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc100c2690 0x7fcc100bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c0750 0x7fcc1015cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:51082/0 (socket says 172.21.15.60:51082) 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0effd700 1 -- 172.21.15.60:0/2183498913 learned_addr learned my addr 172.21.15.60:0/2183498913 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7f149dd9b700 1 -- 172.21.15.60:0/4193528344 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471365889 0 0) 0x7f14a00b1fe0 con 0x7f14a00af810 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7f149f59e700 1 -- 172.21.15.60:0/4193528344 >> v1:172.21.15.144:6789/0 conn(0x7f14a00af810 legacy=0x7f14a00acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7f149f59e700 1 -- 172.21.15.60:0/4193528344 >> v1:172.21.15.60:6789/0 conn(0x7f14a00b0160 legacy=0x7f14a00adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7f149f59e700 1 -- 172.21.15.60:0/4193528344 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00ae730 con 0x7f14a00b0530 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7f149f59e700 1 --2- 172.21.15.60:0/4193528344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a00b27a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f149800af70 tx=0x7f149800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7667890d3511481a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0f7fe700 1 -- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c0750 msgr2=0x7fcc1015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0f7fe700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c0750 0x7fcc1015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0f7fe700 1 -- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc100c2a60 msgr2=0x7fcc1015d460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0f7fe700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc100c2a60 0x7fcc1015d460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcc0f7fe700 1 -- 172.21.15.60:0/2183498913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100c1180 con 0x7fcc100c2690 2023-10-08T16:05:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcc0f7fe700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc100c2690 0x7fcc100bec10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400ec10 tx=0x7fcc04000cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcafc014620 con 0x7fcb04157270 2023-10-08T16:05:12.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.229+0000 7fcaeaffd700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcaf0067080 0x7fcaf0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcafc084550 con 0x7fcb04157270 2023-10-08T16:05:12.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcb02ffd700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcaf0067080 0x7fcaf0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400c880 con 0x7fcc100c2690 2023-10-08T16:05:12.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7f149dd9b700 1 -- 172.21.15.60:0/4193528344 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800a0d0 con 0x7f14a00b0530 2023-10-08T16:05:12.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7f149dd9b700 1 -- 172.21.15.60:0/4193528344 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149800a230 con 0x7f14a00b0530 2023-10-08T16:05:12.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7f149dd9b700 1 -- 172.21.15.60:0/4193528344 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800cca0 con 0x7f14a00b0530 2023-10-08T16:05:12.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcb02ffd700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcaf0067080 0x7fcaf0069530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406dd30 tx=0x7fcaf401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0400c9e0 con 0x7fcc100c2690 2023-10-08T16:05:12.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400cd80 con 0x7fcc100c2690 2023-10-08T16:05:12.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc100c1460 con 0x7fcc100c2690 2023-10-08T16:05:12.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc100c3ad0 con 0x7fcc100c2690 2023-10-08T16:05:12.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.230+0000 7fb52065e700 1 Processor -- start 2023-10-08T16:05:12.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8680c0350 con 0x7ff8680cc8a0 2023-10-08T16:05:12.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7fb52065e700 1 -- start start 2023-10-08T16:05:12.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f00052b0 con 0x7f62100c75c0 2023-10-08T16:05:12.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf00052b0 con 0x7fcc100c2690 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 -- 172.21.15.60:0/4193528344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 msgr2=0x7f14a00b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 --2- 172.21.15.60:0/4193528344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a00b27a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f149800af70 tx=0x7f149800a890 comp rx=0 tx=0).stop 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 -- 172.21.15.60:0/4193528344 shutdown_connections 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 --2- 172.21.15.60:0/4193528344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a00b27a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 -- 172.21.15.60:0/4193528344 >> 172.21.15.60:0/4193528344 conn(0x7f14a00cd1e0 msgr2=0x7f14a00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 -- 172.21.15.60:0/4193528344 shutdown_connections 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.231+0000 7f14a502a700 1 -- 172.21.15.60:0/4193528344 wait complete. 2023-10-08T16:05:12.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff85c013480 con 0x7ff8680cc8a0 2023-10-08T16:05:12.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb52065e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5180ccf10 0x7fb5180c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb52065e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb51815e9b0 0x7fb51806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb52065e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180ab5c0 con 0x7fb5180cd2e0 2023-10-08T16:05:12.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb52065e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180aa9b0 con 0x7fb51815e9b0 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb52065e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180aac90 con 0x7fb5180ccf10 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb51ebfb700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb5180cd2e0 0x7fb5180c9310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43850/0 (socket says 172.21.15.60:43850) 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb51ebfb700 1 -- 172.21.15.60:0/941182691 learned_addr learned my addr 172.21.15.60:0/941182691 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb51e3fa700 1 --2- 172.21.15.60:0/941182691 >> v2:172.21.15.144:3300/0 conn(0x7fb5180ccf10 0x7fb5180c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fb51dbf9700 1 --2- 172.21.15.60:0/941182691 >> v2:172.21.15.60:3300/0 conn(0x7fb51815e9b0 0x7fb51806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc04013630 con 0x7fcc100c2690 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fcbf77fe700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbfc067080 0x7fcbfc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.232+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc040847b0 con 0x7fcc100c2690 2023-10-08T16:05:12.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7ff8567fc700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff848066f30 0x7ff8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff85c085190 con 0x7ff8680cc8a0 2023-10-08T16:05:12.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51dbf9700 1 -- 172.21.15.60:0/941182691 >> v2:172.21.15.144:3300/0 conn(0x7fb5180ccf10 msgr2=0x7fb5180c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:12.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51dbf9700 1 --2- 172.21.15.60:0/941182691 >> v2:172.21.15.144:3300/0 conn(0x7fb5180ccf10 0x7fb5180c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51dbf9700 1 -- 172.21.15.60:0/941182691 >> v1:172.21.15.60:6789/0 conn(0x7fb5180cd2e0 legacy=0x7fb5180c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51dbf9700 1 -- 172.21.15.60:0/941182691 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180aaf70 con 0x7fb51815e9b0 2023-10-08T16:05:12.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7ff86659c700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff848066f30 0x7ff8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7f14a502a700 1 Processor -- start 2023-10-08T16:05:12.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51dbf9700 1 --2- 172.21.15.60:0/941182691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51815e9b0 0x7fb51806eab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5180c92e0 tx=0x7fb5080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6279819e2474feed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7f14a502a700 1 -- start start 2023-10-08T16:05:12.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51d3f8700 1 -- 172.21.15.60:0/941182691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508011630 con 0x7fb51815e9b0 2023-10-08T16:05:12.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51d3f8700 1 -- 172.21.15.60:0/941182691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5080117b0 con 0x7fb51815e9b0 2023-10-08T16:05:12.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7fb51d3f8700 1 -- 172.21.15.60:0/941182691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508011b70 con 0x7fb51815e9b0 2023-10-08T16:05:12.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.233+0000 7ff86659c700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff848066f30 0x7ff8480693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff858009b90 tx=0x7ff858009120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7fcc0effd700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbfc067080 0x7fcbfc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7fcc0effd700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbfc067080 0x7fcbfc069530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc00008fd0 tx=0x7fcc00015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f14a502a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14a00af810 0x7f14a0165a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f14a502a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14a00b0160 0x7f14a00cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f14a502a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a0097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f14a502a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00989a0 con 0x7f14a00b0530 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f14a502a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0099040 con 0x7f14a00b0160 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f14a502a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00983e0 con 0x7f14a00af810 2023-10-08T16:05:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f149f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a0097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f149f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a0097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40522/0 (socket says 172.21.15.60:40522) 2023-10-08T16:05:12.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f149f59e700 1 -- 172.21.15.60:0/457171092 learned_addr learned my addr 172.21.15.60:0/457171092 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f149e59c700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14a00b0160 0x7f14a00cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7fb52065e700 1 -- 172.21.15.60:0/941182691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51815e9b0 msgr2=0x7fb51806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7fb52065e700 1 --2- 172.21.15.60:0/941182691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51815e9b0 0x7fb51806eab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5180c92e0 tx=0x7fb5080091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.234+0000 7f149ed9d700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14a00af810 0x7f14a0165a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fb52065e700 1 -- 172.21.15.60:0/941182691 shutdown_connections 2023-10-08T16:05:12.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fb52065e700 1 --2- 172.21.15.60:0/941182691 >> v2:172.21.15.144:3300/0 conn(0x7fb5180ccf10 0x7fb5180c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fb52065e700 1 --2- 172.21.15.60:0/941182691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51815e9b0 0x7fb51806eab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fb52065e700 1 -- 172.21.15.60:0/941182691 >> 172.21.15.60:0/941182691 conn(0x7fb518070700 msgr2=0x7fb518070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcafc04c5a0 con 0x7fcb04157270 2023-10-08T16:05:12.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fb52065e700 1 -- 172.21.15.60:0/941182691 shutdown_connections 2023-10-08T16:05:12.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f149f59e700 1 -- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14a00af810 msgr2=0x7f14a0165a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f149f59e700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14a00af810 0x7f14a0165a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f149f59e700 1 -- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14a00b0160 msgr2=0x7f14a00cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f149f59e700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14a00b0160 0x7f14a00cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f149f59e700 1 -- 172.21.15.60:0/457171092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149800ab30 con 0x7f14a00b0530 2023-10-08T16:05:12.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7fb52065e700 1 -- 172.21.15.60:0/941182691 wait complete. 2023-10-08T16:05:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f149f59e700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a0097a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14a006c610 tx=0x7f1498018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800a0d0 con 0x7f14a00b0530 2023-10-08T16:05:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498003300 con 0x7f14a00b0530 2023-10-08T16:05:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498013840 con 0x7f14a00b0530 2023-10-08T16:05:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a00986c0 con 0x7f14a00b0530 2023-10-08T16:05:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.236+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff85c0523e0 con 0x7ff8680cc8a0 2023-10-08T16:05:12.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.236+0000 7fb52065e700 1 Processor -- start 2023-10-08T16:05:12.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.236+0000 7fb52065e700 1 -- start start 2023-10-08T16:05:12.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.235+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a0165f90 con 0x7f14a00b0530 2023-10-08T16:05:12.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.236+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6208014690 con 0x7f62100c75c0 2023-10-08T16:05:12.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7f61f6ffd700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61fc067000 0x7f61fc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62080854c0 con 0x7f62100c75c0 2023-10-08T16:05:12.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7f620ed9d700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61fc067000 0x7f61fc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7f620ed9d700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61fc067000 0x7f61fc0694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62040015a0 tx=0x7f6204001090 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7fb52065e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 0x7fb51816d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7fb52065e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180cd2e0 0x7fb5180c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7fb52065e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb51815e9b0 0x7fb5180b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7fb52065e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815db90 con 0x7fb5180ccf10 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7fb52065e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815de30 con 0x7fb5180cd2e0 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7fb52065e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815e110 con 0x7fb51815e9b0 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 0x7fb51816d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 0x7fb51816d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40524/0 (socket says 172.21.15.60:40524) 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 -- 172.21.15.60:0/2026819696 learned_addr learned my addr 172.21.15.60:0/2026819696 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51dbf9700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180cd2e0 0x7fb5180c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 -- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb51815e9b0 msgr2=0x7fb5180b1820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb51815e9b0 0x7fb5180b1820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 -- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180cd2e0 msgr2=0x7fb5180c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180cd2e0 0x7fb5180c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 -- 172.21.15.60:0/2026819696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508009420 con 0x7fb5180ccf10 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7fb51e3fa700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 0x7fb51816d780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb51400ec80 tx=0x7fb5140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a00991b0 con 0x7f14a00b0530 2023-10-08T16:05:12.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.237+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f149801a070 con 0x7f14a00b0530 2023-10-08T16:05:12.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7f1486ffd700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1498085ec0 con 0x7f14a00b0530 2023-10-08T16:05:12.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7f149ed9d700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.238+0000 7f149ed9d700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f148c066f30 0x7f148c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1490003a30 tx=0x7f1490007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.240+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6208052890 con 0x7f62100c75c0 2023-10-08T16:05:12.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.240+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc04051a00 con 0x7fcc100c2690 2023-10-08T16:05:12.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.244+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400c850 con 0x7fb5180ccf10 2023-10-08T16:05:12.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.244+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51400c9b0 con 0x7fb5180ccf10 2023-10-08T16:05:12.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.244+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400cd50 con 0x7fb5180ccf10 2023-10-08T16:05:12.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.244+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1498053130 con 0x7f14a00b0530 2023-10-08T16:05:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.246+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51815e3f0 con 0x7fb5180ccf10 2023-10-08T16:05:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.246+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5180b1210 con 0x7fb5180ccf10 2023-10-08T16:05:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.248+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51804c3c0 con 0x7fb5180ccf10 2023-10-08T16:05:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.248+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb514013680 con 0x7fb5180ccf10 2023-10-08T16:05:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.249+0000 7fb50e7fc700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.249+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb514084750 con 0x7fb5180ccf10 2023-10-08T16:05:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.252+0000 7fb51dbf9700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.253+0000 7fb51dbf9700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb4fc066f30 0x7fb4fc0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5180c92e0 tx=0x7fb508017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.257+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5140519c0 con 0x7fb5180ccf10 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.270+0000 7fd8d8066700 1 Processor -- start 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.270+0000 7fd8d8066700 1 -- start start 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.272+0000 7fd8d8066700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8d00c75c0 0x7fd8d0155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.272+0000 7fd8d8066700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d00c8760 con 0x7fd8d006d2e0 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.272+0000 7fd8d8066700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d00af6e0 con 0x7fd8d006d6b0 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.272+0000 7fd8d8066700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d00c7b50 con 0x7fd8d00c75c0 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.273+0000 7fd8d6603700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd8d006d6b0 0x7fd8d00c8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:34110/0 (socket says 172.21.15.60:34110) 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.273+0000 7fd8d6603700 1 -- 172.21.15.60:0/476979914 learned_addr learned my addr 172.21.15.60:0/476979914 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.273+0000 7fd8d5601700 1 --2- 172.21.15.60:0/476979914 >> v2:172.21.15.60:3300/0 conn(0x7fd8d00c75c0 0x7fd8d0155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.273+0000 7fd8d5601700 1 -- 172.21.15.60:0/476979914 >> v1:172.21.15.144:6789/0 conn(0x7fd8d006d6b0 legacy=0x7fd8d00c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.273+0000 7fd8d5601700 1 -- 172.21.15.60:0/476979914 >> v1:172.21.15.60:6789/0 conn(0x7fd8d006d2e0 legacy=0x7fd8d00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.273+0000 7fd8d5601700 1 -- 172.21.15.60:0/476979914 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00c7e30 con 0x7fd8d00c75c0 2023-10-08T16:05:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.274+0000 7fd8d5601700 1 --2- 172.21.15.60:0/476979914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0155b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00098e0 tx=0x7fd8c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2ba3d62d769db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.287+0000 7fd8d4e00700 1 -- 172.21.15.60:0/476979914 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0009e80 con 0x7fd8d00c75c0 2023-10-08T16:05:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.287+0000 7fd8d4e00700 1 -- 172.21.15.60:0/476979914 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c000c970 con 0x7fd8d00c75c0 2023-10-08T16:05:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.287+0000 7fd8d4e00700 1 -- 172.21.15.60:0/476979914 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000ccf0 con 0x7fd8d00c75c0 2023-10-08T16:05:12.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.288+0000 7fd8d8066700 1 -- 172.21.15.60:0/476979914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d00c75c0 msgr2=0x7fd8d0155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.288+0000 7fd8d8066700 1 --2- 172.21.15.60:0/476979914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0155b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00098e0 tx=0x7fd8c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.288+0000 7fd8d8066700 1 -- 172.21.15.60:0/476979914 shutdown_connections 2023-10-08T16:05:12.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.288+0000 7fd8d8066700 1 --2- 172.21.15.60:0/476979914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0155b60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.288+0000 7fd8d8066700 1 -- 172.21.15.60:0/476979914 >> 172.21.15.60:0/476979914 conn(0x7fd8d0070700 msgr2=0x7fd8d0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.289+0000 7fd8d8066700 1 -- 172.21.15.60:0/476979914 shutdown_connections 2023-10-08T16:05:12.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.289+0000 7fd8d8066700 1 -- 172.21.15.60:0/476979914 wait complete. 2023-10-08T16:05:12.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.290+0000 7fd8d8066700 1 Processor -- start 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.291+0000 7fd8d8066700 1 -- start start 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d8066700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8d006d2e0 0x7fd8d0156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d8066700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 0x7fd8d0157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d8066700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d8066700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c49e0 con 0x7fd8d006d6b0 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d8066700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0158740 con 0x7fd8d00c75c0 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d8066700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c4390 con 0x7fd8d006d2e0 2023-10-08T16:05:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d5e02700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8d006d2e0 0x7fd8d0156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d5601700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 0x7fd8d0157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d5601700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 0x7fd8d0157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40542/0 (socket says 172.21.15.60:40542) 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.292+0000 7fd8d5601700 1 -- 172.21.15.60:0/3328829062 learned_addr learned my addr 172.21.15.60:0/3328829062 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.293+0000 7fd8d6603700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.293+0000 7fd8d5601700 1 -- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8d006d2e0 msgr2=0x7fd8d0156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.293+0000 7fd8d5601700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8d006d2e0 0x7fd8d0156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.293+0000 7fd8d5601700 1 -- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8d00c75c0 msgr2=0x7fd8d0158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.293+0000 7fd8d5601700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.293+0000 7fd8d5601700 1 -- 172.21.15.60:0/3328829062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c0009420 con 0x7fd8d006d6b0 2023-10-08T16:05:12.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.294+0000 7fd8d5601700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 0x7fd8d0157bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00ca000 tx=0x7fd8c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.294+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c001c040 con 0x7fd8d006d6b0 2023-10-08T16:05:12.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.294+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c000c050 con 0x7fd8d006d6b0 2023-10-08T16:05:12.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.294+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00223f0 con 0x7fd8d006d6b0 2023-10-08T16:05:12.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.294+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d00c4670 con 0x7fd8d006d6b0 2023-10-08T16:05:12.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.294+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d01552d0 con 0x7fd8d006d6b0 2023-10-08T16:05:12.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.297+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8c0022760 con 0x7fd8d006d6b0 2023-10-08T16:05:12.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.298+0000 7fd8c5ffb700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8bc0671e0 0x7fd8bc069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:12.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.298+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8c0085e00 con 0x7fd8d006d6b0 2023-10-08T16:05:12.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.298+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d004bbe0 con 0x7fd8d006d6b0 2023-10-08T16:05:12.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.304+0000 7fd8d5e02700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8bc0671e0 0x7fd8bc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:12.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.305+0000 7fd8d5e02700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8bc0671e0 0x7fd8bc069690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc003730 tx=0x7fd8cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:12.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.307+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8c0053100 con 0x7fd8d006d6b0 2023-10-08T16:05:12.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.614+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcbf0005560 con 0x7fcc100c2690 2023-10-08T16:05:12.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.615+0000 7fcbf77fe700 1 -- 172.21.15.60:0/2183498913 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc04055020 con 0x7fcc100c2690 2023-10-08T16:05:12.619 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbfc067080 msgr2=0x7fcbfc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbfc067080 0x7fcbfc069530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc00008fd0 tx=0x7fcc00015000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc100c2690 msgr2=0x7fcc100bec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc100c2690 0x7fcc100bec10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400ec10 tx=0x7fcc04000cc0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 shutdown_connections 2023-10-08T16:05:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbfc067080 0x7fcbfc069530 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc00008fd0 tx=0x7fcc00015000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc100c2a60 0x7fcc1015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc100c2690 0x7fcc100bec10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 --2- 172.21.15.60:0/2183498913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc100c0750 0x7fcc1015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.618+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 >> 172.21.15.60:0/2183498913 conn(0x7fcc10067660 msgr2=0x7fcc1015dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.619+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 shutdown_connections 2023-10-08T16:05:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.619+0000 7fcc16032700 1 -- 172.21.15.60:0/2183498913 wait complete. 2023-10-08T16:05:12.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-08T16:05:12.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.639+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff8680c0350 con 0x7ff8680cc8a0 2023-10-08T16:05:12.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.641+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f482404c3c0 con 0x7f48240ac020 2023-10-08T16:05:12.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.641+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcb040b2bd0 con 0x7fcb04157270 2023-10-08T16:05:12.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.643+0000 7fcaeaffd700 1 -- 172.21.15.60:0/506874913 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcafc051720 con 0x7fcb04157270 2023-10-08T16:05:12.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.646+0000 7f481a7fc700 1 -- 172.21.15.60:0/3847142711 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f480c055110 con 0x7f48240ac020 2023-10-08T16:05:12.647 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.648+0000 7ff8567fc700 1 -- 172.21.15.60:0/624134809 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8680c0350 con 0x7ff8680cc8a0 2023-10-08T16:05:12.649 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.649+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14a004c3c0 con 0x7f14a00b0530 2023-10-08T16:05:12.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.649+0000 7f1486ffd700 1 -- 172.21.15.60:0/457171092 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1498056750 con 0x7f14a00b0530 2023-10-08T16:05:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.649+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61f0005830 con 0x7f62100c75c0 2023-10-08T16:05:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.650+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4804067000 msgr2=0x7f48040694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.650+0000 7f4828b6b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4804067000 0x7f48040694b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f482415e4b0 tx=0x7f4814027000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.650+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48240ac020 msgr2=0x7f4824158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.650+0000 7f4828b6b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48240ac020 0x7f4824158000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f480c00d890 tx=0x7f480c008040 comp rx=0 tx=0).stop 2023-10-08T16:05:12.652 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.650+0000 7f61f6ffd700 1 -- 172.21.15.60:0/3834557163 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6208055eb0 con 0x7f62100c75c0 2023-10-08T16:05:12.652 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.653 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 shutdown_connections 2023-10-08T16:05:12.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7f4828b6b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4804067000 0x7f48040694b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7f4828b6b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48240cc880 0x7f4824159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7f4828b6b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48240ac020 0x7f4824158000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7f4828b6b700 1 --2- 172.21.15.60:0/3847142711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48240bf970 0x7f4824159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 >> 172.21.15.60:0/3847142711 conn(0x7f4824070700 msgr2=0x7f48240b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff848066f30 msgr2=0x7ff8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff848066f30 0x7ff8480693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff858009b90 tx=0x7ff858009120 comp rx=0 tx=0).stop 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8680cc8a0 msgr2=0x7ff868182ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8680cc8a0 0x7ff868182ec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00d860 tx=0x7ff85c008040 comp rx=0 tx=0).stop 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.651+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 shutdown_connections 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff848066f30 0x7ff8480693e0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff858009b90 tx=0x7ff858009120 comp rx=0 tx=0).stop 2023-10-08T16:05:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8680cc8a0 0x7ff868182ec0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff86806ee30 0x7ff8680c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7ff86c9bf700 1 --2- 172.21.15.60:0/624134809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8680adac0 0x7ff8680c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 >> 172.21.15.60:0/624134809 conn(0x7ff868070700 msgr2=0x7ff8680ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 shutdown_connections 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61fc067000 msgr2=0x7f61fc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61fc067000 0x7f61fc0694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62040015a0 tx=0x7f6204001090 comp rx=0 tx=0).stop 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100c75c0 msgr2=0x7f621014fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100c75c0 0x7f621014fbc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f620800ed60 tx=0x7f620800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 shutdown_connections 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61fc067000 0x7f61fc0694b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62100cc450 0x7f6210156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621006d250 0x7f6210155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 --2- 172.21.15.60:0/3834557163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62100c75c0 0x7f621014fbc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.652+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 >> 172.21.15.60:0/3834557163 conn(0x7f6210070700 msgr2=0x7f6210068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f148c066f30 msgr2=0x7f148c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f148c066f30 0x7f148c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1490003a30 tx=0x7f1490007ec0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 msgr2=0x7f14a0097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a0097a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14a006c610 tx=0x7f1498018000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 shutdown_connections 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14a00af810 0x7f14a0165a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14a00b0530 0x7f14a0097a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 --2- 172.21.15.60:0/457171092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14a00b0160 0x7f14a00cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 >> 172.21.15.60:0/457171092 conn(0x7f14a00cd1e0 msgr2=0x7f14a00acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f4828b6b700 1 -- 172.21.15.60:0/3847142711 wait complete. 2023-10-08T16:05:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcaf0067080 msgr2=0x7fcaf0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7fcb09746700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcaf0067080 0x7fcaf0069530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406dd30 tx=0x7fcaf401a000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb04157270 msgr2=0x7fcb04166c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 shutdown_connections 2023-10-08T16:05:12.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.653+0000 7fcb09746700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb04157270 0x7fcb04166c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00bb00 tx=0x7fcafc009780 comp rx=0 tx=0).stop 2023-10-08T16:05:12.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 shutdown_connections 2023-10-08T16:05:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7f14a502a700 1 -- 172.21.15.60:0/457171092 wait complete. 2023-10-08T16:05:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7f621509b700 1 -- 172.21.15.60:0/3834557163 wait complete. 2023-10-08T16:05:12.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 shutdown_connections 2023-10-08T16:05:12.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7fcb09746700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcaf0067080 0x7fcaf0069530 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406dd30 tx=0x7fcaf401a000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7fcb09746700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb04157270 0x7fcb04166c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7fcb09746700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0406e2b0 0x7fcb040c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7fcb09746700 1 --2- 172.21.15.60:0/506874913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb04156ea0 0x7fcb041443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.654+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 >> 172.21.15.60:0/506874913 conn(0x7fcb040ca4f0 msgr2=0x7fcb0406f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.656+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 shutdown_connections 2023-10-08T16:05:12.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.656+0000 7ff86c9bf700 1 -- 172.21.15.60:0/624134809 wait complete. 2023-10-08T16:05:12.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.658+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb5180ab250 con 0x7fb5180ccf10 2023-10-08T16:05:12.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.658+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 shutdown_connections 2023-10-08T16:05:12.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.659+0000 7fb50e7fc700 1 -- 172.21.15.60:0/2026819696 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb514054fe0 con 0x7fb5180ccf10 2023-10-08T16:05:12.666 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.660+0000 7fcb09746700 1 -- 172.21.15.60:0/506874913 wait complete. 2023-10-08T16:05:12.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.663+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb4fc066f30 msgr2=0x7fb4fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.663+0000 7fb52065e700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb4fc066f30 0x7fb4fc0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5180c92e0 tx=0x7fb508017000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.663+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 msgr2=0x7fb51816d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.663+0000 7fb52065e700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 0x7fb51816d780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb51400ec80 tx=0x7fb5140091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.668+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 shutdown_connections 2023-10-08T16:05:12.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.668+0000 7fb52065e700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.668+0000 7fb52065e700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb51815e9b0 0x7fb5180b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.668+0000 7fb52065e700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5180ccf10 0x7fb51816d780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.668+0000 7fb52065e700 1 --2- 172.21.15.60:0/2026819696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5180cd2e0 0x7fb5180c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.668+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 >> 172.21.15.60:0/2026819696 conn(0x7fb518070700 msgr2=0x7fb5180c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.672+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 shutdown_connections 2023-10-08T16:05:12.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.672+0000 7fb52065e700 1 -- 172.21.15.60:0/2026819696 wait complete. 2023-10-08T16:05:12.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-08T16:05:12.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T16:05:12.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-08T16:05:12.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-08T16:05:12.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-08T16:05:12.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-08T16:05:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.692+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd8d004c3c0 con 0x7fd8d006d6b0 2023-10-08T16:05:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.693+0000 7fd8c5ffb700 1 -- 172.21.15.60:0/3328829062 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8c0027020 con 0x7fd8d006d6b0 2023-10-08T16:05:12.694 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8bc0671e0 msgr2=0x7fd8bc069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8bc0671e0 0x7fd8bc069690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc003730 tx=0x7fd8cc009040 comp rx=0 tx=0).stop 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 msgr2=0x7fd8d0157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 0x7fd8d0157bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00ca000 tx=0x7fd8c0018000 comp rx=0 tx=0).stop 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 shutdown_connections 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8bc0671e0 0x7fd8bc069690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8d006d2e0 0x7fd8d0156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8d00c75c0 0x7fd8d0158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 --2- 172.21.15.60:0/3328829062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d006d6b0 0x7fd8d0157bc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 >> 172.21.15.60:0/3328829062 conn(0x7fd8d0070700 msgr2=0x7fd8d00b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 shutdown_connections 2023-10-08T16:05:12.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:12.695+0000 7fd8d8066700 1 -- 172.21.15.60:0/3328829062 wait complete. 2023-10-08T16:05:12.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T16:05:13.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:05:13.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:05:13.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:05:13.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:05:13.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:05:13.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:05:13.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:05:13.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:05:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.850+0000 7f8c26de6700 1 Processor -- start 2023-10-08T16:05:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.850+0000 7f8c26de6700 1 -- start start 2023-10-08T16:05:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.851+0000 7f8c26de6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8c200ccaf0 0x7f8c200883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.851+0000 7f8c26de6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c200ccec0 0x7f8c200888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.851+0000 7f8c26de6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c200c6eb0 con 0x7f8c200af910 2023-10-08T16:05:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.851+0000 7f8c26de6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c20088e30 con 0x7f8c200ccaf0 2023-10-08T16:05:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.851+0000 7f8c26de6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200b1270 con 0x7f8c200ccec0 2023-10-08T16:05:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.852+0000 7f8c25383700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8c200af910 0x7f8c200afd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:50872/0 (socket says 172.21.15.60:50872) 2023-10-08T16:05:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.852+0000 7f8c25383700 1 -- 172.21.15.60:0/3088974411 learned_addr learned my addr 172.21.15.60:0/3088974411 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.852+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/3088974411 >> v2:172.21.15.144:3300/0 conn(0x7f8c200ccec0 0x7f8c200888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.853+0000 7f8c24b82700 1 --2- 172.21.15.60:0/3088974411 >> v2:172.21.15.60:3300/0 conn(0x7f8c200ccaf0 0x7f8c200883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.853+0000 7f8c1ffff700 1 -- 172.21.15.60:0/3088974411 >> v2:172.21.15.60:3300/0 conn(0x7f8c200ccaf0 msgr2=0x7f8c200883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.853+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/3088974411 >> v2:172.21.15.60:3300/0 conn(0x7f8c200ccaf0 0x7f8c200883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.853+0000 7f8c1ffff700 1 -- 172.21.15.60:0/3088974411 >> v1:172.21.15.144:6789/0 conn(0x7f8c200af910 legacy=0x7f8c200afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.853+0000 7f8c1ffff700 1 -- 172.21.15.60:0/3088974411 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200b0410 con 0x7f8c200ccec0 2023-10-08T16:05:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.853+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/3088974411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200ccec0 0x7f8c200888f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c6e40 tx=0x7f8c1800a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e613da95aa9b6dda server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.854+0000 7f8c1f7fe700 1 -- 172.21.15.60:0/3088974411 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800f070 con 0x7f8c200ccec0 2023-10-08T16:05:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.854+0000 7f8c1f7fe700 1 -- 172.21.15.60:0/3088974411 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1800a2e0 con 0x7f8c200ccec0 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.854+0000 7f8c1f7fe700 1 -- 172.21.15.60:0/3088974411 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800cb70 con 0x7f8c200ccec0 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.855+0000 7f8c26de6700 1 -- 172.21.15.60:0/3088974411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200ccec0 msgr2=0x7f8c200888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.855+0000 7f8c26de6700 1 --2- 172.21.15.60:0/3088974411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200ccec0 0x7f8c200888f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c6e40 tx=0x7f8c1800a890 comp rx=0 tx=0).stop 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.855+0000 7f8c26de6700 1 -- 172.21.15.60:0/3088974411 shutdown_connections 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.855+0000 7f8c26de6700 1 --2- 172.21.15.60:0/3088974411 >> v2:172.21.15.60:3300/0 conn(0x7f8c200ccaf0 0x7f8c200883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.855+0000 7f8c26de6700 1 --2- 172.21.15.60:0/3088974411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200ccec0 0x7f8c200888f0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c6e40 tx=0x7f8c1800a890 comp rx=0 tx=0).stop 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.855+0000 7f8c26de6700 1 -- 172.21.15.60:0/3088974411 >> 172.21.15.60:0/3088974411 conn(0x7f8c20070700 msgr2=0x7f8c20070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.856+0000 7f8c26de6700 1 -- 172.21.15.60:0/3088974411 shutdown_connections 2023-10-08T16:05:13.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.856+0000 7f8c26de6700 1 -- 172.21.15.60:0/3088974411 wait complete. 2023-10-08T16:05:13.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.858+0000 7f8c26de6700 1 Processor -- start 2023-10-08T16:05:13.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.858+0000 7f8c26de6700 1 -- start start 2023-10-08T16:05:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.859+0000 7f8c26de6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200af910 0x7f8c201889b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.859+0000 7f8c26de6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c200ccaf0 0x7f8c20168830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.859+0000 7f8c26de6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c2016a060 0x7f8c2017d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.859+0000 7f8c26de6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2017bba0 con 0x7f8c200ccaf0 2023-10-08T16:05:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.859+0000 7f8c26de6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2017c250 con 0x7f8c200af910 2023-10-08T16:05:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.859+0000 7f8c26de6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20188ef0 con 0x7f8c2016a060 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.860+0000 7f8c25383700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c2016a060 0x7f8c2017d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.860+0000 7f8c24b82700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200af910 0x7f8c201889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.860+0000 7f8c25383700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c2016a060 0x7f8c2017d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35654/0 (socket says 172.21.15.60:35654) 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.860+0000 7f8c25383700 1 -- 172.21.15.60:0/1377193281 learned_addr learned my addr 172.21.15.60:0/1377193281 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.860+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c200ccaf0 0x7f8c20168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.861+0000 7f8c1ffff700 1 -- 172.21.15.60:0/1377193281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c2016a060 msgr2=0x7f8c2017d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.861+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c2016a060 0x7f8c2017d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.861+0000 7f8c1ffff700 1 -- 172.21.15.60:0/1377193281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200af910 msgr2=0x7f8c201889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.861+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200af910 0x7f8c201889b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.861+0000 7f8c1ffff700 1 -- 172.21.15.60:0/1377193281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1800ab30 con 0x7f8c200ccaf0 2023-10-08T16:05:13.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.861+0000 7f8c1ffff700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c200ccaf0 0x7f8c20168830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c18015000 tx=0x7f8c18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.862+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c180097f0 con 0x7f8c200ccaf0 2023-10-08T16:05:13.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.862+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c18009950 con 0x7f8c200ccaf0 2023-10-08T16:05:13.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.862+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18009d10 con 0x7f8c200ccaf0 2023-10-08T16:05:13.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.863+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c20168d70 con 0x7f8c200ccaf0 2023-10-08T16:05:13.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.863+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2017d070 con 0x7f8c200ccaf0 2023-10-08T16:05:13.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.866+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c1801a070 con 0x7f8c200ccaf0 2023-10-08T16:05:13.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.866+0000 7f8c1cff9700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8c0c067080 0x7f8c0c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.866+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c180852a0 con 0x7f8c200ccaf0 2023-10-08T16:05:13.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.868+0000 7f8c24b82700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8c0c067080 0x7f8c0c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.868+0000 7f8c24b82700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8c0c067080 0x7f8c0c069530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c2017df70 tx=0x7f8c14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.871+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c20168d70 con 0x7f8c200ccaf0 2023-10-08T16:05:13.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.880+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c20168d70 con 0x7f8c200ccaf0 2023-10-08T16:05:13.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.892+0000 7f9ecac0b700 1 Processor -- start 2023-10-08T16:05:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.892+0000 7f9ecac0b700 1 -- start start 2023-10-08T16:05:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ecac0b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ec406d2e0 0x7f9ec40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ecac0b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ec406d6b0 0x7f9ec40c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ecac0b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec40c8760 con 0x7f9ec40cc450 2023-10-08T16:05:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ecac0b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec40c7930 con 0x7f9ec406d2e0 2023-10-08T16:05:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ecac0b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec40af6e0 con 0x7f9ec406d6b0 2023-10-08T16:05:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7fa9158aa700 1 Processor -- start 2023-10-08T16:05:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ec91a8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ec406d6b0 0x7f9ec40c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ec91a8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ec406d6b0 0x7f9ec40c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37268/0 (socket says 172.21.15.60:37268) 2023-10-08T16:05:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ec89a7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ec406d2e0 0x7f9ec40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1336652576 learned_addr learned my addr 172.21.15.60:0/1336652576 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1336652576 >> v2:172.21.15.60:3300/0 conn(0x7f9ec406d2e0 msgr2=0x7f9ec40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f9ec91a8700 1 --2- 172.21.15.60:0/1336652576 >> v2:172.21.15.60:3300/0 conn(0x7f9ec406d2e0 0x7f9ec40c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1336652576 >> v1:172.21.15.144:6789/0 conn(0x7f9ec40cc450 legacy=0x7f9ec4068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1336652576 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40c7b50 con 0x7f9ec406d6b0 2023-10-08T16:05:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f9ec89a7700 1 --2- 172.21.15.60:0/1336652576 >> v2:172.21.15.60:3300/0 conn(0x7f9ec406d2e0 0x7f9ec40c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f026958b700 1 Processor -- start 2023-10-08T16:05:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f026958b700 1 -- start start 2023-10-08T16:05:13.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7f9ec91a8700 1 --2- 172.21.15.60:0/1336652576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c73f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c86d0 tx=0x7f9ebc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf6724711b8b20a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.894+0000 7fa9158aa700 1 -- start start 2023-10-08T16:05:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.895+0000 7fa9158aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa91006d2e0 0x7fa9100c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa9158aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa9158aa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100c8760 con 0x7fa91006d6b0 2023-10-08T16:05:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa9158aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9100c7930 con 0x7fa91006d2e0 2023-10-08T16:05:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa9158aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100af6e0 con 0x7fa910156270 2023-10-08T16:05:13.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa90effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa91006d2e0 0x7fa9100c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7f06bbea7700 1 Processor -- start 2023-10-08T16:05:13.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35666/0 (socket says 172.21.15.60:35666) 2023-10-08T16:05:13.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7fa90f7fe700 1 -- 172.21.15.60:0/2733174947 learned_addr learned my addr 172.21.15.60:0/2733174947 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7f06bbea7700 1 -- start start 2023-10-08T16:05:13.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7f9ec37fe700 1 -- 172.21.15.60:0/1336652576 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00e070 con 0x7f9ec406d6b0 2023-10-08T16:05:13.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7f9ec37fe700 1 -- 172.21.15.60:0/1336652576 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00b9e0 con 0x7f9ec406d6b0 2023-10-08T16:05:13.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.896+0000 7f9ec37fe700 1 -- 172.21.15.60:0/1336652576 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0092e0 con 0x7f9ec406d6b0 2023-10-08T16:05:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f026958b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f026406d4c0 0x7f02640bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f026958b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640c7960 con 0x7f02640ac1a0 2023-10-08T16:05:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f026958b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640c7c40 con 0x7f02640bf970 2023-10-08T16:05:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f026958b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640c7f20 con 0x7f026406d4c0 2023-10-08T16:05:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fb35361b700 1 Processor -- start 2023-10-08T16:05:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f0262ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f02640bf970 0x7f026406ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:50890/0 (socket says 172.21.15.60:50890) 2023-10-08T16:05:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f0262ffd700 1 -- 172.21.15.60:0/1455244632 learned_addr learned my addr 172.21.15.60:0/1455244632 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fa90f7fe700 1 -- 172.21.15.60:0/2733174947 >> v2:172.21.15.144:3300/0 conn(0x7fa91006d2e0 msgr2=0x7fa9100c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fa90f7fe700 1 --2- 172.21.15.60:0/2733174947 >> v2:172.21.15.144:3300/0 conn(0x7fa91006d2e0 0x7fa9100c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fa90f7fe700 1 -- 172.21.15.60:0/2733174947 >> v1:172.21.15.60:6789/0 conn(0x7fa91006d6b0 legacy=0x7fa910155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fa90f7fe700 1 -- 172.21.15.60:0/2733174947 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100c7b50 con 0x7fa910156270 2023-10-08T16:05:13.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1336652576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 msgr2=0x7f9ec40c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1336652576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c73f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c86d0 tx=0x7f9ebc009840 comp rx=0 tx=0).stop 2023-10-08T16:05:13.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f06bbea7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06b40c9560 0x7f06b4157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f06bbea7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06b4069de0 0x7f06b4157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f06bbea7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b4069060 con 0x7f06b40c9930 2023-10-08T16:05:13.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f06bbea7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b4069300 con 0x7f06b40c9560 2023-10-08T16:05:13.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f06bbea7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b40695e0 con 0x7f06b4069de0 2023-10-08T16:05:13.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fb35361b700 1 -- start start 2023-10-08T16:05:13.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7fa90f7fe700 1 --2- 172.21.15.60:0/2733174947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100c73f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9000089b0 tx=0x7fa9000082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfeb1acac8caa71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.897+0000 7f025a7fc700 1 --2- 172.21.15.60:0/1455244632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f026406d4c0 0x7f02640bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402239070 0 0) 0x7f02640c7c40 con 0x7f02640bf970 2023-10-08T16:05:13.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0250003570 con 0x7f02640bf970 2023-10-08T16:05:13.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fa90dffb700 1 -- 172.21.15.60:0/2733174947 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900010070 con 0x7fa910156270 2023-10-08T16:05:13.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fa90dffb700 1 -- 172.21.15.60:0/2733174947 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90000da40 con 0x7fa910156270 2023-10-08T16:05:13.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fa90dffb700 1 -- 172.21.15.60:0/2733174947 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000dde0 con 0x7fa910156270 2023-10-08T16:05:13.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06b40c9560 0x7f06b4157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06b40c9560 0x7f06b4157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34890/0 (socket says 172.21.15.60:34890) 2023-10-08T16:05:13.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 -- 172.21.15.60:0/2373093230 learned_addr learned my addr 172.21.15.60:0/2373093230 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32770408 0 0) 0x7f02640c7960 con 0x7f02640ac1a0 2023-10-08T16:05:13.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02640c7c40 con 0x7f02640ac1a0 2023-10-08T16:05:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f025a7fc700 1 -- 172.21.15.60:0/1455244632 >> v1:172.21.15.144:6789/0 conn(0x7f02640bf970 legacy=0x7f026406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f025a7fc700 1 -- 172.21.15.60:0/1455244632 >> v1:172.21.15.60:6789/0 conn(0x7f02640ac1a0 legacy=0x7f02640ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f025a7fc700 1 -- 172.21.15.60:0/1455244632 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640c8200 con 0x7f026406d4c0 2023-10-08T16:05:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 -- 172.21.15.60:0/2373093230 >> v2:172.21.15.144:3300/0 conn(0x7f06b4069de0 msgr2=0x7f06b4157f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:05:13.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 --2- 172.21.15.60:0/2373093230 >> v2:172.21.15.144:3300/0 conn(0x7f06b4069de0 0x7f06b4157f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 -- 172.21.15.60:0/2373093230 >> v1:172.21.15.144:6789/0 conn(0x7f06b40c9930 legacy=0x7f06b415bc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:05:13.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 -- 172.21.15.60:0/2373093230 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40698c0 con 0x7f06b40c9560 2023-10-08T16:05:13.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fb35361b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e4e0 0x7fb34c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fb35361b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb34c068880 0x7fb34c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fb35361b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c162150 con 0x7fb34c15e110 2023-10-08T16:05:13.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fb35361b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c161eb0 con 0x7fb34c068880 2023-10-08T16:05:13.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7fb35361b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c8330 con 0x7fb34c15e4e0 2023-10-08T16:05:13.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.898+0000 7f06b9c43700 1 --2- 172.21.15.60:0/2373093230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b40c9560 0x7f06b4157a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06b40aeff0 tx=0x7f06b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb016b866896719 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb3513b7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb34c15e110 0x7fb34c1625e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39578/0 (socket says 172.21.15.60:39578) 2023-10-08T16:05:13.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb3513b7700 1 -- 172.21.15.60:0/3256889670 learned_addr learned my addr 172.21.15.60:0/3256889670 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:13.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb350bb6700 1 --2- 172.21.15.60:0/3256889670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e4e0 0x7fb34c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fa9158aa700 1 -- 172.21.15.60:0/2733174947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 msgr2=0x7fa9100c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fa9158aa700 1 --2- 172.21.15.60:0/2733174947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100c73f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9000089b0 tx=0x7fa9000082d0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f06b8c41700 1 -- 172.21.15.60:0/2373093230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000b820 con 0x7f06b40c9560 2023-10-08T16:05:13.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f025a7fc700 1 --2- 172.21.15.60:0/1455244632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f026406d4c0 0x7f02640bfd40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f024c009910 tx=0x7f024c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2645624e91816a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fa9158aa700 1 -- 172.21.15.60:0/2733174947 shutdown_connections 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fa9158aa700 1 --2- 172.21.15.60:0/2733174947 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100c73f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fa9158aa700 1 --2- 172.21.15.60:0/2733174947 >> v2:172.21.15.144:3300/0 conn(0x7fa91006d2e0 0x7fa9100c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fa9158aa700 1 -- 172.21.15.60:0/2733174947 >> 172.21.15.60:0/2733174947 conn(0x7fa910070700 msgr2=0x7fa910070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb351bb8700 1 --2- 172.21.15.60:0/3256889670 >> v2:172.21.15.60:3300/0 conn(0x7fb34c068880 0x7fb34c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb343fff700 1 -- 172.21.15.60:0/3256889670 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185070071 0 0) 0x7fb34c162150 con 0x7fb34c15e110 2023-10-08T16:05:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb343fff700 1 -- 172.21.15.60:0/3256889670 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb338003570 con 0x7fb34c15e110 2023-10-08T16:05:13.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f06b8c41700 1 -- 172.21.15.60:0/2373093230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b000b980 con 0x7f06b40c9560 2023-10-08T16:05:13.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f06b8c41700 1 -- 172.21.15.60:0/2373093230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000bd20 con 0x7f06b40c9560 2023-10-08T16:05:13.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb351bb8700 1 -- 172.21.15.60:0/3256889670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e4e0 msgr2=0x7fb34c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb351bb8700 1 --2- 172.21.15.60:0/3256889670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e4e0 0x7fb34c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb351bb8700 1 -- 172.21.15.60:0/3256889670 >> v1:172.21.15.60:6789/0 conn(0x7fb34c15e110 legacy=0x7fb34c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb351bb8700 1 -- 172.21.15.60:0/3256889670 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c06a4e0 con 0x7fb34c068880 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7fb351bb8700 1 --2- 172.21.15.60:0/3256889670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c068880 0x7fb34c06ea90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb344009e60 tx=0x7fb344009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1b2d8e7e2bd69e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7fb343fff700 1 -- 172.21.15.60:0/3256889670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400e070 con 0x7fb34c068880 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7fb343fff700 1 -- 172.21.15.60:0/3256889670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400bab0 con 0x7fb34c068880 2023-10-08T16:05:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7fb343fff700 1 -- 172.21.15.60:0/3256889670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400be70 con 0x7fb34c068880 2023-10-08T16:05:13.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 -- 172.21.15.60:0/2373093230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b40c9560 msgr2=0x7f06b4157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 --2- 172.21.15.60:0/2373093230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b40c9560 0x7f06b4157a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06b40aeff0 tx=0x7f06b0009250 comp rx=0 tx=0).stop 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00b690 con 0x7f026406d4c0 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00b7f0 con 0x7f026406d4c0 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f02627fc700 1 -- 172.21.15.60:0/1455244632 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00bb90 con 0x7f026406d4c0 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f026958b700 1 -- 172.21.15.60:0/1455244632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f026406d4c0 msgr2=0x7f02640bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f026958b700 1 --2- 172.21.15.60:0/1455244632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f026406d4c0 0x7f02640bfd40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f024c009910 tx=0x7f024c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1336652576 shutdown_connections 2023-10-08T16:05:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1336652576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c73f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1336652576 >> v2:172.21.15.60:3300/0 conn(0x7f9ec406d2e0 0x7f9ec40c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1336652576 >> 172.21.15.60:0/1336652576 conn(0x7f9ec4070700 msgr2=0x7f9ec4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1336652576 shutdown_connections 2023-10-08T16:05:13.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.899+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1336652576 wait complete. 2023-10-08T16:05:13.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7fa9158aa700 1 -- 172.21.15.60:0/2733174947 shutdown_connections 2023-10-08T16:05:13.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 -- 172.21.15.60:0/2373093230 shutdown_connections 2023-10-08T16:05:13.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 --2- 172.21.15.60:0/2373093230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b40c9560 0x7f06b4157a50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 --2- 172.21.15.60:0/2373093230 >> v2:172.21.15.144:3300/0 conn(0x7f06b4069de0 0x7f06b4157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 -- 172.21.15.60:0/2373093230 >> 172.21.15.60:0/2373093230 conn(0x7f06b4067660 msgr2=0x7f06b4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f026958b700 1 -- 172.21.15.60:0/1455244632 shutdown_connections 2023-10-08T16:05:13.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f026958b700 1 --2- 172.21.15.60:0/1455244632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f026406d4c0 0x7f02640bfd40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f026958b700 1 -- 172.21.15.60:0/1455244632 >> 172.21.15.60:0/1455244632 conn(0x7f0264067660 msgr2=0x7f0264067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7fb35361b700 1 -- 172.21.15.60:0/3256889670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c068880 msgr2=0x7fb34c06ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7fb35361b700 1 --2- 172.21.15.60:0/3256889670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c068880 0x7fb34c06ea90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb344009e60 tx=0x7fb344009780 comp rx=0 tx=0).stop 2023-10-08T16:05:13.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 -- 172.21.15.60:0/2373093230 shutdown_connections 2023-10-08T16:05:13.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f06bbea7700 1 -- 172.21.15.60:0/2373093230 wait complete. 2023-10-08T16:05:13.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7fb35361b700 1 -- 172.21.15.60:0/3256889670 shutdown_connections 2023-10-08T16:05:13.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7fb35361b700 1 --2- 172.21.15.60:0/3256889670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c068880 0x7fb34c06ea90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7fb35361b700 1 --2- 172.21.15.60:0/3256889670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e4e0 0x7fb34c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7fb35361b700 1 -- 172.21.15.60:0/3256889670 >> 172.21.15.60:0/3256889670 conn(0x7fb34c0cda50 msgr2=0x7fb34c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7f9ecac0b700 1 Processor -- start 2023-10-08T16:05:13.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.902+0000 7f06bbea7700 1 Processor -- start 2023-10-08T16:05:13.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.900+0000 7f026958b700 1 -- 172.21.15.60:0/1455244632 shutdown_connections 2023-10-08T16:05:13.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7f026958b700 1 -- 172.21.15.60:0/1455244632 wait complete. 2023-10-08T16:05:13.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7fa9158aa700 1 -- 172.21.15.60:0/2733174947 wait complete. 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.901+0000 7f9ecac0b700 1 -- start start 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ecac0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec406d2e0 0x7f9ec40c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ecac0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ecac0b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ec40cc450 0x7f9ec416ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ecac0b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c7540 con 0x7f9ec40cc450 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ecac0b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4171be0 con 0x7f9ec406d6b0 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ecac0b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4171ec0 con 0x7f9ec406d2e0 2023-10-08T16:05:13.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7fa9158aa700 1 Processor -- start 2023-10-08T16:05:13.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7fa9158aa700 1 -- start start 2023-10-08T16:05:13.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ec3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ec3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37280/0 (socket says 172.21.15.60:37280) 2023-10-08T16:05:13.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f9ec3fff700 1 -- 172.21.15.60:0/1707781896 learned_addr learned my addr 172.21.15.60:0/1707781896 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.902+0000 7f06bbea7700 1 -- start start 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06bbea7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 0x7f06b406d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06bbea7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06b40c9560 0x7f06b406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06bbea7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06b40c9930 0x7f06b415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06bbea7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b414c700 con 0x7f06b4069de0 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06bbea7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b416fbe0 con 0x7f06b40c9930 2023-10-08T16:05:13.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06bbea7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40c6eb0 con 0x7f06b40c9560 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.902+0000 7f026958b700 1 Processor -- start 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.903+0000 7f026958b700 1 -- start start 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f026958b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026406d4c0 0x7f02640c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f026958b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02640ac1a0 0x7f02640c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f026958b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 0x7f02640c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f026958b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640aef80 con 0x7f026406d4c0 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f026958b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640b0b10 con 0x7f02640ac1a0 2023-10-08T16:05:13.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f026958b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640ae9c0 con 0x7f02640bf970 2023-10-08T16:05:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 0x7f06b406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 0x7f06b406d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34910/0 (socket says 172.21.15.60:34910) 2023-10-08T16:05:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 -- 172.21.15.60:0/781179051 learned_addr learned my addr 172.21.15.60:0/781179051 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06ba444700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06b40c9930 0x7f06b415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f9ec89a7700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec406d2e0 0x7f9ec40c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f02637fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 0x7f02640c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f02637fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 0x7f02640c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35688/0 (socket says 172.21.15.60:35688) 2023-10-08T16:05:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f02637fe700 1 -- 172.21.15.60:0/3175912153 learned_addr learned my addr 172.21.15.60:0/3175912153 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f0262ffd700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026406d4c0 0x7f02640c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 -- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06b40c9560 msgr2=0x7f06b406d5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06b40c9560 0x7f06b406d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 -- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06b40c9930 msgr2=0x7f06b415acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06b40c9930 0x7f06b415acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa9158aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91006d2e0 0x7fa91014de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa9158aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 0x7fa9100c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa9158aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa9158aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91014e390 con 0x7fa91006d6b0 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa9158aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91016afc0 con 0x7fa91006d2e0 2023-10-08T16:05:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa9158aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91016a3f0 con 0x7fa910156270 2023-10-08T16:05:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f06b9c43700 1 -- 172.21.15.60:0/781179051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00094f0 con 0x7f06b4069de0 2023-10-08T16:05:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7fa90e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 0x7fa9100c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 0x7fa9100c2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34918/0 (socket says 172.21.15.60:34918) 2023-10-08T16:05:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 -- 172.21.15.60:0/807591291 learned_addr learned my addr 172.21.15.60:0/807591291 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fb35361b700 1 -- 172.21.15.60:0/3256889670 shutdown_connections 2023-10-08T16:05:13.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.904+0000 7f9ec91a8700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ec40cc450 0x7f9ec416ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f02637fe700 1 -- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02640ac1a0 msgr2=0x7f02640c42f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:05:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f02637fe700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02640ac1a0 0x7f02640c42f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f02637fe700 1 -- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026406d4c0 msgr2=0x7f02640c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f02637fe700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026406d4c0 0x7f02640c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f02637fe700 1 -- 172.21.15.60:0/3175912153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009420 con 0x7f02640bf970 2023-10-08T16:05:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f06b9c43700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 0x7f06b406d090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06b0003080 tx=0x7f06b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec406d2e0 msgr2=0x7f9ec40c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f9ec91a8700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec406d2e0 0x7f9ec40c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 msgr2=0x7f9ec40c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f9ec91a8700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f9ec91a8700 1 -- 172.21.15.60:0/1707781896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009420 con 0x7f9ec40cc450 2023-10-08T16:05:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011db0 con 0x7f06b4069de0 2023-10-08T16:05:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0020070 con 0x7f06b4069de0 2023-10-08T16:05:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b001b6a0 con 0x7f06b4069de0 2023-10-08T16:05:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7f9ec91a8700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ec40cc450 0x7f9ec416ef30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc014000 tx=0x7f9ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 -- 172.21.15.60:0/807591291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 msgr2=0x7fa9100aa880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:13.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100aa880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 -- 172.21.15.60:0/807591291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91006d2e0 msgr2=0x7fa91014de50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:13.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91006d2e0 0x7fa91014de50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 -- 172.21.15.60:0/807591291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900008570 con 0x7fa91006d6b0 2023-10-08T16:05:13.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.905+0000 7fa90e7fc700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 0x7fa9100c2a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b5e0 tx=0x7fa904009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400f510 con 0x7fa91006d6b0 2023-10-08T16:05:13.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400f690 con 0x7fa91006d6b0 2023-10-08T16:05:13.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400fa50 con 0x7fa91006d6b0 2023-10-08T16:05:13.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f02637fe700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 0x7f02640c4830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c590 tx=0x7f025c007d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0032f0 con 0x7f9ec40cc450 2023-10-08T16:05:13.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc012e70 con 0x7f9ec40cc450 2023-10-08T16:05:13.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc009ae0 con 0x7f9ec40cc450 2023-10-08T16:05:13.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc01d630 con 0x7f9ec40cc450 2023-10-08T16:05:13.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec4172480 con 0x7f9ec40cc450 2023-10-08T16:05:13.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91016a690 con 0x7fa91006d6b0 2023-10-08T16:05:13.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91016ac50 con 0x7fa91006d6b0 2023-10-08T16:05:13.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b416f2b0 con 0x7f06b4069de0 2023-10-08T16:05:13.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.906+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b416f870 con 0x7f06b4069de0 2023-10-08T16:05:13.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.908+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c016070 con 0x7f02640bf970 2023-10-08T16:05:13.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.908+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c011590 con 0x7f02640bf970 2023-10-08T16:05:13.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.908+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c011970 con 0x7f02640bf970 2023-10-08T16:05:13.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.908+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02640aeca0 con 0x7f02640bf970 2023-10-08T16:05:13.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.908+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02640c4070 con 0x7f02640bf970 2023-10-08T16:05:13.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.908+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa90401a400 con 0x7fa91006d6b0 2023-10-08T16:05:13.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.909+0000 7fb35361b700 1 -- 172.21.15.60:0/3256889670 wait complete. 2023-10-08T16:05:13.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.909+0000 7fa8f6ffd700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8fc066f30 0x7fa8fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.909+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9040840e0 con 0x7fa91006d6b0 2023-10-08T16:05:13.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.910+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91004c3c0 con 0x7fa91006d6b0 2023-10-08T16:05:13.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.909+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b416fec0 con 0x7f06b4069de0 2023-10-08T16:05:13.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.910+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02480052b0 con 0x7f02640bf970 2023-10-08T16:05:13.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.911+0000 7fa90effd700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8fc066f30 0x7fa8fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.911+0000 7fb35361b700 1 Processor -- start 2023-10-08T16:05:13.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.911+0000 7fb35361b700 1 -- start start 2023-10-08T16:05:13.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.910+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ebc01da20 con 0x7f9ec40cc450 2023-10-08T16:05:13.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.910+0000 7f9ec0ff9700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9eb0067080 0x7f9eb0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.910+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ebc085d20 con 0x7f9ec40cc450 2023-10-08T16:05:13.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.911+0000 7f9ec89a7700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9eb0067080 0x7f9eb0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.911+0000 7f9ec89a7700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9eb0067080 0x7f9eb0069530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c0290 tx=0x7f9eb40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea40052b0 con 0x7f9ec40cc450 2023-10-08T16:05:13.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f025c012420 con 0x7f02640bf970 2023-10-08T16:05:13.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7fb35361b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c068880 0x7fb34c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7fb35361b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e110 0x7fb34c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7fb35361b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 0x7fb34c16e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7fb35361b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c4480 con 0x7fb34c0c7720 2023-10-08T16:05:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7fb35361b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c16f3d0 con 0x7fb34c068880 2023-10-08T16:05:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.912+0000 7fb35361b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c16f0f0 con 0x7fb34c15e110 2023-10-08T16:05:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fa90effd700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8fc066f30 0x7fa8fc0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa90800e260 tx=0x7fa90800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 0x7fb34c16e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb3513b7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c068880 0x7fb34c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 0x7fb34c16e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34932/0 (socket says 172.21.15.60:34932) 2023-10-08T16:05:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 -- 172.21.15.60:0/2549512951 learned_addr learned my addr 172.21.15.60:0/2549512951 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7f025b7fe700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0244066f30 0x7f02440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f025c0840e0 con 0x7f02640bf970 2023-10-08T16:05:13.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7f0262ffd700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0244066f30 0x7f02440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 -- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e110 msgr2=0x7fb34c0c71e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:05:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e110 0x7fb34c0c71e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 -- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c068880 msgr2=0x7fb34c0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c068880 0x7fb34c0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 -- 172.21.15.60:0/2549512951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009a20 con 0x7fb34c0c7720 2023-10-08T16:05:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb3513b7700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c068880 0x7fb34c0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.913+0000 7fb351bb8700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 0x7fb34c16e510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb344013000 tx=0x7fb344019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.914+0000 7f0262ffd700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0244066f30 0x7f02440693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0254005c50 tx=0x7f0254009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.915+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06b0022030 con 0x7f06b4069de0 2023-10-08T16:05:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.915+0000 7f06a5ffb700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f06a00671e0 0x7f06a0069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.915+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06b0086810 con 0x7f06b4069de0 2023-10-08T16:05:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.915+0000 7f06b9442700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f06a00671e0 0x7f06a0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.916+0000 7f06b9442700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f06a00671e0 0x7f06a0069690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06b406dbf0 tx=0x7f06a8006c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.916+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa904054e60 con 0x7fa91006d6b0 2023-10-08T16:05:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.918+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f025c051350 con 0x7f02640bf970 2023-10-08T16:05:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.924+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344012ea0 con 0x7fb34c0c7720 2023-10-08T16:05:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.924+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0c4ba0 con 0x7fb34c0c7720 2023-10-08T16:05:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.925+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0c5160 con 0x7fb34c0c7720 2023-10-08T16:05:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.925+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06b0053ae0 con 0x7f06b4069de0 2023-10-08T16:05:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.933+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ebc056a00 con 0x7f9ec40cc450 2023-10-08T16:05:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.934+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344027680 con 0x7fb34c0c7720 2023-10-08T16:05:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.934+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440277f0 con 0x7fb34c0c7720 2023-10-08T16:05:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.935+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb344024070 con 0x7fb34c0c7720 2023-10-08T16:05:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.935+0000 7fb3417fa700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb338067360 0x7fb338069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.935+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3440868e0 con 0x7fb34c0c7720 2023-10-08T16:05:13.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.936+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c0052b0 con 0x7fb34c0c7720 2023-10-08T16:05:13.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.944+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb344053b90 con 0x7fb34c0c7720 2023-10-08T16:05:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.945+0000 7f2b2b24c700 1 Processor -- start 2023-10-08T16:05:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.945+0000 7f2b2b24c700 1 -- start start 2023-10-08T16:05:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.946+0000 7f2b2b24c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b24156ea0 0x7f2b240c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.946+0000 7f2b2b24c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b24157270 0x7f2b2406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.946+0000 7f2b2b24c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b240c42b0 con 0x7f2b2406e2b0 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.946+0000 7f2b2b24c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240c36a0 con 0x7f2b24156ea0 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.946+0000 7f2b2b24c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c3980 con 0x7f2b24157270 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.946+0000 7f2b28fe8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b24156ea0 0x7f2b240c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b24156ea0 0x7f2b240c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37320/0 (socket says 172.21.15.60:37320) 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 -- 172.21.15.60:0/2327293781 learned_addr learned my addr 172.21.15.60:0/2327293781 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b23fff700 1 --2- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b24157270 0x7f2b2406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 -- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b24157270 msgr2=0x7f2b2406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 --2- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b24157270 0x7f2b2406f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 -- 172.21.15.60:0/2327293781 >> v1:172.21.15.60:6789/0 conn(0x7f2b2406e2b0 legacy=0x7f2b2415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 -- 172.21.15.60:0/2327293781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240c3c60 con 0x7f2b24156ea0 2023-10-08T16:05:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7f2b28fe8700 1 --2- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b240c30c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000bc50 tx=0x7f2b1000b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99f0d286bb948fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.947+0000 7fb3513b7700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb338067360 0x7fb338069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.948+0000 7f2b237fe700 1 -- 172.21.15.60:0/2327293781 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000be60 con 0x7f2b24156ea0 2023-10-08T16:05:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.948+0000 7f2b237fe700 1 -- 172.21.15.60:0/2327293781 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1000ddc0 con 0x7f2b24156ea0 2023-10-08T16:05:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.948+0000 7f2b237fe700 1 -- 172.21.15.60:0/2327293781 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100106a0 con 0x7f2b24156ea0 2023-10-08T16:05:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.948+0000 7fb3513b7700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb338067360 0x7fb338069810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fd0 tx=0x7fb33c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.949+0000 7f2b2b24c700 1 -- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 msgr2=0x7f2b240c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.949+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b240c30c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000bc50 tx=0x7f2b1000b4f0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.950+0000 7f2b2b24c700 1 -- 172.21.15.60:0/2327293781 shutdown_connections 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.950+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b240c30c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.950+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/2327293781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b24157270 0x7f2b2406f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.950+0000 7f2b2b24c700 1 -- 172.21.15.60:0/2327293781 >> 172.21.15.60:0/2327293781 conn(0x7f2b240ca4f0 msgr2=0x7f2b240ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.951+0000 7f2b2b24c700 1 -- 172.21.15.60:0/2327293781 shutdown_connections 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.951+0000 7f2b2b24c700 1 -- 172.21.15.60:0/2327293781 wait complete. 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.953+0000 7f2b2b24c700 1 Processor -- start 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.953+0000 7f2b2b24c700 1 -- start start 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b2b24c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b2406e2b0 0x7f2b24153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b2b24c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b24166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b2b24c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24157270 0x7f2b24166e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b2b24c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24167660 con 0x7f2b24157270 2023-10-08T16:05:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b2b24c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24167390 con 0x7f2b24156ea0 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b2b24c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24154a00 con 0x7f2b2406e2b0 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b28fe8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b2406e2b0 0x7f2b24153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b23fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b24166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b28fe8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b2406e2b0 0x7f2b24153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35724/0 (socket says 172.21.15.60:35724) 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.954+0000 7f2b28fe8700 1 -- 172.21.15.60:0/3198574570 learned_addr learned my addr 172.21.15.60:0/3198574570 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b23fff700 1 -- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b2406e2b0 msgr2=0x7f2b24153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b23fff700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b2406e2b0 0x7f2b24153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b23fff700 1 -- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24157270 msgr2=0x7f2b24166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b23fff700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24157270 0x7f2b24166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b23fff700 1 -- 172.21.15.60:0/3198574570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1000b790 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b23fff700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b24166910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b24157680 tx=0x7f2b18008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18014620 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18014780 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18014b40 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b24154ce0 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.955+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b241552a0 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.957+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b1801d400 con 0x7f2b24156ea0 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.958+0000 7f2b20ff9700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b08066f30 0x7f2b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.958+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b18084d40 con 0x7f2b24156ea0 2023-10-08T16:05:13.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.959+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b040052b0 con 0x7f2b24156ea0 2023-10-08T16:05:13.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.969+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b18055a40 con 0x7f2b24156ea0 2023-10-08T16:05:13.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.974+0000 7f2b28fe8700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b08066f30 0x7f2b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.988+0000 7f4ec4eae700 1 Processor -- start 2023-10-08T16:05:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.988+0000 7f4ec4eae700 1 -- start start 2023-10-08T16:05:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.989+0000 7f4ec4eae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 0x7f4ec00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.989+0000 7f4ec4eae700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ec0156270 0x7f4ec00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.989+0000 7f4ec4eae700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec00c8760 con 0x7f4ec006d6b0 2023-10-08T16:05:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.989+0000 7f4ec4eae700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec00c7930 con 0x7f4ec0156270 2023-10-08T16:05:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.990+0000 7f4ec4eae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00af6e0 con 0x7f4ec006d2e0 2023-10-08T16:05:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.988+0000 7f2b28fe8700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b08066f30 0x7f2b080693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000b730 tx=0x7f2b1001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.990+0000 7f4ebe59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 0x7f4ec00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.990+0000 7f4ebe59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 0x7f4ec00c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35734/0 (socket says 172.21.15.60:35734) 2023-10-08T16:05:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.990+0000 7f4ebe59c700 1 -- 172.21.15.60:0/860183721 learned_addr learned my addr 172.21.15.60:0/860183721 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.990+0000 7f4ebed9d700 1 --2- 172.21.15.60:0/860183721 >> v2:172.21.15.144:3300/0 conn(0x7f4ec0156270 0x7f4ec00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebe59c700 1 -- 172.21.15.60:0/860183721 >> v2:172.21.15.144:3300/0 conn(0x7f4ec0156270 msgr2=0x7f4ec00c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebe59c700 1 --2- 172.21.15.60:0/860183721 >> v2:172.21.15.144:3300/0 conn(0x7f4ec0156270 0x7f4ec00c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebe59c700 1 -- 172.21.15.60:0/860183721 >> v1:172.21.15.144:6789/0 conn(0x7f4ec006d6b0 legacy=0x7f4ec0155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebe59c700 1 -- 172.21.15.60:0/860183721 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00c7b50 con 0x7f4ec006d2e0 2023-10-08T16:05:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebe59c700 1 --2- 172.21.15.60:0/860183721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 0x7f4ec00c6eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40089b0 tx=0x7f4eb40082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60f325ddf2aaf637 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebd59a700 1 -- 172.21.15.60:0/860183721 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4010070 con 0x7f4ec006d2e0 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebd59a700 1 -- 172.21.15.60:0/860183721 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400da80 con 0x7f4ec006d2e0 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.991+0000 7f4ebd59a700 1 -- 172.21.15.60:0/860183721 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400de20 con 0x7f4ec006d2e0 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.992+0000 7f4ec4eae700 1 -- 172.21.15.60:0/860183721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 msgr2=0x7f4ec00c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.992+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/860183721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 0x7f4ec00c6eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40089b0 tx=0x7f4eb40082d0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.993+0000 7f4ec4eae700 1 -- 172.21.15.60:0/860183721 shutdown_connections 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.993+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/860183721 >> v2:172.21.15.144:3300/0 conn(0x7f4ec0156270 0x7f4ec00c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.993+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/860183721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d2e0 0x7f4ec00c6eb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.993+0000 7f4ec4eae700 1 -- 172.21.15.60:0/860183721 >> 172.21.15.60:0/860183721 conn(0x7f4ec0070700 msgr2=0x7f4ec0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:13.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.993+0000 7f4ec4eae700 1 -- 172.21.15.60:0/860183721 shutdown_connections 2023-10-08T16:05:13.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.993+0000 7f4ec4eae700 1 -- 172.21.15.60:0/860183721 wait complete. 2023-10-08T16:05:13.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.995+0000 7f4ec4eae700 1 Processor -- start 2023-10-08T16:05:13.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.995+0000 7f4ec4eae700 1 -- start start 2023-10-08T16:05:13.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ec4eae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec006d2e0 0x7f4ec00c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ec4eae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 0x7f4ec0154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ec4eae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec0156270 0x7f4ec01586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:13.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ec4eae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00c2170 con 0x7f4ec0156270 2023-10-08T16:05:13.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ec4eae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00c12c0 con 0x7f4ec006d2e0 2023-10-08T16:05:13.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ec4eae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00c1560 con 0x7f4ec006d6b0 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ebdd9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 0x7f4ec0154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ebdd9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 0x7f4ec0154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35748/0 (socket says 172.21.15.60:35748) 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.996+0000 7f4ebdd9b700 1 -- 172.21.15.60:0/4026748647 learned_addr learned my addr 172.21.15.60:0/4026748647 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebed9d700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec0156270 0x7f4ec01586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebed9d700 1 -- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 msgr2=0x7f4ec0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebed9d700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 0x7f4ec0154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebed9d700 1 -- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec006d2e0 msgr2=0x7f4ec00c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebed9d700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec006d2e0 0x7f4ec00c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebed9d700 1 -- 172.21.15.60:0/4026748647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4008570 con 0x7f4ec0156270 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.997+0000 7f4ebdd9b700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 0x7f4ec0154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.998+0000 7f4ebed9d700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec0156270 0x7f4ec01586e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800ecc0 tx=0x7f4eb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.998+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800c970 con 0x7f4ec0156270 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.998+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb800f040 con 0x7f4ec0156270 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.998+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800cd40 con 0x7f4ec0156270 2023-10-08T16:05:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.998+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec00c1840 con 0x7f4ec0156270 2023-10-08T16:05:14.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:13.998+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec00c1e00 con 0x7f4ec0156270 2023-10-08T16:05:14.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.009+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea40052b0 con 0x7f4ec0156270 2023-10-08T16:05:14.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.011+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4eb8014690 con 0x7f4ec0156270 2023-10-08T16:05:14.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.011+0000 7f4eae7fc700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea8067210 0x7f4ea80696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:14.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.012+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4eb8085530 con 0x7f4ec0156270 2023-10-08T16:05:14.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.012+0000 7f4ebe59c700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea8067210 0x7f4ea80696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:14.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.013+0000 7f4ebe59c700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea8067210 0x7f4ea80696c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40089b0 tx=0x7f4eb401c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:14.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.018+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4eb8052800 con 0x7f4ec0156270 2023-10-08T16:05:14.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.287+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c20168d70 con 0x7f8c200ccaf0 2023-10-08T16:05:14.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.288+0000 7f8c1cff9700 1 -- 172.21.15.60:0/1377193281 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c20168d70 con 0x7f8c200ccaf0 2023-10-08T16:05:14.292 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-10-08T16:05:14.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.292+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8c0c067080 msgr2=0x7f8c0c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.292+0000 7f8c26de6700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8c0c067080 0x7f8c0c069530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c2017df70 tx=0x7f8c14008040 comp rx=0 tx=0).stop 2023-10-08T16:05:14.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.292+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c200ccaf0 msgr2=0x7f8c20168830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.292+0000 7f8c26de6700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c200ccaf0 0x7f8c20168830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c18015000 tx=0x7f8c18018000 comp rx=0 tx=0).stop 2023-10-08T16:05:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 shutdown_connections 2023-10-08T16:05:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8c0c067080 0x7f8c0c069530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c2016a060 0x7f8c2017d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c200af910 0x7f8c201889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 --2- 172.21.15.60:0/1377193281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c200ccaf0 0x7f8c20168830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 >> 172.21.15.60:0/1377193281 conn(0x7f8c20070700 msgr2=0x7f8c200c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 shutdown_connections 2023-10-08T16:05:14.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.295+0000 7f8c26de6700 1 -- 172.21.15.60:0/1377193281 wait complete. 2023-10-08T16:05:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.299+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa91016b130 con 0x7fa91006d6b0 2023-10-08T16:05:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.301+0000 7fa8f6ffd700 1 -- 172.21.15.60:0/807591291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9040549f0 con 0x7fa91006d6b0 2023-10-08T16:05:14.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.311+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb32c005830 con 0x7fb34c0c7720 2023-10-08T16:05:14.312 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.312+0000 7fb3417fa700 1 -- 172.21.15.60:0/2549512951 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3440571b0 con 0x7fb34c0c7720 2023-10-08T16:05:14.316 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.314+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8fc066f30 msgr2=0x7fa8fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.314+0000 7fa9158aa700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8fc066f30 0x7fa8fc0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa90800e260 tx=0x7fa90800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:14.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.314+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 msgr2=0x7fa9100c2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.314+0000 7fa9158aa700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 0x7fa9100c2a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b5e0 tx=0x7fa904009120 comp rx=0 tx=0).stop 2023-10-08T16:05:14.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-08T16:05:14.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.315+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb338067360 msgr2=0x7fb338069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.315+0000 7fb35361b700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb338067360 0x7fb338069810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fd0 tx=0x7fb33c009040 comp rx=0 tx=0).stop 2023-10-08T16:05:14.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.315+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 msgr2=0x7fb34c16e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.315+0000 7fb35361b700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 0x7fb34c16e510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb344013000 tx=0x7fb344019000 comp rx=0 tx=0).stop 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.316+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 shutdown_connections 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.316+0000 7fb35361b700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb338067360 0x7fb338069810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.316+0000 7fb35361b700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb34c0c7720 0x7fb34c16e510 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.316+0000 7fb35361b700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c068880 0x7fb34c0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.316+0000 7fb35361b700 1 --2- 172.21.15.60:0/2549512951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb34c15e110 0x7fb34c0c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.316+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 >> 172.21.15.60:0/2549512951 conn(0x7fb34c0cda50 msgr2=0x7fb34c15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 shutdown_connections 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 shutdown_connections 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8fc066f30 0x7fa8fc0693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa910156270 0x7fa9100aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91006d2e0 0x7fa91014de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 --2- 172.21.15.60:0/807591291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91006d6b0 0x7fa9100c2a90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 >> 172.21.15.60:0/807591291 conn(0x7fa910070700 msgr2=0x7fa910063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 shutdown_connections 2023-10-08T16:05:14.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.317+0000 7fa9158aa700 1 -- 172.21.15.60:0/807591291 wait complete. 2023-10-08T16:05:14.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.320+0000 7fb35361b700 1 -- 172.21.15.60:0/2549512951 wait complete. 2023-10-08T16:05:14.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.319+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0248005830 con 0x7f02640bf970 2023-10-08T16:05:14.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.320+0000 7f025b7fe700 1 -- 172.21.15.60:0/3175912153 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f025c054970 con 0x7f02640bf970 2023-10-08T16:05:14.325 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.326+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f06b416fec0 con 0x7f06b4069de0 2023-10-08T16:05:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.327+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0244066f30 msgr2=0x7f02440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.327+0000 7f026958b700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0244066f30 0x7f02440693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0254005c50 tx=0x7f0254009040 comp rx=0 tx=0).stop 2023-10-08T16:05:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.327+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 msgr2=0x7f02640c4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.327+0000 7f026958b700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 0x7f02640c4830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c590 tx=0x7f025c007d80 comp rx=0 tx=0).stop 2023-10-08T16:05:14.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.328+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 shutdown_connections 2023-10-08T16:05:14.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.328+0000 7f026958b700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0244066f30 0x7f02440693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.328+0000 7f026958b700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02640bf970 0x7f02640c4830 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.328+0000 7f026958b700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f026406d4c0 0x7f02640c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.328+0000 7f026958b700 1 --2- 172.21.15.60:0/3175912153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02640ac1a0 0x7f02640c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.328+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 >> 172.21.15.60:0/3175912153 conn(0x7f0264067660 msgr2=0x7f02640caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.332+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 shutdown_connections 2023-10-08T16:05:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.332+0000 7f026958b700 1 -- 172.21.15.60:0/3175912153 wait complete. 2023-10-08T16:05:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.332+0000 7f06a5ffb700 1 -- 172.21.15.60:0/781179051 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06b0057100 con 0x7f06b4069de0 2023-10-08T16:05:14.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.332+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ea4005560 con 0x7f9ec40cc450 2023-10-08T16:05:14.334 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.332+0000 7f9ec0ff9700 1 -- 172.21.15.60:0/1707781896 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ebc02a070 con 0x7f9ec40cc450 2023-10-08T16:05:14.335 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.337+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9eb0067080 msgr2=0x7f9eb0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.337+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9eb0067080 0x7f9eb0069530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c0290 tx=0x7f9eb40091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.337+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ec40cc450 msgr2=0x7f9ec416ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.337+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ec40cc450 0x7f9ec416ef30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc014000 tx=0x7f9ebc017000 comp rx=0 tx=0).stop 2023-10-08T16:05:14.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.339+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f06a00671e0 msgr2=0x7f06a0069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.339+0000 7f06bbea7700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f06a00671e0 0x7f06a0069690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06b406dbf0 tx=0x7f06a8006c60 comp rx=0 tx=0).stop 2023-10-08T16:05:14.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 msgr2=0x7f06b406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f06bbea7700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 0x7f06b406d090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06b0003080 tx=0x7f06b0016000 comp rx=0 tx=0).stop 2023-10-08T16:05:14.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 shutdown_connections 2023-10-08T16:05:14.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9eb0067080 0x7f9eb0069530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ec406d2e0 0x7f9ec40c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ec40cc450 0x7f9ec416ef30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f9ecac0b700 1 --2- 172.21.15.60:0/1707781896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec406d6b0 0x7f9ec40c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.340+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 >> 172.21.15.60:0/1707781896 conn(0x7f9ec4070700 msgr2=0x7f9ec40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 shutdown_connections 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f06a00671e0 0x7f06a0069690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06b40c9930 0x7f06b415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b4069de0 0x7f06b406d090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 --2- 172.21.15.60:0/781179051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06b40c9560 0x7f06b406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 >> 172.21.15.60:0/781179051 conn(0x7f06b4067660 msgr2=0x7f06b4156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 shutdown_connections 2023-10-08T16:05:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.341+0000 7f06bbea7700 1 -- 172.21.15.60:0/781179051 wait complete. 2023-10-08T16:05:14.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-08T16:05:14.344 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:14.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-08T16:05:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.342+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 shutdown_connections 2023-10-08T16:05:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.342+0000 7f9ecac0b700 1 -- 172.21.15.60:0/1707781896 wait complete. 2023-10-08T16:05:14.345 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:14.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.346+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2b04005830 con 0x7f2b24156ea0 2023-10-08T16:05:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.347+0000 7f2b20ff9700 1 -- 172.21.15.60:0/3198574570 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b180555d0 con 0x7f2b24156ea0 2023-10-08T16:05:14.348 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.350+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b08066f30 msgr2=0x7f2b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.350+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b08066f30 0x7f2b080693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000b730 tx=0x7f2b1001a000 comp rx=0 tx=0).stop 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.350+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 msgr2=0x7f2b24166910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.350+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b24166910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b24157680 tx=0x7f2b18008040 comp rx=0 tx=0).stop 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 shutdown_connections 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b08066f30 0x7f2b080693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b2406e2b0 0x7f2b24153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24157270 0x7f2b24166e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 --2- 172.21.15.60:0/3198574570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b24156ea0 0x7f2b24166910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 >> 172.21.15.60:0/3198574570 conn(0x7f2b240ca4f0 msgr2=0x7f2b241477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 shutdown_connections 2023-10-08T16:05:14.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.351+0000 7f2b2b24c700 1 -- 172.21.15.60:0/3198574570 wait complete. 2023-10-08T16:05:14.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-08T16:05:14.355 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:14.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-08T16:05:14.361 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:14.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-08T16:05:14.362 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:14.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-08T16:05:14.369 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:14.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.379+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4ea4005830 con 0x7f4ec0156270 2023-10-08T16:05:14.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.379+0000 7f4eae7fc700 1 -- 172.21.15.60:0/4026748647 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4eb8055e20 con 0x7f4ec0156270 2023-10-08T16:05:14.381 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.381+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea8067210 msgr2=0x7f4ea80696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.381+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea8067210 0x7f4ea80696c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40089b0 tx=0x7f4eb401c000 comp rx=0 tx=0).stop 2023-10-08T16:05:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.381+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec0156270 msgr2=0x7f4ec01586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.381+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec0156270 0x7f4ec01586e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800ecc0 tx=0x7f4eb800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.381+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 shutdown_connections 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea8067210 0x7f4ea80696c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec0156270 0x7f4ec01586e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec006d2e0 0x7f4ec00c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 --2- 172.21.15.60:0/4026748647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec006d6b0 0x7f4ec0154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 >> 172.21.15.60:0/4026748647 conn(0x7f4ec0070700 msgr2=0x7f4ec0068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 shutdown_connections 2023-10-08T16:05:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:14.382+0000 7f4ec4eae700 1 -- 172.21.15.60:0/4026748647 wait complete. 2023-10-08T16:05:14.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-08T16:05:14.395 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:15.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:05:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.448+0000 7efded8cb700 1 Processor -- start 2023-10-08T16:05:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.448+0000 7efded8cb700 1 -- start start 2023-10-08T16:05:15.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efded8cb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 0x7efde815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efded8cb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde815cbb0 con 0x7efde8157c40 2023-10-08T16:05:15.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efded8cb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde815bfa0 con 0x7efde815a620 2023-10-08T16:05:15.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efded8cb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde815c280 con 0x7efde8157870 2023-10-08T16:05:15.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efde8157c40 0x7efde8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39594/0 (socket says 172.21.15.60:39594) 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde77fe700 1 -- 172.21.15.60:0/3039817937 learned_addr learned my addr 172.21.15.60:0/3039817937 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde6ffd700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 0x7efde815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917979994 0 0) 0x7efde815cbb0 con 0x7efde8157c40 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd4003570 con 0x7efde8157c40 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152466357 0 0) 0x7efde815bfa0 con 0x7efde815a620 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde815cbb0 con 0x7efde815a620 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189717274 0 0) 0x7efdd4003570 con 0x7efde8157c40 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 msgr2=0x7efde815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 0x7efde815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 >> v1:172.21.15.144:6789/0 conn(0x7efde815a620 legacy=0x7efde815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde815c560 con 0x7efde8157c40 2023-10-08T16:05:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7efde0001470 con 0x7efde8157c40 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 >> v1:172.21.15.60:6789/0 conn(0x7efde8157c40 legacy=0x7efde8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdd4003c20 0x7efdd4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 0x7efdd4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde815c280 con 0x7efdd4004810 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd400bbf0 con 0x7efdd4003c20 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.449+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd400bdb0 con 0x7efde8157870 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde6ffd700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdd4003c20 0x7efdd4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde77fe700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 0x7efdd4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 -- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 msgr2=0x7efdd4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efde8157870 0x7efdd4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 -- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdd4003c20 msgr2=0x7efdd4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdd4003c20 0x7efdd4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 -- 172.21.15.60:0/3039817937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4003570 con 0x7efdd4004810 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde67fc700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdd0001a10 tx=0x7efdd0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e30eb28027b3b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000c5d0 con 0x7efdd4004810 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000c730 con 0x7efdd4004810 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.450+0000 7efde5ffb700 1 -- 172.21.15.60:0/3039817937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000cad0 con 0x7efdd4004810 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efded8cb700 1 -- 172.21.15.60:0/3039817937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdd4004810 msgr2=0x7efdd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efded8cb700 1 --2- 172.21.15.60:0/3039817937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdd4004810 0x7efdd4004c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdd0001a10 tx=0x7efdd0007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efde77fe700 1 -- 172.21.15.60:0/3039817937 reap_dead start 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efded8cb700 1 -- 172.21.15.60:0/3039817937 shutdown_connections 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efded8cb700 1 -- 172.21.15.60:0/3039817937 >> 172.21.15.60:0/3039817937 conn(0x7efde8068ce0 msgr2=0x7efde80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:15.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efded8cb700 1 -- 172.21.15.60:0/3039817937 shutdown_connections 2023-10-08T16:05:15.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.451+0000 7efded8cb700 1 -- 172.21.15.60:0/3039817937 wait complete. 2023-10-08T16:05:15.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.452+0000 7efded8cb700 1 Processor -- start 2023-10-08T16:05:15.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.452+0000 7efded8cb700 1 -- start start 2023-10-08T16:05:15.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdd4004810 0x7efde813c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 0x7efde80b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efde816a7a0 0x7efde816ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde813f2c0 con 0x7efde813e220 2023-10-08T16:05:15.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde813e6b0 con 0x7efde816a7a0 2023-10-08T16:05:15.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde813e990 con 0x7efdd4004810 2023-10-08T16:05:15.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 0x7efde80b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 0x7efde80b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34974/0 (socket says 172.21.15.60:34974) 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 -- 172.21.15.60:0/3508692681 learned_addr learned my addr 172.21.15.60:0/3508692681 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde6ffd700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdd4004810 0x7efde813c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 -- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdd4004810 msgr2=0x7efde813c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdd4004810 0x7efde813c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 -- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efde816a7a0 msgr2=0x7efde816ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efde816a7a0 0x7efde816ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 -- 172.21.15.60:0/3508692681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde813ec70 con 0x7efde813e220 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efde67fc700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 0x7efde80b2dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c3c0 tx=0x7efdd0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0001360 con 0x7efde813e220 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000ce40 con 0x7efde813e220 2023-10-08T16:05:15.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.453+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde813ef50 con 0x7efde813e220 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.454+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000cad0 con 0x7efde813e220 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.454+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde80b3310 con 0x7efde813e220 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.455+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde813f470 con 0x7efde813e220 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.455+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdd0019070 con 0x7efde813e220 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.455+0000 7efddeffd700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efdc8066f30 0x7efdc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.455+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdd0085820 con 0x7efde813e220 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.455+0000 7efde6ffd700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efdc8066f30 0x7efdc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.456+0000 7efde6ffd700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efdc8066f30 0x7efdc80693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009fd0 tx=0x7efdd800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:15.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.460+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efde813f470 con 0x7efde813e220 2023-10-08T16:05:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.658+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efde80b3530 con 0x7efde813e220 2023-10-08T16:05:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.658+0000 7efddeffd700 1 -- 172.21.15.60:0/3508692681 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdd0017090 con 0x7efde813e220 2023-10-08T16:05:15.660 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efdc8066f30 msgr2=0x7efdc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efdc8066f30 0x7efdc80693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009fd0 tx=0x7efdd800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 msgr2=0x7efde80b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 0x7efde80b2dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c3c0 tx=0x7efdd0015000 comp rx=0 tx=0).stop 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 shutdown_connections 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efdc8066f30 0x7efdc80693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdd4004810 0x7efde813c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efde816a7a0 0x7efde816ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 --2- 172.21.15.60:0/3508692681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde813e220 0x7efde80b2dd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 >> 172.21.15.60:0/3508692681 conn(0x7efde8068ce0 msgr2=0x7efde80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 shutdown_connections 2023-10-08T16:05:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.660+0000 7efded8cb700 1 -- 172.21.15.60:0/3508692681 wait complete. 2023-10-08T16:05:15.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-08T16:05:15.675 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:15.675 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:05:15.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.793+0000 7f9b86c86700 1 Processor -- start 2023-10-08T16:05:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.793+0000 7f9b86c86700 1 -- start start 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b86c86700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b80157870 0x7f9b8015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b86c86700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8015cbb0 con 0x7f9b80157c40 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b86c86700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8015bfa0 con 0x7f9b8015a620 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b86c86700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8015c280 con 0x7f9b80157870 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b85223700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9b80157c40 0x7f9b80158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39600/0 (socket says 172.21.15.60:39600) 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b85223700 1 -- 172.21.15.60:0/1985233894 learned_addr learned my addr 172.21.15.60:0/1985233894 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845980974 0 0) 0x7f9b8015cbb0 con 0x7f9b80157c40 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6c003570 con 0x7f9b80157c40 2023-10-08T16:05:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b84a22700 1 --2- 172.21.15.60:0/1985233894 >> v2:172.21.15.144:3300/0 conn(0x7f9b80157870 0x7f9b8015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2634049565 0 0) 0x7f9b6c003570 con 0x7f9b80157c40 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 >> v2:172.21.15.144:3300/0 conn(0x7f9b80157870 msgr2=0x7f9b8015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 --2- 172.21.15.60:0/1985233894 >> v2:172.21.15.144:3300/0 conn(0x7f9b80157870 0x7f9b8015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 >> v1:172.21.15.144:6789/0 conn(0x7f9b8015a620 legacy=0x7f9b8015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8015c560 con 0x7f9b80157c40 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f9b68001470 con 0x7f9b80157c40 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 >> v1:172.21.15.60:6789/0 conn(0x7f9b80157c40 legacy=0x7f9b80158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b6c003a60 0x7f9b6c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c004810 0x7f9b6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b6c0051c0 0x7f9b6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8015c280 con 0x7f9b6c003a60 2023-10-08T16:05:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c00c160 con 0x7f9b6c0051c0 2023-10-08T16:05:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c00c320 con 0x7f9b6c004810 2023-10-08T16:05:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.794+0000 7f9b84a22700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b6c003a60 0x7f9b6c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b85223700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b6c0051c0 0x7f9b6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b7ffff700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c004810 0x7f9b6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b84a22700 1 -- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c004810 msgr2=0x7f9b6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b84a22700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c004810 0x7f9b6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b84a22700 1 -- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b6c0051c0 msgr2=0x7f9b6c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b84a22700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b6c0051c0 0x7f9b6c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b85223700 1 -- 172.21.15.60:0/1985233894 reap_dead start 2023-10-08T16:05:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b84a22700 1 -- 172.21.15.60:0/1985233894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c003570 con 0x7f9b6c003a60 2023-10-08T16:05:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b84a22700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b6c003a60 0x7f9b6c003e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800e210 tx=0x7f9b7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fbe93117294bab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800eac0 con 0x7f9b6c003a60 2023-10-08T16:05:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800f040 con 0x7f9b6c003a60 2023-10-08T16:05:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b7f7fe700 1 -- 172.21.15.60:0/1985233894 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800ee70 con 0x7f9b6c003a60 2023-10-08T16:05:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b86c86700 1 -- 172.21.15.60:0/1985233894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b6c003a60 msgr2=0x7f9b6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.795+0000 7f9b86c86700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b6c003a60 0x7f9b6c003e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800e210 tx=0x7f9b7800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.796+0000 7f9b86c86700 1 -- 172.21.15.60:0/1985233894 shutdown_connections 2023-10-08T16:05:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.796+0000 7f9b86c86700 1 --2- 172.21.15.60:0/1985233894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b6c003a60 0x7f9b6c003e70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.796+0000 7f9b86c86700 1 -- 172.21.15.60:0/1985233894 >> 172.21.15.60:0/1985233894 conn(0x7f9b80068ce0 msgr2=0x7f9b800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.796+0000 7f9b86c86700 1 -- 172.21.15.60:0/1985233894 shutdown_connections 2023-10-08T16:05:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.796+0000 7f9b86c86700 1 -- 172.21.15.60:0/1985233894 wait complete. 2023-10-08T16:05:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.797+0000 7f9b86c86700 1 Processor -- start 2023-10-08T16:05:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.797+0000 7f9b86c86700 1 -- start start 2023-10-08T16:05:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c003a60 0x7f9b8014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80153ee0 0x7f9b8014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 0x7f9b80150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80150160 con 0x7f9b8014f060 2023-10-08T16:05:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8014f550 con 0x7f9b80153ee0 2023-10-08T16:05:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8014f830 con 0x7f9b6c003a60 2023-10-08T16:05:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 0x7f9b80150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 0x7f9b80150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34984/0 (socket says 172.21.15.60:34984) 2023-10-08T16:05:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 -- 172.21.15.60:0/3333575854 learned_addr learned my addr 172.21.15.60:0/3333575854 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b7ffff700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80153ee0 0x7f9b8014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b84a22700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c003a60 0x7f9b8014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 -- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c003a60 msgr2=0x7f9b8014bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c003a60 0x7f9b8014bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 -- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80153ee0 msgr2=0x7f9b8014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80153ee0 0x7f9b8014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 -- 172.21.15.60:0/3333575854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8014fb10 con 0x7f9b8014f060 2023-10-08T16:05:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b85223700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 0x7f9b80150ec0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b800b3830 tx=0x7f9b68000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68012590 con 0x7f9b8014f060 2023-10-08T16:05:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680126f0 con 0x7f9b8014f060 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68012ab0 con 0x7f9b8014f060 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8014fdf0 con 0x7f9b8014f060 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.798+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b80151400 con 0x7f9b8014f060 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.799+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8015b1f0 con 0x7f9b8014f060 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.800+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b6801d460 con 0x7f9b8014f060 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.800+0000 7f9b7cff9700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b60066f30 0x7f9b600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.800+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b680842b0 con 0x7f9b8014f060 2023-10-08T16:05:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.800+0000 7f9b84a22700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b60066f30 0x7f9b600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.801+0000 7f9b84a22700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b60066f30 0x7f9b600693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800afd0 tx=0x7f9b7801a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.805+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b68051520 con 0x7f9b8014f060 2023-10-08T16:05:15.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:15.993+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b8004c3c0 con 0x7f9b60066f30 2023-10-08T16:05:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.000+0000 7f9b7cff9700 1 -- 172.21.15.60:0/3333575854 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260133 (secure 0 0 0) 0x7f9b8004c3c0 con 0x7f9b60066f30 2023-10-08T16:05:16.004 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b60066f30 msgr2=0x7f9b600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b60066f30 0x7f9b600693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800afd0 tx=0x7f9b7801a000 comp rx=0 tx=0).stop 2023-10-08T16:05:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 msgr2=0x7f9b80150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 0x7f9b80150ec0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b800b3830 tx=0x7f9b68000fb0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 shutdown_connections 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b60066f30 0x7f9b600693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b6c003a60 0x7f9b8014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b8014f060 0x7f9b80150ec0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 --2- 172.21.15.60:0/3333575854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80153ee0 0x7f9b8014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 >> 172.21.15.60:0/3333575854 conn(0x7f9b80068ce0 msgr2=0x7f9b800b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.003+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 shutdown_connections 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.004+0000 7f9b86c86700 1 -- 172.21.15.60:0/3333575854 wait complete. 2023-10-08T16:05:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:16.017 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:05:15.563848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002686"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507701+0000","last_change":"2023-10-08T16:05:01.507178+0000","last_active":"2023-10-08T16:05:01.507701+0000","last_peered":"2023-10-08T16:05:01.507701+0000","last_clean":"2023-10-08T16:05:01.507701+0000","last_became_active":"2023-10-08T16:05:01.506717+0000","last_became_peered":"2023-10-08T16:05:01.506717+0000","last_unstale":"2023-10-08T16:05:01.507701+0000","last_undegraded":"2023-10-08T16:05:01.507701+0000","last_fullsized":"2023-10-08T16:05:01.507701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507683+0000","last_change":"2023-10-08T16:05:01.507616+0000","last_active":"2023-10-08T16:05:01.507683+0000","last_peered":"2023-10-08T16:05:01.507683+0000","last_clean":"2023-10-08T16:05:01.507683+0000","last_became_active":"2023-10-08T16:05:01.507382+0000","last_became_peered":"2023-10-08T16:05:01.507382+0000","last_unstale":"2023-10-08T16:05:01.507683+0000","last_undegraded":"2023-10-08T16:05:01.507683+0000","last_fullsized":"2023-10-08T16:05:01.507683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506637+0000","last_change":"2023-10-08T16:05:01.506392+0000","last_active":"2023-10-08T16:05:01.506637+0000","last_peered":"2023-10-08T16:05:01.506637+0000","last_clean":"2023-10-08T16:05:01.506637+0000","last_became_active":"2023-10-08T16:05:01.506200+0000","last_became_peered":"2023-10-08T16:05:01.506200+0000","last_unstale":"2023-10-08T16:05:01.506637+0000","last_undegraded":"2023-10-08T16:05:01.506637+0000","last_fullsized":"2023-10-08T16:05:01.506637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498484+0000","last_change":"2023-10-08T16:05:01.498364+0000","last_active":"2023-10-08T16:05:01.498484+0000","last_peered":"2023-10-08T16:05:01.498484+0000","last_clean":"2023-10-08T16:05:01.498484+0000","last_became_active":"2023-10-08T16:05:01.497861+0000","last_became_peered":"2023-10-08T16:05:01.497861+0000","last_unstale":"2023-10-08T16:05:01.498484+0000","last_undegraded":"2023-10-08T16:05:01.498484+0000","last_fullsized":"2023-10-08T16:05:01.498484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:20.479447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509670+0000","last_change":"2023-10-08T16:05:01.509062+0000","last_active":"2023-10-08T16:05:01.509670+0000","last_peered":"2023-10-08T16:05:01.509670+0000","last_clean":"2023-10-08T16:05:01.509670+0000","last_became_active":"2023-10-08T16:05:01.508813+0000","last_became_peered":"2023-10-08T16:05:01.508813+0000","last_unstale":"2023-10-08T16:05:01.509670+0000","last_undegraded":"2023-10-08T16:05:01.509670+0000","last_fullsized":"2023-10-08T16:05:01.509670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509852+0000","last_change":"2023-10-08T16:05:01.509649+0000","last_active":"2023-10-08T16:05:01.509852+0000","last_peered":"2023-10-08T16:05:01.509852+0000","last_clean":"2023-10-08T16:05:01.509852+0000","last_became_active":"2023-10-08T16:05:01.509280+0000","last_became_peered":"2023-10-08T16:05:01.509280+0000","last_unstale":"2023-10-08T16:05:01.509852+0000","last_undegraded":"2023-10-08T16:05:01.509852+0000","last_fullsized":"2023-10-08T16:05:01.509852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:18.844965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507684+0000","last_change":"2023-10-08T16:05:01.507170+0000","last_active":"2023-10-08T16:05:01.507684+0000","last_peered":"2023-10-08T16:05:01.507684+0000","last_clean":"2023-10-08T16:05:01.507684+0000","last_became_active":"2023-10-08T16:05:01.506530+0000","last_became_peered":"2023-10-08T16:05:01.506530+0000","last_unstale":"2023-10-08T16:05:01.507684+0000","last_undegraded":"2023-10-08T16:05:01.507684+0000","last_fullsized":"2023-10-08T16:05:01.507684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498327+0000","last_change":"2023-10-08T16:05:01.497784+0000","last_active":"2023-10-08T16:05:01.498327+0000","last_peered":"2023-10-08T16:05:01.498327+0000","last_clean":"2023-10-08T16:05:01.498327+0000","last_became_active":"2023-10-08T16:05:01.497369+0000","last_became_peered":"2023-10-08T16:05:01.497369+0000","last_unstale":"2023-10-08T16:05:01.498327+0000","last_undegraded":"2023-10-08T16:05:01.498327+0000","last_fullsized":"2023-10-08T16:05:01.498327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505808+0000","last_change":"2023-10-08T16:05:01.505512+0000","last_active":"2023-10-08T16:05:01.505808+0000","last_peered":"2023-10-08T16:05:01.505808+0000","last_clean":"2023-10-08T16:05:01.505808+0000","last_became_active":"2023-10-08T16:05:01.505293+0000","last_became_peered":"2023-10-08T16:05:01.505293+0000","last_unstale":"2023-10-08T16:05:01.505808+0000","last_undegraded":"2023-10-08T16:05:01.505808+0000","last_fullsized":"2023-10-08T16:05:01.505808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:04.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509383+0000","last_change":"2023-10-08T16:05:01.509035+0000","last_active":"2023-10-08T16:05:01.509383+0000","last_peered":"2023-10-08T16:05:01.509383+0000","last_clean":"2023-10-08T16:05:01.509383+0000","last_became_active":"2023-10-08T16:05:01.508838+0000","last_became_peered":"2023-10-08T16:05:01.508838+0000","last_unstale":"2023-10-08T16:05:01.509383+0000","last_undegraded":"2023-10-08T16:05:01.509383+0000","last_fullsized":"2023-10-08T16:05:01.509383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508474+0000","last_change":"2023-10-08T16:05:01.508376+0000","last_active":"2023-10-08T16:05:01.508474+0000","last_peered":"2023-10-08T16:05:01.508474+0000","last_clean":"2023-10-08T16:05:01.508474+0000","last_became_active":"2023-10-08T16:05:01.508137+0000","last_became_peered":"2023-10-08T16:05:01.508137+0000","last_unstale":"2023-10-08T16:05:01.508474+0000","last_undegraded":"2023-10-08T16:05:01.508474+0000","last_fullsized":"2023-10-08T16:05:01.508474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508632+0000","last_change":"2023-10-08T16:05:01.506227+0000","last_active":"2023-10-08T16:05:01.508632+0000","last_peered":"2023-10-08T16:05:01.508632+0000","last_clean":"2023-10-08T16:05:01.508632+0000","last_became_active":"2023-10-08T16:05:01.506000+0000","last_became_peered":"2023-10-08T16:05:01.506000+0000","last_unstale":"2023-10-08T16:05:01.508632+0000","last_undegraded":"2023-10-08T16:05:01.508632+0000","last_fullsized":"2023-10-08T16:05:01.508632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503841+0000","last_change":"2023-10-08T16:05:01.503731+0000","last_active":"2023-10-08T16:05:01.503841+0000","last_peered":"2023-10-08T16:05:01.503841+0000","last_clean":"2023-10-08T16:05:01.503841+0000","last_became_active":"2023-10-08T16:05:01.503403+0000","last_became_peered":"2023-10-08T16:05:01.503403+0000","last_unstale":"2023-10-08T16:05:01.503841+0000","last_undegraded":"2023-10-08T16:05:01.503841+0000","last_fullsized":"2023-10-08T16:05:01.503841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507670+0000","last_change":"2023-10-08T16:05:01.507379+0000","last_active":"2023-10-08T16:05:01.507670+0000","last_peered":"2023-10-08T16:05:01.507670+0000","last_clean":"2023-10-08T16:05:01.507670+0000","last_became_active":"2023-10-08T16:05:01.506542+0000","last_became_peered":"2023-10-08T16:05:01.506542+0000","last_unstale":"2023-10-08T16:05:01.507670+0000","last_undegraded":"2023-10-08T16:05:01.507670+0000","last_fullsized":"2023-10-08T16:05:01.507670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494393+0000","last_change":"2023-10-08T16:05:01.494332+0000","last_active":"2023-10-08T16:05:01.494393+0000","last_peered":"2023-10-08T16:05:01.494393+0000","last_clean":"2023-10-08T16:05:01.494393+0000","last_became_active":"2023-10-08T16:05:01.494145+0000","last_became_peered":"2023-10-08T16:05:01.494145+0000","last_unstale":"2023-10-08T16:05:01.494393+0000","last_undegraded":"2023-10-08T16:05:01.494393+0000","last_fullsized":"2023-10-08T16:05:01.494393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509836+0000","last_change":"2023-10-08T16:05:01.509492+0000","last_active":"2023-10-08T16:05:01.509836+0000","last_peered":"2023-10-08T16:05:01.509836+0000","last_clean":"2023-10-08T16:05:01.509836+0000","last_became_active":"2023-10-08T16:05:01.508987+0000","last_became_peered":"2023-10-08T16:05:01.508987+0000","last_unstale":"2023-10-08T16:05:01.509836+0000","last_undegraded":"2023-10-08T16:05:01.509836+0000","last_fullsized":"2023-10-08T16:05:01.509836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:34.471207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505387+0000","last_change":"2023-10-08T16:05:01.505059+0000","last_active":"2023-10-08T16:05:01.505387+0000","last_peered":"2023-10-08T16:05:01.505387+0000","last_clean":"2023-10-08T16:05:01.505387+0000","last_became_active":"2023-10-08T16:05:01.504334+0000","last_became_peered":"2023-10-08T16:05:01.504334+0000","last_unstale":"2023-10-08T16:05:01.505387+0000","last_undegraded":"2023-10-08T16:05:01.505387+0000","last_fullsized":"2023-10-08T16:05:01.505387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:04.832356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503012+0000","last_change":"2023-10-08T16:05:01.502941+0000","last_active":"2023-10-08T16:05:01.503012+0000","last_peered":"2023-10-08T16:05:01.503012+0000","last_clean":"2023-10-08T16:05:01.503012+0000","last_became_active":"2023-10-08T16:05:01.502711+0000","last_became_peered":"2023-10-08T16:05:01.502711+0000","last_unstale":"2023-10-08T16:05:01.503012+0000","last_undegraded":"2023-10-08T16:05:01.503012+0000","last_fullsized":"2023-10-08T16:05:01.503012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501162+0000","last_change":"2023-10-08T16:05:01.501012+0000","last_active":"2023-10-08T16:05:01.501162+0000","last_peered":"2023-10-08T16:05:01.501162+0000","last_clean":"2023-10-08T16:05:01.501162+0000","last_became_active":"2023-10-08T16:05:01.500370+0000","last_became_peered":"2023-10-08T16:05:01.500370+0000","last_unstale":"2023-10-08T16:05:01.501162+0000","last_undegraded":"2023-10-08T16:05:01.501162+0000","last_fullsized":"2023-10-08T16:05:01.501162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512078+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:01.512078+0000","last_peered":"2023-10-08T16:05:01.512078+0000","last_clean":"2023-10-08T16:05:01.512078+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:01.512078+0000","last_undegraded":"2023-10-08T16:05:01.512078+0000","last_fullsized":"2023-10-08T16:05:01.512078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505034+0000","last_change":"2023-10-08T16:05:01.504888+0000","last_active":"2023-10-08T16:05:01.505034+0000","last_peered":"2023-10-08T16:05:01.505034+0000","last_clean":"2023-10-08T16:05:01.505034+0000","last_became_active":"2023-10-08T16:05:01.504494+0000","last_became_peered":"2023-10-08T16:05:01.504494+0000","last_unstale":"2023-10-08T16:05:01.505034+0000","last_undegraded":"2023-10-08T16:05:01.505034+0000","last_fullsized":"2023-10-08T16:05:01.505034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507845+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:01.507845+0000","last_peered":"2023-10-08T16:05:01.507845+0000","last_clean":"2023-10-08T16:05:01.507845+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:01.507845+0000","last_undegraded":"2023-10-08T16:05:01.507845+0000","last_fullsized":"2023-10-08T16:05:01.507845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506603+0000","last_change":"2023-10-08T16:05:01.505919+0000","last_active":"2023-10-08T16:05:01.506603+0000","last_peered":"2023-10-08T16:05:01.506603+0000","last_clean":"2023-10-08T16:05:01.506603+0000","last_became_active":"2023-10-08T16:05:01.505736+0000","last_became_peered":"2023-10-08T16:05:01.505736+0000","last_unstale":"2023-10-08T16:05:01.506603+0000","last_undegraded":"2023-10-08T16:05:01.506603+0000","last_fullsized":"2023-10-08T16:05:01.506603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510937+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:01.510937+0000","last_peered":"2023-10-08T16:05:01.510937+0000","last_clean":"2023-10-08T16:05:01.510937+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:01.510937+0000","last_undegraded":"2023-10-08T16:05:01.510937+0000","last_fullsized":"2023-10-08T16:05:01.510937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496343+0000","last_change":"2023-10-08T16:05:01.496116+0000","last_active":"2023-10-08T16:05:01.496343+0000","last_peered":"2023-10-08T16:05:01.496343+0000","last_clean":"2023-10-08T16:05:01.496343+0000","last_became_active":"2023-10-08T16:05:01.495442+0000","last_became_peered":"2023-10-08T16:05:01.495442+0000","last_unstale":"2023-10-08T16:05:01.496343+0000","last_undegraded":"2023-10-08T16:05:01.496343+0000","last_fullsized":"2023-10-08T16:05:01.496343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:04.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511859+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:01.511859+0000","last_peered":"2023-10-08T16:05:01.511859+0000","last_clean":"2023-10-08T16:05:01.511859+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:01.511859+0000","last_undegraded":"2023-10-08T16:05:01.511859+0000","last_fullsized":"2023-10-08T16:05:01.511859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494727+0000","last_change":"2023-10-08T16:05:01.494609+0000","last_active":"2023-10-08T16:05:01.494727+0000","last_peered":"2023-10-08T16:05:01.494727+0000","last_clean":"2023-10-08T16:05:01.494727+0000","last_became_active":"2023-10-08T16:05:01.494359+0000","last_became_peered":"2023-10-08T16:05:01.494359+0000","last_unstale":"2023-10-08T16:05:01.494727+0000","last_undegraded":"2023-10-08T16:05:01.494727+0000","last_fullsized":"2023-10-08T16:05:01.494727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508726+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:01.508726+0000","last_peered":"2023-10-08T16:05:01.508726+0000","last_clean":"2023-10-08T16:05:01.508726+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:01.508726+0000","last_undegraded":"2023-10-08T16:05:01.508726+0000","last_fullsized":"2023-10-08T16:05:01.508726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493937+0000","last_change":"2023-10-08T16:05:01.493822+0000","last_active":"2023-10-08T16:05:01.493937+0000","last_peered":"2023-10-08T16:05:01.493937+0000","last_clean":"2023-10-08T16:05:01.493937+0000","last_became_active":"2023-10-08T16:05:01.493538+0000","last_became_peered":"2023-10-08T16:05:01.493538+0000","last_unstale":"2023-10-08T16:05:01.493937+0000","last_undegraded":"2023-10-08T16:05:01.493937+0000","last_fullsized":"2023-10-08T16:05:01.493937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508815+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:01.508815+0000","last_peered":"2023-10-08T16:05:01.508815+0000","last_clean":"2023-10-08T16:05:01.508815+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:01.508815+0000","last_undegraded":"2023-10-08T16:05:01.508815+0000","last_fullsized":"2023-10-08T16:05:01.508815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506621+0000","last_change":"2023-10-08T16:05:01.506208+0000","last_active":"2023-10-08T16:05:01.506621+0000","last_peered":"2023-10-08T16:05:01.506621+0000","last_clean":"2023-10-08T16:05:01.506621+0000","last_became_active":"2023-10-08T16:05:01.505983+0000","last_became_peered":"2023-10-08T16:05:01.505983+0000","last_unstale":"2023-10-08T16:05:01.506621+0000","last_undegraded":"2023-10-08T16:05:01.506621+0000","last_fullsized":"2023-10-08T16:05:01.506621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495445+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:01.495445+0000","last_peered":"2023-10-08T16:05:01.495445+0000","last_clean":"2023-10-08T16:05:01.495445+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:01.495445+0000","last_undegraded":"2023-10-08T16:05:01.495445+0000","last_fullsized":"2023-10-08T16:05:01.495445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.497518+0000","last_change":"2023-10-08T16:05:01.496538+0000","last_active":"2023-10-08T16:05:01.497518+0000","last_peered":"2023-10-08T16:05:01.497518+0000","last_clean":"2023-10-08T16:05:01.497518+0000","last_became_active":"2023-10-08T16:05:01.496309+0000","last_became_peered":"2023-10-08T16:05:01.496309+0000","last_unstale":"2023-10-08T16:05:01.497518+0000","last_undegraded":"2023-10-08T16:05:01.497518+0000","last_fullsized":"2023-10-08T16:05:01.497518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493207+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:01.493207+0000","last_peered":"2023-10-08T16:05:01.493207+0000","last_clean":"2023-10-08T16:05:01.493207+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:01.493207+0000","last_undegraded":"2023-10-08T16:05:01.493207+0000","last_fullsized":"2023-10-08T16:05:01.493207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501613+0000","last_change":"2023-10-08T16:05:01.501537+0000","last_active":"2023-10-08T16:05:01.501613+0000","last_peered":"2023-10-08T16:05:01.501613+0000","last_clean":"2023-10-08T16:05:01.501613+0000","last_became_active":"2023-10-08T16:05:01.501301+0000","last_became_peered":"2023-10-08T16:05:01.501301+0000","last_unstale":"2023-10-08T16:05:01.501613+0000","last_undegraded":"2023-10-08T16:05:01.501613+0000","last_fullsized":"2023-10-08T16:05:01.501613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504104+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:01.504104+0000","last_peered":"2023-10-08T16:05:01.504104+0000","last_clean":"2023-10-08T16:05:01.504104+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:01.504104+0000","last_undegraded":"2023-10-08T16:05:01.504104+0000","last_fullsized":"2023-10-08T16:05:01.504104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504852+0000","last_change":"2023-10-08T16:05:01.504760+0000","last_active":"2023-10-08T16:05:01.504852+0000","last_peered":"2023-10-08T16:05:01.504852+0000","last_clean":"2023-10-08T16:05:01.504852+0000","last_became_active":"2023-10-08T16:05:01.501487+0000","last_became_peered":"2023-10-08T16:05:01.501487+0000","last_unstale":"2023-10-08T16:05:01.504852+0000","last_undegraded":"2023-10-08T16:05:01.504852+0000","last_fullsized":"2023-10-08T16:05:01.504852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494597+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:01.494597+0000","last_peered":"2023-10-08T16:05:01.494597+0000","last_clean":"2023-10-08T16:05:01.494597+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:01.494597+0000","last_undegraded":"2023-10-08T16:05:01.494597+0000","last_fullsized":"2023-10-08T16:05:01.494597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510032+0000","last_change":"2023-10-08T16:05:01.509969+0000","last_active":"2023-10-08T16:05:01.510032+0000","last_peered":"2023-10-08T16:05:01.510032+0000","last_clean":"2023-10-08T16:05:01.510032+0000","last_became_active":"2023-10-08T16:05:01.509066+0000","last_became_peered":"2023-10-08T16:05:01.509066+0000","last_unstale":"2023-10-08T16:05:01.510032+0000","last_undegraded":"2023-10-08T16:05:01.510032+0000","last_fullsized":"2023-10-08T16:05:01.510032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508522+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:01.508522+0000","last_peered":"2023-10-08T16:05:01.508522+0000","last_clean":"2023-10-08T16:05:01.508522+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:01.508522+0000","last_undegraded":"2023-10-08T16:05:01.508522+0000","last_fullsized":"2023-10-08T16:05:01.508522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500882+0000","last_change":"2023-10-08T16:05:01.500764+0000","last_active":"2023-10-08T16:05:01.500882+0000","last_peered":"2023-10-08T16:05:01.500882+0000","last_clean":"2023-10-08T16:05:01.500882+0000","last_became_active":"2023-10-08T16:05:01.500549+0000","last_became_peered":"2023-10-08T16:05:01.500549+0000","last_unstale":"2023-10-08T16:05:01.500882+0000","last_undegraded":"2023-10-08T16:05:01.500882+0000","last_fullsized":"2023-10-08T16:05:01.500882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512754+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:01.512754+0000","last_peered":"2023-10-08T16:05:01.512754+0000","last_clean":"2023-10-08T16:05:01.512754+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:01.512754+0000","last_undegraded":"2023-10-08T16:05:01.512754+0000","last_fullsized":"2023-10-08T16:05:01.512754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504533+0000","last_change":"2023-10-08T16:05:01.501290+0000","last_active":"2023-10-08T16:05:01.504533+0000","last_peered":"2023-10-08T16:05:01.504533+0000","last_clean":"2023-10-08T16:05:01.504533+0000","last_became_active":"2023-10-08T16:05:01.500767+0000","last_became_peered":"2023-10-08T16:05:01.500767+0000","last_unstale":"2023-10-08T16:05:01.504533+0000","last_undegraded":"2023-10-08T16:05:01.504533+0000","last_fullsized":"2023-10-08T16:05:01.504533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:04.832356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511189+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:01.511189+0000","last_peered":"2023-10-08T16:05:01.511189+0000","last_clean":"2023-10-08T16:05:01.511189+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:01.511189+0000","last_undegraded":"2023-10-08T16:05:01.511189+0000","last_fullsized":"2023-10-08T16:05:01.511189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510169+0000","last_change":"2023-10-08T16:05:01.510111+0000","last_active":"2023-10-08T16:05:01.510169+0000","last_peered":"2023-10-08T16:05:01.510169+0000","last_clean":"2023-10-08T16:05:01.510169+0000","last_became_active":"2023-10-08T16:05:01.509382+0000","last_became_peered":"2023-10-08T16:05:01.509382+0000","last_unstale":"2023-10-08T16:05:01.510169+0000","last_undegraded":"2023-10-08T16:05:01.510169+0000","last_fullsized":"2023-10-08T16:05:01.510169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.492941+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:01.492941+0000","last_peered":"2023-10-08T16:05:01.492941+0000","last_clean":"2023-10-08T16:05:01.492941+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:01.492941+0000","last_undegraded":"2023-10-08T16:05:01.492941+0000","last_fullsized":"2023-10-08T16:05:01.492941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500489+0000","last_change":"2023-10-08T16:05:01.500264+0000","last_active":"2023-10-08T16:05:01.500489+0000","last_peered":"2023-10-08T16:05:01.500489+0000","last_clean":"2023-10-08T16:05:01.500489+0000","last_became_active":"2023-10-08T16:05:01.499718+0000","last_became_peered":"2023-10-08T16:05:01.499718+0000","last_unstale":"2023-10-08T16:05:01.500489+0000","last_undegraded":"2023-10-08T16:05:01.500489+0000","last_fullsized":"2023-10-08T16:05:01.500489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:43.184261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503566+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:01.503566+0000","last_peered":"2023-10-08T16:05:01.503566+0000","last_clean":"2023-10-08T16:05:01.503566+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:01.503566+0000","last_undegraded":"2023-10-08T16:05:01.503566+0000","last_fullsized":"2023-10-08T16:05:01.503566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509365+0000","last_change":"2023-10-08T16:05:01.508722+0000","last_active":"2023-10-08T16:05:01.509365+0000","last_peered":"2023-10-08T16:05:01.509365+0000","last_clean":"2023-10-08T16:05:01.509365+0000","last_became_active":"2023-10-08T16:05:01.508485+0000","last_became_peered":"2023-10-08T16:05:01.508485+0000","last_unstale":"2023-10-08T16:05:01.509365+0000","last_undegraded":"2023-10-08T16:05:01.509365+0000","last_fullsized":"2023-10-08T16:05:01.509365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512255+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:01.512255+0000","last_peered":"2023-10-08T16:05:01.512255+0000","last_clean":"2023-10-08T16:05:01.512255+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:01.512255+0000","last_undegraded":"2023-10-08T16:05:01.512255+0000","last_fullsized":"2023-10-08T16:05:01.512255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.502649+0000","last_change":"2023-10-08T16:05:01.501281+0000","last_active":"2023-10-08T16:05:01.502649+0000","last_peered":"2023-10-08T16:05:01.502649+0000","last_clean":"2023-10-08T16:05:01.502649+0000","last_became_active":"2023-10-08T16:05:01.500771+0000","last_became_peered":"2023-10-08T16:05:01.500771+0000","last_unstale":"2023-10-08T16:05:01.502649+0000","last_undegraded":"2023-10-08T16:05:01.502649+0000","last_fullsized":"2023-10-08T16:05:01.502649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:20.479447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508044+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:01.508044+0000","last_peered":"2023-10-08T16:05:01.508044+0000","last_clean":"2023-10-08T16:05:01.508044+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:01.508044+0000","last_undegraded":"2023-10-08T16:05:01.508044+0000","last_fullsized":"2023-10-08T16:05:01.508044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500511+0000","last_change":"2023-10-08T16:05:01.500421+0000","last_active":"2023-10-08T16:05:01.500511+0000","last_peered":"2023-10-08T16:05:01.500511+0000","last_clean":"2023-10-08T16:05:01.500511+0000","last_became_active":"2023-10-08T16:05:01.500040+0000","last_became_peered":"2023-10-08T16:05:01.500040+0000","last_unstale":"2023-10-08T16:05:01.500511+0000","last_undegraded":"2023-10-08T16:05:01.500511+0000","last_fullsized":"2023-10-08T16:05:01.500511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:18.844965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490001+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:01.490001+0000","last_peered":"2023-10-08T16:05:01.490001+0000","last_clean":"2023-10-08T16:05:01.490001+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:01.490001+0000","last_undegraded":"2023-10-08T16:05:01.490001+0000","last_fullsized":"2023-10-08T16:05:01.490001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498470+0000","last_change":"2023-10-08T16:05:01.498224+0000","last_active":"2023-10-08T16:05:01.498470+0000","last_peered":"2023-10-08T16:05:01.498470+0000","last_clean":"2023-10-08T16:05:01.498470+0000","last_became_active":"2023-10-08T16:05:01.497185+0000","last_became_peered":"2023-10-08T16:05:01.497185+0000","last_unstale":"2023-10-08T16:05:01.498470+0000","last_undegraded":"2023-10-08T16:05:01.498470+0000","last_fullsized":"2023-10-08T16:05:01.498470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494662+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:01.494662+0000","last_peered":"2023-10-08T16:05:01.494662+0000","last_clean":"2023-10-08T16:05:01.494662+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:01.494662+0000","last_undegraded":"2023-10-08T16:05:01.494662+0000","last_fullsized":"2023-10-08T16:05:01.494662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509204+0000","last_change":"2023-10-08T16:05:01.509136+0000","last_active":"2023-10-08T16:05:01.509204+0000","last_peered":"2023-10-08T16:05:01.509204+0000","last_clean":"2023-10-08T16:05:01.509204+0000","last_became_active":"2023-10-08T16:05:01.508906+0000","last_became_peered":"2023-10-08T16:05:01.508906+0000","last_unstale":"2023-10-08T16:05:01.509204+0000","last_undegraded":"2023-10-08T16:05:01.509204+0000","last_fullsized":"2023-10-08T16:05:01.509204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495347+0000","last_change":"2023-10-08T16:05:01.495063+0000","last_active":"2023-10-08T16:05:01.495347+0000","last_peered":"2023-10-08T16:05:01.495347+0000","last_clean":"2023-10-08T16:05:01.495347+0000","last_became_active":"2023-10-08T16:05:01.494843+0000","last_became_peered":"2023-10-08T16:05:01.494843+0000","last_unstale":"2023-10-08T16:05:01.495347+0000","last_undegraded":"2023-10-08T16:05:01.495347+0000","last_fullsized":"2023-10-08T16:05:01.495347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493042+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:01.493042+0000","last_peered":"2023-10-08T16:05:01.493042+0000","last_clean":"2023-10-08T16:05:01.493042+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:01.493042+0000","last_undegraded":"2023-10-08T16:05:01.493042+0000","last_fullsized":"2023-10-08T16:05:01.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498357+0000","last_change":"2023-10-08T16:05:01.498232+0000","last_active":"2023-10-08T16:05:01.498357+0000","last_peered":"2023-10-08T16:05:01.498357+0000","last_clean":"2023-10-08T16:05:01.498357+0000","last_became_active":"2023-10-08T16:05:01.497760+0000","last_became_peered":"2023-10-08T16:05:01.497760+0000","last_unstale":"2023-10-08T16:05:01.498357+0000","last_undegraded":"2023-10-08T16:05:01.498357+0000","last_fullsized":"2023-10-08T16:05:01.498357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493029+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:01.493029+0000","last_peered":"2023-10-08T16:05:01.493029+0000","last_clean":"2023-10-08T16:05:01.493029+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:01.493029+0000","last_undegraded":"2023-10-08T16:05:01.493029+0000","last_fullsized":"2023-10-08T16:05:01.493029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499365+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:05:01.499365+0000","last_peered":"2023-10-08T16:05:01.499365+0000","last_clean":"2023-10-08T16:05:01.499365+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:05:01.499365+0000","last_undegraded":"2023-10-08T16:05:01.499365+0000","last_fullsized":"2023-10-08T16:05:01.499365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507652+0000","last_change":"2023-10-08T16:05:01.507288+0000","last_active":"2023-10-08T16:05:01.507652+0000","last_peered":"2023-10-08T16:05:01.507652+0000","last_clean":"2023-10-08T16:05:01.507652+0000","last_became_active":"2023-10-08T16:05:01.506922+0000","last_became_peered":"2023-10-08T16:05:01.506922+0000","last_unstale":"2023-10-08T16:05:01.507652+0000","last_undegraded":"2023-10-08T16:05:01.507652+0000","last_fullsized":"2023-10-08T16:05:01.507652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498601+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:01.498601+0000","last_peered":"2023-10-08T16:05:01.498601+0000","last_clean":"2023-10-08T16:05:01.498601+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:01.498601+0000","last_undegraded":"2023-10-08T16:05:01.498601+0000","last_fullsized":"2023-10-08T16:05:01.498601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498696+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:01.498696+0000","last_peered":"2023-10-08T16:05:01.498696+0000","last_clean":"2023-10-08T16:05:01.498696+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:01.498696+0000","last_undegraded":"2023-10-08T16:05:01.498696+0000","last_fullsized":"2023-10-08T16:05:01.498696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495311+0000","last_change":"2023-10-08T16:05:01.494801+0000","last_active":"2023-10-08T16:05:01.495311+0000","last_peered":"2023-10-08T16:05:01.495311+0000","last_clean":"2023-10-08T16:05:01.495311+0000","last_became_active":"2023-10-08T16:05:01.494548+0000","last_became_peered":"2023-10-08T16:05:01.494548+0000","last_unstale":"2023-10-08T16:05:01.495311+0000","last_undegraded":"2023-10-08T16:05:01.495311+0000","last_fullsized":"2023-10-08T16:05:01.495311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:05:02.494819+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:02.494819+0000","last_peered":"2023-10-08T16:05:02.494819+0000","last_clean":"2023-10-08T16:05:02.494819+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:02.494819+0000","last_undegraded":"2023-10-08T16:05:02.494819+0000","last_fullsized":"2023-10-08T16:05:02.494819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499126+0000","last_change":"2023-10-08T16:05:01.498976+0000","last_active":"2023-10-08T16:05:01.499126+0000","last_peered":"2023-10-08T16:05:01.499126+0000","last_clean":"2023-10-08T16:05:01.499126+0000","last_became_active":"2023-10-08T16:05:01.498743+0000","last_became_peered":"2023-10-08T16:05:01.498743+0000","last_unstale":"2023-10-08T16:05:01.499126+0000","last_undegraded":"2023-10-08T16:05:01.499126+0000","last_fullsized":"2023-10-08T16:05:01.499126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510000+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:01.510000+0000","last_peered":"2023-10-08T16:05:01.510000+0000","last_clean":"2023-10-08T16:05:01.510000+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:01.510000+0000","last_undegraded":"2023-10-08T16:05:01.510000+0000","last_fullsized":"2023-10-08T16:05:01.510000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509969+0000","last_change":"2023-10-08T16:05:01.509864+0000","last_active":"2023-10-08T16:05:01.509969+0000","last_peered":"2023-10-08T16:05:01.509969+0000","last_clean":"2023-10-08T16:05:01.509969+0000","last_became_active":"2023-10-08T16:05:01.509420+0000","last_became_peered":"2023-10-08T16:05:01.509420+0000","last_unstale":"2023-10-08T16:05:01.509969+0000","last_undegraded":"2023-10-08T16:05:01.509969+0000","last_fullsized":"2023-10-08T16:05:01.509969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495044+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:01.495044+0000","last_peered":"2023-10-08T16:05:01.495044+0000","last_clean":"2023-10-08T16:05:01.495044+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:01.495044+0000","last_undegraded":"2023-10-08T16:05:01.495044+0000","last_fullsized":"2023-10-08T16:05:01.495044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496403+0000","last_change":"2023-10-08T16:05:01.496181+0000","last_active":"2023-10-08T16:05:01.496403+0000","last_peered":"2023-10-08T16:05:01.496403+0000","last_clean":"2023-10-08T16:05:01.496403+0000","last_became_active":"2023-10-08T16:05:01.495966+0000","last_became_peered":"2023-10-08T16:05:01.495966+0000","last_unstale":"2023-10-08T16:05:01.496403+0000","last_undegraded":"2023-10-08T16:05:01.496403+0000","last_fullsized":"2023-10-08T16:05:01.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490079+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:01.490079+0000","last_peered":"2023-10-08T16:05:01.490079+0000","last_clean":"2023-10-08T16:05:01.490079+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:01.490079+0000","last_undegraded":"2023-10-08T16:05:01.490079+0000","last_fullsized":"2023-10-08T16:05:01.490079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498311+0000","last_change":"2023-10-08T16:05:01.497738+0000","last_active":"2023-10-08T16:05:01.498311+0000","last_peered":"2023-10-08T16:05:01.498311+0000","last_clean":"2023-10-08T16:05:01.498311+0000","last_became_active":"2023-10-08T16:05:01.497501+0000","last_became_peered":"2023-10-08T16:05:01.497501+0000","last_unstale":"2023-10-08T16:05:01.498311+0000","last_undegraded":"2023-10-08T16:05:01.498311+0000","last_fullsized":"2023-10-08T16:05:01.498311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490084+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:01.490084+0000","last_peered":"2023-10-08T16:05:01.490084+0000","last_clean":"2023-10-08T16:05:01.490084+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:01.490084+0000","last_undegraded":"2023-10-08T16:05:01.490084+0000","last_fullsized":"2023-10-08T16:05:01.490084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508493+0000","last_change":"2023-10-08T16:05:01.508325+0000","last_active":"2023-10-08T16:05:01.508493+0000","last_peered":"2023-10-08T16:05:01.508493+0000","last_clean":"2023-10-08T16:05:01.508493+0000","last_became_active":"2023-10-08T16:05:01.508104+0000","last_became_peered":"2023-10-08T16:05:01.508104+0000","last_unstale":"2023-10-08T16:05:01.508493+0000","last_undegraded":"2023-10-08T16:05:01.508493+0000","last_fullsized":"2023-10-08T16:05:01.508493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511308+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:01.511308+0000","last_peered":"2023-10-08T16:05:01.511308+0000","last_clean":"2023-10-08T16:05:01.511308+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:01.511308+0000","last_undegraded":"2023-10-08T16:05:01.511308+0000","last_fullsized":"2023-10-08T16:05:01.511308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503900+0000","last_change":"2023-10-08T16:05:01.503800+0000","last_active":"2023-10-08T16:05:01.503900+0000","last_peered":"2023-10-08T16:05:01.503900+0000","last_clean":"2023-10-08T16:05:01.503900+0000","last_became_active":"2023-10-08T16:05:01.503436+0000","last_became_peered":"2023-10-08T16:05:01.503436+0000","last_unstale":"2023-10-08T16:05:01.503900+0000","last_undegraded":"2023-10-08T16:05:01.503900+0000","last_fullsized":"2023-10-08T16:05:01.503900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.492352+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:01.492352+0000","last_peered":"2023-10-08T16:05:01.492352+0000","last_clean":"2023-10-08T16:05:01.492352+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:01.492352+0000","last_undegraded":"2023-10-08T16:05:01.492352+0000","last_fullsized":"2023-10-08T16:05:01.492352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498383+0000","last_change":"2023-10-08T16:05:01.497066+0000","last_active":"2023-10-08T16:05:01.498383+0000","last_peered":"2023-10-08T16:05:01.498383+0000","last_clean":"2023-10-08T16:05:01.498383+0000","last_became_active":"2023-10-08T16:05:01.496839+0000","last_became_peered":"2023-10-08T16:05:01.496839+0000","last_unstale":"2023-10-08T16:05:01.498383+0000","last_undegraded":"2023-10-08T16:05:01.498383+0000","last_fullsized":"2023-10-08T16:05:01.498383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505139+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:01.505139+0000","last_peered":"2023-10-08T16:05:01.505139+0000","last_clean":"2023-10-08T16:05:01.505139+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:01.505139+0000","last_undegraded":"2023-10-08T16:05:01.505139+0000","last_fullsized":"2023-10-08T16:05:01.505139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504767+0000","last_change":"2023-10-08T16:05:01.504578+0000","last_active":"2023-10-08T16:05:01.504767+0000","last_peered":"2023-10-08T16:05:01.504767+0000","last_clean":"2023-10-08T16:05:01.504767+0000","last_became_active":"2023-10-08T16:05:01.501061+0000","last_became_peered":"2023-10-08T16:05:01.501061+0000","last_unstale":"2023-10-08T16:05:01.504767+0000","last_undegraded":"2023-10-08T16:05:01.504767+0000","last_fullsized":"2023-10-08T16:05:01.504767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508879+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:01.508879+0000","last_peered":"2023-10-08T16:05:01.508879+0000","last_clean":"2023-10-08T16:05:01.508879+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:01.508879+0000","last_undegraded":"2023-10-08T16:05:01.508879+0000","last_fullsized":"2023-10-08T16:05:01.508879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501242+0000","last_change":"2023-10-08T16:05:01.501159+0000","last_active":"2023-10-08T16:05:01.501242+0000","last_peered":"2023-10-08T16:05:01.501242+0000","last_clean":"2023-10-08T16:05:01.501242+0000","last_became_active":"2023-10-08T16:05:01.500711+0000","last_became_peered":"2023-10-08T16:05:01.500711+0000","last_unstale":"2023-10-08T16:05:01.501242+0000","last_undegraded":"2023-10-08T16:05:01.501242+0000","last_fullsized":"2023-10-08T16:05:01.501242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:34.471207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510349+0000","last_change":"2023-10-08T16:05:01.510144+0000","last_active":"2023-10-08T16:05:01.510349+0000","last_peered":"2023-10-08T16:05:01.510349+0000","last_clean":"2023-10-08T16:05:01.510349+0000","last_became_active":"2023-10-08T16:05:01.509633+0000","last_became_peered":"2023-10-08T16:05:01.509633+0000","last_unstale":"2023-10-08T16:05:01.510349+0000","last_undegraded":"2023-10-08T16:05:01.510349+0000","last_fullsized":"2023-10-08T16:05:01.510349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496004+0000","last_change":"2023-10-08T16:05:01.495936+0000","last_active":"2023-10-08T16:05:01.496004+0000","last_peered":"2023-10-08T16:05:01.496004+0000","last_clean":"2023-10-08T16:05:01.496004+0000","last_became_active":"2023-10-08T16:05:01.495683+0000","last_became_peered":"2023-10-08T16:05:01.495683+0000","last_unstale":"2023-10-08T16:05:01.496004+0000","last_undegraded":"2023-10-08T16:05:01.496004+0000","last_fullsized":"2023-10-08T16:05:01.496004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498422+0000","last_change":"2023-10-08T16:05:01.496960+0000","last_active":"2023-10-08T16:05:01.498422+0000","last_peered":"2023-10-08T16:05:01.498422+0000","last_clean":"2023-10-08T16:05:01.498422+0000","last_became_active":"2023-10-08T16:05:01.496720+0000","last_became_peered":"2023-10-08T16:05:01.496720+0000","last_unstale":"2023-10-08T16:05:01.498422+0000","last_undegraded":"2023-10-08T16:05:01.498422+0000","last_fullsized":"2023-10-08T16:05:01.498422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507685+0000","last_change":"2023-10-08T16:05:01.507536+0000","last_active":"2023-10-08T16:05:01.507685+0000","last_peered":"2023-10-08T16:05:01.507685+0000","last_clean":"2023-10-08T16:05:01.507685+0000","last_became_active":"2023-10-08T16:05:01.507028+0000","last_became_peered":"2023-10-08T16:05:01.507028+0000","last_unstale":"2023-10-08T16:05:01.507685+0000","last_undegraded":"2023-10-08T16:05:01.507685+0000","last_fullsized":"2023-10-08T16:05:01.507685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498292+0000","last_change":"2023-10-08T16:05:01.497598+0000","last_active":"2023-10-08T16:05:01.498292+0000","last_peered":"2023-10-08T16:05:01.498292+0000","last_clean":"2023-10-08T16:05:01.498292+0000","last_became_active":"2023-10-08T16:05:01.497068+0000","last_became_peered":"2023-10-08T16:05:01.497068+0000","last_unstale":"2023-10-08T16:05:01.498292+0000","last_undegraded":"2023-10-08T16:05:01.498292+0000","last_fullsized":"2023-10-08T16:05:01.498292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495329+0000","last_change":"2023-10-08T16:05:01.494815+0000","last_active":"2023-10-08T16:05:01.495329+0000","last_peered":"2023-10-08T16:05:01.495329+0000","last_clean":"2023-10-08T16:05:01.495329+0000","last_became_active":"2023-10-08T16:05:01.494588+0000","last_became_peered":"2023-10-08T16:05:01.494588+0000","last_unstale":"2023-10-08T16:05:01.495329+0000","last_undegraded":"2023-10-08T16:05:01.495329+0000","last_fullsized":"2023-10-08T16:05:01.495329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505789+0000","last_change":"2023-10-08T16:05:01.505706+0000","last_active":"2023-10-08T16:05:01.505789+0000","last_peered":"2023-10-08T16:05:01.505789+0000","last_clean":"2023-10-08T16:05:01.505789+0000","last_became_active":"2023-10-08T16:05:01.505486+0000","last_became_peered":"2023-10-08T16:05:01.505486+0000","last_unstale":"2023-10-08T16:05:01.505789+0000","last_undegraded":"2023-10-08T16:05:01.505789+0000","last_fullsized":"2023-10-08T16:05:01.505789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.497536+0000","last_change":"2023-10-08T16:05:01.497102+0000","last_active":"2023-10-08T16:05:01.497536+0000","last_peered":"2023-10-08T16:05:01.497536+0000","last_clean":"2023-10-08T16:05:01.497536+0000","last_became_active":"2023-10-08T16:05:01.496760+0000","last_became_peered":"2023-10-08T16:05:01.496760+0000","last_unstale":"2023-10-08T16:05:01.497536+0000","last_undegraded":"2023-10-08T16:05:01.497536+0000","last_fullsized":"2023-10-08T16:05:01.497536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498454+0000","last_change":"2023-10-08T16:05:01.498081+0000","last_active":"2023-10-08T16:05:01.498454+0000","last_peered":"2023-10-08T16:05:01.498454+0000","last_clean":"2023-10-08T16:05:01.498454+0000","last_became_active":"2023-10-08T16:05:01.496861+0000","last_became_peered":"2023-10-08T16:05:01.496861+0000","last_unstale":"2023-10-08T16:05:01.498454+0000","last_undegraded":"2023-10-08T16:05:01.498454+0000","last_fullsized":"2023-10-08T16:05:01.498454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499735+0000","last_change":"2023-10-08T16:05:01.499621+0000","last_active":"2023-10-08T16:05:01.499735+0000","last_peered":"2023-10-08T16:05:01.499735+0000","last_clean":"2023-10-08T16:05:01.499735+0000","last_became_active":"2023-10-08T16:05:01.499401+0000","last_became_peered":"2023-10-08T16:05:01.499401+0000","last_unstale":"2023-10-08T16:05:01.499735+0000","last_undegraded":"2023-10-08T16:05:01.499735+0000","last_fullsized":"2023-10-08T16:05:01.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505149+0000","last_change":"2023-10-08T16:05:01.504917+0000","last_active":"2023-10-08T16:05:01.505149+0000","last_peered":"2023-10-08T16:05:01.505149+0000","last_clean":"2023-10-08T16:05:01.505149+0000","last_became_active":"2023-10-08T16:05:01.501765+0000","last_became_peered":"2023-10-08T16:05:01.501765+0000","last_unstale":"2023-10-08T16:05:01.505149+0000","last_undegraded":"2023-10-08T16:05:01.505149+0000","last_fullsized":"2023-10-08T16:05:01.505149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510856+0000","last_change":"2023-10-08T16:05:01.510328+0000","last_active":"2023-10-08T16:05:01.510856+0000","last_peered":"2023-10-08T16:05:01.510856+0000","last_clean":"2023-10-08T16:05:01.510856+0000","last_became_active":"2023-10-08T16:05:01.509693+0000","last_became_peered":"2023-10-08T16:05:01.509693+0000","last_unstale":"2023-10-08T16:05:01.510856+0000","last_undegraded":"2023-10-08T16:05:01.510856+0000","last_fullsized":"2023-10-08T16:05:01.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504190+0000","last_change":"2023-10-08T16:05:01.504127+0000","last_active":"2023-10-08T16:05:01.504190+0000","last_peered":"2023-10-08T16:05:01.504190+0000","last_clean":"2023-10-08T16:05:01.504190+0000","last_became_active":"2023-10-08T16:05:01.503128+0000","last_became_peered":"2023-10-08T16:05:01.503128+0000","last_unstale":"2023-10-08T16:05:01.504190+0000","last_undegraded":"2023-10-08T16:05:01.504190+0000","last_fullsized":"2023-10-08T16:05:01.504190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:16.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:05:16.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.174+0000 7f9029c78700 1 Processor -- start 2023-10-08T16:05:16.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9029c78700 1 -- start start 2023-10-08T16:05:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9029c78700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90240cd390 0x7f9024067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9029c78700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902415b050 con 0x7f9024070e10 2023-10-08T16:05:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9029c78700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902415a480 con 0x7f9024157520 2023-10-08T16:05:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9029c78700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902415a270 con 0x7f90240cd390 2023-10-08T16:05:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9023fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9024070e10 0x7f90240ccc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39610/0 (socket says 172.21.15.60:39610) 2023-10-08T16:05:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.175+0000 7f9023fff700 1 -- 172.21.15.60:0/935652289 learned_addr learned my addr 172.21.15.60:0/935652289 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f9029477700 1 --2- 172.21.15.60:0/935652289 >> v2:172.21.15.144:3300/0 conn(0x7f90240cd390 0x7f9024067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479763697 0 0) 0x7f902415b050 con 0x7f9024070e10 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9010003570 con 0x7f9024070e10 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047087705 0 0) 0x7f902415a480 con 0x7f9024157520 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f902415b050 con 0x7f9024157520 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 837468446 0 0) 0x7f9010003570 con 0x7f9024070e10 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f9029477700 1 -- 172.21.15.60:0/935652289 >> v1:172.21.15.144:6789/0 conn(0x7f9024157520 legacy=0x7f9024070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f9029477700 1 -- 172.21.15.60:0/935652289 >> v1:172.21.15.60:6789/0 conn(0x7f9024070e10 legacy=0x7f90240ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f9029477700 1 -- 172.21.15.60:0/935652289 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902415a720 con 0x7f90240cd390 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f9029477700 1 --2- 172.21.15.60:0/935652289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90240cd390 0x7f9024067660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f900c0098e0 tx=0x7f900c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af00368b31fba5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9014001470 con 0x7f90240cd390 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c011420 con 0x7f90240cd390 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.176+0000 7f90237fe700 1 -- 172.21.15.60:0/935652289 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0117c0 con 0x7f90240cd390 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 -- 172.21.15.60:0/935652289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90240cd390 msgr2=0x7f9024067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 --2- 172.21.15.60:0/935652289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90240cd390 0x7f9024067660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f900c0098e0 tx=0x7f900c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 -- 172.21.15.60:0/935652289 shutdown_connections 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 --2- 172.21.15.60:0/935652289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90240cd390 0x7f9024067660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 -- 172.21.15.60:0/935652289 >> 172.21.15.60:0/935652289 conn(0x7f90240cd8f0 msgr2=0x7f90240cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:16.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 -- 172.21.15.60:0/935652289 shutdown_connections 2023-10-08T16:05:16.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.177+0000 7f9029c78700 1 -- 172.21.15.60:0/935652289 wait complete. 2023-10-08T16:05:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.178+0000 7f9029c78700 1 Processor -- start 2023-10-08T16:05:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.178+0000 7f9029c78700 1 -- start start 2023-10-08T16:05:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029c78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 0x7f902415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029c78700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90240cd390 0x7f90240b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029c78700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024157520 0x7f90240b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029c78700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902415c300 con 0x7f9024070e10 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029c78700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902415ccd0 con 0x7f9024157520 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029c78700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902415b6f0 con 0x7f90240cd390 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 0x7f902415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 0x7f902415c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34998/0 (socket says 172.21.15.60:34998) 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 -- 172.21.15.60:0/1677516949 learned_addr learned my addr 172.21.15.60:0/1677516949 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9023fff700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90240cd390 0x7f90240b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029477700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024157520 0x7f90240b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 -- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90240cd390 msgr2=0x7f90240b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90240cd390 0x7f90240b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 -- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024157520 msgr2=0x7f90240b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024157520 0x7f90240b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 -- 172.21.15.60:0/1677516949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c009420 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9029477700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024157520 0x7f90240b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.179+0000 7f9028c76700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 0x7f902415c790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f901c00cb40 tx=0x7f901c002810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.180+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00a7e0 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.180+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c00a960 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.180+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902415b9d0 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.180+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00ad20 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.180+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902415bf90 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.181+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902406d5d0 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.181+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f901c012630 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.182+0000 7f9020ff9700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9004066f30 0x7f90040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.182+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f901c084a10 con 0x7f9024070e10 2023-10-08T16:05:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.182+0000 7f9023fff700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9004066f30 0x7f90040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.182+0000 7f9023fff700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9004066f30 0x7f90040693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90240b00a0 tx=0x7f9014009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.186+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f901c051be0 con 0x7f9024070e10 2023-10-08T16:05:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.375+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f902415c440 con 0x7f9004066f30 2023-10-08T16:05:16.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.382+0000 7f9020ff9700 1 -- 172.21.15.60:0/1677516949 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260133 (secure 0 0 0) 0x7f9014005900 con 0x7f9004066f30 2023-10-08T16:05:16.389 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9004066f30 msgr2=0x7f90040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9004066f30 0x7f90040693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90240b00a0 tx=0x7f9014009040 comp rx=0 tx=0).stop 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 msgr2=0x7f902415c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 0x7f902415c790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f901c00cb40 tx=0x7f901c002810 comp rx=0 tx=0).stop 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 shutdown_connections 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9004066f30 0x7f90040693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024157520 0x7f90240b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9024070e10 0x7f902415c790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 --2- 172.21.15.60:0/1677516949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90240cd390 0x7f90240b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 >> 172.21.15.60:0/1677516949 conn(0x7f90240cd8f0 msgr2=0x7f9024154430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 shutdown_connections 2023-10-08T16:05:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.385+0000 7f9029c78700 1 -- 172.21.15.60:0/1677516949 wait complete. 2023-10-08T16:05:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:05:16.398 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:05:15.563848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002686"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507701+0000","last_change":"2023-10-08T16:05:01.507178+0000","last_active":"2023-10-08T16:05:01.507701+0000","last_peered":"2023-10-08T16:05:01.507701+0000","last_clean":"2023-10-08T16:05:01.507701+0000","last_became_active":"2023-10-08T16:05:01.506717+0000","last_became_peered":"2023-10-08T16:05:01.506717+0000","last_unstale":"2023-10-08T16:05:01.507701+0000","last_undegraded":"2023-10-08T16:05:01.507701+0000","last_fullsized":"2023-10-08T16:05:01.507701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507683+0000","last_change":"2023-10-08T16:05:01.507616+0000","last_active":"2023-10-08T16:05:01.507683+0000","last_peered":"2023-10-08T16:05:01.507683+0000","last_clean":"2023-10-08T16:05:01.507683+0000","last_became_active":"2023-10-08T16:05:01.507382+0000","last_became_peered":"2023-10-08T16:05:01.507382+0000","last_unstale":"2023-10-08T16:05:01.507683+0000","last_undegraded":"2023-10-08T16:05:01.507683+0000","last_fullsized":"2023-10-08T16:05:01.507683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506637+0000","last_change":"2023-10-08T16:05:01.506392+0000","last_active":"2023-10-08T16:05:01.506637+0000","last_peered":"2023-10-08T16:05:01.506637+0000","last_clean":"2023-10-08T16:05:01.506637+0000","last_became_active":"2023-10-08T16:05:01.506200+0000","last_became_peered":"2023-10-08T16:05:01.506200+0000","last_unstale":"2023-10-08T16:05:01.506637+0000","last_undegraded":"2023-10-08T16:05:01.506637+0000","last_fullsized":"2023-10-08T16:05:01.506637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498484+0000","last_change":"2023-10-08T16:05:01.498364+0000","last_active":"2023-10-08T16:05:01.498484+0000","last_peered":"2023-10-08T16:05:01.498484+0000","last_clean":"2023-10-08T16:05:01.498484+0000","last_became_active":"2023-10-08T16:05:01.497861+0000","last_became_peered":"2023-10-08T16:05:01.497861+0000","last_unstale":"2023-10-08T16:05:01.498484+0000","last_undegraded":"2023-10-08T16:05:01.498484+0000","last_fullsized":"2023-10-08T16:05:01.498484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:20.479447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509670+0000","last_change":"2023-10-08T16:05:01.509062+0000","last_active":"2023-10-08T16:05:01.509670+0000","last_peered":"2023-10-08T16:05:01.509670+0000","last_clean":"2023-10-08T16:05:01.509670+0000","last_became_active":"2023-10-08T16:05:01.508813+0000","last_became_peered":"2023-10-08T16:05:01.508813+0000","last_unstale":"2023-10-08T16:05:01.509670+0000","last_undegraded":"2023-10-08T16:05:01.509670+0000","last_fullsized":"2023-10-08T16:05:01.509670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509852+0000","last_change":"2023-10-08T16:05:01.509649+0000","last_active":"2023-10-08T16:05:01.509852+0000","last_peered":"2023-10-08T16:05:01.509852+0000","last_clean":"2023-10-08T16:05:01.509852+0000","last_became_active":"2023-10-08T16:05:01.509280+0000","last_became_peered":"2023-10-08T16:05:01.509280+0000","last_unstale":"2023-10-08T16:05:01.509852+0000","last_undegraded":"2023-10-08T16:05:01.509852+0000","last_fullsized":"2023-10-08T16:05:01.509852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:18.844965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507684+0000","last_change":"2023-10-08T16:05:01.507170+0000","last_active":"2023-10-08T16:05:01.507684+0000","last_peered":"2023-10-08T16:05:01.507684+0000","last_clean":"2023-10-08T16:05:01.507684+0000","last_became_active":"2023-10-08T16:05:01.506530+0000","last_became_peered":"2023-10-08T16:05:01.506530+0000","last_unstale":"2023-10-08T16:05:01.507684+0000","last_undegraded":"2023-10-08T16:05:01.507684+0000","last_fullsized":"2023-10-08T16:05:01.507684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498327+0000","last_change":"2023-10-08T16:05:01.497784+0000","last_active":"2023-10-08T16:05:01.498327+0000","last_peered":"2023-10-08T16:05:01.498327+0000","last_clean":"2023-10-08T16:05:01.498327+0000","last_became_active":"2023-10-08T16:05:01.497369+0000","last_became_peered":"2023-10-08T16:05:01.497369+0000","last_unstale":"2023-10-08T16:05:01.498327+0000","last_undegraded":"2023-10-08T16:05:01.498327+0000","last_fullsized":"2023-10-08T16:05:01.498327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505808+0000","last_change":"2023-10-08T16:05:01.505512+0000","last_active":"2023-10-08T16:05:01.505808+0000","last_peered":"2023-10-08T16:05:01.505808+0000","last_clean":"2023-10-08T16:05:01.505808+0000","last_became_active":"2023-10-08T16:05:01.505293+0000","last_became_peered":"2023-10-08T16:05:01.505293+0000","last_unstale":"2023-10-08T16:05:01.505808+0000","last_undegraded":"2023-10-08T16:05:01.505808+0000","last_fullsized":"2023-10-08T16:05:01.505808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:04.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509383+0000","last_change":"2023-10-08T16:05:01.509035+0000","last_active":"2023-10-08T16:05:01.509383+0000","last_peered":"2023-10-08T16:05:01.509383+0000","last_clean":"2023-10-08T16:05:01.509383+0000","last_became_active":"2023-10-08T16:05:01.508838+0000","last_became_peered":"2023-10-08T16:05:01.508838+0000","last_unstale":"2023-10-08T16:05:01.509383+0000","last_undegraded":"2023-10-08T16:05:01.509383+0000","last_fullsized":"2023-10-08T16:05:01.509383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:02.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508474+0000","last_change":"2023-10-08T16:05:01.508376+0000","last_active":"2023-10-08T16:05:01.508474+0000","last_peered":"2023-10-08T16:05:01.508474+0000","last_clean":"2023-10-08T16:05:01.508474+0000","last_became_active":"2023-10-08T16:05:01.508137+0000","last_became_peered":"2023-10-08T16:05:01.508137+0000","last_unstale":"2023-10-08T16:05:01.508474+0000","last_undegraded":"2023-10-08T16:05:01.508474+0000","last_fullsized":"2023-10-08T16:05:01.508474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508632+0000","last_change":"2023-10-08T16:05:01.506227+0000","last_active":"2023-10-08T16:05:01.508632+0000","last_peered":"2023-10-08T16:05:01.508632+0000","last_clean":"2023-10-08T16:05:01.508632+0000","last_became_active":"2023-10-08T16:05:01.506000+0000","last_became_peered":"2023-10-08T16:05:01.506000+0000","last_unstale":"2023-10-08T16:05:01.508632+0000","last_undegraded":"2023-10-08T16:05:01.508632+0000","last_fullsized":"2023-10-08T16:05:01.508632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:11.280471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503841+0000","last_change":"2023-10-08T16:05:01.503731+0000","last_active":"2023-10-08T16:05:01.503841+0000","last_peered":"2023-10-08T16:05:01.503841+0000","last_clean":"2023-10-08T16:05:01.503841+0000","last_became_active":"2023-10-08T16:05:01.503403+0000","last_became_peered":"2023-10-08T16:05:01.503403+0000","last_unstale":"2023-10-08T16:05:01.503841+0000","last_undegraded":"2023-10-08T16:05:01.503841+0000","last_fullsized":"2023-10-08T16:05:01.503841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507670+0000","last_change":"2023-10-08T16:05:01.507379+0000","last_active":"2023-10-08T16:05:01.507670+0000","last_peered":"2023-10-08T16:05:01.507670+0000","last_clean":"2023-10-08T16:05:01.507670+0000","last_became_active":"2023-10-08T16:05:01.506542+0000","last_became_peered":"2023-10-08T16:05:01.506542+0000","last_unstale":"2023-10-08T16:05:01.507670+0000","last_undegraded":"2023-10-08T16:05:01.507670+0000","last_fullsized":"2023-10-08T16:05:01.507670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:10.299295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494393+0000","last_change":"2023-10-08T16:05:01.494332+0000","last_active":"2023-10-08T16:05:01.494393+0000","last_peered":"2023-10-08T16:05:01.494393+0000","last_clean":"2023-10-08T16:05:01.494393+0000","last_became_active":"2023-10-08T16:05:01.494145+0000","last_became_peered":"2023-10-08T16:05:01.494145+0000","last_unstale":"2023-10-08T16:05:01.494393+0000","last_undegraded":"2023-10-08T16:05:01.494393+0000","last_fullsized":"2023-10-08T16:05:01.494393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509836+0000","last_change":"2023-10-08T16:05:01.509492+0000","last_active":"2023-10-08T16:05:01.509836+0000","last_peered":"2023-10-08T16:05:01.509836+0000","last_clean":"2023-10-08T16:05:01.509836+0000","last_became_active":"2023-10-08T16:05:01.508987+0000","last_became_peered":"2023-10-08T16:05:01.508987+0000","last_unstale":"2023-10-08T16:05:01.509836+0000","last_undegraded":"2023-10-08T16:05:01.509836+0000","last_fullsized":"2023-10-08T16:05:01.509836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:34.471207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505387+0000","last_change":"2023-10-08T16:05:01.505059+0000","last_active":"2023-10-08T16:05:01.505387+0000","last_peered":"2023-10-08T16:05:01.505387+0000","last_clean":"2023-10-08T16:05:01.505387+0000","last_became_active":"2023-10-08T16:05:01.504334+0000","last_became_peered":"2023-10-08T16:05:01.504334+0000","last_unstale":"2023-10-08T16:05:01.505387+0000","last_undegraded":"2023-10-08T16:05:01.505387+0000","last_fullsized":"2023-10-08T16:05:01.505387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:04.832356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503012+0000","last_change":"2023-10-08T16:05:01.502941+0000","last_active":"2023-10-08T16:05:01.503012+0000","last_peered":"2023-10-08T16:05:01.503012+0000","last_clean":"2023-10-08T16:05:01.503012+0000","last_became_active":"2023-10-08T16:05:01.502711+0000","last_became_peered":"2023-10-08T16:05:01.502711+0000","last_unstale":"2023-10-08T16:05:01.503012+0000","last_undegraded":"2023-10-08T16:05:01.503012+0000","last_fullsized":"2023-10-08T16:05:01.503012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501162+0000","last_change":"2023-10-08T16:05:01.501012+0000","last_active":"2023-10-08T16:05:01.501162+0000","last_peered":"2023-10-08T16:05:01.501162+0000","last_clean":"2023-10-08T16:05:01.501162+0000","last_became_active":"2023-10-08T16:05:01.500370+0000","last_became_peered":"2023-10-08T16:05:01.500370+0000","last_unstale":"2023-10-08T16:05:01.501162+0000","last_undegraded":"2023-10-08T16:05:01.501162+0000","last_fullsized":"2023-10-08T16:05:01.501162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:25.376191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512078+0000","last_change":"2023-10-08T16:05:00.505057+0000","last_active":"2023-10-08T16:05:01.512078+0000","last_peered":"2023-10-08T16:05:01.512078+0000","last_clean":"2023-10-08T16:05:01.512078+0000","last_became_active":"2023-10-08T16:05:00.504851+0000","last_became_peered":"2023-10-08T16:05:00.504851+0000","last_unstale":"2023-10-08T16:05:01.512078+0000","last_undegraded":"2023-10-08T16:05:01.512078+0000","last_fullsized":"2023-10-08T16:05:01.512078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:13.666589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505034+0000","last_change":"2023-10-08T16:05:01.504888+0000","last_active":"2023-10-08T16:05:01.505034+0000","last_peered":"2023-10-08T16:05:01.505034+0000","last_clean":"2023-10-08T16:05:01.505034+0000","last_became_active":"2023-10-08T16:05:01.504494+0000","last_became_peered":"2023-10-08T16:05:01.504494+0000","last_unstale":"2023-10-08T16:05:01.505034+0000","last_undegraded":"2023-10-08T16:05:01.505034+0000","last_fullsized":"2023-10-08T16:05:01.505034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507845+0000","last_change":"2023-10-08T16:05:00.507202+0000","last_active":"2023-10-08T16:05:01.507845+0000","last_peered":"2023-10-08T16:05:01.507845+0000","last_clean":"2023-10-08T16:05:01.507845+0000","last_became_active":"2023-10-08T16:05:00.506538+0000","last_became_peered":"2023-10-08T16:05:00.506538+0000","last_unstale":"2023-10-08T16:05:01.507845+0000","last_undegraded":"2023-10-08T16:05:01.507845+0000","last_fullsized":"2023-10-08T16:05:01.507845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506603+0000","last_change":"2023-10-08T16:05:01.505919+0000","last_active":"2023-10-08T16:05:01.506603+0000","last_peered":"2023-10-08T16:05:01.506603+0000","last_clean":"2023-10-08T16:05:01.506603+0000","last_became_active":"2023-10-08T16:05:01.505736+0000","last_became_peered":"2023-10-08T16:05:01.505736+0000","last_unstale":"2023-10-08T16:05:01.506603+0000","last_undegraded":"2023-10-08T16:05:01.506603+0000","last_fullsized":"2023-10-08T16:05:01.506603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510937+0000","last_change":"2023-10-08T16:05:00.503801+0000","last_active":"2023-10-08T16:05:01.510937+0000","last_peered":"2023-10-08T16:05:01.510937+0000","last_clean":"2023-10-08T16:05:01.510937+0000","last_became_active":"2023-10-08T16:05:00.503565+0000","last_became_peered":"2023-10-08T16:05:00.503565+0000","last_unstale":"2023-10-08T16:05:01.510937+0000","last_undegraded":"2023-10-08T16:05:01.510937+0000","last_fullsized":"2023-10-08T16:05:01.510937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496343+0000","last_change":"2023-10-08T16:05:01.496116+0000","last_active":"2023-10-08T16:05:01.496343+0000","last_peered":"2023-10-08T16:05:01.496343+0000","last_clean":"2023-10-08T16:05:01.496343+0000","last_became_active":"2023-10-08T16:05:01.495442+0000","last_became_peered":"2023-10-08T16:05:01.495442+0000","last_unstale":"2023-10-08T16:05:01.496343+0000","last_undegraded":"2023-10-08T16:05:01.496343+0000","last_fullsized":"2023-10-08T16:05:01.496343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:04.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511859+0000","last_change":"2023-10-08T16:05:00.504293+0000","last_active":"2023-10-08T16:05:01.511859+0000","last_peered":"2023-10-08T16:05:01.511859+0000","last_clean":"2023-10-08T16:05:01.511859+0000","last_became_active":"2023-10-08T16:05:00.504069+0000","last_became_peered":"2023-10-08T16:05:00.504069+0000","last_unstale":"2023-10-08T16:05:01.511859+0000","last_undegraded":"2023-10-08T16:05:01.511859+0000","last_fullsized":"2023-10-08T16:05:01.511859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.764168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494727+0000","last_change":"2023-10-08T16:05:01.494609+0000","last_active":"2023-10-08T16:05:01.494727+0000","last_peered":"2023-10-08T16:05:01.494727+0000","last_clean":"2023-10-08T16:05:01.494727+0000","last_became_active":"2023-10-08T16:05:01.494359+0000","last_became_peered":"2023-10-08T16:05:01.494359+0000","last_unstale":"2023-10-08T16:05:01.494727+0000","last_undegraded":"2023-10-08T16:05:01.494727+0000","last_fullsized":"2023-10-08T16:05:01.494727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508726+0000","last_change":"2023-10-08T16:05:00.504995+0000","last_active":"2023-10-08T16:05:01.508726+0000","last_peered":"2023-10-08T16:05:01.508726+0000","last_clean":"2023-10-08T16:05:01.508726+0000","last_became_active":"2023-10-08T16:05:00.504495+0000","last_became_peered":"2023-10-08T16:05:00.504495+0000","last_unstale":"2023-10-08T16:05:01.508726+0000","last_undegraded":"2023-10-08T16:05:01.508726+0000","last_fullsized":"2023-10-08T16:05:01.508726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:22.186395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493937+0000","last_change":"2023-10-08T16:05:01.493822+0000","last_active":"2023-10-08T16:05:01.493937+0000","last_peered":"2023-10-08T16:05:01.493937+0000","last_clean":"2023-10-08T16:05:01.493937+0000","last_became_active":"2023-10-08T16:05:01.493538+0000","last_became_peered":"2023-10-08T16:05:01.493538+0000","last_unstale":"2023-10-08T16:05:01.493937+0000","last_undegraded":"2023-10-08T16:05:01.493937+0000","last_fullsized":"2023-10-08T16:05:01.493937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:30.760927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508815+0000","last_change":"2023-10-08T16:05:00.505226+0000","last_active":"2023-10-08T16:05:01.508815+0000","last_peered":"2023-10-08T16:05:01.508815+0000","last_clean":"2023-10-08T16:05:01.508815+0000","last_became_active":"2023-10-08T16:05:00.505000+0000","last_became_peered":"2023-10-08T16:05:00.505000+0000","last_unstale":"2023-10-08T16:05:01.508815+0000","last_undegraded":"2023-10-08T16:05:01.508815+0000","last_fullsized":"2023-10-08T16:05:01.508815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.506621+0000","last_change":"2023-10-08T16:05:01.506208+0000","last_active":"2023-10-08T16:05:01.506621+0000","last_peered":"2023-10-08T16:05:01.506621+0000","last_clean":"2023-10-08T16:05:01.506621+0000","last_became_active":"2023-10-08T16:05:01.505983+0000","last_became_peered":"2023-10-08T16:05:01.505983+0000","last_unstale":"2023-10-08T16:05:01.506621+0000","last_undegraded":"2023-10-08T16:05:01.506621+0000","last_fullsized":"2023-10-08T16:05:01.506621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495445+0000","last_change":"2023-10-08T16:05:00.507367+0000","last_active":"2023-10-08T16:05:01.495445+0000","last_peered":"2023-10-08T16:05:01.495445+0000","last_clean":"2023-10-08T16:05:01.495445+0000","last_became_active":"2023-10-08T16:05:00.506917+0000","last_became_peered":"2023-10-08T16:05:00.506917+0000","last_unstale":"2023-10-08T16:05:01.495445+0000","last_undegraded":"2023-10-08T16:05:01.495445+0000","last_fullsized":"2023-10-08T16:05:01.495445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.497518+0000","last_change":"2023-10-08T16:05:01.496538+0000","last_active":"2023-10-08T16:05:01.497518+0000","last_peered":"2023-10-08T16:05:01.497518+0000","last_clean":"2023-10-08T16:05:01.497518+0000","last_became_active":"2023-10-08T16:05:01.496309+0000","last_became_peered":"2023-10-08T16:05:01.496309+0000","last_unstale":"2023-10-08T16:05:01.497518+0000","last_undegraded":"2023-10-08T16:05:01.497518+0000","last_fullsized":"2023-10-08T16:05:01.497518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493207+0000","last_change":"2023-10-08T16:05:00.505047+0000","last_active":"2023-10-08T16:05:01.493207+0000","last_peered":"2023-10-08T16:05:01.493207+0000","last_clean":"2023-10-08T16:05:01.493207+0000","last_became_active":"2023-10-08T16:05:00.504802+0000","last_became_peered":"2023-10-08T16:05:00.504802+0000","last_unstale":"2023-10-08T16:05:01.493207+0000","last_undegraded":"2023-10-08T16:05:01.493207+0000","last_fullsized":"2023-10-08T16:05:01.493207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501613+0000","last_change":"2023-10-08T16:05:01.501537+0000","last_active":"2023-10-08T16:05:01.501613+0000","last_peered":"2023-10-08T16:05:01.501613+0000","last_clean":"2023-10-08T16:05:01.501613+0000","last_became_active":"2023-10-08T16:05:01.501301+0000","last_became_peered":"2023-10-08T16:05:01.501301+0000","last_unstale":"2023-10-08T16:05:01.501613+0000","last_undegraded":"2023-10-08T16:05:01.501613+0000","last_fullsized":"2023-10-08T16:05:01.501613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504104+0000","last_change":"2023-10-08T16:05:00.500519+0000","last_active":"2023-10-08T16:05:01.504104+0000","last_peered":"2023-10-08T16:05:01.504104+0000","last_clean":"2023-10-08T16:05:01.504104+0000","last_became_active":"2023-10-08T16:05:00.500239+0000","last_became_peered":"2023-10-08T16:05:00.500239+0000","last_unstale":"2023-10-08T16:05:01.504104+0000","last_undegraded":"2023-10-08T16:05:01.504104+0000","last_fullsized":"2023-10-08T16:05:01.504104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504852+0000","last_change":"2023-10-08T16:05:01.504760+0000","last_active":"2023-10-08T16:05:01.504852+0000","last_peered":"2023-10-08T16:05:01.504852+0000","last_clean":"2023-10-08T16:05:01.504852+0000","last_became_active":"2023-10-08T16:05:01.501487+0000","last_became_peered":"2023-10-08T16:05:01.501487+0000","last_unstale":"2023-10-08T16:05:01.504852+0000","last_undegraded":"2023-10-08T16:05:01.504852+0000","last_fullsized":"2023-10-08T16:05:01.504852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494597+0000","last_change":"2023-10-08T16:05:00.501225+0000","last_active":"2023-10-08T16:05:01.494597+0000","last_peered":"2023-10-08T16:05:01.494597+0000","last_clean":"2023-10-08T16:05:01.494597+0000","last_became_active":"2023-10-08T16:05:00.501008+0000","last_became_peered":"2023-10-08T16:05:00.501008+0000","last_unstale":"2023-10-08T16:05:01.494597+0000","last_undegraded":"2023-10-08T16:05:01.494597+0000","last_fullsized":"2023-10-08T16:05:01.494597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510032+0000","last_change":"2023-10-08T16:05:01.509969+0000","last_active":"2023-10-08T16:05:01.510032+0000","last_peered":"2023-10-08T16:05:01.510032+0000","last_clean":"2023-10-08T16:05:01.510032+0000","last_became_active":"2023-10-08T16:05:01.509066+0000","last_became_peered":"2023-10-08T16:05:01.509066+0000","last_unstale":"2023-10-08T16:05:01.510032+0000","last_undegraded":"2023-10-08T16:05:01.510032+0000","last_fullsized":"2023-10-08T16:05:01.510032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508522+0000","last_change":"2023-10-08T16:05:00.502084+0000","last_active":"2023-10-08T16:05:01.508522+0000","last_peered":"2023-10-08T16:05:01.508522+0000","last_clean":"2023-10-08T16:05:01.508522+0000","last_became_active":"2023-10-08T16:05:00.501502+0000","last_became_peered":"2023-10-08T16:05:00.501502+0000","last_unstale":"2023-10-08T16:05:01.508522+0000","last_undegraded":"2023-10-08T16:05:01.508522+0000","last_fullsized":"2023-10-08T16:05:01.508522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:49.703310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500882+0000","last_change":"2023-10-08T16:05:01.500764+0000","last_active":"2023-10-08T16:05:01.500882+0000","last_peered":"2023-10-08T16:05:01.500882+0000","last_clean":"2023-10-08T16:05:01.500882+0000","last_became_active":"2023-10-08T16:05:01.500549+0000","last_became_peered":"2023-10-08T16:05:01.500549+0000","last_unstale":"2023-10-08T16:05:01.500882+0000","last_undegraded":"2023-10-08T16:05:01.500882+0000","last_fullsized":"2023-10-08T16:05:01.500882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:23.768759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512754+0000","last_change":"2023-10-08T16:05:00.508257+0000","last_active":"2023-10-08T16:05:01.512754+0000","last_peered":"2023-10-08T16:05:01.512754+0000","last_clean":"2023-10-08T16:05:01.512754+0000","last_became_active":"2023-10-08T16:05:00.507817+0000","last_became_peered":"2023-10-08T16:05:00.507817+0000","last_unstale":"2023-10-08T16:05:01.512754+0000","last_undegraded":"2023-10-08T16:05:01.512754+0000","last_fullsized":"2023-10-08T16:05:01.512754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504533+0000","last_change":"2023-10-08T16:05:01.501290+0000","last_active":"2023-10-08T16:05:01.504533+0000","last_peered":"2023-10-08T16:05:01.504533+0000","last_clean":"2023-10-08T16:05:01.504533+0000","last_became_active":"2023-10-08T16:05:01.500767+0000","last_became_peered":"2023-10-08T16:05:01.500767+0000","last_unstale":"2023-10-08T16:05:01.504533+0000","last_undegraded":"2023-10-08T16:05:01.504533+0000","last_fullsized":"2023-10-08T16:05:01.504533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:04.832356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511189+0000","last_change":"2023-10-08T16:05:00.505739+0000","last_active":"2023-10-08T16:05:01.511189+0000","last_peered":"2023-10-08T16:05:01.511189+0000","last_clean":"2023-10-08T16:05:01.511189+0000","last_became_active":"2023-10-08T16:05:00.505485+0000","last_became_peered":"2023-10-08T16:05:00.505485+0000","last_unstale":"2023-10-08T16:05:01.511189+0000","last_undegraded":"2023-10-08T16:05:01.511189+0000","last_fullsized":"2023-10-08T16:05:01.511189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510169+0000","last_change":"2023-10-08T16:05:01.510111+0000","last_active":"2023-10-08T16:05:01.510169+0000","last_peered":"2023-10-08T16:05:01.510169+0000","last_clean":"2023-10-08T16:05:01.510169+0000","last_became_active":"2023-10-08T16:05:01.509382+0000","last_became_peered":"2023-10-08T16:05:01.509382+0000","last_unstale":"2023-10-08T16:05:01.510169+0000","last_undegraded":"2023-10-08T16:05:01.510169+0000","last_fullsized":"2023-10-08T16:05:01.510169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.492941+0000","last_change":"2023-10-08T16:05:00.499397+0000","last_active":"2023-10-08T16:05:01.492941+0000","last_peered":"2023-10-08T16:05:01.492941+0000","last_clean":"2023-10-08T16:05:01.492941+0000","last_became_active":"2023-10-08T16:05:00.499123+0000","last_became_peered":"2023-10-08T16:05:00.499123+0000","last_unstale":"2023-10-08T16:05:01.492941+0000","last_undegraded":"2023-10-08T16:05:01.492941+0000","last_fullsized":"2023-10-08T16:05:01.492941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500489+0000","last_change":"2023-10-08T16:05:01.500264+0000","last_active":"2023-10-08T16:05:01.500489+0000","last_peered":"2023-10-08T16:05:01.500489+0000","last_clean":"2023-10-08T16:05:01.500489+0000","last_became_active":"2023-10-08T16:05:01.499718+0000","last_became_peered":"2023-10-08T16:05:01.499718+0000","last_unstale":"2023-10-08T16:05:01.500489+0000","last_undegraded":"2023-10-08T16:05:01.500489+0000","last_fullsized":"2023-10-08T16:05:01.500489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:43.184261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503566+0000","last_change":"2023-10-08T16:05:00.506081+0000","last_active":"2023-10-08T16:05:01.503566+0000","last_peered":"2023-10-08T16:05:01.503566+0000","last_clean":"2023-10-08T16:05:01.503566+0000","last_became_active":"2023-10-08T16:05:00.505868+0000","last_became_peered":"2023-10-08T16:05:00.505868+0000","last_unstale":"2023-10-08T16:05:01.503566+0000","last_undegraded":"2023-10-08T16:05:01.503566+0000","last_fullsized":"2023-10-08T16:05:01.503566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509365+0000","last_change":"2023-10-08T16:05:01.508722+0000","last_active":"2023-10-08T16:05:01.509365+0000","last_peered":"2023-10-08T16:05:01.509365+0000","last_clean":"2023-10-08T16:05:01.509365+0000","last_became_active":"2023-10-08T16:05:01.508485+0000","last_became_peered":"2023-10-08T16:05:01.508485+0000","last_unstale":"2023-10-08T16:05:01.509365+0000","last_undegraded":"2023-10-08T16:05:01.509365+0000","last_fullsized":"2023-10-08T16:05:01.509365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.512255+0000","last_change":"2023-10-08T16:05:00.500864+0000","last_active":"2023-10-08T16:05:01.512255+0000","last_peered":"2023-10-08T16:05:01.512255+0000","last_clean":"2023-10-08T16:05:01.512255+0000","last_became_active":"2023-10-08T16:05:00.500213+0000","last_became_peered":"2023-10-08T16:05:00.500213+0000","last_unstale":"2023-10-08T16:05:01.512255+0000","last_undegraded":"2023-10-08T16:05:01.512255+0000","last_fullsized":"2023-10-08T16:05:01.512255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.502649+0000","last_change":"2023-10-08T16:05:01.501281+0000","last_active":"2023-10-08T16:05:01.502649+0000","last_peered":"2023-10-08T16:05:01.502649+0000","last_clean":"2023-10-08T16:05:01.502649+0000","last_became_active":"2023-10-08T16:05:01.500771+0000","last_became_peered":"2023-10-08T16:05:01.500771+0000","last_unstale":"2023-10-08T16:05:01.502649+0000","last_undegraded":"2023-10-08T16:05:01.502649+0000","last_fullsized":"2023-10-08T16:05:01.502649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:20.479447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508044+0000","last_change":"2023-10-08T16:05:00.502071+0000","last_active":"2023-10-08T16:05:01.508044+0000","last_peered":"2023-10-08T16:05:01.508044+0000","last_clean":"2023-10-08T16:05:01.508044+0000","last_became_active":"2023-10-08T16:05:00.501833+0000","last_became_peered":"2023-10-08T16:05:00.501833+0000","last_unstale":"2023-10-08T16:05:01.508044+0000","last_undegraded":"2023-10-08T16:05:01.508044+0000","last_fullsized":"2023-10-08T16:05:01.508044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:29.120432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.500511+0000","last_change":"2023-10-08T16:05:01.500421+0000","last_active":"2023-10-08T16:05:01.500511+0000","last_peered":"2023-10-08T16:05:01.500511+0000","last_clean":"2023-10-08T16:05:01.500511+0000","last_became_active":"2023-10-08T16:05:01.500040+0000","last_became_peered":"2023-10-08T16:05:01.500040+0000","last_unstale":"2023-10-08T16:05:01.500511+0000","last_undegraded":"2023-10-08T16:05:01.500511+0000","last_fullsized":"2023-10-08T16:05:01.500511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:18.844965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490001+0000","last_change":"2023-10-08T16:05:00.502386+0000","last_active":"2023-10-08T16:05:01.490001+0000","last_peered":"2023-10-08T16:05:01.490001+0000","last_clean":"2023-10-08T16:05:01.490001+0000","last_became_active":"2023-10-08T16:05:00.502145+0000","last_became_peered":"2023-10-08T16:05:00.502145+0000","last_unstale":"2023-10-08T16:05:01.490001+0000","last_undegraded":"2023-10-08T16:05:01.490001+0000","last_fullsized":"2023-10-08T16:05:01.490001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498470+0000","last_change":"2023-10-08T16:05:01.498224+0000","last_active":"2023-10-08T16:05:01.498470+0000","last_peered":"2023-10-08T16:05:01.498470+0000","last_clean":"2023-10-08T16:05:01.498470+0000","last_became_active":"2023-10-08T16:05:01.497185+0000","last_became_peered":"2023-10-08T16:05:01.497185+0000","last_unstale":"2023-10-08T16:05:01.498470+0000","last_undegraded":"2023-10-08T16:05:01.498470+0000","last_fullsized":"2023-10-08T16:05:01.498470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.494662+0000","last_change":"2023-10-08T16:05:00.499218+0000","last_active":"2023-10-08T16:05:01.494662+0000","last_peered":"2023-10-08T16:05:01.494662+0000","last_clean":"2023-10-08T16:05:01.494662+0000","last_became_active":"2023-10-08T16:05:00.498960+0000","last_became_peered":"2023-10-08T16:05:00.498960+0000","last_unstale":"2023-10-08T16:05:01.494662+0000","last_undegraded":"2023-10-08T16:05:01.494662+0000","last_fullsized":"2023-10-08T16:05:01.494662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509204+0000","last_change":"2023-10-08T16:05:01.509136+0000","last_active":"2023-10-08T16:05:01.509204+0000","last_peered":"2023-10-08T16:05:01.509204+0000","last_clean":"2023-10-08T16:05:01.509204+0000","last_became_active":"2023-10-08T16:05:01.508906+0000","last_became_peered":"2023-10-08T16:05:01.508906+0000","last_unstale":"2023-10-08T16:05:01.509204+0000","last_undegraded":"2023-10-08T16:05:01.509204+0000","last_fullsized":"2023-10-08T16:05:01.509204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495347+0000","last_change":"2023-10-08T16:05:01.495063+0000","last_active":"2023-10-08T16:05:01.495347+0000","last_peered":"2023-10-08T16:05:01.495347+0000","last_clean":"2023-10-08T16:05:01.495347+0000","last_became_active":"2023-10-08T16:05:01.494843+0000","last_became_peered":"2023-10-08T16:05:01.494843+0000","last_unstale":"2023-10-08T16:05:01.495347+0000","last_undegraded":"2023-10-08T16:05:01.495347+0000","last_fullsized":"2023-10-08T16:05:01.495347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493042+0000","last_change":"2023-10-08T16:05:00.497630+0000","last_active":"2023-10-08T16:05:01.493042+0000","last_peered":"2023-10-08T16:05:01.493042+0000","last_clean":"2023-10-08T16:05:01.493042+0000","last_became_active":"2023-10-08T16:05:00.497355+0000","last_became_peered":"2023-10-08T16:05:00.497355+0000","last_unstale":"2023-10-08T16:05:01.493042+0000","last_undegraded":"2023-10-08T16:05:01.493042+0000","last_fullsized":"2023-10-08T16:05:01.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498357+0000","last_change":"2023-10-08T16:05:01.498232+0000","last_active":"2023-10-08T16:05:01.498357+0000","last_peered":"2023-10-08T16:05:01.498357+0000","last_clean":"2023-10-08T16:05:01.498357+0000","last_became_active":"2023-10-08T16:05:01.497760+0000","last_became_peered":"2023-10-08T16:05:01.497760+0000","last_unstale":"2023-10-08T16:05:01.498357+0000","last_undegraded":"2023-10-08T16:05:01.498357+0000","last_fullsized":"2023-10-08T16:05:01.498357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.493029+0000","last_change":"2023-10-08T16:05:00.507753+0000","last_active":"2023-10-08T16:05:01.493029+0000","last_peered":"2023-10-08T16:05:01.493029+0000","last_clean":"2023-10-08T16:05:01.493029+0000","last_became_active":"2023-10-08T16:05:00.506842+0000","last_became_peered":"2023-10-08T16:05:00.506842+0000","last_unstale":"2023-10-08T16:05:01.493029+0000","last_undegraded":"2023-10-08T16:05:01.493029+0000","last_fullsized":"2023-10-08T16:05:01.493029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499365+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:05:01.499365+0000","last_peered":"2023-10-08T16:05:01.499365+0000","last_clean":"2023-10-08T16:05:01.499365+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:05:01.499365+0000","last_undegraded":"2023-10-08T16:05:01.499365+0000","last_fullsized":"2023-10-08T16:05:01.499365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507652+0000","last_change":"2023-10-08T16:05:01.507288+0000","last_active":"2023-10-08T16:05:01.507652+0000","last_peered":"2023-10-08T16:05:01.507652+0000","last_clean":"2023-10-08T16:05:01.507652+0000","last_became_active":"2023-10-08T16:05:01.506922+0000","last_became_peered":"2023-10-08T16:05:01.506922+0000","last_unstale":"2023-10-08T16:05:01.507652+0000","last_undegraded":"2023-10-08T16:05:01.507652+0000","last_fullsized":"2023-10-08T16:05:01.507652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:09.112654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498601+0000","last_change":"2023-10-08T16:05:00.505073+0000","last_active":"2023-10-08T16:05:01.498601+0000","last_peered":"2023-10-08T16:05:01.498601+0000","last_clean":"2023-10-08T16:05:01.498601+0000","last_became_active":"2023-10-08T16:05:00.504853+0000","last_became_peered":"2023-10-08T16:05:00.504853+0000","last_unstale":"2023-10-08T16:05:01.498601+0000","last_undegraded":"2023-10-08T16:05:01.498601+0000","last_fullsized":"2023-10-08T16:05:01.498601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498696+0000","last_change":"2023-10-08T16:05:00.507413+0000","last_active":"2023-10-08T16:05:01.498696+0000","last_peered":"2023-10-08T16:05:01.498696+0000","last_clean":"2023-10-08T16:05:01.498696+0000","last_became_active":"2023-10-08T16:05:00.507180+0000","last_became_peered":"2023-10-08T16:05:00.507180+0000","last_unstale":"2023-10-08T16:05:01.498696+0000","last_undegraded":"2023-10-08T16:05:01.498696+0000","last_fullsized":"2023-10-08T16:05:01.498696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495311+0000","last_change":"2023-10-08T16:05:01.494801+0000","last_active":"2023-10-08T16:05:01.495311+0000","last_peered":"2023-10-08T16:05:01.495311+0000","last_clean":"2023-10-08T16:05:01.495311+0000","last_became_active":"2023-10-08T16:05:01.494548+0000","last_became_peered":"2023-10-08T16:05:01.494548+0000","last_unstale":"2023-10-08T16:05:01.495311+0000","last_undegraded":"2023-10-08T16:05:01.495311+0000","last_fullsized":"2023-10-08T16:05:01.495311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:05:02.494819+0000","last_change":"2023-10-08T16:05:00.501771+0000","last_active":"2023-10-08T16:05:02.494819+0000","last_peered":"2023-10-08T16:05:02.494819+0000","last_clean":"2023-10-08T16:05:02.494819+0000","last_became_active":"2023-10-08T16:05:00.501155+0000","last_became_peered":"2023-10-08T16:05:00.501155+0000","last_unstale":"2023-10-08T16:05:02.494819+0000","last_undegraded":"2023-10-08T16:05:02.494819+0000","last_fullsized":"2023-10-08T16:05:02.494819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499126+0000","last_change":"2023-10-08T16:05:01.498976+0000","last_active":"2023-10-08T16:05:01.499126+0000","last_peered":"2023-10-08T16:05:01.499126+0000","last_clean":"2023-10-08T16:05:01.499126+0000","last_became_active":"2023-10-08T16:05:01.498743+0000","last_became_peered":"2023-10-08T16:05:01.498743+0000","last_unstale":"2023-10-08T16:05:01.499126+0000","last_undegraded":"2023-10-08T16:05:01.499126+0000","last_fullsized":"2023-10-08T16:05:01.499126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:05.297497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510000+0000","last_change":"2023-10-08T16:05:00.503946+0000","last_active":"2023-10-08T16:05:01.510000+0000","last_peered":"2023-10-08T16:05:01.510000+0000","last_clean":"2023-10-08T16:05:01.510000+0000","last_became_active":"2023-10-08T16:05:00.503699+0000","last_became_peered":"2023-10-08T16:05:00.503699+0000","last_unstale":"2023-10-08T16:05:01.510000+0000","last_undegraded":"2023-10-08T16:05:01.510000+0000","last_fullsized":"2023-10-08T16:05:01.510000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.509969+0000","last_change":"2023-10-08T16:05:01.509864+0000","last_active":"2023-10-08T16:05:01.509969+0000","last_peered":"2023-10-08T16:05:01.509969+0000","last_clean":"2023-10-08T16:05:01.509969+0000","last_became_active":"2023-10-08T16:05:01.509420+0000","last_became_peered":"2023-10-08T16:05:01.509420+0000","last_unstale":"2023-10-08T16:05:01.509969+0000","last_undegraded":"2023-10-08T16:05:01.509969+0000","last_fullsized":"2023-10-08T16:05:01.509969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:17.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495044+0000","last_change":"2023-10-08T16:05:00.507066+0000","last_active":"2023-10-08T16:05:01.495044+0000","last_peered":"2023-10-08T16:05:01.495044+0000","last_clean":"2023-10-08T16:05:01.495044+0000","last_became_active":"2023-10-08T16:05:00.506774+0000","last_became_peered":"2023-10-08T16:05:00.506774+0000","last_unstale":"2023-10-08T16:05:01.495044+0000","last_undegraded":"2023-10-08T16:05:01.495044+0000","last_fullsized":"2023-10-08T16:05:01.495044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:10.275880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496403+0000","last_change":"2023-10-08T16:05:01.496181+0000","last_active":"2023-10-08T16:05:01.496403+0000","last_peered":"2023-10-08T16:05:01.496403+0000","last_clean":"2023-10-08T16:05:01.496403+0000","last_became_active":"2023-10-08T16:05:01.495966+0000","last_became_peered":"2023-10-08T16:05:01.495966+0000","last_unstale":"2023-10-08T16:05:01.496403+0000","last_undegraded":"2023-10-08T16:05:01.496403+0000","last_fullsized":"2023-10-08T16:05:01.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:50.707901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490079+0000","last_change":"2023-10-08T16:05:00.504446+0000","last_active":"2023-10-08T16:05:01.490079+0000","last_peered":"2023-10-08T16:05:01.490079+0000","last_clean":"2023-10-08T16:05:01.490079+0000","last_became_active":"2023-10-08T16:05:00.504222+0000","last_became_peered":"2023-10-08T16:05:00.504222+0000","last_unstale":"2023-10-08T16:05:01.490079+0000","last_undegraded":"2023-10-08T16:05:01.490079+0000","last_fullsized":"2023-10-08T16:05:01.490079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498311+0000","last_change":"2023-10-08T16:05:01.497738+0000","last_active":"2023-10-08T16:05:01.498311+0000","last_peered":"2023-10-08T16:05:01.498311+0000","last_clean":"2023-10-08T16:05:01.498311+0000","last_became_active":"2023-10-08T16:05:01.497501+0000","last_became_peered":"2023-10-08T16:05:01.497501+0000","last_unstale":"2023-10-08T16:05:01.498311+0000","last_undegraded":"2023-10-08T16:05:01.498311+0000","last_fullsized":"2023-10-08T16:05:01.498311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.490084+0000","last_change":"2023-10-08T16:05:00.508562+0000","last_active":"2023-10-08T16:05:01.490084+0000","last_peered":"2023-10-08T16:05:01.490084+0000","last_clean":"2023-10-08T16:05:01.490084+0000","last_became_active":"2023-10-08T16:05:00.508413+0000","last_became_peered":"2023-10-08T16:05:00.508413+0000","last_unstale":"2023-10-08T16:05:01.490084+0000","last_undegraded":"2023-10-08T16:05:01.490084+0000","last_fullsized":"2023-10-08T16:05:01.490084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:50.800877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508493+0000","last_change":"2023-10-08T16:05:01.508325+0000","last_active":"2023-10-08T16:05:01.508493+0000","last_peered":"2023-10-08T16:05:01.508493+0000","last_clean":"2023-10-08T16:05:01.508493+0000","last_became_active":"2023-10-08T16:05:01.508104+0000","last_became_peered":"2023-10-08T16:05:01.508104+0000","last_unstale":"2023-10-08T16:05:01.508493+0000","last_undegraded":"2023-10-08T16:05:01.508493+0000","last_fullsized":"2023-10-08T16:05:01.508493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.511308+0000","last_change":"2023-10-08T16:05:00.506058+0000","last_active":"2023-10-08T16:05:01.511308+0000","last_peered":"2023-10-08T16:05:01.511308+0000","last_clean":"2023-10-08T16:05:01.511308+0000","last_became_active":"2023-10-08T16:05:00.505676+0000","last_became_peered":"2023-10-08T16:05:00.505676+0000","last_unstale":"2023-10-08T16:05:01.511308+0000","last_undegraded":"2023-10-08T16:05:01.511308+0000","last_fullsized":"2023-10-08T16:05:01.511308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:59.475812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.503900+0000","last_change":"2023-10-08T16:05:01.503800+0000","last_active":"2023-10-08T16:05:01.503900+0000","last_peered":"2023-10-08T16:05:01.503900+0000","last_clean":"2023-10-08T16:05:01.503900+0000","last_became_active":"2023-10-08T16:05:01.503436+0000","last_became_peered":"2023-10-08T16:05:01.503436+0000","last_unstale":"2023-10-08T16:05:01.503900+0000","last_undegraded":"2023-10-08T16:05:01.503900+0000","last_fullsized":"2023-10-08T16:05:01.503900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.492352+0000","last_change":"2023-10-08T16:05:00.504216+0000","last_active":"2023-10-08T16:05:01.492352+0000","last_peered":"2023-10-08T16:05:01.492352+0000","last_clean":"2023-10-08T16:05:01.492352+0000","last_became_active":"2023-10-08T16:05:00.503942+0000","last_became_peered":"2023-10-08T16:05:00.503942+0000","last_unstale":"2023-10-08T16:05:01.492352+0000","last_undegraded":"2023-10-08T16:05:01.492352+0000","last_fullsized":"2023-10-08T16:05:01.492352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498383+0000","last_change":"2023-10-08T16:05:01.497066+0000","last_active":"2023-10-08T16:05:01.498383+0000","last_peered":"2023-10-08T16:05:01.498383+0000","last_clean":"2023-10-08T16:05:01.498383+0000","last_became_active":"2023-10-08T16:05:01.496839+0000","last_became_peered":"2023-10-08T16:05:01.496839+0000","last_unstale":"2023-10-08T16:05:01.498383+0000","last_undegraded":"2023-10-08T16:05:01.498383+0000","last_fullsized":"2023-10-08T16:05:01.498383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505139+0000","last_change":"2023-10-08T16:05:00.499292+0000","last_active":"2023-10-08T16:05:01.505139+0000","last_peered":"2023-10-08T16:05:01.505139+0000","last_clean":"2023-10-08T16:05:01.505139+0000","last_became_active":"2023-10-08T16:05:00.499046+0000","last_became_peered":"2023-10-08T16:05:00.499046+0000","last_unstale":"2023-10-08T16:05:01.505139+0000","last_undegraded":"2023-10-08T16:05:01.505139+0000","last_fullsized":"2023-10-08T16:05:01.505139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:36.532167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504767+0000","last_change":"2023-10-08T16:05:01.504578+0000","last_active":"2023-10-08T16:05:01.504767+0000","last_peered":"2023-10-08T16:05:01.504767+0000","last_clean":"2023-10-08T16:05:01.504767+0000","last_became_active":"2023-10-08T16:05:01.501061+0000","last_became_peered":"2023-10-08T16:05:01.501061+0000","last_unstale":"2023-10-08T16:05:01.504767+0000","last_undegraded":"2023-10-08T16:05:01.504767+0000","last_fullsized":"2023-10-08T16:05:01.504767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.508879+0000","last_change":"2023-10-08T16:05:00.496605+0000","last_active":"2023-10-08T16:05:01.508879+0000","last_peered":"2023-10-08T16:05:01.508879+0000","last_clean":"2023-10-08T16:05:01.508879+0000","last_became_active":"2023-10-08T16:05:00.496334+0000","last_became_peered":"2023-10-08T16:05:00.496334+0000","last_unstale":"2023-10-08T16:05:01.508879+0000","last_undegraded":"2023-10-08T16:05:01.508879+0000","last_fullsized":"2023-10-08T16:05:01.508879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:59.481561+0000","last_clean_scrub_stamp":"2023-10-08T16:04:59.481561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:36.633003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.501242+0000","last_change":"2023-10-08T16:05:01.501159+0000","last_active":"2023-10-08T16:05:01.501242+0000","last_peered":"2023-10-08T16:05:01.501242+0000","last_clean":"2023-10-08T16:05:01.501242+0000","last_became_active":"2023-10-08T16:05:01.500711+0000","last_became_peered":"2023-10-08T16:05:01.500711+0000","last_unstale":"2023-10-08T16:05:01.501242+0000","last_undegraded":"2023-10-08T16:05:01.501242+0000","last_fullsized":"2023-10-08T16:05:01.501242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:34.471207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510349+0000","last_change":"2023-10-08T16:05:01.510144+0000","last_active":"2023-10-08T16:05:01.510349+0000","last_peered":"2023-10-08T16:05:01.510349+0000","last_clean":"2023-10-08T16:05:01.510349+0000","last_became_active":"2023-10-08T16:05:01.509633+0000","last_became_peered":"2023-10-08T16:05:01.509633+0000","last_unstale":"2023-10-08T16:05:01.510349+0000","last_undegraded":"2023-10-08T16:05:01.510349+0000","last_fullsized":"2023-10-08T16:05:01.510349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.496004+0000","last_change":"2023-10-08T16:05:01.495936+0000","last_active":"2023-10-08T16:05:01.496004+0000","last_peered":"2023-10-08T16:05:01.496004+0000","last_clean":"2023-10-08T16:05:01.496004+0000","last_became_active":"2023-10-08T16:05:01.495683+0000","last_became_peered":"2023-10-08T16:05:01.495683+0000","last_unstale":"2023-10-08T16:05:01.496004+0000","last_undegraded":"2023-10-08T16:05:01.496004+0000","last_fullsized":"2023-10-08T16:05:01.496004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:52.286529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498422+0000","last_change":"2023-10-08T16:05:01.496960+0000","last_active":"2023-10-08T16:05:01.498422+0000","last_peered":"2023-10-08T16:05:01.498422+0000","last_clean":"2023-10-08T16:05:01.498422+0000","last_became_active":"2023-10-08T16:05:01.496720+0000","last_became_peered":"2023-10-08T16:05:01.496720+0000","last_unstale":"2023-10-08T16:05:01.498422+0000","last_undegraded":"2023-10-08T16:05:01.498422+0000","last_fullsized":"2023-10-08T16:05:01.498422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:27.685344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.507685+0000","last_change":"2023-10-08T16:05:01.507536+0000","last_active":"2023-10-08T16:05:01.507685+0000","last_peered":"2023-10-08T16:05:01.507685+0000","last_clean":"2023-10-08T16:05:01.507685+0000","last_became_active":"2023-10-08T16:05:01.507028+0000","last_became_peered":"2023-10-08T16:05:01.507028+0000","last_unstale":"2023-10-08T16:05:01.507685+0000","last_undegraded":"2023-10-08T16:05:01.507685+0000","last_fullsized":"2023-10-08T16:05:01.507685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:05.517473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498292+0000","last_change":"2023-10-08T16:05:01.497598+0000","last_active":"2023-10-08T16:05:01.498292+0000","last_peered":"2023-10-08T16:05:01.498292+0000","last_clean":"2023-10-08T16:05:01.498292+0000","last_became_active":"2023-10-08T16:05:01.497068+0000","last_became_peered":"2023-10-08T16:05:01.497068+0000","last_unstale":"2023-10-08T16:05:01.498292+0000","last_undegraded":"2023-10-08T16:05:01.498292+0000","last_fullsized":"2023-10-08T16:05:01.498292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:58.035903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.495329+0000","last_change":"2023-10-08T16:05:01.494815+0000","last_active":"2023-10-08T16:05:01.495329+0000","last_peered":"2023-10-08T16:05:01.495329+0000","last_clean":"2023-10-08T16:05:01.495329+0000","last_became_active":"2023-10-08T16:05:01.494588+0000","last_became_peered":"2023-10-08T16:05:01.494588+0000","last_unstale":"2023-10-08T16:05:01.495329+0000","last_undegraded":"2023-10-08T16:05:01.495329+0000","last_fullsized":"2023-10-08T16:05:01.495329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:50.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505789+0000","last_change":"2023-10-08T16:05:01.505706+0000","last_active":"2023-10-08T16:05:01.505789+0000","last_peered":"2023-10-08T16:05:01.505789+0000","last_clean":"2023-10-08T16:05:01.505789+0000","last_became_active":"2023-10-08T16:05:01.505486+0000","last_became_peered":"2023-10-08T16:05:01.505486+0000","last_unstale":"2023-10-08T16:05:01.505789+0000","last_undegraded":"2023-10-08T16:05:01.505789+0000","last_fullsized":"2023-10-08T16:05:01.505789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:23.892831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.497536+0000","last_change":"2023-10-08T16:05:01.497102+0000","last_active":"2023-10-08T16:05:01.497536+0000","last_peered":"2023-10-08T16:05:01.497536+0000","last_clean":"2023-10-08T16:05:01.497536+0000","last_became_active":"2023-10-08T16:05:01.496760+0000","last_became_peered":"2023-10-08T16:05:01.496760+0000","last_unstale":"2023-10-08T16:05:01.497536+0000","last_undegraded":"2023-10-08T16:05:01.497536+0000","last_fullsized":"2023-10-08T16:05:01.497536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.498454+0000","last_change":"2023-10-08T16:05:01.498081+0000","last_active":"2023-10-08T16:05:01.498454+0000","last_peered":"2023-10-08T16:05:01.498454+0000","last_clean":"2023-10-08T16:05:01.498454+0000","last_became_active":"2023-10-08T16:05:01.496861+0000","last_became_peered":"2023-10-08T16:05:01.496861+0000","last_unstale":"2023-10-08T16:05:01.498454+0000","last_undegraded":"2023-10-08T16:05:01.498454+0000","last_fullsized":"2023-10-08T16:05:01.498454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:55.348669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.499735+0000","last_change":"2023-10-08T16:05:01.499621+0000","last_active":"2023-10-08T16:05:01.499735+0000","last_peered":"2023-10-08T16:05:01.499735+0000","last_clean":"2023-10-08T16:05:01.499735+0000","last_became_active":"2023-10-08T16:05:01.499401+0000","last_became_peered":"2023-10-08T16:05:01.499401+0000","last_unstale":"2023-10-08T16:05:01.499735+0000","last_undegraded":"2023-10-08T16:05:01.499735+0000","last_fullsized":"2023-10-08T16:05:01.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:03.119415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.505149+0000","last_change":"2023-10-08T16:05:01.504917+0000","last_active":"2023-10-08T16:05:01.505149+0000","last_peered":"2023-10-08T16:05:01.505149+0000","last_clean":"2023-10-08T16:05:01.505149+0000","last_became_active":"2023-10-08T16:05:01.501765+0000","last_became_peered":"2023-10-08T16:05:01.501765+0000","last_unstale":"2023-10-08T16:05:01.505149+0000","last_undegraded":"2023-10-08T16:05:01.505149+0000","last_fullsized":"2023-10-08T16:05:01.505149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:44.793559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.510856+0000","last_change":"2023-10-08T16:05:01.510328+0000","last_active":"2023-10-08T16:05:01.510856+0000","last_peered":"2023-10-08T16:05:01.510856+0000","last_clean":"2023-10-08T16:05:01.510856+0000","last_became_active":"2023-10-08T16:05:01.509693+0000","last_became_peered":"2023-10-08T16:05:01.509693+0000","last_unstale":"2023-10-08T16:05:01.510856+0000","last_undegraded":"2023-10-08T16:05:01.510856+0000","last_fullsized":"2023-10-08T16:05:01.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:25.948094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:05:01.504190+0000","last_change":"2023-10-08T16:05:01.504127+0000","last_active":"2023-10-08T16:05:01.504190+0000","last_peered":"2023-10-08T16:05:01.504190+0000","last_clean":"2023-10-08T16:05:01.504190+0000","last_became_active":"2023-10-08T16:05:01.503128+0000","last_became_peered":"2023-10-08T16:05:01.503128+0000","last_unstale":"2023-10-08T16:05:01.504190+0000","last_undegraded":"2023-10-08T16:05:01.504190+0000","last_fullsized":"2023-10-08T16:05:01.504190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:00.486151+0000","last_clean_scrub_stamp":"2023-10-08T16:05:00.486151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:31.985315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[]}} 2023-10-08T16:05:16.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:05:16.405 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T16:05:16.405 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T16:05:16.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T16:05:16.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.556+0000 7f0cf6453700 1 Processor -- start 2023-10-08T16:05:16.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.556+0000 7f0cf6453700 1 -- start start 2023-10-08T16:05:16.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf6453700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0cf0157870 0x7f0cf015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf6453700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf6453700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf015cbb0 con 0x7f0cf015a620 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf6453700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf015bfa0 con 0x7f0cf0157870 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf6453700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf015c280 con 0x7f0cf0157c40 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0cf0157870 0x7f0cf015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0cf0157870 0x7f0cf015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35002/0 (socket says 172.21.15.60:35002) 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 -- 172.21.15.60:0/2346036178 learned_addr learned my addr 172.21.15.60:0/2346036178 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf49f0700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 -- 172.21.15.60:0/2346036178 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 msgr2=0x7f0cf0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 -- 172.21.15.60:0/2346036178 >> v1:172.21.15.144:6789/0 conn(0x7f0cf015a620 legacy=0x7f0cf015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 -- 172.21.15.60:0/2346036178 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf015c560 con 0x7f0cf0157870 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0cf49f0700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.557+0000 7f0ceffff700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf015b6a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80099b0 tx=0x7f0cd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81bcc2c51864258 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0ceeffd700 1 -- 172.21.15.60:0/2346036178 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800b820 con 0x7f0cf0157870 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0ceeffd700 1 -- 172.21.15.60:0/2346036178 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800b980 con 0x7f0cf0157870 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0ceeffd700 1 -- 172.21.15.60:0/2346036178 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800bd20 con 0x7f0cf0157870 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 -- 172.21.15.60:0/2346036178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 msgr2=0x7f0cf015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf015b6a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80099b0 tx=0x7f0cd8009250 comp rx=0 tx=0).stop 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 -- 172.21.15.60:0/2346036178 shutdown_connections 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 --2- 172.21.15.60:0/2346036178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf015b6a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 -- 172.21.15.60:0/2346036178 >> 172.21.15.60:0/2346036178 conn(0x7f0cf0068ce0 msgr2=0x7f0cf00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 -- 172.21.15.60:0/2346036178 shutdown_connections 2023-10-08T16:05:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.558+0000 7f0cf6453700 1 -- 172.21.15.60:0/2346036178 wait complete. 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.559+0000 7f0cf6453700 1 Processor -- start 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.559+0000 7f0cf6453700 1 -- start start 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf6453700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf6453700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf01605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf6453700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf015a620 0x7f0cf0160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf6453700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00cd600 con 0x7f0cf0157870 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf6453700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00c7030 con 0x7f0cf015a620 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf6453700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf015d840 con 0x7f0cf0157c40 2023-10-08T16:05:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0ceffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0ceffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf01562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35004/0 (socket says 172.21.15.60:35004) 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0ceffff700 1 -- 172.21.15.60:0/1342740771 learned_addr learned my addr 172.21.15.60:0/1342740771 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cf49f0700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf015a620 0x7f0cf0160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.560+0000 7f0cef7fe700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf01605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ceffff700 1 -- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 msgr2=0x7f0cf01605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ceffff700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf01605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ceffff700 1 -- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf015a620 msgr2=0x7f0cf0160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ceffff700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf015a620 0x7f0cf0160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ceffff700 1 -- 172.21.15.60:0/1342740771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80094f0 con 0x7f0cf0157870 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0cf49f0700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf015a620 0x7f0cf0160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ceffff700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf01562a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009290 tx=0x7f0cd8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8011d70 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8020070 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf00c6790 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd801b6a0 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.561+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf00c6d50 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.562+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf004c3c0 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.562+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cd8022030 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.563+0000 7f0ce7fff700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.563+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0cd8086480 con 0x7f0cf0157870 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.563+0000 7f0cef7fe700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.563+0000 7f0cef7fe700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0cd0066f30 0x7f0cd00693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0006fd0 tx=0x7f0ce0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.567+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cd80536f0 con 0x7f0cf0157870 2023-10-08T16:05:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.808+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0cf004c3c0 con 0x7f0cf0157870 2023-10-08T16:05:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.808+0000 7f0ce7fff700 1 -- 172.21.15.60:0/1342740771 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0cd8056d10 con 0x7f0cf0157870 2023-10-08T16:05:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:16.873 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T16:05:16.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0cd0066f30 msgr2=0x7f0cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0cd0066f30 0x7f0cd00693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0006fd0 tx=0x7f0ce0008040 comp rx=0 tx=0).stop 2023-10-08T16:05:16.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 msgr2=0x7f0cf01562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf01562a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009290 tx=0x7f0cd8016000 comp rx=0 tx=0).stop 2023-10-08T16:05:16.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 shutdown_connections 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf015a620 0x7f0cf0160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cf0157870 0x7f0cf01562a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 --2- 172.21.15.60:0/1342740771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf0157c40 0x7f0cf01605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 >> 172.21.15.60:0/1342740771 conn(0x7f0cf0068ce0 msgr2=0x7f0cf00b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 shutdown_connections 2023-10-08T16:05:16.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.810+0000 7f0cf6453700 1 -- 172.21.15.60:0/1342740771 wait complete. 2023-10-08T16:05:16.875 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T16:05:16.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.993+0000 7faf8f23d700 1 Processor -- start 2023-10-08T16:05:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.993+0000 7faf8f23d700 1 -- start start 2023-10-08T16:05:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8f23d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf88158e50 0x7faf880cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8f23d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8806c010 con 0x7faf88152010 2023-10-08T16:05:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8f23d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8806bd10 con 0x7faf881523e0 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8f23d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8815c060 con 0x7faf88158e50 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8d7da700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf88158e50 0x7faf880cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8cfd9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faf88152010 0x7faf8815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39612/0 (socket says 172.21.15.60:39612) 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.994+0000 7faf8cfd9700 1 -- 172.21.15.60:0/1039222137 learned_addr learned my addr 172.21.15.60:0/1039222137 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8d7da700 1 -- 172.21.15.60:0/1039222137 >> v1:172.21.15.144:6789/0 conn(0x7faf881523e0 legacy=0x7faf8806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8d7da700 1 -- 172.21.15.60:0/1039222137 >> v1:172.21.15.60:6789/0 conn(0x7faf88152010 legacy=0x7faf8815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf877fe700 1 -- 172.21.15.60:0/1039222137 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429174896 0 0) 0x7faf8806c010 con 0x7faf88152010 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8d7da700 1 -- 172.21.15.60:0/1039222137 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8815c340 con 0x7faf88158e50 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8d7da700 1 --2- 172.21.15.60:0/1039222137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf880cb750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf800098e0 tx=0x7faf800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe76dcec61865de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf877fe700 1 -- 172.21.15.60:0/1039222137 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80009e80 con 0x7faf88158e50 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf877fe700 1 -- 172.21.15.60:0/1039222137 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000b820 con 0x7faf88158e50 2023-10-08T16:05:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf877fe700 1 -- 172.21.15.60:0/1039222137 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000bba0 con 0x7faf88158e50 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8f23d700 1 -- 172.21.15.60:0/1039222137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 msgr2=0x7faf880cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8f23d700 1 --2- 172.21.15.60:0/1039222137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf880cb750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf800098e0 tx=0x7faf800091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8f23d700 1 -- 172.21.15.60:0/1039222137 shutdown_connections 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8f23d700 1 --2- 172.21.15.60:0/1039222137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf880cb750 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.995+0000 7faf8f23d700 1 -- 172.21.15.60:0/1039222137 >> 172.21.15.60:0/1039222137 conn(0x7faf88069870 msgr2=0x7faf88069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.996+0000 7faf8f23d700 1 -- 172.21.15.60:0/1039222137 shutdown_connections 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.996+0000 7faf8f23d700 1 -- 172.21.15.60:0/1039222137 wait complete. 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.997+0000 7faf8f23d700 1 Processor -- start 2023-10-08T16:05:17.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.997+0000 7faf8f23d700 1 -- start start 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.997+0000 7faf8f23d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf88152010 0x7faf880b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.997+0000 7faf8f23d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf881523e0 0x7faf8814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8f23d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf88167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8f23d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880cf270 con 0x7faf88158e50 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8f23d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880b48d0 con 0x7faf881523e0 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8f23d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8814e640 con 0x7faf88152010 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf88167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf88167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35022/0 (socket says 172.21.15.60:35022) 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 -- 172.21.15.60:0/844562358 learned_addr learned my addr 172.21.15.60:0/844562358 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8cfd9700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf88152010 0x7faf880b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf87fff700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf881523e0 0x7faf8814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 -- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf88152010 msgr2=0x7faf880b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf88152010 0x7faf880b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 -- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf881523e0 msgr2=0x7faf8814ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf881523e0 0x7faf8814ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 -- 172.21.15.60:0/844562358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009420 con 0x7faf88158e50 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf87fff700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf881523e0 0x7faf8814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8d7da700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf88167a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf800093f0 tx=0x7faf80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8001b450 con 0x7faf88158e50 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf80020070 con 0x7faf88158e50 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf880ced20 con 0x7faf88158e50 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8001b820 con 0x7faf88158e50 2023-10-08T16:05:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.998+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8814e2d0 con 0x7faf88158e50 2023-10-08T16:05:17.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:16.999+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8804c3c0 con 0x7faf88158e50 2023-10-08T16:05:17.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.000+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf80022030 con 0x7faf88158e50 2023-10-08T16:05:17.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.000+0000 7faf84ff9700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faf68066f30 0x7faf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.000+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf800865a0 con 0x7faf88158e50 2023-10-08T16:05:17.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.000+0000 7faf8cfd9700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faf68066f30 0x7faf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.000+0000 7faf8cfd9700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faf68066f30 0x7faf680693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf880cc090 tx=0x7faf70007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.004+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf80053810 con 0x7faf88158e50 2023-10-08T16:05:17.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.197+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf8804c3c0 con 0x7faf88158e50 2023-10-08T16:05:17.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.198+0000 7faf84ff9700 1 -- 172.21.15.60:0/844562358 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7faf80056e30 con 0x7faf88158e50 2023-10-08T16:05:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:17.200 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faf68066f30 msgr2=0x7faf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faf68066f30 0x7faf680693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf880cc090 tx=0x7faf70007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 msgr2=0x7faf88167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf88167a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf800093f0 tx=0x7faf80016000 comp rx=0 tx=0).stop 2023-10-08T16:05:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 shutdown_connections 2023-10-08T16:05:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faf68066f30 0x7faf680693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf88152010 0x7faf880b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf88158e50 0x7faf88167a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 --2- 172.21.15.60:0/844562358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf881523e0 0x7faf8814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.200+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 >> 172.21.15.60:0/844562358 conn(0x7faf88069870 msgr2=0x7faf8814c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.201+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 shutdown_connections 2023-10-08T16:05:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.201+0000 7faf8f23d700 1 -- 172.21.15.60:0/844562358 wait complete. 2023-10-08T16:05:17.214 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:17.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:17.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 Processor -- start 2023-10-08T16:05:17.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 -- start start 2023-10-08T16:05:17.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f21780b3570 0x7f217815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21780b4c30 0x7f21780b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780b14f0 con 0x7f21780b4860 2023-10-08T16:05:17.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780b17d0 con 0x7f21780b4c30 2023-10-08T16:05:17.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.335+0000 7f217e99d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780b1ab0 con 0x7f21780b3570 2023-10-08T16:05:17.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21780b4c30 0x7f21780b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21780b4c30 0x7f21780b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35034/0 (socket says 172.21.15.60:35034) 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 -- 172.21.15.60:0/2718943727 learned_addr learned my addr 172.21.15.60:0/2718943727 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f21777fe700 1 --2- 172.21.15.60:0/2718943727 >> v2:172.21.15.144:3300/0 conn(0x7f21780b3570 0x7f217815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 -- 172.21.15.60:0/2718943727 >> v2:172.21.15.144:3300/0 conn(0x7f21780b3570 msgr2=0x7f217815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 --2- 172.21.15.60:0/2718943727 >> v2:172.21.15.144:3300/0 conn(0x7f21780b3570 0x7f217815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 -- 172.21.15.60:0/2718943727 >> v1:172.21.15.144:6789/0 conn(0x7f21780b4860 legacy=0x7f2178159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 -- 172.21.15.60:0/2718943727 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780b1d90 con 0x7f21780b4c30 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f217cf3a700 1 --2- 172.21.15.60:0/2718943727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4c30 0x7f21780b6700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21780899c0 tx=0x7f2170009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5352ce2d75a8dce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f2176ffd700 1 -- 172.21.15.60:0/2718943727 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000e070 con 0x7f21780b4c30 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f2176ffd700 1 -- 172.21.15.60:0/2718943727 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000bab0 con 0x7f21780b4c30 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.336+0000 7f2176ffd700 1 -- 172.21.15.60:0/2718943727 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700092e0 con 0x7f21780b4c30 2023-10-08T16:05:17.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 -- 172.21.15.60:0/2718943727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4c30 msgr2=0x7f21780b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 --2- 172.21.15.60:0/2718943727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4c30 0x7f21780b6700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21780899c0 tx=0x7f2170009840 comp rx=0 tx=0).stop 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 -- 172.21.15.60:0/2718943727 shutdown_connections 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 --2- 172.21.15.60:0/2718943727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4c30 0x7f21780b6700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 --2- 172.21.15.60:0/2718943727 >> v2:172.21.15.144:3300/0 conn(0x7f21780b3570 0x7f217815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 -- 172.21.15.60:0/2718943727 >> 172.21.15.60:0/2718943727 conn(0x7f217809a0f0 msgr2=0x7f2178067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 -- 172.21.15.60:0/2718943727 shutdown_connections 2023-10-08T16:05:17.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.337+0000 7f217e99d700 1 -- 172.21.15.60:0/2718943727 wait complete. 2023-10-08T16:05:17.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.338+0000 7f217e99d700 1 Processor -- start 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.338+0000 7f217e99d700 1 -- start start 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217e99d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21780b3570 0x7f21780d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217e99d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 0x7f217809c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217e99d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b4c30 0x7f217809ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217e99d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217809de90 con 0x7f21780b4860 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217e99d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780abe60 con 0x7f21780b4c30 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217e99d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780ac420 con 0x7f21780b3570 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 0x7f217809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 0x7f217809c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35042/0 (socket says 172.21.15.60:35042) 2023-10-08T16:05:17.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 -- 172.21.15.60:0/2869827420 learned_addr learned my addr 172.21.15.60:0/2869827420 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f217cf3a700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b4c30 0x7f217809ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f2177fff700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21780b3570 0x7f21780d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 -- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21780b3570 msgr2=0x7f21780d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21780b3570 0x7f21780d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 -- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b4c30 msgr2=0x7f217809ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b4c30 0x7f217809ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 -- 172.21.15.60:0/2869827420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009ae0 con 0x7f21780b4860 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f21777fe700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 0x7f217809c540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f216c00e930 tx=0x7f216c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c013680 con 0x7f21780b4860 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.339+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0137e0 con 0x7f21780b4860 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.340+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217809d150 con 0x7f21780b4860 2023-10-08T16:05:17.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.340+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c013ba0 con 0x7f21780b4860 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.340+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21780ac0b0 con 0x7f21780b4860 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.340+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21780ac590 con 0x7f21780b4860 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.341+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f216c00c3e0 con 0x7f21780b4860 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.341+0000 7f215ffff700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.341+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f216c084560 con 0x7f21780b4860 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.341+0000 7f2177fff700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.342+0000 7f2177fff700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2168007fd0 tx=0x7f2168007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.346+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f216c0517d0 con 0x7f21780b4860 2023-10-08T16:05:17.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.538+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f217804c3c0 con 0x7f21780b4860 2023-10-08T16:05:17.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.539+0000 7f215ffff700 1 -- 172.21.15.60:0/2869827420 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f216c054df0 con 0x7f21780b4860 2023-10-08T16:05:17.540 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2164066f30 msgr2=0x7f21640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2168007fd0 tx=0x7f2168007eb0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 msgr2=0x7f217809c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 0x7f217809c540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f216c00e930 tx=0x7f216c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 shutdown_connections 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21780b3570 0x7f21780d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b4c30 0x7f217809ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 --2- 172.21.15.60:0/2869827420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21780b4860 0x7f217809c540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 >> 172.21.15.60:0/2869827420 conn(0x7f217809a0f0 msgr2=0x7f217815c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:17.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 shutdown_connections 2023-10-08T16:05:17.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.541+0000 7f217e99d700 1 -- 172.21.15.60:0/2869827420 wait complete. 2023-10-08T16:05:17.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:17.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.675+0000 7f4e5d586700 1 Processor -- start 2023-10-08T16:05:17.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e5d586700 1 -- start start 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e5d586700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e580c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e5d586700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5815b260 con 0x7f4e580cd900 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e5d586700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580c7830 con 0x7f4e5815dcc0 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e5d586700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5809af70 con 0x7f4e580c88d0 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e567fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e580cd900 0x7f4e5815b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39622/0 (socket says 172.21.15.60:39622) 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.676+0000 7f4e567fc700 1 -- 172.21.15.60:0/2278330482 learned_addr learned my addr 172.21.15.60:0/2278330482 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e577fe700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e580c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324314390 0 0) 0x7f4e5815b260 con 0x7f4e580cd900 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e44003570 con 0x7f4e580cd900 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384675599 0 0) 0x7f4e580c7830 con 0x7f4e5815dcc0 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e5815b260 con 0x7f4e5815dcc0 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2731393456 0 0) 0x7f4e44003570 con 0x7f4e580cd900 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 msgr2=0x7f4e580c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e580c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 >> v1:172.21.15.144:6789/0 conn(0x7f4e5815dcc0 legacy=0x7f4e5815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580c7b10 con 0x7f4e580cd900 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f4e40001470 con 0x7f4e580cd900 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 >> v1:172.21.15.60:6789/0 conn(0x7f4e580cd900 legacy=0x7f4e5815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e44003c20 0x7f4e44004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e44004810 0x7f4e44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5809af70 con 0x7f4e44004810 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4400bb70 con 0x7f4e44003c20 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4400bd30 con 0x7f4e580c88d0 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e567fc700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e44004810 0x7f4e44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e56ffd700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e44003c20 0x7f4e44004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e577fe700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e567fc700 1 -- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 msgr2=0x7f4e440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e567fc700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e567fc700 1 -- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e44003c20 msgr2=0x7f4e44004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e567fc700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e44003c20 0x7f4e44004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e567fc700 1 -- 172.21.15.60:0/2278330482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44003570 con 0x7f4e44004810 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e577fe700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e580c88d0 0x7f4e440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.677+0000 7f4e56ffd700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e44003c20 0x7f4e44004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e567fc700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e44004810 0x7f4e44004c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000c2d0 tx=0x7f4e40001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4726f1937f1f6c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000cba0 con 0x7f4e44004810 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4000cd00 con 0x7f4e44004810 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e55ffb700 1 -- 172.21.15.60:0/2278330482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40005b70 con 0x7f4e44004810 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e5d586700 1 -- 172.21.15.60:0/2278330482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e44004810 msgr2=0x7f4e44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e5d586700 1 --2- 172.21.15.60:0/2278330482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e44004810 0x7f4e44004c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000c2d0 tx=0x7f4e40001e10 comp rx=0 tx=0).stop 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e577fe700 1 -- 172.21.15.60:0/2278330482 reap_dead start 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e5d586700 1 -- 172.21.15.60:0/2278330482 shutdown_connections 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e5d586700 1 -- 172.21.15.60:0/2278330482 >> 172.21.15.60:0/2278330482 conn(0x7f4e58068170 msgr2=0x7f4e580cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e5d586700 1 -- 172.21.15.60:0/2278330482 shutdown_connections 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.678+0000 7f4e5d586700 1 -- 172.21.15.60:0/2278330482 wait complete. 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 Processor -- start 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 -- start start 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44004810 0x7f4e580b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 0x7f4e580b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5816a830 0x7f4e5816acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5809a350 con 0x7f4e580b2c00 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58099740 con 0x7f4e5816a830 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e5d586700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58099a20 con 0x7f4e44004810 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e567fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 0x7f4e580b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e567fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 0x7f4e580b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35060/0 (socket says 172.21.15.60:35060) 2023-10-08T16:05:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.680+0000 7f4e567fc700 1 -- 172.21.15.60:0/1620191352 learned_addr learned my addr 172.21.15.60:0/1620191352 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e56ffd700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44004810 0x7f4e580b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e577fe700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5816a830 0x7f4e5816acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e567fc700 1 -- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44004810 msgr2=0x7f4e580b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e567fc700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44004810 0x7f4e580b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e567fc700 1 -- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5816a830 msgr2=0x7f4e5816acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e567fc700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5816a830 0x7f4e5816acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e567fc700 1 -- 172.21.15.60:0/1620191352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58099d00 con 0x7f4e580b2c00 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e56ffd700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44004810 0x7f4e580b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e577fe700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5816a830 0x7f4e5816acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e567fc700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 0x7f4e580b2500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bb40 tx=0x7f4e40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40001740 con 0x7f4e580b2c00 2023-10-08T16:05:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400070d0 con 0x7f4e580b2c00 2023-10-08T16:05:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40007490 con 0x7f4e580b2c00 2023-10-08T16:05:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5809a350 con 0x7f4e580b2c00 2023-10-08T16:05:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.681+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e58099360 con 0x7f4e580b2c00 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.682+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5809a4e0 con 0x7f4e580b2c00 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.682+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e40019030 con 0x7f4e580b2c00 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.683+0000 7f4e4effd700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e38066f30 0x7f4e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.683+0000 7f4e56ffd700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e38066f30 0x7f4e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.683+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e40085c20 con 0x7f4e580b2c00 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.683+0000 7f4e56ffd700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e38066f30 0x7f4e380693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e48007f40 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:17.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.687+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e40052e90 con 0x7f4e580b2c00 2023-10-08T16:05:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.878+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e5804c3c0 con 0x7f4e580b2c00 2023-10-08T16:05:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.878+0000 7f4e4effd700 1 -- 172.21.15.60:0/1620191352 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e400564b0 con 0x7f4e580b2c00 2023-10-08T16:05:17.880 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:17.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e38066f30 msgr2=0x7f4e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e38066f30 0x7f4e380693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e48007f40 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2023-10-08T16:05:17.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 msgr2=0x7f4e580b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:17.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 0x7f4e580b2500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bb40 tx=0x7f4e40015000 comp rx=0 tx=0).stop 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 shutdown_connections 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e38066f30 0x7f4e380693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44004810 0x7f4e580b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e5816a830 0x7f4e5816acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 --2- 172.21.15.60:0/1620191352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e580b2c00 0x7f4e580b2500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.880+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 >> 172.21.15.60:0/1620191352 conn(0x7f4e58068170 msgr2=0x7f4e581571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.881+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 shutdown_connections 2023-10-08T16:05:17.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:17.881+0000 7f4e5d586700 1 -- 172.21.15.60:0/1620191352 wait complete. 2023-10-08T16:05:17.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:18.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.014+0000 7f28978ed700 1 Processor -- start 2023-10-08T16:05:18.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.014+0000 7f28978ed700 1 -- start start 2023-10-08T16:05:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f28978ed700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28900678b0 0x7f289015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f28978ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f28978ed700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28900c9390 0x7f289015e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f28978ed700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cae70 con 0x7f28900678b0 2023-10-08T16:05:18.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f28978ed700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cb150 con 0x7f28900c9390 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f28978ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900cb430 con 0x7f28900cbf10 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f2895689700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28900678b0 0x7f289015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f2895689700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28900678b0 0x7f289015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35064/0 (socket says 172.21.15.60:35064) 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.015+0000 7f2895689700 1 -- 172.21.15.60:0/239552550 learned_addr learned my addr 172.21.15.60:0/239552550 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895e8a700 1 --2- 172.21.15.60:0/239552550 >> v2:172.21.15.144:3300/0 conn(0x7f28900c9390 0x7f289015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2894e88700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895689700 1 -- 172.21.15.60:0/239552550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 msgr2=0x7f289015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895689700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895689700 1 -- 172.21.15.60:0/239552550 >> v2:172.21.15.144:3300/0 conn(0x7f28900c9390 msgr2=0x7f289015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895689700 1 --2- 172.21.15.60:0/239552550 >> v2:172.21.15.144:3300/0 conn(0x7f28900c9390 0x7f289015e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895689700 1 -- 172.21.15.60:0/239552550 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900cb710 con 0x7f28900678b0 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895e8a700 1 --2- 172.21.15.60:0/239552550 >> v2:172.21.15.144:3300/0 conn(0x7f28900c9390 0x7f289015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2894e88700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f2895689700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900678b0 0x7f289015db80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28880099b0 tx=0x7f2888009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1460c6016b11ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f288ffff700 1 -- 172.21.15.60:0/239552550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800b820 con 0x7f28900678b0 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f288ffff700 1 -- 172.21.15.60:0/239552550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800b980 con 0x7f28900678b0 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f288ffff700 1 -- 172.21.15.60:0/239552550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800bd20 con 0x7f28900678b0 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 -- 172.21.15.60:0/239552550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900678b0 msgr2=0x7f289015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900678b0 0x7f289015db80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28880099b0 tx=0x7f2888009250 comp rx=0 tx=0).stop 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 -- 172.21.15.60:0/239552550 shutdown_connections 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 --2- 172.21.15.60:0/239552550 >> v2:172.21.15.144:3300/0 conn(0x7f28900c9390 0x7f289015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900678b0 0x7f289015db80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 --2- 172.21.15.60:0/239552550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.016+0000 7f28978ed700 1 -- 172.21.15.60:0/239552550 >> 172.21.15.60:0/239552550 conn(0x7f2890069870 msgr2=0x7f2890069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.017+0000 7f28978ed700 1 -- 172.21.15.60:0/239552550 shutdown_connections 2023-10-08T16:05:18.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.017+0000 7f28978ed700 1 -- 172.21.15.60:0/239552550 wait complete. 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.018+0000 7f28978ed700 1 Processor -- start 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.018+0000 7f28978ed700 1 -- start start 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.018+0000 7f28978ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28900678b0 0x7f28900c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.018+0000 7f28978ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 0x7f28900c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f28978ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f28978ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c8130 con 0x7f28900c9390 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f28978ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c8b00 con 0x7f28900678b0 2023-10-08T16:05:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f28978ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c7520 con 0x7f28900cbf10 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 0x7f28900c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 0x7f28900c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35080/0 (socket says 172.21.15.60:35080) 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 -- 172.21.15.60:0/2511135492 learned_addr learned my addr 172.21.15.60:0/2511135492 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2895689700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28900678b0 0x7f28900c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2895e8a700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 -- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 msgr2=0x7f289015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 -- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28900678b0 msgr2=0x7f28900c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28900678b0 0x7f28900c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 -- 172.21.15.60:0/2511135492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880094f0 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f2894e88700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 0x7f28900c85c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f288400c850 tx=0x7f2884008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884011600 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2884011760 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2884011b00 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28900c7800 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.019+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28900c7dc0 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.020+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289004c3c0 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.021+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2884018350 con 0x7f28900c9390 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.021+0000 7f288d7fa700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f287c066f30 0x7f287c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.021+0000 7f2895689700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f287c066f30 0x7f287c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.021+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28840843d0 con 0x7f28900c9390 2023-10-08T16:05:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.022+0000 7f2895689700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f287c066f30 0x7f287c0693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28880099b0 tx=0x7f2888017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.025+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28840550d0 con 0x7f28900c9390 2023-10-08T16:05:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.217+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28900c8270 con 0x7f28900c9390 2023-10-08T16:05:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.217+0000 7f288d7fa700 1 -- 172.21.15.60:0/2511135492 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2884054c60 con 0x7f28900c9390 2023-10-08T16:05:18.219 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f287c066f30 msgr2=0x7f287c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f287c066f30 0x7f287c0693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28880099b0 tx=0x7f2888017000 comp rx=0 tx=0).stop 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 msgr2=0x7f28900c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 0x7f28900c85c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f288400c850 tx=0x7f2884008040 comp rx=0 tx=0).stop 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 shutdown_connections 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f287c066f30 0x7f287c0693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28900cbf10 0x7f289015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28900678b0 0x7f28900c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 --2- 172.21.15.60:0/2511135492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28900c9390 0x7f28900c85c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 >> 172.21.15.60:0/2511135492 conn(0x7f2890069870 msgr2=0x7f289015ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 shutdown_connections 2023-10-08T16:05:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.219+0000 7f28978ed700 1 -- 172.21.15.60:0/2511135492 wait complete. 2023-10-08T16:05:18.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:18.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.350+0000 7fb55ccfc700 1 Processor -- start 2023-10-08T16:05:18.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.350+0000 7fb55ccfc700 1 -- start start 2023-10-08T16:05:18.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb55ccfc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb55ccfc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5580cbd40 0x7fb558067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb55ccfc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb55806c630 0x7fb558067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb55ccfc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580cb370 con 0x7fb5580cbd40 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb55ccfc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580b0c60 con 0x7fb55806c630 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb55ccfc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55806a1e0 con 0x7fb5580b0890 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb555d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5580cbd40 0x7fb558067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb555d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5580cbd40 0x7fb558067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35096/0 (socket says 172.21.15.60:35096) 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.351+0000 7fb555d9b700 1 -- 172.21.15.60:0/2466060016 learned_addr learned my addr 172.21.15.60:0/2466060016 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb556d9d700 1 --2- 172.21.15.60:0/2466060016 >> v2:172.21.15.144:3300/0 conn(0x7fb55806c630 0x7fb558067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55659c700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb555d9b700 1 -- 172.21.15.60:0/2466060016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 msgr2=0x7fb5580cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:18.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb555d9b700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb555d9b700 1 -- 172.21.15.60:0/2466060016 >> v2:172.21.15.144:3300/0 conn(0x7fb55806c630 msgr2=0x7fb558067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb555d9b700 1 --2- 172.21.15.60:0/2466060016 >> v2:172.21.15.144:3300/0 conn(0x7fb55806c630 0x7fb558067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb555d9b700 1 -- 172.21.15.60:0/2466060016 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55806cb80 con 0x7fb5580cbd40 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55659c700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb555d9b700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5580cbd40 0x7fb558067660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb558071430 tx=0x7fb540009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50745539493e683f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55559a700 1 -- 172.21.15.60:0/2466060016 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000b860 con 0x7fb5580cbd40 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55559a700 1 -- 172.21.15.60:0/2466060016 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000b9c0 con 0x7fb5580cbd40 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55559a700 1 -- 172.21.15.60:0/2466060016 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000bd60 con 0x7fb5580cbd40 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55ccfc700 1 -- 172.21.15.60:0/2466060016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5580cbd40 msgr2=0x7fb558067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.352+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5580cbd40 0x7fb558067660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb558071430 tx=0x7fb540009250 comp rx=0 tx=0).stop 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 -- 172.21.15.60:0/2466060016 shutdown_connections 2023-10-08T16:05:18.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/2466060016 >> v2:172.21.15.144:3300/0 conn(0x7fb55806c630 0x7fb558067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/2466060016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5580cbd40 0x7fb558067660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 -- 172.21.15.60:0/2466060016 >> 172.21.15.60:0/2466060016 conn(0x7fb55806fe50 msgr2=0x7fb558069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:18.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 -- 172.21.15.60:0/2466060016 shutdown_connections 2023-10-08T16:05:18.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.353+0000 7fb55ccfc700 1 -- 172.21.15.60:0/2466060016 wait complete. 2023-10-08T16:05:18.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 Processor -- start 2023-10-08T16:05:18.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 -- start start 2023-10-08T16:05:18.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 0x7fb5580b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5580cbd40 0x7fb558159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580b2f00 con 0x7fb55806c630 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558159740 con 0x7fb5580cbd40 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55ccfc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580c3cb0 con 0x7fb5580b0890 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 0x7fb5580b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 0x7fb5580b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35106/0 (socket says 172.21.15.60:35106) 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.354+0000 7fb55659c700 1 -- 172.21.15.60:0/1305431617 learned_addr learned my addr 172.21.15.60:0/1305431617 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb556d9d700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5580cbd40 0x7fb558159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb555d9b700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55659c700 1 -- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 msgr2=0x7fb5580b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55659c700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55659c700 1 -- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5580cbd40 msgr2=0x7fb558159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55659c700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5580cbd40 0x7fb558159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55659c700 1 -- 172.21.15.60:0/1305431617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400094f0 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb556d9d700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5580cbd40 0x7fb558159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55659c700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 0x7fb5580b3560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c830 tx=0x7fb550008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550011600 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb550011760 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550011b20 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5580b3c20 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.355+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5580b41e0 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.356+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55804c3c0 con 0x7fb55806c630 2023-10-08T16:05:18.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.356+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb55000a3e0 con 0x7fb55806c630 2023-10-08T16:05:18.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.357+0000 7fb54e7fc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb538066f30 0x7fb5380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.357+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5500849f0 con 0x7fb55806c630 2023-10-08T16:05:18.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.357+0000 7fb555d9b700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb538066f30 0x7fb5380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.357+0000 7fb555d9b700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb538066f30 0x7fb5380693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb558071430 tx=0x7fb540017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.361+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb550051c60 con 0x7fb55806c630 2023-10-08T16:05:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.598+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb55806cdc0 con 0x7fb55806c630 2023-10-08T16:05:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.598+0000 7fb54e7fc700 1 -- 172.21.15.60:0/1305431617 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fb550015090 con 0x7fb55806c630 2023-10-08T16:05:18.600 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:18.600 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb538066f30 msgr2=0x7fb5380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb538066f30 0x7fb5380693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb558071430 tx=0x7fb540017000 comp rx=0 tx=0).stop 2023-10-08T16:05:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 msgr2=0x7fb5580b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 0x7fb5580b3560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c830 tx=0x7fb550008040 comp rx=0 tx=0).stop 2023-10-08T16:05:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 shutdown_connections 2023-10-08T16:05:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb538066f30 0x7fb5380693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5580cbd40 0x7fb558159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55806c630 0x7fb5580b3560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 --2- 172.21.15.60:0/1305431617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5580b0890 0x7fb5580b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 >> 172.21.15.60:0/1305431617 conn(0x7fb55806fe50 msgr2=0x7fb5580ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 shutdown_connections 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.600+0000 7fb55ccfc700 1 -- 172.21.15.60:0/1305431617 wait complete. 2023-10-08T16:05:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:18.614 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.732+0000 7f13f1305700 1 Processor -- start 2023-10-08T16:05:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.732+0000 7f13f1305700 1 -- start start 2023-10-08T16:05:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.732+0000 7f13f1305700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13ec15a620 0x7f13ec15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13f1305700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec15cbb0 con 0x7f13ec157870 2023-10-08T16:05:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13f1305700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec15bfa0 con 0x7f13ec15d580 2023-10-08T16:05:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13f1305700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec15bdb0 con 0x7f13ec15a620 2023-10-08T16:05:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13ea7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13ec15a620 0x7f13ec15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13eaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f13ec157870 0x7f13ec15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39626/0 (socket says 172.21.15.60:39626) 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13eaffd700 1 -- 172.21.15.60:0/3433386420 learned_addr learned my addr 172.21.15.60:0/3433386420 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13ea7fc700 1 -- 172.21.15.60:0/3433386420 >> v1:172.21.15.144:6789/0 conn(0x7f13ec15d580 legacy=0x7f13ec158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13ea7fc700 1 -- 172.21.15.60:0/3433386420 >> v1:172.21.15.60:6789/0 conn(0x7f13ec157870 legacy=0x7f13ec15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13ea7fc700 1 -- 172.21.15.60:0/3433386420 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec15c280 con 0x7f13ec15a620 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13ea7fc700 1 --2- 172.21.15.60:0/3433386420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15a620 0x7f13ec15d040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13d40098e0 tx=0x7f13d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24132069b71e034c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13e9ffb700 1 -- 172.21.15.60:0/3433386420 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4009e80 con 0x7f13ec15a620 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13e9ffb700 1 -- 172.21.15.60:0/3433386420 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d400b860 con 0x7f13ec15a620 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.733+0000 7f13e9ffb700 1 -- 172.21.15.60:0/3433386420 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400bbe0 con 0x7f13ec15a620 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 -- 172.21.15.60:0/3433386420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15a620 msgr2=0x7f13ec15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 --2- 172.21.15.60:0/3433386420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15a620 0x7f13ec15d040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13d40098e0 tx=0x7f13d40091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 -- 172.21.15.60:0/3433386420 shutdown_connections 2023-10-08T16:05:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 --2- 172.21.15.60:0/3433386420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15a620 0x7f13ec15d040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 -- 172.21.15.60:0/3433386420 >> 172.21.15.60:0/3433386420 conn(0x7f13ec068ce0 msgr2=0x7f13ec0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 -- 172.21.15.60:0/3433386420 shutdown_connections 2023-10-08T16:05:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.734+0000 7f13f1305700 1 -- 172.21.15.60:0/3433386420 wait complete. 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.735+0000 7f13f1305700 1 Processor -- start 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.735+0000 7f13f1305700 1 -- start start 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13f1305700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec157870 0x7f13ec151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13f1305700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec15a620 0x7f13ec152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13f1305700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 0x7f13ec153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13f1305700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec153b80 con 0x7f13ec15d580 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13f1305700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec152490 con 0x7f13ec15a620 2023-10-08T16:05:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13f1305700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec151880 con 0x7f13ec157870 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 0x7f13ec153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 0x7f13ec153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35128/0 (socket says 172.21.15.60:35128) 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 -- 172.21.15.60:0/2343802609 learned_addr learned my addr 172.21.15.60:0/2343802609 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13ea7fc700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec15a620 0x7f13ec152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eaffd700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec157870 0x7f13ec151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 -- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec157870 msgr2=0x7f13ec151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec157870 0x7f13ec151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 -- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec15a620 msgr2=0x7f13ec152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec15a620 0x7f13ec152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 -- 172.21.15.60:0/2343802609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009420 con 0x7f13ec15d580 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13eb7fe700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 0x7f13ec153640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c490 tx=0x7f13dc007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00ce40 con 0x7f13ec15d580 2023-10-08T16:05:18.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.736+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc011590 con 0x7f13ec15d580 2023-10-08T16:05:18.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.737+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec151b60 con 0x7f13ec15d580 2023-10-08T16:05:18.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.737+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc011950 con 0x7f13ec15d580 2023-10-08T16:05:18.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.737+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec152120 con 0x7f13ec15d580 2023-10-08T16:05:18.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.737+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec070b10 con 0x7f13ec15d580 2023-10-08T16:05:18.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.738+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13dc011cc0 con 0x7f13ec15d580 2023-10-08T16:05:18.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.738+0000 7f13e2ffd700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:18.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.738+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13dc0837f0 con 0x7f13ec15d580 2023-10-08T16:05:18.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.738+0000 7f13eaffd700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:18.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.739+0000 7f13eaffd700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13cc066f30 0x7f13cc0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0b3500 tx=0x7f13e4001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.743+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13dc050a60 con 0x7f13ec15d580 2023-10-08T16:05:18.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.938+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13ec04c3c0 con 0x7f13ec15d580 2023-10-08T16:05:18.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.938+0000 7f13e2ffd700 1 -- 172.21.15.60:0/2343802609 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f13dc017070 con 0x7f13ec15d580 2023-10-08T16:05:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:18.940 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:18.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13cc066f30 msgr2=0x7f13cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13cc066f30 0x7f13cc0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0b3500 tx=0x7f13e4001a10 comp rx=0 tx=0).stop 2023-10-08T16:05:18.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 msgr2=0x7f13ec153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:18.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 0x7f13ec153640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c490 tx=0x7f13dc007f20 comp rx=0 tx=0).stop 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 shutdown_connections 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13cc066f30 0x7f13cc0693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.940+0000 7f13f1305700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec157870 0x7f13ec151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.941+0000 7f13f1305700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13ec15d580 0x7f13ec153640 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.941+0000 7f13f1305700 1 --2- 172.21.15.60:0/2343802609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec15a620 0x7f13ec152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.941+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 >> 172.21.15.60:0/2343802609 conn(0x7f13ec068ce0 msgr2=0x7f13ec158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.941+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 shutdown_connections 2023-10-08T16:05:18.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:18.941+0000 7f13f1305700 1 -- 172.21.15.60:0/2343802609 wait complete. 2023-10-08T16:05:18.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:18.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:19.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.075+0000 7f40d2a06700 1 Processor -- start 2023-10-08T16:05:19.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.075+0000 7f40d2a06700 1 -- start start 2023-10-08T16:05:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40d2a06700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40cc15b2e0 0x7f40cc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40d2a06700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc0cc160 0x7f40cc0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40d2a06700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc157010 con 0x7f40cc156c40 2023-10-08T16:05:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40d2a06700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc15b710 con 0x7f40cc15b2e0 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40d2a06700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0cbdf0 con 0x7f40cc0cc160 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40cb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40cc15b2e0 0x7f40cc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.076+0000 7f40cb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40cc15b2e0 0x7f40cc0cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35136/0 (socket says 172.21.15.60:35136) 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40cb7fe700 1 -- 172.21.15.60:0/2700049498 learned_addr learned my addr 172.21.15.60:0/2700049498 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40d0fa3700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc0cc160 0x7f40cc0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40cb7fe700 1 -- 172.21.15.60:0/2700049498 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc0cc160 msgr2=0x7f40cc0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40cb7fe700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc0cc160 0x7f40cc0cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40cb7fe700 1 -- 172.21.15.60:0/2700049498 >> v1:172.21.15.144:6789/0 conn(0x7f40cc156c40 legacy=0x7f40cc0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40cb7fe700 1 -- 172.21.15.60:0/2700049498 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0cbbb0 con 0x7f40cc15b2e0 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40d0fa3700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc0cc160 0x7f40cc0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40cb7fe700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc15b2e0 0x7f40cc0cb670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40c00099b0 tx=0x7f40c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481952cbccb161e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40caffd700 1 -- 172.21.15.60:0/2700049498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000b860 con 0x7f40cc15b2e0 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40caffd700 1 -- 172.21.15.60:0/2700049498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000b9c0 con 0x7f40cc15b2e0 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.077+0000 7f40caffd700 1 -- 172.21.15.60:0/2700049498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000bd60 con 0x7f40cc15b2e0 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 -- 172.21.15.60:0/2700049498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc15b2e0 msgr2=0x7f40cc0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc15b2e0 0x7f40cc0cb670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40c00099b0 tx=0x7f40c0009250 comp rx=0 tx=0).stop 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 -- 172.21.15.60:0/2700049498 shutdown_connections 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc0cc160 0x7f40cc0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2700049498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc15b2e0 0x7f40cc0cb670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 -- 172.21.15.60:0/2700049498 >> 172.21.15.60:0/2700049498 conn(0x7f40cc0ce570 msgr2=0x7f40cc0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 -- 172.21.15.60:0/2700049498 shutdown_connections 2023-10-08T16:05:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.078+0000 7f40d2a06700 1 -- 172.21.15.60:0/2700049498 wait complete. 2023-10-08T16:05:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.079+0000 7f40d2a06700 1 Processor -- start 2023-10-08T16:05:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.079+0000 7f40d2a06700 1 -- start start 2023-10-08T16:05:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 0x7f40cc142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40cc156c40 0x7f40cc0c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc15b2e0 0x7f40cc0b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1424d0 con 0x7f40cc0cc160 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b2580 con 0x7f40cc156c40 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc158870 con 0x7f40cc15b2e0 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 0x7f40cc142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 0x7f40cc142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35150/0 (socket says 172.21.15.60:35150) 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 -- 172.21.15.60:0/2568827804 learned_addr learned my addr 172.21.15.60:0/2568827804 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d0fa3700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc15b2e0 0x7f40cc0b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cb7fe700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40cc156c40 0x7f40cc0c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 -- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc15b2e0 msgr2=0x7f40cc0b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc15b2e0 0x7f40cc0b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 -- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40cc156c40 msgr2=0x7f40cc0c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40cc156c40 0x7f40cc0c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 -- 172.21.15.60:0/2568827804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00094f0 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d0fa3700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc15b2e0 0x7f40cc0b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cb7fe700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40cc156c40 0x7f40cc0c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40cbfff700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 0x7f40cc142c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c590 tx=0x7f40bc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011590 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc0116f0 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011ab0 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.080+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc0b1f30 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.081+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc158b50 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.081+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc04c3c0 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.082+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40bc01b3b0 con 0x7f40cc0cc160 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.082+0000 7f40b3fff700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.082+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40bc083a50 con 0x7f40cc0cc160 2023-10-08T16:05:19.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.082+0000 7f40cb7fe700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.083+0000 7f40cb7fe700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f40b8066f30 0x7f40b80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f40c00099b0 tx=0x7f40c0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.086+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40bc050cc0 con 0x7f40cc0cc160 2023-10-08T16:05:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.279+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40cc0b2860 con 0x7f40cc0cc160 2023-10-08T16:05:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.279+0000 7f40b3fff700 1 -- 172.21.15.60:0/2568827804 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40bc017070 con 0x7f40cc0cc160 2023-10-08T16:05:19.281 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f40b8066f30 msgr2=0x7f40b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f40b8066f30 0x7f40b80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f40c00099b0 tx=0x7f40c0017000 comp rx=0 tx=0).stop 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 msgr2=0x7f40cc142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 0x7f40cc142c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c590 tx=0x7f40bc00c950 comp rx=0 tx=0).stop 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 shutdown_connections 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40cc15b2e0 0x7f40cc0b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40cc0cc160 0x7f40cc142c60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 --2- 172.21.15.60:0/2568827804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40cc156c40 0x7f40cc0c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 >> 172.21.15.60:0/2568827804 conn(0x7f40cc0ce570 msgr2=0x7f40cc14c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 shutdown_connections 2023-10-08T16:05:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.281+0000 7f40d2a06700 1 -- 172.21.15.60:0/2568827804 wait complete. 2023-10-08T16:05:19.295 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:19.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.415+0000 7f1bfc8a5700 1 Processor -- start 2023-10-08T16:05:19.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.415+0000 7f1bfc8a5700 1 -- start start 2023-10-08T16:05:19.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bfc8a5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1bf815a290 0x7f1bf806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bfc8a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1bf806aae0 0x7f1bf80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bfc8a5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf80b0790 con 0x7f1bf8159ec0 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bfc8a5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf806af20 con 0x7f1bf806aae0 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bfc8a5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf80ce1f0 con 0x7f1bf815a290 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1bf806aae0 0x7f1bf80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1bf8159ec0 0x7f1bf80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39632/0 (socket says 172.21.15.60:39632) 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1bf806aae0 0x7f1bf80cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35160/0 (socket says 172.21.15.60:35160) 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 -- 172.21.15.60:0/3493069452 learned_addr learned my addr 172.21.15.60:0/3493069452 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf5d9b700 1 --2- 172.21.15.60:0/3493069452 >> v2:172.21.15.144:3300/0 conn(0x7f1bf815a290 0x7f1bf806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 -- 172.21.15.60:0/3493069452 >> v2:172.21.15.144:3300/0 conn(0x7f1bf815a290 msgr2=0x7f1bf806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 --2- 172.21.15.60:0/3493069452 >> v2:172.21.15.144:3300/0 conn(0x7f1bf815a290 0x7f1bf806a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 -- 172.21.15.60:0/3493069452 >> v1:172.21.15.60:6789/0 conn(0x7f1bf8159ec0 legacy=0x7f1bf80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf559a700 1 -- 172.21.15.60:0/3493069452 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578751962 0 0) 0x7f1bf80b0790 con 0x7f1bf8159ec0 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 -- 172.21.15.60:0/3493069452 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf80b0b20 con 0x7f1bf806aae0 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf6d9d700 1 --2- 172.21.15.60:0/3493069452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf806aae0 0x7f1bf80cf590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8089910 tx=0x7f1bf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639e350c40e227e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf559a700 1 -- 172.21.15.60:0/3493069452 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000b860 con 0x7f1bf806aae0 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf559a700 1 -- 172.21.15.60:0/3493069452 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf000b9c0 con 0x7f1bf806aae0 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.416+0000 7f1bf559a700 1 -- 172.21.15.60:0/3493069452 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000bd60 con 0x7f1bf806aae0 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/3493069452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf806aae0 msgr2=0x7f1bf80cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/3493069452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf806aae0 0x7f1bf80cf590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8089910 tx=0x7f1bf0009250 comp rx=0 tx=0).stop 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/3493069452 shutdown_connections 2023-10-08T16:05:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/3493069452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf806aae0 0x7f1bf80cf590 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/3493069452 >> v2:172.21.15.144:3300/0 conn(0x7f1bf815a290 0x7f1bf806a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/3493069452 >> 172.21.15.60:0/3493069452 conn(0x7f1bf80d1880 msgr2=0x7f1bf80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/3493069452 shutdown_connections 2023-10-08T16:05:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.417+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/3493069452 wait complete. 2023-10-08T16:05:19.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.418+0000 7f1bfc8a5700 1 Processor -- start 2023-10-08T16:05:19.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.418+0000 7f1bfc8a5700 1 -- start start 2023-10-08T16:05:19.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bfc8a5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bf806aae0 0x7f1bf80c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bfc8a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 0x7f1bf80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bfc8a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1bf815a290 0x7f1bf80b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bfc8a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80b4b20 con 0x7f1bf8159ec0 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bfc8a5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80c8720 con 0x7f1bf806aae0 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bfc8a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80b4090 con 0x7f1bf815a290 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 0x7f1bf80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 0x7f1bf80b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35166/0 (socket says 172.21.15.60:35166) 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 -- 172.21.15.60:0/321292858 learned_addr learned my addr 172.21.15.60:0/321292858 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf659c700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bf806aae0 0x7f1bf80c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf6d9d700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1bf815a290 0x7f1bf80b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 -- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1bf815a290 msgr2=0x7f1bf80b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1bf815a290 0x7f1bf80b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 -- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bf806aae0 msgr2=0x7f1bf80c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bf806aae0 0x7f1bf80c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 -- 172.21.15.60:0/321292858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00094f0 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1bf5d9b700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 0x7f1bf80b3b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d860 tx=0x7f1bec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.419+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0125f0 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.420+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec012750 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.420+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf80b42e0 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.420+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec012b10 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.420+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf80b5080 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.421+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf80b52a0 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.421+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bec01e460 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.421+0000 7f1be67fc700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1bd8066f30 0x7f1bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.421+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bec084a60 con 0x7f1bf8159ec0 2023-10-08T16:05:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.421+0000 7f1bf659c700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1bd8066f30 0x7f1bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.422+0000 7f1bf659c700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1bd8066f30 0x7f1bd80693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1be8001560 tx=0x7f1be8001b00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.426+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bec055760 con 0x7f1bf8159ec0 2023-10-08T16:05:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.619+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bf804c3c0 con 0x7f1bf8159ec0 2023-10-08T16:05:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.619+0000 7f1be67fc700 1 -- 172.21.15.60:0/321292858 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bec0552f0 con 0x7f1bf8159ec0 2023-10-08T16:05:19.620 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:19.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1bd8066f30 msgr2=0x7f1bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1bd8066f30 0x7f1bd80693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1be8001560 tx=0x7f1be8001b00 comp rx=0 tx=0).stop 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 msgr2=0x7f1bf80b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 0x7f1bf80b3b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d860 tx=0x7f1bec008040 comp rx=0 tx=0).stop 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 shutdown_connections 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1bd8066f30 0x7f1bd80693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1bf815a290 0x7f1bf80b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bf806aae0 0x7f1bf80c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 --2- 172.21.15.60:0/321292858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8159ec0 0x7f1bf80b3b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 >> 172.21.15.60:0/321292858 conn(0x7f1bf80d1880 msgr2=0x7f1bf80c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 shutdown_connections 2023-10-08T16:05:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.621+0000 7f1bfc8a5700 1 -- 172.21.15.60:0/321292858 wait complete. 2023-10-08T16:05:19.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:19.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.755+0000 7fb20f30f700 1 Processor -- start 2023-10-08T16:05:19.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20f30f700 1 -- start start 2023-10-08T16:05:19.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20f30f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb20815b2e0 0x7fb2080cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20f30f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb2080cc160 0x7fb2080cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20f30f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb208157010 con 0x7fb208156c40 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20f30f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20815b710 con 0x7fb20815b2e0 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20f30f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2080cbdf0 con 0x7fb2080cc160 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.756+0000 7fb20c8aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb20815b2e0 0x7fb2080cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb20815b2e0 0x7fb2080cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35180/0 (socket says 172.21.15.60:35180) 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 -- 172.21.15.60:0/1877807978 learned_addr learned my addr 172.21.15.60:0/1877807978 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20d8ac700 1 --2- 172.21.15.60:0/1877807978 >> v2:172.21.15.144:3300/0 conn(0x7fb2080cc160 0x7fb2080cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 -- 172.21.15.60:0/1877807978 >> v2:172.21.15.144:3300/0 conn(0x7fb2080cc160 msgr2=0x7fb2080cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 --2- 172.21.15.60:0/1877807978 >> v2:172.21.15.144:3300/0 conn(0x7fb2080cc160 0x7fb2080cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 -- 172.21.15.60:0/1877807978 >> v1:172.21.15.144:6789/0 conn(0x7fb208156c40 legacy=0x7fb2080c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 -- 172.21.15.60:0/1877807978 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2080cbbb0 con 0x7fb20815b2e0 2023-10-08T16:05:19.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb20c8aa700 1 --2- 172.21.15.60:0/1877807978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20815b2e0 0x7fb2080cb670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb20815a650 tx=0x7fb1fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b317eb29026516b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb207fff700 1 -- 172.21.15.60:0/1877807978 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00b7e0 con 0x7fb20815b2e0 2023-10-08T16:05:19.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb207fff700 1 -- 172.21.15.60:0/1877807978 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc00b940 con 0x7fb20815b2e0 2023-10-08T16:05:19.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.757+0000 7fb207fff700 1 -- 172.21.15.60:0/1877807978 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00bce0 con 0x7fb20815b2e0 2023-10-08T16:05:19.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 -- 172.21.15.60:0/1877807978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20815b2e0 msgr2=0x7fb2080cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 --2- 172.21.15.60:0/1877807978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20815b2e0 0x7fb2080cb670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb20815a650 tx=0x7fb1fc009250 comp rx=0 tx=0).stop 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 -- 172.21.15.60:0/1877807978 shutdown_connections 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 --2- 172.21.15.60:0/1877807978 >> v2:172.21.15.144:3300/0 conn(0x7fb2080cc160 0x7fb2080cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 --2- 172.21.15.60:0/1877807978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20815b2e0 0x7fb2080cb670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 -- 172.21.15.60:0/1877807978 >> 172.21.15.60:0/1877807978 conn(0x7fb2080ce570 msgr2=0x7fb2080ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 -- 172.21.15.60:0/1877807978 shutdown_connections 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.758+0000 7fb20f30f700 1 -- 172.21.15.60:0/1877807978 wait complete. 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.759+0000 7fb20f30f700 1 Processor -- start 2023-10-08T16:05:19.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.759+0000 7fb20f30f700 1 -- start start 2023-10-08T16:05:19.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20f30f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2080cc160 0x7fb208158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20f30f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 0x7fb208145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20f30f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20815b2e0 0x7fb208067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20f30f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb208160fc0 con 0x7fb208156c40 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20f30f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb208158a40 con 0x7fb20815b2e0 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20f30f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb208145eb0 con 0x7fb2080cc160 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 0x7fb208145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 0x7fb208145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35184/0 (socket says 172.21.15.60:35184) 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 -- 172.21.15.60:0/3947252925 learned_addr learned my addr 172.21.15.60:0/3947252925 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20d0ab700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2080cc160 0x7fb208158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20d8ac700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20815b2e0 0x7fb208067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 -- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2080cc160 msgr2=0x7fb208158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2080cc160 0x7fb208158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 -- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20815b2e0 msgr2=0x7fb208067dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20815b2e0 0x7fb208067dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 -- 172.21.15.60:0/3947252925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0094f0 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20d8ac700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20815b2e0 0x7fb208067dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb20c8aa700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 0x7fb208145970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009930 tx=0x7fb1fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc011e70 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.760+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc01c450 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.761+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2081603b0 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.761+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc01c810 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.761+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb208160970 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.761+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb208161170 con 0x7fb208156c40 2023-10-08T16:05:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.762+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1fc01cc00 con 0x7fb208156c40 2023-10-08T16:05:19.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.762+0000 7fb2057fa700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb1f4066f30 0x7fb1f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:19.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.762+0000 7fb20d0ab700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb1f4066f30 0x7fb1f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:19.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.762+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1fc085e80 con 0x7fb208156c40 2023-10-08T16:05:19.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.763+0000 7fb20d0ab700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb1f4066f30 0x7fb1f40693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb200007fd0 tx=0x7fb2000026f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:19.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.766+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb208161170 con 0x7fb208156c40 2023-10-08T16:05:19.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.956+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2080cbbb0 con 0x7fb208156c40 2023-10-08T16:05:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.956+0000 7fb2057fa700 1 -- 172.21.15.60:0/3947252925 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2080cbbb0 con 0x7fb208156c40 2023-10-08T16:05:19.958 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb1f4066f30 msgr2=0x7fb1f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb1f4066f30 0x7fb1f40693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb200007fd0 tx=0x7fb2000026f0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 msgr2=0x7fb208145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 0x7fb208145970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009930 tx=0x7fb1fc016000 comp rx=0 tx=0).stop 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 shutdown_connections 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb1f4066f30 0x7fb1f40693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2080cc160 0x7fb208158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20815b2e0 0x7fb208067dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 --2- 172.21.15.60:0/3947252925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb208156c40 0x7fb208145970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 >> 172.21.15.60:0/3947252925 conn(0x7fb2080ce570 msgr2=0x7fb20806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 shutdown_connections 2023-10-08T16:05:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:19.958+0000 7fb20f30f700 1 -- 172.21.15.60:0/3947252925 wait complete. 2023-10-08T16:05:19.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:20.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.089+0000 7f9f73970700 1 Processor -- start 2023-10-08T16:05:20.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.089+0000 7f9f73970700 1 -- start start 2023-10-08T16:05:20.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f73970700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9f6c15a620 0x7f9f6c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f73970700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f6c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f73970700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c15cbb0 con 0x7f9f6c157870 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f73970700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c15bdb0 con 0x7f9f6c15a620 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f73970700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c15bfa0 con 0x7f9f6c15d580 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f7170c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9f6c157870 0x7f9f6c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39638/0 (socket says 172.21.15.60:39638) 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f7170c700 1 -- 172.21.15.60:0/3964729740 learned_addr learned my addr 172.21.15.60:0/3964729740 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/3964729740 >> v2:172.21.15.144:3300/0 conn(0x7f9f6c15a620 0x7f9f6c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f71f0d700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f6c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.090+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910015030 0 0) 0x7f9f6c15cbb0 con 0x7f9f6c157870 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f54003570 con 0x7f9f6c157870 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270113439 0 0) 0x7f9f54003570 con 0x7f9f6c157870 2023-10-08T16:05:20.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 msgr2=0x7f9f6c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f6c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 >> v2:172.21.15.144:3300/0 conn(0x7f9f6c15a620 msgr2=0x7f9f6c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 --2- 172.21.15.60:0/3964729740 >> v2:172.21.15.144:3300/0 conn(0x7f9f6c15a620 0x7f9f6c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c15c280 con 0x7f9f6c157870 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f9f5c0017f0 con 0x7f9f6c157870 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 >> v1:172.21.15.60:6789/0 conn(0x7f9f6c157870 legacy=0x7f9f6c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54003a60 0x7f9f54003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f54004d50 0x7f9f540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c15bfa0 con 0x7f9f54004d50 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5400ba60 con 0x7f9f54003a60 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5400bba0 con 0x7f9f6c15d580 2023-10-08T16:05:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/3964729740 >> v2:172.21.15.144:3300/0 conn(0x7f9f6c15a620 0x7f9f6c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f54004d50 0x7f9f540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f7170c700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54003a60 0x7f9f54003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 -- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 msgr2=0x7f9f54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 -- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54003a60 msgr2=0x7f9f54003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54003a60 0x7f9f54003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 -- 172.21.15.60:0/3964729740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54003570 con 0x7f9f54004d50 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c15d580 0x7f9f54004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.091+0000 7f9f71f0d700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f54004d50 0x7f9f540051c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c15d9e0 tx=0x7f9f640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5593b2d75161a73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400e6b0 con 0x7f9f54004d50 2023-10-08T16:05:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400e810 con 0x7f9f54004d50 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f6bfff700 1 -- 172.21.15.60:0/3964729740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400ebd0 con 0x7f9f54004d50 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f73970700 1 -- 172.21.15.60:0/3964729740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f54004d50 msgr2=0x7f9f540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f73970700 1 --2- 172.21.15.60:0/3964729740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f54004d50 0x7f9f540051c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c15d9e0 tx=0x7f9f640091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f71f0d700 1 -- 172.21.15.60:0/3964729740 reap_dead start 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f73970700 1 -- 172.21.15.60:0/3964729740 shutdown_connections 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f73970700 1 -- 172.21.15.60:0/3964729740 >> 172.21.15.60:0/3964729740 conn(0x7f9f6c068ce0 msgr2=0x7f9f6c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f73970700 1 -- 172.21.15.60:0/3964729740 shutdown_connections 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.092+0000 7f9f73970700 1 -- 172.21.15.60:0/3964729740 wait complete. 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.093+0000 7f9f73970700 1 Processor -- start 2023-10-08T16:05:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.093+0000 7f9f73970700 1 -- start start 2023-10-08T16:05:20.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f73970700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f6c14bc00 0x7f9f6c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f73970700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 0x7f9f6c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f73970700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c14bfd0 0x7f9f6c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f73970700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0b2470 con 0x7f9f6c15da10 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f73970700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c15dea0 con 0x7f9f6c14bc00 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f73970700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c15e180 con 0x7f9f6c14bfd0 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f70f0b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 0x7f9f6c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f70f0b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 0x7f9f6c14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35192/0 (socket says 172.21.15.60:35192) 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.094+0000 7f9f70f0b700 1 -- 172.21.15.60:0/1211369207 learned_addr learned my addr 172.21.15.60:0/1211369207 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f7170c700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f6c14bc00 0x7f9f6c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f71f0d700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c14bfd0 0x7f9f6c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f70f0b700 1 -- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c14bfd0 msgr2=0x7f9f6c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c14bfd0 0x7f9f6c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f70f0b700 1 -- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f6c14bc00 msgr2=0x7f9f6c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f6c14bc00 0x7f9f6c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f70f0b700 1 -- 172.21.15.60:0/1211369207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c15e460 con 0x7f9f6c15da10 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f70f0b700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 0x7f9f6c14d180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009170 tx=0x7f9f60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000f8b0 con 0x7f9f6c15da10 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000fa10 con 0x7f9f6c15da10 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c15e740 con 0x7f9f6c15da10 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000fd90 con 0x7f9f6c15da10 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.095+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c0b1560 con 0x7f9f6c15da10 2023-10-08T16:05:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.096+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c04c3c0 con 0x7f9f6c15da10 2023-10-08T16:05:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.096+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f60015670 con 0x7f9f6c15da10 2023-10-08T16:05:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.097+0000 7f9f697fa700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f58066f30 0x7f9f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.097+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f60084ed0 con 0x7f9f6c15da10 2023-10-08T16:05:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.097+0000 7f9f7170c700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f58066f30 0x7f9f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.097+0000 7f9f7170c700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f58066f30 0x7f9f580693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00a100 tx=0x7f9f5c006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.101+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f60052140 con 0x7f9f6c15da10 2023-10-08T16:05:20.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.337+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f6c15c560 con 0x7f9f6c15da10 2023-10-08T16:05:20.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.338+0000 7f9f697fa700 1 -- 172.21.15.60:0/1211369207 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f9f60055760 con 0x7f9f6c15da10 2023-10-08T16:05:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:20.339 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:20.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f58066f30 msgr2=0x7f9f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f58066f30 0x7f9f580693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00a100 tx=0x7f9f5c006040 comp rx=0 tx=0).stop 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 msgr2=0x7f9f6c14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 0x7f9f6c14d180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009170 tx=0x7f9f60008040 comp rx=0 tx=0).stop 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 shutdown_connections 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f58066f30 0x7f9f580693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f6c14bfd0 0x7f9f6c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f6c14bc00 0x7f9f6c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 --2- 172.21.15.60:0/1211369207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f6c15da10 0x7f9f6c14d180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 >> 172.21.15.60:0/1211369207 conn(0x7f9f6c068ce0 msgr2=0x7f9f6c0d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 shutdown_connections 2023-10-08T16:05:20.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.340+0000 7f9f73970700 1 -- 172.21.15.60:0/1211369207 wait complete. 2023-10-08T16:05:20.343 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:20.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:20.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.471+0000 7f8eff829700 1 Processor -- start 2023-10-08T16:05:20.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.471+0000 7f8eff829700 1 -- start start 2023-10-08T16:05:20.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.471+0000 7f8eff829700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ef815a2b0 0x7f8ef80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8eff829700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef80cfe20 0x7f8ef80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8eff829700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef80c5d80 con 0x7f8ef80d1c30 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8eff829700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef8068470 con 0x7f8ef815a2b0 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8eff829700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80c6060 con 0x7f8ef80cfe20 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ef815a2b0 0x7f8ef80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ef815a2b0 0x7f8ef80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35196/0 (socket says 172.21.15.60:35196) 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 -- 172.21.15.60:0/796824593 learned_addr learned my addr 172.21.15.60:0/796824593 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efddc6700 1 --2- 172.21.15.60:0/796824593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef80cfe20 0x7f8ef80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 -- 172.21.15.60:0/796824593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef80cfe20 msgr2=0x7f8ef80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 --2- 172.21.15.60:0/796824593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef80cfe20 0x7f8ef80ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 -- 172.21.15.60:0/796824593 >> v1:172.21.15.144:6789/0 conn(0x7f8ef80d1c30 legacy=0x7f8ef80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 -- 172.21.15.60:0/796824593 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80c6340 con 0x7f8ef815a2b0 2023-10-08T16:05:20.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8efd5c5700 1 --2- 172.21.15.60:0/796824593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef815a2b0 0x7f8ef80b3da0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009f70 tx=0x7f8ee8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1c771f2f31062d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8ef7fff700 1 -- 172.21.15.60:0/796824593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800e070 con 0x7f8ef815a2b0 2023-10-08T16:05:20.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8ef7fff700 1 -- 172.21.15.60:0/796824593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee800ba20 con 0x7f8ef815a2b0 2023-10-08T16:05:20.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.472+0000 7f8ef7fff700 1 -- 172.21.15.60:0/796824593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80092e0 con 0x7f8ef815a2b0 2023-10-08T16:05:20.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 -- 172.21.15.60:0/796824593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef815a2b0 msgr2=0x7f8ef80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 --2- 172.21.15.60:0/796824593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef815a2b0 0x7f8ef80b3da0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009f70 tx=0x7f8ee8009840 comp rx=0 tx=0).stop 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 -- 172.21.15.60:0/796824593 shutdown_connections 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 --2- 172.21.15.60:0/796824593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef80cfe20 0x7f8ef80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 --2- 172.21.15.60:0/796824593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef815a2b0 0x7f8ef80b3da0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 -- 172.21.15.60:0/796824593 >> 172.21.15.60:0/796824593 conn(0x7f8ef8067e40 msgr2=0x7f8ef80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 -- 172.21.15.60:0/796824593 shutdown_connections 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.473+0000 7f8eff829700 1 -- 172.21.15.60:0/796824593 wait complete. 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.474+0000 7f8eff829700 1 Processor -- start 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.474+0000 7f8eff829700 1 -- start start 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8eff829700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 0x7f8ef81479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8eff829700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef80d1c30 0x7f8ef80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8eff829700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef815a2b0 0x7f8ef80ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8eff829700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80cae10 con 0x7f8ef80cfe20 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8eff829700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef815ea00 con 0x7f8ef80d1c30 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8eff829700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef815ec70 con 0x7f8ef815a2b0 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 0x7f8ef81479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 0x7f8ef81479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35204/0 (socket says 172.21.15.60:35204) 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 -- 172.21.15.60:0/3850565506 learned_addr learned my addr 172.21.15.60:0/3850565506 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efddc6700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef815a2b0 0x7f8ef80ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efcdc4700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef80d1c30 0x7f8ef80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 -- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef815a2b0 msgr2=0x7f8ef80ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef815a2b0 0x7f8ef80ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 -- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef80d1c30 msgr2=0x7f8ef80ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.475+0000 7f8efd5c5700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef80d1c30 0x7f8ef80ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8efd5c5700 1 -- 172.21.15.60:0/3850565506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8009ae0 con 0x7f8ef80cfe20 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8efd5c5700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 0x7f8ef81479d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800b6c0 tx=0x7f8ee8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8008ba0 con 0x7f8ef80cfe20 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8008d00 con 0x7f8ef80cfe20 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee801c660 con 0x7f8ef80cfe20 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef815ef50 con 0x7f8ef80cfe20 2023-10-08T16:05:20.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.476+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef816a600 con 0x7f8ef80cfe20 2023-10-08T16:05:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.477+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef815f470 con 0x7f8ef80cfe20 2023-10-08T16:05:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.477+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ee8003040 con 0x7f8ef80cfe20 2023-10-08T16:05:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.478+0000 7f8ef57fa700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ee4066f30 0x7f8ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.478+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ee8085da0 con 0x7f8ef80cfe20 2023-10-08T16:05:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.478+0000 7f8efcdc4700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ee4066f30 0x7f8ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.478+0000 7f8efcdc4700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ee4066f30 0x7f8ee40693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80d0a60 tx=0x7f8eec007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.482+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ee8053010 con 0x7f8ef80cfe20 2023-10-08T16:05:20.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.677+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ef804c3c0 con 0x7f8ef80cfe20 2023-10-08T16:05:20.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.678+0000 7f8ef57fa700 1 -- 172.21.15.60:0/3850565506 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f8ee8056630 con 0x7f8ef80cfe20 2023-10-08T16:05:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:20.680 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.680+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ee4066f30 msgr2=0x7f8ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.680+0000 7f8eff829700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ee4066f30 0x7f8ee40693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80d0a60 tx=0x7f8eec007ec0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.680+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 msgr2=0x7f8ef81479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.680+0000 7f8eff829700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 0x7f8ef81479d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800b6c0 tx=0x7f8ee8018000 comp rx=0 tx=0).stop 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 shutdown_connections 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ee4066f30 0x7f8ee40693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef815a2b0 0x7f8ef80ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef80cfe20 0x7f8ef81479d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 --2- 172.21.15.60:0/3850565506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef80d1c30 0x7f8ef80ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 >> 172.21.15.60:0/3850565506 conn(0x7f8ef8067e40 msgr2=0x7f8ef8157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 shutdown_connections 2023-10-08T16:05:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.681+0000 7f8eff829700 1 -- 172.21.15.60:0/3850565506 wait complete. 2023-10-08T16:05:20.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:20.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.811+0000 7f5c4cddc700 1 Processor -- start 2023-10-08T16:05:20.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.811+0000 7f5c4cddc700 1 -- start start 2023-10-08T16:05:20.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c4cddc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c48159e30 0x7f5c4815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c4cddc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5c4815e770 0x7f5c4815e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c4cddc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c480cc660 con 0x7f5c4815a200 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c4cddc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480ccf00 con 0x7f5c4815e770 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c4cddc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48068ec0 con 0x7f5c48159e30 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c45d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5c4815e770 0x7f5c4815e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c45d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5c4815e770 0x7f5c4815e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35218/0 (socket says 172.21.15.60:35218) 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.812+0000 7f5c45d9b700 1 -- 172.21.15.60:0/3669391416 learned_addr learned my addr 172.21.15.60:0/3669391416 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c4659c700 1 --2- 172.21.15.60:0/3669391416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c48159e30 0x7f5c4815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c45d9b700 1 -- 172.21.15.60:0/3669391416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c48159e30 msgr2=0x7f5c4815dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c45d9b700 1 --2- 172.21.15.60:0/3669391416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c48159e30 0x7f5c4815dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c45d9b700 1 -- 172.21.15.60:0/3669391416 >> v1:172.21.15.144:6789/0 conn(0x7f5c4815a200 legacy=0x7f5c480cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c45d9b700 1 -- 172.21.15.60:0/3669391416 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480cc8b0 con 0x7f5c4815e770 2023-10-08T16:05:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c45d9b700 1 --2- 172.21.15.60:0/3669391416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c4815e770 0x7f5c4815e100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c300099b0 tx=0x7f5c30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c471aad0f5c199 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c4559a700 1 -- 172.21.15.60:0/3669391416 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30009ea0 con 0x7f5c4815e770 2023-10-08T16:05:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c4559a700 1 -- 172.21.15.60:0/3669391416 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000b860 con 0x7f5c4815e770 2023-10-08T16:05:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.813+0000 7f5c4559a700 1 -- 172.21.15.60:0/3669391416 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000bc00 con 0x7f5c4815e770 2023-10-08T16:05:20.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3669391416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c4815e770 msgr2=0x7f5c4815e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3669391416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c4815e770 0x7f5c4815e100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c300099b0 tx=0x7f5c30009250 comp rx=0 tx=0).stop 2023-10-08T16:05:20.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3669391416 shutdown_connections 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3669391416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c48159e30 0x7f5c4815dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3669391416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c4815e770 0x7f5c4815e100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3669391416 >> 172.21.15.60:0/3669391416 conn(0x7f5c4806a310 msgr2=0x7f5c480cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3669391416 shutdown_connections 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.814+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3669391416 wait complete. 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.815+0000 7f5c4cddc700 1 Processor -- start 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.815+0000 7f5c4cddc700 1 -- start start 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.815+0000 7f5c4cddc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 0x7f5c480c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.815+0000 7f5c4cddc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c4815a200 0x7f5c480b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4cddc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c4815e770 0x7f5c480b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4cddc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480c7970 con 0x7f5c48159e30 2023-10-08T16:05:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4cddc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480c7e00 con 0x7f5c4815e770 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4cddc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480c6d60 con 0x7f5c4815a200 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 0x7f5c480c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 0x7f5c480c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35226/0 (socket says 172.21.15.60:35226) 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 -- 172.21.15.60:0/3891861795 learned_addr learned my addr 172.21.15.60:0/3891861795 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c45d9b700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c4815a200 0x7f5c480b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c46d9d700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c4815e770 0x7f5c480b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 -- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c4815a200 msgr2=0x7f5c480b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c4815a200 0x7f5c480b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 -- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c4815e770 msgr2=0x7f5c480b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c4815e770 0x7f5c480b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 -- 172.21.15.60:0/3891861795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300094f0 con 0x7f5c48159e30 2023-10-08T16:05:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4659c700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 0x7f5c480c6500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009ef0 tx=0x7f5c4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000cc20 con 0x7f5c48159e30 2023-10-08T16:05:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000f040 con 0x7f5c48159e30 2023-10-08T16:05:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c480c7040 con 0x7f5c48159e30 2023-10-08T16:05:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40014480 con 0x7f5c48159e30 2023-10-08T16:05:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.816+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c480c7600 con 0x7f5c48159e30 2023-10-08T16:05:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.817+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c480c7c50 con 0x7f5c48159e30 2023-10-08T16:05:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.818+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c400147f0 con 0x7f5c48159e30 2023-10-08T16:05:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.818+0000 7f5c3e7fc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.818+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c40084f20 con 0x7f5c48159e30 2023-10-08T16:05:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.818+0000 7f5c45d9b700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.818+0000 7f5c45d9b700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c4815ebe0 tx=0x7f5c30017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:20.822+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c40052190 con 0x7f5c48159e30 2023-10-08T16:05:21.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.058+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c4804c3c0 con 0x7f5c48159e30 2023-10-08T16:05:21.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.059+0000 7f5c3e7fc700 1 -- 172.21.15.60:0/3891861795 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f5c400557b0 con 0x7f5c48159e30 2023-10-08T16:05:21.060 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:21.061 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5c28066f30 msgr2=0x7f5c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c4815ebe0 tx=0x7f5c30017000 comp rx=0 tx=0).stop 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 msgr2=0x7f5c480c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 0x7f5c480c6500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009ef0 tx=0x7f5c4000b040 comp rx=0 tx=0).stop 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 shutdown_connections 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c4815e770 0x7f5c480b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c48159e30 0x7f5c480c6500 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 --2- 172.21.15.60:0/3891861795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c4815a200 0x7f5c480b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 >> 172.21.15.60:0/3891861795 conn(0x7f5c4806a310 msgr2=0x7f5c4806d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 shutdown_connections 2023-10-08T16:05:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.061+0000 7f5c4cddc700 1 -- 172.21.15.60:0/3891861795 wait complete. 2023-10-08T16:05:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:21.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:05:00.901778+0000', 'modified': '2023-10-08T16:05:04.504559+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2192248829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6835', 'nonce': 2192248829}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2192248829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:05:21.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:05:21.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:05:21.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.599+0000 7fb31d832700 1 Processor -- start 2023-10-08T16:05:21.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb31d832700 1 -- start start 2023-10-08T16:05:21.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb31d832700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb318159e10 0x7fb3180b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb31d832700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb31815a1e0 0x7fb3180b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb31d832700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31815db80 con 0x7fb3180b1610 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb31d832700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31815e800 con 0x7fb318159e10 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb31d832700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31815de60 con 0x7fb31815a1e0 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb316ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb318159e10 0x7fb3180b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.600+0000 7fb3177fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb3180b1610 0x7fb3180cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39640/0 (socket says 172.21.15.60:39640) 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb3177fe700 1 -- 172.21.15.60:0/2248336643 learned_addr learned my addr 172.21.15.60:0/2248336643 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2248336643 >> v2:172.21.15.144:3300/0 conn(0x7fb31815a1e0 0x7fb3180b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb316ffd700 1 -- 172.21.15.60:0/2248336643 >> v2:172.21.15.144:3300/0 conn(0x7fb31815a1e0 msgr2=0x7fb3180b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2248336643 >> v2:172.21.15.144:3300/0 conn(0x7fb31815a1e0 0x7fb3180b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb316ffd700 1 -- 172.21.15.60:0/2248336643 >> v1:172.21.15.60:6789/0 conn(0x7fb3180b1610 legacy=0x7fb3180cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb316ffd700 1 -- 172.21.15.60:0/2248336643 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31815e140 con 0x7fb318159e10 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb315ffb700 1 -- 172.21.15.60:0/2248336643 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452464013 0 0) 0x7fb31815db80 con 0x7fb3180b1610 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2248336643 >> v2:172.21.15.144:3300/0 conn(0x7fb31815a1e0 0x7fb3180b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2248336643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318159e10 0x7fb3180b2d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb318068580 tx=0x7fb308009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e3d285fc97d414 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb315ffb700 1 -- 172.21.15.60:0/2248336643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800e070 con 0x7fb318159e10 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb315ffb700 1 -- 172.21.15.60:0/2248336643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30800bc30 con 0x7fb318159e10 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.601+0000 7fb315ffb700 1 -- 172.21.15.60:0/2248336643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308012430 con 0x7fb318159e10 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 -- 172.21.15.60:0/2248336643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318159e10 msgr2=0x7fb3180b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 --2- 172.21.15.60:0/2248336643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318159e10 0x7fb3180b2d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb318068580 tx=0x7fb308009780 comp rx=0 tx=0).stop 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 -- 172.21.15.60:0/2248336643 shutdown_connections 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 --2- 172.21.15.60:0/2248336643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318159e10 0x7fb3180b2d20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 --2- 172.21.15.60:0/2248336643 >> v2:172.21.15.144:3300/0 conn(0x7fb31815a1e0 0x7fb3180b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 -- 172.21.15.60:0/2248336643 >> 172.21.15.60:0/2248336643 conn(0x7fb318067660 msgr2=0x7fb318067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 -- 172.21.15.60:0/2248336643 shutdown_connections 2023-10-08T16:05:21.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.602+0000 7fb31d832700 1 -- 172.21.15.60:0/2248336643 wait complete. 2023-10-08T16:05:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.603+0000 7fb31d832700 1 Processor -- start 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.603+0000 7fb31d832700 1 -- start start 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 0x7fb3180c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb318159e10 0x7fb3180cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb31815a1e0 0x7fb318157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180d0b00 con 0x7fb3180b1610 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180d0670 con 0x7fb31815a1e0 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180cf7c0 con 0x7fb318159e10 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 0x7fb3180c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 0x7fb3180c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35246/0 (socket says 172.21.15.60:35246) 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 -- 172.21.15.60:0/483733271 learned_addr learned my addr 172.21.15.60:0/483733271 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb3167fc700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb318159e10 0x7fb3180cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb3177fe700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb31815a1e0 0x7fb318157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 -- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb318159e10 msgr2=0x7fb3180cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb318159e10 0x7fb3180cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 -- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb31815a1e0 msgr2=0x7fb318157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb31815a1e0 0x7fb318157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 -- 172.21.15.60:0/483733271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308009a20 con 0x7fb3180b1610 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb316ffd700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 0x7fb3180c6c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb308013000 tx=0x7fb308019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb30effd700 1 -- 172.21.15.60:0/483733271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308027470 con 0x7fb3180b1610 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb30effd700 1 -- 172.21.15.60:0/483733271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308027610 con 0x7fb3180b1610 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3180cfa60 con 0x7fb3180b1610 2023-10-08T16:05:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb30effd700 1 -- 172.21.15.60:0/483733271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080279d0 con 0x7fb3180b1610 2023-10-08T16:05:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.604+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3180d0020 con 0x7fb3180b1610 2023-10-08T16:05:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.606+0000 7fb30effd700 1 -- 172.21.15.60:0/483733271 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb308024070 con 0x7fb3180b1610 2023-10-08T16:05:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.606+0000 7fb30effd700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2f8066f30 0x7fb2f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.606+0000 7fb3167fc700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2f8066f30 0x7fb2f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.606+0000 7fb30effd700 1 -- 172.21.15.60:0/483733271 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb308086b80 con 0x7fb3180b1610 2023-10-08T16:05:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.607+0000 7fb3167fc700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2f8066f30 0x7fb2f80693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3180c73d0 tx=0x7fb300008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.608+0000 7fb326b2ab80 1 Processor -- start 2023-10-08T16:05:21.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.608+0000 7fb326b2ab80 1 -- start start 2023-10-08T16:05:21.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549ce92e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cebba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ce8ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549cde9a70 con 0x56549cebbf60 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549cde7270 con 0x56549ce92a50 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56549cde3060 con 0x56549cedcd00 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ce8ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ce8ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35254/0 (socket says 172.21.15.60:35254) 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 -- 172.21.15.60:0/1850394831 learned_addr learned my addr 172.21.15.60:0/1850394831 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3167fc700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cebba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb316ffd700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549ce92e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 -- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 msgr2=0x56549cebba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cebba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 -- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 msgr2=0x56549ce92e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549ce92e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 -- 172.21.15.60:0/1850394831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549cc7d270 con 0x56549cebbf60 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3167fc700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cebba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb316ffd700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549ce92e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.609+0000 7fb3177fe700 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ce8ecf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb310001710 tx=0x7fb310009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d0d433c2f4a96e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb2f7fff700 1 -- 172.21.15.60:0/1850394831 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310005b10 con 0x56549cebbf60 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb2f7fff700 1 -- 172.21.15.60:0/1850394831 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005c90 con 0x56549cebbf60 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb2f7fff700 1 -- 172.21.15.60:0/1850394831 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310004a80 con 0x56549cebbf60 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 -- 172.21.15.60:0/1850394831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 msgr2=0x56549ce8ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ce8ecf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb310001710 tx=0x7fb310009040 comp rx=0 tx=0).stop 2023-10-08T16:05:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 -- 172.21.15.60:0/1850394831 shutdown_connections 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ce8ecf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549ce92e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/1850394831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cebba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 -- 172.21.15.60:0/1850394831 >> 172.21.15.60:0/1850394831 conn(0x56549ce94370 msgr2=0x56549ce94740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 -- 172.21.15.60:0/1850394831 shutdown_connections 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.610+0000 7fb326b2ab80 1 -- 172.21.15.60:0/1850394831 wait complete. 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.611+0000 7fb326b2ab80 1 -- start start 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.611+0000 7fb326b2ab80 1 Processor -- start 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ceecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cedcd00 0x56549ceb7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549cd8e890 con 0x56549cebbf60 2023-10-08T16:05:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549cda9ea0 con 0x56549cedcd00 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56549cc65e30 con 0x56549ce92a50 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb326b2ab80 10 client.0 _ll_register_callbacks cb 0x56549ce56110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35266/0 (socket says 172.21.15.60:35266) 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 -- 172.21.15.60:0/2478454932 learned_addr learned my addr 172.21.15.60:0/2478454932 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ceecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3177fe700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cedcd00 0x56549ceb7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 -- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 msgr2=0x56549ceecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ceecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 -- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cedcd00 msgr2=0x56549ceb7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cedcd00 0x56549ceb7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.612+0000 7fb3167fc700 1 -- 172.21.15.60:0/2478454932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31000f040 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced32d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb300006fd0 tx=0x7fb300017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f34460524f32ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb2f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2478454932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300013630 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2478454932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb300013790 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56549ce87b70 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2478454932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb300013b60 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 10 client.4689 fetch_fsmap learned FSMap version 8 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56549cc1ffe0 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2478454932 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56549ce87b70 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2478454932 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb300013cc0 con 0x56549cebbf60 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T16:05:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 10 client.4689 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 20 client.4689 populate_metadata read hostname 'smithi060' 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549ced9520 0x56549ced98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 4 client.4689 mds_command: new command op to 4269 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 --> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56549ce64aa0 con 0x56549ced9520 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.613+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549ced9520 0x56549ced98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb2f57fa700 10 client.4689 ms_handle_connect on v2:172.21.15.60:6835/2192248829 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549ced9520 0x56549ced98f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85c08ac130ab3387 server_cookie=18aa3c873e2f309f in_seq=0 out_seq=0 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2478454932 <== mds.0 v2:172.21.15.60:6835/2192248829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56549ce64aa0 con 0x56549ced9520 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb2f57fa700 10 client.4689 handle_command_reply: tid=0 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 client.4689 shutdown 2023-10-08T16:05:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 msgr2=0x56549ced32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced32d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb300006fd0 tx=0x7fb300017000 comp rx=0 tx=0).stop 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 shutdown_connections 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549ced9520 0x56549ced98f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ceecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb2f57fa700 0 client.4689 ms_handle_reset on v2:172.21.15.60:6835/2192248829 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cedcd00 0x56549ceb7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.614+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2478454932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced32d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.615+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 >> 172.21.15.60:0/2478454932 conn(0x56549ce94370 msgr2=0x56549ce8f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.615+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 shutdown_connections 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.615+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2478454932 wait complete. 2023-10-08T16:05:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.615+0000 7fb326b2ab80 20 client.4689 trim_cache size 0 max 16384 2023-10-08T16:05:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.631+0000 7fb326b2ab80 1 Processor -- start 2023-10-08T16:05:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.631+0000 7fb326b2ab80 1 -- start start 2023-10-08T16:05:21.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ce8f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cebbf60 0x56549ce947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 0x56549ceb7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549ce8d5a0 con 0x56549cedcd00 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549ce94cf0 con 0x56549cebbf60 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56549ce90670 con 0x56549ce92a50 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb3177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 0x56549ceb7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb3177fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 0x56549ceb7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35280/0 (socket says 172.21.15.60:35280) 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.632+0000 7fb3177fe700 1 -- 172.21.15.60:0/4165487910 learned_addr learned my addr 172.21.15.60:0/4165487910 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3177fe700 1 -- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 msgr2=0x56549ce8f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb316ffd700 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ce8f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3167fc700 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cebbf60 0x56549ce947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3177fe700 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ce8f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3177fe700 1 -- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cebbf60 msgr2=0x56549ce947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3177fe700 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cebbf60 0x56549ce947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3177fe700 1 -- 172.21.15.60:0/4165487910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549cdb1780 con 0x56549cedcd00 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb3177fe700 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 0x56549ceb7d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb310005000 tx=0x7fb310017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900144be468db9d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb30cff9700 1 -- 172.21.15.60:0/4165487910 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310000c30 con 0x56549cedcd00 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb30cff9700 1 -- 172.21.15.60:0/4165487910 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310007a20 con 0x56549cedcd00 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb30cff9700 1 -- 172.21.15.60:0/4165487910 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310004a80 con 0x56549cedcd00 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 -- 172.21.15.60:0/4165487910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 msgr2=0x56549ceb7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 0x56549ceb7d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb310005000 tx=0x7fb310017000 comp rx=0 tx=0).stop 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 -- 172.21.15.60:0/4165487910 shutdown_connections 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549ce92a50 0x56549ce8f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cedcd00 0x56549ceb7d50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/4165487910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549cebbf60 0x56549ce947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.633+0000 7fb326b2ab80 1 -- 172.21.15.60:0/4165487910 >> 172.21.15.60:0/4165487910 conn(0x56549ce94370 msgr2=0x56549cec2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.634+0000 7fb326b2ab80 1 -- 172.21.15.60:0/4165487910 shutdown_connections 2023-10-08T16:05:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.634+0000 7fb326b2ab80 1 -- 172.21.15.60:0/4165487910 wait complete. 2023-10-08T16:05:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.634+0000 7fb326b2ab80 1 -- start start 2023-10-08T16:05:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.634+0000 7fb326b2ab80 1 Processor -- start 2023-10-08T16:05:21.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549cef0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cecfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549cef3460 con 0x56549cebbf60 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549ce93650 con 0x56549ce92a50 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56549cef0e60 con 0x56549cedcd00 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb326b2ab80 10 client.0 _ll_register_callbacks cb 0x56549ce56110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35286/0 (socket says 172.21.15.60:35286) 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 -- 172.21.15.60:0/2245899218 learned_addr learned my addr 172.21.15.60:0/2245899218 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549cef0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3177fe700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cecfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 -- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 msgr2=0x56549cecfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cecfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 -- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 msgr2=0x56549cef0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549cef0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.635+0000 7fb3167fc700 1 -- 172.21.15.60:0/2245899218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56549cc7d270 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb3167fc700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced9cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb300008010 tx=0x7fb300022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16080e2d7d95b9e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2245899218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000287e0 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2245899218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb300013b60 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb310005c90 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2245899218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb300028940 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 10 client.4695 fetch_fsmap learned FSMap version 8 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56549cd98470 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2245899218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005c90 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2245899218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb300028aa0 con 0x56549cebbf60 2023-10-08T16:05:21.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 10 client.4695 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 20 client.4695 populate_metadata read hostname 'smithi060' 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549cf3e490 0x56549cf3e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 4 client.4695 mds_command: new command op to 4269 tid=0[{"prefix": "status"}] 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 --> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56549cd85e00 con 0x56549cf3e490 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549cf3e490 0x56549cf3e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb2f57fa700 10 client.4695 ms_handle_connect on v2:172.21.15.60:6835/2192248829 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.636+0000 7fb316ffd700 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549cf3e490 0x56549cf3e860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f97c841ad7de19 server_cookie=e0d3c1585929a430 in_seq=0 out_seq=0 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb2f57fa700 1 -- 172.21.15.60:0/2245899218 <== mds.0 v2:172.21.15.60:6835/2192248829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56549cd85e00 con 0x56549cf3e490 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb2f57fa700 10 client.4695 handle_command_reply: tid=0 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 client.4695 shutdown 2023-10-08T16:05:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 msgr2=0x56549ced9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced9cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb300008010 tx=0x7fb300022000 comp rx=0 tx=0).stop 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 shutdown_connections 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:6835/2192248829,v1:172.21.15.60:6837/2192248829] conn(0x56549cf3e490 0x56549cf3e860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56549cedcd00 0x56549cecfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb2f57fa700 0 client.4695 ms_handle_reset on v2:172.21.15.60:6835/2192248829 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56549ce92a50 0x56549cef0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 --2- 172.21.15.60:0/2245899218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56549cebbf60 0x56549ced9cd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 >> 172.21.15.60:0/2245899218 conn(0x56549ce94370 msgr2=0x56549cec2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 shutdown_connections 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 1 -- 172.21.15.60:0/2245899218 wait complete. 2023-10-08T16:05:21.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb326b2ab80 20 client.4695 trim_cache size 0 max 16384 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4269, 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 20.141252960999999, 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 8, 2023-10-08T16:05:21.646 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 20, 2023-10-08T16:05:21.647 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T16:05:21.647 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 27.180464964999999 2023-10-08T16:05:21.647 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:05:21.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2f8066f30 msgr2=0x7fb2f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb31d832700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2f8066f30 0x7fb2f80693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3180c73d0 tx=0x7fb300008040 comp rx=0 tx=0).stop 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 msgr2=0x7fb3180c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.637+0000 7fb31d832700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 0x7fb3180c6c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb308013000 tx=0x7fb308019000 comp rx=0 tx=0).stop 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 shutdown_connections 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2f8066f30 0x7fb2f80693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb31815a1e0 0x7fb318157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180b1610 0x7fb3180c6c60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 --2- 172.21.15.60:0/483733271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb318159e10 0x7fb3180cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 >> 172.21.15.60:0/483733271 conn(0x7fb318067660 msgr2=0x7fb3180cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 shutdown_connections 2023-10-08T16:05:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:21.638+0000 7fb31d832700 1 -- 172.21.15.60:0/483733271 wait complete. 2023-10-08T16:05:21.651 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T16:05:21.671 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T16:05:21.671 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T16:05:21.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.671 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:05:21.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-08T16:05:21.754 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-08T16:05:21.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:21.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.756 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:05:21.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-08T16:05:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-08T16:05:21.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:21.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.879 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:05:21.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-08T16:05:21.970 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-10-08T16:05:21.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:21.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:21.972 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:05:22.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-08T16:05:22.098 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-10-08T16:05:22.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:05:22.099 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-08T16:05:22.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:05:22.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.218+0000 7f7a4563e700 1 Processor -- start 2023-10-08T16:05:22.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.218+0000 7f7a4563e700 1 -- start start 2023-10-08T16:05:22.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.218+0000 7f7a4563e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a40159e10 0x7f7a400b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.218+0000 7f7a4563e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a400b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a4563e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4015db80 con 0x7f7a400b1610 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a4563e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4015e800 con 0x7f7a40159e10 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a4563e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4015de60 con 0x7f7a4015a1e0 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a40159e10 0x7f7a400b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7a400b1610 0x7f7a400cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39650/0 (socket says 172.21.15.60:39650) 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3f7fe700 1 -- 172.21.15.60:0/2405655234 learned_addr learned my addr 172.21.15.60:0/2405655234 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3e7fc700 1 --2- 172.21.15.60:0/2405655234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a400b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3dffb700 1 -- 172.21.15.60:0/2405655234 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157550842 0 0) 0x7f7a4015db80 con 0x7f7a400b1610 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3dffb700 1 -- 172.21.15.60:0/2405655234 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c003570 con 0x7f7a400b1610 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3effd700 1 -- 172.21.15.60:0/2405655234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 msgr2=0x7f7a400b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3effd700 1 --2- 172.21.15.60:0/2405655234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a400b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3effd700 1 -- 172.21.15.60:0/2405655234 >> v1:172.21.15.60:6789/0 conn(0x7f7a400b1610 legacy=0x7f7a400cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3effd700 1 -- 172.21.15.60:0/2405655234 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4015e140 con 0x7f7a40159e10 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3effd700 1 --2- 172.21.15.60:0/2405655234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a40159e10 0x7f7a400b2d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a300098e0 tx=0x7f7a300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4b2b27b8d158e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3dffb700 1 -- 172.21.15.60:0/2405655234 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000b640 con 0x7f7a40159e10 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3dffb700 1 -- 172.21.15.60:0/2405655234 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3000b7a0 con 0x7f7a40159e10 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.219+0000 7f7a3dffb700 1 -- 172.21.15.60:0/2405655234 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000bb40 con 0x7f7a40159e10 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 -- 172.21.15.60:0/2405655234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a40159e10 msgr2=0x7f7a400b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 --2- 172.21.15.60:0/2405655234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a40159e10 0x7f7a400b2d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a300098e0 tx=0x7f7a300091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 -- 172.21.15.60:0/2405655234 shutdown_connections 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 --2- 172.21.15.60:0/2405655234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a40159e10 0x7f7a400b2d20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 --2- 172.21.15.60:0/2405655234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a400b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 -- 172.21.15.60:0/2405655234 >> 172.21.15.60:0/2405655234 conn(0x7f7a40067660 msgr2=0x7f7a40067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:22.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 -- 172.21.15.60:0/2405655234 shutdown_connections 2023-10-08T16:05:22.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.220+0000 7f7a4563e700 1 -- 172.21.15.60:0/2405655234 wait complete. 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.221+0000 7f7a4563e700 1 Processor -- start 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.221+0000 7f7a4563e700 1 -- start start 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a4563e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 0x7f7a400c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a4563e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a40159e10 0x7f7a4016df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a4563e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a4016cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a4563e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400ca870 con 0x7f7a400b1610 2023-10-08T16:05:22.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a4563e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4016e4c0 con 0x7f7a40159e10 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a4563e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c9c60 con 0x7f7a4015a1e0 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 0x7f7a400c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 0x7f7a400c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35294/0 (socket says 172.21.15.60:35294) 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 -- 172.21.15.60:0/1332910536 learned_addr learned my addr 172.21.15.60:0/1332910536 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3f7fe700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a4016cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3e7fc700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a40159e10 0x7f7a4016df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 -- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 msgr2=0x7f7a4016cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a4016cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 -- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a40159e10 msgr2=0x7f7a4016df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a40159e10 0x7f7a4016df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3effd700 1 -- 172.21.15.60:0/1332910536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30009420 con 0x7f7a400b1610 2023-10-08T16:05:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.222+0000 7f7a3e7fc700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a40159e10 0x7f7a4016df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.223+0000 7f7a3effd700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 0x7f7a400c9680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a400b6690 tx=0x7f7a30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.223+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3001bda0 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.223+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30011420 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.223+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a400c9f40 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.223+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a300117e0 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.223+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a400ca500 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.224+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4004c3c0 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.224+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a30011b90 con 0x7f7a400b1610 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.225+0000 7f7a36ffd700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a20066f30 0x7f7a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.225+0000 7f7a3e7fc700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a20066f30 0x7f7a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.225+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a30085ba0 con 0x7f7a400b1610 2023-10-08T16:05:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.225+0000 7f7a3e7fc700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a20066f30 0x7f7a200693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7a400b10b0 tx=0x7f7a28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:22.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.229+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a30052e10 con 0x7f7a400b1610 2023-10-08T16:05:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.466+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7a400cac00 con 0x7f7a400b1610 2023-10-08T16:05:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.467+0000 7f7a36ffd700 1 -- 172.21.15.60:0/1332910536 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7a30056430 con 0x7f7a400b1610 2023-10-08T16:05:22.468 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:05:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.468+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a20066f30 msgr2=0x7f7a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.468+0000 7f7a4563e700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a20066f30 0x7f7a200693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7a400b10b0 tx=0x7f7a28008040 comp rx=0 tx=0).stop 2023-10-08T16:05:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.468+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 msgr2=0x7f7a400c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.468+0000 7f7a4563e700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 0x7f7a400c9680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a400b6690 tx=0x7f7a30017000 comp rx=0 tx=0).stop 2023-10-08T16:05:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.468+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 shutdown_connections 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.468+0000 7f7a4563e700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a20066f30 0x7f7a200693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.469+0000 7f7a4563e700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7a4015a1e0 0x7f7a4016cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.469+0000 7f7a4563e700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a400b1610 0x7f7a400c9680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.469+0000 7f7a4563e700 1 --2- 172.21.15.60:0/1332910536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a40159e10 0x7f7a4016df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.469+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 >> 172.21.15.60:0/1332910536 conn(0x7f7a40067660 msgr2=0x7f7a40159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.469+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 shutdown_connections 2023-10-08T16:05:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:22.469+0000 7f7a4563e700 1 -- 172.21.15.60:0/1332910536 wait complete. 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:05:22.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:05:22.483 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:05:22.483 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:05:22.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.483 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:22.498 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42419sec preferred_lft 42419sec 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:05:22.499 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:22.500 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:22.500 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:22.500 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:05:22.500 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T16:05:22.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.500 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:22.500 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:22.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-10-08T16:05:22.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-10-08T16:05:22.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-10-08T16:05:22.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T16:05:22.501 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:22.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.657 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:05:22.701 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:05:22.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.703 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:05:22.729 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:05:22.729 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:05:22.729 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:05:22.729 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:05:22.729 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:05:22.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.731 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:22.731 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:22.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:05:22.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:05:22.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:05:22.732 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:22.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.983 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:05:22.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:22.998 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-08T16:05:23.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:23.053 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:23.053 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:23.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:05:23.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T16:05:23.054 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:23.145 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T16:05:23.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:23.145 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:23.145 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:23.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T16:05:23.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T16:05:23.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T16:05:23.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T16:05:23.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T16:05:23.146 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:23.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:23.407 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:23.407 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:23.407 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:05:23.407 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T16:05:23.407 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:23.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:23.501 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:05:23.516 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:05:23.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:23.516 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:05:23.571 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:05:23.571 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:05:23.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:23.669 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:23.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:23.764 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:23.764 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:23.764 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:23.764 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:23.764 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:23.764 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:23.765 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:23.765 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:23.786 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:23.786 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:23.786 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:23.786 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:23.786 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:23.787 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:23.787 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:23.787 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:23.787 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:05:23.787 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:05:23.787 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:05:23.789 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:05:23.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:23.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:05:23.815 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-08T16:05:23.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:05:23.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.973+0000 7f936530e700 1 Processor -- start 2023-10-08T16:05:23.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.973+0000 7f936530e700 1 -- start start 2023-10-08T16:05:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.974+0000 7f936530e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9360158e50 0x7f93600cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.974+0000 7f936530e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936006c010 con 0x7f9360152010 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.974+0000 7f936530e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936006bd10 con 0x7f93601523e0 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.974+0000 7f936530e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936015c060 con 0x7f9360158e50 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.974+0000 7f935f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9360158e50 0x7f93600cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.974+0000 7f935effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9360152010 0x7f936015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50616/0 (socket says 172.21.15.60:50616) 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935effd700 1 -- 172.21.15.60:0/701610023 learned_addr learned my addr 172.21.15.60:0/701610023 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935f7fe700 1 -- 172.21.15.60:0/701610023 >> v1:172.21.15.144:6789/0 conn(0x7f93601523e0 legacy=0x7f936006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935f7fe700 1 -- 172.21.15.60:0/701610023 >> v1:172.21.15.60:6789/0 conn(0x7f9360152010 legacy=0x7f936015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935f7fe700 1 -- 172.21.15.60:0/701610023 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936015c340 con 0x7f9360158e50 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935dffb700 1 -- 172.21.15.60:0/701610023 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028119214 0 0) 0x7f936006c010 con 0x7f9360152010 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935f7fe700 1 --2- 172.21.15.60:0/701610023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360158e50 0x7f93600cb750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9350009e60 tx=0x7f9350009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b4fdf8a4495450 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935dffb700 1 -- 172.21.15.60:0/701610023 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935000e070 con 0x7f9360158e50 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935dffb700 1 -- 172.21.15.60:0/701610023 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000bbf0 con 0x7f9360158e50 2023-10-08T16:05:23.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.975+0000 7f935dffb700 1 -- 172.21.15.60:0/701610023 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350012430 con 0x7f9360158e50 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 -- 172.21.15.60:0/701610023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360158e50 msgr2=0x7f93600cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 --2- 172.21.15.60:0/701610023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360158e50 0x7f93600cb750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9350009e60 tx=0x7f9350009780 comp rx=0 tx=0).stop 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 -- 172.21.15.60:0/701610023 shutdown_connections 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 --2- 172.21.15.60:0/701610023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360158e50 0x7f93600cb750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 -- 172.21.15.60:0/701610023 >> 172.21.15.60:0/701610023 conn(0x7f9360069870 msgr2=0x7f9360069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 -- 172.21.15.60:0/701610023 shutdown_connections 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.976+0000 7f936530e700 1 -- 172.21.15.60:0/701610023 wait complete. 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.977+0000 7f936530e700 1 Processor -- start 2023-10-08T16:05:23.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.977+0000 7f936530e700 1 -- start start 2023-10-08T16:05:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f936530e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 0x7f93600b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f936530e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93601523e0 0x7f936014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:23.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f936530e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9360158e50 0x7f9360167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f936530e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600cf270 con 0x7f9360152010 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f936530e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600b48d0 con 0x7f93601523e0 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f936530e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936014e640 con 0x7f9360158e50 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 0x7f93600b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 0x7f93600b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44892/0 (socket says 172.21.15.60:44892) 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 -- 172.21.15.60:0/1931647311 learned_addr learned my addr 172.21.15.60:0/1931647311 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935e7fc700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93601523e0 0x7f936014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935f7fe700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9360158e50 0x7f9360167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 -- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9360158e50 msgr2=0x7f9360167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9360158e50 0x7f9360167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 -- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93601523e0 msgr2=0x7f936014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:23.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93601523e0 0x7f936014ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935effd700 1 -- 172.21.15.60:0/1931647311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009a20 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.978+0000 7f935e7fc700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93601523e0 0x7f936014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.979+0000 7f935effd700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 0x7f93600b4390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f935800c7e0 tx=0x7f9358007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.979+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358005b30 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.979+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9358005c90 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.979+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93600ced20 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.979+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358007300 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.979+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936014c0a0 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.980+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600cf0a0 con 0x7f9360152010 2023-10-08T16:05:23.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.980+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f935801b400 con 0x7f9360152010 2023-10-08T16:05:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.981+0000 7f9356ffd700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.981+0000 7f935e7fc700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.981+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9358084040 con 0x7f9360152010 2023-10-08T16:05:23.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.981+0000 7f935e7fc700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9340066f30 0x7f93400693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9348007fd0 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:23.985+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9358051330 con 0x7f9360152010 2023-10-08T16:05:24.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.223+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f936014e490 con 0x7f9360152010 2023-10-08T16:05:24.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.223+0000 7f9356ffd700 1 -- 172.21.15.60:0/1931647311 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9358054950 con 0x7f9360152010 2023-10-08T16:05:24.225 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9340066f30 msgr2=0x7f93400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9340066f30 0x7f93400693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9348007fd0 tx=0x7f9348009040 comp rx=0 tx=0).stop 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 msgr2=0x7f93600b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 0x7f93600b4390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f935800c7e0 tx=0x7f9358007df0 comp rx=0 tx=0).stop 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 shutdown_connections 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9360158e50 0x7f9360167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9360152010 0x7f93600b4390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 --2- 172.21.15.60:0/1931647311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93601523e0 0x7f936014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:24.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 >> 172.21.15.60:0/1931647311 conn(0x7f9360069870 msgr2=0x7f936014c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:24.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 shutdown_connections 2023-10-08T16:05:24.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:24.225+0000 7f936530e700 1 -- 172.21.15.60:0/1931647311 wait complete. 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:05:24.239 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T16:05:24.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.239 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:05:24.254 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.255 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:05:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42417sec preferred_lft 42417sec 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:05:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.259 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:05:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:05:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link tentative 2023-10-08T16:05:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.259 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:05:24.319 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:05:24.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.320 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:05:24.376 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:05:24.376 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:05:24.376 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:05:24.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:05:24.376 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:05:24.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.377 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:24.377 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:24.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:05:24.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:05:24.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:05:24.377 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:24.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.478 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:05:24.493 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:05:24.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.493 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-08T16:05:24.548 INFO:teuthology.orchestra.run.smithi060.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T16:05:24.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.548 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:24.548 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:24.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:05:24.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T16:05:24.549 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:24.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:4e:7d:2e:9e:25 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:05:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:05:24.672 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.672 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::804e:7dff:fe2e:9e25/64 scope link tentative 2023-10-08T16:05:24.672 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T16:05:24.758 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:24.758 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:24.758 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:24.758 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.758 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:24.758 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.759 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:05:24.759 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:4e:7d:2e:9e:25 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:05:24.759 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:05:24.759 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.759 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::804e:7dff:fe2e:9e25/64 scope link tentative 2023-10-08T16:05:24.759 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:24.767 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T16:05:24.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:24.767 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:24.767 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:24.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T16:05:24.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T16:05:24.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T16:05:24.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T16:05:24.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T16:05:24.768 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:25.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:25.002 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:05:25.002 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:05:25.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.1 up 2023-10-08T16:05:25.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T16:05:25.002 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:05:25.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:25.083 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T16:05:25.097 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T16:05:25.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:25.098 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T16:05:25.152 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-08T16:05:25.152 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:05:25.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:25.233 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:25.233 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 2@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:25.252 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:25.273 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:25.273 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:25.273 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:25.273 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 2@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:25.273 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:25.273 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:25.274 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:25.274 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:25.274 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:05:25.274 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:05:25.274 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:05:25.275 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:05:25.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:25.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T16:05:25.340 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-08T16:05:25.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:05:25.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.498+0000 7fb3f743d700 1 Processor -- start 2023-10-08T16:05:25.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.498+0000 7fb3f743d700 1 -- start start 2023-10-08T16:05:25.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f743d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3f015c180 0x7fb3f00b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:25.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f743d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00caa20 con 0x7fb3f00b0f60 2023-10-08T16:05:25.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f743d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f006cfb0 con 0x7fb3f00b1330 2023-10-08T16:05:25.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f743d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f0158400 con 0x7fb3f015c180 2023-10-08T16:05:25.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f59da700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3f015c180 0x7fb3f00b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:25.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f51d9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb3f00b0f60 0x7fb3f00ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50630/0 (socket says 172.21.15.60:50630) 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f59da700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3f015c180 0x7fb3f00b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:50724/0 (socket says 172.21.15.60:50724) 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f51d9700 1 -- 172.21.15.60:0/1019601877 learned_addr learned my addr 172.21.15.60:0/1019601877 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f49d8700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb3f00b1330 0x7fb3f015ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37730/0 (socket says 172.21.15.60:37730) 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3e7fff700 1 -- 172.21.15.60:0/1019601877 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030230713 0 0) 0x7fb3f00caa20 con 0x7fb3f00b0f60 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3e7fff700 1 -- 172.21.15.60:0/1019601877 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc003570 con 0x7fb3f00b0f60 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f59da700 1 -- 172.21.15.60:0/1019601877 >> v1:172.21.15.144:6789/0 conn(0x7fb3f00b1330 legacy=0x7fb3f015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3e7fff700 1 -- 172.21.15.60:0/1019601877 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735117948 0 0) 0x7fb3f006cfb0 con 0x7fb3f00b1330 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f59da700 1 -- 172.21.15.60:0/1019601877 >> v1:172.21.15.60:6789/0 conn(0x7fb3f00b0f60 legacy=0x7fb3f00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.499+0000 7fb3f59da700 1 -- 172.21.15.60:0/1019601877 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00cafc0 con 0x7fb3f015c180 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.500+0000 7fb3f59da700 1 --2- 172.21.15.60:0/1019601877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f015c180 0x7fb3f00b1950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009e60 tx=0x7fb3e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6f085a735f6b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.500+0000 7fb3e7fff700 1 -- 172.21.15.60:0/1019601877 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800e070 con 0x7fb3f015c180 2023-10-08T16:05:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.500+0000 7fb3e7fff700 1 -- 172.21.15.60:0/1019601877 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800bb60 con 0x7fb3f015c180 2023-10-08T16:05:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.500+0000 7fb3e7fff700 1 -- 172.21.15.60:0/1019601877 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8012430 con 0x7fb3f015c180 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.500+0000 7fb3f743d700 1 -- 172.21.15.60:0/1019601877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f015c180 msgr2=0x7fb3f00b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.500+0000 7fb3f743d700 1 --2- 172.21.15.60:0/1019601877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f015c180 0x7fb3f00b1950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009e60 tx=0x7fb3e8009780 comp rx=0 tx=0).stop 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.501+0000 7fb3f743d700 1 -- 172.21.15.60:0/1019601877 shutdown_connections 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.501+0000 7fb3f743d700 1 --2- 172.21.15.60:0/1019601877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f015c180 0x7fb3f00b1950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.501+0000 7fb3f743d700 1 -- 172.21.15.60:0/1019601877 >> 172.21.15.60:0/1019601877 conn(0x7fb3f0069870 msgr2=0x7fb3f0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.501+0000 7fb3f743d700 1 -- 172.21.15.60:0/1019601877 shutdown_connections 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.501+0000 7fb3f743d700 1 -- 172.21.15.60:0/1019601877 wait complete. 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.502+0000 7fb3f743d700 1 Processor -- start 2023-10-08T16:05:25.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.502+0000 7fb3f743d700 1 -- start start 2023-10-08T16:05:25.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f743d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f00b0f60 0x7fb3f014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:25.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f743d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb3f00b1330 0x7fb3f0158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:25.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f743d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 0x7fb3f00b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:25.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f743d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f01697d0 con 0x7fb3f015c180 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f743d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0159190 con 0x7fb3f00b0f60 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f743d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f014c770 con 0x7fb3f00b1330 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 0x7fb3f00b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f51d9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f00b0f60 0x7fb3f014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 0x7fb3f00b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44904/0 (socket says 172.21.15.60:44904) 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 -- 172.21.15.60:0/531746396 learned_addr learned my addr 172.21.15.60:0/531746396 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f49d8700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb3f00b1330 0x7fb3f0158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 -- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb3f00b1330 msgr2=0x7fb3f0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb3f00b1330 0x7fb3f0158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 -- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f00b0f60 msgr2=0x7fb3f014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f00b0f60 0x7fb3f014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 -- 172.21.15.60:0/531746396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009a20 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.503+0000 7fb3f59da700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 0x7fb3f00b4090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8013000 tx=0x7fb3e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.504+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8012e90 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.504+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8026480 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.504+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f0158eb0 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.504+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8026840 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.504+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f0169460 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.505+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f0169980 con 0x7fb3f015c180 2023-10-08T16:05:25.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.505+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e801c400 con 0x7fb3f015c180 2023-10-08T16:05:25.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.506+0000 7fb3e57fa700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:25.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.506+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3e80864b0 con 0x7fb3f015c180 2023-10-08T16:05:25.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.506+0000 7fb3f51d9700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:25.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.506+0000 7fb3f51d9700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb3d4066f30 0x7fb3d40693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0158210 tx=0x7fb3ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:25.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.510+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3f0169980 con 0x7fb3f015c180 2023-10-08T16:05:25.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.747+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3f0169980 con 0x7fb3f015c180 2023-10-08T16:05:25.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.747+0000 7fb3e57fa700 1 -- 172.21.15.60:0/531746396 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb3f0169980 con 0x7fb3f015c180 2023-10-08T16:05:25.749 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:05:25.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb3d4066f30 msgr2=0x7fb3d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb3d4066f30 0x7fb3d40693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0158210 tx=0x7fb3ec009040 comp rx=0 tx=0).stop 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 msgr2=0x7fb3f00b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 0x7fb3f00b4090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8013000 tx=0x7fb3e8019000 comp rx=0 tx=0).stop 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 shutdown_connections 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3f015c180 0x7fb3f00b4090 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3f00b0f60 0x7fb3f014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 --2- 172.21.15.60:0/531746396 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb3f00b1330 0x7fb3f0158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 >> 172.21.15.60:0/531746396 conn(0x7fb3f0069870 msgr2=0x7fb3f01559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 shutdown_connections 2023-10-08T16:05:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:25.749+0000 7fb3f743d700 1 -- 172.21.15.60:0/531746396 wait complete. 2023-10-08T16:05:25.762 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:05:25.762 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:05:25.762 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:05:25.762 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:05:25.763 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:05:25.763 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:05:25.763 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:05:25.763 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:05:25.763 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:05:25.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:25.763 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:25.782 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:05:25.783 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:25.784 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T16:05:25.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T16:05:25.784 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:25.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:25.961 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:05:26.004 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:05:26.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.005 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:05:26.074 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:05:26.074 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:05:26.074 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:05:26.074 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:05:26.074 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:05:26.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.075 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:26.075 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:26.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:05:26.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:05:26.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:05:26.075 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:26.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.321 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:05:26.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.336 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-10-08T16:05:26.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.391 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:26.391 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:26.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:05:26.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T16:05:26.391 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:26.480 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T16:05:26.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T16:05:26.481 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:26.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:26.674 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:26.674 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:26.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:05:26.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T16:05:26.674 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:26.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:26.765 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:05:26.780 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:05:26.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:26.780 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:05:26.834 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:05:26.834 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:05:26.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:26.928 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:26.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:27.017 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:27.039 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:27.039 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:27.039 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:27.039 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:27.039 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:27.039 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:27.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:27.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:27.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:05:27.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:05:27.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:05:27.042 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:05:27.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:05:27.066 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-08T16:05:27.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:05:27.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.197+0000 7fa5d5bae700 1 Processor -- start 2023-10-08T16:05:27.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.197+0000 7fa5d5bae700 1 -- start start 2023-10-08T16:05:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5d5bae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d006c630 0x7fa5d0067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5d5bae700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5d0067ba0 0x7fa5d0159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5d5bae700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d0068000 con 0x7fa5d00b0890 2023-10-08T16:05:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5d5bae700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00cb370 con 0x7fa5d0067ba0 2023-10-08T16:05:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5d5bae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00b0c60 con 0x7fa5d006c630 2023-10-08T16:05:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5cffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5d0067ba0 0x7fa5d0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5cffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5d0067ba0 0x7fa5d0159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44918/0 (socket says 172.21.15.60:44918) 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.198+0000 7fa5cffff700 1 -- 172.21.15.60:0/3819220363 learned_addr learned my addr 172.21.15.60:0/3819220363 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5ceffd700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d006c630 0x7fa5d0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5cffff700 1 -- 172.21.15.60:0/3819220363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d006c630 msgr2=0x7fa5d0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5cffff700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d006c630 0x7fa5d0067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5cffff700 1 -- 172.21.15.60:0/3819220363 >> v1:172.21.15.144:6789/0 conn(0x7fa5d00b0890 legacy=0x7fa5d00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5cffff700 1 -- 172.21.15.60:0/3819220363 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d006a1e0 con 0x7fa5d0067ba0 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5ceffd700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d006c630 0x7fa5d0067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5cffff700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d0067ba0 0x7fa5d0159790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009f20 tx=0x7fa5c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea4314ce0b20eef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5ce7fc700 1 -- 172.21.15.60:0/3819220363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800e070 con 0x7fa5d0067ba0 2023-10-08T16:05:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5ce7fc700 1 -- 172.21.15.60:0/3819220363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c800ba40 con 0x7fa5d0067ba0 2023-10-08T16:05:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.199+0000 7fa5ce7fc700 1 -- 172.21.15.60:0/3819220363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80092e0 con 0x7fa5d0067ba0 2023-10-08T16:05:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3819220363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d0067ba0 msgr2=0x7fa5d0159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d0067ba0 0x7fa5d0159790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009f20 tx=0x7fa5c8009840 comp rx=0 tx=0).stop 2023-10-08T16:05:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3819220363 shutdown_connections 2023-10-08T16:05:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d0067ba0 0x7fa5d0159790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3819220363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d006c630 0x7fa5d0067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3819220363 >> 172.21.15.60:0/3819220363 conn(0x7fa5d006fe50 msgr2=0x7fa5d0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3819220363 shutdown_connections 2023-10-08T16:05:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.200+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3819220363 wait complete. 2023-10-08T16:05:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.201+0000 7fa5d5bae700 1 Processor -- start 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.201+0000 7fa5d5bae700 1 -- start start 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d0067ba0 0x7fa5d00c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 0x7fa5d00c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5d00b0890 0x7fa5d00c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00c35a0 con 0x7fa5d006c630 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00c2bd0 con 0x7fa5d00b0890 2023-10-08T16:05:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00c4d10 con 0x7fa5d0067ba0 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 0x7fa5d00c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 0x7fa5d00c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44924/0 (socket says 172.21.15.60:44924) 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 -- 172.21.15.60:0/3546850121 learned_addr learned my addr 172.21.15.60:0/3546850121 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5cffff700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5d00b0890 0x7fa5d00c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5cf7fe700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d0067ba0 0x7fa5d00c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 -- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d0067ba0 msgr2=0x7fa5d00c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d0067ba0 0x7fa5d00c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 -- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5d00b0890 msgr2=0x7fa5d00c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5d00b0890 0x7fa5d00c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 -- 172.21.15.60:0/3546850121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c8009ae0 con 0x7fa5d006c630 2023-10-08T16:05:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5ceffd700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 0x7fa5d00c3060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c830 tx=0x7fa5c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011600 con 0x7fa5d006c630 2023-10-08T16:05:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c4011760 con 0x7fa5d006c630 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011b20 con 0x7fa5d006c630 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d00c4fc0 con 0x7fa5d006c630 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d00c2580 con 0x7fa5d006c630 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.203+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d00c2d80 con 0x7fa5d006c630 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.204+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5c4018360 con 0x7fa5d006c630 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.204+0000 7fa5b77fe700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5bc066f60 0x7fa5bc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.204+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5c4084480 con 0x7fa5d006c630 2023-10-08T16:05:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.204+0000 7fa5cf7fe700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5bc066f60 0x7fa5bc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.205+0000 7fa5cf7fe700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5bc066f60 0x7fa5bc069410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009af0 tx=0x7fa5c0009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.210+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5d00c2d80 con 0x7fa5d006c630 2023-10-08T16:05:27.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.447+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5d00c2d40 con 0x7fa5d006c630 2023-10-08T16:05:27.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.448+0000 7fa5b77fe700 1 -- 172.21.15.60:0/3546850121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5c40516f0 con 0x7fa5d006c630 2023-10-08T16:05:27.449 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:05:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5bc066f60 msgr2=0x7fa5bc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5bc066f60 0x7fa5bc069410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009af0 tx=0x7fa5c0009060 comp rx=0 tx=0).stop 2023-10-08T16:05:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 msgr2=0x7fa5d00c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 0x7fa5d00c3060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c830 tx=0x7fa5c4008040 comp rx=0 tx=0).stop 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 shutdown_connections 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5bc066f60 0x7fa5bc069410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5d0067ba0 0x7fa5d00c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5d00b0890 0x7fa5d00c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 --2- 172.21.15.60:0/3546850121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5d006c630 0x7fa5d00c3060 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 >> 172.21.15.60:0/3546850121 conn(0x7fa5d006fe50 msgr2=0x7fa5d00cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 shutdown_connections 2023-10-08T16:05:27.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:27.450+0000 7fa5d5bae700 1 -- 172.21.15.60:0/3546850121 wait complete. 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:05:27.463 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T16:05:27.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.464 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:05:27.479 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:05:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42416sec preferred_lft 42416sec 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link tentative 2023-10-08T16:05:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.482 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:05:27.542 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:05:27.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.544 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:05:27.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.601 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:27.601 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:27.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:05:27.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:05:27.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:05:27.601 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:27.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.699 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:05:27.713 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:05:27.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.714 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-10-08T16:05:27.768 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T16:05:27.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.768 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:27.768 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:27.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:05:27.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T16:05:27.769 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:27.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T16:05:27.889 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 36:b5:75:e6:96:50 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::34b5:75ff:fee6:9650/64 scope link tentative 2023-10-08T16:05:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T16:05:27.977 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:05:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:05:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:05:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 36:b5:75:e6:96:50 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::34b5:75ff:fee6:9650/64 scope link tentative 2023-10-08T16:05:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:05:27.989 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T16:05:27.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:27.989 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T16:05:27.990 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:28.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:28.214 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:05:28.214 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:05:28.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2023-10-08T16:05:28.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T16:05:28.214 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:05:28.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:28.294 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T16:05:28.309 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T16:05:28.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:05:28.309 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T16:05:28.364 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-08T16:05:28.364 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:05:28.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:28.444 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:28.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 3@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:28.484 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:05:28.484 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 3@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:05:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:05:28.487 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:05:28.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:28.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T16:05:28.551 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T16:05:28.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:28.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.702+0000 7fd4a30f8700 1 Processor -- start 2023-10-08T16:05:28.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.702+0000 7fd4a30f8700 1 -- start start 2023-10-08T16:05:28.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a30f8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b0f20 0x7fd49c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a30f8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd49c0b12f0 0x7fd49c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a30f8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c0d0580 con 0x7fd49c0b64d0 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a30f8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c0b35c0 con 0x7fd49c0b12f0 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a30f8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15dad0 con 0x7fd49c0b0f20 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a28f7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd49c0b64d0 0x7fd49c0ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50632/0 (socket says 172.21.15.60:50632) 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.703+0000 7fd4a28f7700 1 -- 172.21.15.60:0/4106132896 learned_addr learned my addr 172.21.15.60:0/4106132896 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a20f6700 1 --2- 172.21.15.60:0/4106132896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b0f20 0x7fd49c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a18f5700 1 --2- 172.21.15.60:0/4106132896 >> v2:172.21.15.144:3300/0 conn(0x7fd49c0b12f0 0x7fd49c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a10f4700 1 -- 172.21.15.60:0/4106132896 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047788719 0 0) 0x7fd49c0d0580 con 0x7fd49c0b64d0 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a10f4700 1 -- 172.21.15.60:0/4106132896 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd484003570 con 0x7fd49c0b64d0 2023-10-08T16:05:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a10f4700 1 -- 172.21.15.60:0/4106132896 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 695295367 0 0) 0x7fd484003570 con 0x7fd49c0b64d0 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a20f6700 1 -- 172.21.15.60:0/4106132896 >> v2:172.21.15.144:3300/0 conn(0x7fd49c0b12f0 msgr2=0x7fd49c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a20f6700 1 --2- 172.21.15.60:0/4106132896 >> v2:172.21.15.144:3300/0 conn(0x7fd49c0b12f0 0x7fd49c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a20f6700 1 -- 172.21.15.60:0/4106132896 >> v1:172.21.15.60:6789/0 conn(0x7fd49c0b64d0 legacy=0x7fd49c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a20f6700 1 -- 172.21.15.60:0/4106132896 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c0cfc50 con 0x7fd49c0b0f20 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a18f5700 1 --2- 172.21.15.60:0/4106132896 >> v2:172.21.15.144:3300/0 conn(0x7fd49c0b12f0 0x7fd49c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a20f6700 1 --2- 172.21.15.60:0/4106132896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b0f20 0x7fd49c0b2d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009e60 tx=0x7fd48c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80770f030f1b2f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a10f4700 1 -- 172.21.15.60:0/4106132896 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00e070 con 0x7fd49c0b0f20 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a10f4700 1 -- 172.21.15.60:0/4106132896 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00b830 con 0x7fd49c0b0f20 2023-10-08T16:05:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.704+0000 7fd4a10f4700 1 -- 172.21.15.60:0/4106132896 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494001470 con 0x7fd49c0b0f20 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 -- 172.21.15.60:0/4106132896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b0f20 msgr2=0x7fd49c0b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/4106132896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b0f20 0x7fd49c0b2d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009e60 tx=0x7fd48c009780 comp rx=0 tx=0).stop 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 -- 172.21.15.60:0/4106132896 shutdown_connections 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/4106132896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b0f20 0x7fd49c0b2d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/4106132896 >> v2:172.21.15.144:3300/0 conn(0x7fd49c0b12f0 0x7fd49c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 -- 172.21.15.60:0/4106132896 >> 172.21.15.60:0/4106132896 conn(0x7fd49c067e40 msgr2=0x7fd49c0d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 -- 172.21.15.60:0/4106132896 shutdown_connections 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.705+0000 7fd4a30f8700 1 -- 172.21.15.60:0/4106132896 wait complete. 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.706+0000 7fd4a30f8700 1 Processor -- start 2023-10-08T16:05:28.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.706+0000 7fd4a30f8700 1 -- start start 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a30f8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd49c0b0f20 0x7fd49c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a30f8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b12f0 0x7fd49c09b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a30f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 0x7fd49c0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a30f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c15b680 con 0x7fd49c0b64d0 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a30f8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c09ce70 con 0x7fd49c0b0f20 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a30f8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c09b760 con 0x7fd49c0b12f0 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 0x7fd49c0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 0x7fd49c0c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44926/0 (socket says 172.21.15.60:44926) 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 -- 172.21.15.60:0/1268924243 learned_addr learned my addr 172.21.15.60:0/1268924243 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a18f5700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b12f0 0x7fd49c09b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:28.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a20f6700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd49c0b0f20 0x7fd49c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 -- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b12f0 msgr2=0x7fd49c09b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b12f0 0x7fd49c09b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 -- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd49c0b0f20 msgr2=0x7fd49c15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd49c0b0f20 0x7fd49c15b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 -- 172.21.15.60:0/1268924243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490009420 con 0x7fd49c0b64d0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.707+0000 7fd4a28f7700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 0x7fd49c0c62d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd494001ed0 tx=0x7fd494001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.708+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494007360 con 0x7fd49c0b64d0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.708+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940074e0 con 0x7fd49c0b64d0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.708+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c009a20 con 0x7fd49c0b64d0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.708+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004830 con 0x7fd49c0b64d0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.708+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c09bd10 con 0x7fd49c0b64d0 2023-10-08T16:05:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.709+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c09cc40 con 0x7fd49c0b64d0 2023-10-08T16:05:28.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.709+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd494004c20 con 0x7fd49c0b64d0 2023-10-08T16:05:28.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.709+0000 7fd49a7fc700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd488066f30 0x7fd4880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:28.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.709+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd494083780 con 0x7fd49c0b64d0 2023-10-08T16:05:28.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.709+0000 7fd4a20f6700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd488066f30 0x7fd4880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:28.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.709+0000 7fd4a20f6700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd488066f30 0x7fd4880693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0099f0 tx=0x7fd48c018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:28.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.713+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd49c09cc40 con 0x7fd49c0b64d0 2023-10-08T16:05:28.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.908+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd49c09cc40 con 0x7fd49c0b64d0 2023-10-08T16:05:28.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.909+0000 7fd49a7fc700 1 -- 172.21.15.60:0/1268924243 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd49c09cc40 con 0x7fd49c0b64d0 2023-10-08T16:05:28.910 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:28.910 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd488066f30 msgr2=0x7fd4880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd488066f30 0x7fd4880693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0099f0 tx=0x7fd48c018000 comp rx=0 tx=0).stop 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 msgr2=0x7fd49c0c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 0x7fd49c0c62d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd494001ed0 tx=0x7fd494001a00 comp rx=0 tx=0).stop 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 shutdown_connections 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd488066f30 0x7fd4880693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0b64d0 0x7fd49c0c62d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd49c0b0f20 0x7fd49c15b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 --2- 172.21.15.60:0/1268924243 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd49c0b12f0 0x7fd49c09b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:28.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.911+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 >> 172.21.15.60:0/1268924243 conn(0x7fd49c067e40 msgr2=0x7fd49c0b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:28.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.912+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 shutdown_connections 2023-10-08T16:05:28.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:28.912+0000 7fd4a30f8700 1 -- 172.21.15.60:0/1268924243 wait complete. 2023-10-08T16:05:28.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:28.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.046+0000 7ffb5965c700 1 Processor -- start 2023-10-08T16:05:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.046+0000 7ffb5965c700 1 -- start start 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb5965c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb5965c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb540697c0 0x7ffb540af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb5965c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5415ea90 con 0x7ffb5415a230 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb5965c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540d1cf0 con 0x7ffb540697c0 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb5965c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540b3100 con 0x7ffb54159e60 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb537fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb540697c0 0x7ffb540af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb52ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb527fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffb5415a230 0x7ffb540690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37750/0 (socket says 172.21.15.60:37750) 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb527fc700 1 -- 172.21.15.60:0/662513982 learned_addr learned my addr 172.21.15.60:0/662513982 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb537fe700 1 -- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 msgr2=0x7ffb5415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:29.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb537fe700 1 --2- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb537fe700 1 -- 172.21.15.60:0/662513982 >> v1:172.21.15.144:6789/0 conn(0x7ffb5415a230 legacy=0x7ffb540690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb51ffb700 1 -- 172.21.15.60:0/662513982 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795605088 0 0) 0x7ffb5415ea90 con 0x7ffb5415a230 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb537fe700 1 -- 172.21.15.60:0/662513982 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540d10e0 con 0x7ffb540697c0 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb52ffd700 1 --2- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.047+0000 7ffb537fe700 1 --2- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb540697c0 0x7ffb540af730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009e60 tx=0x7ffb4c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d72cc1341d74c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb51ffb700 1 -- 172.21.15.60:0/662513982 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00e070 con 0x7ffb540697c0 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb51ffb700 1 -- 172.21.15.60:0/662513982 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00bb60 con 0x7ffb540697c0 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb51ffb700 1 -- 172.21.15.60:0/662513982 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c012430 con 0x7ffb540697c0 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 -- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb540697c0 msgr2=0x7ffb540af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 --2- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb540697c0 0x7ffb540af730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009e60 tx=0x7ffb4c009780 comp rx=0 tx=0).stop 2023-10-08T16:05:29.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 -- 172.21.15.60:0/662513982 shutdown_connections 2023-10-08T16:05:29.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 --2- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb540697c0 0x7ffb540af730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 --2- 172.21.15.60:0/662513982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 -- 172.21.15.60:0/662513982 >> 172.21.15.60:0/662513982 conn(0x7ffb54070700 msgr2=0x7ffb54070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:29.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 -- 172.21.15.60:0/662513982 shutdown_connections 2023-10-08T16:05:29.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.048+0000 7ffb5965c700 1 -- 172.21.15.60:0/662513982 wait complete. 2023-10-08T16:05:29.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.049+0000 7ffb5965c700 1 Processor -- start 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 -- start start 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 0x7ffb5415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb5415a230 0x7ffb5416d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5415e940 con 0x7ffb540697c0 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54160250 con 0x7ffb5415a230 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb5965c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5415dd30 con 0x7ffb54159e60 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb52ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 0x7ffb5415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb52ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 0x7ffb5415fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44938/0 (socket says 172.21.15.60:44938) 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.050+0000 7ffb52ffd700 1 -- 172.21.15.60:0/23840332 learned_addr learned my addr 172.21.15.60:0/23840332 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb52ffd700 1 -- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 msgr2=0x7ffb5415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb537fe700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb5415a230 0x7ffb5416d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb527fc700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb52ffd700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb52ffd700 1 -- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb5415a230 msgr2=0x7ffb5416d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb52ffd700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb5415a230 0x7ffb5416d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb52ffd700 1 -- 172.21.15.60:0/23840332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009420 con 0x7ffb540697c0 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb537fe700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb5415a230 0x7ffb5416d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb527fc700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb52ffd700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 0x7ffb5415fd10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400ec80 tx=0x7ffb440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400c9d0 con 0x7ffb540697c0 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400cb30 con 0x7ffb540697c0 2023-10-08T16:05:29.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c009a20 con 0x7ffb540697c0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400ceb0 con 0x7ffb540697c0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.051+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5415e2f0 con 0x7ffb540697c0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.052+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5404c3c0 con 0x7ffb540697c0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.053+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb44013680 con 0x7ffb540697c0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.053+0000 7ffb3affd700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb40066f30 0x7ffb400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.053+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb44084980 con 0x7ffb540697c0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.053+0000 7ffb527fc700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb40066f30 0x7ffb400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.053+0000 7ffb527fc700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb40066f30 0x7ffb400693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb5415eb10 tx=0x7ffb48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.057+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb44051bf0 con 0x7ffb540697c0 2023-10-08T16:05:29.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.251+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb540cb590 con 0x7ffb540697c0 2023-10-08T16:05:29.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.252+0000 7ffb3affd700 1 -- 172.21.15.60:0/23840332 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb44055210 con 0x7ffb540697c0 2023-10-08T16:05:29.252 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:29.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb40066f30 msgr2=0x7ffb400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb40066f30 0x7ffb400693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb5415eb10 tx=0x7ffb48009040 comp rx=0 tx=0).stop 2023-10-08T16:05:29.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 msgr2=0x7ffb5415fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 0x7ffb5415fd10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400ec80 tx=0x7ffb440091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 shutdown_connections 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb40066f30 0x7ffb400693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb5415a230 0x7ffb5416d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb540697c0 0x7ffb5415fd10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 --2- 172.21.15.60:0/23840332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb54159e60 0x7ffb5415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 >> 172.21.15.60:0/23840332 conn(0x7ffb54070700 msgr2=0x7ffb540d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 shutdown_connections 2023-10-08T16:05:29.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.254+0000 7ffb5965c700 1 -- 172.21.15.60:0/23840332 wait complete. 2023-10-08T16:05:29.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:29.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.388+0000 7f24072f6700 1 Processor -- start 2023-10-08T16:05:29.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.388+0000 7f24072f6700 1 -- start start 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24072f6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24000b06b0 0x7f24000b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24072f6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f24000cf5a0 0x7f24000b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24072f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2400069240 0x7f24001597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24072f6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2400069680 con 0x7f24000cf5a0 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24072f6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24000ce7e0 con 0x7f24000b06b0 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24072f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24000ceac0 con 0x7f2400069240 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f2405af3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f24000cf5a0 0x7f24000b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f2405af3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f24000cf5a0 0x7f24000b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44942/0 (socket says 172.21.15.60:44942) 2023-10-08T16:05:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f2405af3700 1 -- 172.21.15.60:0/4239781139 learned_addr learned my addr 172.21.15.60:0/4239781139 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f2406af5700 1 --2- 172.21.15.60:0/4239781139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2400069240 0x7f24001597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.389+0000 7f24062f4700 1 --2- 172.21.15.60:0/4239781139 >> v2:172.21.15.144:3300/0 conn(0x7f24000b06b0 0x7f24000b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f2405af3700 1 -- 172.21.15.60:0/4239781139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2400069240 msgr2=0x7f24001597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f2405af3700 1 --2- 172.21.15.60:0/4239781139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2400069240 0x7f24001597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f2405af3700 1 -- 172.21.15.60:0/4239781139 >> v2:172.21.15.144:3300/0 conn(0x7f24000b06b0 msgr2=0x7f24000b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f2405af3700 1 --2- 172.21.15.60:0/4239781139 >> v2:172.21.15.144:3300/0 conn(0x7f24000b06b0 0x7f24000b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f2405af3700 1 -- 172.21.15.60:0/4239781139 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24000ceda0 con 0x7f24000cf5a0 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f2405af3700 1 --2- 172.21.15.60:0/4239781139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24000cf5a0 0x7f24000b1850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f240006e700 tx=0x7f23f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5064a030bb107894 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24052f2700 1 -- 172.21.15.60:0/4239781139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400b640 con 0x7f24000cf5a0 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24052f2700 1 -- 172.21.15.60:0/4239781139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400b7a0 con 0x7f24000cf5a0 2023-10-08T16:05:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24052f2700 1 -- 172.21.15.60:0/4239781139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400bb60 con 0x7f24000cf5a0 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24072f6700 1 -- 172.21.15.60:0/4239781139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24000cf5a0 msgr2=0x7f24000b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24072f6700 1 --2- 172.21.15.60:0/4239781139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24000cf5a0 0x7f24000b1850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f240006e700 tx=0x7f23f4009250 comp rx=0 tx=0).stop 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24072f6700 1 -- 172.21.15.60:0/4239781139 shutdown_connections 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.390+0000 7f24072f6700 1 --2- 172.21.15.60:0/4239781139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2400069240 0x7f24001597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.391+0000 7f24072f6700 1 --2- 172.21.15.60:0/4239781139 >> v2:172.21.15.144:3300/0 conn(0x7f24000b06b0 0x7f24000b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.391+0000 7f24072f6700 1 --2- 172.21.15.60:0/4239781139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24000cf5a0 0x7f24000b1850 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.391+0000 7f24072f6700 1 -- 172.21.15.60:0/4239781139 >> 172.21.15.60:0/4239781139 conn(0x7f240006c700 msgr2=0x7f2400069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.391+0000 7f24072f6700 1 -- 172.21.15.60:0/4239781139 shutdown_connections 2023-10-08T16:05:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.391+0000 7f24072f6700 1 -- 172.21.15.60:0/4239781139 wait complete. 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 Processor -- start 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 -- start start 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 0x7f2400149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24000b06b0 0x7f240015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24000cf5a0 0x7f24000c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24000cb4c0 con 0x7f2400069240 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240015c4e0 con 0x7f24000b06b0 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24072f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240016dbe0 con 0x7f24000cf5a0 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24062f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 0x7f2400149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.392+0000 7f24062f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 0x7f2400149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44946/0 (socket says 172.21.15.60:44946) 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 -- 172.21.15.60:0/507751312 learned_addr learned my addr 172.21.15.60:0/507751312 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f2406af5700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24000cf5a0 0x7f24000c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f2405af3700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24000b06b0 0x7f240015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 -- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24000cf5a0 msgr2=0x7f24000c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24000cf5a0 0x7f24000c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 -- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24000b06b0 msgr2=0x7f240015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24000b06b0 0x7f240015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 -- 172.21.15.60:0/507751312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40094f0 con 0x7f2400069240 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24062f4700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 0x7f2400149670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009f20 tx=0x7f23f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800cb70 con 0x7f2400069240 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f800f040 con 0x7f2400069240 2023-10-08T16:05:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240016dec0 con 0x7f2400069240 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8014480 con 0x7f2400069240 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.393+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240016e480 con 0x7f2400069240 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.394+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240004c3c0 con 0x7f2400069240 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.395+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23f80147f0 con 0x7f2400069240 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.395+0000 7f23fe7fc700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f23ec066f30 0x7f23ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.395+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23f8084f00 con 0x7f2400069240 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.395+0000 7f2405af3700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f23ec066f30 0x7f23ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.395+0000 7f2405af3700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f23ec066f30 0x7f23ec0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f240006e700 tx=0x7f23f4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.399+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23f80520d0 con 0x7f2400069240 2023-10-08T16:05:29.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.592+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24000cf080 con 0x7f2400069240 2023-10-08T16:05:29.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.592+0000 7f23fe7fc700 1 -- 172.21.15.60:0/507751312 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23f80556f0 con 0x7f2400069240 2023-10-08T16:05:29.593 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f23ec066f30 msgr2=0x7f23ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f23ec066f30 0x7f23ec0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f240006e700 tx=0x7f23f4017000 comp rx=0 tx=0).stop 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 msgr2=0x7f2400149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 0x7f2400149670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009f20 tx=0x7f23f800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 shutdown_connections 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f23ec066f30 0x7f23ec0693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24000cf5a0 0x7f24000c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400069240 0x7f2400149670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 --2- 172.21.15.60:0/507751312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24000b06b0 0x7f240015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 >> 172.21.15.60:0/507751312 conn(0x7f240006c700 msgr2=0x7f240006fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 shutdown_connections 2023-10-08T16:05:29.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.594+0000 7f24072f6700 1 -- 172.21.15.60:0/507751312 wait complete. 2023-10-08T16:05:29.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:29.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.727+0000 7f2ecc8ff700 1 Processor -- start 2023-10-08T16:05:29.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.728+0000 7f2ecc8ff700 1 -- start start 2023-10-08T16:05:29.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.728+0000 7f2ecc8ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ec8152300 0x7f2ec815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.728+0000 7f2ecc8ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.728+0000 7f2ecc8ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec815c8d0 con 0x7f2ec8158df0 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.728+0000 7f2ecc8ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec80b1400 con 0x7f2ec8152300 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.728+0000 7f2ecc8ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec80c9370 con 0x7f2ec806d370 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ec8152300 0x7f2ec815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec6d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec5d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2ec8158df0 0x7f2ec80caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37752/0 (socket says 172.21.15.60:37752) 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec5d9b700 1 -- 172.21.15.60:0/3969377733 learned_addr learned my addr 172.21.15.60:0/3969377733 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec559a700 1 -- 172.21.15.60:0/3969377733 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962728202 0 0) 0x7f2ec815c8d0 con 0x7f2ec8158df0 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec559a700 1 -- 172.21.15.60:0/3969377733 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb4003570 con 0x7f2ec8158df0 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec659c700 1 -- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 msgr2=0x7f2ec806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec659c700 1 --2- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec659c700 1 -- 172.21.15.60:0/3969377733 >> v1:172.21.15.144:6789/0 conn(0x7f2ec8158df0 legacy=0x7f2ec80caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec659c700 1 -- 172.21.15.60:0/3969377733 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec815c030 con 0x7f2ec8152300 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec6d9d700 1 --2- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec659c700 1 --2- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8152300 0x7f2ec815b9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009e60 tx=0x7f2ec0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab7dab9ce14d203 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.729+0000 7f2ec559a700 1 -- 172.21.15.60:0/3969377733 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000e070 con 0x7f2ec8152300 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ec559a700 1 -- 172.21.15.60:0/3969377733 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000bab0 con 0x7f2ec8152300 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ec559a700 1 -- 172.21.15.60:0/3969377733 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000be70 con 0x7f2ec8152300 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8152300 msgr2=0x7f2ec815b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8152300 0x7f2ec815b9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009e60 tx=0x7f2ec0009780 comp rx=0 tx=0).stop 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/3969377733 shutdown_connections 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/3969377733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8152300 0x7f2ec815b9a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/3969377733 >> 172.21.15.60:0/3969377733 conn(0x7f2ec8069870 msgr2=0x7f2ec8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/3969377733 shutdown_connections 2023-10-08T16:05:29.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.730+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/3969377733 wait complete. 2023-10-08T16:05:29.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.731+0000 7f2ecc8ff700 1 Processor -- start 2023-10-08T16:05:29.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.731+0000 7f2ecc8ff700 1 -- start start 2023-10-08T16:05:29.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ecc8ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec814a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ecc8ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 0x7f2ec814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ecc8ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8158df0 0x7f2ec80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ecc8ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec814e5d0 con 0x7f2ec8152300 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ecc8ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec814dec0 con 0x7f2ec8158df0 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ecc8ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec80b29f0 con 0x7f2ec806d370 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 0x7f2ec814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 0x7f2ec814b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44962/0 (socket says 172.21.15.60:44962) 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 -- 172.21.15.60:0/2746161439 learned_addr learned my addr 172.21.15.60:0/2746161439 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec6d9d700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8158df0 0x7f2ec80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec659c700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 -- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 msgr2=0x7f2ec814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 -- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8158df0 msgr2=0x7f2ec80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8158df0 0x7f2ec80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.732+0000 7f2ec5d9b700 1 -- 172.21.15.60:0/2746161439 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8009420 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.733+0000 7f2ec5d9b700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 0x7f2ec814b040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c7c0 tx=0x7f2eb0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.733+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0005b30 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.733+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0005cb0 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.733+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec0009a20 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.733+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0007320 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.733+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec80b2d80 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.734+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec814e740 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.734+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2eb001b3b0 con 0x7f2ec8152300 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.734+0000 7f2ebe7fc700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ea8066f30 0x7f2ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.735+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2eb00839c0 con 0x7f2ec8152300 2023-10-08T16:05:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.735+0000 7f2ec659c700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ea8066f30 0x7f2ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.735+0000 7f2ec659c700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ea8066f30 0x7f2ea80693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00097c0 tx=0x7f2ec0019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:29.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.739+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ec814e740 con 0x7f2ec8152300 2023-10-08T16:05:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.930+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ec814e740 con 0x7f2ec8152300 2023-10-08T16:05:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.931+0000 7f2ebe7fc700 1 -- 172.21.15.60:0/2746161439 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ec814e740 con 0x7f2ec8152300 2023-10-08T16:05:29.931 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ea8066f30 msgr2=0x7f2ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ea8066f30 0x7f2ea80693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00097c0 tx=0x7f2ec0019000 comp rx=0 tx=0).stop 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 msgr2=0x7f2ec814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 0x7f2ec814b040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c7c0 tx=0x7f2eb0007e00 comp rx=0 tx=0).stop 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 shutdown_connections 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ea8066f30 0x7f2ea80693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ec806d370 0x7f2ec814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ec8158df0 0x7f2ec80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 --2- 172.21.15.60:0/2746161439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ec8152300 0x7f2ec814b040 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 >> 172.21.15.60:0/2746161439 conn(0x7f2ec8069870 msgr2=0x7f2ec80c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 shutdown_connections 2023-10-08T16:05:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:29.933+0000 7f2ecc8ff700 1 -- 172.21.15.60:0/2746161439 wait complete. 2023-10-08T16:05:29.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:30.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.064+0000 7f43ee2dc700 1 Processor -- start 2023-10-08T16:05:30.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.064+0000 7f43ee2dc700 1 -- start start 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ee2dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e80cd6e0 0x7f43e80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ee2dc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43e80cdab0 0x7f43e815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ee2dc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f43e815dda0 0x7f43e815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ee2dc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e815e850 con 0x7f43e80cdab0 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ee2dc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e80cd030 con 0x7f43e815dda0 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ee2dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80cb7c0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43e80cdab0 0x7f43e815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43e80cdab0 0x7f43e815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44976/0 (socket says 172.21.15.60:44976) 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 -- 172.21.15.60:0/3625885853 learned_addr learned my addr 172.21.15.60:0/3625885853 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ed2da700 1 --2- 172.21.15.60:0/3625885853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e80cd6e0 0x7f43e80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43edadb700 1 --2- 172.21.15.60:0/3625885853 >> v2:172.21.15.144:3300/0 conn(0x7f43e815dda0 0x7f43e815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 -- 172.21.15.60:0/3625885853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e80cd6e0 msgr2=0x7f43e80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 --2- 172.21.15.60:0/3625885853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e80cd6e0 0x7f43e80cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 -- 172.21.15.60:0/3625885853 >> v2:172.21.15.144:3300/0 conn(0x7f43e815dda0 msgr2=0x7f43e815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 --2- 172.21.15.60:0/3625885853 >> v2:172.21.15.144:3300/0 conn(0x7f43e815dda0 0x7f43e815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43ecad9700 1 -- 172.21.15.60:0/3625885853 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e815e290 con 0x7f43e80cdab0 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.065+0000 7f43edadb700 1 --2- 172.21.15.60:0/3625885853 >> v2:172.21.15.144:3300/0 conn(0x7f43e815dda0 0x7f43e815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ecad9700 1 --2- 172.21.15.60:0/3625885853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cdab0 0x7f43e815d860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f43e8089ac0 tx=0x7f43dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6f2e2790c4f228 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43e7fff700 1 -- 172.21.15.60:0/3625885853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00b860 con 0x7f43e80cdab0 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43e7fff700 1 -- 172.21.15.60:0/3625885853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00b9c0 con 0x7f43e80cdab0 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43e7fff700 1 -- 172.21.15.60:0/3625885853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00bd60 con 0x7f43e80cdab0 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 -- 172.21.15.60:0/3625885853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cdab0 msgr2=0x7f43e815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/3625885853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cdab0 0x7f43e815d860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f43e8089ac0 tx=0x7f43dc009250 comp rx=0 tx=0).stop 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 -- 172.21.15.60:0/3625885853 shutdown_connections 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/3625885853 >> v2:172.21.15.144:3300/0 conn(0x7f43e815dda0 0x7f43e815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/3625885853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e80cd6e0 0x7f43e80cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/3625885853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cdab0 0x7f43e815d860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 -- 172.21.15.60:0/3625885853 >> 172.21.15.60:0/3625885853 conn(0x7f43e8067660 msgr2=0x7f43e8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.066+0000 7f43ee2dc700 1 -- 172.21.15.60:0/3625885853 shutdown_connections 2023-10-08T16:05:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.067+0000 7f43ee2dc700 1 -- 172.21.15.60:0/3625885853 wait complete. 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.068+0000 7f43ee2dc700 1 Processor -- start 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.068+0000 7f43ee2dc700 1 -- start start 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.068+0000 7f43ee2dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 0x7f43e81536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.068+0000 7f43ee2dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e80cdab0 0x7f43e80c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.068+0000 7f43ee2dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e815dda0 0x7f43e8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ee2dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8151510 con 0x7f43e80cd6e0 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ee2dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8151250 con 0x7f43e80cdab0 2023-10-08T16:05:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ee2dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8153c20 con 0x7f43e815dda0 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 0x7f43e81536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 0x7f43e81536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44980/0 (socket says 172.21.15.60:44980) 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 -- 172.21.15.60:0/2477412965 learned_addr learned my addr 172.21.15.60:0/2477412965 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ecad9700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e80cdab0 0x7f43e80c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43edadb700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e815dda0 0x7f43e8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 -- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e815dda0 msgr2=0x7f43e8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e815dda0 0x7f43e8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 -- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e80cdab0 msgr2=0x7f43e80c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e80cdab0 0x7f43e80c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 -- 172.21.15.60:0/2477412965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0094f0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ecad9700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e80cdab0 0x7f43e80c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ed2da700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 0x7f43e81536e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43e000d890 tx=0x7f43e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00125f0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0012750 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e80c99b0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0012b10 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.069+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e80c9ff0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.070+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e81517b0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.071+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43e001e460 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.071+0000 7f43e57fa700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f43d4066f30 0x7f43d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.071+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43e0084ad0 con 0x7f43e80cd6e0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.071+0000 7f43ecad9700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f43d4066f30 0x7f43d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.072+0000 7f43ecad9700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f43d4066f30 0x7f43d40693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43e8089ac0 tx=0x7f43dc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.075+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43e0051d40 con 0x7f43e80cd6e0 2023-10-08T16:05:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.268+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43e80c9740 con 0x7f43e80cd6e0 2023-10-08T16:05:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.269+0000 7f43e57fa700 1 -- 172.21.15.60:0/2477412965 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f43e0055360 con 0x7f43e80cd6e0 2023-10-08T16:05:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:30.269 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f43d4066f30 msgr2=0x7f43d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f43d4066f30 0x7f43d40693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43e8089ac0 tx=0x7f43dc017000 comp rx=0 tx=0).stop 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 msgr2=0x7f43e81536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 0x7f43e81536e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43e000d890 tx=0x7f43e0008040 comp rx=0 tx=0).stop 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 shutdown_connections 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f43d4066f30 0x7f43d40693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43e815dda0 0x7f43e8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43e80cd6e0 0x7f43e81536e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 --2- 172.21.15.60:0/2477412965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e80cdab0 0x7f43e80c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 >> 172.21.15.60:0/2477412965 conn(0x7f43e8067660 msgr2=0x7f43e81568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 shutdown_connections 2023-10-08T16:05:30.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.271+0000 7f43ee2dc700 1 -- 172.21.15.60:0/2477412965 wait complete. 2023-10-08T16:05:30.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:30.284 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.406+0000 7fd660e22700 1 Processor -- start 2023-10-08T16:05:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.406+0000 7fd660e22700 1 -- start start 2023-10-08T16:05:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd660e22700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd65c159ec0 0x7fd65c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd660e22700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c06acb0 0x7fd65c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd660e22700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c0b0790 con 0x7fd65c15a290 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd660e22700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c0ce1f0 con 0x7fd65c159ec0 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd660e22700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0b0b20 con 0x7fd65c06acb0 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd65a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd65c159ec0 0x7fd65c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd659d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd65c15a290 0x7fd65c06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50648/0 (socket says 172.21.15.60:50648) 2023-10-08T16:05:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd65a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd65c159ec0 0x7fd65c0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44996/0 (socket says 172.21.15.60:44996) 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.407+0000 7fd659d9b700 1 -- 172.21.15.60:0/4146394581 learned_addr learned my addr 172.21.15.60:0/4146394581 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65ad9d700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c06acb0 0x7fd65c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65a59c700 1 -- 172.21.15.60:0/4146394581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c06acb0 msgr2=0x7fd65c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65a59c700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c06acb0 0x7fd65c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65a59c700 1 -- 172.21.15.60:0/4146394581 >> v1:172.21.15.60:6789/0 conn(0x7fd65c15a290 legacy=0x7fd65c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65a59c700 1 -- 172.21.15.60:0/4146394581 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0b04b0 con 0x7fd65c159ec0 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65959a700 1 -- 172.21.15.60:0/4146394581 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945767686 0 0) 0x7fd65c0b0790 con 0x7fd65c15a290 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65ad9d700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c06acb0 0x7fd65c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:30.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65a59c700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c159ec0 0x7fd65c0af940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd6540098e0 tx=0x7fd6540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f402db0bfeed7d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65959a700 1 -- 172.21.15.60:0/4146394581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654009e80 con 0x7fd65c159ec0 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65959a700 1 -- 172.21.15.60:0/4146394581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65400b860 con 0x7fd65c159ec0 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd65959a700 1 -- 172.21.15.60:0/4146394581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65400bbe0 con 0x7fd65c159ec0 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd660e22700 1 -- 172.21.15.60:0/4146394581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c159ec0 msgr2=0x7fd65c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.408+0000 7fd660e22700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c159ec0 0x7fd65c0af940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd6540098e0 tx=0x7fd6540091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.409+0000 7fd660e22700 1 -- 172.21.15.60:0/4146394581 shutdown_connections 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.409+0000 7fd660e22700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c06acb0 0x7fd65c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.409+0000 7fd660e22700 1 --2- 172.21.15.60:0/4146394581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c159ec0 0x7fd65c0af940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.409+0000 7fd660e22700 1 -- 172.21.15.60:0/4146394581 >> 172.21.15.60:0/4146394581 conn(0x7fd65c0d1880 msgr2=0x7fd65c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.409+0000 7fd660e22700 1 -- 172.21.15.60:0/4146394581 shutdown_connections 2023-10-08T16:05:30.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.409+0000 7fd660e22700 1 -- 172.21.15.60:0/4146394581 wait complete. 2023-10-08T16:05:30.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 Processor -- start 2023-10-08T16:05:30.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 -- start start 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 0x7fd65c14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c159ec0 0x7fd65c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c15a290 0x7fd65c0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0c9fb0 con 0x7fd65c06acb0 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0c93a0 con 0x7fd65c159ec0 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.410+0000 7fd660e22700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0c9680 con 0x7fd65c15a290 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 0x7fd65c14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 0x7fd65c14a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45012/0 (socket says 172.21.15.60:45012) 2023-10-08T16:05:30.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 -- 172.21.15.60:0/648161056 learned_addr learned my addr 172.21.15.60:0/648161056 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65ad9d700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c15a290 0x7fd65c0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd659d9b700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c159ec0 0x7fd65c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 -- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c15a290 msgr2=0x7fd65c0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c15a290 0x7fd65c0b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 -- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c159ec0 msgr2=0x7fd65c0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c159ec0 0x7fd65c0cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 -- 172.21.15.60:0/648161056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654009420 con 0x7fd65c06acb0 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd65a59c700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 0x7fd65c14a740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd65c071eb0 tx=0x7fd654017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65400bbe0 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654011420 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c0c9960 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540117c0 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.411+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c14ac80 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.412+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c04c3c0 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.413+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd654011bb0 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.413+0000 7fd6527fc700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd63c066f30 0x7fd63c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.413+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd654085d10 con 0x7fd65c06acb0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.413+0000 7fd659d9b700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd63c066f30 0x7fd63c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.413+0000 7fd659d9b700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd63c066f30 0x7fd63c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b3510 tx=0x7fd644009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.417+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd654052f80 con 0x7fd65c06acb0 2023-10-08T16:05:30.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.610+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd65c0ceab0 con 0x7fd65c06acb0 2023-10-08T16:05:30.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.610+0000 7fd6527fc700 1 -- 172.21.15.60:0/648161056 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd654011e60 con 0x7fd65c06acb0 2023-10-08T16:05:30.611 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:30.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd63c066f30 msgr2=0x7fd63c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd63c066f30 0x7fd63c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b3510 tx=0x7fd644009040 comp rx=0 tx=0).stop 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 msgr2=0x7fd65c14a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 0x7fd65c14a740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd65c071eb0 tx=0x7fd654017000 comp rx=0 tx=0).stop 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 shutdown_connections 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd63c066f30 0x7fd63c0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd65c15a290 0x7fd65c0b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd65c06acb0 0x7fd65c14a740 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 --2- 172.21.15.60:0/648161056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd65c159ec0 0x7fd65c0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 >> 172.21.15.60:0/648161056 conn(0x7fd65c0d1880 msgr2=0x7fd65c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 shutdown_connections 2023-10-08T16:05:30.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.612+0000 7fd660e22700 1 -- 172.21.15.60:0/648161056 wait complete. 2023-10-08T16:05:30.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:30.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.745+0000 7fbb6b131700 1 Processor -- start 2023-10-08T16:05:30.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.745+0000 7fbb6b131700 1 -- start start 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb6b131700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb64156e50 0x7fbb640c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb6b131700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640c9060 con 0x7fbb6406f2f0 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb6b131700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64068e20 con 0x7fbb64156a80 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb6b131700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6406f7a0 con 0x7fbb64156e50 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb696ce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb64156e50 0x7fbb640c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb63fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbb6406f2f0 0x7fbb640cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50660/0 (socket says 172.21.15.60:50660) 2023-10-08T16:05:30.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.746+0000 7fbb63fff700 1 -- 172.21.15.60:0/2208770246 learned_addr learned my addr 172.21.15.60:0/2208770246 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb696ce700 1 -- 172.21.15.60:0/2208770246 >> v1:172.21.15.144:6789/0 conn(0x7fbb64156a80 legacy=0x7fbb6406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb696ce700 1 -- 172.21.15.60:0/2208770246 >> v1:172.21.15.60:6789/0 conn(0x7fbb6406f2f0 legacy=0x7fbb640cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb696ce700 1 -- 172.21.15.60:0/2208770246 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640c8a10 con 0x7fbb64156e50 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb637fe700 1 -- 172.21.15.60:0/2208770246 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922947905 0 0) 0x7fbb640c9060 con 0x7fbb6406f2f0 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb696ce700 1 --2- 172.21.15.60:0/2208770246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb64156e50 0x7fbb640c94f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400bb90 tx=0x7fbb5400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c247ec6c76c8f2fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb637fe700 1 -- 172.21.15.60:0/2208770246 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400db60 con 0x7fbb64156e50 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb637fe700 1 -- 172.21.15.60:0/2208770246 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5400dcc0 con 0x7fbb64156e50 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.747+0000 7fbb637fe700 1 -- 172.21.15.60:0/2208770246 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540106a0 con 0x7fbb64156e50 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 -- 172.21.15.60:0/2208770246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb64156e50 msgr2=0x7fbb640c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2208770246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb64156e50 0x7fbb640c94f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400bb90 tx=0x7fbb5400b430 comp rx=0 tx=0).stop 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 -- 172.21.15.60:0/2208770246 shutdown_connections 2023-10-08T16:05:30.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2208770246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb64156e50 0x7fbb640c94f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 -- 172.21.15.60:0/2208770246 >> 172.21.15.60:0/2208770246 conn(0x7fbb640ce530 msgr2=0x7fbb640ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:30.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 -- 172.21.15.60:0/2208770246 shutdown_connections 2023-10-08T16:05:30.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.748+0000 7fbb6b131700 1 -- 172.21.15.60:0/2208770246 wait complete. 2023-10-08T16:05:30.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.749+0000 7fbb6b131700 1 Processor -- start 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.749+0000 7fbb6b131700 1 -- start start 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 0x7fbb6414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb64156a80 0x7fbb640c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb64156e50 0x7fbb6406e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6416a030 con 0x7fbb6406f2f0 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb641694b0 con 0x7fbb64156e50 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64169790 con 0x7fbb64156a80 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 0x7fbb6414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 0x7fbb6414a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45032/0 (socket says 172.21.15.60:45032) 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 -- 172.21.15.60:0/2350196549 learned_addr learned my addr 172.21.15.60:0/2350196549 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb63fff700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb64156a80 0x7fbb640c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb696ce700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb64156e50 0x7fbb6406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 -- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb64156a80 msgr2=0x7fbb640c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb64156a80 0x7fbb640c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 -- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb64156e50 msgr2=0x7fbb6406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb64156e50 0x7fbb6406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 -- 172.21.15.60:0/2350196549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5400b6d0 con 0x7fbb6406f2f0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb696ce700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb64156e50 0x7fbb6406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb68ecd700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 0x7fbb6414a620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00c950 tx=0x7fbb5c002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c012630 con 0x7fbb6406f2f0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c012790 con 0x7fbb6406f2f0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb64169a70 con 0x7fbb6406f2f0 2023-10-08T16:05:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.750+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c012b50 con 0x7fbb6406f2f0 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.751+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6414ab60 con 0x7fbb6406f2f0 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.751+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6404c3c0 con 0x7fbb6406f2f0 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.752+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb5c00a420 con 0x7fbb6406f2f0 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.752+0000 7fbb60ff9700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb50066f30 0x7fbb500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.752+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb5c084970 con 0x7fbb6406f2f0 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.752+0000 7fbb63fff700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb50066f30 0x7fbb500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.753+0000 7fbb63fff700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb50066f30 0x7fbb500693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb640b2ae0 tx=0x7fbb58007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.757+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb5c051be0 con 0x7fbb6406f2f0 2023-10-08T16:05:30.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.946+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb640c8cf0 con 0x7fbb6406f2f0 2023-10-08T16:05:30.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.946+0000 7fbb60ff9700 1 -- 172.21.15.60:0/2350196549 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb5c055200 con 0x7fbb6406f2f0 2023-10-08T16:05:30.947 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb50066f30 msgr2=0x7fbb500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb50066f30 0x7fbb500693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb640b2ae0 tx=0x7fbb58007d30 comp rx=0 tx=0).stop 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 msgr2=0x7fbb6414a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 0x7fbb6414a620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00c950 tx=0x7fbb5c002760 comp rx=0 tx=0).stop 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 shutdown_connections 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb50066f30 0x7fbb500693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb64156e50 0x7fbb6406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6406f2f0 0x7fbb6414a620 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 --2- 172.21.15.60:0/2350196549 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb64156a80 0x7fbb640c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 >> 172.21.15.60:0/2350196549 conn(0x7fbb640ce530 msgr2=0x7fbb640c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:30.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 shutdown_connections 2023-10-08T16:05:30.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:30.948+0000 7fbb6b131700 1 -- 172.21.15.60:0/2350196549 wait complete. 2023-10-08T16:05:30.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.081+0000 7fc59f3c3700 1 Processor -- start 2023-10-08T16:05:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.082+0000 7fc59f3c3700 1 -- start start 2023-10-08T16:05:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.082+0000 7fc59f3c3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc598159ec0 0x7fc5980af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.082+0000 7fc59f3c3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc59806acb0 0x7fc5980afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.082+0000 7fc59f3c3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5980b0790 con 0x7fc59815a290 2023-10-08T16:05:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.082+0000 7fc59f3c3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980ce1f0 con 0x7fc59806acb0 2023-10-08T16:05:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.082+0000 7fc59f3c3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980b0b20 con 0x7fc598159ec0 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc59806acb0 0x7fc5980afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59c95e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc59815a290 0x7fc59806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50666/0 (socket says 172.21.15.60:50666) 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc59806acb0 0x7fc5980afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45036/0 (socket says 172.21.15.60:45036) 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59c95e700 1 -- 172.21.15.60:0/1394857638 learned_addr learned my addr 172.21.15.60:0/1394857638 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d15f700 1 --2- 172.21.15.60:0/1394857638 >> v2:172.21.15.144:3300/0 conn(0x7fc598159ec0 0x7fc5980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 -- 172.21.15.60:0/1394857638 >> v2:172.21.15.144:3300/0 conn(0x7fc598159ec0 msgr2=0x7fc5980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 --2- 172.21.15.60:0/1394857638 >> v2:172.21.15.144:3300/0 conn(0x7fc598159ec0 0x7fc5980af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 -- 172.21.15.60:0/1394857638 >> v1:172.21.15.60:6789/0 conn(0x7fc59815a290 legacy=0x7fc59806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc58ffff700 1 -- 172.21.15.60:0/1394857638 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028266113 0 0) 0x7fc5980b0790 con 0x7fc59815a290 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 -- 172.21.15.60:0/1394857638 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980b04b0 con 0x7fc59806acb0 2023-10-08T16:05:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc59d960700 1 --2- 172.21.15.60:0/1394857638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59806acb0 0x7fc5980afe80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5980898e0 tx=0x7fc590009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4484c971c3e98e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc58ffff700 1 -- 172.21.15.60:0/1394857638 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000e070 con 0x7fc59806acb0 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc58ffff700 1 -- 172.21.15.60:0/1394857638 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000bc30 con 0x7fc59806acb0 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.083+0000 7fc58ffff700 1 -- 172.21.15.60:0/1394857638 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590012430 con 0x7fc59806acb0 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 -- 172.21.15.60:0/1394857638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59806acb0 msgr2=0x7fc5980afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/1394857638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59806acb0 0x7fc5980afe80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5980898e0 tx=0x7fc590009780 comp rx=0 tx=0).stop 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 -- 172.21.15.60:0/1394857638 shutdown_connections 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/1394857638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59806acb0 0x7fc5980afe80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/1394857638 >> v2:172.21.15.144:3300/0 conn(0x7fc598159ec0 0x7fc5980af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 -- 172.21.15.60:0/1394857638 >> 172.21.15.60:0/1394857638 conn(0x7fc5980d1880 msgr2=0x7fc5980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 -- 172.21.15.60:0/1394857638 shutdown_connections 2023-10-08T16:05:31.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.084+0000 7fc59f3c3700 1 -- 172.21.15.60:0/1394857638 wait complete. 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.085+0000 7fc59f3c3700 1 Processor -- start 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.085+0000 7fc59f3c3700 1 -- start start 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59f3c3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59806acb0 0x7fc5980ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59f3c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 0x7fc5980b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59f3c3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59815a290 0x7fc5981548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59f3c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980b45e0 con 0x7fc598159ec0 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59f3c3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980b3cd0 con 0x7fc59815a290 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59f3c3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980b3f90 con 0x7fc59806acb0 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 0x7fc5980b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 0x7fc5980b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45040/0 (socket says 172.21.15.60:45040) 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 -- 172.21.15.60:0/331407916 learned_addr learned my addr 172.21.15.60:0/331407916 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59d960700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59815a290 0x7fc5981548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59d15f700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59806acb0 0x7fc5980ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 -- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59806acb0 msgr2=0x7fc5980ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59806acb0 0x7fc5980ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 -- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59815a290 msgr2=0x7fc5981548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59815a290 0x7fc5981548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 -- 172.21.15.60:0/331407916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590009a20 con 0x7fc598159ec0 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.086+0000 7fc59c95e700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 0x7fc5980b1e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c5b0 tx=0x7fc588001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.087+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588005b30 con 0x7fc598159ec0 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.087+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588005c90 con 0x7fc598159ec0 2023-10-08T16:05:31.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.087+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5980b4270 con 0x7fc598159ec0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.087+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588007300 con 0x7fc598159ec0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.087+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5980b23c0 con 0x7fc598159ec0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.087+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5980b4750 con 0x7fc598159ec0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.088+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc58801b3b0 con 0x7fc598159ec0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.088+0000 7fc58d7fa700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc57c066f30 0x7fc57c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.089+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc588083b00 con 0x7fc598159ec0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.089+0000 7fc59d15f700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc57c066f30 0x7fc57c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.089+0000 7fc59d15f700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc57c066f30 0x7fc57c0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc594006fd0 tx=0x7fc594008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.093+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc588085e60 con 0x7fc598159ec0 2023-10-08T16:05:31.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.284+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc59804c3c0 con 0x7fc598159ec0 2023-10-08T16:05:31.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.284+0000 7fc58d7fa700 1 -- 172.21.15.60:0/331407916 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5880170a0 con 0x7fc598159ec0 2023-10-08T16:05:31.285 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc57c066f30 msgr2=0x7fc57c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc57c066f30 0x7fc57c0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc594006fd0 tx=0x7fc594008040 comp rx=0 tx=0).stop 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 msgr2=0x7fc5980b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 0x7fc5980b1e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c5b0 tx=0x7fc588001070 comp rx=0 tx=0).stop 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 shutdown_connections 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc57c066f30 0x7fc57c0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc59806acb0 0x7fc5980ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59815a290 0x7fc5981548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 --2- 172.21.15.60:0/331407916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc598159ec0 0x7fc5980b1e80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 >> 172.21.15.60:0/331407916 conn(0x7fc5980d1880 msgr2=0x7fc598156310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:31.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 shutdown_connections 2023-10-08T16:05:31.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.286+0000 7fc59f3c3700 1 -- 172.21.15.60:0/331407916 wait complete. 2023-10-08T16:05:31.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:31.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.417+0000 7f0fd804b700 1 Processor -- start 2023-10-08T16:05:31.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.418+0000 7f0fd804b700 1 -- start start 2023-10-08T16:05:31.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.418+0000 7f0fd804b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0fd00af1e0 0x7f0fd00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.418+0000 7f0fd804b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fd00af5b0 0x7f0fd00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd804b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fd00af5b0 0x7f0fd00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd804b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00b2890 con 0x7f0fd00af5b0 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd804b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00b1c80 con 0x7f0fd00af1e0 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd804b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00b1f60 con 0x7f0fd006f470 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fd00af5b0 0x7f0fd00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45044/0 (socket says 172.21.15.60:45044) 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 -- 172.21.15.60:0/2797451392 learned_addr learned my addr 172.21.15.60:0/2797451392 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd5de7700 1 --2- 172.21.15.60:0/2797451392 >> v2:172.21.15.144:3300/0 conn(0x7f0fd00af1e0 0x7f0fd00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd65e8700 1 --2- 172.21.15.60:0/2797451392 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd0159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 -- 172.21.15.60:0/2797451392 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 msgr2=0x7f0fd0159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 --2- 172.21.15.60:0/2797451392 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd0159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 -- 172.21.15.60:0/2797451392 >> v2:172.21.15.144:3300/0 conn(0x7f0fd00af1e0 msgr2=0x7f0fd00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 --2- 172.21.15.60:0/2797451392 >> v2:172.21.15.144:3300/0 conn(0x7f0fd00af1e0 0x7f0fd00b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 -- 172.21.15.60:0/2797451392 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00b2240 con 0x7f0fd00af5b0 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd5de7700 1 --2- 172.21.15.60:0/2797451392 >> v2:172.21.15.144:3300/0 conn(0x7f0fd00af1e0 0x7f0fd00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd55e6700 1 --2- 172.21.15.60:0/2797451392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd00b1680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00afca0 tx=0x7f0fc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf31caea5f5f210 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd4de5700 1 -- 172.21.15.60:0/2797451392 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400b860 con 0x7f0fd00af5b0 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd4de5700 1 -- 172.21.15.60:0/2797451392 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400b9c0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.419+0000 7f0fd4de5700 1 -- 172.21.15.60:0/2797451392 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400bd60 con 0x7f0fd00af5b0 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 -- 172.21.15.60:0/2797451392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 msgr2=0x7f0fd00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 --2- 172.21.15.60:0/2797451392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd00b1680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00afca0 tx=0x7f0fc4009250 comp rx=0 tx=0).stop 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 -- 172.21.15.60:0/2797451392 shutdown_connections 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 --2- 172.21.15.60:0/2797451392 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 --2- 172.21.15.60:0/2797451392 >> v2:172.21.15.144:3300/0 conn(0x7f0fd00af1e0 0x7f0fd00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 --2- 172.21.15.60:0/2797451392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd00b1680 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 -- 172.21.15.60:0/2797451392 >> 172.21.15.60:0/2797451392 conn(0x7f0fd00cd1e0 msgr2=0x7f0fd00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:31.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 -- 172.21.15.60:0/2797451392 shutdown_connections 2023-10-08T16:05:31.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.420+0000 7f0fd804b700 1 -- 172.21.15.60:0/2797451392 wait complete. 2023-10-08T16:05:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.421+0000 7f0fd804b700 1 Processor -- start 2023-10-08T16:05:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.421+0000 7f0fd804b700 1 -- start start 2023-10-08T16:05:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd804b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd015fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd804b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fd00af1e0 0x7f0fd0154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd804b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd804b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd015d2f0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd804b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd015c6e0 con 0x7f0fd00af1e0 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd804b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd015c9c0 con 0x7f0fd006f470 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd0154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45048/0 (socket says 172.21.15.60:45048) 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 -- 172.21.15.60:0/188692822 learned_addr learned my addr 172.21.15.60:0/188692822 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd55e6700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fd00af1e0 0x7f0fd0154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd5de7700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd015fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 -- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 msgr2=0x7f0fd015fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd015fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 -- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fd00af1e0 msgr2=0x7f0fd0154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fd00af1e0 0x7f0fd0154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.422+0000 7f0fd65e8700 1 -- 172.21.15.60:0/188692822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094f0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.423+0000 7f0fd65e8700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd0154980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009fa0 tx=0x7f0fc0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.423+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000ebc0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.423+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000ed20 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.423+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd015cca0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.423+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0014670 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.423+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd015d780 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.424+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd015d460 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.424+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fc00149e0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.424+0000 7f0fcdffb700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0fbc066f30 0x7f0fbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.425+0000 7f0fd5de7700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0fbc066f30 0x7f0fbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.425+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fc0084b90 con 0x7f0fd00af5b0 2023-10-08T16:05:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.425+0000 7f0fd5de7700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0fbc066f30 0x7f0fbc0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8006f00 tx=0x7f0fc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.429+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fc0051e00 con 0x7f0fd00af5b0 2023-10-08T16:05:31.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.622+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd004c3c0 con 0x7f0fd00af5b0 2023-10-08T16:05:31.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.622+0000 7f0fcdffb700 1 -- 172.21.15.60:0/188692822 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0fc0055420 con 0x7f0fd00af5b0 2023-10-08T16:05:31.623 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:31.623 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.624+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0fbc066f30 msgr2=0x7f0fbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.624+0000 7f0fd804b700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0fbc066f30 0x7f0fbc0693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8006f00 tx=0x7f0fc8008040 comp rx=0 tx=0).stop 2023-10-08T16:05:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.624+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 msgr2=0x7f0fd0154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.624+0000 7f0fd804b700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd0154980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009fa0 tx=0x7f0fc0009900 comp rx=0 tx=0).stop 2023-10-08T16:05:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 shutdown_connections 2023-10-08T16:05:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0fbc066f30 0x7f0fbc0693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fd006f470 0x7f0fd015fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fd00af5b0 0x7f0fd0154980 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 --2- 172.21.15.60:0/188692822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fd00af1e0 0x7f0fd0154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 >> 172.21.15.60:0/188692822 conn(0x7f0fd00cd1e0 msgr2=0x7f0fd0069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 shutdown_connections 2023-10-08T16:05:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.625+0000 7f0fd804b700 1 -- 172.21.15.60:0/188692822 wait complete. 2023-10-08T16:05:31.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:31.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:31.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.758+0000 7f186c99a700 1 Processor -- start 2023-10-08T16:05:31.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.758+0000 7f186c99a700 1 -- start start 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f186c99a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f186c99a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f186815a230 0x7f18680af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f186c99a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186815ea90 con 0x7f1868159e60 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f186c99a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680d1cf0 con 0x7f186815a230 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f186c99a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680b3100 con 0x7f18680697c0 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f1866d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f186815a230 0x7f18680af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f186815a230 0x7f18680af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45052/0 (socket says 172.21.15.60:45052) 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.759+0000 7f186659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1868159e60 0x7f18680690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50678/0 (socket says 172.21.15.60:50678) 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 -- 172.21.15.60:0/307877982 learned_addr learned my addr 172.21.15.60:0/307877982 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1865d9b700 1 --2- 172.21.15.60:0/307877982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 -- 172.21.15.60:0/307877982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 msgr2=0x7f186815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 --2- 172.21.15.60:0/307877982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 -- 172.21.15.60:0/307877982 >> v1:172.21.15.60:6789/0 conn(0x7f1868159e60 legacy=0x7f18680690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f186559a700 1 -- 172.21.15.60:0/307877982 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019691894 0 0) 0x7f186815ea90 con 0x7f1868159e60 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 -- 172.21.15.60:0/307877982 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680d10e0 con 0x7f186815a230 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f1866d9d700 1 --2- 172.21.15.60:0/307877982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186815a230 0x7f18680af730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1858009f20 tx=0x7f1858009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e0e34d7d53aa27 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f186559a700 1 -- 172.21.15.60:0/307877982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800e070 con 0x7f186815a230 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f186559a700 1 -- 172.21.15.60:0/307877982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800ba80 con 0x7f186815a230 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.760+0000 7f186559a700 1 -- 172.21.15.60:0/307877982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580092e0 con 0x7f186815a230 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 -- 172.21.15.60:0/307877982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186815a230 msgr2=0x7f18680af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 --2- 172.21.15.60:0/307877982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186815a230 0x7f18680af730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1858009f20 tx=0x7f1858009840 comp rx=0 tx=0).stop 2023-10-08T16:05:31.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 -- 172.21.15.60:0/307877982 shutdown_connections 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 --2- 172.21.15.60:0/307877982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186815a230 0x7f18680af730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 --2- 172.21.15.60:0/307877982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 -- 172.21.15.60:0/307877982 >> 172.21.15.60:0/307877982 conn(0x7f1868070700 msgr2=0x7f1868070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 -- 172.21.15.60:0/307877982 shutdown_connections 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.761+0000 7f186c99a700 1 -- 172.21.15.60:0/307877982 wait complete. 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.762+0000 7f186c99a700 1 Processor -- start 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.762+0000 7f186c99a700 1 -- start start 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 0x7f18680c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f186815a230 0x7f18680c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c8490 con 0x7f1868159e60 2023-10-08T16:05:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680ca2a0 con 0x7f186815a230 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186814e740 con 0x7f18680697c0 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 0x7f18680c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 0x7f18680c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45060/0 (socket says 172.21.15.60:45060) 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 -- 172.21.15.60:0/2212469339 learned_addr learned my addr 172.21.15.60:0/2212469339 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186659c700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 -- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 msgr2=0x7f186814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1866d9d700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f186815a230 0x7f18680c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186814e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 -- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f186815a230 msgr2=0x7f18680c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f186815a230 0x7f18680c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 -- 172.21.15.60:0/2212469339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009ae0 con 0x7f1868159e60 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1866d9d700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f186815a230 0x7f18680c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f1865d9b700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 0x7f18680c5fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f185000d860 tx=0x7f1850008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850009610 con 0x7f1868159e60 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1850009770 con 0x7f1868159e60 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186816b030 con 0x7f1868159e60 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.763+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850009b30 con 0x7f1868159e60 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.764+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18680c7e40 con 0x7f1868159e60 2023-10-08T16:05:31.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.764+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680c8600 con 0x7f1868159e60 2023-10-08T16:05:31.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.765+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f185001e460 con 0x7f1868159e60 2023-10-08T16:05:31.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.765+0000 7f185e7fc700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1848066f30 0x7f18480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:31.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.765+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1850084b50 con 0x7f1868159e60 2023-10-08T16:05:31.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.765+0000 7f186659c700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1848066f30 0x7f18480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:31.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.766+0000 7f186659c700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1848066f30 0x7f18480693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18680c9ee0 tx=0x7f1860007bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:31.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.770+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1850051dc0 con 0x7f1868159e60 2023-10-08T16:05:31.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.960+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f186804c3c0 con 0x7f1868159e60 2023-10-08T16:05:31.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.961+0000 7f185e7fc700 1 -- 172.21.15.60:0/2212469339 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18500553e0 con 0x7f1868159e60 2023-10-08T16:05:31.961 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1848066f30 msgr2=0x7f18480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1848066f30 0x7f18480693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18680c9ee0 tx=0x7f1860007bf0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 msgr2=0x7f18680c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 0x7f18680c5fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f185000d860 tx=0x7f1850008040 comp rx=0 tx=0).stop 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 shutdown_connections 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1848066f30 0x7f18480693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18680697c0 0x7f186814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f186815a230 0x7f18680c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 --2- 172.21.15.60:0/2212469339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1868159e60 0x7f18680c5fe0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 >> 172.21.15.60:0/2212469339 conn(0x7f1868070700 msgr2=0x7f1868159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 shutdown_connections 2023-10-08T16:05:31.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:31.963+0000 7f186c99a700 1 -- 172.21.15.60:0/2212469339 wait complete. 2023-10-08T16:05:31.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:32.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.096+0000 7f0124151700 1 Processor -- start 2023-10-08T16:05:32.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.097+0000 7f0124151700 1 -- start start 2023-10-08T16:05:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.097+0000 7f0124151700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f011c159e60 0x7f011c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.097+0000 7f0124151700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c15a230 0x7f011c0690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0124151700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011c15ea90 con 0x7f011c0695f0 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0124151700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011c0d1cf0 con 0x7f011c159e60 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0124151700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c069a70 con 0x7f011c15a230 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f011c159e60 0x7f011c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f011c159e60 0x7f011c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45070/0 (socket says 172.21.15.60:45070) 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 -- 172.21.15.60:0/488079139 learned_addr learned my addr 172.21.15.60:0/488079139 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f01216ec700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c15a230 0x7f011c0690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 -- 172.21.15.60:0/488079139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c15a230 msgr2=0x7f011c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c15a230 0x7f011c0690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 -- 172.21.15.60:0/488079139 >> v1:172.21.15.144:6789/0 conn(0x7f011c0695f0 legacy=0x7f011c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 -- 172.21.15.60:0/488079139 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0b3100 con 0x7f011c159e60 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f01216ec700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c15a230 0x7f011c0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0121eed700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c159e60 0x7f011c15e550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f01140099b0 tx=0x7f0114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3184a2532f92297 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0120eeb700 1 -- 172.21.15.60:0/488079139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011400b860 con 0x7f011c159e60 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0120eeb700 1 -- 172.21.15.60:0/488079139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011400b9c0 con 0x7f011c159e60 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.098+0000 7f0120eeb700 1 -- 172.21.15.60:0/488079139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011400bd60 con 0x7f011c159e60 2023-10-08T16:05:32.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 -- 172.21.15.60:0/488079139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c159e60 msgr2=0x7f011c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c159e60 0x7f011c15e550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f01140099b0 tx=0x7f0114009250 comp rx=0 tx=0).stop 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 -- 172.21.15.60:0/488079139 shutdown_connections 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c159e60 0x7f011c15e550 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 --2- 172.21.15.60:0/488079139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c15a230 0x7f011c0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 -- 172.21.15.60:0/488079139 >> 172.21.15.60:0/488079139 conn(0x7f011c070700 msgr2=0x7f011c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 -- 172.21.15.60:0/488079139 shutdown_connections 2023-10-08T16:05:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.099+0000 7f0124151700 1 -- 172.21.15.60:0/488079139 wait complete. 2023-10-08T16:05:32.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.100+0000 7f0124151700 1 Processor -- start 2023-10-08T16:05:32.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.100+0000 7f0124151700 1 -- start start 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0124151700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 0x7f011c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0124151700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c159e60 0x7f011c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0124151700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c15a230 0x7f011c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0124151700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c15bca0 con 0x7f011c0695f0 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0124151700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c0ca100 con 0x7f011c15a230 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0124151700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c0c94f0 con 0x7f011c159e60 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 0x7f011c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 0x7f011c0ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45078/0 (socket says 172.21.15.60:45078) 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 -- 172.21.15.60:0/3370601780 learned_addr learned my addr 172.21.15.60:0/3370601780 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f01226ee700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c15a230 0x7f011c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f01216ec700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c159e60 0x7f011c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 -- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c159e60 msgr2=0x7f011c15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c159e60 0x7f011c15b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 -- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c15a230 msgr2=0x7f011c157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c15a230 0x7f011c157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f0121eed700 1 -- 172.21.15.60:0/3370601780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140094f0 con 0x7f011c0695f0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.101+0000 7f01226ee700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c15a230 0x7f011c157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.102+0000 7f0121eed700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 0x7f011c0ca590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f01140090b0 tx=0x7f0114017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.102+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114026480 con 0x7f011c0695f0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.102+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011401f070 con 0x7f011c0695f0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.102+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c0c97d0 con 0x7f011c0695f0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.102+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114026870 con 0x7f011c0695f0 2023-10-08T16:05:32.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.102+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c0c9d90 con 0x7f011c0695f0 2023-10-08T16:05:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.103+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c04c3c0 con 0x7f011c0695f0 2023-10-08T16:05:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.103+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f011401a430 con 0x7f011c0695f0 2023-10-08T16:05:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.104+0000 7f0119ffb700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0108066f30 0x7f01080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.104+0000 7f01216ec700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0108066f30 0x7f01080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.104+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0114021070 con 0x7f011c0695f0 2023-10-08T16:05:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.104+0000 7f01216ec700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0108066f30 0x7f01080693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0110006f00 tx=0x7f0110008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.108+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01140537c0 con 0x7f011c0695f0 2023-10-08T16:05:32.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:32.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:32.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.298+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f011c0cb590 con 0x7f011c0695f0 2023-10-08T16:05:32.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.299+0000 7f0119ffb700 1 -- 172.21.15.60:0/3370601780 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0114056de0 con 0x7f011c0695f0 2023-10-08T16:05:32.299 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0108066f30 msgr2=0x7f01080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0108066f30 0x7f01080693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0110006f00 tx=0x7f0110008040 comp rx=0 tx=0).stop 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 msgr2=0x7f011c0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 0x7f011c0ca590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f01140090b0 tx=0x7f0114017000 comp rx=0 tx=0).stop 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 shutdown_connections 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0108066f30 0x7f01080693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c15a230 0x7f011c157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011c0695f0 0x7f011c0ca590 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 --2- 172.21.15.60:0/3370601780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f011c159e60 0x7f011c15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 >> 172.21.15.60:0/3370601780 conn(0x7f011c070700 msgr2=0x7f011c0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:32.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 shutdown_connections 2023-10-08T16:05:32.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.301+0000 7f0124151700 1 -- 172.21.15.60:0/3370601780 wait complete. 2023-10-08T16:05:32.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:32.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.476+0000 7f181b59e700 1 Processor -- start 2023-10-08T16:05:32.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.476+0000 7f181b59e700 1 -- start start 2023-10-08T16:05:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c0cce30 0x7f181c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c0b4d70 con 0x7f181c0b6580 2023-10-08T16:05:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181b59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c0cd8d0 con 0x7f181c06aa00 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0b4440 con 0x7f181c0cce30 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f1819d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f181c0b6580 0x7f181c06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41448/0 (socket says 172.21.15.60:41448) 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f1819d9b700 1 -- 172.21.15.60:0/4136587550 learned_addr learned my addr 172.21.15.60:0/4136587550 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181a59c700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c0cce30 0x7f181c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579880919 0 0) 0x7f181c0b4d70 con 0x7f181c0b6580 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1808003570 con 0x7f181c0b6580 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344520130 0 0) 0x7f181c0cd8d0 con 0x7f181c06aa00 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.477+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f181c0b4d70 con 0x7f181c06aa00 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562633488 0 0) 0x7f1808003570 con 0x7f181c0b6580 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c0cce30 msgr2=0x7f181c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c0cce30 0x7f181c15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 >> v1:172.21.15.144:6789/0 conn(0x7f181c06aa00 legacy=0x7f181c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c0b4720 con 0x7f181c0b6580 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f1804001470 con 0x7f181c0b6580 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 >> v1:172.21.15.60:6789/0 conn(0x7f181c0b6580 legacy=0x7f181c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1808003c20 0x7f1808004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1808004810 0x7f1808004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18080051c0 0x7f180800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0b4440 con 0x7f18080051c0 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180800c0b0 con 0x7f1808004810 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180800c270 con 0x7f1808003c20 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181a59c700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c0cce30 0x7f181c15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18080051c0 0x7f180800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f1819d9b700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1808004810 0x7f1808004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181a59c700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1808003c20 0x7f1808004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 -- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1808003c20 msgr2=0x7f1808004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1808003c20 0x7f1808004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 -- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1808004810 msgr2=0x7f1808004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1808004810 0x7f1808004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 -- 172.21.15.60:0/4136587550 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808003570 con 0x7f18080051c0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181a59c700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1808003c20 0x7f1808004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181ad9d700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18080051c0 0x7f180800ba60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f181c06ae00 tx=0x7f180c0017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e43222059f407a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c001ad0 con 0x7f18080051c0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c00c8b0 con 0x7f18080051c0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.478+0000 7f181959a700 1 -- 172.21.15.60:0/4136587550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00cc70 con 0x7f18080051c0 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181b59e700 1 -- 172.21.15.60:0/4136587550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18080051c0 msgr2=0x7f180800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181b59e700 1 --2- 172.21.15.60:0/4136587550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18080051c0 0x7f180800ba60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f181c06ae00 tx=0x7f180c0017c0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181ad9d700 1 -- 172.21.15.60:0/4136587550 reap_dead start 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181b59e700 1 -- 172.21.15.60:0/4136587550 shutdown_connections 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181b59e700 1 -- 172.21.15.60:0/4136587550 >> 172.21.15.60:0/4136587550 conn(0x7f181c068cb0 msgr2=0x7f181c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181b59e700 1 -- 172.21.15.60:0/4136587550 shutdown_connections 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.479+0000 7f181b59e700 1 -- 172.21.15.60:0/4136587550 wait complete. 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.480+0000 7f181b59e700 1 Processor -- start 2023-10-08T16:05:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.480+0000 7f181b59e700 1 -- start start 2023-10-08T16:05:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18080051c0 0x7f181c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c150030 0x7f181c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 0x7f181c16a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c16b420 con 0x7f181c152fc0 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181b59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1504a0 con 0x7f18080051c0 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c153440 con 0x7f181c150030 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 0x7f181c16a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 0x7f181c16a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49430/0 (socket says 172.21.15.60:49430) 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 -- 172.21.15.60:0/941562608 learned_addr learned my addr 172.21.15.60:0/941562608 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181a59c700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18080051c0 0x7f181c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f1819d9b700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c150030 0x7f181c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 -- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c150030 msgr2=0x7f181c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c150030 0x7f181c152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 -- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18080051c0 msgr2=0x7f181c155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18080051c0 0x7f181c155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 -- 172.21.15.60:0/941562608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c159260 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.481+0000 7f181ad9d700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 0x7f181c16a450 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f180800c080 tx=0x7f180c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.482+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c012910 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.482+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c012a90 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.482+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c16b140 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.482+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c012c40 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.482+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c154d10 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.483+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c154890 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.483+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f180c025020 con 0x7f181c152fc0 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.483+0000 7f18127fc700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f17fc066f30 0x7f17fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.484+0000 7f181a59c700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f17fc066f30 0x7f17fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.484+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f180c085d90 con 0x7f181c152fc0 2023-10-08T16:05:32.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.484+0000 7f181a59c700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f17fc066f30 0x7f17fc0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f18140093f0 tx=0x7f1814008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.488+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f181c154890 con 0x7f181c152fc0 2023-10-08T16:05:32.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.682+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f181c159260 con 0x7f181c152fc0 2023-10-08T16:05:32.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.682+0000 7f18127fc700 1 -- 172.21.15.60:0/941562608 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f181c159260 con 0x7f181c152fc0 2023-10-08T16:05:32.683 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.684+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f17fc066f30 msgr2=0x7f17fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.684+0000 7f181b59e700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f17fc066f30 0x7f17fc0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f18140093f0 tx=0x7f1814008040 comp rx=0 tx=0).stop 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.684+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 msgr2=0x7f181c16a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.684+0000 7f181b59e700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 0x7f181c16a450 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f180800c080 tx=0x7f180c016000 comp rx=0 tx=0).stop 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 shutdown_connections 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f17fc066f30 0x7f17fc0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f181c152fc0 0x7f181c16a450 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18080051c0 0x7f181c155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 --2- 172.21.15.60:0/941562608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f181c150030 0x7f181c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 >> 172.21.15.60:0/941562608 conn(0x7f181c068cb0 msgr2=0x7f181c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 shutdown_connections 2023-10-08T16:05:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.685+0000 7f181b59e700 1 -- 172.21.15.60:0/941562608 wait complete. 2023-10-08T16:05:32.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:32.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.816+0000 7f50ecca0700 1 Processor -- start 2023-10-08T16:05:32.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.816+0000 7f50ecca0700 1 -- start start 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.816+0000 7f50ecca0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50e81523e0 0x7f50e806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.816+0000 7f50ecca0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e806c010 con 0x7f50e8152010 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50ecca0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e806bd10 con 0x7f50e8158e50 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50ecca0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e815c060 con 0x7f50e81523e0 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f50e8152010 0x7f50e815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41454/0 (socket says 172.21.15.60:41454) 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50e81523e0 0x7f50e806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e659c700 1 -- 172.21.15.60:0/378868624 learned_addr learned my addr 172.21.15.60:0/378868624 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e5d9b700 1 -- 172.21.15.60:0/378868624 >> v1:172.21.15.144:6789/0 conn(0x7f50e8158e50 legacy=0x7f50e80cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e5d9b700 1 -- 172.21.15.60:0/378868624 >> v1:172.21.15.60:6789/0 conn(0x7f50e8152010 legacy=0x7f50e815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e559a700 1 -- 172.21.15.60:0/378868624 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859270726 0 0) 0x7f50e806c010 con 0x7f50e8152010 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e5d9b700 1 -- 172.21.15.60:0/378868624 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e815c340 con 0x7f50e81523e0 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e5d9b700 1 --2- 172.21.15.60:0/378868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e806c4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098e0 tx=0x7f50d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edce0fa32f9fbb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e559a700 1 -- 172.21.15.60:0/378868624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0009e80 con 0x7f50e81523e0 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e559a700 1 -- 172.21.15.60:0/378868624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d000b860 con 0x7f50e81523e0 2023-10-08T16:05:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.817+0000 7f50e559a700 1 -- 172.21.15.60:0/378868624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000bbe0 con 0x7f50e81523e0 2023-10-08T16:05:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 -- 172.21.15.60:0/378868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 msgr2=0x7f50e806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 --2- 172.21.15.60:0/378868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e806c4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098e0 tx=0x7f50d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 -- 172.21.15.60:0/378868624 shutdown_connections 2023-10-08T16:05:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 --2- 172.21.15.60:0/378868624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e806c4a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 -- 172.21.15.60:0/378868624 >> 172.21.15.60:0/378868624 conn(0x7f50e8069870 msgr2=0x7f50e8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 -- 172.21.15.60:0/378868624 shutdown_connections 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.818+0000 7f50ecca0700 1 -- 172.21.15.60:0/378868624 wait complete. 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.819+0000 7f50ecca0700 1 Processor -- start 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.819+0000 7f50ecca0700 1 -- start start 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50ecca0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50e8152010 0x7f50e815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50ecca0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e80afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50ecca0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e8158e50 0x7f50e80c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50ecca0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815a1a0 con 0x7f50e81523e0 2023-10-08T16:05:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50ecca0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8155590 con 0x7f50e8158e50 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50ecca0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8159620 con 0x7f50e8152010 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e80afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e80afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49442/0 (socket says 172.21.15.60:49442) 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 -- 172.21.15.60:0/4094523329 learned_addr learned my addr 172.21.15.60:0/4094523329 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e659c700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50e8152010 0x7f50e815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e6d9d700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e8158e50 0x7f50e80c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 -- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50e8152010 msgr2=0x7f50e815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50e8152010 0x7f50e815ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 -- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e8158e50 msgr2=0x7f50e80c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e8158e50 0x7f50e80c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.820+0000 7f50e5d9b700 1 -- 172.21.15.60:0/4094523329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009420 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.821+0000 7f50e5d9b700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e80afd40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f50e80c59e0 tx=0x7f50d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.821+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000bbe0 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.821+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0011420 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.821+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e8159900 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.821+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00117c0 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.821+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e8159ec0 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.822+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e804c3c0 con 0x7f50e81523e0 2023-10-08T16:05:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.822+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50d0011b30 con 0x7f50e81523e0 2023-10-08T16:05:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.822+0000 7f50de7fc700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.823+0000 7f50e659c700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.823+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d0085f80 con 0x7f50e81523e0 2023-10-08T16:05:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.823+0000 7f50e659c700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f50c8066f30 0x7f50c80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f50e0002250 tx=0x7f50e0001a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:32.827+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50d00b75a0 con 0x7f50e81523e0 2023-10-08T16:05:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.021+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50e8069650 con 0x7f50e81523e0 2023-10-08T16:05:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.021+0000 7f50de7fc700 1 -- 172.21.15.60:0/4094523329 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f50d0053270 con 0x7f50e81523e0 2023-10-08T16:05:33.022 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:33.022 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:33.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.023+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f50c8066f30 msgr2=0x7f50c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f50c8066f30 0x7f50c80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f50e0002250 tx=0x7f50e0001a00 comp rx=0 tx=0).stop 2023-10-08T16:05:33.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 msgr2=0x7f50e80afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e80afd40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f50e80c59e0 tx=0x7f50d0017000 comp rx=0 tx=0).stop 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 shutdown_connections 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50e8152010 0x7f50e815ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e8158e50 0x7f50e80c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 --2- 172.21.15.60:0/4094523329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e81523e0 0x7f50e80afd40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 >> 172.21.15.60:0/4094523329 conn(0x7f50e8069870 msgr2=0x7f50e80cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 shutdown_connections 2023-10-08T16:05:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.024+0000 7f50ecca0700 1 -- 172.21.15.60:0/4094523329 wait complete. 2023-10-08T16:05:33.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:33.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:33.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.158+0000 7f067a64f700 1 Processor -- start 2023-10-08T16:05:33.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.158+0000 7f067a64f700 1 -- start start 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f067a64f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0674159ec0 0x7f06740af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f067a64f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f067415a290 0x7f06740afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f067a64f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067406aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f067a64f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067406af60 con 0x7f067415a290 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f067a64f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06740b0790 con 0x7f0674159ec0 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f067a64f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06740ce1f0 con 0x7f067406a5a0 2023-10-08T16:05:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f06737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f067415a290 0x7f06740afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f06737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f067415a290 0x7f06740afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49450/0 (socket says 172.21.15.60:49450) 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f06737fe700 1 -- 172.21.15.60:0/935014038 learned_addr learned my addr 172.21.15.60:0/935014038 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f0678bec700 1 --2- 172.21.15.60:0/935014038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067406aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.159+0000 7f0673fff700 1 --2- 172.21.15.60:0/935014038 >> v2:172.21.15.144:3300/0 conn(0x7f0674159ec0 0x7f06740af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f06737fe700 1 -- 172.21.15.60:0/935014038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 msgr2=0x7f067406aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f06737fe700 1 --2- 172.21.15.60:0/935014038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067406aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f06737fe700 1 -- 172.21.15.60:0/935014038 >> v2:172.21.15.144:3300/0 conn(0x7f0674159ec0 msgr2=0x7f06740af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f06737fe700 1 --2- 172.21.15.60:0/935014038 >> v2:172.21.15.144:3300/0 conn(0x7f0674159ec0 0x7f06740af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f06737fe700 1 -- 172.21.15.60:0/935014038 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740b0b20 con 0x7f067415a290 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f06737fe700 1 --2- 172.21.15.60:0/935014038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067415a290 0x7f06740afe80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06740898e0 tx=0x7f0668009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32609f890191ef93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f0672ffd700 1 -- 172.21.15.60:0/935014038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800b640 con 0x7f067415a290 2023-10-08T16:05:33.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f0672ffd700 1 -- 172.21.15.60:0/935014038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800b7a0 con 0x7f067415a290 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f0672ffd700 1 -- 172.21.15.60:0/935014038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800bb60 con 0x7f067415a290 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f067a64f700 1 -- 172.21.15.60:0/935014038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067415a290 msgr2=0x7f06740afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.160+0000 7f067a64f700 1 --2- 172.21.15.60:0/935014038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067415a290 0x7f06740afe80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06740898e0 tx=0x7f0668009250 comp rx=0 tx=0).stop 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 -- 172.21.15.60:0/935014038 shutdown_connections 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 --2- 172.21.15.60:0/935014038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 --2- 172.21.15.60:0/935014038 >> v2:172.21.15.144:3300/0 conn(0x7f0674159ec0 0x7f06740af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 --2- 172.21.15.60:0/935014038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067415a290 0x7f06740afe80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 -- 172.21.15.60:0/935014038 >> 172.21.15.60:0/935014038 conn(0x7f06740d1880 msgr2=0x7f06740cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 -- 172.21.15.60:0/935014038 shutdown_connections 2023-10-08T16:05:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.161+0000 7f067a64f700 1 -- 172.21.15.60:0/935014038 wait complete. 2023-10-08T16:05:33.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.162+0000 7f067a64f700 1 Processor -- start 2023-10-08T16:05:33.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.162+0000 7f067a64f700 1 -- start start 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415a290 0x7f06741590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067416dc70 con 0x7f0674159ec0 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06740b3f60 con 0x7f067415a290 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06740b2d70 con 0x7f067406a5a0 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49452/0 (socket says 172.21.15.60:49452) 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 -- 172.21.15.60:0/4083059062 learned_addr learned my addr 172.21.15.60:0/4083059062 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f0673fff700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f0678bec700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415a290 0x7f06741590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 -- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 msgr2=0x7f067414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 -- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415a290 msgr2=0x7f06741590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415a290 0x7f06741590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 -- 172.21.15.60:0/4083059062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680094f0 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f06737fe700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674158ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0668006fd0 tx=0x7f0668017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800bb20 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668000c90 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06740b27b0 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.163+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066801a6a0 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.164+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06740b3bf0 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.164+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06740b40f0 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.165+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f066801aa50 con 0x7f0674159ec0 2023-10-08T16:05:33.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.165+0000 7f065bfff700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0660066f30 0x7f06600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.165+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0668085c90 con 0x7f0674159ec0 2023-10-08T16:05:33.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.165+0000 7f0673fff700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0660066f30 0x7f06600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.166+0000 7f0673fff700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0660066f30 0x7f06600693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06740cfe70 tx=0x7f06640091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.170+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0668052f80 con 0x7f0674159ec0 2023-10-08T16:05:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.363+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f067404c420 con 0x7f0674159ec0 2023-10-08T16:05:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.363+0000 7f065bfff700 1 -- 172.21.15.60:0/4083059062 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06680565a0 con 0x7f0674159ec0 2023-10-08T16:05:33.364 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:33.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0660066f30 msgr2=0x7f06600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0660066f30 0x7f06600693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06740cfe70 tx=0x7f06640091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 msgr2=0x7f0674158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674158ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0668006fd0 tx=0x7f0668017000 comp rx=0 tx=0).stop 2023-10-08T16:05:33.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 shutdown_connections 2023-10-08T16:05:33.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0660066f30 0x7f06600693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067406a5a0 0x7f067414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067415a290 0x7f06741590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 --2- 172.21.15.60:0/4083059062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674158ba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.365+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 >> 172.21.15.60:0/4083059062 conn(0x7f06740d1880 msgr2=0x7f0674157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.366+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 shutdown_connections 2023-10-08T16:05:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.366+0000 7f067a64f700 1 -- 172.21.15.60:0/4083059062 wait complete. 2023-10-08T16:05:33.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.500+0000 7f5e93194700 1 Processor -- start 2023-10-08T16:05:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.500+0000 7f5e93194700 1 -- start start 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e93194700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c0ca250 0x7f5e8c15b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e93194700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e8c15b9a0 0x7f5e8c0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e93194700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0c7710 con 0x7f5e8c06f060 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e93194700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c06fcb0 con 0x7f5e8c15b9a0 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e93194700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c79f0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e8c15b9a0 0x7f5e8c0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e91991700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c0ca250 0x7f5e8c15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e8c15b9a0 0x7f5e8c0c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:42468/0 (socket says 172.21.15.60:42468) 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 -- 172.21.15.60:0/1264082610 learned_addr learned my addr 172.21.15.60:0/1264082610 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92192700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5e8c06f060 0x7f5e8c15ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:40380/0 (socket says 172.21.15.60:40380) 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e91190700 1 -- 172.21.15.60:0/1264082610 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570336597 0 0) 0x7f5e8c0c7710 con 0x7f5e8c06f060 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e91190700 1 -- 172.21.15.60:0/1264082610 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e78003570 con 0x7f5e8c06f060 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 -- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c0ca250 msgr2=0x7f5e8c15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 --2- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c0ca250 0x7f5e8c15b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 -- 172.21.15.60:0/1264082610 >> v1:172.21.15.144:6789/0 conn(0x7f5e8c06f060 legacy=0x7f5e8c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e92993700 1 -- 172.21.15.60:0/1264082610 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0c7cd0 con 0x7f5e8c15b9a0 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.501+0000 7f5e91991700 1 --2- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c0ca250 0x7f5e8c15b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e92993700 1 --2- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c15b9a0 0x7f5e8c0c87b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009f20 tx=0x7f5e84009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db48f2f6b76e11d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e91190700 1 -- 172.21.15.60:0/1264082610 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400e070 con 0x7f5e8c15b9a0 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e91190700 1 -- 172.21.15.60:0/1264082610 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400b970 con 0x7f5e8c15b9a0 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e91190700 1 -- 172.21.15.60:0/1264082610 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840092e0 con 0x7f5e8c15b9a0 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 -- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c15b9a0 msgr2=0x7f5e8c0c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 --2- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c15b9a0 0x7f5e8c0c87b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009f20 tx=0x7f5e84009840 comp rx=0 tx=0).stop 2023-10-08T16:05:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 -- 172.21.15.60:0/1264082610 shutdown_connections 2023-10-08T16:05:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 --2- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c15b9a0 0x7f5e8c0c87b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 --2- 172.21.15.60:0/1264082610 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c0ca250 0x7f5e8c15b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 -- 172.21.15.60:0/1264082610 >> 172.21.15.60:0/1264082610 conn(0x7f5e8c0cdba0 msgr2=0x7f5e8c0c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 -- 172.21.15.60:0/1264082610 shutdown_connections 2023-10-08T16:05:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.502+0000 7f5e93194700 1 -- 172.21.15.60:0/1264082610 wait complete. 2023-10-08T16:05:33.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.503+0000 7f5e93194700 1 Processor -- start 2023-10-08T16:05:33.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 -- start start 2023-10-08T16:05:33.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c06f060 0x7f5e8c097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 0x7f5e8c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c15b9a0 0x7f5e8c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b04f0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c098330 con 0x7f5e8c06f060 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e93194700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c098610 con 0x7f5e8c15b9a0 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e91991700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 0x7f5e8c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e91991700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 0x7f5e8c0cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49460/0 (socket says 172.21.15.60:49460) 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.504+0000 7f5e91991700 1 -- 172.21.15.60:0/3852287358 learned_addr learned my addr 172.21.15.60:0/3852287358 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e92993700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c15b9a0 0x7f5e8c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e92192700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c06f060 0x7f5e8c097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e91991700 1 -- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c15b9a0 msgr2=0x7f5e8c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e91991700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c15b9a0 0x7f5e8c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e91991700 1 -- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c06f060 msgr2=0x7f5e8c097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e91991700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c06f060 0x7f5e8c097a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e91991700 1 -- 172.21.15.60:0/3852287358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c009420 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e91991700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 0x7f5e8c0cc250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00ec80 tx=0x7f5e7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00c9d0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00cb30 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84009ae0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00ceb0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.505+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c0b0790 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.506+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c06a060 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.507+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e7c013680 con 0x7f5e8c0ca250 2023-10-08T16:05:33.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.507+0000 7f5e827fc700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5e70066f30 0x7f5e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.507+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e7c084970 con 0x7f5e8c0ca250 2023-10-08T16:05:33.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.507+0000 7f5e92192700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5e70066f30 0x7f5e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.508+0000 7f5e92192700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5e70066f30 0x7f5e700693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e88005e50 tx=0x7f5e88007ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.512+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e7c051be0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.706+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e8c0c7fb0 con 0x7f5e8c0ca250 2023-10-08T16:05:33.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.706+0000 7f5e827fc700 1 -- 172.21.15.60:0/3852287358 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e7c055200 con 0x7f5e8c0ca250 2023-10-08T16:05:33.707 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5e70066f30 msgr2=0x7f5e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5e70066f30 0x7f5e700693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e88005e50 tx=0x7f5e88007ba0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 msgr2=0x7f5e8c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 0x7f5e8c0cc250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00ec80 tx=0x7f5e7c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 shutdown_connections 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5e70066f30 0x7f5e700693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e8c15b9a0 0x7f5e8c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e8c06f060 0x7f5e8c097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 --2- 172.21.15.60:0/3852287358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8c0ca250 0x7f5e8c0cc250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 >> 172.21.15.60:0/3852287358 conn(0x7f5e8c0cdba0 msgr2=0x7f5e8c069950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:33.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 shutdown_connections 2023-10-08T16:05:33.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.708+0000 7f5e93194700 1 -- 172.21.15.60:0/3852287358 wait complete. 2023-10-08T16:05:33.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:33.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.841+0000 7f494285a700 1 Processor -- start 2023-10-08T16:05:33.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.842+0000 7f494285a700 1 -- start start 2023-10-08T16:05:33.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.842+0000 7f494285a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f493c159ec0 0x7f493c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.842+0000 7f494285a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0b0790 con 0x7f493c15a290 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.842+0000 7f494285a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0ce1f0 con 0x7f493c06acb0 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.842+0000 7f494285a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0b0b20 con 0x7f493c159ec0 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f493c15a290 0x7f493c06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41466/0 (socket says 172.21.15.60:41466) 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493b7fe700 1 -- 172.21.15.60:0/4083431764 learned_addr learned my addr 172.21.15.60:0/4083431764 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493bfff700 1 --2- 172.21.15.60:0/4083431764 >> v2:172.21.15.144:3300/0 conn(0x7f493c159ec0 0x7f493c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035624559 0 0) 0x7f493c0b0790 con 0x7f493c15a290 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4924003570 con 0x7f493c15a290 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882403852 0 0) 0x7f493c0ce1f0 con 0x7f493c06acb0 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f493c0b0790 con 0x7f493c06acb0 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493bfff700 1 -- 172.21.15.60:0/4083431764 >> v1:172.21.15.144:6789/0 conn(0x7f493c06acb0 legacy=0x7f493c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493bfff700 1 -- 172.21.15.60:0/4083431764 >> v1:172.21.15.60:6789/0 conn(0x7f493c15a290 legacy=0x7f493c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325091613 0 0) 0x7f4924003570 con 0x7f493c15a290 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493bfff700 1 -- 172.21.15.60:0/4083431764 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0b04b0 con 0x7f493c159ec0 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493bfff700 1 --2- 172.21.15.60:0/4083431764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c159ec0 0x7f493c0af940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7a38f95a7c8589 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.843+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930001470 con 0x7f493c159ec0 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011420 con 0x7f493c159ec0 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f493affd700 1 -- 172.21.15.60:0/4083431764 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c0117c0 con 0x7f493c159ec0 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 -- 172.21.15.60:0/4083431764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c159ec0 msgr2=0x7f493c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 --2- 172.21.15.60:0/4083431764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c159ec0 0x7f493c0af940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 -- 172.21.15.60:0/4083431764 shutdown_connections 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 --2- 172.21.15.60:0/4083431764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c159ec0 0x7f493c0af940 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 -- 172.21.15.60:0/4083431764 >> 172.21.15.60:0/4083431764 conn(0x7f493c0d1880 msgr2=0x7f493c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 -- 172.21.15.60:0/4083431764 shutdown_connections 2023-10-08T16:05:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.844+0000 7f494285a700 1 -- 172.21.15.60:0/4083431764 wait complete. 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.845+0000 7f494285a700 1 Processor -- start 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.845+0000 7f494285a700 1 -- start start 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f494285a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c06acb0 0x7f493c140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f494285a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 0x7f493c0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f494285a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a290 0x7f493c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f494285a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c141440 con 0x7f493c159ec0 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f494285a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0cb5d0 con 0x7f493c15a290 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f494285a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0cb2f0 con 0x7f493c06acb0 2023-10-08T16:05:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f493b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 0x7f493c0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f493b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 0x7f493c0b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49468/0 (socket says 172.21.15.60:49468) 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f493b7fe700 1 -- 172.21.15.60:0/1452196293 learned_addr learned my addr 172.21.15.60:0/1452196293 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f493bfff700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c06acb0 0x7f493c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.846+0000 7f4940df7700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a290 0x7f493c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f493b7fe700 1 -- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c06acb0 msgr2=0x7f493c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f493b7fe700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c06acb0 0x7f493c140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f493b7fe700 1 -- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a290 msgr2=0x7f493c0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f493b7fe700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a290 0x7f493c0b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f493b7fe700 1 -- 172.21.15.60:0/1452196293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009420 con 0x7f493c159ec0 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f493b7fe700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 0x7f493c0b4b20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f493000cb70 tx=0x7f4930001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930007150 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49300072b0 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c1417e0 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930007670 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.847+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c141da0 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.848+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c141fc0 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.848+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4930004a40 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.849+0000 7f4923fff700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4928066f30 0x7f49280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.849+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4930083790 con 0x7f493c159ec0 2023-10-08T16:05:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.849+0000 7f493bfff700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4928066f30 0x7f49280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:33.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.849+0000 7f493bfff700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4928066f30 0x7f49280693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f492c0093f0 tx=0x7f492c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:33.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:33.853+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4930054490 con 0x7f493c159ec0 2023-10-08T16:05:34.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.045+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f493c04c3c0 con 0x7f493c159ec0 2023-10-08T16:05:34.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.046+0000 7f4923fff700 1 -- 172.21.15.60:0/1452196293 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49300180a0 con 0x7f493c159ec0 2023-10-08T16:05:34.046 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:34.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4928066f30 msgr2=0x7f49280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4928066f30 0x7f49280693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f492c0093f0 tx=0x7f492c016000 comp rx=0 tx=0).stop 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 msgr2=0x7f493c0b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 0x7f493c0b4b20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f493000cb70 tx=0x7f4930001ab0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 shutdown_connections 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4928066f30 0x7f49280693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c06acb0 0x7f493c140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a290 0x7f493c0b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 --2- 172.21.15.60:0/1452196293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c159ec0 0x7f493c0b4b20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 >> 172.21.15.60:0/1452196293 conn(0x7f493c0d1880 msgr2=0x7f493c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 shutdown_connections 2023-10-08T16:05:34.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.048+0000 7f494285a700 1 -- 172.21.15.60:0/1452196293 wait complete. 2023-10-08T16:05:34.069 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-08T16:05:34.069 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T16:05:34.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-08T16:05:34.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.187+0000 7f4636707700 1 Processor -- start 2023-10-08T16:05:34.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.187+0000 7f4636707700 1 -- start start 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f4636707700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46301523e0 0x7f463006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f4636707700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463006c010 con 0x7f4630158e50 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f4636707700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463006bd10 con 0x7f4630152010 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f4636707700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463015c060 con 0x7f46301523e0 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f462f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46301523e0 0x7f463006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f4634ca4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4630158e50 0x7f46300cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41480/0 (socket says 172.21.15.60:41480) 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.188+0000 7f4634ca4700 1 -- 172.21.15.60:0/472277844 learned_addr learned my addr 172.21.15.60:0/472277844 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462f7fe700 1 -- 172.21.15.60:0/472277844 >> v1:172.21.15.144:6789/0 conn(0x7f4630152010 legacy=0x7f463015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462f7fe700 1 -- 172.21.15.60:0/472277844 >> v1:172.21.15.60:6789/0 conn(0x7f4630158e50 legacy=0x7f46300cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462f7fe700 1 -- 172.21.15.60:0/472277844 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463015c340 con 0x7f46301523e0 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462f7fe700 1 --2- 172.21.15.60:0/472277844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46301523e0 0x7f463006c4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f46180098e0 tx=0x7f46180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcd78e0024260a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462effd700 1 -- 172.21.15.60:0/472277844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618009e80 con 0x7f46301523e0 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462effd700 1 -- 172.21.15.60:0/472277844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461800b860 con 0x7f46301523e0 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.189+0000 7f462effd700 1 -- 172.21.15.60:0/472277844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461800bbe0 con 0x7f46301523e0 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 -- 172.21.15.60:0/472277844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46301523e0 msgr2=0x7f463006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 --2- 172.21.15.60:0/472277844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46301523e0 0x7f463006c4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f46180098e0 tx=0x7f46180091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 -- 172.21.15.60:0/472277844 shutdown_connections 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 --2- 172.21.15.60:0/472277844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46301523e0 0x7f463006c4a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 -- 172.21.15.60:0/472277844 >> 172.21.15.60:0/472277844 conn(0x7f4630069870 msgr2=0x7f4630069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 -- 172.21.15.60:0/472277844 shutdown_connections 2023-10-08T16:05:34.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.190+0000 7f4636707700 1 -- 172.21.15.60:0/472277844 wait complete. 2023-10-08T16:05:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.191+0000 7f4636707700 1 Processor -- start 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.191+0000 7f4636707700 1 -- start start 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4636707700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 0x7f463015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4636707700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46301523e0 0x7f463015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4636707700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4630158e50 0x7f46300b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4636707700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300687f0 con 0x7f4630152010 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4636707700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c8e20 con 0x7f4630158e50 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4636707700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c8b40 con 0x7f46301523e0 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 0x7f463015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 0x7f463015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49484/0 (socket says 172.21.15.60:49484) 2023-10-08T16:05:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 -- 172.21.15.60:0/3705676991 learned_addr learned my addr 172.21.15.60:0/3705676991 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4634ca4700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4630158e50 0x7f46300b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462f7fe700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46301523e0 0x7f463015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 -- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46301523e0 msgr2=0x7f463015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46301523e0 0x7f463015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 -- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4630158e50 msgr2=0x7f46300b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4630158e50 0x7f46300b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 -- 172.21.15.60:0/3705676991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4618009420 con 0x7f4630152010 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f462ffff700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 0x7f463015a210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f462000c590 tx=0x7f462000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620011590 con 0x7f4630152010 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.192+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620011710 con 0x7f4630152010 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.193+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46300681a0 con 0x7f4630152010 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.193+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620011ad0 con 0x7f4630152010 2023-10-08T16:05:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.193+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46300c8760 con 0x7f4630152010 2023-10-08T16:05:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.193+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463004c3c0 con 0x7f4630152010 2023-10-08T16:05:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.194+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f462001b3b0 con 0x7f4630152010 2023-10-08T16:05:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.194+0000 7f4627fff700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4610066f30 0x7f46100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.194+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46200839c0 con 0x7f4630152010 2023-10-08T16:05:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.194+0000 7f462f7fe700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4610066f30 0x7f46100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.195+0000 7f462f7fe700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4610066f30 0x7f46100693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46180093f0 tx=0x7f4618017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.199+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4620050c30 con 0x7f4630152010 2023-10-08T16:05:34.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:34.472+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f4630157990 con 0x7f4630152010 2023-10-08T16:05:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.320+0000 7f4627fff700 1 -- 172.21.15.60:0/3705676991 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4620017070 con 0x7f4630152010 2023-10-08T16:05:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4610066f30 msgr2=0x7f46100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4610066f30 0x7f46100693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46180093f0 tx=0x7f4618017000 comp rx=0 tx=0).stop 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 msgr2=0x7f463015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 0x7f463015a210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f462000c590 tx=0x7f462000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 shutdown_connections 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4610066f30 0x7f46100693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4630158e50 0x7f46300b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4630152010 0x7f463015a210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 --2- 172.21.15.60:0/3705676991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46301523e0 0x7f463015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 >> 172.21.15.60:0/3705676991 conn(0x7f4630069870 msgr2=0x7f46301505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 shutdown_connections 2023-10-08T16:05:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.322+0000 7f4636707700 1 -- 172.21.15.60:0/3705676991 wait complete. 2023-10-08T16:05:35.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T16:05:35.473 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_objectstore":"memstore"} 2023-10-08T16:05:35.473 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T16:05:35.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:05:35.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.596+0000 7f59f7a12700 1 Processor -- start 2023-10-08T16:05:35.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.596+0000 7f59f7a12700 1 -- start start 2023-10-08T16:05:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f7a12700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 0x7f59f00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f7a12700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00b14f0 con 0x7f59f00b4c30 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f7a12700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00b17d0 con 0x7f59f00b3570 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f7a12700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00b1ab0 con 0x7f59f00b4860 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f4fad700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f59f00b4c30 0x7f59f0159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41494/0 (socket says 172.21.15.60:41494) 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f4fad700 1 -- 172.21.15.60:0/91586770 learned_addr learned my addr 172.21.15.60:0/91586770 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709403061 0 0) 0x7f59f00b14f0 con 0x7f59f00b4c30 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59f57ae700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 0x7f59f00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003570 con 0x7f59f00b4c30 2023-10-08T16:05:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1436413533 0 0) 0x7f59d8003570 con 0x7f59f00b4c30 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 msgr2=0x7f59f00b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 0x7f59f00b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 >> v1:172.21.15.144:6789/0 conn(0x7f59f00b3570 legacy=0x7f59f00cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00b1d90 con 0x7f59f00b4c30 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f59e4001470 con 0x7f59f00b4c30 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.597+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 >> v1:172.21.15.60:6789/0 conn(0x7f59f00b4c30 legacy=0x7f59f0159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 0x7f59d8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d8004010 0x7f59d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00b1ab0 con 0x7f59d8004d50 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d800bbf0 con 0x7f59d8004010 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d800bdb0 con 0x7f59f00b4860 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f4fad700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d8004010 0x7f59d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f57ae700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 0x7f59d8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 -- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 msgr2=0x7f59d8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f00b4860 0x7f59d8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 -- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d8004010 msgr2=0x7f59d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d8004010 0x7f59d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 -- 172.21.15.60:0/91586770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8003570 con 0x7f59d8004d50 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59f5faf700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59d80051c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f59f008b610 tx=0x7f59e0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c991acfdd04b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0001950 con 0x7f59d8004d50 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0004030 con 0x7f59d8004d50 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.598+0000 7f59effff700 1 -- 172.21.15.60:0/91586770 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000cb00 con 0x7f59d8004d50 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f7a12700 1 -- 172.21.15.60:0/91586770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 msgr2=0x7f59d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f7a12700 1 --2- 172.21.15.60:0/91586770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59d80051c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f59f008b610 tx=0x7f59e0001640 comp rx=0 tx=0).stop 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f5faf700 1 -- 172.21.15.60:0/91586770 reap_dead start 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f7a12700 1 -- 172.21.15.60:0/91586770 shutdown_connections 2023-10-08T16:05:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f7a12700 1 -- 172.21.15.60:0/91586770 >> 172.21.15.60:0/91586770 conn(0x7f59f009a0f0 msgr2=0x7f59f0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f7a12700 1 -- 172.21.15.60:0/91586770 shutdown_connections 2023-10-08T16:05:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.599+0000 7f59f7a12700 1 -- 172.21.15.60:0/91586770 wait complete. 2023-10-08T16:05:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.600+0000 7f59f7a12700 1 Processor -- start 2023-10-08T16:05:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.600+0000 7f59f7a12700 1 -- start start 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f7a12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59f015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f7a12700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f015d8b0 0x7f59f00acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f7a12700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f01597a0 0x7f59f00ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f7a12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f015e930 con 0x7f59d8004d50 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f7a12700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f015dd20 con 0x7f59f01597a0 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f7a12700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f015e000 con 0x7f59f015d8b0 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59f015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59f015edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49506/0 (socket says 172.21.15.60:49506) 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 -- 172.21.15.60:0/2215737596 learned_addr learned my addr 172.21.15.60:0/2215737596 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f5faf700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f01597a0 0x7f59f00ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f4fad700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f015d8b0 0x7f59f00acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 -- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f015d8b0 msgr2=0x7f59f00acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f015d8b0 0x7f59f00acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 -- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f01597a0 msgr2=0x7f59f00ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f01597a0 0x7f59f00ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 -- 172.21.15.60:0/2215737596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f015e2e0 con 0x7f59d8004d50 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f4fad700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f015d8b0 0x7f59f00acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.601+0000 7f59f57ae700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59f015edc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59e8011b10 tx=0x7f59e8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.602+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8005c10 con 0x7f59d8004d50 2023-10-08T16:05:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.602+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8005d70 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.602+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800f960 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.602+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f015e5c0 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.602+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f0159c10 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.603+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f015f300 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.603+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59e800fd50 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.603+0000 7f59ed7fa700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.603+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59e8084f50 con 0x7f59d8004d50 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.603+0000 7f59f4fad700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.604+0000 7f59f4fad700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59dc066f30 0x7f59dc0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59e4001200 tx=0x7f59e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.608+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59e8052120 con 0x7f59d8004d50 2023-10-08T16:05:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.798+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f59f015ec10 con 0x7f59d8004d50 2023-10-08T16:05:35.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.802+0000 7f59ed7fa700 1 -- 172.21.15.60:0/2215737596 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59e80210c0 con 0x7f59d8004d50 2023-10-08T16:05:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59dc066f30 msgr2=0x7f59dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59dc066f30 0x7f59dc0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59e4001200 tx=0x7f59e4009040 comp rx=0 tx=0).stop 2023-10-08T16:05:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 msgr2=0x7f59f015edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59f015edc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59e8011b10 tx=0x7f59e8009120 comp rx=0 tx=0).stop 2023-10-08T16:05:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 shutdown_connections 2023-10-08T16:05:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f01597a0 0x7f59f00ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d8004d50 0x7f59f015edc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 --2- 172.21.15.60:0/2215737596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59f015d8b0 0x7f59f00acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:35.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 >> 172.21.15.60:0/2215737596 conn(0x7f59f009a0f0 msgr2=0x7f59f0068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:35.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 shutdown_connections 2023-10-08T16:05:35.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:35.804+0000 7f59f7a12700 1 -- 172.21.15.60:0/2215737596 wait complete. 2023-10-08T16:05:35.816 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:05:35.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:05:35.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:05:35.901 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:05:35.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:05:35.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:05:35.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-08T16:05:35.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:05:35.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:35.936 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:05:35.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:05:35.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:05:35.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-08T16:05:36.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:05:36.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:36.034 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:05:36.090 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-08T16:05:36.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:05:36.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-08T16:05:36.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:05:36.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:36.127 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T16:05:36.183 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-08T16:05:36.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:05:36.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-08T16:05:36.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:05:36.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:05:36.222 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T16:05:36.278 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:05:36.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:36.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.397+0000 7efc3d88f700 1 Processor -- start 2023-10-08T16:05:36.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.397+0000 7efc3d88f700 1 -- start start 2023-10-08T16:05:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3d88f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 0x7efc3815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3d88f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3815dda0 0x7efc3815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3d88f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc380cb7c0 con 0x7efc380cd6e0 2023-10-08T16:05:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3d88f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3815e850 con 0x7efc3815dda0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3d88f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc380cc360 con 0x7efc380cdab0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3c88d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efc380cd6e0 0x7efc380cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41510/0 (socket says 172.21.15.60:41510) 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3c88d700 1 -- 172.21.15.60:0/2686632991 learned_addr learned my addr 172.21.15.60:0/2686632991 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc3d08e700 1 --2- 172.21.15.60:0/2686632991 >> v2:172.21.15.144:3300/0 conn(0x7efc3815dda0 0x7efc3815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc37fff700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 0x7efc3815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594073408 0 0) 0x7efc380cb7c0 con 0x7efc380cd6e0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.398+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc20003570 con 0x7efc380cd6e0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805944079 0 0) 0x7efc20003570 con 0x7efc380cd6e0 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 msgr2=0x7efc3815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 0x7efc3815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 >> v2:172.21.15.144:3300/0 conn(0x7efc3815dda0 msgr2=0x7efc3815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 --2- 172.21.15.60:0/2686632991 >> v2:172.21.15.144:3300/0 conn(0x7efc3815dda0 0x7efc3815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3815e290 con 0x7efc380cd6e0 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7efc300017f0 con 0x7efc380cd6e0 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 >> v1:172.21.15.60:6789/0 conn(0x7efc380cd6e0 legacy=0x7efc380cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 0x7efc20003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc20004d50 0x7efc200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3815e850 con 0x7efc20003fe0 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc380cc360 con 0x7efc20004d50 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000ba90 con 0x7efc380cdab0 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc3d08e700 1 --2- 172.21.15.60:0/2686632991 >> v2:172.21.15.144:3300/0 conn(0x7efc3815dda0 0x7efc3815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc3c88d700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 0x7efc20003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc3d08e700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc20004d50 0x7efc200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 -- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 msgr2=0x7efc20003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc380cdab0 0x7efc20003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 -- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc20004d50 msgr2=0x7efc200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc20004d50 0x7efc200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 -- 172.21.15.60:0/2686632991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20003570 con 0x7efc20003fe0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc3d08e700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc20004d50 0x7efc200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc37fff700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc20004810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009c00 tx=0x7efc2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e52c60e1f52550 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00e6b0 con 0x7efc20003fe0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00e810 con 0x7efc20003fe0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.399+0000 7efc377fe700 1 -- 172.21.15.60:0/2686632991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00ebd0 con 0x7efc20003fe0 2023-10-08T16:05:36.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d88f700 1 -- 172.21.15.60:0/2686632991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 msgr2=0x7efc20004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d88f700 1 --2- 172.21.15.60:0/2686632991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc20004810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009c00 tx=0x7efc2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d08e700 1 -- 172.21.15.60:0/2686632991 reap_dead start 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d88f700 1 -- 172.21.15.60:0/2686632991 shutdown_connections 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d88f700 1 -- 172.21.15.60:0/2686632991 >> 172.21.15.60:0/2686632991 conn(0x7efc38067660 msgr2=0x7efc38067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d88f700 1 -- 172.21.15.60:0/2686632991 shutdown_connections 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.400+0000 7efc3d88f700 1 -- 172.21.15.60:0/2686632991 wait complete. 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.401+0000 7efc3d88f700 1 Processor -- start 2023-10-08T16:05:36.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.401+0000 7efc3d88f700 1 -- start start 2023-10-08T16:05:36.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d88f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc380b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d88f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc38156000 0x7efc3815b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d88f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc38159180 0x7efc380c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d88f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc38158cf0 con 0x7efc20003fe0 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d88f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3815bea0 con 0x7efc38156000 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d88f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3815c160 con 0x7efc38159180 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc380b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc380b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49516/0 (socket says 172.21.15.60:49516) 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 -- 172.21.15.60:0/966971030 learned_addr learned my addr 172.21.15.60:0/966971030 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3d08e700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc38159180 0x7efc380c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc37fff700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc38156000 0x7efc3815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 -- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc38159180 msgr2=0x7efc380c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc38159180 0x7efc380c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 -- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc38156000 msgr2=0x7efc3815b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc38156000 0x7efc3815b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.402+0000 7efc3c88d700 1 -- 172.21.15.60:0/966971030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3815c440 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.403+0000 7efc3c88d700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc380b5910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc30002100 tx=0x7efc380ccaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.403+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000acd0 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.403+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3000ae70 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.403+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc38158980 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.403+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30013620 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.403+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc381595f0 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.404+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc381587e0 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.404+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc30013990 con 0x7efc20003fe0 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.405+0000 7efc34ff9700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.405+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc300852f0 con 0x7efc20003fe0 2023-10-08T16:05:36.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.405+0000 7efc37fff700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.405+0000 7efc37fff700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0091e0 tx=0x7efc2c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:36.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.409+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc381587e0 con 0x7efc20003fe0 2023-10-08T16:05:36.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.647+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc381587e0 con 0x7efc20003fe0 2023-10-08T16:05:36.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.647+0000 7efc34ff9700 1 -- 172.21.15.60:0/966971030 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7efc381587e0 con 0x7efc20003fe0 2023-10-08T16:05:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:36.648 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:36.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 msgr2=0x7efc240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0091e0 tx=0x7efc2c01a000 comp rx=0 tx=0).stop 2023-10-08T16:05:36.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 msgr2=0x7efc380b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc380b5910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc30002100 tx=0x7efc380ccaf0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 shutdown_connections 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc38159180 0x7efc380c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc20003fe0 0x7efc380b5910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 --2- 172.21.15.60:0/966971030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc38156000 0x7efc3815b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 >> 172.21.15.60:0/966971030 conn(0x7efc38067660 msgr2=0x7efc3815c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 shutdown_connections 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.650+0000 7efc3d88f700 1 -- 172.21.15.60:0/966971030 wait complete. 2023-10-08T16:05:36.651 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:36.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:36.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.780+0000 7ff44ecc1700 1 Processor -- start 2023-10-08T16:05:36.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.780+0000 7ff44ecc1700 1 -- start start 2023-10-08T16:05:36.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ecc1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff4480af1e0 0x7ff4480b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ecc1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480b1680 0x7ff448159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ecc1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4480b2890 con 0x7ff4480af5b0 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ecc1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480b1c80 con 0x7ff4480af1e0 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ecc1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480b1f60 con 0x7ff4480b1680 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ca5d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff4480af1e0 0x7ff4480b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ca5d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff4480af1e0 0x7ff4480b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49526/0 (socket says 172.21.15.60:49526) 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.781+0000 7ff44ca5d700 1 -- 172.21.15.60:0/2674499776 learned_addr learned my addr 172.21.15.60:0/2674499776 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44d25e700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480b1680 0x7ff448159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44ca5d700 1 -- 172.21.15.60:0/2674499776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480b1680 msgr2=0x7ff448159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44ca5d700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480b1680 0x7ff448159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44ca5d700 1 -- 172.21.15.60:0/2674499776 >> v1:172.21.15.144:6789/0 conn(0x7ff4480af5b0 legacy=0x7ff44806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44ca5d700 1 -- 172.21.15.60:0/2674499776 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480b2240 con 0x7ff4480af1e0 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44d25e700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480b1680 0x7ff448159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff44ca5d700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff4480b2d20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff440009f20 tx=0x7ff440009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a763781d493a4845 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:36.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff4477fe700 1 -- 172.21.15.60:0/2674499776 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000e070 con 0x7ff4480af1e0 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff4477fe700 1 -- 172.21.15.60:0/2674499776 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000ba40 con 0x7ff4480af1e0 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.782+0000 7ff4477fe700 1 -- 172.21.15.60:0/2674499776 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400092e0 con 0x7ff4480af1e0 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 -- 172.21.15.60:0/2674499776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 msgr2=0x7ff4480b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff4480b2d20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff440009f20 tx=0x7ff440009840 comp rx=0 tx=0).stop 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 -- 172.21.15.60:0/2674499776 shutdown_connections 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480b1680 0x7ff448159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/2674499776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff4480b2d20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 -- 172.21.15.60:0/2674499776 >> 172.21.15.60:0/2674499776 conn(0x7ff4480cd1e0 msgr2=0x7ff4480cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 -- 172.21.15.60:0/2674499776 shutdown_connections 2023-10-08T16:05:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.783+0000 7ff44ecc1700 1 -- 172.21.15.60:0/2674499776 wait complete. 2023-10-08T16:05:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.784+0000 7ff44ecc1700 1 Processor -- start 2023-10-08T16:05:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.784+0000 7ff44ecc1700 1 -- start start 2023-10-08T16:05:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff44806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480af5b0 0x7ff44816a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4480b1680 0x7ff44816ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44816b890 con 0x7ff4480af1e0 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44816be50 con 0x7ff4480b1680 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44816b230 con 0x7ff4480af5b0 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff44806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff44806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49540/0 (socket says 172.21.15.60:49540) 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 -- 172.21.15.60:0/953082346 learned_addr learned my addr 172.21.15.60:0/953082346 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44d25e700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4480b1680 0x7ff44816ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff447fff700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480af5b0 0x7ff44816a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 -- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480af5b0 msgr2=0x7ff44816a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480af5b0 0x7ff44816a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 -- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4480b1680 msgr2=0x7ff44816ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4480b1680 0x7ff44816ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 -- 172.21.15.60:0/953082346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009ae0 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44d25e700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4480b1680 0x7ff44816ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ca5d700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff44806f080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b6c0 tx=0x7ff440017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440012aa0 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440012c20 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44816b510 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44001d420 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.785+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44809a5d0 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.786+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44804c3c0 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.787+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff44001d830 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.787+0000 7ff444ff9700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff428066f30 0x7ff4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.787+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff440085cc0 con 0x7ff4480af1e0 2023-10-08T16:05:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.787+0000 7ff447fff700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff428066f30 0x7ff4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:36.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.788+0000 7ff447fff700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff428066f30 0x7ff4280693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff44816dc20 tx=0x7ff430009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:36.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.791+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff440052f30 con 0x7ff4480af1e0 2023-10-08T16:05:36.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.985+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4481576d0 con 0x7ff4480af1e0 2023-10-08T16:05:36.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.986+0000 7ff444ff9700 1 -- 172.21.15.60:0/953082346 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff440056550 con 0x7ff4480af1e0 2023-10-08T16:05:36.987 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:36.987 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:36.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.988+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff428066f30 msgr2=0x7ff4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.988+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff428066f30 0x7ff4280693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff44816dc20 tx=0x7ff430009040 comp rx=0 tx=0).stop 2023-10-08T16:05:36.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.988+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 msgr2=0x7ff44806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:36.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.988+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff44806f080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b6c0 tx=0x7ff440017000 comp rx=0 tx=0).stop 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.988+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 shutdown_connections 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff428066f30 0x7ff4280693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4480b1680 0x7ff44816ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4480af1e0 0x7ff44806f080 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 --2- 172.21.15.60:0/953082346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4480af5b0 0x7ff44816a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 >> 172.21.15.60:0/953082346 conn(0x7ff4480cd1e0 msgr2=0x7ff44806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 shutdown_connections 2023-10-08T16:05:36.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:36.989+0000 7ff44ecc1700 1 -- 172.21.15.60:0/953082346 wait complete. 2023-10-08T16:05:37.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:59.230242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:59.862234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:05:37.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:37.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.122+0000 7efcc67a9700 1 Processor -- start 2023-10-08T16:05:37.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.122+0000 7efcc67a9700 1 -- start start 2023-10-08T16:05:37.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.123+0000 7efcc67a9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcc0156c40 0x7efcc015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.123+0000 7efcc67a9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc0157010 con 0x7efcc00cb670 2023-10-08T16:05:37.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.123+0000 7efcc67a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00c9410 con 0x7efcc00cc160 2023-10-08T16:05:37.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.123+0000 7efcc67a9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc00cbdf0 con 0x7efcc0156c40 2023-10-08T16:05:37.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.123+0000 7efcbf7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efcc00cb670 0x7efcc00c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41526/0 (socket says 172.21.15.60:41526) 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.123+0000 7efcbf7fe700 1 -- 172.21.15.60:0/414529996 learned_addr learned my addr 172.21.15.60:0/414529996 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbffff700 1 --2- 172.21.15.60:0/414529996 >> v2:172.21.15.144:3300/0 conn(0x7efcc0156c40 0x7efcc015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491154462 0 0) 0x7efcc0157010 con 0x7efcc00cb670 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca8003570 con 0x7efcc00cb670 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2419245494 0 0) 0x7efca8003570 con 0x7efcc00cb670 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 >> v2:172.21.15.144:3300/0 conn(0x7efcc0156c40 msgr2=0x7efcc015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 --2- 172.21.15.60:0/414529996 >> v2:172.21.15.144:3300/0 conn(0x7efcc0156c40 0x7efcc015b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 >> v1:172.21.15.144:6789/0 conn(0x7efcc00cc160 legacy=0x7efcc006e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00c8840 con 0x7efcc00cb670 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7efcb4001470 con 0x7efcc00cb670 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 >> v1:172.21.15.60:6789/0 conn(0x7efcc00cb670 legacy=0x7efcc00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8003a60 0x7efca8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8004810 0x7efca8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efca80051c0 0x7efca800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca800c0a0 con 0x7efca8003a60 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca800c210 con 0x7efca8004810 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca800e5e0 con 0x7efca80051c0 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbffff700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8003a60 0x7efca8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcbf7fe700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8004810 0x7efca8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.124+0000 7efcc4d46700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efca80051c0 0x7efca800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbffff700 1 -- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efca80051c0 msgr2=0x7efca800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbffff700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efca80051c0 0x7efca800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbffff700 1 -- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8004810 msgr2=0x7efca8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:37.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbffff700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8004810 0x7efca8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbffff700 1 -- 172.21.15.60:0/414529996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8003570 con 0x7efca8003a60 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc4d46700 1 -- 172.21.15.60:0/414529996 reap_dead start 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbffff700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8003a60 0x7efca8003e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009c00 tx=0x7efcb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384d453550c11f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000e710 con 0x7efca8003a60 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb000e870 con 0x7efca8003a60 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcbeffd700 1 -- 172.21.15.60:0/414529996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000ec30 con 0x7efca8003a60 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 -- 172.21.15.60:0/414529996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8003a60 msgr2=0x7efca8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8003a60 0x7efca8003e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009c00 tx=0x7efcb00091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 -- 172.21.15.60:0/414529996 shutdown_connections 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 --2- 172.21.15.60:0/414529996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca8003a60 0x7efca8003e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 -- 172.21.15.60:0/414529996 >> 172.21.15.60:0/414529996 conn(0x7efcc00ce570 msgr2=0x7efcc00ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 -- 172.21.15.60:0/414529996 shutdown_connections 2023-10-08T16:05:37.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.125+0000 7efcc67a9700 1 -- 172.21.15.60:0/414529996 wait complete. 2023-10-08T16:05:37.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.127+0000 7efcc67a9700 1 Processor -- start 2023-10-08T16:05:37.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.127+0000 7efcc67a9700 1 -- start start 2023-10-08T16:05:37.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.127+0000 7efcc67a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8003a60 0x7efcc0159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.127+0000 7efcc67a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 0x7efcc00c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc67a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc00c4b50 0x7efcc00c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc67a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00c7760 con 0x7efcc00c6db0 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc67a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00c6420 con 0x7efca8003a60 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc67a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0159770 con 0x7efcc00c4b50 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 0x7efcc00c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 0x7efcc00c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49560/0 (socket says 172.21.15.60:49560) 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 -- 172.21.15.60:0/2977782294 learned_addr learned my addr 172.21.15.60:0/2977782294 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbffff700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8003a60 0x7efcc0159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc4d46700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc00c4b50 0x7efcc00c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 -- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc00c4b50 msgr2=0x7efcc00c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc00c4b50 0x7efcc00c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 -- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8003a60 msgr2=0x7efcc0159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8003a60 0x7efcc0159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 -- 172.21.15.60:0/2977782294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00c5810 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc4d46700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc00c4b50 0x7efcc00c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbffff700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8003a60 0x7efcc0159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcbf7fe700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 0x7efcc00c7220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efcb4007390 tx=0x7efcc00c89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400f870 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400fa10 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400fdd0 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc00c5af0 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.128+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc00c60b0 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.129+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc004c3c0 con 0x7efcc00c6db0 2023-10-08T16:05:37.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.130+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcb4013600 con 0x7efcc00c6db0 2023-10-08T16:05:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.130+0000 7efca7fff700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.130+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcb40846b0 con 0x7efcc00c6db0 2023-10-08T16:05:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.130+0000 7efcbffff700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.130+0000 7efcbffff700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efcac066f30 0x7efcac0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efcb00091e0 tx=0x7efcb001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.134+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcb4051920 con 0x7efcc00c6db0 2023-10-08T16:05:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.326+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc00cbf40 con 0x7efcc00c6db0 2023-10-08T16:05:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.326+0000 7efca7fff700 1 -- 172.21.15.60:0/2977782294 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcb4054f40 con 0x7efcc00c6db0 2023-10-08T16:05:37.327 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efcac066f30 msgr2=0x7efcac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efcac066f30 0x7efcac0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efcb00091e0 tx=0x7efcb001a000 comp rx=0 tx=0).stop 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 msgr2=0x7efcc00c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 0x7efcc00c7220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efcb4007390 tx=0x7efcc00c89d0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 shutdown_connections 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc00c4b50 0x7efcc00c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efca8003a60 0x7efcc0159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 --2- 172.21.15.60:0/2977782294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00c6db0 0x7efcc00c7220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 >> 172.21.15.60:0/2977782294 conn(0x7efcc00ce570 msgr2=0x7efcc0151780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 shutdown_connections 2023-10-08T16:05:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.328+0000 7efcc67a9700 1 -- 172.21.15.60:0/2977782294 wait complete. 2023-10-08T16:05:37.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:05:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.462+0000 7f952c8b8700 1 Processor -- start 2023-10-08T16:05:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.462+0000 7f952c8b8700 1 -- start start 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952c8b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9528154440 0x7f952815da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952c8b8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952815e1e0 con 0x7f952815af30 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952c8b8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952815e4c0 con 0x7f9528067d70 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952c8b8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952815dfd0 con 0x7f9528154440 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f9525d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f952815af30 0x7f9528067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41538/0 (socket says 172.21.15.60:41538) 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f9525d9b700 1 -- 172.21.15.60:0/1263828780 learned_addr learned my addr 172.21.15.60:0/1263828780 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952659c700 1 --2- 172.21.15.60:0/1263828780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9528154440 0x7f952815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145419135 0 0) 0x7f952815e1e0 con 0x7f952815af30 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9510003570 con 0x7f952815af30 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796060383 0 0) 0x7f952815e4c0 con 0x7f9528067d70 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f952815e1e0 con 0x7f9528067d70 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952659c700 1 -- 172.21.15.60:0/1263828780 >> v1:172.21.15.144:6789/0 conn(0x7f9528067d70 legacy=0x7f95280cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952659c700 1 -- 172.21.15.60:0/1263828780 >> v1:172.21.15.60:6789/0 conn(0x7f952815af30 legacy=0x7f9528067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.463+0000 7f952659c700 1 -- 172.21.15.60:0/1263828780 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952815e7a0 con 0x7f9528154440 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952659c700 1 --2- 172.21.15.60:0/1263828780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9528154440 0x7f952815da90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9518009910 tx=0x7f95180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7478b8b7716d0b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011630 con 0x7f9528154440 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518011790 con 0x7f9528154440 2023-10-08T16:05:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952559a700 1 -- 172.21.15.60:0/1263828780 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011b30 con 0x7f9528154440 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 -- 172.21.15.60:0/1263828780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9528154440 msgr2=0x7f952815da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 --2- 172.21.15.60:0/1263828780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9528154440 0x7f952815da90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9518009910 tx=0x7f95180091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 -- 172.21.15.60:0/1263828780 shutdown_connections 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 --2- 172.21.15.60:0/1263828780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9528154440 0x7f952815da90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 -- 172.21.15.60:0/1263828780 >> 172.21.15.60:0/1263828780 conn(0x7f95280d0dd0 msgr2=0x7f95280d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 -- 172.21.15.60:0/1263828780 shutdown_connections 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.464+0000 7f952c8b8700 1 -- 172.21.15.60:0/1263828780 wait complete. 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.465+0000 7f952c8b8700 1 Processor -- start 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 -- start start 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 0x7f95280b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9528154440 0x7f9528143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815af30 0x7f9528153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952816e530 con 0x7f9528067d70 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952816d920 con 0x7f9528154440 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952c8b8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952816dc00 con 0x7f952815af30 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 0x7f95280b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 0x7f95280b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49576/0 (socket says 172.21.15.60:49576) 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f952659c700 1 -- 172.21.15.60:0/480716069 learned_addr learned my addr 172.21.15.60:0/480716069 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f9525d9b700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9528154440 0x7f9528143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.466+0000 7f9526d9d700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815af30 0x7f9528153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952659c700 1 -- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815af30 msgr2=0x7f9528153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952659c700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815af30 0x7f9528153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952659c700 1 -- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9528154440 msgr2=0x7f9528143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952659c700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9528154440 0x7f9528143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952659c700 1 -- 172.21.15.60:0/480716069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009420 con 0x7f9528067d70 2023-10-08T16:05:37.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952659c700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 0x7f95280b2eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9518009f00 tx=0x7f9518017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951801f070 con 0x7f9528067d70 2023-10-08T16:05:37.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518002f70 con 0x7f9528067d70 2023-10-08T16:05:37.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952816dee0 con 0x7f9528067d70 2023-10-08T16:05:37.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518006af0 con 0x7f9528067d70 2023-10-08T16:05:37.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.467+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952816d5b0 con 0x7f9528067d70 2023-10-08T16:05:37.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.468+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952804c3c0 con 0x7f9528067d70 2023-10-08T16:05:37.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.468+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9518023070 con 0x7f9528067d70 2023-10-08T16:05:37.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.469+0000 7f95167fc700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.469+0000 7f9525d9b700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.469+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9518085710 con 0x7f9528067d70 2023-10-08T16:05:37.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.469+0000 7f9525d9b700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9508066f30 0x7f95080693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9528158a00 tx=0x7f951c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.473+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95180529c0 con 0x7f9528067d70 2023-10-08T16:05:37.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.666+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95280cf500 con 0x7f9528067d70 2023-10-08T16:05:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.666+0000 7f95167fc700 1 -- 172.21.15.60:0/480716069 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95180150a0 con 0x7f9528067d70 2023-10-08T16:05:37.667 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9508066f30 msgr2=0x7f95080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9508066f30 0x7f95080693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9528158a00 tx=0x7f951c009040 comp rx=0 tx=0).stop 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 msgr2=0x7f95280b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 0x7f95280b2eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9518009f00 tx=0x7f9518017000 comp rx=0 tx=0).stop 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 shutdown_connections 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815af30 0x7f9528153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9528067d70 0x7f95280b2eb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 --2- 172.21.15.60:0/480716069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9528154440 0x7f9528143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 >> 172.21.15.60:0/480716069 conn(0x7f95280d0dd0 msgr2=0x7f95280b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 shutdown_connections 2023-10-08T16:05:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.668+0000 7f952c8b8700 1 -- 172.21.15.60:0/480716069 wait complete. 2023-10-08T16:05:37.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:05:37.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.801+0000 7f467d786700 1 Processor -- start 2023-10-08T16:05:37.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.801+0000 7f467d786700 1 -- start start 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f467d786700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f467d786700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467815c8d0 con 0x7f467815b9a0 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f467d786700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46780c9370 con 0x7f4678152300 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f467d786700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b1400 con 0x7f467806d370 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f46767fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f467815b9a0 0x7f46780caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41540/0 (socket says 172.21.15.60:41540) 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f46767fc700 1 -- 172.21.15.60:0/676742556 learned_addr learned my addr 172.21.15.60:0/676742556 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.802+0000 7f46777fe700 1 --2- 172.21.15.60:0/676742556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354164035 0 0) 0x7f467815c8d0 con 0x7f467815b9a0 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4664003570 con 0x7f467815b9a0 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472364568 0 0) 0x7f46780c9370 con 0x7f4678152300 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467815c8d0 con 0x7f4678152300 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f46777fe700 1 -- 172.21.15.60:0/676742556 >> v1:172.21.15.144:6789/0 conn(0x7f4678152300 legacy=0x7f4678158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f46777fe700 1 -- 172.21.15.60:0/676742556 >> v1:172.21.15.60:6789/0 conn(0x7f467815b9a0 legacy=0x7f46780caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3215872934 0 0) 0x7f4664003570 con 0x7f467815b9a0 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f46777fe700 1 -- 172.21.15.60:0/676742556 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467815c030 con 0x7f467806d370 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f46777fe700 1 --2- 172.21.15.60:0/676742556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467806d790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e90 tx=0x7f4668009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6205e6295bb961 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800e070 con 0x7f467806d370 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466800b870 con 0x7f467806d370 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.803+0000 7f4675ffb700 1 -- 172.21.15.60:0/676742556 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660001470 con 0x7f467806d370 2023-10-08T16:05:37.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 -- 172.21.15.60:0/676742556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 msgr2=0x7f467806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 --2- 172.21.15.60:0/676742556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467806d790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e90 tx=0x7f4668009780 comp rx=0 tx=0).stop 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 -- 172.21.15.60:0/676742556 shutdown_connections 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 --2- 172.21.15.60:0/676742556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467806d790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 -- 172.21.15.60:0/676742556 >> 172.21.15.60:0/676742556 conn(0x7f4678069870 msgr2=0x7f4678069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 -- 172.21.15.60:0/676742556 shutdown_connections 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.804+0000 7f467d786700 1 -- 172.21.15.60:0/676742556 wait complete. 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.805+0000 7f467d786700 1 Processor -- start 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.805+0000 7f467d786700 1 -- start start 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467816bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 0x7f46781515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467815b9a0 0x7f46780b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467815af30 con 0x7f4678152300 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46781530a0 con 0x7f467815b9a0 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467816c1a0 con 0x7f467806d370 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 0x7f46781515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 0x7f46781515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49582/0 (socket says 172.21.15.60:49582) 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 -- 172.21.15.60:0/1102554818 learned_addr learned my addr 172.21.15.60:0/1102554818 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f4676ffd700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467816bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46777fe700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467815b9a0 0x7f46780b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 -- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 msgr2=0x7f467816bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467816bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 -- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467815b9a0 msgr2=0x7f46780b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467815b9a0 0x7f46780b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 -- 172.21.15.60:0/1102554818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668009a20 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46777fe700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467815b9a0 0x7f46780b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f46767fc700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 0x7f46781515a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f466000c7e0 tx=0x7f4660001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660007360 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600074e0 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660004830 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46780c7ff0 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.806+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4678152a50 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.807+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467804c3c0 con 0x7f4678152300 2023-10-08T16:05:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.808+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4660004ba0 con 0x7f4678152300 2023-10-08T16:05:37.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.808+0000 7f466effd700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:37.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.808+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4660083910 con 0x7f4678152300 2023-10-08T16:05:37.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.808+0000 7f4676ffd700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:37.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.809+0000 7f4676ffd700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4658066f30 0x7f46580693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4670003870 tx=0x7f4670009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:37.813+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4660050c00 con 0x7f4678152300 2023-10-08T16:05:38.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.002+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46781531e0 con 0x7f4678152300 2023-10-08T16:05:38.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.003+0000 7f466effd700 1 -- 172.21.15.60:0/1102554818 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4660018020 con 0x7f4678152300 2023-10-08T16:05:38.003 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:05:38.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4658066f30 msgr2=0x7f46580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4658066f30 0x7f46580693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4670003870 tx=0x7f4670009040 comp rx=0 tx=0).stop 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 msgr2=0x7f46781515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 0x7f46781515a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f466000c7e0 tx=0x7f4660001a30 comp rx=0 tx=0).stop 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 shutdown_connections 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4658066f30 0x7f46580693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f467806d370 0x7f467816bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467815b9a0 0x7f46780b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 --2- 172.21.15.60:0/1102554818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4678152300 0x7f46781515a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 >> 172.21.15.60:0/1102554818 conn(0x7f4678069870 msgr2=0x7f46780cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 shutdown_connections 2023-10-08T16:05:38.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.005+0000 7f467d786700 1 -- 172.21.15.60:0/1102554818 wait complete. 2023-10-08T16:05:38.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:38.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.136+0000 7f277ea8f700 1 Processor -- start 2023-10-08T16:05:38.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.136+0000 7f277ea8f700 1 -- start start 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277ea8f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f277815a620 0x7f277815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277ea8f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815d580 0x7f2778158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277ea8f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277815cbb0 con 0x7f2778157870 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277ea8f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277815bdb0 con 0x7f277815a620 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277ea8f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277815bfa0 con 0x7f277815d580 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f277815a620 0x7f277815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277d02c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815d580 0x7f2778158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f277815a620 0x7f277815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:42590/0 (socket says 172.21.15.60:42590) 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 -- 172.21.15.60:0/2129756034 learned_addr learned my addr 172.21.15.60:0/2129756034 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f277c82b700 1 --1- 172.21.15.60:0/2129756034 >> v1:172.21.15.144:6789/0 conn(0x7f2778157870 0x7f277815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:40440/0 (socket says 172.21.15.60:40440) 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 -- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815d580 msgr2=0x7f2778158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 --2- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815d580 0x7f2778158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 -- 172.21.15.60:0/2129756034 >> v1:172.21.15.144:6789/0 conn(0x7f2778157870 legacy=0x7f277815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f2777fff700 1 -- 172.21.15.60:0/2129756034 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277815c280 con 0x7f277815a620 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.137+0000 7f27777fe700 1 -- 172.21.15.60:0/2129756034 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781342771 0 0) 0x7f277815cbb0 con 0x7f2778157870 2023-10-08T16:05:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f2777fff700 1 --2- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f277815a620 0x7f277815d040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27680099b0 tx=0x7f2768009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe67dddcb0ed1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f27777fe700 1 -- 172.21.15.60:0/2129756034 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768009ea0 con 0x7f277815a620 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f27777fe700 1 -- 172.21.15.60:0/2129756034 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800b860 con 0x7f277815a620 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f27777fe700 1 -- 172.21.15.60:0/2129756034 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800bc00 con 0x7f277815a620 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 -- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f277815a620 msgr2=0x7f277815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f277815a620 0x7f277815d040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27680099b0 tx=0x7f2768009250 comp rx=0 tx=0).stop 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 -- 172.21.15.60:0/2129756034 shutdown_connections 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815d580 0x7f2778158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2129756034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f277815a620 0x7f277815d040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 -- 172.21.15.60:0/2129756034 >> 172.21.15.60:0/2129756034 conn(0x7f2778068ce0 msgr2=0x7f27780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:38.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 -- 172.21.15.60:0/2129756034 shutdown_connections 2023-10-08T16:05:38.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.138+0000 7f277ea8f700 1 -- 172.21.15.60:0/2129756034 wait complete. 2023-10-08T16:05:38.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 Processor -- start 2023-10-08T16:05:38.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 -- start start 2023-10-08T16:05:38.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2778157870 0x7f277816d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815a620 0x7f27780b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 0x7f277816a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780cf730 con 0x7f277815d580 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780d02b0 con 0x7f2778157870 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.140+0000 7f277ea8f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780cf980 con 0x7f277815a620 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 0x7f277816a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 0x7f277816a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49590/0 (socket says 172.21.15.60:49590) 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 -- 172.21.15.60:0/2148708100 learned_addr learned my addr 172.21.15.60:0/2148708100 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f2777fff700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815a620 0x7f27780b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277c82b700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2778157870 0x7f277816d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 -- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815a620 msgr2=0x7f27780b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815a620 0x7f27780b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 -- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2778157870 msgr2=0x7f277816d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2778157870 0x7f277816d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 -- 172.21.15.60:0/2148708100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680094f0 con 0x7f277815d580 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277c82b700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2778157870 0x7f277816d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277d02c700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 0x7f277816a6e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2770009d70 tx=0x7f277000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000cb50 con 0x7f277815d580 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000f040 con 0x7f277815d580 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780cfc60 con 0x7f277815d580 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770014480 con 0x7f277815d580 2023-10-08T16:05:38.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.141+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780b5d50 con 0x7f277815d580 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.142+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27780d0420 con 0x7f277815d580 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.143+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2770014830 con 0x7f277815d580 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.143+0000 7f2774ff9700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.143+0000 7f277c82b700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.143+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27700851c0 con 0x7f277815d580 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.144+0000 7f277c82b700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2758066f30 0x7f27580693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27600018d0 tx=0x7f2760009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.148+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2770052430 con 0x7f277815d580 2023-10-08T16:05:38.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.386+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f277804c3c0 con 0x7f277815d580 2023-10-08T16:05:38.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.387+0000 7f2774ff9700 1 -- 172.21.15.60:0/2148708100 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f2770055a50 con 0x7f277815d580 2023-10-08T16:05:38.387 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:38.388 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2758066f30 msgr2=0x7f27580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2758066f30 0x7f27580693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27600018d0 tx=0x7f2760009040 comp rx=0 tx=0).stop 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 msgr2=0x7f277816a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 0x7f277816a6e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2770009d70 tx=0x7f277000b040 comp rx=0 tx=0).stop 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 shutdown_connections 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f277815d580 0x7f277816a6e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2778157870 0x7f277816d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 --2- 172.21.15.60:0/2148708100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f277815a620 0x7f27780b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 >> 172.21.15.60:0/2148708100 conn(0x7f2778068ce0 msgr2=0x7f2778155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 shutdown_connections 2023-10-08T16:05:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.389+0000 7f277ea8f700 1 -- 172.21.15.60:0/2148708100 wait complete. 2023-10-08T16:05:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:38.401 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.520+0000 7f7dcce33700 1 Processor -- start 2023-10-08T16:05:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.520+0000 7f7dcce33700 1 -- start start 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dcce33700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 0x7f7dc80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dcce33700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7dc80b1680 0x7f7dc8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dcce33700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80b2890 con 0x7f7dc80af1e0 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dcce33700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80b1c80 con 0x7f7dc80b1680 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dcce33700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80b1f60 con 0x7f7dc80af5b0 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dc659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7dc80af1e0 0x7f7dc806f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41554/0 (socket says 172.21.15.60:41554) 2023-10-08T16:05:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.521+0000 7f7dc659c700 1 -- 172.21.15.60:0/3709500438 learned_addr learned my addr 172.21.15.60:0/3709500438 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc6d9d700 1 --2- 172.21.15.60:0/3709500438 >> v2:172.21.15.144:3300/0 conn(0x7f7dc80b1680 0x7f7dc8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc5d9b700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 0x7f7dc80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497690964 0 0) 0x7f7dc80b2890 con 0x7f7dc80af1e0 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db4003570 con 0x7f7dc80af1e0 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651586794 0 0) 0x7f7db4003570 con 0x7f7dc80af1e0 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 msgr2=0x7f7dc80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 0x7f7dc80b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 >> v2:172.21.15.144:3300/0 conn(0x7f7dc80b1680 msgr2=0x7f7dc8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 --2- 172.21.15.60:0/3709500438 >> v2:172.21.15.144:3300/0 conn(0x7f7dc80b1680 0x7f7dc8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80b2240 con 0x7f7dc80af1e0 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f7dc0001470 con 0x7f7dc80af1e0 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc6d9d700 1 --2- 172.21.15.60:0/3709500438 >> v2:172.21.15.144:3300/0 conn(0x7f7dc80b1680 0x7f7dc8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 >> v1:172.21.15.60:6789/0 conn(0x7f7dc80af1e0 legacy=0x7f7dc806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7db4003a60 0x7f7db4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db4004810 0x7f7db4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 0x7f7db40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80b1c80 con 0x7f7db4003a60 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80b1f60 con 0x7f7db4004810 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db400ba60 con 0x7f7dc80af5b0 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7db4003a60 0x7f7db4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc5d9b700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db4004810 0x7f7db4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.522+0000 7f7dc6d9d700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 0x7f7db40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc659c700 1 -- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 msgr2=0x7f7db40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7dc80af5b0 0x7f7db40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc659c700 1 -- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db4004810 msgr2=0x7f7db4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db4004810 0x7f7db4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc659c700 1 -- 172.21.15.60:0/3709500438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4003570 con 0x7f7db4003a60 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7db4003a60 0x7f7db4003e70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c3f0 tx=0x7f7dc0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b62fd47d23ad59f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000cc80 con 0x7f7db4003a60 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000ce00 con 0x7f7db4003a60 2023-10-08T16:05:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc559a700 1 -- 172.21.15.60:0/3709500438 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0005b70 con 0x7f7db4003a60 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dcce33700 1 -- 172.21.15.60:0/3709500438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7db4003a60 msgr2=0x7f7db4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3709500438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7db4003a60 0x7f7db4003e70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c3f0 tx=0x7f7dc0001e90 comp rx=0 tx=0).stop 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dc6d9d700 1 -- 172.21.15.60:0/3709500438 reap_dead start 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dcce33700 1 -- 172.21.15.60:0/3709500438 shutdown_connections 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.523+0000 7f7dcce33700 1 -- 172.21.15.60:0/3709500438 >> 172.21.15.60:0/3709500438 conn(0x7f7dc80cd1e0 msgr2=0x7f7dc80cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.524+0000 7f7dcce33700 1 -- 172.21.15.60:0/3709500438 shutdown_connections 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.524+0000 7f7dcce33700 1 -- 172.21.15.60:0/3709500438 wait complete. 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 Processor -- start 2023-10-08T16:05:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 -- start start 2023-10-08T16:05:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7db4003a60 0x7f7dc815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7dc815a560 0x7f7dc806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 0x7f7dc81548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8154de0 con 0x7f7dc8154440 2023-10-08T16:05:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815d6d0 con 0x7f7dc815a560 2023-10-08T16:05:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dcce33700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8098650 con 0x7f7db4003a60 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dc6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 0x7f7dc81548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dc6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 0x7f7dc81548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49612/0 (socket says 172.21.15.60:49612) 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.525+0000 7f7dc6d9d700 1 -- 172.21.15.60:0/3420435300 learned_addr learned my addr 172.21.15.60:0/3420435300 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7db4003a60 0x7f7dc815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc5d9b700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7dc815a560 0x7f7dc806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc6d9d700 1 -- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7db4003a60 msgr2=0x7f7dc815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc6d9d700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7db4003a60 0x7f7dc815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc6d9d700 1 -- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7dc815a560 msgr2=0x7f7dc806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc6d9d700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7dc815a560 0x7f7dc806eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc6d9d700 1 -- 172.21.15.60:0/3420435300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc815d110 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dc6d9d700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 0x7f7dc81548a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80a81f0 tx=0x7f7db800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800e040 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800f040 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc815d3f0 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800fdb0 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.526+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc815cd50 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.527+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc804c3c0 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.528+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7db8015640 con 0x7f7dc8154440 2023-10-08T16:05:38.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.528+0000 7f7dbe7fc700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.528+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7db8084ea0 con 0x7f7dc8154440 2023-10-08T16:05:38.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.528+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.528+0000 7f7dc659c700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7da8066f30 0x7f7da80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001ed0 tx=0x7f7dc0015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.532+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7db8052110 con 0x7f7dc8154440 2023-10-08T16:05:38.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.726+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dc8063c00 con 0x7f7dc8154440 2023-10-08T16:05:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.727+0000 7f7dbe7fc700 1 -- 172.21.15.60:0/3420435300 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7db8019090 con 0x7f7dc8154440 2023-10-08T16:05:38.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:38.727 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7da8066f30 msgr2=0x7f7da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7da8066f30 0x7f7da80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001ed0 tx=0x7f7dc0015000 comp rx=0 tx=0).stop 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 msgr2=0x7f7dc81548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 0x7f7dc81548a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80a81f0 tx=0x7f7db800b040 comp rx=0 tx=0).stop 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 shutdown_connections 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7db4003a60 0x7f7dc815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dc8154440 0x7f7dc81548a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 --2- 172.21.15.60:0/3420435300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7dc815a560 0x7f7dc806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 >> 172.21.15.60:0/3420435300 conn(0x7f7dc80cd1e0 msgr2=0x7f7dc8156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 shutdown_connections 2023-10-08T16:05:38.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.729+0000 7f7dcce33700 1 -- 172.21.15.60:0/3420435300 wait complete. 2023-10-08T16:05:38.742 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:05:38.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 Processor -- start 2023-10-08T16:05:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 -- start start 2023-10-08T16:05:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3680b0cd0 0x7fd3680cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd36815b820 0x7fd3680ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680c9450 con 0x7fd3680b10a0 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680ce960 con 0x7fd3680b0cd0 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.860+0000 7fd36e37e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680cc520 con 0x7fd36815b820 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3680b0cd0 0x7fd3680cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3680b0cd0 0x7fd3680cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49620/0 (socket says 172.21.15.60:49620) 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 -- 172.21.15.60:0/3549036066 learned_addr learned my addr 172.21.15.60:0/3549036066 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd36c91b700 1 --2- 172.21.15.60:0/3549036066 >> v2:172.21.15.144:3300/0 conn(0x7fd36815b820 0x7fd3680ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 -- 172.21.15.60:0/3549036066 >> v2:172.21.15.144:3300/0 conn(0x7fd36815b820 msgr2=0x7fd3680ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 --2- 172.21.15.60:0/3549036066 >> v2:172.21.15.144:3300/0 conn(0x7fd36815b820 0x7fd3680ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 -- 172.21.15.60:0/3549036066 >> v1:172.21.15.144:6789/0 conn(0x7fd3680b10a0 legacy=0x7fd3680ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 -- 172.21.15.60:0/3549036066 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680cc910 con 0x7fd3680b0cd0 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd36c91b700 1 --2- 172.21.15.60:0/3549036066 >> v2:172.21.15.144:3300/0 conn(0x7fd36815b820 0x7fd3680ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd367fff700 1 --2- 172.21.15.60:0/3549036066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b0cd0 0x7fd3680cb580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd36806f130 tx=0x7fd358009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04eae5ad9fa0b68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd366ffd700 1 -- 172.21.15.60:0/3549036066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800b820 con 0x7fd3680b0cd0 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd366ffd700 1 -- 172.21.15.60:0/3549036066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800b980 con 0x7fd3680b0cd0 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.861+0000 7fd366ffd700 1 -- 172.21.15.60:0/3549036066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800bd20 con 0x7fd3680b0cd0 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 -- 172.21.15.60:0/3549036066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b0cd0 msgr2=0x7fd3680cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 --2- 172.21.15.60:0/3549036066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b0cd0 0x7fd3680cb580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd36806f130 tx=0x7fd358009250 comp rx=0 tx=0).stop 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 -- 172.21.15.60:0/3549036066 shutdown_connections 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 --2- 172.21.15.60:0/3549036066 >> v2:172.21.15.144:3300/0 conn(0x7fd36815b820 0x7fd3680ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 --2- 172.21.15.60:0/3549036066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b0cd0 0x7fd3680cb580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 -- 172.21.15.60:0/3549036066 >> 172.21.15.60:0/3549036066 conn(0x7fd36806fdc0 msgr2=0x7fd36806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 -- 172.21.15.60:0/3549036066 shutdown_connections 2023-10-08T16:05:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.862+0000 7fd36e37e700 1 -- 172.21.15.60:0/3549036066 wait complete. 2023-10-08T16:05:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.863+0000 7fd36e37e700 1 Processor -- start 2023-10-08T16:05:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.863+0000 7fd36e37e700 1 -- start start 2023-10-08T16:05:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36e37e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3680b0cd0 0x7fd368169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36e37e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 0x7fd3681465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36e37e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815b820 0x7fd3680b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36e37e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680c6b20 con 0x7fd3680b10a0 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36e37e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368169770 con 0x7fd36815b820 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36e37e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680c5c30 con 0x7fd3680b0cd0 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 0x7fd3681465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 0x7fd3681465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49636/0 (socket says 172.21.15.60:49636) 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 -- 172.21.15.60:0/348686162 learned_addr learned my addr 172.21.15.60:0/348686162 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd36c91b700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815b820 0x7fd3680b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd367fff700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3680b0cd0 0x7fd368169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 -- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3680b0cd0 msgr2=0x7fd368169230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3680b0cd0 0x7fd368169230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 -- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815b820 msgr2=0x7fd3680b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815b820 0x7fd3680b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 -- 172.21.15.60:0/348686162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580094f0 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.864+0000 7fd3677fe700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 0x7fd3681465b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c4f0 tx=0x7fd35c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.865+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c011590 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.865+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c011710 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.865+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3680c5f10 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.865+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c011ad0 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.865+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3680c64d0 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.865+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3680c6cd0 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.866+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd35c012420 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.866+0000 7fd34ffff700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd354066f30 0x7fd3540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.866+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd35c083c20 con 0x7fd3680b10a0 2023-10-08T16:05:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.866+0000 7fd367fff700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd354066f30 0x7fd3540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.867+0000 7fd367fff700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd354066f30 0x7fd3540693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd36806f130 tx=0x7fd358016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:38.871+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3680c6cd0 con 0x7fd3680b10a0 2023-10-08T16:05:39.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.104+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd36804c3c0 con 0x7fd3680b10a0 2023-10-08T16:05:39.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.105+0000 7fd34ffff700 1 -- 172.21.15.60:0/348686162 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd35c050e90 con 0x7fd3680b10a0 2023-10-08T16:05:39.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:39.105 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:39.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.106+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd354066f30 msgr2=0x7fd3540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.106+0000 7fd36e37e700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd354066f30 0x7fd3540693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd36806f130 tx=0x7fd358016000 comp rx=0 tx=0).stop 2023-10-08T16:05:39.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 msgr2=0x7fd3681465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 0x7fd3681465b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c4f0 tx=0x7fd35c007f30 comp rx=0 tx=0).stop 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 shutdown_connections 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd354066f30 0x7fd3540693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3680b0cd0 0x7fd368169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815b820 0x7fd3680b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 --2- 172.21.15.60:0/348686162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3680b10a0 0x7fd3681465b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 >> 172.21.15.60:0/348686162 conn(0x7fd36806fdc0 msgr2=0x7fd368155170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 shutdown_connections 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.107+0000 7fd36e37e700 1 -- 172.21.15.60:0/348686162 wait complete. 2023-10-08T16:05:39.108 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:39.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:05:39.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.237+0000 7f73b6bfd700 1 Processor -- start 2023-10-08T16:05:39.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.237+0000 7f73b6bfd700 1 -- start start 2023-10-08T16:05:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b6bfd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f73b00abae0 0x7f73b00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b6bfd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73b00abeb0 0x7f73b00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b6bfd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00c8400 0x7f73b00c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b6bfd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b00c9cb0 con 0x7f73b00abae0 2023-10-08T16:05:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b6bfd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b00c90a0 con 0x7f73b00abeb0 2023-10-08T16:05:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b6bfd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00c9380 con 0x7f73b00c8400 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b4999700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f73b00abae0 0x7f73b00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b4999700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f73b00abae0 0x7f73b00c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49650/0 (socket says 172.21.15.60:49650) 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b4999700 1 -- 172.21.15.60:0/3952078245 learned_addr learned my addr 172.21.15.60:0/3952078245 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.238+0000 7f73b519a700 1 --2- 172.21.15.60:0/3952078245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00c8400 0x7f73b00c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73affff700 1 --2- 172.21.15.60:0/3952078245 >> v2:172.21.15.144:3300/0 conn(0x7f73b00abeb0 0x7f73b00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73b4999700 1 -- 172.21.15.60:0/3952078245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00c8400 msgr2=0x7f73b00c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73b4999700 1 --2- 172.21.15.60:0/3952078245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00c8400 0x7f73b00c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73b4999700 1 -- 172.21.15.60:0/3952078245 >> v2:172.21.15.144:3300/0 conn(0x7f73b00abeb0 msgr2=0x7f73b00c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73b4999700 1 --2- 172.21.15.60:0/3952078245 >> v2:172.21.15.144:3300/0 conn(0x7f73b00abeb0 0x7f73b00c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73b4999700 1 -- 172.21.15.60:0/3952078245 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00c9660 con 0x7f73b00abae0 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73b4999700 1 --2- 172.21.15.60:0/3952078245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00abae0 0x7f73b00c6eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73b00ca160 tx=0x7f73a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198da1e0dcc749e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73af7fe700 1 -- 172.21.15.60:0/3952078245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800e070 con 0x7f73b00abae0 2023-10-08T16:05:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73af7fe700 1 -- 172.21.15.60:0/3952078245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800b970 con 0x7f73b00abae0 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.239+0000 7f73af7fe700 1 -- 172.21.15.60:0/3952078245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80092e0 con 0x7f73b00abae0 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 -- 172.21.15.60:0/3952078245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00abae0 msgr2=0x7f73b00c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/3952078245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00abae0 0x7f73b00c6eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73b00ca160 tx=0x7f73a8009840 comp rx=0 tx=0).stop 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 -- 172.21.15.60:0/3952078245 shutdown_connections 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/3952078245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00c8400 0x7f73b00c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/3952078245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00abae0 0x7f73b00c6eb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/3952078245 >> v2:172.21.15.144:3300/0 conn(0x7f73b00abeb0 0x7f73b00c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 -- 172.21.15.60:0/3952078245 >> 172.21.15.60:0/3952078245 conn(0x7f73b0067660 msgr2=0x7f73b0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 -- 172.21.15.60:0/3952078245 shutdown_connections 2023-10-08T16:05:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.240+0000 7f73b6bfd700 1 -- 172.21.15.60:0/3952078245 wait complete. 2023-10-08T16:05:39.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.241+0000 7f73b6bfd700 1 Processor -- start 2023-10-08T16:05:39.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.241+0000 7f73b6bfd700 1 -- start start 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b6bfd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b00abae0 0x7f73b00af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b6bfd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00abeb0 0x7f73b01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b6bfd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 0x7f73b00c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b6bfd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0158a20 con 0x7f73b00c8400 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b6bfd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00c2380 con 0x7f73b00abae0 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b6bfd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00c1ae0 con 0x7f73b00abeb0 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 0x7f73b00c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 0x7f73b00c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49660/0 (socket says 172.21.15.60:49660) 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 -- 172.21.15.60:0/160485654 learned_addr learned my addr 172.21.15.60:0/160485654 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b4999700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b00abae0 0x7f73b00af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73affff700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00abeb0 0x7f73b01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 -- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00abeb0 msgr2=0x7f73b01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00abeb0 0x7f73b01584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 -- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b00abae0 msgr2=0x7f73b00af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b00abae0 0x7f73b00af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 -- 172.21.15.60:0/160485654 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8009ae0 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.242+0000 7f73b519a700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 0x7f73b00c0f90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f73a000e8d0 tx=0x7f73a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.243+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0013680 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.243+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00137e0 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.243+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b00c1e20 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.243+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0013ba0 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.243+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b00b1e50 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.244+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b004c3c0 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.244+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73a00123d0 con 0x7f73b00c8400 2023-10-08T16:05:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.244+0000 7f73acff9700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f739c066f30 0x7f739c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.245+0000 7f73b4999700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f739c066f30 0x7f739c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.245+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73a00845b0 con 0x7f73b00c8400 2023-10-08T16:05:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.245+0000 7f73b4999700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f739c066f30 0x7f739c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009880 tx=0x7f73a8018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.249+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73a0051820 con 0x7f73b00c8400 2023-10-08T16:05:39.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.486+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73b00b22c0 con 0x7f73b00c8400 2023-10-08T16:05:39.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.486+0000 7f73acff9700 1 -- 172.21.15.60:0/160485654 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f73a0054e40 con 0x7f73b00c8400 2023-10-08T16:05:39.487 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:39.487 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3308175832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3308175832},{"type":"v1","addr":"172.21.15.144:6835","nonce":3308175832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/385895591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":385895591},{"type":"v1","addr":"172.21.15.60:6836","nonce":385895591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/4088622953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4088622953},{"type":"v1","addr":"172.21.15.144:6834","nonce":4088622953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:00.901778+0000","modified":"2023-10-08T16:05:04.504559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2192248829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2192248829},{"type":"v1","addr":"172.21.15.60:6837","nonce":2192248829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:05:39.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f739c066f30 msgr2=0x7f739c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f739c066f30 0x7f739c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009880 tx=0x7f73a8018000 comp rx=0 tx=0).stop 2023-10-08T16:05:39.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 msgr2=0x7f73b00c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 0x7f73b00c0f90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f73a000e8d0 tx=0x7f73a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 shutdown_connections 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f739c066f30 0x7f739c0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73b00c8400 0x7f73b00c0f90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b00abae0 0x7f73b00af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 --2- 172.21.15.60:0/160485654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b00abeb0 0x7f73b01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 >> 172.21.15.60:0/160485654 conn(0x7f73b0067660 msgr2=0x7f73b0159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 shutdown_connections 2023-10-08T16:05:39.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.488+0000 7f73b6bfd700 1 -- 172.21.15.60:0/160485654 wait complete. 2023-10-08T16:05:39.491 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2023-10-08T16:05:39.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:39.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.618+0000 7f3952ce7700 1 Processor -- start 2023-10-08T16:05:39.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.619+0000 7f3952ce7700 1 -- start start 2023-10-08T16:05:39.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.619+0000 7f3952ce7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0c9200 0x7f394c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.619+0000 7f3952ce7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f394c0cba50 0x7f394c0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.619+0000 7f3952ce7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c0caa60 con 0x7f394c0cc720 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.619+0000 7f3952ce7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0cf330 con 0x7f394c0cba50 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.619+0000 7f3952ce7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0cf570 con 0x7f394c0c9200 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f394c0cba50 0x7f394c0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f394bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0c9200 0x7f394c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3950a83700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f394c0cc720 0x7f394c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:40462/0 (socket says 172.21.15.60:40462) 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f394bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0c9200 0x7f394c0b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35352/0 (socket says 172.21.15.60:35352) 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3950a83700 1 -- 172.21.15.60:0/1409284335 learned_addr learned my addr 172.21.15.60:0/1409284335 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:39.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f394c0cba50 0x7f394c0cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:42676/0 (socket says 172.21.15.60:42676) 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 -- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0c9200 msgr2=0x7f394c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 --2- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0c9200 0x7f394c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 -- 172.21.15.60:0/1409284335 >> v1:172.21.15.144:6789/0 conn(0x7f394c0cc720 legacy=0x7f394c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 -- 172.21.15.60:0/1409284335 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0cb5c0 con 0x7f394c0cba50 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f394b7fe700 1 -- 172.21.15.60:0/1409284335 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689413490 0 0) 0x7f394c0caa60 con 0x7f394c0cc720 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f3951284700 1 --2- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0cbed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39340098e0 tx=0x7f39340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45983bfd04ed038 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f394b7fe700 1 -- 172.21.15.60:0/1409284335 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400b640 con 0x7f394c0cba50 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f394b7fe700 1 -- 172.21.15.60:0/1409284335 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400b7a0 con 0x7f394c0cba50 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.620+0000 7f394b7fe700 1 -- 172.21.15.60:0/1409284335 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400bb40 con 0x7f394c0cba50 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 -- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 msgr2=0x7f394c0cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 --2- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0cbed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39340098e0 tx=0x7f39340091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 -- 172.21.15.60:0/1409284335 shutdown_connections 2023-10-08T16:05:39.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 --2- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0cbed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 --2- 172.21.15.60:0/1409284335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0c9200 0x7f394c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 -- 172.21.15.60:0/1409284335 >> 172.21.15.60:0/1409284335 conn(0x7f394c06c6e0 msgr2=0x7f394c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:39.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 -- 172.21.15.60:0/1409284335 shutdown_connections 2023-10-08T16:05:39.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.621+0000 7f3952ce7700 1 -- 172.21.15.60:0/1409284335 wait complete. 2023-10-08T16:05:39.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.622+0000 7f3952ce7700 1 Processor -- start 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.622+0000 7f3952ce7700 1 -- start start 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3952ce7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 0x7f394c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3952ce7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3952ce7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0cc720 0x7f394c15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3952ce7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c167b30 con 0x7f394c0c9200 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3952ce7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c7d30 con 0x7f394c0cba50 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3952ce7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0a6b50 con 0x7f394c0cc720 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 0x7f394c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 0x7f394c14b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49668/0 (socket says 172.21.15.60:49668) 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 -- 172.21.15.60:0/979327542 learned_addr learned my addr 172.21.15.60:0/979327542 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f394bfff700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3951284700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0cc720 0x7f394c15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 -- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0cc720 msgr2=0x7f394c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0cc720 0x7f394c15da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 -- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 msgr2=0x7f394c0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3950a83700 1 -- 172.21.15.60:0/979327542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009420 con 0x7f394c0c9200 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.623+0000 7f3951284700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0cc720 0x7f394c15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.624+0000 7f3950a83700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 0x7f394c14b7e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f394400c5b0 tx=0x7f3944001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.624+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944005b30 con 0x7f394c0c9200 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.624+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944005c90 con 0x7f394c0c9200 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.624+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c0c7a50 con 0x7f394c0c9200 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.624+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944007300 con 0x7f394c0c9200 2023-10-08T16:05:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.624+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0a67e0 con 0x7f394c0c9200 2023-10-08T16:05:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.625+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0c7ea0 con 0x7f394c0c9200 2023-10-08T16:05:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.625+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39440076b0 con 0x7f394c0c9200 2023-10-08T16:05:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.626+0000 7f3948ff9700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f392c066f30 0x7f392c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.626+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3944083a00 con 0x7f394c0c9200 2023-10-08T16:05:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.626+0000 7f394bfff700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f392c066f30 0x7f392c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.626+0000 7f394bfff700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f392c066f30 0x7f392c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f394c1594e0 tx=0x7f393c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.630+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3944050c70 con 0x7f394c0c9200 2023-10-08T16:05:39.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.823+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394c0a6970 con 0x7f394c0c9200 2023-10-08T16:05:39.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.824+0000 7f3948ff9700 1 -- 172.21.15.60:0/979327542 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f3944017020 con 0x7f394c0c9200 2023-10-08T16:05:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:39.825 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:02.488764+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:59.230242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:59.862234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f392c066f30 msgr2=0x7f392c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f392c066f30 0x7f392c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f394c1594e0 tx=0x7f393c00b040 comp rx=0 tx=0).stop 2023-10-08T16:05:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 msgr2=0x7f394c14b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 0x7f394c14b7e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f394400c5b0 tx=0x7f3944001070 comp rx=0 tx=0).stop 2023-10-08T16:05:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 shutdown_connections 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f392c066f30 0x7f392c0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f394c0cc720 0x7f394c15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f394c0c9200 0x7f394c14b7e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 --2- 172.21.15.60:0/979327542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f394c0cba50 0x7f394c0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 >> 172.21.15.60:0/979327542 conn(0x7f394c06c6e0 msgr2=0x7f394c0c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.826+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 shutdown_connections 2023-10-08T16:05:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.827+0000 7f3952ce7700 1 -- 172.21.15.60:0/979327542 wait complete. 2023-10-08T16:05:39.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:05:39.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.958+0000 7fda50681700 1 Processor -- start 2023-10-08T16:05:39.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.958+0000 7fda50681700 1 -- start start 2023-10-08T16:05:39.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.959+0000 7fda50681700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda4815a2b0 0x7fda480b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.959+0000 7fda50681700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480c5d80 con 0x7fda480d1c30 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.959+0000 7fda50681700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480c6060 con 0x7fda480cfe20 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.959+0000 7fda50681700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda48068470 con 0x7fda4815a2b0 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4dc1c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fda480d1c30 0x7fda480cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41570/0 (socket says 172.21.15.60:41570) 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4dc1c700 1 -- 172.21.15.60:0/146006115 learned_addr learned my addr 172.21.15.60:0/146006115 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4e41d700 1 --2- 172.21.15.60:0/146006115 >> v2:172.21.15.144:3300/0 conn(0x7fda4815a2b0 0x7fda480b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222794235 0 0) 0x7fda480c5d80 con 0x7fda480d1c30 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30003570 con 0x7fda480d1c30 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058695473 0 0) 0x7fda480c6060 con 0x7fda480cfe20 2023-10-08T16:05:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda480c5d80 con 0x7fda480cfe20 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4e41d700 1 -- 172.21.15.60:0/146006115 >> v1:172.21.15.144:6789/0 conn(0x7fda480cfe20 legacy=0x7fda480c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4e41d700 1 -- 172.21.15.60:0/146006115 >> v1:172.21.15.60:6789/0 conn(0x7fda480d1c30 legacy=0x7fda480cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4e41d700 1 -- 172.21.15.60:0/146006115 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480c6340 con 0x7fda4815a2b0 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4e41d700 1 --2- 172.21.15.60:0/146006115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4815a2b0 0x7fda480b3da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda40009eb0 tx=0x7fda40009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27cc1b36f32a341 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000e070 con 0x7fda4815a2b0 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000bb80 con 0x7fda4815a2b0 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.960+0000 7fda4d41b700 1 -- 172.21.15.60:0/146006115 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40012430 con 0x7fda4815a2b0 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 -- 172.21.15.60:0/146006115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4815a2b0 msgr2=0x7fda480b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 --2- 172.21.15.60:0/146006115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4815a2b0 0x7fda480b3da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda40009eb0 tx=0x7fda40009780 comp rx=0 tx=0).stop 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 -- 172.21.15.60:0/146006115 shutdown_connections 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 --2- 172.21.15.60:0/146006115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4815a2b0 0x7fda480b3da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 -- 172.21.15.60:0/146006115 >> 172.21.15.60:0/146006115 conn(0x7fda48067e40 msgr2=0x7fda480d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:39.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 -- 172.21.15.60:0/146006115 shutdown_connections 2023-10-08T16:05:39.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.961+0000 7fda50681700 1 -- 172.21.15.60:0/146006115 wait complete. 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.962+0000 7fda50681700 1 Processor -- start 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.962+0000 7fda50681700 1 -- start start 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda50681700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 0x7fda481608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda50681700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda480d1c30 0x7fda4815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda50681700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4815a2b0 0x7fda4816a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda50681700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48160fc0 con 0x7fda480cfe20 2023-10-08T16:05:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda50681700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4815b110 con 0x7fda480d1c30 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda50681700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda481597c0 con 0x7fda4815a2b0 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 0x7fda481608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 0x7fda481608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49670/0 (socket says 172.21.15.60:49670) 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 -- 172.21.15.60:0/724196047 learned_addr learned my addr 172.21.15.60:0/724196047 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4dc1c700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda480d1c30 0x7fda4815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4ec1e700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4815a2b0 0x7fda4816a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 -- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4815a2b0 msgr2=0x7fda4816a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4815a2b0 0x7fda4816a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 -- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda480d1c30 msgr2=0x7fda4815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda480d1c30 0x7fda4815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 -- 172.21.15.60:0/724196047 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009a20 con 0x7fda480cfe20 2023-10-08T16:05:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.963+0000 7fda4e41d700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 0x7fda481608c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda400099f0 tx=0x7fda40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.964+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40012db0 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.964+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4001b420 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.964+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4815a820 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.964+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4001b7e0 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.964+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4815aac0 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.964+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4804c3c0 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.965+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda4001bb50 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.965+0000 7fda467fc700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.965+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda40086100 con 0x7fda480cfe20 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.966+0000 7fda4dc1c700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.966+0000 7fda4dc1c700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda34066f30 0x7fda340693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda4815a280 tx=0x7fda3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:39.970+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda40053370 con 0x7fda480cfe20 2023-10-08T16:05:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.207+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fda48064a00 con 0x7fda480cfe20 2023-10-08T16:05:40.208 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:05:40.208+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:05:40.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.212+0000 7fda467fc700 1 -- 172.21.15.60:0/724196047 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fda40056990 con 0x7fda480cfe20 2023-10-08T16:05:40.213 INFO:tasks.ceph.mds.c.smithi060.stderr: -1776> 2023-10-08T16:05:05.478+0000 7f47ffd01700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda34066f30 msgr2=0x7fda340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda34066f30 0x7fda340693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda4815a280 tx=0x7fda3c009040 comp rx=0 tx=0).stop 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 msgr2=0x7fda481608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 0x7fda481608c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda400099f0 tx=0x7fda40019000 comp rx=0 tx=0).stop 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 shutdown_connections 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4815a2b0 0x7fda4816a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480cfe20 0x7fda481608c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 --2- 172.21.15.60:0/724196047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda480d1c30 0x7fda4815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 >> 172.21.15.60:0/724196047 conn(0x7fda48067e40 msgr2=0x7fda480cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:40.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 shutdown_connections 2023-10-08T16:05:40.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.214+0000 7fda50681700 1 -- 172.21.15.60:0/724196047 wait complete. 2023-10-08T16:05:40.216 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:05:40.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:05:40.235 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:05:40.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.349+0000 7fbe7e77f700 1 Processor -- start 2023-10-08T16:05:40.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.349+0000 7fbe7e77f700 1 -- start start 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7e77f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7e77f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe780b6580 0x7fbe7806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7e77f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780b4d70 con 0x7fbe7806a830 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7e77f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7806ac70 con 0x7fbe780b6580 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7e77f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780cd8d0 con 0x7fbe780cce30 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe780b6580 0x7fbe7806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe780b6580 0x7fbe7806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49692/0 (socket says 172.21.15.60:49692) 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/3807204226 learned_addr learned my addr 172.21.15.60:0/3807204226 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7d77d700 1 --2- 172.21.15.60:0/3807204226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:40.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/3807204226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 msgr2=0x7fbe7815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 --2- 172.21.15.60:0/3807204226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/3807204226 >> v1:172.21.15.144:6789/0 conn(0x7fbe7806a830 legacy=0x7fbe7815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.350+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/3807204226 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780b4440 con 0x7fbe780b6580 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7cf7c700 1 --2- 172.21.15.60:0/3807204226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7806a2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0099b0 tx=0x7fbe6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b93bf9db3fb11 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe77fff700 1 -- 172.21.15.60:0/3807204226 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00b860 con 0x7fbe780b6580 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe77fff700 1 -- 172.21.15.60:0/3807204226 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00b9c0 con 0x7fbe780b6580 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe77fff700 1 -- 172.21.15.60:0/3807204226 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00bd60 con 0x7fbe780b6580 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 -- 172.21.15.60:0/3807204226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 msgr2=0x7fbe7806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/3807204226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7806a2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0099b0 tx=0x7fbe6c009250 comp rx=0 tx=0).stop 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 -- 172.21.15.60:0/3807204226 shutdown_connections 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/3807204226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/3807204226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7806a2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 -- 172.21.15.60:0/3807204226 >> 172.21.15.60:0/3807204226 conn(0x7fbe78068cb0 msgr2=0x7fbe780690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:40.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 -- 172.21.15.60:0/3807204226 shutdown_connections 2023-10-08T16:05:40.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.351+0000 7fbe7e77f700 1 -- 172.21.15.60:0/3807204226 wait complete. 2023-10-08T16:05:40.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.352+0000 7fbe7e77f700 1 Processor -- start 2023-10-08T16:05:40.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 -- start start 2023-10-08T16:05:40.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe7806a830 0x7fbe781522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:40.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7816ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781512e0 con 0x7fbe780b6580 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78151e20 con 0x7fbe7806a830 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7e77f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781527f0 con 0x7fbe780cce30 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7cf7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7816ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.353+0000 7fbe7cf7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7816ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49704/0 (socket says 172.21.15.60:49704) 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/1775111737 learned_addr learned my addr 172.21.15.60:0/1775111737 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7d77d700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe7806a830 0x7fbe781522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7df7e700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 msgr2=0x7fbe7815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe7806a830 msgr2=0x7fbe781522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe7806a830 0x7fbe781522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 -- 172.21.15.60:0/1775111737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0094f0 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7cf7c700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7816ac20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbe7806b300 tx=0x7fbe6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c011e40 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c024440 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe781514f0 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c024800 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.354+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe78151ab0 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.355+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe78159af0 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.356+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe6c01a420 con 0x7fbe780b6580 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.356+0000 7fbe757fa700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe64066f30 0x7fbe640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:40.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.356+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbe6c0863e0 con 0x7fbe780b6580 2023-10-08T16:05:40.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.356+0000 7fbe7d77d700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe64066f30 0x7fbe640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:40.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.356+0000 7fbe7d77d700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe64066f30 0x7fbe640693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe70006fd0 tx=0x7fbe70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:40.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.360+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe6c053600 con 0x7fbe780b6580 2023-10-08T16:05:40.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:40.603+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbe78151c40 con 0x7fbe780b6580 2023-10-08T16:05:41.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.213+0000 7fbe757fa700 1 -- 172.21.15.60:0/1775111737 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe6c056c20 con 0x7fbe780b6580 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe64066f30 msgr2=0x7fbe640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe64066f30 0x7fbe640693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe70006fd0 tx=0x7fbe70008040 comp rx=0 tx=0).stop 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 msgr2=0x7fbe7816ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7816ac20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbe7806b300 tx=0x7fbe6c017000 comp rx=0 tx=0).stop 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 shutdown_connections 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe64066f30 0x7fbe640693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe780cce30 0x7fbe7815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe7806a830 0x7fbe781522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 --2- 172.21.15.60:0/1775111737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe780b6580 0x7fbe7816ac20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 >> 172.21.15.60:0/1775111737 conn(0x7fbe78068cb0 msgr2=0x7fbe78150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 shutdown_connections 2023-10-08T16:05:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.215+0000 7fbe7e77f700 1 -- 172.21.15.60:0/1775111737 wait complete. 2023-10-08T16:05:41.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:05:41.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.397+0000 7f6db1c71700 1 Processor -- start 2023-10-08T16:05:41.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.397+0000 7f6db1c71700 1 -- start start 2023-10-08T16:05:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6db1c71700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6dac070950 0x7f6dac06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6db1c71700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac070d20 0x7f6dac067e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6db1c71700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6dac1431f0 0x7f6dac143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6db1c71700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0c8640 con 0x7f6dac070950 2023-10-08T16:05:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6db1c71700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0c8e80 con 0x7f6dac1431f0 2023-10-08T16:05:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6db1c71700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac068350 con 0x7f6dac070d20 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6dac070950 0x7f6dac06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6dac070950 0x7f6dac06ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49712/0 (socket says 172.21.15.60:49712) 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 -- 172.21.15.60:0/1796541240 learned_addr learned my addr 172.21.15.60:0/1796541240 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 -- 172.21.15.60:0/1796541240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac070d20 msgr2=0x7f6dac067e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dabfff700 1 --2- 172.21.15.60:0/1796541240 >> v2:172.21.15.144:3300/0 conn(0x7f6dac1431f0 0x7f6dac143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6daaffd700 1 --2- 172.21.15.60:0/1796541240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac070d20 0x7f6dac067e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 --2- 172.21.15.60:0/1796541240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac070d20 0x7f6dac067e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 -- 172.21.15.60:0/1796541240 >> v2:172.21.15.144:3300/0 conn(0x7f6dac1431f0 msgr2=0x7f6dac143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 --2- 172.21.15.60:0/1796541240 >> v2:172.21.15.144:3300/0 conn(0x7f6dac1431f0 0x7f6dac143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.398+0000 7f6dab7fe700 1 -- 172.21.15.60:0/1796541240 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac06f630 con 0x7f6dac070950 2023-10-08T16:05:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6dab7fe700 1 --2- 172.21.15.60:0/1796541240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070950 0x7f6dac06ec70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6dac069590 tx=0x7f6d9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92db50532d82132c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6daa7fc700 1 -- 172.21.15.60:0/1796541240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00b860 con 0x7f6dac070950 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6daa7fc700 1 -- 172.21.15.60:0/1796541240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00b9c0 con 0x7f6dac070950 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6daa7fc700 1 -- 172.21.15.60:0/1796541240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00bd60 con 0x7f6dac070950 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 -- 172.21.15.60:0/1796541240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070950 msgr2=0x7f6dac06ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 --2- 172.21.15.60:0/1796541240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070950 0x7f6dac06ec70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6dac069590 tx=0x7f6d9c009250 comp rx=0 tx=0).stop 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 -- 172.21.15.60:0/1796541240 shutdown_connections 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 --2- 172.21.15.60:0/1796541240 >> v2:172.21.15.144:3300/0 conn(0x7f6dac1431f0 0x7f6dac143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 --2- 172.21.15.60:0/1796541240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070950 0x7f6dac06ec70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 --2- 172.21.15.60:0/1796541240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac070d20 0x7f6dac067e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 -- 172.21.15.60:0/1796541240 >> 172.21.15.60:0/1796541240 conn(0x7f6dac0ce570 msgr2=0x7f6dac0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:41.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 -- 172.21.15.60:0/1796541240 shutdown_connections 2023-10-08T16:05:41.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.399+0000 7f6db1c71700 1 -- 172.21.15.60:0/1796541240 wait complete. 2023-10-08T16:05:41.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 Processor -- start 2023-10-08T16:05:41.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 -- start start 2023-10-08T16:05:41.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dac070950 0x7f6dac15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 0x7f6dac0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac1431f0 0x7f6dac0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac15bd50 con 0x7f6dac070d20 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac15cbb0 con 0x7f6dac070950 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.401+0000 7f6db1c71700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac15bfa0 con 0x7f6dac1431f0 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 0x7f6dac0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 0x7f6dac0c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49722/0 (socket says 172.21.15.60:49722) 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 -- 172.21.15.60:0/2523735617 learned_addr learned my addr 172.21.15.60:0/2523735617 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6dabfff700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac1431f0 0x7f6dac0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6dab7fe700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dac070950 0x7f6dac15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 -- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac1431f0 msgr2=0x7f6dac0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac1431f0 0x7f6dac0b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 -- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dac070950 msgr2=0x7f6dac15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dac070950 0x7f6dac15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 -- 172.21.15.60:0/2523735617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0094f0 con 0x7f6dac070d20 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6daaffd700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 0x7f6dac0c7030 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c800 tx=0x7f6da0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011600 con 0x7f6dac070d20 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0011760 con 0x7f6dac070d20 2023-10-08T16:05:41.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac15c280 con 0x7f6dac070d20 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011b20 con 0x7f6dac070d20 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.402+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac15c840 con 0x7f6dac070d20 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.403+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac15cd40 con 0x7f6dac070d20 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.404+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6da00193f0 con 0x7f6dac070d20 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.404+0000 7f6d937fe700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.404+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6da00849b0 con 0x7f6dac070d20 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.404+0000 7f6dab7fe700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:41.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.404+0000 7f6dab7fe700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6dac069590 tx=0x7f6d9c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:41.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.408+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6da0051bd0 con 0x7f6dac070d20 2023-10-08T16:05:41.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:41.606+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6dac04c3c0 con 0x7f6dac070d20 2023-10-08T16:05:42.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.340+0000 7f6d937fe700 1 -- 172.21.15.60:0/2523735617 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6da00551f0 con 0x7f6dac070d20 2023-10-08T16:05:42.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d98066f30 msgr2=0x7f6d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6dac069590 tx=0x7f6d9c017000 comp rx=0 tx=0).stop 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 msgr2=0x7f6dac0c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 0x7f6dac0c7030 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c800 tx=0x7f6da0008040 comp rx=0 tx=0).stop 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 shutdown_connections 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dac1431f0 0x7f6dac0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dac070950 0x7f6dac15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 --2- 172.21.15.60:0/2523735617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac070d20 0x7f6dac0c7030 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 >> 172.21.15.60:0/2523735617 conn(0x7f6dac0ce570 msgr2=0x7f6dac0cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 shutdown_connections 2023-10-08T16:05:42.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.343+0000 7f6db1c71700 1 -- 172.21.15.60:0/2523735617 wait complete. 2023-10-08T16:05:42.345 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:05:42.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:05:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.486+0000 7fbfa1d21700 1 Processor -- start 2023-10-08T16:05:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.486+0000 7fbfa1d21700 1 -- start start 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.487+0000 7fbfa1d21700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c067c80 0x7fbf9c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.487+0000 7fbfa1d21700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 0x7fbf9c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.487+0000 7fbfa1d21700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c15e720 con 0x7fbf9c0678b0 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.487+0000 7fbfa1d21700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c15b2f0 con 0x7fbf9c1578f0 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.487+0000 7fbfa1d21700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c15db10 con 0x7fbf9c067c80 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9affd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c067c80 0x7fbf9c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 0x7fbf9c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:42.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 0x7fbf9c0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:56046/0 (socket says 172.21.15.60:56046) 2023-10-08T16:05:42.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9bfff700 1 -- 172.21.15.60:0/3072532814 learned_addr learned my addr 172.21.15.60:0/3072532814 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9affd700 1 -- 172.21.15.60:0/3072532814 >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 msgr2=0x7fbf9c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9affd700 1 --2- 172.21.15.60:0/3072532814 >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 0x7fbf9c0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9affd700 1 -- 172.21.15.60:0/3072532814 >> v1:172.21.15.144:6789/0 conn(0x7fbf9c0678b0 legacy=0x7fbf9c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9a7fc700 1 -- 172.21.15.60:0/3072532814 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709954433 0 0) 0x7fbf9c15e720 con 0x7fbf9c0678b0 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9affd700 1 -- 172.21.15.60:0/3072532814 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c15ddf0 con 0x7fbf9c067c80 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9bfff700 1 --2- 172.21.15.60:0/3072532814 >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 0x7fbf9c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9affd700 1 --2- 172.21.15.60:0/3072532814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c067c80 0x7fbf9c1573b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf900098e0 tx=0x7fbf900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec30590003887e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:42.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.488+0000 7fbf9a7fc700 1 -- 172.21.15.60:0/3072532814 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000b640 con 0x7fbf9c067c80 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbf9a7fc700 1 -- 172.21.15.60:0/3072532814 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000b7a0 con 0x7fbf9c067c80 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbf9a7fc700 1 -- 172.21.15.60:0/3072532814 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000bb40 con 0x7fbf9c067c80 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 -- 172.21.15.60:0/3072532814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c067c80 msgr2=0x7fbf9c1573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/3072532814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c067c80 0x7fbf9c1573b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf900098e0 tx=0x7fbf900091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 -- 172.21.15.60:0/3072532814 shutdown_connections 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/3072532814 >> v2:172.21.15.144:3300/0 conn(0x7fbf9c1578f0 0x7fbf9c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/3072532814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c067c80 0x7fbf9c1573b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 -- 172.21.15.60:0/3072532814 >> 172.21.15.60:0/3072532814 conn(0x7fbf9c0d0dc0 msgr2=0x7fbf9c0d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 -- 172.21.15.60:0/3072532814 shutdown_connections 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.489+0000 7fbfa1d21700 1 -- 172.21.15.60:0/3072532814 wait complete. 2023-10-08T16:05:42.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.490+0000 7fbfa1d21700 1 Processor -- start 2023-10-08T16:05:42.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.490+0000 7fbfa1d21700 1 -- start start 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbfa1d21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 0x7fbf9c1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbfa1d21700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf9c067c80 0x7fbf9c0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbfa1d21700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c1578f0 0x7fbf9c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbfa1d21700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c1596f0 con 0x7fbf9c0678b0 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbfa1d21700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c154a00 con 0x7fbf9c067c80 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbfa1d21700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c158ae0 con 0x7fbf9c1578f0 2023-10-08T16:05:42.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 0x7fbf9c1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 0x7fbf9c1544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51844/0 (socket says 172.21.15.60:51844) 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 -- 172.21.15.60:0/1691351558 learned_addr learned my addr 172.21.15.60:0/1691351558 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9affd700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf9c067c80 0x7fbf9c0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9bfff700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c1578f0 0x7fbf9c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 -- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c1578f0 msgr2=0x7fbf9c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c1578f0 0x7fbf9c0b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 -- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf9c067c80 msgr2=0x7fbf9c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.491+0000 7fbf9b7fe700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf9c067c80 0x7fbf9c0b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbf9b7fe700 1 -- 172.21.15.60:0/1691351558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94009ae0 con 0x7fbf9c0678b0 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbf9affd700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf9c067c80 0x7fbf9c0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:42.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbf9b7fe700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 0x7fbf9c1544c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c7e0 tx=0x7fbf8c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c012700 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c012880 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf90009420 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c012c40 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.492+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c1590a0 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.493+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c04c3c0 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.493+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf8c01b400 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.494+0000 7fbf837fe700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf88066f30 0x7fbf880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.494+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fbf8c083fe0 con 0x7fbf9c0678b0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.494+0000 7fbf9affd700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf88066f30 0x7fbf880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:42.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.494+0000 7fbf9affd700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf88066f30 0x7fbf880693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c157f60 tx=0x7fbf90017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:42.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.498+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf8c051370 con 0x7fbf9c0678b0 2023-10-08T16:05:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:42.690+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf9c1599d0 con 0x7fbf9c0678b0 2023-10-08T16:05:43.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.342+0000 7fbf837fe700 1 -- 172.21.15.60:0/1691351558 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbf8c054990 con 0x7fbf9c0678b0 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf88066f30 msgr2=0x7fbf880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf88066f30 0x7fbf880693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c157f60 tx=0x7fbf90017000 comp rx=0 tx=0).stop 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 msgr2=0x7fbf9c1544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 0x7fbf9c1544c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c7e0 tx=0x7fbf8c007df0 comp rx=0 tx=0).stop 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 shutdown_connections 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf88066f30 0x7fbf880693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf9c1578f0 0x7fbf9c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c0678b0 0x7fbf9c1544c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 --2- 172.21.15.60:0/1691351558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf9c067c80 0x7fbf9c0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 >> 172.21.15.60:0/1691351558 conn(0x7fbf9c0d0dc0 msgr2=0x7fbf9c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:43.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 shutdown_connections 2023-10-08T16:05:43.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:43.345+0000 7fbfa1d21700 1 -- 172.21.15.60:0/1691351558 wait complete. 2023-10-08T16:05:43.347 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:05:43.360 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:05:43.361 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:05:43.361 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:05:43.361 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:05:43.361 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:05:43.361 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:05:43.362 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:05:43.362 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:05:43.362 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:05:43.362 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:05:43.362 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:05:43.362 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:05:43.363 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:05:43.363 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:05:43.363 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:05:43.363 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:05:43.370 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:05:43.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:05:43.371 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:05:43.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:05:43.373 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:05:43.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:05:43.412 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:05:43.413 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:43.413 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:05:43.414 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:43.415 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:05:43.416 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:43.490 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:05:43.490 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:05:43.491 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:05:45.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T16:05:49.373 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:05:49.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:05:49.375 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:05:49.375 DEBUG:teuthology.parallel:result is None 2023-10-08T16:05:49.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:05:49.452 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:05:49.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.508+0000 7fd3b7d62700 1 Processor -- start 2023-10-08T16:05:49.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.508+0000 7fd3b7d62700 1 -- start start 2023-10-08T16:05:49.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b7d62700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3b0157870 0x7fd3b015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b7d62700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b7d62700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b015cbb0 con 0x7fd3b015a620 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b7d62700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b015bfa0 con 0x7fd3b0157870 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b7d62700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b015c280 con 0x7fd3b0157c40 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b52fd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd3b015a620 0x7fd3b015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52684/0 (socket says 172.21.15.60:52684) 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b5afe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3b0157870 0x7fd3b015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b52fd700 1 -- 172.21.15.60:0/1051642668 learned_addr learned my addr 172.21.15.60:0/1051642668 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b62ff700 1 --2- 172.21.15.60:0/1051642668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b4afc700 1 -- 172.21.15.60:0/1051642668 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919481459 0 0) 0x7fd3b015cbb0 con 0x7fd3b015a620 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b4afc700 1 -- 172.21.15.60:0/1051642668 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39c003570 con 0x7fd3b015a620 2023-10-08T16:05:49.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b5afe700 1 -- 172.21.15.60:0/1051642668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 msgr2=0x7fd3b0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b5afe700 1 --2- 172.21.15.60:0/1051642668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b5afe700 1 -- 172.21.15.60:0/1051642668 >> v1:172.21.15.60:6789/0 conn(0x7fd3b015a620 legacy=0x7fd3b015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b5afe700 1 -- 172.21.15.60:0/1051642668 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b015c560 con 0x7fd3b0157870 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.509+0000 7fd3b5afe700 1 --2- 172.21.15.60:0/1051642668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b015b6a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0098e0 tx=0x7fd3ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7d9890ab636e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b4afc700 1 -- 172.21.15.60:0/1051642668 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac011630 con 0x7fd3b0157870 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b4afc700 1 -- 172.21.15.60:0/1051642668 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac011790 con 0x7fd3b0157870 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b4afc700 1 -- 172.21.15.60:0/1051642668 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac011b30 con 0x7fd3b0157870 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 -- 172.21.15.60:0/1051642668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 msgr2=0x7fd3b015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/1051642668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b015b6a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0098e0 tx=0x7fd3ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 -- 172.21.15.60:0/1051642668 shutdown_connections 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/1051642668 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/1051642668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b015b6a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 -- 172.21.15.60:0/1051642668 >> 172.21.15.60:0/1051642668 conn(0x7fd3b0068ce0 msgr2=0x7fd3b00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 -- 172.21.15.60:0/1051642668 shutdown_connections 2023-10-08T16:05:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.510+0000 7fd3b7d62700 1 -- 172.21.15.60:0/1051642668 wait complete. 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 Processor -- start 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 -- start start 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b00b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b016d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b015a620 0x7fd3b016dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0151cb0 con 0x7fd3b0157870 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0151980 con 0x7fd3b015a620 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b7d62700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00b2eb0 con 0x7fd3b0157c40 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b5afe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b00b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:49.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b5afe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b00b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51914/0 (socket says 172.21.15.60:51914) 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.512+0000 7fd3b5afe700 1 -- 172.21.15.60:0/3075478208 learned_addr learned my addr 172.21.15.60:0/3075478208 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b62ff700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b015a620 0x7fd3b016dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b52fd700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b016d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b5afe700 1 -- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 msgr2=0x7fd3b016d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b5afe700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b016d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b5afe700 1 -- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b015a620 msgr2=0x7fd3b016dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b5afe700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b015a620 0x7fd3b016dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b5afe700 1 -- 172.21.15.60:0/3075478208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009420 con 0x7fd3b0157870 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b5afe700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b00b24f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd3b006b530 tx=0x7fd3ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac011b10 con 0x7fd3b0157870 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0253f0 con 0x7fd3b0157870 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b00b3190 con 0x7fd3b0157870 2023-10-08T16:05:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0257b0 con 0x7fd3b0157870 2023-10-08T16:05:49.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.513+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b013d4a0 con 0x7fd3b0157870 2023-10-08T16:05:49.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.514+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b004c3c0 con 0x7fd3b0157870 2023-10-08T16:05:49.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.515+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3ac025ba0 con 0x7fd3b0157870 2023-10-08T16:05:49.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.515+0000 7fd3a5ffb700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:49.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.515+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd3ac085c10 con 0x7fd3b0157870 2023-10-08T16:05:49.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.515+0000 7fd3b52fd700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:49.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.516+0000 7fd3b52fd700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd394066f30 0x7fd3940693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3b014d620 tx=0x7fd3a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.520+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3ac0530e0 con 0x7fd3b0157870 2023-10-08T16:05:49.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:49.729+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd3b015c840 con 0x7fd3b0157870 2023-10-08T16:05:51.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.372+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/3075478208 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd3ac056700 con 0x7fd3b0157870 2023-10-08T16:05:51.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd394066f30 msgr2=0x7fd3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd394066f30 0x7fd3940693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3b014d620 tx=0x7fd3a0009040 comp rx=0 tx=0).stop 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 msgr2=0x7fd3b00b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b00b24f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd3b006b530 tx=0x7fd3ac017000 comp rx=0 tx=0).stop 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 shutdown_connections 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b015a620 0x7fd3b016dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3b0157870 0x7fd3b00b24f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 --2- 172.21.15.60:0/3075478208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3b0157c40 0x7fd3b016d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 >> 172.21.15.60:0/3075478208 conn(0x7fd3b0068ce0 msgr2=0x7fd3b0159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 shutdown_connections 2023-10-08T16:05:51.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.375+0000 7fd3b7d62700 1 -- 172.21.15.60:0/3075478208 wait complete. 2023-10-08T16:05:51.377 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:05:51.390 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.515+0000 7f6d19765700 1 Processor -- start 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d19765700 1 -- start start 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d19765700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d14070e10 0x7f6d140c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d19765700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d140ca270 con 0x7f6d140afd90 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d19765700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d140c87c0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d19765700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1406e3e0 con 0x7f6d14070e10 2023-10-08T16:05:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d12ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6d140afd90 0x7f6d1415b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52692/0 (socket says 172.21.15.60:52692) 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.516+0000 7f6d12ffd700 1 -- 172.21.15.60:0/4099578194 learned_addr learned my addr 172.21.15.60:0/4099578194 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d137fe700 1 --2- 172.21.15.60:0/4099578194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d14070e10 0x7f6d140c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240672907 0 0) 0x7f6d140ca270 con 0x7f6d140afd90 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d00003570 con 0x7f6d140afd90 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823119117 0 0) 0x7f6d140c87c0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d140ca270 con 0x7f6d1406f1a0 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867332203 0 0) 0x7f6d00003570 con 0x7f6d140afd90 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d137fe700 1 -- 172.21.15.60:0/4099578194 >> v1:172.21.15.144:6789/0 conn(0x7f6d1406f1a0 legacy=0x7f6d14070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d137fe700 1 -- 172.21.15.60:0/4099578194 >> v1:172.21.15.60:6789/0 conn(0x7f6d140afd90 legacy=0x7f6d1415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d137fe700 1 -- 172.21.15.60:0/4099578194 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1406e6c0 con 0x7f6d14070e10 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d137fe700 1 --2- 172.21.15.60:0/4099578194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d14070e10 0x7f6d140c9c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009910 tx=0x7f6d0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f5249c6898c456f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:51.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040017f0 con 0x7f6d14070e10 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c011420 con 0x7f6d14070e10 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.517+0000 7f6d11ffb700 1 -- 172.21.15.60:0/4099578194 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0117a0 con 0x7f6d14070e10 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 -- 172.21.15.60:0/4099578194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d14070e10 msgr2=0x7f6d140c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 --2- 172.21.15.60:0/4099578194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d14070e10 0x7f6d140c9c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009910 tx=0x7f6d0c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 -- 172.21.15.60:0/4099578194 shutdown_connections 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 --2- 172.21.15.60:0/4099578194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d14070e10 0x7f6d140c9c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 -- 172.21.15.60:0/4099578194 >> 172.21.15.60:0/4099578194 conn(0x7f6d140ca4f0 msgr2=0x7f6d140ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 -- 172.21.15.60:0/4099578194 shutdown_connections 2023-10-08T16:05:51.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.518+0000 7f6d19765700 1 -- 172.21.15.60:0/4099578194 wait complete. 2023-10-08T16:05:51.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.519+0000 7f6d19765700 1 Processor -- start 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.519+0000 7f6d19765700 1 -- start start 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d19765700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 0x7f6d1416d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d19765700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d14070e10 0x7f6d1416de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d19765700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d140afd90 0x7f6d14148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d19765700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14159cb0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d19765700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140c28c0 con 0x7f6d14070e10 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d19765700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140c2ba0 con 0x7f6d140afd90 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 0x7f6d1416d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 0x7f6d1416d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51926/0 (socket says 172.21.15.60:51926) 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d12ffd700 1 -- 172.21.15.60:0/1829366548 learned_addr learned my addr 172.21.15.60:0/1829366548 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:51.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d137fe700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d140afd90 0x7f6d14148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.520+0000 7f6d127fc700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d14070e10 0x7f6d1416de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d12ffd700 1 -- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d140afd90 msgr2=0x7f6d14148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d12ffd700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d140afd90 0x7f6d14148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d12ffd700 1 -- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d14070e10 msgr2=0x7f6d1416de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d12ffd700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d14070e10 0x7f6d1416de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d12ffd700 1 -- 172.21.15.60:0/1829366548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c009420 con 0x7f6d1406f1a0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d12ffd700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 0x7f6d1416d920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400cbc0 tx=0x7f6d04007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04004dc0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d04007150 con 0x7f6d1406f1a0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04007510 con 0x7f6d1406f1a0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d140c2e80 con 0x7f6d1406f1a0 2023-10-08T16:05:51.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.521+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d140b3620 con 0x7f6d1406f1a0 2023-10-08T16:05:51.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.522+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d140c33a0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.522+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d04007880 con 0x7f6d1406f1a0 2023-10-08T16:05:51.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.523+0000 7f6d0affd700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.523+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6d04083870 con 0x7f6d1406f1a0 2023-10-08T16:05:51.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.523+0000 7f6d127fc700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.523+0000 7f6d127fc700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6cf4066f30 0x7f6cf40693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d14156f90 tx=0x7f6cfc007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:51.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.527+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d140c33a0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.799+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6d140c33a0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.800+0000 7f6d0affd700 1 -- 172.21.15.60:0/1829366548 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6d140c33a0 con 0x7f6d1406f1a0 2023-10-08T16:05:51.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.801 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.802 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.803 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.804 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.805 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.807 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:05:51.808 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.809 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:05:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:05:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mds", 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAb0yJlFk1pHxAAQHkp4xMIXXyC3amBnr5Gdg==", 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAb0yJlVFppHxAAwwttdu6dcvYjEN5FKK7TRQ==", 2023-10-08T16:05:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-osd", 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAb0yJlemJpHxAAaohmJrR5bRE4v0j6sU75lQ==", 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAb0yJlpWtpHxAAkxsCMWgxEMbjr63O7reNHQ==", 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAb0yJl4nNpHxAABn/OmizJmFhUsw/0e3coIw==", 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAb0yJlZnxpHxAAeKjHT75BxAx+gyvnaGn3MQ==", 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:05:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:05:51.821 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:05:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6cf4066f30 msgr2=0x7f6cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6cf4066f30 0x7f6cf40693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d14156f90 tx=0x7f6cfc007d50 comp rx=0 tx=0).stop 2023-10-08T16:05:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 msgr2=0x7f6d1416d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 0x7f6d1416d920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400cbc0 tx=0x7f6d04007d20 comp rx=0 tx=0).stop 2023-10-08T16:05:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 shutdown_connections 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d140afd90 0x7f6d14148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d1406f1a0 0x7f6d1416d920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 --2- 172.21.15.60:0/1829366548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d14070e10 0x7f6d1416de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 >> 172.21.15.60:0/1829366548 conn(0x7f6d140ca4f0 msgr2=0x7f6d14070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 shutdown_connections 2023-10-08T16:05:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.802+0000 7f6d19765700 1 -- 172.21.15.60:0/1829366548 wait complete. 2023-10-08T16:05:51.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T16:05:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.942+0000 7fb71f6ee700 1 Processor -- start 2023-10-08T16:05:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.943+0000 7fb71f6ee700 1 -- start start 2023-10-08T16:05:51.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.943+0000 7fb71f6ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb71815a2b0 0x7fb7180b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71f6ee700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180c5d80 con 0x7fb7180d1c30 2023-10-08T16:05:51.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71f6ee700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180c6060 con 0x7fb7180cfe20 2023-10-08T16:05:51.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71f6ee700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb718068470 con 0x7fb71815a2b0 2023-10-08T16:05:51.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71d48a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb71815a2b0 0x7fb7180b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71cc89700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb7180d1c30 0x7fb7180cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52706/0 (socket says 172.21.15.60:52706) 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71cc89700 1 -- 172.21.15.60:0/1013989645 learned_addr learned my addr 172.21.15.60:0/1013989645 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71d48a700 1 -- 172.21.15.60:0/1013989645 >> v1:172.21.15.144:6789/0 conn(0x7fb7180cfe20 legacy=0x7fb7180c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71d48a700 1 -- 172.21.15.60:0/1013989645 >> v1:172.21.15.60:6789/0 conn(0x7fb7180d1c30 legacy=0x7fb7180cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71d48a700 1 -- 172.21.15.60:0/1013989645 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180c6340 con 0x7fb71815a2b0 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb71d48a700 1 --2- 172.21.15.60:0/1013989645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb71815a2b0 0x7fb7180b3da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb708009eb0 tx=0x7fb708009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32667c7d038d14d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb717fff700 1 -- 172.21.15.60:0/1013989645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800e070 con 0x7fb71815a2b0 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb717fff700 1 -- 172.21.15.60:0/1013989645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70800bbf0 con 0x7fb71815a2b0 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.944+0000 7fb717fff700 1 -- 172.21.15.60:0/1013989645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708012430 con 0x7fb71815a2b0 2023-10-08T16:05:51.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 -- 172.21.15.60:0/1013989645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb71815a2b0 msgr2=0x7fb7180b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/1013989645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb71815a2b0 0x7fb7180b3da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb708009eb0 tx=0x7fb708009780 comp rx=0 tx=0).stop 2023-10-08T16:05:51.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 -- 172.21.15.60:0/1013989645 shutdown_connections 2023-10-08T16:05:51.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/1013989645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb71815a2b0 0x7fb7180b3da0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 -- 172.21.15.60:0/1013989645 >> 172.21.15.60:0/1013989645 conn(0x7fb718067e40 msgr2=0x7fb7180d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:51.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 -- 172.21.15.60:0/1013989645 shutdown_connections 2023-10-08T16:05:51.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.945+0000 7fb71f6ee700 1 -- 172.21.15.60:0/1013989645 wait complete. 2023-10-08T16:05:51.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.946+0000 7fb71f6ee700 1 Processor -- start 2023-10-08T16:05:51.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.946+0000 7fb71f6ee700 1 -- start start 2023-10-08T16:05:51.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71f6ee700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7180cfe20 0x7fb718155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71f6ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 0x7fb7180b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71f6ee700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb71815a2b0 0x7fb7180b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71f6ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180c91d0 con 0x7fb7180d1c30 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71f6ee700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71816a720 con 0x7fb7180cfe20 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71f6ee700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180c8650 con 0x7fb71815a2b0 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 0x7fb7180b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 0x7fb7180b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51944/0 (socket says 172.21.15.60:51944) 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 -- 172.21.15.60:0/216882577 learned_addr learned my addr 172.21.15.60:0/216882577 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 -- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb71815a2b0 msgr2=0x7fb7180b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb71815a2b0 0x7fb7180b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 -- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7180cfe20 msgr2=0x7fb718155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71d48a700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7180cfe20 0x7fb718155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7180cfe20 0x7fb718155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 -- 172.21.15.60:0/216882577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009a20 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.947+0000 7fb71cc89700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 0x7fb7180b57b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c590 tx=0x7fb70c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.948+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c005b30 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.948+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c005cb0 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.948+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7180c8930 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.948+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c007320 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.948+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7180c8ef0 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.949+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71816a8e0 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.949+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb70c01b3b0 con 0x7fb7180d1c30 2023-10-08T16:05:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.949+0000 7fb7157fa700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb704066f30 0x7fb7040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:51.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.950+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb70c0836b0 con 0x7fb7180d1c30 2023-10-08T16:05:51.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.950+0000 7fb71d48a700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb704066f30 0x7fb7040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:51.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.950+0000 7fb71d48a700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb704066f30 0x7fb7040693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097c0 tx=0x7fb708016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:51.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:51.954+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb71816a8e0 con 0x7fb7180d1c30 2023-10-08T16:05:52.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.224+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb71816a8e0 con 0x7fb7180d1c30 2023-10-08T16:05:52.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.227+0000 7fb7157fa700 1 -- 172.21.15.60:0/216882577 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb71816a8e0 con 0x7fb7180d1c30 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb704066f30 msgr2=0x7fb7040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb704066f30 0x7fb7040693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097c0 tx=0x7fb708016000 comp rx=0 tx=0).stop 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 msgr2=0x7fb7180b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 0x7fb7180b57b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c590 tx=0x7fb70c001020 comp rx=0 tx=0).stop 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 shutdown_connections 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb704066f30 0x7fb7040693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb71815a2b0 0x7fb7180b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7180cfe20 0x7fb718155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 --2- 172.21.15.60:0/216882577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7180d1c30 0x7fb7180b57b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 >> 172.21.15.60:0/216882577 conn(0x7fb718067e40 msgr2=0x7fb718159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:52.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 shutdown_connections 2023-10-08T16:05:52.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.229+0000 7fb71f6ee700 1 -- 172.21.15.60:0/216882577 wait complete. 2023-10-08T16:05:52.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T16:05:52.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.360+0000 7f12a2f8b700 1 Processor -- start 2023-10-08T16:05:52.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a2f8b700 1 -- start start 2023-10-08T16:05:52.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a2f8b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a2f8b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f129c15b0d0 0x7f129c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a2f8b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c15c360 con 0x7f129c1577d0 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a2f8b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c15b790 con 0x7f129c15b0d0 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a2f8b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c15d800 con 0x7f129c157ba0 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.361+0000 7f12a1528700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f129c15b0d0 0x7f129c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f129c15b0d0 0x7f129c06aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42646/0 (socket says 172.21.15.60:42646) 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 -- 172.21.15.60:0/1382019598 learned_addr learned my addr 172.21.15.60:0/1382019598 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f129bfff700 1 --2- 172.21.15.60:0/1382019598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 -- 172.21.15.60:0/1382019598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 msgr2=0x7f129c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 --2- 172.21.15.60:0/1382019598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 -- 172.21.15.60:0/1382019598 >> v1:172.21.15.144:6789/0 conn(0x7f129c1577d0 legacy=0x7f129c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 -- 172.21.15.60:0/1382019598 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c15ba30 con 0x7f129c15b0d0 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f12a1528700 1 --2- 172.21.15.60:0/1382019598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c06aa60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12840099b0 tx=0x7f1284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a172ea0af8fdb954 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f129b7fe700 1 -- 172.21.15.60:0/1382019598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400b860 con 0x7f129c15b0d0 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f129b7fe700 1 -- 172.21.15.60:0/1382019598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128400b9c0 con 0x7f129c15b0d0 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.362+0000 7f129b7fe700 1 -- 172.21.15.60:0/1382019598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400bd60 con 0x7f129c15b0d0 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1382019598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 msgr2=0x7f129c06aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1382019598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c06aa60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12840099b0 tx=0x7f1284009250 comp rx=0 tx=0).stop 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1382019598 shutdown_connections 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1382019598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c06aa60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1382019598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1382019598 >> 172.21.15.60:0/1382019598 conn(0x7f129c068ce0 msgr2=0x7f129c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1382019598 shutdown_connections 2023-10-08T16:05:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.363+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1382019598 wait complete. 2023-10-08T16:05:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.364+0000 7f12a2f8b700 1 Processor -- start 2023-10-08T16:05:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.364+0000 7f12a2f8b700 1 -- start start 2023-10-08T16:05:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a2f8b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f129c1577d0 0x7f129c169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a2f8b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a2f8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a2f8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c16b040 con 0x7f129c15b0d0 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a2f8b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c16a520 con 0x7f129c1577d0 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a2f8b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c14bd80 con 0x7f129c157ba0 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c0d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42648/0 (socket says 172.21.15.60:42648) 2023-10-08T16:05:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 -- 172.21.15.60:0/1774234679 learned_addr learned my addr 172.21.15.60:0/1774234679 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f129bfff700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a0d27700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f129c1577d0 0x7f129c169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 -- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 msgr2=0x7f129c14b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c14b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 -- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f129c1577d0 msgr2=0x7f129c169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f129c1577d0 0x7f129c169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 -- 172.21.15.60:0/1774234679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840094f0 con 0x7f129c15b0d0 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a0d27700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f129c1577d0 0x7f129c169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f129bfff700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c14b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.365+0000 7f12a1528700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c0d01c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f129c06b580 tx=0x7f1284017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.366+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284006bc0 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.366+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128401a660 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.366+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c16a7a0 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.366+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128401aa00 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.366+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c16ad60 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.366+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c0b0010 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.367+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f128401b430 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.367+0000 7f1298ff9700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f127c066f30 0x7f127c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.367+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1284085bd0 con 0x7f129c15b0d0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.367+0000 7f12a0d27700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f127c066f30 0x7f127c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.368+0000 7f12a0d27700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f127c066f30 0x7f127c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1294007fd0 tx=0x7f1294009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.372+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1284053210 con 0x7f129c15b0d0 2023-10-08T16:05:52.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T16:05:52.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.642+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f129c04c3c0 con 0x7f129c15b0d0 2023-10-08T16:05:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.645+0000 7f1298ff9700 1 -- 172.21.15.60:0/1774234679 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f128405ae60 con 0x7f129c15b0d0 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f127c066f30 msgr2=0x7f127c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f127c066f30 0x7f127c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1294007fd0 tx=0x7f1294009040 comp rx=0 tx=0).stop 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 msgr2=0x7f129c0d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c0d01c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f129c06b580 tx=0x7f1284017000 comp rx=0 tx=0).stop 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 shutdown_connections 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f127c066f30 0x7f127c0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f129c15b0d0 0x7f129c0d01c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f129c1577d0 0x7f129c169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 --2- 172.21.15.60:0/1774234679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f129c157ba0 0x7f129c14b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 >> 172.21.15.60:0/1774234679 conn(0x7f129c068ce0 msgr2=0x7f129c156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:52.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 shutdown_connections 2023-10-08T16:05:52.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.647+0000 7f12a2f8b700 1 -- 172.21.15.60:0/1774234679 wait complete. 2023-10-08T16:05:52.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T16:05:52.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.779+0000 7fe2d5ce1700 1 Processor -- start 2023-10-08T16:05:52.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.779+0000 7fe2d5ce1700 1 -- start start 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2d5ce1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe2d00cf1c0 0x7fe2d015e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2d5ce1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00cca20 con 0x7fe2d015a0c0 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2d5ce1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d015ea40 con 0x7fe2d0159cf0 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2d5ce1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d0067660 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ceffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe2d00cf1c0 0x7fe2d015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2cffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe2d015a0c0 0x7fe2d0068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40378/0 (socket says 172.21.15.60:40378) 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2cffff700 1 -- 172.21.15.60:0/3779729027 learned_addr learned my addr 172.21.15.60:0/3779729027 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ceffd700 1 -- 172.21.15.60:0/3779729027 >> v1:172.21.15.144:6789/0 conn(0x7fe2d0159cf0 legacy=0x7fe2d00ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ceffd700 1 -- 172.21.15.60:0/3779729027 >> v1:172.21.15.60:6789/0 conn(0x7fe2d015a0c0 legacy=0x7fe2d0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ce7fc700 1 -- 172.21.15.60:0/3779729027 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450520352 0 0) 0x7fe2d00cca20 con 0x7fe2d015a0c0 2023-10-08T16:05:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ceffd700 1 -- 172.21.15.60:0/3779729027 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0067f00 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ceffd700 1 --2- 172.21.15.60:0/3779729027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d015e500 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40098e0 tx=0x7fe2c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f016e4f31ddf988 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:52.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ce7fc700 1 -- 172.21.15.60:0/3779729027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4009e80 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ce7fc700 1 -- 172.21.15.60:0/3779729027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400b860 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.780+0000 7fe2ce7fc700 1 -- 172.21.15.60:0/3779729027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400bbe0 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3779729027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 msgr2=0x7fe2d015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3779729027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d015e500 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40098e0 tx=0x7fe2c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3779729027 shutdown_connections 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3779729027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d015e500 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3779729027 >> 172.21.15.60:0/3779729027 conn(0x7fe2d006c6e0 msgr2=0x7fe2d0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3779729027 shutdown_connections 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.781+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3779729027 wait complete. 2023-10-08T16:05:52.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.782+0000 7fe2d5ce1700 1 Processor -- start 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.782+0000 7fe2d5ce1700 1 -- start start 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2d5ce1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2d5ce1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d0159cf0 0x7fe2d0158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2d5ce1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d015a0c0 0x7fe2d0156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2d5ce1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01565e0 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2d5ce1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0157e80 con 0x7fe2d015a0c0 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2d5ce1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0158160 con 0x7fe2d0159cf0 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d0154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42658/0 (socket says 172.21.15.60:42658) 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 -- 172.21.15.60:0/3699303680 learned_addr learned my addr 172.21.15.60:0/3699303680 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cffff700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d015a0c0 0x7fe2d0156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2ceffd700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d0159cf0 0x7fe2d0158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 -- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d0159cf0 msgr2=0x7fe2d0158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d0159cf0 0x7fe2d0158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 -- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d015a0c0 msgr2=0x7fe2d0156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d015a0c0 0x7fe2d0156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cf7fe700 1 -- 172.21.15.60:0/3699303680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4009420 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2ceffd700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d0159cf0 0x7fe2d0158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.783+0000 7fe2cffff700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d015a0c0 0x7fe2d0156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.784+0000 7fe2cf7fe700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d0154110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c590 tx=0x7fe2c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.784+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0011590 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.784+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00116f0 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.784+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0158440 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.784+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0011ab0 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.784+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d0154650 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.785+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d004c3c0 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.785+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2c001b3b0 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.786+0000 7fe2b77fe700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.786+0000 7fe2ceffd700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.786+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe2c0083610 con 0x7fe2d00cf1c0 2023-10-08T16:05:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.786+0000 7fe2ceffd700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2bc066f30 0x7fe2bc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40093f0 tx=0x7fe2c4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:52.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:52.790+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2c0050bd0 con 0x7fe2d00cf1c0 2023-10-08T16:05:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.063+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe2d015ea40 con 0x7fe2d00cf1c0 2023-10-08T16:05:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.066+0000 7fe2b77fe700 1 -- 172.21.15.60:0/3699303680 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe2d015ea40 con 0x7fe2d00cf1c0 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2bc066f30 msgr2=0x7fe2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2bc066f30 0x7fe2bc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40093f0 tx=0x7fe2c4017000 comp rx=0 tx=0).stop 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 msgr2=0x7fe2d0154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d0154110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c590 tx=0x7fe2c000c950 comp rx=0 tx=0).stop 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 shutdown_connections 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d015a0c0 0x7fe2d0156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d00cf1c0 0x7fe2d0154110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 --2- 172.21.15.60:0/3699303680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d0159cf0 0x7fe2d0158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 >> 172.21.15.60:0/3699303680 conn(0x7fe2d006c6e0 msgr2=0x7fe2d0155750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 shutdown_connections 2023-10-08T16:05:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.068+0000 7fe2d5ce1700 1 -- 172.21.15.60:0/3699303680 wait complete. 2023-10-08T16:05:53.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T16:05:53.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.200+0000 7f3d01048700 1 Processor -- start 2023-10-08T16:05:53.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.200+0000 7f3d01048700 1 -- start start 2023-10-08T16:05:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.201+0000 7f3d01048700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cfc0d1c30 0x7f3cfc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.201+0000 7f3d01048700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc0c5d80 con 0x7f3cfc15a680 2023-10-08T16:05:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.201+0000 7f3d01048700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc0c6060 con 0x7f3cfc15a2b0 2023-10-08T16:05:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.201+0000 7f3d01048700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc068470 con 0x7f3cfc0d1c30 2023-10-08T16:05:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.201+0000 7f3cfb59e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3cfc15a680 0x7f3cfc0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40390/0 (socket says 172.21.15.60:40390) 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.201+0000 7f3cfb59e700 1 -- 172.21.15.60:0/646917180 learned_addr learned my addr 172.21.15.60:0/646917180 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfa59c700 1 --2- 172.21.15.60:0/646917180 >> v2:172.21.15.144:3300/0 conn(0x7f3cfc0d1c30 0x7f3cfc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550581650 0 0) 0x7f3cfc0c5d80 con 0x7f3cfc15a680 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce8003570 con 0x7f3cfc15a680 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3782625510 0 0) 0x7f3ce8003570 con 0x7f3cfc15a680 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 >> v2:172.21.15.144:3300/0 conn(0x7f3cfc0d1c30 msgr2=0x7f3cfc0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 --2- 172.21.15.60:0/646917180 >> v2:172.21.15.144:3300/0 conn(0x7f3cfc0d1c30 0x7f3cfc0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 >> v1:172.21.15.144:6789/0 conn(0x7f3cfc15a2b0 legacy=0x7f3cfc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc0c6340 con 0x7f3cfc15a680 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f3cec0017f0 con 0x7f3cfc15a680 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 >> v1:172.21.15.60:6789/0 conn(0x7f3cfc15a680 legacy=0x7f3cfc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce8003a60 0x7f3ce8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce8004810 0x7f3ce8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80051c0 0x7f3ce800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc068470 con 0x7f3ce80051c0 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce800c0d0 con 0x7f3ce8004810 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce800c290 con 0x7f3ce8003a60 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfb59e700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80051c0 0x7f3ce800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfa59c700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce8004810 0x7f3ce8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfad9d700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce8003a60 0x7f3ce8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfb59e700 1 -- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce8003a60 msgr2=0x7f3ce8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfb59e700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce8003a60 0x7f3ce8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfb59e700 1 -- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce8004810 msgr2=0x7f3ce8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfb59e700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce8004810 0x7f3ce8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.202+0000 7f3cfb59e700 1 -- 172.21.15.60:0/646917180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce8003570 con 0x7f3ce80051c0 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3cfb59e700 1 -- 172.21.15.60:0/646917180 reap_dead start 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3cfb59e700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80051c0 0x7f3ce800ba60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00a930 tx=0x7f3cec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7c46ac5417123c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0070d0 con 0x7f3ce80051c0 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec007230 con 0x7f3ce80051c0 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3cf9d9b700 1 -- 172.21.15.60:0/646917180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0075d0 con 0x7f3ce80051c0 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 -- 172.21.15.60:0/646917180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80051c0 msgr2=0x7f3ce800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80051c0 0x7f3ce800ba60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00a930 tx=0x7f3cec0021d0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 -- 172.21.15.60:0/646917180 shutdown_connections 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 --2- 172.21.15.60:0/646917180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ce80051c0 0x7f3ce800ba60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 -- 172.21.15.60:0/646917180 >> 172.21.15.60:0/646917180 conn(0x7f3cfc067e40 msgr2=0x7f3cfc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:53.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 -- 172.21.15.60:0/646917180 shutdown_connections 2023-10-08T16:05:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.203+0000 7f3d01048700 1 -- 172.21.15.60:0/646917180 wait complete. 2023-10-08T16:05:53.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 Processor -- start 2023-10-08T16:05:53.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 -- start start 2023-10-08T16:05:53.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce80051c0 0x7f3cfc0b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 0x7f3cfc1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc0c8a80 0x7f3cfc0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0c9420 con 0x7f3cfc0caa50 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc15bb80 con 0x7f3cfc0c8a80 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3d01048700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0caec0 con 0x7f3ce80051c0 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.205+0000 7f3cfa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 0x7f3cfc1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 0x7f3cfc1554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42680/0 (socket says 172.21.15.60:42680) 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 -- 172.21.15.60:0/916877605 learned_addr learned my addr 172.21.15.60:0/916877605 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfad9d700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce80051c0 0x7f3cfc0b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfb59e700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc0c8a80 0x7f3cfc0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 -- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce80051c0 msgr2=0x7f3cfc0b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce80051c0 0x7f3cfc0b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 -- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc0c8a80 msgr2=0x7f3cfc0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc0c8a80 0x7f3cfc0c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 -- 172.21.15.60:0/916877605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc155fb0 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cfa59c700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 0x7f3cfc1554c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4011a40 tx=0x7f3ce40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4011e80 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400f940 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc0b5d40 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400fcc0 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.206+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc0b6300 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.207+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc04c3c0 con 0x7f3cfc0caa50 2023-10-08T16:05:53.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.207+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ce4014650 con 0x7f3cfc0caa50 2023-10-08T16:05:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.208+0000 7f3cf2ffd700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cdc066f30 0x7f3cdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.208+0000 7f3cfad9d700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cdc066f30 0x7f3cdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.208+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3ce4018030 con 0x7f3cfc0caa50 2023-10-08T16:05:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.208+0000 7f3cfad9d700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cdc066f30 0x7f3cdc0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc15b9e0 tx=0x7f3cf4007d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:53.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.212+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ce4055b30 con 0x7f3cfc0caa50 2023-10-08T16:05:53.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.485+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3cfc15bcc0 con 0x7f3cfc0caa50 2023-10-08T16:05:53.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.488+0000 7f3cf2ffd700 1 -- 172.21.15.60:0/916877605 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3ce40220a0 con 0x7f3cfc0caa50 2023-10-08T16:05:53.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cdc066f30 msgr2=0x7f3cdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cdc066f30 0x7f3cdc0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc15b9e0 tx=0x7f3cf4007d80 comp rx=0 tx=0).stop 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 msgr2=0x7f3cfc1554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 0x7f3cfc1554c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4011a40 tx=0x7f3ce40091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 shutdown_connections 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cdc066f30 0x7f3cdc0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ce80051c0 0x7f3cfc0b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc0c8a80 0x7f3cfc0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 --2- 172.21.15.60:0/916877605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0caa50 0x7f3cfc1554c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 >> 172.21.15.60:0/916877605 conn(0x7f3cfc067e40 msgr2=0x7f3cfc069910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 shutdown_connections 2023-10-08T16:05:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.490+0000 7f3d01048700 1 -- 172.21.15.60:0/916877605 wait complete. 2023-10-08T16:05:53.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T16:05:53.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.622+0000 7ff5e359e700 1 Processor -- start 2023-10-08T16:05:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.622+0000 7ff5e359e700 1 -- start start 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 0x7ff5e4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e415ea70 con 0x7ff5e4069040 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e359e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e40b3990 con 0x7ff5e4159da0 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40b34b0 con 0x7ff5e415a170 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e2d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff5e4069040 0x7ff5e40af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40392/0 (socket says 172.21.15.60:40392) 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e2d9d700 1 -- 172.21.15.60:0/3296354538 learned_addr learned my addr 172.21.15.60:0/3296354538 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:53.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e1d9b700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 0x7ff5e4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206085637 0 0) 0x7ff5e415ea70 con 0x7ff5e4069040 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.623+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5cc003570 con 0x7ff5e4069040 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944384649 0 0) 0x7ff5cc003570 con 0x7ff5e4069040 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 msgr2=0x7ff5e4068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 0x7ff5e4068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 >> v1:172.21.15.144:6789/0 conn(0x7ff5e4159da0 legacy=0x7ff5e40b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40b0b70 con 0x7ff5e4069040 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7ff5dc0017f0 con 0x7ff5e4069040 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 >> v1:172.21.15.60:6789/0 conn(0x7ff5e4069040 legacy=0x7ff5e40af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 0x7ff5cc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5cc004010 0x7ff5cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc004d50 0x7ff5cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40b34b0 con 0x7ff5cc004010 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc00bc70 con 0x7ff5cc004d50 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc00be30 con 0x7ff5e415a170 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e1d9b700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5cc004010 0x7ff5cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e2d9d700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc004d50 0x7ff5cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e259c700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 0x7ff5cc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e1d9b700 1 -- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 msgr2=0x7ff5cc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e1d9b700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e415a170 0x7ff5cc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e1d9b700 1 -- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc004d50 msgr2=0x7ff5cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e1d9b700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc004d50 0x7ff5cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.624+0000 7ff5e1d9b700 1 -- 172.21.15.60:0/3296354538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc003570 con 0x7ff5cc004010 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e1d9b700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5cc004010 0x7ff5cc004810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8006f00 tx=0x7ff5d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd11d7074833cdcc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800e710 con 0x7ff5cc004010 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800e870 con 0x7ff5cc004010 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e159a700 1 -- 172.21.15.60:0/3296354538 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800ec30 con 0x7ff5cc004010 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e359e700 1 -- 172.21.15.60:0/3296354538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5cc004010 msgr2=0x7ff5cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3296354538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5cc004010 0x7ff5cc004810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8006f00 tx=0x7ff5d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e2d9d700 1 -- 172.21.15.60:0/3296354538 reap_dead start 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e359e700 1 -- 172.21.15.60:0/3296354538 shutdown_connections 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e359e700 1 -- 172.21.15.60:0/3296354538 >> 172.21.15.60:0/3296354538 conn(0x7ff5e40d0bc0 msgr2=0x7ff5e40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e359e700 1 -- 172.21.15.60:0/3296354538 shutdown_connections 2023-10-08T16:05:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.625+0000 7ff5e359e700 1 -- 172.21.15.60:0/3296354538 wait complete. 2023-10-08T16:05:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.626+0000 7ff5e359e700 1 Processor -- start 2023-10-08T16:05:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.626+0000 7ff5e359e700 1 -- start start 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5cc004010 0x7ff5e41466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e40ca370 0x7ff5e4158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 0x7ff5e41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40c53c0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4146c20 con 0x7ff5e40ca370 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40cada0 con 0x7ff5cc004010 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 0x7ff5e41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 0x7ff5e41590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42702/0 (socket says 172.21.15.60:42702) 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e2d9d700 1 -- 172.21.15.60:0/3194884298 learned_addr learned my addr 172.21.15.60:0/3194884298 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.627+0000 7ff5e1d9b700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e40ca370 0x7ff5e4158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e259c700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5cc004010 0x7ff5e41466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e2d9d700 1 -- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5cc004010 msgr2=0x7ff5e41466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e2d9d700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5cc004010 0x7ff5e41466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e2d9d700 1 -- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e40ca370 msgr2=0x7ff5e4158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e2d9d700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e40ca370 0x7ff5e4158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e2d9d700 1 -- 172.21.15.60:0/3194884298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40c4d70 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e2d9d700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 0x7ff5e41590a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff5e406b5c0 tx=0x7ff5dc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00ae10 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc0133f0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e40c5050 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0137b0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.628+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e40b3b70 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.629+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e40c4bd0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.629+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5dc013be0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.630+0000 7ff5d27fc700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5c4066f30 0x7ff5c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:53.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.630+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff5dc084bd0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.630+0000 7ff5e259c700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5c4066f30 0x7ff5c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:53.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.630+0000 7ff5e259c700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5c4066f30 0x7ff5c40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4000f60 tx=0x7ff5d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:53.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.634+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5e40c4bd0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.903+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff5e40c4bd0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.906+0000 7ff5d27fc700 1 -- 172.21.15.60:0/3194884298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff5e40c4bd0 con 0x7ff5e40ca7e0 2023-10-08T16:05:53.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5c4066f30 msgr2=0x7ff5c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5c4066f30 0x7ff5c40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4000f60 tx=0x7ff5d4009040 comp rx=0 tx=0).stop 2023-10-08T16:05:53.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 msgr2=0x7ff5e41590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:53.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 0x7ff5e41590a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff5e406b5c0 tx=0x7ff5dc0021d0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 shutdown_connections 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5c4066f30 0x7ff5c40693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5cc004010 0x7ff5e41466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e40ca7e0 0x7ff5e41590a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 --2- 172.21.15.60:0/3194884298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e40ca370 0x7ff5e4158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 >> 172.21.15.60:0/3194884298 conn(0x7ff5e40d0bc0 msgr2=0x7ff5e40b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 shutdown_connections 2023-10-08T16:05:53.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:53.908+0000 7ff5e359e700 1 -- 172.21.15.60:0/3194884298 wait complete. 2023-10-08T16:05:53.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T16:05:54.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.040+0000 7f7c626aa700 1 Processor -- start 2023-10-08T16:05:54.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.040+0000 7f7c626aa700 1 -- start start 2023-10-08T16:05:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c626aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c5c0affa0 0x7f7c5c0a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c626aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c5c0af3d0 0x7f7c5c0a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c626aa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c0ccac0 con 0x7f7c5c0af000 2023-10-08T16:05:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c626aa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0b1bd0 con 0x7f7c5c0affa0 2023-10-08T16:05:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c626aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0b1eb0 con 0x7f7c5c0af3d0 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c5b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c5c0affa0 0x7f7c5c0a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c5bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7c5c0af000 0x7f7c5c0b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40402/0 (socket says 172.21.15.60:40402) 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c5bfff700 1 -- 172.21.15.60:0/1145193693 learned_addr learned my addr 172.21.15.60:0/1145193693 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.041+0000 7f7c60c47700 1 --2- 172.21.15.60:0/1145193693 >> v2:172.21.15.144:3300/0 conn(0x7f7c5c0af3d0 0x7f7c5c0a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/1145193693 >> v2:172.21.15.144:3300/0 conn(0x7f7c5c0af3d0 msgr2=0x7f7c5c0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5b7fe700 1 --2- 172.21.15.60:0/1145193693 >> v2:172.21.15.144:3300/0 conn(0x7f7c5c0af3d0 0x7f7c5c0a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/1145193693 >> v1:172.21.15.60:6789/0 conn(0x7f7c5c0af000 legacy=0x7f7c5c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5affd700 1 -- 172.21.15.60:0/1145193693 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140498170 0 0) 0x7f7c5c0ccac0 con 0x7f7c5c0af000 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/1145193693 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0b2190 con 0x7f7c5c0affa0 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5b7fe700 1 --2- 172.21.15.60:0/1145193693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c0a7400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c06d520 tx=0x7f7c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af8048bf605b441 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5affd700 1 -- 172.21.15.60:0/1145193693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400b690 con 0x7f7c5c0affa0 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5affd700 1 -- 172.21.15.60:0/1145193693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400b7f0 con 0x7f7c5c0affa0 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c5affd700 1 -- 172.21.15.60:0/1145193693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400bb90 con 0x7f7c5c0affa0 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c626aa700 1 -- 172.21.15.60:0/1145193693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 msgr2=0x7f7c5c0a7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c626aa700 1 --2- 172.21.15.60:0/1145193693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c0a7400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c06d520 tx=0x7f7c440091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c626aa700 1 -- 172.21.15.60:0/1145193693 shutdown_connections 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c626aa700 1 --2- 172.21.15.60:0/1145193693 >> v2:172.21.15.144:3300/0 conn(0x7f7c5c0af3d0 0x7f7c5c0a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c626aa700 1 --2- 172.21.15.60:0/1145193693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c0a7400 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.042+0000 7f7c626aa700 1 -- 172.21.15.60:0/1145193693 >> 172.21.15.60:0/1145193693 conn(0x7f7c5c0cd1e0 msgr2=0x7f7c5c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.043+0000 7f7c626aa700 1 -- 172.21.15.60:0/1145193693 shutdown_connections 2023-10-08T16:05:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.043+0000 7f7c626aa700 1 -- 172.21.15.60:0/1145193693 wait complete. 2023-10-08T16:05:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.044+0000 7f7c626aa700 1 Processor -- start 2023-10-08T16:05:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.044+0000 7f7c626aa700 1 -- start start 2023-10-08T16:05:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.044+0000 7f7c626aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5c0af000 0x7f7c5c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5c0af3d0 0x7f7c5c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c9070 con 0x7f7c5c0affa0 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c6c10 con 0x7f7c5c0af3d0 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c6390 con 0x7f7c5c0af000 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42722/0 (socket says 172.21.15.60:42722) 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 -- 172.21.15.60:0/232291175 learned_addr learned my addr 172.21.15.60:0/232291175 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c5b7fe700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5c0af3d0 0x7f7c5c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c5bfff700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5c0af000 0x7f7c5c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 -- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5c0af000 msgr2=0x7f7c5c0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5c0af000 0x7f7c5c0c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 -- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5c0af3d0 msgr2=0x7f7c5c14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5c0af3d0 0x7f7c5c14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 -- 172.21.15.60:0/232291175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44009420 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c60c47700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c150390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009e90 tx=0x7f7c5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400cb70 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5400f040 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c0c6650 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54014480 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.045+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c0acd40 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.046+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c04c3c0 con 0x7f7c5c0affa0 2023-10-08T16:05:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.047+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c540147f0 con 0x7f7c5c0affa0 2023-10-08T16:05:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.047+0000 7f7c53fff700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c3c066f30 0x7f7c3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.047+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7c54084ec0 con 0x7f7c5c0affa0 2023-10-08T16:05:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.047+0000 7f7c5bfff700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c3c066f30 0x7f7c3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.048+0000 7f7c5bfff700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c3c066f30 0x7f7c3c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c007160 tx=0x7f7c4c007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.051+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c54052480 con 0x7f7c5c0affa0 2023-10-08T16:05:54.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.323+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f7c5c0cb140 con 0x7f7c5c0affa0 2023-10-08T16:05:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.327+0000 7f7c53fff700 1 -- 172.21.15.60:0/232291175 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c54055aa0 con 0x7f7c5c0affa0 2023-10-08T16:05:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c3c066f30 msgr2=0x7f7c3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c3c066f30 0x7f7c3c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c007160 tx=0x7f7c4c007f50 comp rx=0 tx=0).stop 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 msgr2=0x7f7c5c150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c150390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009e90 tx=0x7f7c5400b040 comp rx=0 tx=0).stop 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 shutdown_connections 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c3c066f30 0x7f7c3c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5c0af000 0x7f7c5c0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c0affa0 0x7f7c5c150390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 --2- 172.21.15.60:0/232291175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5c0af3d0 0x7f7c5c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 >> 172.21.15.60:0/232291175 conn(0x7f7c5c0cd1e0 msgr2=0x7f7c5c09a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 shutdown_connections 2023-10-08T16:05:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.329+0000 7f7c626aa700 1 -- 172.21.15.60:0/232291175 wait complete. 2023-10-08T16:05:54.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:54.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.460+0000 7f745b17e700 1 Processor -- start 2023-10-08T16:05:54.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.460+0000 7f745b17e700 1 -- start start 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745b17e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f745415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745b17e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f745415dda0 0x7f745415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745b17e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540cb7c0 con 0x7f74540cd6e0 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745b17e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745415e850 con 0x7f745415dda0 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745b17e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540cc360 con 0x7f74540cdab0 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745a17c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f74540cd6e0 0x7f74540cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40406/0 (socket says 172.21.15.60:40406) 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745a17c700 1 -- 172.21.15.60:0/3320011155 learned_addr learned my addr 172.21.15.60:0/3320011155 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745a97d700 1 --2- 172.21.15.60:0/3320011155 >> v2:172.21.15.144:3300/0 conn(0x7f745415dda0 0x7f745415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745997b700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f745415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116372299 0 0) 0x7f74540cb7c0 con 0x7f74540cd6e0 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.461+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f743c003570 con 0x7f74540cd6e0 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570649735 0 0) 0x7f743c003570 con 0x7f74540cd6e0 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 msgr2=0x7f745415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f745415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 >> v2:172.21.15.144:3300/0 conn(0x7f745415dda0 msgr2=0x7f745415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 --2- 172.21.15.60:0/3320011155 >> v2:172.21.15.144:3300/0 conn(0x7f745415dda0 0x7f745415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745415e290 con 0x7f74540cd6e0 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f744c001470 con 0x7f74540cd6e0 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 >> v1:172.21.15.60:6789/0 conn(0x7f74540cd6e0 legacy=0x7f74540cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c003a60 0x7f743c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f743c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f743c004d50 0x7f743c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745415e850 con 0x7f743c004d50 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540cc360 con 0x7f743c003a60 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c00ba60 con 0x7f74540cdab0 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f743c004d50 0x7f743c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a17c700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c003a60 0x7f743c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745997b700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f743c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 -- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 msgr2=0x7f743c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f743c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 -- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c003a60 msgr2=0x7f743c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c003a60 0x7f743c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 -- 172.21.15.60:0/3320011155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c003570 con 0x7f743c004d50 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a17c700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c003a60 0x7f743c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745997b700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540cdab0 0x7f743c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745a97d700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f743c004d50 0x7f743c0051c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f744400e210 tx=0x7f744400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c9625e478ed8d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400ea60 con 0x7f743c004d50 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744400f040 con 0x7f743c004d50 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.462+0000 7f745917a700 1 -- 172.21.15.60:0/3320011155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400ee10 con 0x7f743c004d50 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745b17e700 1 -- 172.21.15.60:0/3320011155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f743c004d50 msgr2=0x7f743c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745b17e700 1 --2- 172.21.15.60:0/3320011155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f743c004d50 0x7f743c0051c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f744400e210 tx=0x7f744400b040 comp rx=0 tx=0).stop 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745a97d700 1 -- 172.21.15.60:0/3320011155 reap_dead start 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745b17e700 1 -- 172.21.15.60:0/3320011155 shutdown_connections 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745b17e700 1 -- 172.21.15.60:0/3320011155 >> 172.21.15.60:0/3320011155 conn(0x7f7454067660 msgr2=0x7f7454067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:54.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745b17e700 1 -- 172.21.15.60:0/3320011155 shutdown_connections 2023-10-08T16:05:54.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.463+0000 7f745b17e700 1 -- 172.21.15.60:0/3320011155 wait complete. 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.464+0000 7f745b17e700 1 Processor -- start 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.464+0000 7f745b17e700 1 -- start start 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745b17e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c004d50 0x7f74540b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745b17e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540c7d20 0x7f74540c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745b17e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 0x7f74540ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745b17e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540c86d0 con 0x7f74540ca110 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745b17e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b2490 con 0x7f743c004d50 2023-10-08T16:05:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745b17e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b1880 con 0x7f74540c7d20 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 0x7f74540ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 0x7f74540ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42734/0 (socket says 172.21.15.60:42734) 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 -- 172.21.15.60:0/329039291 learned_addr learned my addr 172.21.15.60:0/329039291 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a17c700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c004d50 0x7f74540b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745997b700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540c7d20 0x7f74540c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 -- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540c7d20 msgr2=0x7f74540c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540c7d20 0x7f74540c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 -- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c004d50 msgr2=0x7f74540b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c004d50 0x7f74540b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.465+0000 7f745a97d700 1 -- 172.21.15.60:0/329039291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540b1b60 con 0x7f74540ca110 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.466+0000 7f745a97d700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 0x7f74540ca5b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f744400afd0 tx=0x7f744401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.466+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400ee60 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.466+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744401d630 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.466+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74540b1e40 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.466+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744401d9f0 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.466+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74540b1590 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.467+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7444003040 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.467+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74540b2640 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.468+0000 7f74527fc700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7440066f30 0x7f74400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.468+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7444084e90 con 0x7f74540ca110 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.468+0000 7f745a17c700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7440066f30 0x7f74400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.468+0000 7f745a17c700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7440066f30 0x7f74400693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f744c005bb0 tx=0x7f74540ccaf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.472+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74540b2640 con 0x7f74540ca110 2023-10-08T16:05:54.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.672+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7454089b50 con 0x7f74540ca110 2023-10-08T16:05:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.673+0000 7f74527fc700 1 -- 172.21.15.60:0/329039291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f7444018090 con 0x7f74540ca110 2023-10-08T16:05:54.673 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:54.673 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:51.369381+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:54.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7440066f30 msgr2=0x7f74400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7440066f30 0x7f74400693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f744c005bb0 tx=0x7f74540ccaf0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 msgr2=0x7f74540ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 0x7f74540ca5b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f744400afd0 tx=0x7f744401a000 comp rx=0 tx=0).stop 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 shutdown_connections 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7440066f30 0x7f74400693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74540ca110 0x7f74540ca5b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f743c004d50 0x7f74540b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 --2- 172.21.15.60:0/329039291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74540c7d20 0x7f74540c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 >> 172.21.15.60:0/329039291 conn(0x7f7454067660 msgr2=0x7f745415d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 shutdown_connections 2023-10-08T16:05:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.675+0000 7f745b17e700 1 -- 172.21.15.60:0/329039291 wait complete. 2023-10-08T16:05:54.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:05:54.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:05:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.809+0000 7f67e19eb700 1 Processor -- start 2023-10-08T16:05:54.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.809+0000 7f67e19eb700 1 -- start start 2023-10-08T16:05:54.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67e19eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4860 0x7f67dc0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67e19eb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67dc0b4c30 0x7f67dc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67e19eb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0b14f0 con 0x7f67dc159fd0 2023-10-08T16:05:54.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67e19eb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0b17d0 con 0x7f67dc0b4c30 2023-10-08T16:05:54.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67e19eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0b1ab0 con 0x7f67dc0b4860 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67da7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67dc0b4c30 0x7f67dc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67daffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4860 0x7f67dc0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67da7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67dc0b4c30 0x7f67dc159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:47916/0 (socket says 172.21.15.60:47916) 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.810+0000 7f67da7fc700 1 -- 172.21.15.60:0/1360625640 learned_addr learned my addr 172.21.15.60:0/1360625640 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67da7fc700 1 -- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4860 msgr2=0x7f67dc0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67da7fc700 1 --2- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4860 0x7f67dc0b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67da7fc700 1 -- 172.21.15.60:0/1360625640 >> v1:172.21.15.144:6789/0 conn(0x7f67dc159fd0 legacy=0x7f67dc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67da7fc700 1 -- 172.21.15.60:0/1360625640 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0b1d90 con 0x7f67dc0b4c30 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67daffd700 1 --2- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4860 0x7f67dc0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67da7fc700 1 --2- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc0b4c30 0x7f67dc159a90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67c40099b0 tx=0x7f67c4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=798a418961821329 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67d9ffb700 1 -- 172.21.15.60:0/1360625640 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4009ea0 con 0x7f67dc0b4c30 2023-10-08T16:05:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67d9ffb700 1 -- 172.21.15.60:0/1360625640 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c400b8f0 con 0x7f67dc0b4c30 2023-10-08T16:05:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67d9ffb700 1 -- 172.21.15.60:0/1360625640 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c400bc90 con 0x7f67dc0b4c30 2023-10-08T16:05:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67e19eb700 1 -- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc0b4c30 msgr2=0x7f67dc159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67e19eb700 1 --2- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc0b4c30 0x7f67dc159a90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67c40099b0 tx=0x7f67c4009250 comp rx=0 tx=0).stop 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.811+0000 7f67e19eb700 1 -- 172.21.15.60:0/1360625640 shutdown_connections 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.812+0000 7f67e19eb700 1 --2- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4860 0x7f67dc0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.812+0000 7f67e19eb700 1 --2- 172.21.15.60:0/1360625640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc0b4c30 0x7f67dc159a90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.812+0000 7f67e19eb700 1 -- 172.21.15.60:0/1360625640 >> 172.21.15.60:0/1360625640 conn(0x7f67dc09a0f0 msgr2=0x7f67dc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.812+0000 7f67e19eb700 1 -- 172.21.15.60:0/1360625640 shutdown_connections 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.812+0000 7f67e19eb700 1 -- 172.21.15.60:0/1360625640 wait complete. 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.813+0000 7f67e19eb700 1 Processor -- start 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.813+0000 7f67e19eb700 1 -- start start 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 0x7f67dc0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4c30 0x7f67dc1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc159fd0 0x7f67dc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc156c20 con 0x7f67dc0b4860 2023-10-08T16:05:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc169cc0 con 0x7f67dc159fd0 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc09c340 con 0x7f67dc0b4c30 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 0x7f67dc0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 0x7f67dc0acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42742/0 (socket says 172.21.15.60:42742) 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 -- 172.21.15.60:0/3313502990 learned_addr learned my addr 172.21.15.60:0/3313502990 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67da7fc700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4c30 0x7f67dc1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67db7fe700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc159fd0 0x7f67dc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 -- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4c30 msgr2=0x7f67dc1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4c30 0x7f67dc1566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 -- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc159fd0 msgr2=0x7f67dc0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc159fd0 0x7f67dc0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 -- 172.21.15.60:0/3313502990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40093c0 con 0x7f67dc0b4860 2023-10-08T16:05:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67daffd700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 0x7f67dc0acba0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f67d400ecb0 tx=0x7f67d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4005a00 con 0x7f67dc0b4860 2023-10-08T16:05:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4005b60 con 0x7f67dc0b4860 2023-10-08T16:05:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d400c8c0 con 0x7f67dc0b4860 2023-10-08T16:05:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c40094f0 con 0x7f67dc0b4860 2023-10-08T16:05:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.814+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc0afa20 con 0x7f67dc0b4860 2023-10-08T16:05:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.815+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc0afce0 con 0x7f67dc0b4860 2023-10-08T16:05:54.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.816+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67d400cc70 con 0x7f67dc0b4860 2023-10-08T16:05:54.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.816+0000 7f67d2ffd700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f67bc066f30 0x7f67bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:54.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.816+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f67d4084610 con 0x7f67dc0b4860 2023-10-08T16:05:54.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.816+0000 7f67da7fc700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f67bc066f30 0x7f67bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:54.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.817+0000 7f67da7fc700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f67bc066f30 0x7f67bc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67c40099b0 tx=0x7f67c4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:54.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:54.821+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67d4051bd0 con 0x7f67dc0b4860 2023-10-08T16:05:55.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.011+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67dc04c3c0 con 0x7f67dc0b4860 2023-10-08T16:05:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.011+0000 7f67d2ffd700 1 -- 172.21.15.60:0/3313502990 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67d40551f0 con 0x7f67dc0b4860 2023-10-08T16:05:55.013 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:05:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f67bc066f30 msgr2=0x7f67bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f67bc066f30 0x7f67bc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67c40099b0 tx=0x7f67c4017000 comp rx=0 tx=0).stop 2023-10-08T16:05:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 msgr2=0x7f67dc0acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 0x7f67dc0acba0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f67d400ecb0 tx=0x7f67d4009120 comp rx=0 tx=0).stop 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 shutdown_connections 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f67bc066f30 0x7f67bc0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67dc159fd0 0x7f67dc0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67dc0b4860 0x7f67dc0acba0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 --2- 172.21.15.60:0/3313502990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f67dc0b4c30 0x7f67dc1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 >> 172.21.15.60:0/3313502990 conn(0x7f67dc09a0f0 msgr2=0x7f67dc158430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 shutdown_connections 2023-10-08T16:05:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.013+0000 7f67e19eb700 1 -- 172.21.15.60:0/3313502990 wait complete. 2023-10-08T16:05:55.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:05:55.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.144+0000 7f952b9a4700 1 Processor -- start 2023-10-08T16:05:55.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.144+0000 7f952b9a4700 1 -- start start 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f952b9a4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9524157c40 0x7f9524158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f952b9a4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952415cbb0 con 0x7f952415a620 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f952b9a4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952415bfa0 con 0x7f9524157870 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f952b9a4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952415bdb0 con 0x7f9524157c40 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9528f3f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f952415a620 0x7f952415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40418/0 (socket says 172.21.15.60:40418) 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9528f3f700 1 -- 172.21.15.60:0/1016087876 learned_addr learned my addr 172.21.15.60:0/1016087876 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:55.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9529f41700 1 --2- 172.21.15.60:0/1016087876 >> v2:172.21.15.60:3300/0 conn(0x7f9524157c40 0x7f9524158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9523fff700 1 -- 172.21.15.60:0/1016087876 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696358769 0 0) 0x7f952415cbb0 con 0x7f952415a620 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9523fff700 1 -- 172.21.15.60:0/1016087876 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f950c003570 con 0x7f952415a620 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9529f41700 1 -- 172.21.15.60:0/1016087876 >> v1:172.21.15.144:6789/0 conn(0x7f9524157870 legacy=0x7f952415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9529f41700 1 -- 172.21.15.60:0/1016087876 >> v1:172.21.15.60:6789/0 conn(0x7f952415a620 legacy=0x7f952415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9529f41700 1 -- 172.21.15.60:0/1016087876 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952415c280 con 0x7f9524157c40 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.145+0000 7f9529f41700 1 --2- 172.21.15.60:0/1016087876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157c40 0x7f9524158110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9514009e60 tx=0x7f9514009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6382858c0e12ecc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f9523fff700 1 -- 172.21.15.60:0/1016087876 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400e070 con 0x7f9524157c40 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f9523fff700 1 -- 172.21.15.60:0/1016087876 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400bb60 con 0x7f9524157c40 2023-10-08T16:05:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f9523fff700 1 -- 172.21.15.60:0/1016087876 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514012430 con 0x7f9524157c40 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 -- 172.21.15.60:0/1016087876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157c40 msgr2=0x7f9524158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 --2- 172.21.15.60:0/1016087876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157c40 0x7f9524158110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9514009e60 tx=0x7f9514009780 comp rx=0 tx=0).stop 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 -- 172.21.15.60:0/1016087876 shutdown_connections 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 --2- 172.21.15.60:0/1016087876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157c40 0x7f9524158110 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 -- 172.21.15.60:0/1016087876 >> 172.21.15.60:0/1016087876 conn(0x7f9524068ce0 msgr2=0x7f95240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 -- 172.21.15.60:0/1016087876 shutdown_connections 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.146+0000 7f952b9a4700 1 -- 172.21.15.60:0/1016087876 wait complete. 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.147+0000 7f952b9a4700 1 Processor -- start 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.147+0000 7f952b9a4700 1 -- start start 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f952b9a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 0x7f952413f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f952b9a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9524157c40 0x7f95240b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f952b9a4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952415a620 0x7f952414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f952b9a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240b2cf0 con 0x7f9524157870 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f952b9a4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952413fcc0 con 0x7f952415a620 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f952b9a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240b20e0 con 0x7f9524157c40 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f9529740700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 0x7f952413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f9529740700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 0x7f952413f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42760/0 (socket says 172.21.15.60:42760) 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.148+0000 7f9529740700 1 -- 172.21.15.60:0/2411622144 learned_addr learned my addr 172.21.15.60:0/2411622144 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f9529740700 1 -- 172.21.15.60:0/2411622144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9524157c40 msgr2=0x7f95240b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f9529740700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9524157c40 0x7f95240b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f9529740700 1 -- 172.21.15.60:0/2411622144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952415a620 msgr2=0x7f952414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f9529740700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952415a620 0x7f952414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f9529740700 1 -- 172.21.15.60:0/2411622144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514009a20 con 0x7f9524157870 2023-10-08T16:05:55.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f9529740700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 0x7f952413f780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c590 tx=0x7f951c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c011590 con 0x7f9524157870 2023-10-08T16:05:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0116f0 con 0x7f9524157870 2023-10-08T16:05:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95240b23c0 con 0x7f9524157870 2023-10-08T16:05:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c011ab0 con 0x7f9524157870 2023-10-08T16:05:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.149+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95240b2980 con 0x7f9524157870 2023-10-08T16:05:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.150+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952404c3c0 con 0x7f9524157870 2023-10-08T16:05:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.150+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f951c01b3b0 con 0x7f9524157870 2023-10-08T16:05:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.151+0000 7f95217fa700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9510066f30 0x7f95100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.151+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f951c083790 con 0x7f9524157870 2023-10-08T16:05:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.151+0000 7f9528f3f700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9510066f30 0x7f95100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.151+0000 7f9528f3f700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9510066f30 0x7f95100693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95180058d0 tx=0x7f95180079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.155+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f951c050d50 con 0x7f9524157870 2023-10-08T16:05:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.351+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f952415c560 con 0x7f9524157870 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.351+0000 7f95217fa700 1 -- 172.21.15.60:0/2411622144 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f951c017020 con 0x7f9524157870 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:05:55.352 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9510066f30 msgr2=0x7f95100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9510066f30 0x7f95100693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95180058d0 tx=0x7f95180079d0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 msgr2=0x7f952413f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 0x7f952413f780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c590 tx=0x7f951c00c950 comp rx=0 tx=0).stop 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 shutdown_connections 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9510066f30 0x7f95100693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952415a620 0x7f952414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9524157870 0x7f952413f780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 --2- 172.21.15.60:0/2411622144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9524157c40 0x7f95240b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 >> 172.21.15.60:0/2411622144 conn(0x7f9524068ce0 msgr2=0x7f95240b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 shutdown_connections 2023-10-08T16:05:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.353+0000 7f952b9a4700 1 -- 172.21.15.60:0/2411622144 wait complete. 2023-10-08T16:05:55.365 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:05:55.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.488+0000 7f8976cde700 1 Processor -- start 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.488+0000 7f8976cde700 1 -- start start 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f8976cde700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f897015d240 0x7f89700b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f8976cde700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89700cc940 0x7f89700ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f8976cde700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700b3f40 con 0x7f89700c59e0 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f8976cde700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89700cbb80 con 0x7f897015d240 2023-10-08T16:05:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f8976cde700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89700cbe60 con 0x7f89700cc940 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f8975cdc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f897015d240 0x7f89700b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f89764dd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f89700c59e0 0x7f89700c5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40428/0 (socket says 172.21.15.60:40428) 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f89764dd700 1 -- 172.21.15.60:0/1523539431 learned_addr learned my addr 172.21.15.60:0/1523539431 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.489+0000 7f89754db700 1 --2- 172.21.15.60:0/1523539431 >> v2:172.21.15.144:3300/0 conn(0x7f89700cc940 0x7f89700ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.490+0000 7f8975cdc700 1 -- 172.21.15.60:0/1523539431 >> v2:172.21.15.144:3300/0 conn(0x7f89700cc940 msgr2=0x7f89700ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.490+0000 7f8975cdc700 1 --2- 172.21.15.60:0/1523539431 >> v2:172.21.15.144:3300/0 conn(0x7f89700cc940 0x7f89700ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.490+0000 7f8975cdc700 1 -- 172.21.15.60:0/1523539431 >> v1:172.21.15.60:6789/0 conn(0x7f89700c59e0 legacy=0x7f89700c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.490+0000 7f8975cdc700 1 -- 172.21.15.60:0/1523539431 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700cc140 con 0x7f897015d240 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.490+0000 7f8975cdc700 1 --2- 172.21.15.60:0/1523539431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f89700b3a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f897006b8c0 tx=0x7f896c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62a76a7c301c125 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.491+0000 7f8974cda700 1 -- 172.21.15.60:0/1523539431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c00e070 con 0x7f897015d240 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.491+0000 7f8974cda700 1 -- 172.21.15.60:0/1523539431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c00bb60 con 0x7f897015d240 2023-10-08T16:05:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.491+0000 7f8974cda700 1 -- 172.21.15.60:0/1523539431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c012430 con 0x7f897015d240 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 -- 172.21.15.60:0/1523539431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 msgr2=0x7f89700b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 --2- 172.21.15.60:0/1523539431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f89700b3a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f897006b8c0 tx=0x7f896c009780 comp rx=0 tx=0).stop 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 -- 172.21.15.60:0/1523539431 shutdown_connections 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 --2- 172.21.15.60:0/1523539431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f89700b3a00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 --2- 172.21.15.60:0/1523539431 >> v2:172.21.15.144:3300/0 conn(0x7f89700cc940 0x7f89700ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 -- 172.21.15.60:0/1523539431 >> 172.21.15.60:0/1523539431 conn(0x7f8970067e40 msgr2=0x7f89700d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 -- 172.21.15.60:0/1523539431 shutdown_connections 2023-10-08T16:05:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.492+0000 7f8976cde700 1 -- 172.21.15.60:0/1523539431 wait complete. 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.493+0000 7f8976cde700 1 Processor -- start 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.493+0000 7f8976cde700 1 -- start start 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89700c59e0 0x7f897016b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89700cc940 0x7f89700b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f897016dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897009c970 con 0x7f897015d240 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897016e640 con 0x7f89700c59e0 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897016e920 con 0x7f89700cc940 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f897016dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f897016dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42778/0 (socket says 172.21.15.60:42778) 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 -- 172.21.15.60:0/1453510848 learned_addr learned my addr 172.21.15.60:0/1453510848 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:55.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8975cdc700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89700c59e0 0x7f897016b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89754db700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89700cc940 0x7f89700b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 -- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89700cc940 msgr2=0x7f89700b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89700cc940 0x7f89700b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 -- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89700c59e0 msgr2=0x7f897016b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89700c59e0 0x7f897016b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 -- 172.21.15.60:0/1453510848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c009a20 con 0x7f897015d240 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f89764dd700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f897016dad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f896800c560 tx=0x7f8968007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968005b30 con 0x7f897015d240 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8968005c90 con 0x7f897015d240 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89680072e0 con 0x7f897015d240 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.494+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897016a820 con 0x7f897015d240 2023-10-08T16:05:55.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.495+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897016a4d0 con 0x7f897015d240 2023-10-08T16:05:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.496+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897016ad20 con 0x7f897015d240 2023-10-08T16:05:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.496+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8968007690 con 0x7f897015d240 2023-10-08T16:05:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.496+0000 7f8965ffb700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8954066f30 0x7f89540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.496+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8968083430 con 0x7f897015d240 2023-10-08T16:05:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.496+0000 7f8975cdc700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8954066f30 0x7f89540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.497+0000 7f8975cdc700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8954066f30 0x7f89540693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097c0 tx=0x7f896c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:55.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.501+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f896804b5a0 con 0x7f897015d240 2023-10-08T16:05:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:55.695+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89700cc420 con 0x7f897015d240 2023-10-08T16:05:56.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.496+0000 7f8965ffb700 1 -- 172.21.15.60:0/1453510848 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f89680170b0 con 0x7f897015d240 2023-10-08T16:05:56.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.500+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8954066f30 msgr2=0x7f89540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:56.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.500+0000 7f8976cde700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8954066f30 0x7f89540693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097c0 tx=0x7f896c019000 comp rx=0 tx=0).stop 2023-10-08T16:05:56.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.500+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 msgr2=0x7f897016dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:56.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.500+0000 7f8976cde700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f897016dad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f896800c560 tx=0x7f8968007f60 comp rx=0 tx=0).stop 2023-10-08T16:05:56.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 shutdown_connections 2023-10-08T16:05:56.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8954066f30 0x7f89540693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897015d240 0x7f897016dad0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89700c59e0 0x7f897016b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 --2- 172.21.15.60:0/1453510848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89700cc940 0x7f89700b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 >> 172.21.15.60:0/1453510848 conn(0x7f8970067e40 msgr2=0x7f897015a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:56.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 shutdown_connections 2023-10-08T16:05:56.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.501+0000 7f8976cde700 1 -- 172.21.15.60:0/1453510848 wait complete. 2023-10-08T16:05:56.502 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:05:56.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:05:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.642+0000 7f7051320700 1 Processor -- start 2023-10-08T16:05:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.642+0000 7f7051320700 1 -- start start 2023-10-08T16:05:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f7051320700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f704c0c9cf0 0x7f704c140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f7051320700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 0x7f704c141420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f7051320700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704c069fd0 con 0x7f704c070950 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f7051320700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704c06afe0 con 0x7f704c0c9cf0 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f7051320700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c06ab50 con 0x7f704c070d20 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f704a7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f704c0c9cf0 0x7f704c140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.643+0000 7f704b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 0x7f704c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704affd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f704c070950 0x7f704c0c95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:58970/0 (socket says 172.21.15.60:58970) 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704affd700 1 -- 172.21.15.60:0/1256915847 learned_addr learned my addr 172.21.15.60:0/1256915847 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 0x7f704c141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:52028/0 (socket says 172.21.15.60:52028) 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704b7fe700 1 -- 172.21.15.60:0/1256915847 >> v2:172.21.15.144:3300/0 conn(0x7f704c0c9cf0 msgr2=0x7f704c140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704b7fe700 1 --2- 172.21.15.60:0/1256915847 >> v2:172.21.15.144:3300/0 conn(0x7f704c0c9cf0 0x7f704c140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704b7fe700 1 -- 172.21.15.60:0/1256915847 >> v1:172.21.15.144:6789/0 conn(0x7f704c070950 legacy=0x7f704c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f7049ffb700 1 -- 172.21.15.60:0/1256915847 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396292257 0 0) 0x7f704c069fd0 con 0x7f704c070950 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704b7fe700 1 -- 172.21.15.60:0/1256915847 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c06f5a0 con 0x7f704c070d20 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704a7fc700 1 --2- 172.21.15.60:0/1256915847 >> v2:172.21.15.144:3300/0 conn(0x7f704c0c9cf0 0x7f704c140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f704b7fe700 1 --2- 172.21.15.60:0/1256915847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 0x7f704c141420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f703c0098e0 tx=0x7f703c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb46ea0bec4698c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f7049ffb700 1 -- 172.21.15.60:0/1256915847 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00b640 con 0x7f704c070d20 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f7049ffb700 1 -- 172.21.15.60:0/1256915847 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00b7a0 con 0x7f704c070d20 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.644+0000 7f7049ffb700 1 -- 172.21.15.60:0/1256915847 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00bb40 con 0x7f704c070d20 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 -- 172.21.15.60:0/1256915847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 msgr2=0x7f704c141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 --2- 172.21.15.60:0/1256915847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 0x7f704c141420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f703c0098e0 tx=0x7f703c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 -- 172.21.15.60:0/1256915847 shutdown_connections 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 --2- 172.21.15.60:0/1256915847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c070d20 0x7f704c141420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 --2- 172.21.15.60:0/1256915847 >> v2:172.21.15.144:3300/0 conn(0x7f704c0c9cf0 0x7f704c140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 -- 172.21.15.60:0/1256915847 >> 172.21.15.60:0/1256915847 conn(0x7f704c0cd900 msgr2=0x7f704c0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 -- 172.21.15.60:0/1256915847 shutdown_connections 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.645+0000 7f7051320700 1 -- 172.21.15.60:0/1256915847 wait complete. 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.646+0000 7f7051320700 1 Processor -- start 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.646+0000 7f7051320700 1 -- start start 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f7051320700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704c070950 0x7f704c0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f7051320700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 0x7f704c16d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:56.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f7051320700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c0c9cf0 0x7f704c16db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f7051320700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0af5f0 con 0x7f704c070d20 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f7051320700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0b20e0 con 0x7f704c070950 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f7051320700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0b14d0 con 0x7f704c0c9cf0 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f704a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 0x7f704c16d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f704a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 0x7f704c16d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42794/0 (socket says 172.21.15.60:42794) 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f704a7fc700 1 -- 172.21.15.60:0/2003601237 learned_addr learned my addr 172.21.15.60:0/2003601237 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f704affd700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704c070950 0x7f704c0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.647+0000 7f704b7fe700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c0c9cf0 0x7f704c16db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f704a7fc700 1 -- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c0c9cf0 msgr2=0x7f704c16db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f704a7fc700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c0c9cf0 0x7f704c16db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f704a7fc700 1 -- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704c070950 msgr2=0x7f704c0b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:56.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f704a7fc700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704c070950 0x7f704c0b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f704a7fc700 1 -- 172.21.15.60:0/2003601237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034009420 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f704a7fc700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 0x7f704c16d620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f703400ecb0 tx=0x7f70340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400c850 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703400c9b0 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c009420 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400cd30 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.648+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c0b1a90 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.649+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704c06d940 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.649+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7034013680 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.650+0000 7f7042ffd700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f702c066f30 0x7f702c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.650+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f70340845d0 con 0x7f704c070d20 2023-10-08T16:05:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.650+0000 7f704affd700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f702c066f30 0x7f702c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:56.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.650+0000 7f704affd700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f702c066f30 0x7f702c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7044002250 tx=0x7f7044001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:56.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.654+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70340554b0 con 0x7f704c070d20 2023-10-08T16:05:56.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:56.847+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f704c0b2220 con 0x7f704c070d20 2023-10-08T16:05:57.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.502+0000 7f7042ffd700 1 -- 172.21.15.60:0/2003601237 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7034055040 con 0x7f704c070d20 2023-10-08T16:05:57.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f702c066f30 msgr2=0x7f702c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:57.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f702c066f30 0x7f702c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7044002250 tx=0x7f7044001a20 comp rx=0 tx=0).stop 2023-10-08T16:05:57.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 msgr2=0x7f704c16d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:57.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 0x7f704c16d620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f703400ecb0 tx=0x7f70340091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 shutdown_connections 2023-10-08T16:05:57.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f702c066f30 0x7f702c0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f704c0c9cf0 0x7f704c16db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704c070950 0x7f704c0b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 --2- 172.21.15.60:0/2003601237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f704c070d20 0x7f704c16d620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.507+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 >> 172.21.15.60:0/2003601237 conn(0x7f704c0cd900 msgr2=0x7f704c140290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.508+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 shutdown_connections 2023-10-08T16:05:57.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.509+0000 7f7051320700 1 -- 172.21.15.60:0/2003601237 wait complete. 2023-10-08T16:05:57.513 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:05:57.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:05:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.649+0000 7f24279e6700 1 Processor -- start 2023-10-08T16:05:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.650+0000 7f24279e6700 1 -- start start 2023-10-08T16:05:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.650+0000 7f24279e6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2420070e10 0x7f24200c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.650+0000 7f24279e6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2420068880 0x7f242006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.650+0000 7f24279e6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242006f980 con 0x7f24200affe0 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.650+0000 7f24279e6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242006f230 con 0x7f2420068880 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.650+0000 7f24279e6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200cd8c0 con 0x7f2420070e10 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425f83700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2420068880 0x7f242006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425782700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f24200affe0 0x7f2420070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40440/0 (socket says 172.21.15.60:40440) 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425782700 1 -- 172.21.15.60:0/3641606858 learned_addr learned my addr 172.21.15.60:0/3641606858 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2424f81700 1 --2- 172.21.15.60:0/3641606858 >> v2:172.21.15.144:3300/0 conn(0x7f2420070e10 0x7f24200c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425f83700 1 -- 172.21.15.60:0/3641606858 >> v2:172.21.15.144:3300/0 conn(0x7f2420070e10 msgr2=0x7f24200c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425f83700 1 --2- 172.21.15.60:0/3641606858 >> v2:172.21.15.144:3300/0 conn(0x7f2420070e10 0x7f24200c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425f83700 1 -- 172.21.15.60:0/3641606858 >> v1:172.21.15.60:6789/0 conn(0x7f24200affe0 legacy=0x7f2420070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425f83700 1 -- 172.21.15.60:0/3641606858 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200ccfd0 con 0x7f2420068880 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f241ffff700 1 -- 172.21.15.60:0/3641606858 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075479969 0 0) 0x7f242006f980 con 0x7f24200affe0 2023-10-08T16:05:57.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2424f81700 1 --2- 172.21.15.60:0/3641606858 >> v2:172.21.15.144:3300/0 conn(0x7f2420070e10 0x7f24200c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f2425f83700 1 --2- 172.21.15.60:0/3641606858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f242006ecf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f242006dfd0 tx=0x7f2410009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70563c849a18c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f241ffff700 1 -- 172.21.15.60:0/3641606858 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000e070 con 0x7f2420068880 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f241ffff700 1 -- 172.21.15.60:0/3641606858 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000bc30 con 0x7f2420068880 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.651+0000 7f241ffff700 1 -- 172.21.15.60:0/3641606858 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410012430 con 0x7f2420068880 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 -- 172.21.15.60:0/3641606858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 msgr2=0x7f242006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 --2- 172.21.15.60:0/3641606858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f242006ecf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f242006dfd0 tx=0x7f2410009780 comp rx=0 tx=0).stop 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 -- 172.21.15.60:0/3641606858 shutdown_connections 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 --2- 172.21.15.60:0/3641606858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f242006ecf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 --2- 172.21.15.60:0/3641606858 >> v2:172.21.15.144:3300/0 conn(0x7f2420070e10 0x7f24200c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 -- 172.21.15.60:0/3641606858 >> 172.21.15.60:0/3641606858 conn(0x7f24200ce570 msgr2=0x7f24200ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:57.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 -- 172.21.15.60:0/3641606858 shutdown_connections 2023-10-08T16:05:57.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.652+0000 7f24279e6700 1 -- 172.21.15.60:0/3641606858 wait complete. 2023-10-08T16:05:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.653+0000 7f24279e6700 1 Processor -- start 2023-10-08T16:05:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.653+0000 7f24279e6700 1 -- start start 2023-10-08T16:05:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f24279e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f2420157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f24279e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2420070e10 0x7f242015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f24279e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24200affe0 0x7f24200c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f24279e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242015ab50 con 0x7f2420068880 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f24279e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242015e620 con 0x7f24200affe0 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f24279e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242015e900 con 0x7f2420070e10 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f2420157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f2420157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42814/0 (socket says 172.21.15.60:42814) 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 -- 172.21.15.60:0/3727005051 learned_addr learned my addr 172.21.15.60:0/3727005051 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425f83700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24200affe0 0x7f24200c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2424f81700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2420070e10 0x7f242015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 -- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2420070e10 msgr2=0x7f242015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2420070e10 0x7f242015dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 -- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24200affe0 msgr2=0x7f24200c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24200affe0 0x7f24200c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 -- 172.21.15.60:0/3727005051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410009a20 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.654+0000 7f2425782700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f2420157600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f241800c7e0 tx=0x7f2418007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.655+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418005b30 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.655+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418005c90 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.655+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242015ebe0 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.655+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418007300 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.655+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2420157b40 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.656+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242015a640 con 0x7f2420068880 2023-10-08T16:05:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.656+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f241801b3b0 con 0x7f2420068880 2023-10-08T16:05:57.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.657+0000 7f241d7fa700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f240c066f30 0x7f240c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:57.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.657+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2418083c60 con 0x7f2420068880 2023-10-08T16:05:57.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.657+0000 7f2424f81700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f240c066f30 0x7f240c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:57.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.657+0000 7f2424f81700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f240c066f30 0x7f240c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24200b3970 tx=0x7f2414008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:57.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.661+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2418050fb0 con 0x7f2420068880 2023-10-08T16:05:57.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:57.898+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f242015a640 con 0x7f2420068880 2023-10-08T16:05:58.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.507+0000 7f241d7fa700 1 -- 172.21.15.60:0/3727005051 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f242015a640 con 0x7f2420068880 2023-10-08T16:05:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.511+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f240c066f30 msgr2=0x7f240c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.511+0000 7f24279e6700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f240c066f30 0x7f240c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24200b3970 tx=0x7f2414008040 comp rx=0 tx=0).stop 2023-10-08T16:05:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.511+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 msgr2=0x7f2420157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.511+0000 7f24279e6700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f2420157600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f241800c7e0 tx=0x7f2418007df0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.512+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 shutdown_connections 2023-10-08T16:05:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.512+0000 7f24279e6700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f240c066f30 0x7f240c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.512+0000 7f24279e6700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24200affe0 0x7f24200c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.512+0000 7f24279e6700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2420068880 0x7f2420157600 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.512+0000 7f24279e6700 1 --2- 172.21.15.60:0/3727005051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2420070e10 0x7f242015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.512+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 >> 172.21.15.60:0/3727005051 conn(0x7f24200ce570 msgr2=0x7f2420069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:58.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.513+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 shutdown_connections 2023-10-08T16:05:58.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.513+0000 7f24279e6700 1 -- 172.21.15.60:0/3727005051 wait complete. 2023-10-08T16:05:58.514 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T16:05:58.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.648+0000 7f0ad3a49700 1 Processor -- start 2023-10-08T16:05:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.648+0000 7f0ad3a49700 1 -- start start 2023-10-08T16:05:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad3a49700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0acc0c9560 0x7f0acc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad3a49700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad3a49700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc069060 con 0x7f0acc069de0 2023-10-08T16:05:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad3a49700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc069300 con 0x7f0acc0c9560 2023-10-08T16:05:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad3a49700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0695e0 con 0x7f0acc0c9930 2023-10-08T16:05:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad0fe4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0acc069de0 0x7f0acc15bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40456/0 (socket says 172.21.15.60:40456) 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad0fe4700 1 -- 172.21.15.60:0/2363408016 learned_addr learned my addr 172.21.15.60:0/2363408016 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad17e5700 1 --2- 172.21.15.60:0/2363408016 >> v2:172.21.15.144:3300/0 conn(0x7f0acc0c9560 0x7f0acc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0ad1fe6700 1 --2- 172.21.15.60:0/2363408016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.649+0000 7f0acbfff700 1 -- 172.21.15.60:0/2363408016 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28524960 0 0) 0x7f0acc069060 con 0x7f0acc069de0 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0acbfff700 1 -- 172.21.15.60:0/2363408016 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003570 con 0x7f0acc069de0 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0acbfff700 1 -- 172.21.15.60:0/2363408016 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360836524 0 0) 0x7f0ab4003570 con 0x7f0acc069de0 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0ad1fe6700 1 -- 172.21.15.60:0/2363408016 >> v2:172.21.15.144:3300/0 conn(0x7f0acc0c9560 msgr2=0x7f0acc157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0ad1fe6700 1 --2- 172.21.15.60:0/2363408016 >> v2:172.21.15.144:3300/0 conn(0x7f0acc0c9560 0x7f0acc157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0ad1fe6700 1 -- 172.21.15.60:0/2363408016 >> v1:172.21.15.60:6789/0 conn(0x7f0acc069de0 legacy=0x7f0acc15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0ad1fe6700 1 -- 172.21.15.60:0/2363408016 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0698c0 con 0x7f0acc0c9930 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0ad1fe6700 1 --2- 172.21.15.60:0/2363408016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc15c370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0098e0 tx=0x7f0abc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd3f0aa076cee37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0acbfff700 1 -- 172.21.15.60:0/2363408016 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0001470 con 0x7f0acc0c9930 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0acbfff700 1 -- 172.21.15.60:0/2363408016 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc011420 con 0x7f0acc0c9930 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.650+0000 7f0acbfff700 1 -- 172.21.15.60:0/2363408016 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0117c0 con 0x7f0acc0c9930 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 -- 172.21.15.60:0/2363408016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 msgr2=0x7f0acc15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/2363408016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc15c370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0098e0 tx=0x7f0abc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 -- 172.21.15.60:0/2363408016 shutdown_connections 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/2363408016 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc15c370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/2363408016 >> v2:172.21.15.144:3300/0 conn(0x7f0acc0c9560 0x7f0acc157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 -- 172.21.15.60:0/2363408016 >> 172.21.15.60:0/2363408016 conn(0x7f0acc067660 msgr2=0x7f0acc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 -- 172.21.15.60:0/2363408016 shutdown_connections 2023-10-08T16:05:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.651+0000 7f0ad3a49700 1 -- 172.21.15.60:0/2363408016 wait complete. 2023-10-08T16:05:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.652+0000 7f0ad3a49700 1 Processor -- start 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.652+0000 7f0ad3a49700 1 -- start start 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad3a49700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 0x7f0acc0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad3a49700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0acc0c9560 0x7f0acc0c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad3a49700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad3a49700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0c72c0 con 0x7f0acc069de0 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad3a49700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0c3080 con 0x7f0acc0c9560 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad3a49700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0c3360 con 0x7f0acc0c9930 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 0x7f0acc0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 0x7f0acc0c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42824/0 (socket says 172.21.15.60:42824) 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 -- 172.21.15.60:0/1925849602 learned_addr learned my addr 172.21.15.60:0/1925849602 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad0fe4700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0acc0c9560 0x7f0acc0c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad1fe6700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 -- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 msgr2=0x7f0acc0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 -- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0acc0c9560 msgr2=0x7f0acc0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0acc0c9560 0x7f0acc0c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 -- 172.21.15.60:0/1925849602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009420 con 0x7f0acc069de0 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad1fe6700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.653+0000 7f0ad17e5700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 0x7f0acc0c24c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009ef0 tx=0x7f0ac400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.654+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400cc20 con 0x7f0acc069de0 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.654+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400f040 con 0x7f0acc069de0 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.654+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc0c3640 con 0x7f0acc069de0 2023-10-08T16:05:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.654+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4014480 con 0x7f0acc069de0 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.654+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc157170 con 0x7f0acc069de0 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.655+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc0c75a0 con 0x7f0acc069de0 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.655+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ac40147f0 con 0x7f0acc069de0 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.655+0000 7f0ac97fa700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.656+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ac40852b0 con 0x7f0acc069de0 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.656+0000 7f0ad0fe4700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.656+0000 7f0ad0fe4700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ab8066f30 0x7f0ab80693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0ca870 tx=0x7f0ac00011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:58.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.660+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ac4052520 con 0x7f0acc069de0 2023-10-08T16:05:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.853+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0acc04c3c0 con 0x7f0acc069de0 2023-10-08T16:05:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.854+0000 7f0ac97fa700 1 -- 172.21.15.60:0/1925849602 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f0ac405b020 con 0x7f0acc069de0 2023-10-08T16:05:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:58.855 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:57.899650+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ab8066f30 msgr2=0x7f0ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ab8066f30 0x7f0ab80693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0ca870 tx=0x7f0ac00011a0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 msgr2=0x7f0acc0c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 0x7f0acc0c24c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009ef0 tx=0x7f0ac400b040 comp rx=0 tx=0).stop 2023-10-08T16:05:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 shutdown_connections 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0acc0c9930 0x7f0acc0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0acc069de0 0x7f0acc0c24c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 --2- 172.21.15.60:0/1925849602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0acc0c9560 0x7f0acc0c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.856+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 >> 172.21.15.60:0/1925849602 conn(0x7f0acc067660 msgr2=0x7f0acc0c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.857+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 shutdown_connections 2023-10-08T16:05:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.857+0000 7f0ad3a49700 1 -- 172.21.15.60:0/1925849602 wait complete. 2023-10-08T16:05:58.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:05:58.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.988+0000 7f3df142c700 1 Processor -- start 2023-10-08T16:05:58.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.988+0000 7f3df142c700 1 -- start start 2023-10-08T16:05:58.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3df142c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0abae0 0x7f3dec0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3df142c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3dec0c8b10 0x7f3dec0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3df142c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec0c9cb0 con 0x7f3dec0abeb0 2023-10-08T16:05:58.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3df142c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0c90a0 con 0x7f3dec0c8b10 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3df142c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c9380 con 0x7f3dec0abae0 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3deb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3dec0c8b10 0x7f3dec0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3dea7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3dec0abeb0 0x7f3dec0c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40464/0 (socket says 172.21.15.60:40464) 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.989+0000 7f3dea7fc700 1 -- 172.21.15.60:0/1632092148 learned_addr learned my addr 172.21.15.60:0/1632092148 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deaffd700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0abae0 0x7f3dec0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deb7fe700 1 -- 172.21.15.60:0/1632092148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0abae0 msgr2=0x7f3dec0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deb7fe700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0abae0 0x7f3dec0c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deb7fe700 1 -- 172.21.15.60:0/1632092148 >> v1:172.21.15.60:6789/0 conn(0x7f3dec0abeb0 legacy=0x7f3dec0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deb7fe700 1 -- 172.21.15.60:0/1632092148 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0c9660 con 0x7f3dec0c8b10 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3de9ffb700 1 -- 172.21.15.60:0/1632092148 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536995748 0 0) 0x7f3dec0c9cb0 con 0x7f3dec0abeb0 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deaffd700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0abae0 0x7f3dec0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:05:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3deb7fe700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0c8b10 0x7f3dec0c73f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3de40098e0 tx=0x7f3de40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eff7819b04e66f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3de9ffb700 1 -- 172.21.15.60:0/1632092148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4009e80 con 0x7f3dec0c8b10 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3de9ffb700 1 -- 172.21.15.60:0/1632092148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400b860 con 0x7f3dec0c8b10 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.990+0000 7f3de9ffb700 1 -- 172.21.15.60:0/1632092148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400bbe0 con 0x7f3dec0c8b10 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 -- 172.21.15.60:0/1632092148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0c8b10 msgr2=0x7f3dec0c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0c8b10 0x7f3dec0c73f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3de40098e0 tx=0x7f3de40091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 -- 172.21.15.60:0/1632092148 shutdown_connections 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0c8b10 0x7f3dec0c73f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 --2- 172.21.15.60:0/1632092148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0abae0 0x7f3dec0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 -- 172.21.15.60:0/1632092148 >> 172.21.15.60:0/1632092148 conn(0x7f3dec067660 msgr2=0x7f3dec067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 -- 172.21.15.60:0/1632092148 shutdown_connections 2023-10-08T16:05:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.991+0000 7f3df142c700 1 -- 172.21.15.60:0/1632092148 wait complete. 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.992+0000 7f3df142c700 1 Processor -- start 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.992+0000 7f3df142c700 1 -- start start 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 0x7f3dec165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec0abeb0 0x7f3dec0c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0c8b10 0x7f3dec0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c5350 con 0x7f3dec0abae0 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c4740 con 0x7f3dec0abeb0 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c4a20 con 0x7f3dec0c8b10 2023-10-08T16:05:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 0x7f3dec165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 0x7f3dec165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42832/0 (socket says 172.21.15.60:42832) 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 -- 172.21.15.60:0/2259768271 learned_addr learned my addr 172.21.15.60:0/2259768271 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3dea7fc700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec0abeb0 0x7f3dec0c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deb7fe700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0c8b10 0x7f3dec0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 -- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0c8b10 msgr2=0x7f3dec0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0c8b10 0x7f3dec0c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 -- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec0abeb0 msgr2=0x7f3dec0c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec0abeb0 0x7f3dec0c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 -- 172.21.15.60:0/2259768271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4009420 con 0x7f3dec0abae0 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3deaffd700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 0x7f3dec165120 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00cfb0 tx=0x7f3ddc007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc016420 con 0x7f3dec0abae0 2023-10-08T16:05:58.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc016580 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0c4d00 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.993+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc016940 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.994+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec06da20 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.995+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec04c3c0 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.995+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ddc016d30 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.995+0000 7f3dd2ffd700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3dd8066f30 0x7f3dd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.995+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ddc012070 con 0x7f3dec0abae0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.995+0000 7f3dea7fc700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3dd8066f30 0x7f3dd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:58.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:58.996+0000 7f3dea7fc700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3dd8066f30 0x7f3dd80693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3dec06a3f0 tx=0x7f3de0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:59.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.000+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ddc04e5a0 con 0x7f3dec0abae0 2023-10-08T16:05:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.194+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dec06aeb0 con 0x7f3dec0abae0 2023-10-08T16:05:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.195+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/2259768271 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f3ddc0521b0 con 0x7f3dec0abae0 2023-10-08T16:05:59.195 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:05:59.195 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:57.899650+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:05:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3dd8066f30 msgr2=0x7f3dd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3dd8066f30 0x7f3dd80693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3dec06a3f0 tx=0x7f3de0009040 comp rx=0 tx=0).stop 2023-10-08T16:05:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 msgr2=0x7f3dec165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 0x7f3dec165120 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00cfb0 tx=0x7f3ddc007870 comp rx=0 tx=0).stop 2023-10-08T16:05:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 shutdown_connections 2023-10-08T16:05:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3dd8066f30 0x7f3dd80693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dec0c8b10 0x7f3dec0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec0abae0 0x7f3dec165120 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 --2- 172.21.15.60:0/2259768271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec0abeb0 0x7f3dec0c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.196+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 >> 172.21.15.60:0/2259768271 conn(0x7f3dec067660 msgr2=0x7f3dec0c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.197+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 shutdown_connections 2023-10-08T16:05:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.197+0000 7f3df142c700 1 -- 172.21.15.60:0/2259768271 wait complete. 2023-10-08T16:05:59.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:05:59.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.331+0000 7f34cbee5700 1 Processor -- start 2023-10-08T16:05:59.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.332+0000 7f34cbee5700 1 -- start start 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.332+0000 7f34cbee5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34c40ab910 0x7f34c40caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.332+0000 7f34cbee5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34c415a730 0x7f34c40c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.332+0000 7f34cbee5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c415abc0 con 0x7f34c40abce0 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.332+0000 7f34cbee5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c40c9100 con 0x7f34c415a730 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.332+0000 7f34cbee5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c4158050 con 0x7f34c40ab910 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9480700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34c415a730 0x7f34c40c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34ca482700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34c40abce0 0x7f34c40cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40478/0 (socket says 172.21.15.60:40478) 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34ca482700 1 -- 172.21.15.60:0/3715469888 learned_addr learned my addr 172.21.15.60:0/3715469888 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9c81700 1 --2- 172.21.15.60:0/3715469888 >> v2:172.21.15.144:3300/0 conn(0x7f34c40ab910 0x7f34c40caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c8c7f700 1 -- 172.21.15.60:0/3715469888 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356776397 0 0) 0x7f34c415abc0 con 0x7f34c40abce0 2023-10-08T16:05:59.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c8c7f700 1 -- 172.21.15.60:0/3715469888 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b0003570 con 0x7f34c40abce0 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9480700 1 -- 172.21.15.60:0/3715469888 >> v2:172.21.15.144:3300/0 conn(0x7f34c40ab910 msgr2=0x7f34c40caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9480700 1 --2- 172.21.15.60:0/3715469888 >> v2:172.21.15.144:3300/0 conn(0x7f34c40ab910 0x7f34c40caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9480700 1 -- 172.21.15.60:0/3715469888 >> v1:172.21.15.60:6789/0 conn(0x7f34c40abce0 legacy=0x7f34c40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9480700 1 -- 172.21.15.60:0/3715469888 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c415aea0 con 0x7f34c415a730 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c9480700 1 --2- 172.21.15.60:0/3715469888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c40c2d20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f34c40ca4c0 tx=0x7f34b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a32fe650aed917f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c8c7f700 1 -- 172.21.15.60:0/3715469888 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011630 con 0x7f34c415a730 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c8c7f700 1 -- 172.21.15.60:0/3715469888 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4011790 con 0x7f34c415a730 2023-10-08T16:05:59.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.333+0000 7f34c8c7f700 1 -- 172.21.15.60:0/3715469888 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011b30 con 0x7f34c415a730 2023-10-08T16:05:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 -- 172.21.15.60:0/3715469888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 msgr2=0x7f34c40c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 --2- 172.21.15.60:0/3715469888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c40c2d20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f34c40ca4c0 tx=0x7f34b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 -- 172.21.15.60:0/3715469888 shutdown_connections 2023-10-08T16:05:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 --2- 172.21.15.60:0/3715469888 >> v2:172.21.15.144:3300/0 conn(0x7f34c40ab910 0x7f34c40caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 --2- 172.21.15.60:0/3715469888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c40c2d20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 -- 172.21.15.60:0/3715469888 >> 172.21.15.60:0/3715469888 conn(0x7f34c4067660 msgr2=0x7f34c4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 -- 172.21.15.60:0/3715469888 shutdown_connections 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.334+0000 7f34cbee5700 1 -- 172.21.15.60:0/3715469888 wait complete. 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.335+0000 7f34cbee5700 1 Processor -- start 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.335+0000 7f34cbee5700 1 -- start start 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34cbee5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34c40ab910 0x7f34c40aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34cbee5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c40abce0 0x7f34c414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34cbee5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34cbee5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c4144600 con 0x7f34c415a730 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34cbee5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c4158a10 con 0x7f34c40abce0 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34cbee5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40c3a30 con 0x7f34c40ab910 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c414cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42856/0 (socket says 172.21.15.60:42856) 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 -- 172.21.15.60:0/1585914244 learned_addr learned my addr 172.21.15.60:0/1585914244 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34c9c81700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34c40ab910 0x7f34c40aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34c9480700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c40abce0 0x7f34c414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 -- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34c40ab910 msgr2=0x7f34c40aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34c40ab910 0x7f34c40aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 -- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c40abce0 msgr2=0x7f34c414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c40abce0 0x7f34c414c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 -- 172.21.15.60:0/1585914244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4009420 con 0x7f34c415a730 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.336+0000 7f34ca482700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c414cc60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f34bc001460 tx=0x7f34bc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.337+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00a890 con 0x7f34c415a730 2023-10-08T16:05:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.337+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc00a9f0 con 0x7f34c415a730 2023-10-08T16:05:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.337+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00ad70 con 0x7f34c415a730 2023-10-08T16:05:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.337+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c40ace10 con 0x7f34c415a730 2023-10-08T16:05:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.337+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c41586a0 con 0x7f34c415a730 2023-10-08T16:05:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.338+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c4158b80 con 0x7f34c415a730 2023-10-08T16:05:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.338+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34bc007300 con 0x7f34c415a730 2023-10-08T16:05:59.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.338+0000 7f34b9ffb700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34a8066f30 0x7f34a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:05:59.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.339+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34bc084910 con 0x7f34c415a730 2023-10-08T16:05:59.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.339+0000 7f34c9c81700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34a8066f30 0x7f34a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:05:59.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.339+0000 7f34c9c81700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34a8066f30 0x7f34a80693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009d10 tx=0x7f34c00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:05:59.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.343+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34bc051b60 con 0x7f34c415a730 2023-10-08T16:05:59.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:05:59.587+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f34c404c3c0 con 0x7f34c415a730 2023-10-08T16:06:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.523+0000 7f34b9ffb700 1 -- 172.21.15.60:0/1585914244 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34bc055180 con 0x7f34c415a730 2023-10-08T16:06:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34a8066f30 msgr2=0x7f34a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34a8066f30 0x7f34a80693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009d10 tx=0x7f34c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 msgr2=0x7f34c414cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c414cc60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f34bc001460 tx=0x7f34bc001ae0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 shutdown_connections 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34a8066f30 0x7f34a80693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34c40ab910 0x7f34c40aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c415a730 0x7f34c414cc60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 --2- 172.21.15.60:0/1585914244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34c40abce0 0x7f34c414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.525+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 >> 172.21.15.60:0/1585914244 conn(0x7f34c4067660 msgr2=0x7f34c41578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.526+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 shutdown_connections 2023-10-08T16:06:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.526+0000 7f34cbee5700 1 -- 172.21.15.60:0/1585914244 wait complete. 2023-10-08T16:06:00.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:06:00.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.669+0000 7f0af5316700 1 Processor -- start 2023-10-08T16:06:00.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.669+0000 7f0af5316700 1 -- start start 2023-10-08T16:06:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0af5316700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0af015afb0 0x7f0af00d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0af5316700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0af00d12a0 0x7f0af00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0af5316700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af01513f0 con 0x7f0af00cd300 2023-10-08T16:06:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0af5316700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af015e7a0 con 0x7f0af015afb0 2023-10-08T16:06:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0af5316700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af015b430 con 0x7f0af00d12a0 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0aee7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0af015afb0 0x7f0af00d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0aee7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0af015afb0 0x7f0af00d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42860/0 (socket says 172.21.15.60:42860) 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.670+0000 7f0aee7fc700 1 -- 172.21.15.60:0/38476091 learned_addr learned my addr 172.21.15.60:0/38476091 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aef7fe700 1 --2- 172.21.15.60:0/38476091 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d12a0 0x7f0af00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aee7fc700 1 -- 172.21.15.60:0/38476091 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d12a0 msgr2=0x7f0af00cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aee7fc700 1 --2- 172.21.15.60:0/38476091 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d12a0 0x7f0af00cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aee7fc700 1 -- 172.21.15.60:0/38476091 >> v1:172.21.15.144:6789/0 conn(0x7f0af00cd300 legacy=0x7f0af00b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aee7fc700 1 -- 172.21.15.60:0/38476091 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00d1700 con 0x7f0af015afb0 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aee7fc700 1 --2- 172.21.15.60:0/38476091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af015afb0 0x7f0af00d0d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0af0089a90 tx=0x7f0ad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f5b230df37ad03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aedffb700 1 -- 172.21.15.60:0/38476091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800b820 con 0x7f0af015afb0 2023-10-08T16:06:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aedffb700 1 -- 172.21.15.60:0/38476091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad800b980 con 0x7f0af015afb0 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.671+0000 7f0aedffb700 1 -- 172.21.15.60:0/38476091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800bd20 con 0x7f0af015afb0 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 -- 172.21.15.60:0/38476091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af015afb0 msgr2=0x7f0af00d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 --2- 172.21.15.60:0/38476091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af015afb0 0x7f0af00d0d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0af0089a90 tx=0x7f0ad8009250 comp rx=0 tx=0).stop 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 -- 172.21.15.60:0/38476091 shutdown_connections 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 --2- 172.21.15.60:0/38476091 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d12a0 0x7f0af00cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 --2- 172.21.15.60:0/38476091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af015afb0 0x7f0af00d0d60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 -- 172.21.15.60:0/38476091 >> 172.21.15.60:0/38476091 conn(0x7f0af0068d90 msgr2=0x7f0af0069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 -- 172.21.15.60:0/38476091 shutdown_connections 2023-10-08T16:06:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.672+0000 7f0af5316700 1 -- 172.21.15.60:0/38476091 wait complete. 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.673+0000 7f0af5316700 1 Processor -- start 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.673+0000 7f0af5316700 1 -- start start 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0af00cd300 0x7f0af0169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 0x7f0af015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af015afb0 0x7f0af015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00c8360 con 0x7f0af00d12a0 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00c96f0 con 0x7f0af00cd300 2023-10-08T16:06:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00c99d0 con 0x7f0af015afb0 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 0x7f0af015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 0x7f0af015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42872/0 (socket says 172.21.15.60:42872) 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 -- 172.21.15.60:0/1295423309 learned_addr learned my addr 172.21.15.60:0/1295423309 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aeeffd700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0af00cd300 0x7f0af0169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aef7fe700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af015afb0 0x7f0af015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 -- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af015afb0 msgr2=0x7f0af015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af015afb0 0x7f0af015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 -- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0af00cd300 msgr2=0x7f0af0169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0af00cd300 0x7f0af0169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 -- 172.21.15.60:0/1295423309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80094f0 con 0x7f0af00d12a0 2023-10-08T16:06:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0aee7fc700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 0x7f0af015cb40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80094c0 tx=0x7f0ad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8024440 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad80245c0 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af00c9cb0 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8024980 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.674+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af016a520 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.675+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af00c84d0 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.676+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ad801a420 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.676+0000 7f0ae6ffd700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.676+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ad80861f0 con 0x7f0af00d12a0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.676+0000 7f0aeeffd700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:00.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.677+0000 7f0aeeffd700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ad0066f30 0x7f0ad00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8003860 tx=0x7f0ae8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:00.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.681+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0af00c84d0 con 0x7f0af00d12a0 2023-10-08T16:06:00.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:00.918+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0af00d1700 con 0x7f0af00d12a0 2023-10-08T16:06:01.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.524+0000 7f0ae6ffd700 1 -- 172.21.15.60:0/1295423309 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0af00d1700 con 0x7f0af00d12a0 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ad0066f30 msgr2=0x7f0ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ad0066f30 0x7f0ad00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8003860 tx=0x7f0ae8009040 comp rx=0 tx=0).stop 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 msgr2=0x7f0af015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 0x7f0af015cb40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80094c0 tx=0x7f0ad8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 shutdown_connections 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ad0066f30 0x7f0ad00693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af015afb0 0x7f0af015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0af00cd300 0x7f0af0169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 --2- 172.21.15.60:0/1295423309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0af00d12a0 0x7f0af015cb40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 >> 172.21.15.60:0/1295423309 conn(0x7f0af0068d90 msgr2=0x7f0af0150610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:01.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 shutdown_connections 2023-10-08T16:06:01.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.526+0000 7f0af5316700 1 -- 172.21.15.60:0/1295423309 wait complete. 2023-10-08T16:06:01.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:01.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.660+0000 7f1928e47700 1 Processor -- start 2023-10-08T16:06:01.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.660+0000 7f1928e47700 1 -- start start 2023-10-08T16:06:01.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1928e47700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1924152010 0x7f192415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:01.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1928e47700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924158e50 0x7f19240cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1928e47700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192406c010 con 0x7f19241523e0 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1928e47700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192406bd10 con 0x7f1924152010 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1928e47700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192415c060 con 0x7f1924158e50 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1921d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19241523e0 0x7f192406c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40480/0 (socket says 172.21.15.60:40480) 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1921d9b700 1 -- 172.21.15.60:0/1248873192 learned_addr learned my addr 172.21.15.60:0/1248873192 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f1922d9d700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924158e50 0x7f19240cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.661+0000 7f192259c700 1 --2- 172.21.15.60:0/1248873192 >> v2:172.21.15.144:3300/0 conn(0x7f1924152010 0x7f192415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192159a700 1 -- 172.21.15.60:0/1248873192 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167150467 0 0) 0x7f192406c010 con 0x7f19241523e0 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192159a700 1 -- 172.21.15.60:0/1248873192 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1910003570 con 0x7f19241523e0 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192259c700 1 -- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924158e50 msgr2=0x7f19240cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192259c700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924158e50 0x7f19240cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192259c700 1 -- 172.21.15.60:0/1248873192 >> v1:172.21.15.60:6789/0 conn(0x7f19241523e0 legacy=0x7f192406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192259c700 1 -- 172.21.15.60:0/1248873192 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192415c340 con 0x7f1924152010 2023-10-08T16:06:01.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f1922d9d700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924158e50 0x7f19240cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:01.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192259c700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924152010 0x7f192415b810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f191c009e60 tx=0x7f191c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8395cf6c32748bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:01.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192159a700 1 -- 172.21.15.60:0/1248873192 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00e070 con 0x7f1924152010 2023-10-08T16:06:01.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192159a700 1 -- 172.21.15.60:0/1248873192 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00bab0 con 0x7f1924152010 2023-10-08T16:06:01.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.662+0000 7f192159a700 1 -- 172.21.15.60:0/1248873192 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00be70 con 0x7f1924152010 2023-10-08T16:06:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 -- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924152010 msgr2=0x7f192415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924152010 0x7f192415b810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f191c009e60 tx=0x7f191c009780 comp rx=0 tx=0).stop 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 -- 172.21.15.60:0/1248873192 shutdown_connections 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924158e50 0x7f19240cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 --2- 172.21.15.60:0/1248873192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924152010 0x7f192415b810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 -- 172.21.15.60:0/1248873192 >> 172.21.15.60:0/1248873192 conn(0x7f1924069870 msgr2=0x7f1924069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 -- 172.21.15.60:0/1248873192 shutdown_connections 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.663+0000 7f1928e47700 1 -- 172.21.15.60:0/1248873192 wait complete. 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.664+0000 7f1928e47700 1 Processor -- start 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.664+0000 7f1928e47700 1 -- start start 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1928e47700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924152010 0x7f1924147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1928e47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 0x7f19240b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1928e47700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924158e50 0x7f192416b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1928e47700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b2f40 con 0x7f19241523e0 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1928e47700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924147ed0 con 0x7f1924158e50 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1928e47700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192416bf20 con 0x7f1924152010 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 0x7f19240b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 0x7f19240b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42884/0 (socket says 172.21.15.60:42884) 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 -- 172.21.15.60:0/2861870593 learned_addr learned my addr 172.21.15.60:0/2861870593 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f192259c700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924152010 0x7f1924147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1922d9d700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924158e50 0x7f192416b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 -- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924152010 msgr2=0x7f1924147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924152010 0x7f1924147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 -- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924158e50 msgr2=0x7f192416b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924158e50 0x7f192416b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 -- 172.21.15.60:0/2861870593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009420 con 0x7f19241523e0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f192259c700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924152010 0x7f1924147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f1921d9b700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 0x7f19240b33d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c7c0 tx=0x7f190c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c005b30 con 0x7f19241523e0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.665+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c005c90 con 0x7f19241523e0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.666+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c009a20 con 0x7f19241523e0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.666+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c007340 con 0x7f19241523e0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.666+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19240b2bd0 con 0x7f19241523e0 2023-10-08T16:06:01.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.666+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192404c3c0 con 0x7f19241523e0 2023-10-08T16:06:01.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.667+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f190c01b400 con 0x7f19241523e0 2023-10-08T16:06:01.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.667+0000 7f191a7fc700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1904066f30 0x7f19040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:01.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.667+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f190c083f10 con 0x7f19241523e0 2023-10-08T16:06:01.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.667+0000 7f192259c700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1904066f30 0x7f19040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:01.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.668+0000 7f192259c700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1904066f30 0x7f19040693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f191c0097c0 tx=0x7f191c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:01.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.671+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f190c0512c0 con 0x7f19241523e0 2023-10-08T16:06:01.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.910+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19240cd9d0 con 0x7f19241523e0 2023-10-08T16:06:01.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.910+0000 7f191a7fc700 1 -- 172.21.15.60:0/2861870593 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f190c0548e0 con 0x7f19241523e0 2023-10-08T16:06:01.911 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:01.911 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1904066f30 msgr2=0x7f19040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1904066f30 0x7f19040693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f191c0097c0 tx=0x7f191c019000 comp rx=0 tx=0).stop 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 msgr2=0x7f19240b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 0x7f19240b33d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c7c0 tx=0x7f190c007e00 comp rx=0 tx=0).stop 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 shutdown_connections 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1904066f30 0x7f19040693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1924152010 0x7f1924147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1924158e50 0x7f192416b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 --2- 172.21.15.60:0/2861870593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19241523e0 0x7f19240b33d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 >> 172.21.15.60:0/2861870593 conn(0x7f1924069870 msgr2=0x7f1924158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.912+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 shutdown_connections 2023-10-08T16:06:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:01.913+0000 7f1928e47700 1 -- 172.21.15.60:0/2861870593 wait complete. 2023-10-08T16:06:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:01.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:02.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.043+0000 7efc49a61700 1 Processor -- start 2023-10-08T16:06:02.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.043+0000 7efc49a61700 1 -- start start 2023-10-08T16:06:02.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc49a61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc49a61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440cb7c0 con 0x7efc440cdab0 2023-10-08T16:06:02.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc49a61700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4415e290 con 0x7efc4415cbd0 2023-10-08T16:06:02.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc49a61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4415e850 con 0x7efc440cd6e0 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc43fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efc440cdab0 0x7efc4415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40492/0 (socket says 172.21.15.60:40492) 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc43fff700 1 -- 172.21.15.60:0/2572452177 learned_addr learned my addr 172.21.15.60:0/2572452177 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc48a5f700 1 --2- 172.21.15.60:0/2572452177 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319541386 0 0) 0x7efc440cb7c0 con 0x7efc440cdab0 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc30003570 con 0x7efc440cdab0 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341501638 0 0) 0x7efc4415e290 con 0x7efc4415cbd0 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc440cb7c0 con 0x7efc4415cbd0 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc48a5f700 1 -- 172.21.15.60:0/2572452177 >> v1:172.21.15.144:6789/0 conn(0x7efc4415cbd0 legacy=0x7efc4415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc48a5f700 1 -- 172.21.15.60:0/2572452177 >> v1:172.21.15.60:6789/0 conn(0x7efc440cdab0 legacy=0x7efc4415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.044+0000 7efc48a5f700 1 -- 172.21.15.60:0/2572452177 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4415e570 con 0x7efc440cd6e0 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc48a5f700 1 --2- 172.21.15.60:0/2572452177 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440cbc50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009e90 tx=0x7efc3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac86ca9dd8a829d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00e070 con 0x7efc440cd6e0 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00bb80 con 0x7efc440cd6e0 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc437fe700 1 -- 172.21.15.60:0/2572452177 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c012430 con 0x7efc440cd6e0 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 -- 172.21.15.60:0/2572452177 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 msgr2=0x7efc440cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 --2- 172.21.15.60:0/2572452177 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440cbc50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009e90 tx=0x7efc3c009780 comp rx=0 tx=0).stop 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 -- 172.21.15.60:0/2572452177 shutdown_connections 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 --2- 172.21.15.60:0/2572452177 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440cbc50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 -- 172.21.15.60:0/2572452177 >> 172.21.15.60:0/2572452177 conn(0x7efc44067660 msgr2=0x7efc44067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:02.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 -- 172.21.15.60:0/2572452177 shutdown_connections 2023-10-08T16:06:02.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.045+0000 7efc49a61700 1 -- 172.21.15.60:0/2572452177 wait complete. 2023-10-08T16:06:02.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.046+0000 7efc49a61700 1 Processor -- start 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 -- start start 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 0x7efc441537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4415cbd0 0x7efc440b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc44151380 con 0x7efc440cdab0 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4414d0b0 con 0x7efc4415cbd0 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc49a61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc44151510 con 0x7efc440cd6e0 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc43fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 0x7efc441537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.047+0000 7efc43fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 0x7efc441537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42900/0 (socket says 172.21.15.60:42900) 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 -- 172.21.15.60:0/1549927218 learned_addr learned my addr 172.21.15.60:0/1549927218 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc48a5f700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc49260700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4415cbd0 0x7efc440b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 -- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 msgr2=0x7efc440b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 -- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4415cbd0 msgr2=0x7efc440b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4415cbd0 0x7efc440b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 -- 172.21.15.60:0/1549927218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009a20 con 0x7efc440cdab0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc43fff700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 0x7efc441537c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c790 tx=0x7efc34007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34005b30 con 0x7efc440cdab0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34005c90 con 0x7efc440cdab0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc440b6550 con 0x7efc440cdab0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34007300 con 0x7efc440cdab0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.048+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc440b4ce0 con 0x7efc440cdab0 2023-10-08T16:06:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.049+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc440c7870 con 0x7efc440cdab0 2023-10-08T16:06:02.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.050+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc3401b400 con 0x7efc440cdab0 2023-10-08T16:06:02.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.050+0000 7efc40ff9700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.050+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc34084060 con 0x7efc440cdab0 2023-10-08T16:06:02.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.050+0000 7efc48a5f700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.051+0000 7efc48a5f700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009de0 tx=0x7efc3c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.055+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc34054e90 con 0x7efc440cdab0 2023-10-08T16:06:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.248+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc44151650 con 0x7efc440cdab0 2023-10-08T16:06:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.249+0000 7efc40ff9700 1 -- 172.21.15.60:0/1549927218 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15350 (secure 0 0 0) 0x7efc340076f0 con 0x7efc440cdab0 2023-10-08T16:06:02.249 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:02.249 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:05:59.291645+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:02.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 msgr2=0x7efc240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009de0 tx=0x7efc3c019000 comp rx=0 tx=0).stop 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 msgr2=0x7efc441537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 0x7efc441537c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c790 tx=0x7efc34007ea0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 shutdown_connections 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc24066f30 0x7efc240693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc440cd6e0 0x7efc440b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4415cbd0 0x7efc440b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 --2- 172.21.15.60:0/1549927218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc440cdab0 0x7efc441537c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 >> 172.21.15.60:0/1549927218 conn(0x7efc44067660 msgr2=0x7efc440cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 shutdown_connections 2023-10-08T16:06:02.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.251+0000 7efc49a61700 1 -- 172.21.15.60:0/1549927218 wait complete. 2023-10-08T16:06:02.264 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:06:02.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:02.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:02.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:02.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.383+0000 7f3cafe97700 1 Processor -- start 2023-10-08T16:06:02.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cafe97700 1 -- start start 2023-10-08T16:06:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cafe97700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ca80c8f10 0x7f3ca815b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cafe97700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca815c6e0 con 0x7f3ca8141760 2023-10-08T16:06:02.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cafe97700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80c8150 con 0x7f3ca8070950 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cafe97700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80c8430 con 0x7f3ca80c8f10 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cad432700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ca80c8f10 0x7f3ca815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.384+0000 7f3cae434700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3ca8141760 0x7f3ca815bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53558/0 (socket says 172.21.15.60:53558) 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cae434700 1 -- 172.21.15.60:0/2566472994 learned_addr learned my addr 172.21.15.60:0/2566472994 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cad432700 1 -- 172.21.15.60:0/2566472994 >> v1:172.21.15.144:6789/0 conn(0x7f3ca8070950 legacy=0x7f3ca8141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cad432700 1 -- 172.21.15.60:0/2566472994 >> v1:172.21.15.60:6789/0 conn(0x7f3ca8141760 legacy=0x7f3ca815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cad432700 1 -- 172.21.15.60:0/2566472994 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80c8710 con 0x7f3ca80c8f10 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cad432700 1 --2- 172.21.15.60:0/2566472994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca80c8f10 0x7f3ca815b990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0098e0 tx=0x7f3c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737ef21ad8978b85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cacc31700 1 -- 172.21.15.60:0/2566472994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c009e80 con 0x7f3ca80c8f10 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cacc31700 1 -- 172.21.15.60:0/2566472994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c00b820 con 0x7f3ca80c8f10 2023-10-08T16:06:02.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.385+0000 7f3cacc31700 1 -- 172.21.15.60:0/2566472994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00bba0 con 0x7f3ca80c8f10 2023-10-08T16:06:02.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 -- 172.21.15.60:0/2566472994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca80c8f10 msgr2=0x7f3ca815b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2566472994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca80c8f10 0x7f3ca815b990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0098e0 tx=0x7f3c9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 -- 172.21.15.60:0/2566472994 shutdown_connections 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2566472994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca80c8f10 0x7f3ca815b990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 -- 172.21.15.60:0/2566472994 >> 172.21.15.60:0/2566472994 conn(0x7f3ca806ad20 msgr2=0x7f3ca80cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 -- 172.21.15.60:0/2566472994 shutdown_connections 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.386+0000 7f3cafe97700 1 -- 172.21.15.60:0/2566472994 wait complete. 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.387+0000 7f3cafe97700 1 Processor -- start 2023-10-08T16:06:02.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.387+0000 7f3cafe97700 1 -- start start 2023-10-08T16:06:02.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 0x7f3ca813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca80c8f10 0x7f3ca80b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca8141760 0x7f3ca80c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca813af30 con 0x7f3ca8070950 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca813a0c0 con 0x7f3ca8141760 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca813a340 con 0x7f3ca80c8f10 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 0x7f3ca813b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 0x7f3ca813b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52360/0 (socket says 172.21.15.60:52360) 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 -- 172.21.15.60:0/2726027796 learned_addr learned my addr 172.21.15.60:0/2726027796 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cae434700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca8141760 0x7f3ca80c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cad432700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca80c8f10 0x7f3ca80b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 -- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca80c8f10 msgr2=0x7f3ca80b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca80c8f10 0x7f3ca80b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 -- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca8141760 msgr2=0x7f3ca80c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca8141760 0x7f3ca80c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 -- 172.21.15.60:0/2726027796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009420 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cae434700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca8141760 0x7f3ca80c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cadc33700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 0x7f3ca813b3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000b610 tx=0x7f3ca0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000f510 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000f690 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca813a600 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.388+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000fa50 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.389+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca813abc0 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.390+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca813b210 con 0x7f3ca8070950 2023-10-08T16:06:02.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.390+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ca001a400 con 0x7f3ca8070950 2023-10-08T16:06:02.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.390+0000 7f3ca5ffb700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3c94066f30 0x7f3c940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.390+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ca0083fc0 con 0x7f3ca8070950 2023-10-08T16:06:02.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.390+0000 7f3cad432700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3c94066f30 0x7f3c940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.391+0000 7f3cad432700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3c94066f30 0x7f3c940693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80c9300 tx=0x7f3c9c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.395+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ca00512b0 con 0x7f3ca8070950 2023-10-08T16:06:02.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.583+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ca813b070 con 0x7f3c94066f30 2023-10-08T16:06:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.591+0000 7f3ca5ffb700 1 -- 172.21.15.60:0/2726027796 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285097 (secure 0 0 0) 0x7f3c9c000ce0 con 0x7f3c94066f30 2023-10-08T16:06:02.595 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3c94066f30 msgr2=0x7f3c940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3c94066f30 0x7f3c940693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80c9300 tx=0x7f3c9c016000 comp rx=0 tx=0).stop 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 msgr2=0x7f3ca813b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 0x7f3ca813b3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000b610 tx=0x7f3ca0009120 comp rx=0 tx=0).stop 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 shutdown_connections 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3c94066f30 0x7f3c940693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca8141760 0x7f3ca80c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ca8070950 0x7f3ca813b3c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 --2- 172.21.15.60:0/2726027796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca80c8f10 0x7f3ca80b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 >> 172.21.15.60:0/2726027796 conn(0x7f3ca806ad20 msgr2=0x7f3ca806ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 shutdown_connections 2023-10-08T16:06:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.595+0000 7f3cafe97700 1 -- 172.21.15.60:0/2726027796 wait complete. 2023-10-08T16:06:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:06:02.607 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-10-08T16:06:01.572899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560269,"statfs":{"total":1600000000,"available":1597716372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076986"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307232+0000","last_change":"2023-10-08T16:05:58.307104+0000","last_active":"2023-10-08T16:05:58.307232+0000","last_peered":"2023-10-08T16:05:58.307232+0000","last_clean":"2023-10-08T16:05:58.307232+0000","last_became_active":"2023-10-08T16:05:58.306500+0000","last_became_peered":"2023-10-08T16:05:58.306500+0000","last_unstale":"2023-10-08T16:05:58.307232+0000","last_undegraded":"2023-10-08T16:05:58.307232+0000","last_fullsized":"2023-10-08T16:05:58.307232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:21.770629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300807+0000","last_change":"2023-10-08T16:05:58.300737+0000","last_active":"2023-10-08T16:05:58.300807+0000","last_peered":"2023-10-08T16:05:58.300807+0000","last_clean":"2023-10-08T16:05:58.300807+0000","last_became_active":"2023-10-08T16:05:58.300374+0000","last_became_peered":"2023-10-08T16:05:58.300374+0000","last_unstale":"2023-10-08T16:05:58.300807+0000","last_undegraded":"2023-10-08T16:05:58.300807+0000","last_fullsized":"2023-10-08T16:05:58.300807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:34.735994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302965+0000","last_change":"2023-10-08T16:05:58.302893+0000","last_active":"2023-10-08T16:05:58.302965+0000","last_peered":"2023-10-08T16:05:58.302965+0000","last_clean":"2023-10-08T16:05:58.302965+0000","last_became_active":"2023-10-08T16:05:58.302281+0000","last_became_peered":"2023-10-08T16:05:58.302281+0000","last_unstale":"2023-10-08T16:05:58.302965+0000","last_undegraded":"2023-10-08T16:05:58.302965+0000","last_fullsized":"2023-10-08T16:05:58.302965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:32.544629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306334+0000","last_change":"2023-10-08T16:05:58.306206+0000","last_active":"2023-10-08T16:05:58.306334+0000","last_peered":"2023-10-08T16:05:58.306334+0000","last_clean":"2023-10-08T16:05:58.306334+0000","last_became_active":"2023-10-08T16:05:58.302809+0000","last_became_peered":"2023-10-08T16:05:58.302809+0000","last_unstale":"2023-10-08T16:05:58.306334+0000","last_undegraded":"2023-10-08T16:05:58.306334+0000","last_fullsized":"2023-10-08T16:05:58.306334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:27.910282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301781+0000","last_change":"2023-10-08T16:05:58.301781+0000","last_active":"2023-10-08T16:05:58.301781+0000","last_peered":"2023-10-08T16:05:58.301781+0000","last_clean":"2023-10-08T16:05:58.301781+0000","last_became_active":"2023-10-08T16:05:58.301512+0000","last_became_peered":"2023-10-08T16:05:58.301512+0000","last_unstale":"2023-10-08T16:05:58.301781+0000","last_undegraded":"2023-10-08T16:05:58.301781+0000","last_fullsized":"2023-10-08T16:05:58.301781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:18.335648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304936+0000","last_change":"2023-10-08T16:05:58.304867+0000","last_active":"2023-10-08T16:05:58.304936+0000","last_peered":"2023-10-08T16:05:58.304936+0000","last_clean":"2023-10-08T16:05:58.304936+0000","last_became_active":"2023-10-08T16:05:58.303982+0000","last_became_peered":"2023-10-08T16:05:58.303982+0000","last_unstale":"2023-10-08T16:05:58.304936+0000","last_undegraded":"2023-10-08T16:05:58.304936+0000","last_fullsized":"2023-10-08T16:05:58.304936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:59.519155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.308806+0000","last_change":"2023-10-08T16:05:58.308730+0000","last_active":"2023-10-08T16:05:58.308806+0000","last_peered":"2023-10-08T16:05:58.308806+0000","last_clean":"2023-10-08T16:05:58.308806+0000","last_became_active":"2023-10-08T16:05:58.308088+0000","last_became_peered":"2023-10-08T16:05:58.308088+0000","last_unstale":"2023-10-08T16:05:58.308806+0000","last_undegraded":"2023-10-08T16:05:58.308806+0000","last_fullsized":"2023-10-08T16:05:58.308806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:34.735994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307914+0000","last_change":"2023-10-08T16:05:58.307849+0000","last_active":"2023-10-08T16:05:58.307914+0000","last_peered":"2023-10-08T16:05:58.307914+0000","last_clean":"2023-10-08T16:05:58.307914+0000","last_became_active":"2023-10-08T16:05:58.307623+0000","last_became_peered":"2023-10-08T16:05:58.307623+0000","last_unstale":"2023-10-08T16:05:58.307914+0000","last_undegraded":"2023-10-08T16:05:58.307914+0000","last_fullsized":"2023-10-08T16:05:58.307914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301512+0000","last_change":"2023-10-08T16:05:58.298641+0000","last_active":"2023-10-08T16:05:58.301512+0000","last_peered":"2023-10-08T16:05:58.301512+0000","last_clean":"2023-10-08T16:05:58.301512+0000","last_became_active":"2023-10-08T16:05:58.298408+0000","last_became_peered":"2023-10-08T16:05:58.298408+0000","last_unstale":"2023-10-08T16:05:58.301512+0000","last_undegraded":"2023-10-08T16:05:58.301512+0000","last_fullsized":"2023-10-08T16:05:58.301512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:37.195652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302253+0000","last_change":"2023-10-08T16:05:58.302187+0000","last_active":"2023-10-08T16:05:58.302253+0000","last_peered":"2023-10-08T16:05:58.302253+0000","last_clean":"2023-10-08T16:05:58.302253+0000","last_became_active":"2023-10-08T16:05:58.301662+0000","last_became_peered":"2023-10-08T16:05:58.301662+0000","last_unstale":"2023-10-08T16:05:58.302253+0000","last_undegraded":"2023-10-08T16:05:58.302253+0000","last_fullsized":"2023-10-08T16:05:58.302253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300435+0000","last_change":"2023-10-08T16:05:58.300295+0000","last_active":"2023-10-08T16:05:58.300435+0000","last_peered":"2023-10-08T16:05:58.300435+0000","last_clean":"2023-10-08T16:05:58.300435+0000","last_became_active":"2023-10-08T16:05:58.300031+0000","last_became_peered":"2023-10-08T16:05:58.300031+0000","last_unstale":"2023-10-08T16:05:58.300435+0000","last_undegraded":"2023-10-08T16:05:58.300435+0000","last_fullsized":"2023-10-08T16:05:58.300435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:22.211164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304133+0000","last_change":"2023-10-08T16:05:58.303847+0000","last_active":"2023-10-08T16:05:58.304133+0000","last_peered":"2023-10-08T16:05:58.304133+0000","last_clean":"2023-10-08T16:05:58.304133+0000","last_became_active":"2023-10-08T16:05:58.302341+0000","last_became_peered":"2023-10-08T16:05:58.302341+0000","last_unstale":"2023-10-08T16:05:58.304133+0000","last_undegraded":"2023-10-08T16:05:58.304133+0000","last_fullsized":"2023-10-08T16:05:58.304133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:34.735994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296455+0000","last_change":"2023-10-08T16:05:58.296455+0000","last_active":"2023-10-08T16:05:58.296455+0000","last_peered":"2023-10-08T16:05:58.296455+0000","last_clean":"2023-10-08T16:05:58.296455+0000","last_became_active":"2023-10-08T16:05:58.296218+0000","last_became_peered":"2023-10-08T16:05:58.296218+0000","last_unstale":"2023-10-08T16:05:58.296455+0000","last_undegraded":"2023-10-08T16:05:58.296455+0000","last_fullsized":"2023-10-08T16:05:58.296455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:10.087593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303495+0000","last_change":"2023-10-08T16:05:58.303359+0000","last_active":"2023-10-08T16:05:58.303495+0000","last_peered":"2023-10-08T16:05:58.303495+0000","last_clean":"2023-10-08T16:05:58.303495+0000","last_became_active":"2023-10-08T16:05:58.303115+0000","last_became_peered":"2023-10-08T16:05:58.303115+0000","last_unstale":"2023-10-08T16:05:58.303495+0000","last_undegraded":"2023-10-08T16:05:58.303495+0000","last_fullsized":"2023-10-08T16:05:58.303495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:09.114879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304941+0000","last_change":"2023-10-08T16:05:58.304874+0000","last_active":"2023-10-08T16:05:58.304941+0000","last_peered":"2023-10-08T16:05:58.304941+0000","last_clean":"2023-10-08T16:05:58.304941+0000","last_became_active":"2023-10-08T16:05:58.304629+0000","last_became_peered":"2023-10-08T16:05:58.304629+0000","last_unstale":"2023-10-08T16:05:58.304941+0000","last_undegraded":"2023-10-08T16:05:58.304941+0000","last_fullsized":"2023-10-08T16:05:58.304941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:16.890239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302333+0000","last_change":"2023-10-08T16:05:58.302192+0000","last_active":"2023-10-08T16:05:58.302333+0000","last_peered":"2023-10-08T16:05:58.302333+0000","last_clean":"2023-10-08T16:05:58.302333+0000","last_became_active":"2023-10-08T16:05:58.301948+0000","last_became_peered":"2023-10-08T16:05:58.301948+0000","last_unstale":"2023-10-08T16:05:58.302333+0000","last_undegraded":"2023-10-08T16:05:58.302333+0000","last_fullsized":"2023-10-08T16:05:58.302333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:32.544629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.308949+0000","last_change":"2023-10-08T16:05:58.308882+0000","last_active":"2023-10-08T16:05:58.308949+0000","last_peered":"2023-10-08T16:05:58.308949+0000","last_clean":"2023-10-08T16:05:58.308949+0000","last_became_active":"2023-10-08T16:05:58.308441+0000","last_became_peered":"2023-10-08T16:05:58.308441+0000","last_unstale":"2023-10-08T16:05:58.308949+0000","last_undegraded":"2023-10-08T16:05:58.308949+0000","last_fullsized":"2023-10-08T16:05:58.308949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:21.078947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304221+0000","last_change":"2023-10-08T16:05:58.304162+0000","last_active":"2023-10-08T16:05:58.304221+0000","last_peered":"2023-10-08T16:05:58.304221+0000","last_clean":"2023-10-08T16:05:58.304221+0000","last_became_active":"2023-10-08T16:05:58.303942+0000","last_became_peered":"2023-10-08T16:05:58.303942+0000","last_unstale":"2023-10-08T16:05:58.304221+0000","last_undegraded":"2023-10-08T16:05:58.304221+0000","last_fullsized":"2023-10-08T16:05:58.304221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:32.544629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307872+0000","last_change":"2023-10-08T16:05:58.307803+0000","last_active":"2023-10-08T16:05:58.307872+0000","last_peered":"2023-10-08T16:05:58.307872+0000","last_clean":"2023-10-08T16:05:58.307872+0000","last_became_active":"2023-10-08T16:05:58.307255+0000","last_became_peered":"2023-10-08T16:05:58.307255+0000","last_unstale":"2023-10-08T16:05:58.307872+0000","last_undegraded":"2023-10-08T16:05:58.307872+0000","last_fullsized":"2023-10-08T16:05:58.307872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:28:36.935723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296520+0000","last_change":"2023-10-08T16:05:58.296520+0000","last_active":"2023-10-08T16:05:58.296520+0000","last_peered":"2023-10-08T16:05:58.296520+0000","last_clean":"2023-10-08T16:05:58.296520+0000","last_became_active":"2023-10-08T16:05:58.296286+0000","last_became_peered":"2023-10-08T16:05:58.296286+0000","last_unstale":"2023-10-08T16:05:58.296520+0000","last_undegraded":"2023-10-08T16:05:58.296520+0000","last_fullsized":"2023-10-08T16:05:58.296520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:00.853800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302196+0000","last_change":"2023-10-08T16:05:58.301666+0000","last_active":"2023-10-08T16:05:58.302196+0000","last_peered":"2023-10-08T16:05:58.302196+0000","last_clean":"2023-10-08T16:05:58.302196+0000","last_became_active":"2023-10-08T16:05:58.301404+0000","last_became_peered":"2023-10-08T16:05:58.301404+0000","last_unstale":"2023-10-08T16:05:58.302196+0000","last_undegraded":"2023-10-08T16:05:58.302196+0000","last_fullsized":"2023-10-08T16:05:58.302196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:23.367591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305549+0000","last_change":"2023-10-08T16:05:58.305481+0000","last_active":"2023-10-08T16:05:58.305549+0000","last_peered":"2023-10-08T16:05:58.305549+0000","last_clean":"2023-10-08T16:05:58.305549+0000","last_became_active":"2023-10-08T16:05:58.305245+0000","last_became_peered":"2023-10-08T16:05:58.305245+0000","last_unstale":"2023-10-08T16:05:58.305549+0000","last_undegraded":"2023-10-08T16:05:58.305549+0000","last_fullsized":"2023-10-08T16:05:58.305549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.508410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304307+0000","last_change":"2023-10-08T16:05:58.304307+0000","last_active":"2023-10-08T16:05:58.304307+0000","last_peered":"2023-10-08T16:05:58.304307+0000","last_clean":"2023-10-08T16:05:58.304307+0000","last_became_active":"2023-10-08T16:05:58.304082+0000","last_became_peered":"2023-10-08T16:05:58.304082+0000","last_unstale":"2023-10-08T16:05:58.304307+0000","last_undegraded":"2023-10-08T16:05:58.304307+0000","last_fullsized":"2023-10-08T16:05:58.304307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298308+0000","last_change":"2023-10-08T16:05:58.298158+0000","last_active":"2023-10-08T16:05:58.298308+0000","last_peered":"2023-10-08T16:05:58.298308+0000","last_clean":"2023-10-08T16:05:58.298308+0000","last_became_active":"2023-10-08T16:05:58.297597+0000","last_became_peered":"2023-10-08T16:05:58.297597+0000","last_unstale":"2023-10-08T16:05:58.298308+0000","last_undegraded":"2023-10-08T16:05:58.298308+0000","last_fullsized":"2023-10-08T16:05:58.298308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:21.078947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302904+0000","last_change":"2023-10-08T16:05:58.302803+0000","last_active":"2023-10-08T16:05:58.302904+0000","last_peered":"2023-10-08T16:05:58.302904+0000","last_clean":"2023-10-08T16:05:58.302904+0000","last_became_active":"2023-10-08T16:05:58.302411+0000","last_became_peered":"2023-10-08T16:05:58.302411+0000","last_unstale":"2023-10-08T16:05:58.302904+0000","last_undegraded":"2023-10-08T16:05:58.302904+0000","last_fullsized":"2023-10-08T16:05:58.302904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:44.157676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305087+0000","last_change":"2023-10-08T16:05:58.305020+0000","last_active":"2023-10-08T16:05:58.305087+0000","last_peered":"2023-10-08T16:05:58.305087+0000","last_clean":"2023-10-08T16:05:58.305087+0000","last_became_active":"2023-10-08T16:05:58.304269+0000","last_became_peered":"2023-10-08T16:05:58.304269+0000","last_unstale":"2023-10-08T16:05:58.305087+0000","last_undegraded":"2023-10-08T16:05:58.305087+0000","last_fullsized":"2023-10-08T16:05:58.305087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:43.050975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300537+0000","last_change":"2023-10-08T16:05:58.300300+0000","last_active":"2023-10-08T16:05:58.300537+0000","last_peered":"2023-10-08T16:05:58.300537+0000","last_clean":"2023-10-08T16:05:58.300537+0000","last_became_active":"2023-10-08T16:05:58.299763+0000","last_became_peered":"2023-10-08T16:05:58.299763+0000","last_unstale":"2023-10-08T16:05:58.300537+0000","last_undegraded":"2023-10-08T16:05:58.300537+0000","last_fullsized":"2023-10-08T16:05:58.300537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:34:36.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302836+0000","last_change":"2023-10-08T16:05:58.302702+0000","last_active":"2023-10-08T16:05:58.302836+0000","last_peered":"2023-10-08T16:05:58.302836+0000","last_clean":"2023-10-08T16:05:58.302836+0000","last_became_active":"2023-10-08T16:05:58.301959+0000","last_became_peered":"2023-10-08T16:05:58.301959+0000","last_unstale":"2023-10-08T16:05:58.302836+0000","last_undegraded":"2023-10-08T16:05:58.302836+0000","last_fullsized":"2023-10-08T16:05:58.302836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:09.114879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304100+0000","last_change":"2023-10-08T16:05:58.303683+0000","last_active":"2023-10-08T16:05:58.304100+0000","last_peered":"2023-10-08T16:05:58.304100+0000","last_clean":"2023-10-08T16:05:58.304100+0000","last_became_active":"2023-10-08T16:05:58.303312+0000","last_became_peered":"2023-10-08T16:05:58.303312+0000","last_unstale":"2023-10-08T16:05:58.304100+0000","last_undegraded":"2023-10-08T16:05:58.304100+0000","last_fullsized":"2023-10-08T16:05:58.304100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:17.645955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306978+0000","last_change":"2023-10-08T16:05:58.306912+0000","last_active":"2023-10-08T16:05:58.306978+0000","last_peered":"2023-10-08T16:05:58.306978+0000","last_clean":"2023-10-08T16:05:58.306978+0000","last_became_active":"2023-10-08T16:05:58.306399+0000","last_became_peered":"2023-10-08T16:05:58.306399+0000","last_unstale":"2023-10-08T16:05:58.306978+0000","last_undegraded":"2023-10-08T16:05:58.306978+0000","last_fullsized":"2023-10-08T16:05:58.306978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:09.114879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307214+0000","last_change":"2023-10-08T16:05:58.306948+0000","last_active":"2023-10-08T16:05:58.307214+0000","last_peered":"2023-10-08T16:05:58.307214+0000","last_clean":"2023-10-08T16:05:58.307214+0000","last_became_active":"2023-10-08T16:05:58.306159+0000","last_became_peered":"2023-10-08T16:05:58.306159+0000","last_unstale":"2023-10-08T16:05:58.307214+0000","last_undegraded":"2023-10-08T16:05:58.307214+0000","last_fullsized":"2023-10-08T16:05:58.307214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:21.544798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306300+0000","last_change":"2023-10-08T16:05:58.306231+0000","last_active":"2023-10-08T16:05:58.306300+0000","last_peered":"2023-10-08T16:05:58.306300+0000","last_clean":"2023-10-08T16:05:58.306300+0000","last_became_active":"2023-10-08T16:05:58.306006+0000","last_became_peered":"2023-10-08T16:05:58.306006+0000","last_unstale":"2023-10-08T16:05:58.306300+0000","last_undegraded":"2023-10-08T16:05:58.306300+0000","last_fullsized":"2023-10-08T16:05:58.306300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:44.157676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300431+0000","last_change":"2023-10-08T16:05:58.300431+0000","last_active":"2023-10-08T16:05:58.300431+0000","last_peered":"2023-10-08T16:05:58.300431+0000","last_clean":"2023-10-08T16:05:58.300431+0000","last_became_active":"2023-10-08T16:05:58.300212+0000","last_became_peered":"2023-10-08T16:05:58.300212+0000","last_unstale":"2023-10-08T16:05:58.300431+0000","last_undegraded":"2023-10-08T16:05:58.300431+0000","last_fullsized":"2023-10-08T16:05:58.300431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:27.910282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512514+0000","last_change":"2023-10-08T16:05:57.513427+0000","last_active":"2023-10-08T16:05:58.512514+0000","last_peered":"2023-10-08T16:05:58.512514+0000","last_clean":"2023-10-08T16:05:58.512514+0000","last_became_active":"2023-10-08T16:05:57.513214+0000","last_became_peered":"2023-10-08T16:05:57.513214+0000","last_unstale":"2023-10-08T16:05:58.512514+0000","last_undegraded":"2023-10-08T16:05:58.512514+0000","last_fullsized":"2023-10-08T16:05:58.512514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:21.273570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.308812+0000","last_change":"2023-10-08T16:05:58.308734+0000","last_active":"2023-10-08T16:05:58.308812+0000","last_peered":"2023-10-08T16:05:58.308812+0000","last_clean":"2023-10-08T16:05:58.308812+0000","last_became_active":"2023-10-08T16:05:58.308501+0000","last_became_peered":"2023-10-08T16:05:58.308501+0000","last_unstale":"2023-10-08T16:05:58.308812+0000","last_undegraded":"2023-10-08T16:05:58.308812+0000","last_fullsized":"2023-10-08T16:05:58.308812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:17.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297424+0000","last_change":"2023-10-08T16:05:57.513196+0000","last_active":"2023-10-08T16:05:58.297424+0000","last_peered":"2023-10-08T16:05:58.297424+0000","last_clean":"2023-10-08T16:05:58.297424+0000","last_became_active":"2023-10-08T16:05:57.512973+0000","last_became_peered":"2023-10-08T16:05:57.512973+0000","last_unstale":"2023-10-08T16:05:58.297424+0000","last_undegraded":"2023-10-08T16:05:58.297424+0000","last_fullsized":"2023-10-08T16:05:58.297424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:41.927383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304120+0000","last_change":"2023-10-08T16:05:58.303936+0000","last_active":"2023-10-08T16:05:58.304120+0000","last_peered":"2023-10-08T16:05:58.304120+0000","last_clean":"2023-10-08T16:05:58.304120+0000","last_became_active":"2023-10-08T16:05:58.303681+0000","last_became_peered":"2023-10-08T16:05:58.303681+0000","last_unstale":"2023-10-08T16:05:58.304120+0000","last_undegraded":"2023-10-08T16:05:58.304120+0000","last_fullsized":"2023-10-08T16:05:58.304120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.514298+0000","last_change":"2023-10-08T16:05:57.515417+0000","last_active":"2023-10-08T16:05:58.514298+0000","last_peered":"2023-10-08T16:05:58.514298+0000","last_clean":"2023-10-08T16:05:58.514298+0000","last_became_active":"2023-10-08T16:05:57.515212+0000","last_became_peered":"2023-10-08T16:05:57.515212+0000","last_unstale":"2023-10-08T16:05:58.514298+0000","last_undegraded":"2023-10-08T16:05:58.514298+0000","last_fullsized":"2023-10-08T16:05:58.514298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:20.765202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302888+0000","last_change":"2023-10-08T16:05:58.302659+0000","last_active":"2023-10-08T16:05:58.302888+0000","last_peered":"2023-10-08T16:05:58.302888+0000","last_clean":"2023-10-08T16:05:58.302888+0000","last_became_active":"2023-10-08T16:05:58.301963+0000","last_became_peered":"2023-10-08T16:05:58.301963+0000","last_unstale":"2023-10-08T16:05:58.302888+0000","last_undegraded":"2023-10-08T16:05:58.302888+0000","last_fullsized":"2023-10-08T16:05:58.302888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.508410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.511167+0000","last_change":"2023-10-08T16:05:57.507154+0000","last_active":"2023-10-08T16:05:58.511167+0000","last_peered":"2023-10-08T16:05:58.511167+0000","last_clean":"2023-10-08T16:05:58.511167+0000","last_became_active":"2023-10-08T16:05:57.506879+0000","last_became_peered":"2023-10-08T16:05:57.506879+0000","last_unstale":"2023-10-08T16:05:58.511167+0000","last_undegraded":"2023-10-08T16:05:58.511167+0000","last_fullsized":"2023-10-08T16:05:58.511167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:05.248157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303663+0000","last_change":"2023-10-08T16:05:58.303571+0000","last_active":"2023-10-08T16:05:58.303663+0000","last_peered":"2023-10-08T16:05:58.303663+0000","last_clean":"2023-10-08T16:05:58.303663+0000","last_became_active":"2023-10-08T16:05:58.303193+0000","last_became_peered":"2023-10-08T16:05:58.303193+0000","last_unstale":"2023-10-08T16:05:58.303663+0000","last_undegraded":"2023-10-08T16:05:58.303663+0000","last_fullsized":"2023-10-08T16:05:58.303663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:37.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512823+0000","last_change":"2023-10-08T16:05:57.516773+0000","last_active":"2023-10-08T16:05:58.512823+0000","last_peered":"2023-10-08T16:05:58.512823+0000","last_clean":"2023-10-08T16:05:58.512823+0000","last_became_active":"2023-10-08T16:05:57.516270+0000","last_became_peered":"2023-10-08T16:05:57.516270+0000","last_unstale":"2023-10-08T16:05:58.512823+0000","last_undegraded":"2023-10-08T16:05:58.512823+0000","last_fullsized":"2023-10-08T16:05:58.512823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:50.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304101+0000","last_change":"2023-10-08T16:05:58.303538+0000","last_active":"2023-10-08T16:05:58.304101+0000","last_peered":"2023-10-08T16:05:58.304101+0000","last_clean":"2023-10-08T16:05:58.304101+0000","last_became_active":"2023-10-08T16:05:58.301672+0000","last_became_peered":"2023-10-08T16:05:58.301672+0000","last_unstale":"2023-10-08T16:05:58.304101+0000","last_undegraded":"2023-10-08T16:05:58.304101+0000","last_fullsized":"2023-10-08T16:05:58.304101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512805+0000","last_change":"2023-10-08T16:05:57.510698+0000","last_active":"2023-10-08T16:05:58.512805+0000","last_peered":"2023-10-08T16:05:58.512805+0000","last_clean":"2023-10-08T16:05:58.512805+0000","last_became_active":"2023-10-08T16:05:57.510407+0000","last_became_peered":"2023-10-08T16:05:57.510407+0000","last_unstale":"2023-10-08T16:05:58.512805+0000","last_undegraded":"2023-10-08T16:05:58.512805+0000","last_fullsized":"2023-10-08T16:05:58.512805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:36.873523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307942+0000","last_change":"2023-10-08T16:05:58.307588+0000","last_active":"2023-10-08T16:05:58.307942+0000","last_peered":"2023-10-08T16:05:58.307942+0000","last_clean":"2023-10-08T16:05:58.307942+0000","last_became_active":"2023-10-08T16:05:58.307354+0000","last_became_peered":"2023-10-08T16:05:58.307354+0000","last_unstale":"2023-10-08T16:05:58.307942+0000","last_undegraded":"2023-10-08T16:05:58.307942+0000","last_fullsized":"2023-10-08T16:05:58.307942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:49.137795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.299514+0000","last_change":"2023-10-08T16:05:57.508472+0000","last_active":"2023-10-08T16:05:58.299514+0000","last_peered":"2023-10-08T16:05:58.299514+0000","last_clean":"2023-10-08T16:05:58.299514+0000","last_became_active":"2023-10-08T16:05:57.508237+0000","last_became_peered":"2023-10-08T16:05:57.508237+0000","last_unstale":"2023-10-08T16:05:58.299514+0000","last_undegraded":"2023-10-08T16:05:58.299514+0000","last_fullsized":"2023-10-08T16:05:58.299514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:16.708184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297659+0000","last_change":"2023-10-08T16:05:58.297602+0000","last_active":"2023-10-08T16:05:58.297659+0000","last_peered":"2023-10-08T16:05:58.297659+0000","last_clean":"2023-10-08T16:05:58.297659+0000","last_became_active":"2023-10-08T16:05:58.297365+0000","last_became_peered":"2023-10-08T16:05:58.297365+0000","last_unstale":"2023-10-08T16:05:58.297659+0000","last_undegraded":"2023-10-08T16:05:58.297659+0000","last_fullsized":"2023-10-08T16:05:58.297659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297556+0000","last_change":"2023-10-08T16:05:57.515558+0000","last_active":"2023-10-08T16:05:58.297556+0000","last_peered":"2023-10-08T16:05:58.297556+0000","last_clean":"2023-10-08T16:05:58.297556+0000","last_became_active":"2023-10-08T16:05:57.514842+0000","last_became_peered":"2023-10-08T16:05:57.514842+0000","last_unstale":"2023-10-08T16:05:58.297556+0000","last_undegraded":"2023-10-08T16:05:58.297556+0000","last_fullsized":"2023-10-08T16:05:58.297556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.330221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304118+0000","last_change":"2023-10-08T16:05:58.303684+0000","last_active":"2023-10-08T16:05:58.304118+0000","last_peered":"2023-10-08T16:05:58.304118+0000","last_clean":"2023-10-08T16:05:58.304118+0000","last_became_active":"2023-10-08T16:05:58.302001+0000","last_became_peered":"2023-10-08T16:05:58.302001+0000","last_unstale":"2023-10-08T16:05:58.304118+0000","last_undegraded":"2023-10-08T16:05:58.304118+0000","last_fullsized":"2023-10-08T16:05:58.304118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:22.211164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300961+0000","last_change":"2023-10-08T16:05:57.513550+0000","last_active":"2023-10-08T16:05:58.300961+0000","last_peered":"2023-10-08T16:05:58.300961+0000","last_clean":"2023-10-08T16:05:58.300961+0000","last_became_active":"2023-10-08T16:05:57.513368+0000","last_became_peered":"2023-10-08T16:05:57.513368+0000","last_unstale":"2023-10-08T16:05:58.300961+0000","last_undegraded":"2023-10-08T16:05:58.300961+0000","last_fullsized":"2023-10-08T16:05:58.300961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:11.876677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304801+0000","last_change":"2023-10-08T16:05:58.304728+0000","last_active":"2023-10-08T16:05:58.304801+0000","last_peered":"2023-10-08T16:05:58.304801+0000","last_clean":"2023-10-08T16:05:58.304801+0000","last_became_active":"2023-10-08T16:05:58.303674+0000","last_became_peered":"2023-10-08T16:05:58.303674+0000","last_unstale":"2023-10-08T16:05:58.304801+0000","last_undegraded":"2023-10-08T16:05:58.304801+0000","last_fullsized":"2023-10-08T16:05:58.304801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:05:57.511149+0000","last_change":"2023-10-08T16:05:57.511047+0000","last_active":"2023-10-08T16:05:57.511149+0000","last_peered":"2023-10-08T16:05:57.511149+0000","last_clean":"2023-10-08T16:05:57.511149+0000","last_became_active":"2023-10-08T16:05:57.510178+0000","last_became_peered":"2023-10-08T16:05:57.510178+0000","last_unstale":"2023-10-08T16:05:57.511149+0000","last_undegraded":"2023-10-08T16:05:57.511149+0000","last_fullsized":"2023-10-08T16:05:57.511149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:59.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305842+0000","last_change":"2023-10-08T16:05:58.305760+0000","last_active":"2023-10-08T16:05:58.305842+0000","last_peered":"2023-10-08T16:05:58.305842+0000","last_clean":"2023-10-08T16:05:58.305842+0000","last_became_active":"2023-10-08T16:05:58.305451+0000","last_became_peered":"2023-10-08T16:05:58.305451+0000","last_unstale":"2023-10-08T16:05:58.305842+0000","last_undegraded":"2023-10-08T16:05:58.305842+0000","last_fullsized":"2023-10-08T16:05:58.305842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:21.706615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.511562+0000","last_change":"2023-10-08T16:05:57.513393+0000","last_active":"2023-10-08T16:05:58.511562+0000","last_peered":"2023-10-08T16:05:58.511562+0000","last_clean":"2023-10-08T16:05:58.511562+0000","last_became_active":"2023-10-08T16:05:57.513171+0000","last_became_peered":"2023-10-08T16:05:57.513171+0000","last_unstale":"2023-10-08T16:05:58.511562+0000","last_undegraded":"2023-10-08T16:05:58.511562+0000","last_fullsized":"2023-10-08T16:05:58.511562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:11.876677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296807+0000","last_change":"2023-10-08T16:05:58.296725+0000","last_active":"2023-10-08T16:05:58.296807+0000","last_peered":"2023-10-08T16:05:58.296807+0000","last_clean":"2023-10-08T16:05:58.296807+0000","last_became_active":"2023-10-08T16:05:58.296047+0000","last_became_peered":"2023-10-08T16:05:58.296047+0000","last_unstale":"2023-10-08T16:05:58.296807+0000","last_undegraded":"2023-10-08T16:05:58.296807+0000","last_fullsized":"2023-10-08T16:05:58.296807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:44.157676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.515653+0000","last_change":"2023-10-08T16:05:57.515814+0000","last_active":"2023-10-08T16:05:58.515653+0000","last_peered":"2023-10-08T16:05:58.515653+0000","last_clean":"2023-10-08T16:05:58.515653+0000","last_became_active":"2023-10-08T16:05:57.515353+0000","last_became_peered":"2023-10-08T16:05:57.515353+0000","last_unstale":"2023-10-08T16:05:58.515653+0000","last_undegraded":"2023-10-08T16:05:58.515653+0000","last_fullsized":"2023-10-08T16:05:58.515653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:36.640315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298997+0000","last_change":"2023-10-08T16:05:58.298742+0000","last_active":"2023-10-08T16:05:58.298997+0000","last_peered":"2023-10-08T16:05:58.298997+0000","last_clean":"2023-10-08T16:05:58.298997+0000","last_became_active":"2023-10-08T16:05:58.297417+0000","last_became_peered":"2023-10-08T16:05:58.297417+0000","last_unstale":"2023-10-08T16:05:58.298997+0000","last_undegraded":"2023-10-08T16:05:58.298997+0000","last_fullsized":"2023-10-08T16:05:58.298997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:17.645955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512435+0000","last_change":"2023-10-08T16:05:57.515697+0000","last_active":"2023-10-08T16:05:58.512435+0000","last_peered":"2023-10-08T16:05:58.512435+0000","last_clean":"2023-10-08T16:05:58.512435+0000","last_became_active":"2023-10-08T16:05:57.515049+0000","last_became_peered":"2023-10-08T16:05:57.515049+0000","last_unstale":"2023-10-08T16:05:58.512435+0000","last_undegraded":"2023-10-08T16:05:58.512435+0000","last_fullsized":"2023-10-08T16:05:58.512435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:09.082166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301054+0000","last_change":"2023-10-08T16:05:58.300995+0000","last_active":"2023-10-08T16:05:58.301054+0000","last_peered":"2023-10-08T16:05:58.301054+0000","last_clean":"2023-10-08T16:05:58.301054+0000","last_became_active":"2023-10-08T16:05:58.300725+0000","last_became_peered":"2023-10-08T16:05:58.300725+0000","last_unstale":"2023-10-08T16:05:58.301054+0000","last_undegraded":"2023-10-08T16:05:58.301054+0000","last_fullsized":"2023-10-08T16:05:58.301054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:22.211164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.292780+0000","last_change":"2023-10-08T16:05:57.516926+0000","last_active":"2023-10-08T16:05:58.292780+0000","last_peered":"2023-10-08T16:05:58.292780+0000","last_clean":"2023-10-08T16:05:58.292780+0000","last_became_active":"2023-10-08T16:05:57.516652+0000","last_became_peered":"2023-10-08T16:05:57.516652+0000","last_unstale":"2023-10-08T16:05:58.292780+0000","last_undegraded":"2023-10-08T16:05:58.292780+0000","last_fullsized":"2023-10-08T16:05:58.292780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:59.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303647+0000","last_change":"2023-10-08T16:05:58.303438+0000","last_active":"2023-10-08T16:05:58.303647+0000","last_peered":"2023-10-08T16:05:58.303647+0000","last_clean":"2023-10-08T16:05:58.303647+0000","last_became_active":"2023-10-08T16:05:58.302889+0000","last_became_peered":"2023-10-08T16:05:58.302889+0000","last_unstale":"2023-10-08T16:05:58.303647+0000","last_undegraded":"2023-10-08T16:05:58.303647+0000","last_fullsized":"2023-10-08T16:05:58.303647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:17.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.295810+0000","last_change":"2023-10-08T16:05:57.514688+0000","last_active":"2023-10-08T16:05:58.295810+0000","last_peered":"2023-10-08T16:05:58.295810+0000","last_clean":"2023-10-08T16:05:58.295810+0000","last_became_active":"2023-10-08T16:05:57.514400+0000","last_became_peered":"2023-10-08T16:05:57.514400+0000","last_unstale":"2023-10-08T16:05:58.295810+0000","last_undegraded":"2023-10-08T16:05:58.295810+0000","last_fullsized":"2023-10-08T16:05:58.295810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:41.927383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.309705+0000","last_change":"2023-10-08T16:05:58.309639+0000","last_active":"2023-10-08T16:05:58.309705+0000","last_peered":"2023-10-08T16:05:58.309705+0000","last_clean":"2023-10-08T16:05:58.309705+0000","last_became_active":"2023-10-08T16:05:58.309026+0000","last_became_peered":"2023-10-08T16:05:58.309026+0000","last_unstale":"2023-10-08T16:05:58.309705+0000","last_undegraded":"2023-10-08T16:05:58.309705+0000","last_fullsized":"2023-10-08T16:05:58.309705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:37.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.514569+0000","last_change":"2023-10-08T16:05:57.515397+0000","last_active":"2023-10-08T16:05:58.514569+0000","last_peered":"2023-10-08T16:05:58.514569+0000","last_clean":"2023-10-08T16:05:58.514569+0000","last_became_active":"2023-10-08T16:05:57.515170+0000","last_became_peered":"2023-10-08T16:05:57.515170+0000","last_unstale":"2023-10-08T16:05:58.514569+0000","last_undegraded":"2023-10-08T16:05:58.514569+0000","last_fullsized":"2023-10-08T16:05:58.514569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:46.849374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298411+0000","last_change":"2023-10-08T16:05:58.298338+0000","last_active":"2023-10-08T16:05:58.298411+0000","last_peered":"2023-10-08T16:05:58.298411+0000","last_clean":"2023-10-08T16:05:58.298411+0000","last_became_active":"2023-10-08T16:05:58.298086+0000","last_became_peered":"2023-10-08T16:05:58.298086+0000","last_unstale":"2023-10-08T16:05:58.298411+0000","last_undegraded":"2023-10-08T16:05:58.298411+0000","last_fullsized":"2023-10-08T16:05:58.298411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:27.910282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.514405+0000","last_change":"2023-10-08T16:05:57.515939+0000","last_active":"2023-10-08T16:05:58.514405+0000","last_peered":"2023-10-08T16:05:58.514405+0000","last_clean":"2023-10-08T16:05:58.514405+0000","last_became_active":"2023-10-08T16:05:57.515294+0000","last_became_peered":"2023-10-08T16:05:57.515294+0000","last_unstale":"2023-10-08T16:05:58.514405+0000","last_undegraded":"2023-10-08T16:05:58.514405+0000","last_fullsized":"2023-10-08T16:05:58.514405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:41.927383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298667+0000","last_change":"2023-10-08T16:05:58.298499+0000","last_active":"2023-10-08T16:05:58.298667+0000","last_peered":"2023-10-08T16:05:58.298667+0000","last_clean":"2023-10-08T16:05:58.298667+0000","last_became_active":"2023-10-08T16:05:58.297910+0000","last_became_peered":"2023-10-08T16:05:58.297910+0000","last_unstale":"2023-10-08T16:05:58.298667+0000","last_undegraded":"2023-10-08T16:05:58.298667+0000","last_fullsized":"2023-10-08T16:05:58.298667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:37.195652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512276+0000","last_change":"2023-10-08T16:05:57.515842+0000","last_active":"2023-10-08T16:05:58.512276+0000","last_peered":"2023-10-08T16:05:58.512276+0000","last_clean":"2023-10-08T16:05:58.512276+0000","last_became_active":"2023-10-08T16:05:57.515328+0000","last_became_peered":"2023-10-08T16:05:57.515328+0000","last_unstale":"2023-10-08T16:05:58.512276+0000","last_undegraded":"2023-10-08T16:05:58.512276+0000","last_fullsized":"2023-10-08T16:05:58.512276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:14.336145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300553+0000","last_change":"2023-10-08T16:05:58.300478+0000","last_active":"2023-10-08T16:05:58.300553+0000","last_peered":"2023-10-08T16:05:58.300553+0000","last_clean":"2023-10-08T16:05:58.300553+0000","last_became_active":"2023-10-08T16:05:58.300087+0000","last_became_peered":"2023-10-08T16:05:58.300087+0000","last_unstale":"2023-10-08T16:05:58.300553+0000","last_undegraded":"2023-10-08T16:05:58.300553+0000","last_fullsized":"2023-10-08T16:05:58.300553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:49.137795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512106+0000","last_change":"2023-10-08T16:05:57.511069+0000","last_active":"2023-10-08T16:05:58.512106+0000","last_peered":"2023-10-08T16:05:58.512106+0000","last_clean":"2023-10-08T16:05:58.512106+0000","last_became_active":"2023-10-08T16:05:57.510635+0000","last_became_peered":"2023-10-08T16:05:57.510635+0000","last_unstale":"2023-10-08T16:05:58.512106+0000","last_undegraded":"2023-10-08T16:05:58.512106+0000","last_fullsized":"2023-10-08T16:05:58.512106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:29.222973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301809+0000","last_change":"2023-10-08T16:05:58.301809+0000","last_active":"2023-10-08T16:05:58.301809+0000","last_peered":"2023-10-08T16:05:58.301809+0000","last_clean":"2023-10-08T16:05:58.301809+0000","last_became_active":"2023-10-08T16:05:58.301365+0000","last_became_peered":"2023-10-08T16:05:58.301365+0000","last_unstale":"2023-10-08T16:05:58.301809+0000","last_undegraded":"2023-10-08T16:05:58.301809+0000","last_fullsized":"2023-10-08T16:05:58.301809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:13.937101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296198+0000","last_change":"2023-10-08T16:05:57.516928+0000","last_active":"2023-10-08T16:05:58.296198+0000","last_peered":"2023-10-08T16:05:58.296198+0000","last_clean":"2023-10-08T16:05:58.296198+0000","last_became_active":"2023-10-08T16:05:57.516557+0000","last_became_peered":"2023-10-08T16:05:57.516557+0000","last_unstale":"2023-10-08T16:05:58.296198+0000","last_undegraded":"2023-10-08T16:05:58.296198+0000","last_fullsized":"2023-10-08T16:05:58.296198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:21.273570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298361+0000","last_change":"2023-10-08T16:05:58.298361+0000","last_active":"2023-10-08T16:05:58.298361+0000","last_peered":"2023-10-08T16:05:58.298361+0000","last_clean":"2023-10-08T16:05:58.298361+0000","last_became_active":"2023-10-08T16:05:58.298144+0000","last_became_peered":"2023-10-08T16:05:58.298144+0000","last_unstale":"2023-10-08T16:05:58.298361+0000","last_undegraded":"2023-10-08T16:05:58.298361+0000","last_fullsized":"2023-10-08T16:05:58.298361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:30.228400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512176+0000","last_change":"2023-10-08T16:05:57.513397+0000","last_active":"2023-10-08T16:05:58.512176+0000","last_peered":"2023-10-08T16:05:58.512176+0000","last_clean":"2023-10-08T16:05:58.512176+0000","last_became_active":"2023-10-08T16:05:57.512731+0000","last_became_peered":"2023-10-08T16:05:57.512731+0000","last_unstale":"2023-10-08T16:05:58.512176+0000","last_undegraded":"2023-10-08T16:05:58.512176+0000","last_fullsized":"2023-10-08T16:05:58.512176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:05.883181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303001+0000","last_change":"2023-10-08T16:05:58.303001+0000","last_active":"2023-10-08T16:05:58.303001+0000","last_peered":"2023-10-08T16:05:58.303001+0000","last_clean":"2023-10-08T16:05:58.303001+0000","last_became_active":"2023-10-08T16:05:58.302256+0000","last_became_peered":"2023-10-08T16:05:58.302256+0000","last_unstale":"2023-10-08T16:05:58.303001+0000","last_undegraded":"2023-10-08T16:05:58.303001+0000","last_fullsized":"2023-10-08T16:05:58.303001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:37.878950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300265+0000","last_change":"2023-10-08T16:05:57.516816+0000","last_active":"2023-10-08T16:05:58.300265+0000","last_peered":"2023-10-08T16:05:58.300265+0000","last_clean":"2023-10-08T16:05:58.300265+0000","last_became_active":"2023-10-08T16:05:57.516581+0000","last_became_peered":"2023-10-08T16:05:57.516581+0000","last_unstale":"2023-10-08T16:05:58.300265+0000","last_undegraded":"2023-10-08T16:05:58.300265+0000","last_fullsized":"2023-10-08T16:05:58.300265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.330221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301654+0000","last_change":"2023-10-08T16:05:58.301654+0000","last_active":"2023-10-08T16:05:58.301654+0000","last_peered":"2023-10-08T16:05:58.301654+0000","last_clean":"2023-10-08T16:05:58.301654+0000","last_became_active":"2023-10-08T16:05:58.300631+0000","last_became_peered":"2023-10-08T16:05:58.300631+0000","last_unstale":"2023-10-08T16:05:58.301654+0000","last_undegraded":"2023-10-08T16:05:58.301654+0000","last_fullsized":"2023-10-08T16:05:58.301654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:22.278997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297845+0000","last_change":"2023-10-08T16:05:57.514580+0000","last_active":"2023-10-08T16:05:58.297845+0000","last_peered":"2023-10-08T16:05:58.297845+0000","last_clean":"2023-10-08T16:05:58.297845+0000","last_became_active":"2023-10-08T16:05:57.514163+0000","last_became_peered":"2023-10-08T16:05:57.514163+0000","last_unstale":"2023-10-08T16:05:58.297845+0000","last_undegraded":"2023-10-08T16:05:58.297845+0000","last_fullsized":"2023-10-08T16:05:58.297845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:25.054951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307113+0000","last_change":"2023-10-08T16:05:58.307050+0000","last_active":"2023-10-08T16:05:58.307113+0000","last_peered":"2023-10-08T16:05:58.307113+0000","last_clean":"2023-10-08T16:05:58.307113+0000","last_became_active":"2023-10-08T16:05:58.306705+0000","last_became_peered":"2023-10-08T16:05:58.306705+0000","last_unstale":"2023-10-08T16:05:58.307113+0000","last_undegraded":"2023-10-08T16:05:58.307113+0000","last_fullsized":"2023-10-08T16:05:58.307113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:16.890239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.295739+0000","last_change":"2023-10-08T16:05:57.513465+0000","last_active":"2023-10-08T16:05:58.295739+0000","last_peered":"2023-10-08T16:05:58.295739+0000","last_clean":"2023-10-08T16:05:58.295739+0000","last_became_active":"2023-10-08T16:05:57.513225+0000","last_became_peered":"2023-10-08T16:05:57.513225+0000","last_unstale":"2023-10-08T16:05:58.295739+0000","last_undegraded":"2023-10-08T16:05:58.295739+0000","last_fullsized":"2023-10-08T16:05:58.295739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:05.883181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302871+0000","last_change":"2023-10-08T16:05:58.302871+0000","last_active":"2023-10-08T16:05:58.302871+0000","last_peered":"2023-10-08T16:05:58.302871+0000","last_clean":"2023-10-08T16:05:58.302871+0000","last_became_active":"2023-10-08T16:05:58.301963+0000","last_became_peered":"2023-10-08T16:05:58.301963+0000","last_unstale":"2023-10-08T16:05:58.302871+0000","last_undegraded":"2023-10-08T16:05:58.302871+0000","last_fullsized":"2023-10-08T16:05:58.302871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:51.380605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512553+0000","last_change":"2023-10-08T16:05:57.511868+0000","last_active":"2023-10-08T16:05:58.512553+0000","last_peered":"2023-10-08T16:05:58.512553+0000","last_clean":"2023-10-08T16:05:58.512553+0000","last_became_active":"2023-10-08T16:05:57.511522+0000","last_became_peered":"2023-10-08T16:05:57.511522+0000","last_unstale":"2023-10-08T16:05:58.512553+0000","last_undegraded":"2023-10-08T16:05:58.512553+0000","last_fullsized":"2023-10-08T16:05:58.512553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:12.931674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304148+0000","last_change":"2023-10-08T16:05:58.304032+0000","last_active":"2023-10-08T16:05:58.304148+0000","last_peered":"2023-10-08T16:05:58.304148+0000","last_clean":"2023-10-08T16:05:58.304148+0000","last_became_active":"2023-10-08T16:05:58.303254+0000","last_became_peered":"2023-10-08T16:05:58.303254+0000","last_unstale":"2023-10-08T16:05:58.304148+0000","last_undegraded":"2023-10-08T16:05:58.304148+0000","last_fullsized":"2023-10-08T16:05:58.304148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:17.645955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:05:57.513363+0000","last_change":"2023-10-08T16:05:57.513235+0000","last_active":"2023-10-08T16:05:57.513363+0000","last_peered":"2023-10-08T16:05:57.513363+0000","last_clean":"2023-10-08T16:05:57.513363+0000","last_became_active":"2023-10-08T16:05:57.512369+0000","last_became_peered":"2023-10-08T16:05:57.512369+0000","last_unstale":"2023-10-08T16:05:57.513363+0000","last_undegraded":"2023-10-08T16:05:57.513363+0000","last_fullsized":"2023-10-08T16:05:57.513363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:11.876677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306923+0000","last_change":"2023-10-08T16:05:58.306923+0000","last_active":"2023-10-08T16:05:58.306923+0000","last_peered":"2023-10-08T16:05:58.306923+0000","last_clean":"2023-10-08T16:05:58.306923+0000","last_became_active":"2023-10-08T16:05:58.306708+0000","last_became_peered":"2023-10-08T16:05:58.306708+0000","last_unstale":"2023-10-08T16:05:58.306923+0000","last_undegraded":"2023-10-08T16:05:58.306923+0000","last_fullsized":"2023-10-08T16:05:58.306923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:23.367591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.293496+0000","last_change":"2023-10-08T16:05:57.507380+0000","last_active":"2023-10-08T16:05:58.293496+0000","last_peered":"2023-10-08T16:05:58.293496+0000","last_clean":"2023-10-08T16:05:58.293496+0000","last_became_active":"2023-10-08T16:05:57.507152+0000","last_became_peered":"2023-10-08T16:05:57.507152+0000","last_unstale":"2023-10-08T16:05:58.293496+0000","last_undegraded":"2023-10-08T16:05:58.293496+0000","last_fullsized":"2023-10-08T16:05:58.293496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:21.273570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305924+0000","last_change":"2023-10-08T16:05:58.305438+0000","last_active":"2023-10-08T16:05:58.305924+0000","last_peered":"2023-10-08T16:05:58.305924+0000","last_clean":"2023-10-08T16:05:58.305924+0000","last_became_active":"2023-10-08T16:05:58.304352+0000","last_became_peered":"2023-10-08T16:05:58.304352+0000","last_unstale":"2023-10-08T16:05:58.305924+0000","last_undegraded":"2023-10-08T16:05:58.305924+0000","last_fullsized":"2023-10-08T16:05:58.305924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:47.854801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:05:57.511791+0000","last_change":"2023-10-08T16:05:57.511720+0000","last_active":"2023-10-08T16:05:57.511791+0000","last_peered":"2023-10-08T16:05:57.511791+0000","last_clean":"2023-10-08T16:05:57.511791+0000","last_became_active":"2023-10-08T16:05:57.511565+0000","last_became_peered":"2023-10-08T16:05:57.511565+0000","last_unstale":"2023-10-08T16:05:57.511791+0000","last_undegraded":"2023-10-08T16:05:57.511791+0000","last_fullsized":"2023-10-08T16:05:57.511791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:12.931674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304721+0000","last_change":"2023-10-08T16:05:58.304721+0000","last_active":"2023-10-08T16:05:58.304721+0000","last_peered":"2023-10-08T16:05:58.304721+0000","last_clean":"2023-10-08T16:05:58.304721+0000","last_became_active":"2023-10-08T16:05:58.304475+0000","last_became_peered":"2023-10-08T16:05:58.304475+0000","last_unstale":"2023-10-08T16:05:58.304721+0000","last_undegraded":"2023-10-08T16:05:58.304721+0000","last_fullsized":"2023-10-08T16:05:58.304721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:37.195652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.293220+0000","last_change":"2023-10-08T16:05:57.511693+0000","last_active":"2023-10-08T16:05:58.293220+0000","last_peered":"2023-10-08T16:05:58.293220+0000","last_clean":"2023-10-08T16:05:58.293220+0000","last_became_active":"2023-10-08T16:05:57.511289+0000","last_became_peered":"2023-10-08T16:05:57.511289+0000","last_unstale":"2023-10-08T16:05:58.293220+0000","last_undegraded":"2023-10-08T16:05:58.293220+0000","last_fullsized":"2023-10-08T16:05:58.293220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:50.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307662+0000","last_change":"2023-10-08T16:05:58.307523+0000","last_active":"2023-10-08T16:05:58.307662+0000","last_peered":"2023-10-08T16:05:58.307662+0000","last_clean":"2023-10-08T16:05:58.307662+0000","last_became_active":"2023-10-08T16:05:58.306931+0000","last_became_peered":"2023-10-08T16:05:58.306931+0000","last_unstale":"2023-10-08T16:05:58.307662+0000","last_undegraded":"2023-10-08T16:05:58.307662+0000","last_fullsized":"2023-10-08T16:05:58.307662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:57:02.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.294280+0000","last_change":"2023-10-08T16:05:57.514378+0000","last_active":"2023-10-08T16:05:58.294280+0000","last_peered":"2023-10-08T16:05:58.294280+0000","last_clean":"2023-10-08T16:05:58.294280+0000","last_became_active":"2023-10-08T16:05:57.514086+0000","last_became_peered":"2023-10-08T16:05:57.514086+0000","last_unstale":"2023-10-08T16:05:58.294280+0000","last_undegraded":"2023-10-08T16:05:58.294280+0000","last_fullsized":"2023-10-08T16:05:58.294280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:23.802509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296999+0000","last_change":"2023-10-08T16:05:58.296553+0000","last_active":"2023-10-08T16:05:58.296999+0000","last_peered":"2023-10-08T16:05:58.296999+0000","last_clean":"2023-10-08T16:05:58.296999+0000","last_became_active":"2023-10-08T16:05:58.296314+0000","last_became_peered":"2023-10-08T16:05:58.296314+0000","last_unstale":"2023-10-08T16:05:58.296999+0000","last_undegraded":"2023-10-08T16:05:58.296999+0000","last_fullsized":"2023-10-08T16:05:58.296999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:34:36.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.299951+0000","last_change":"2023-10-08T16:05:57.513932+0000","last_active":"2023-10-08T16:05:58.299951+0000","last_peered":"2023-10-08T16:05:58.299951+0000","last_clean":"2023-10-08T16:05:58.299951+0000","last_became_active":"2023-10-08T16:05:57.513727+0000","last_became_peered":"2023-10-08T16:05:57.513727+0000","last_unstale":"2023-10-08T16:05:58.299951+0000","last_undegraded":"2023-10-08T16:05:58.299951+0000","last_fullsized":"2023-10-08T16:05:58.299951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:20.539371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303628+0000","last_change":"2023-10-08T16:05:58.302844+0000","last_active":"2023-10-08T16:05:58.303628+0000","last_peered":"2023-10-08T16:05:58.303628+0000","last_clean":"2023-10-08T16:05:58.303628+0000","last_became_active":"2023-10-08T16:05:58.302606+0000","last_became_peered":"2023-10-08T16:05:58.302606+0000","last_unstale":"2023-10-08T16:05:58.303628+0000","last_undegraded":"2023-10-08T16:05:58.303628+0000","last_fullsized":"2023-10-08T16:05:58.303628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300370+0000","last_change":"2023-10-08T16:05:57.513664+0000","last_active":"2023-10-08T16:05:58.300370+0000","last_peered":"2023-10-08T16:05:58.300370+0000","last_clean":"2023-10-08T16:05:58.300370+0000","last_became_active":"2023-10-08T16:05:57.513512+0000","last_became_peered":"2023-10-08T16:05:57.513512+0000","last_unstale":"2023-10-08T16:05:58.300370+0000","last_undegraded":"2023-10-08T16:05:58.300370+0000","last_fullsized":"2023-10-08T16:05:58.300370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:09.082166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298778+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:05:58.298778+0000","last_peered":"2023-10-08T16:05:58.298778+0000","last_clean":"2023-10-08T16:05:58.298778+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:05:58.298778+0000","last_undegraded":"2023-10-08T16:05:58.298778+0000","last_fullsized":"2023-10-08T16:05:58.298778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46400000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.432}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.751},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.73799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.78600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.77400000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.379}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.311}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34599999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.4929999999999999,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.623},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277063,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.27500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199867361,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.308}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.252}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.307},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.59899999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.623}]},{"osd":3,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.501}]},{"osd":7,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.505}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.63200000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73699999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:06:02.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:02.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.766+0000 7f3086418700 1 Processor -- start 2023-10-08T16:06:02.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.766+0000 7f3086418700 1 -- start start 2023-10-08T16:06:02.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.766+0000 7f3086418700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3080159e10 0x7f30800b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.766+0000 7f3086418700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f308015a1e0 0x7f30800b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.766+0000 7f3086418700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30800b1610 0x7f30800cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.766+0000 7f3086418700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308015e800 con 0x7f3080159e10 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f3086418700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308015db80 con 0x7f308015a1e0 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f3086418700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308015de60 con 0x7f30800b1610 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3080159e10 0x7f30800b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3080159e10 0x7f30800b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52366/0 (socket says 172.21.15.60:52366) 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 -- 172.21.15.60:0/4203771162 learned_addr learned my addr 172.21.15.60:0/4203771162 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307f7fe700 1 --2- 172.21.15.60:0/4203771162 >> v2:172.21.15.144:3300/0 conn(0x7f308015a1e0 0x7f30800b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f30849b5700 1 --2- 172.21.15.60:0/4203771162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30800b1610 0x7f30800cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 -- 172.21.15.60:0/4203771162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30800b1610 msgr2=0x7f30800cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 --2- 172.21.15.60:0/4203771162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30800b1610 0x7f30800cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 -- 172.21.15.60:0/4203771162 >> v2:172.21.15.144:3300/0 conn(0x7f308015a1e0 msgr2=0x7f30800b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:02.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 --2- 172.21.15.60:0/4203771162 >> v2:172.21.15.144:3300/0 conn(0x7f308015a1e0 0x7f30800b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 -- 172.21.15.60:0/4203771162 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308015e140 con 0x7f3080159e10 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307ffff700 1 --2- 172.21.15.60:0/4203771162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f30800b2d20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3080068580 tx=0x7f3070009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3535792bc10e6c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307effd700 1 -- 172.21.15.60:0/4203771162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000b860 con 0x7f3080159e10 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307effd700 1 -- 172.21.15.60:0/4203771162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307000b9c0 con 0x7f3080159e10 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.767+0000 7f307effd700 1 -- 172.21.15.60:0/4203771162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000bd60 con 0x7f3080159e10 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 -- 172.21.15.60:0/4203771162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 msgr2=0x7f30800b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 --2- 172.21.15.60:0/4203771162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f30800b2d20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3080068580 tx=0x7f3070009250 comp rx=0 tx=0).stop 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 -- 172.21.15.60:0/4203771162 shutdown_connections 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 --2- 172.21.15.60:0/4203771162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30800b1610 0x7f30800cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 --2- 172.21.15.60:0/4203771162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f30800b2d20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 --2- 172.21.15.60:0/4203771162 >> v2:172.21.15.144:3300/0 conn(0x7f308015a1e0 0x7f30800b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 -- 172.21.15.60:0/4203771162 >> 172.21.15.60:0/4203771162 conn(0x7f3080067660 msgr2=0x7f3080067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:02.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 -- 172.21.15.60:0/4203771162 shutdown_connections 2023-10-08T16:06:02.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.768+0000 7f3086418700 1 -- 172.21.15.60:0/4203771162 wait complete. 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.769+0000 7f3086418700 1 Processor -- start 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.769+0000 7f3086418700 1 -- start start 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f3086418700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30800b1610 0x7f308016ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f3086418700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f308015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f3086418700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f308015a1e0 0x7f308015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f3086418700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c97b0 con 0x7f3080159e10 2023-10-08T16:06:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f3086418700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c8ea0 con 0x7f30800b1610 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f3086418700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c9160 con 0x7f308015a1e0 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f308015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f308015aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52380/0 (socket says 172.21.15.60:52380) 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 -- 172.21.15.60:0/541931777 learned_addr learned my addr 172.21.15.60:0/541931777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307ffff700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30800b1610 0x7f308016ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f30849b5700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f308015a1e0 0x7f308015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 -- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f308015a1e0 msgr2=0x7f308015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f308015a1e0 0x7f308015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 -- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30800b1610 msgr2=0x7f308016ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30800b1610 0x7f308016ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 -- 172.21.15.60:0/541931777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700094f0 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.770+0000 7f307f7fe700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f308015aa10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f306800c880 tx=0x7f3068008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.771+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011600 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.771+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3068011760 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.771+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011b00 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.771+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30800c9440 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.771+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308015b920 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.772+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30800c9920 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.772+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30680193b0 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.773+0000 7f3077fff700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3060066f30 0x7f30600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.773+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3068084360 con 0x7f3080159e10 2023-10-08T16:06:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.773+0000 7f307ffff700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3060066f30 0x7f30600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.773+0000 7f307ffff700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3060066f30 0x7f30600693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3080068580 tx=0x7f3070017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.777+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30680515d0 con 0x7f3080159e10 2023-10-08T16:06:02.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.968+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f308004c3c0 con 0x7f3060066f30 2023-10-08T16:06:02.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.976+0000 7f3077fff700 1 -- 172.21.15.60:0/541931777 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285097 (secure 0 0 0) 0x7f308004c3c0 con 0x7f3060066f30 2023-10-08T16:06:02.980 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.979+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3060066f30 msgr2=0x7f30600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.979+0000 7f3086418700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3060066f30 0x7f30600693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3080068580 tx=0x7f3070017000 comp rx=0 tx=0).stop 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.979+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 msgr2=0x7f308015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.979+0000 7f3086418700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f308015aa10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f306800c880 tx=0x7f3068008040 comp rx=0 tx=0).stop 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.979+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 shutdown_connections 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.979+0000 7f3086418700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3060066f30 0x7f30600693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.980+0000 7f3086418700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f308015a1e0 0x7f308015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.980+0000 7f3086418700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30800b1610 0x7f308016ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.980+0000 7f3086418700 1 --2- 172.21.15.60:0/541931777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3080159e10 0x7f308015aa10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:02.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.980+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 >> 172.21.15.60:0/541931777 conn(0x7f3080067660 msgr2=0x7f30800c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:02.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.980+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 shutdown_connections 2023-10-08T16:06:02.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:02.980+0000 7f3086418700 1 -- 172.21.15.60:0/541931777 wait complete. 2023-10-08T16:06:02.983 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:06:02.992 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-10-08T16:06:01.572899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560269,"statfs":{"total":1600000000,"available":1597716372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076986"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307232+0000","last_change":"2023-10-08T16:05:58.307104+0000","last_active":"2023-10-08T16:05:58.307232+0000","last_peered":"2023-10-08T16:05:58.307232+0000","last_clean":"2023-10-08T16:05:58.307232+0000","last_became_active":"2023-10-08T16:05:58.306500+0000","last_became_peered":"2023-10-08T16:05:58.306500+0000","last_unstale":"2023-10-08T16:05:58.307232+0000","last_undegraded":"2023-10-08T16:05:58.307232+0000","last_fullsized":"2023-10-08T16:05:58.307232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:21.770629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300807+0000","last_change":"2023-10-08T16:05:58.300737+0000","last_active":"2023-10-08T16:05:58.300807+0000","last_peered":"2023-10-08T16:05:58.300807+0000","last_clean":"2023-10-08T16:05:58.300807+0000","last_became_active":"2023-10-08T16:05:58.300374+0000","last_became_peered":"2023-10-08T16:05:58.300374+0000","last_unstale":"2023-10-08T16:05:58.300807+0000","last_undegraded":"2023-10-08T16:05:58.300807+0000","last_fullsized":"2023-10-08T16:05:58.300807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:34.735994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302965+0000","last_change":"2023-10-08T16:05:58.302893+0000","last_active":"2023-10-08T16:05:58.302965+0000","last_peered":"2023-10-08T16:05:58.302965+0000","last_clean":"2023-10-08T16:05:58.302965+0000","last_became_active":"2023-10-08T16:05:58.302281+0000","last_became_peered":"2023-10-08T16:05:58.302281+0000","last_unstale":"2023-10-08T16:05:58.302965+0000","last_undegraded":"2023-10-08T16:05:58.302965+0000","last_fullsized":"2023-10-08T16:05:58.302965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:32.544629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306334+0000","last_change":"2023-10-08T16:05:58.306206+0000","last_active":"2023-10-08T16:05:58.306334+0000","last_peered":"2023-10-08T16:05:58.306334+0000","last_clean":"2023-10-08T16:05:58.306334+0000","last_became_active":"2023-10-08T16:05:58.302809+0000","last_became_peered":"2023-10-08T16:05:58.302809+0000","last_unstale":"2023-10-08T16:05:58.306334+0000","last_undegraded":"2023-10-08T16:05:58.306334+0000","last_fullsized":"2023-10-08T16:05:58.306334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:27.910282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301781+0000","last_change":"2023-10-08T16:05:58.301781+0000","last_active":"2023-10-08T16:05:58.301781+0000","last_peered":"2023-10-08T16:05:58.301781+0000","last_clean":"2023-10-08T16:05:58.301781+0000","last_became_active":"2023-10-08T16:05:58.301512+0000","last_became_peered":"2023-10-08T16:05:58.301512+0000","last_unstale":"2023-10-08T16:05:58.301781+0000","last_undegraded":"2023-10-08T16:05:58.301781+0000","last_fullsized":"2023-10-08T16:05:58.301781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:18.335648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304936+0000","last_change":"2023-10-08T16:05:58.304867+0000","last_active":"2023-10-08T16:05:58.304936+0000","last_peered":"2023-10-08T16:05:58.304936+0000","last_clean":"2023-10-08T16:05:58.304936+0000","last_became_active":"2023-10-08T16:05:58.303982+0000","last_became_peered":"2023-10-08T16:05:58.303982+0000","last_unstale":"2023-10-08T16:05:58.304936+0000","last_undegraded":"2023-10-08T16:05:58.304936+0000","last_fullsized":"2023-10-08T16:05:58.304936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:59.519155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.308806+0000","last_change":"2023-10-08T16:05:58.308730+0000","last_active":"2023-10-08T16:05:58.308806+0000","last_peered":"2023-10-08T16:05:58.308806+0000","last_clean":"2023-10-08T16:05:58.308806+0000","last_became_active":"2023-10-08T16:05:58.308088+0000","last_became_peered":"2023-10-08T16:05:58.308088+0000","last_unstale":"2023-10-08T16:05:58.308806+0000","last_undegraded":"2023-10-08T16:05:58.308806+0000","last_fullsized":"2023-10-08T16:05:58.308806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:34.735994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307914+0000","last_change":"2023-10-08T16:05:58.307849+0000","last_active":"2023-10-08T16:05:58.307914+0000","last_peered":"2023-10-08T16:05:58.307914+0000","last_clean":"2023-10-08T16:05:58.307914+0000","last_became_active":"2023-10-08T16:05:58.307623+0000","last_became_peered":"2023-10-08T16:05:58.307623+0000","last_unstale":"2023-10-08T16:05:58.307914+0000","last_undegraded":"2023-10-08T16:05:58.307914+0000","last_fullsized":"2023-10-08T16:05:58.307914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301512+0000","last_change":"2023-10-08T16:05:58.298641+0000","last_active":"2023-10-08T16:05:58.301512+0000","last_peered":"2023-10-08T16:05:58.301512+0000","last_clean":"2023-10-08T16:05:58.301512+0000","last_became_active":"2023-10-08T16:05:58.298408+0000","last_became_peered":"2023-10-08T16:05:58.298408+0000","last_unstale":"2023-10-08T16:05:58.301512+0000","last_undegraded":"2023-10-08T16:05:58.301512+0000","last_fullsized":"2023-10-08T16:05:58.301512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:37.195652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302253+0000","last_change":"2023-10-08T16:05:58.302187+0000","last_active":"2023-10-08T16:05:58.302253+0000","last_peered":"2023-10-08T16:05:58.302253+0000","last_clean":"2023-10-08T16:05:58.302253+0000","last_became_active":"2023-10-08T16:05:58.301662+0000","last_became_peered":"2023-10-08T16:05:58.301662+0000","last_unstale":"2023-10-08T16:05:58.302253+0000","last_undegraded":"2023-10-08T16:05:58.302253+0000","last_fullsized":"2023-10-08T16:05:58.302253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300435+0000","last_change":"2023-10-08T16:05:58.300295+0000","last_active":"2023-10-08T16:05:58.300435+0000","last_peered":"2023-10-08T16:05:58.300435+0000","last_clean":"2023-10-08T16:05:58.300435+0000","last_became_active":"2023-10-08T16:05:58.300031+0000","last_became_peered":"2023-10-08T16:05:58.300031+0000","last_unstale":"2023-10-08T16:05:58.300435+0000","last_undegraded":"2023-10-08T16:05:58.300435+0000","last_fullsized":"2023-10-08T16:05:58.300435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:22.211164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304133+0000","last_change":"2023-10-08T16:05:58.303847+0000","last_active":"2023-10-08T16:05:58.304133+0000","last_peered":"2023-10-08T16:05:58.304133+0000","last_clean":"2023-10-08T16:05:58.304133+0000","last_became_active":"2023-10-08T16:05:58.302341+0000","last_became_peered":"2023-10-08T16:05:58.302341+0000","last_unstale":"2023-10-08T16:05:58.304133+0000","last_undegraded":"2023-10-08T16:05:58.304133+0000","last_fullsized":"2023-10-08T16:05:58.304133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:34.735994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296455+0000","last_change":"2023-10-08T16:05:58.296455+0000","last_active":"2023-10-08T16:05:58.296455+0000","last_peered":"2023-10-08T16:05:58.296455+0000","last_clean":"2023-10-08T16:05:58.296455+0000","last_became_active":"2023-10-08T16:05:58.296218+0000","last_became_peered":"2023-10-08T16:05:58.296218+0000","last_unstale":"2023-10-08T16:05:58.296455+0000","last_undegraded":"2023-10-08T16:05:58.296455+0000","last_fullsized":"2023-10-08T16:05:58.296455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:10.087593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303495+0000","last_change":"2023-10-08T16:05:58.303359+0000","last_active":"2023-10-08T16:05:58.303495+0000","last_peered":"2023-10-08T16:05:58.303495+0000","last_clean":"2023-10-08T16:05:58.303495+0000","last_became_active":"2023-10-08T16:05:58.303115+0000","last_became_peered":"2023-10-08T16:05:58.303115+0000","last_unstale":"2023-10-08T16:05:58.303495+0000","last_undegraded":"2023-10-08T16:05:58.303495+0000","last_fullsized":"2023-10-08T16:05:58.303495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:09.114879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304941+0000","last_change":"2023-10-08T16:05:58.304874+0000","last_active":"2023-10-08T16:05:58.304941+0000","last_peered":"2023-10-08T16:05:58.304941+0000","last_clean":"2023-10-08T16:05:58.304941+0000","last_became_active":"2023-10-08T16:05:58.304629+0000","last_became_peered":"2023-10-08T16:05:58.304629+0000","last_unstale":"2023-10-08T16:05:58.304941+0000","last_undegraded":"2023-10-08T16:05:58.304941+0000","last_fullsized":"2023-10-08T16:05:58.304941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:16.890239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302333+0000","last_change":"2023-10-08T16:05:58.302192+0000","last_active":"2023-10-08T16:05:58.302333+0000","last_peered":"2023-10-08T16:05:58.302333+0000","last_clean":"2023-10-08T16:05:58.302333+0000","last_became_active":"2023-10-08T16:05:58.301948+0000","last_became_peered":"2023-10-08T16:05:58.301948+0000","last_unstale":"2023-10-08T16:05:58.302333+0000","last_undegraded":"2023-10-08T16:05:58.302333+0000","last_fullsized":"2023-10-08T16:05:58.302333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:32.544629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.308949+0000","last_change":"2023-10-08T16:05:58.308882+0000","last_active":"2023-10-08T16:05:58.308949+0000","last_peered":"2023-10-08T16:05:58.308949+0000","last_clean":"2023-10-08T16:05:58.308949+0000","last_became_active":"2023-10-08T16:05:58.308441+0000","last_became_peered":"2023-10-08T16:05:58.308441+0000","last_unstale":"2023-10-08T16:05:58.308949+0000","last_undegraded":"2023-10-08T16:05:58.308949+0000","last_fullsized":"2023-10-08T16:05:58.308949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:21.078947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304221+0000","last_change":"2023-10-08T16:05:58.304162+0000","last_active":"2023-10-08T16:05:58.304221+0000","last_peered":"2023-10-08T16:05:58.304221+0000","last_clean":"2023-10-08T16:05:58.304221+0000","last_became_active":"2023-10-08T16:05:58.303942+0000","last_became_peered":"2023-10-08T16:05:58.303942+0000","last_unstale":"2023-10-08T16:05:58.304221+0000","last_undegraded":"2023-10-08T16:05:58.304221+0000","last_fullsized":"2023-10-08T16:05:58.304221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:32.544629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307872+0000","last_change":"2023-10-08T16:05:58.307803+0000","last_active":"2023-10-08T16:05:58.307872+0000","last_peered":"2023-10-08T16:05:58.307872+0000","last_clean":"2023-10-08T16:05:58.307872+0000","last_became_active":"2023-10-08T16:05:58.307255+0000","last_became_peered":"2023-10-08T16:05:58.307255+0000","last_unstale":"2023-10-08T16:05:58.307872+0000","last_undegraded":"2023-10-08T16:05:58.307872+0000","last_fullsized":"2023-10-08T16:05:58.307872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:28:36.935723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296520+0000","last_change":"2023-10-08T16:05:58.296520+0000","last_active":"2023-10-08T16:05:58.296520+0000","last_peered":"2023-10-08T16:05:58.296520+0000","last_clean":"2023-10-08T16:05:58.296520+0000","last_became_active":"2023-10-08T16:05:58.296286+0000","last_became_peered":"2023-10-08T16:05:58.296286+0000","last_unstale":"2023-10-08T16:05:58.296520+0000","last_undegraded":"2023-10-08T16:05:58.296520+0000","last_fullsized":"2023-10-08T16:05:58.296520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:00.853800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302196+0000","last_change":"2023-10-08T16:05:58.301666+0000","last_active":"2023-10-08T16:05:58.302196+0000","last_peered":"2023-10-08T16:05:58.302196+0000","last_clean":"2023-10-08T16:05:58.302196+0000","last_became_active":"2023-10-08T16:05:58.301404+0000","last_became_peered":"2023-10-08T16:05:58.301404+0000","last_unstale":"2023-10-08T16:05:58.302196+0000","last_undegraded":"2023-10-08T16:05:58.302196+0000","last_fullsized":"2023-10-08T16:05:58.302196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:23.367591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305549+0000","last_change":"2023-10-08T16:05:58.305481+0000","last_active":"2023-10-08T16:05:58.305549+0000","last_peered":"2023-10-08T16:05:58.305549+0000","last_clean":"2023-10-08T16:05:58.305549+0000","last_became_active":"2023-10-08T16:05:58.305245+0000","last_became_peered":"2023-10-08T16:05:58.305245+0000","last_unstale":"2023-10-08T16:05:58.305549+0000","last_undegraded":"2023-10-08T16:05:58.305549+0000","last_fullsized":"2023-10-08T16:05:58.305549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.508410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304307+0000","last_change":"2023-10-08T16:05:58.304307+0000","last_active":"2023-10-08T16:05:58.304307+0000","last_peered":"2023-10-08T16:05:58.304307+0000","last_clean":"2023-10-08T16:05:58.304307+0000","last_became_active":"2023-10-08T16:05:58.304082+0000","last_became_peered":"2023-10-08T16:05:58.304082+0000","last_unstale":"2023-10-08T16:05:58.304307+0000","last_undegraded":"2023-10-08T16:05:58.304307+0000","last_fullsized":"2023-10-08T16:05:58.304307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298308+0000","last_change":"2023-10-08T16:05:58.298158+0000","last_active":"2023-10-08T16:05:58.298308+0000","last_peered":"2023-10-08T16:05:58.298308+0000","last_clean":"2023-10-08T16:05:58.298308+0000","last_became_active":"2023-10-08T16:05:58.297597+0000","last_became_peered":"2023-10-08T16:05:58.297597+0000","last_unstale":"2023-10-08T16:05:58.298308+0000","last_undegraded":"2023-10-08T16:05:58.298308+0000","last_fullsized":"2023-10-08T16:05:58.298308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:21.078947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302904+0000","last_change":"2023-10-08T16:05:58.302803+0000","last_active":"2023-10-08T16:05:58.302904+0000","last_peered":"2023-10-08T16:05:58.302904+0000","last_clean":"2023-10-08T16:05:58.302904+0000","last_became_active":"2023-10-08T16:05:58.302411+0000","last_became_peered":"2023-10-08T16:05:58.302411+0000","last_unstale":"2023-10-08T16:05:58.302904+0000","last_undegraded":"2023-10-08T16:05:58.302904+0000","last_fullsized":"2023-10-08T16:05:58.302904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:44.157676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305087+0000","last_change":"2023-10-08T16:05:58.305020+0000","last_active":"2023-10-08T16:05:58.305087+0000","last_peered":"2023-10-08T16:05:58.305087+0000","last_clean":"2023-10-08T16:05:58.305087+0000","last_became_active":"2023-10-08T16:05:58.304269+0000","last_became_peered":"2023-10-08T16:05:58.304269+0000","last_unstale":"2023-10-08T16:05:58.305087+0000","last_undegraded":"2023-10-08T16:05:58.305087+0000","last_fullsized":"2023-10-08T16:05:58.305087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:43.050975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300537+0000","last_change":"2023-10-08T16:05:58.300300+0000","last_active":"2023-10-08T16:05:58.300537+0000","last_peered":"2023-10-08T16:05:58.300537+0000","last_clean":"2023-10-08T16:05:58.300537+0000","last_became_active":"2023-10-08T16:05:58.299763+0000","last_became_peered":"2023-10-08T16:05:58.299763+0000","last_unstale":"2023-10-08T16:05:58.300537+0000","last_undegraded":"2023-10-08T16:05:58.300537+0000","last_fullsized":"2023-10-08T16:05:58.300537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:34:36.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302836+0000","last_change":"2023-10-08T16:05:58.302702+0000","last_active":"2023-10-08T16:05:58.302836+0000","last_peered":"2023-10-08T16:05:58.302836+0000","last_clean":"2023-10-08T16:05:58.302836+0000","last_became_active":"2023-10-08T16:05:58.301959+0000","last_became_peered":"2023-10-08T16:05:58.301959+0000","last_unstale":"2023-10-08T16:05:58.302836+0000","last_undegraded":"2023-10-08T16:05:58.302836+0000","last_fullsized":"2023-10-08T16:05:58.302836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:09.114879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304100+0000","last_change":"2023-10-08T16:05:58.303683+0000","last_active":"2023-10-08T16:05:58.304100+0000","last_peered":"2023-10-08T16:05:58.304100+0000","last_clean":"2023-10-08T16:05:58.304100+0000","last_became_active":"2023-10-08T16:05:58.303312+0000","last_became_peered":"2023-10-08T16:05:58.303312+0000","last_unstale":"2023-10-08T16:05:58.304100+0000","last_undegraded":"2023-10-08T16:05:58.304100+0000","last_fullsized":"2023-10-08T16:05:58.304100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:17.645955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306978+0000","last_change":"2023-10-08T16:05:58.306912+0000","last_active":"2023-10-08T16:05:58.306978+0000","last_peered":"2023-10-08T16:05:58.306978+0000","last_clean":"2023-10-08T16:05:58.306978+0000","last_became_active":"2023-10-08T16:05:58.306399+0000","last_became_peered":"2023-10-08T16:05:58.306399+0000","last_unstale":"2023-10-08T16:05:58.306978+0000","last_undegraded":"2023-10-08T16:05:58.306978+0000","last_fullsized":"2023-10-08T16:05:58.306978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:09.114879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307214+0000","last_change":"2023-10-08T16:05:58.306948+0000","last_active":"2023-10-08T16:05:58.307214+0000","last_peered":"2023-10-08T16:05:58.307214+0000","last_clean":"2023-10-08T16:05:58.307214+0000","last_became_active":"2023-10-08T16:05:58.306159+0000","last_became_peered":"2023-10-08T16:05:58.306159+0000","last_unstale":"2023-10-08T16:05:58.307214+0000","last_undegraded":"2023-10-08T16:05:58.307214+0000","last_fullsized":"2023-10-08T16:05:58.307214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:21.544798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306300+0000","last_change":"2023-10-08T16:05:58.306231+0000","last_active":"2023-10-08T16:05:58.306300+0000","last_peered":"2023-10-08T16:05:58.306300+0000","last_clean":"2023-10-08T16:05:58.306300+0000","last_became_active":"2023-10-08T16:05:58.306006+0000","last_became_peered":"2023-10-08T16:05:58.306006+0000","last_unstale":"2023-10-08T16:05:58.306300+0000","last_undegraded":"2023-10-08T16:05:58.306300+0000","last_fullsized":"2023-10-08T16:05:58.306300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:44.157676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300431+0000","last_change":"2023-10-08T16:05:58.300431+0000","last_active":"2023-10-08T16:05:58.300431+0000","last_peered":"2023-10-08T16:05:58.300431+0000","last_clean":"2023-10-08T16:05:58.300431+0000","last_became_active":"2023-10-08T16:05:58.300212+0000","last_became_peered":"2023-10-08T16:05:58.300212+0000","last_unstale":"2023-10-08T16:05:58.300431+0000","last_undegraded":"2023-10-08T16:05:58.300431+0000","last_fullsized":"2023-10-08T16:05:58.300431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:27.910282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512514+0000","last_change":"2023-10-08T16:05:57.513427+0000","last_active":"2023-10-08T16:05:58.512514+0000","last_peered":"2023-10-08T16:05:58.512514+0000","last_clean":"2023-10-08T16:05:58.512514+0000","last_became_active":"2023-10-08T16:05:57.513214+0000","last_became_peered":"2023-10-08T16:05:57.513214+0000","last_unstale":"2023-10-08T16:05:58.512514+0000","last_undegraded":"2023-10-08T16:05:58.512514+0000","last_fullsized":"2023-10-08T16:05:58.512514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:21.273570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.308812+0000","last_change":"2023-10-08T16:05:58.308734+0000","last_active":"2023-10-08T16:05:58.308812+0000","last_peered":"2023-10-08T16:05:58.308812+0000","last_clean":"2023-10-08T16:05:58.308812+0000","last_became_active":"2023-10-08T16:05:58.308501+0000","last_became_peered":"2023-10-08T16:05:58.308501+0000","last_unstale":"2023-10-08T16:05:58.308812+0000","last_undegraded":"2023-10-08T16:05:58.308812+0000","last_fullsized":"2023-10-08T16:05:58.308812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:17.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297424+0000","last_change":"2023-10-08T16:05:57.513196+0000","last_active":"2023-10-08T16:05:58.297424+0000","last_peered":"2023-10-08T16:05:58.297424+0000","last_clean":"2023-10-08T16:05:58.297424+0000","last_became_active":"2023-10-08T16:05:57.512973+0000","last_became_peered":"2023-10-08T16:05:57.512973+0000","last_unstale":"2023-10-08T16:05:58.297424+0000","last_undegraded":"2023-10-08T16:05:58.297424+0000","last_fullsized":"2023-10-08T16:05:58.297424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:41.927383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304120+0000","last_change":"2023-10-08T16:05:58.303936+0000","last_active":"2023-10-08T16:05:58.304120+0000","last_peered":"2023-10-08T16:05:58.304120+0000","last_clean":"2023-10-08T16:05:58.304120+0000","last_became_active":"2023-10-08T16:05:58.303681+0000","last_became_peered":"2023-10-08T16:05:58.303681+0000","last_unstale":"2023-10-08T16:05:58.304120+0000","last_undegraded":"2023-10-08T16:05:58.304120+0000","last_fullsized":"2023-10-08T16:05:58.304120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.514298+0000","last_change":"2023-10-08T16:05:57.515417+0000","last_active":"2023-10-08T16:05:58.514298+0000","last_peered":"2023-10-08T16:05:58.514298+0000","last_clean":"2023-10-08T16:05:58.514298+0000","last_became_active":"2023-10-08T16:05:57.515212+0000","last_became_peered":"2023-10-08T16:05:57.515212+0000","last_unstale":"2023-10-08T16:05:58.514298+0000","last_undegraded":"2023-10-08T16:05:58.514298+0000","last_fullsized":"2023-10-08T16:05:58.514298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:20.765202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302888+0000","last_change":"2023-10-08T16:05:58.302659+0000","last_active":"2023-10-08T16:05:58.302888+0000","last_peered":"2023-10-08T16:05:58.302888+0000","last_clean":"2023-10-08T16:05:58.302888+0000","last_became_active":"2023-10-08T16:05:58.301963+0000","last_became_peered":"2023-10-08T16:05:58.301963+0000","last_unstale":"2023-10-08T16:05:58.302888+0000","last_undegraded":"2023-10-08T16:05:58.302888+0000","last_fullsized":"2023-10-08T16:05:58.302888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.508410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.511167+0000","last_change":"2023-10-08T16:05:57.507154+0000","last_active":"2023-10-08T16:05:58.511167+0000","last_peered":"2023-10-08T16:05:58.511167+0000","last_clean":"2023-10-08T16:05:58.511167+0000","last_became_active":"2023-10-08T16:05:57.506879+0000","last_became_peered":"2023-10-08T16:05:57.506879+0000","last_unstale":"2023-10-08T16:05:58.511167+0000","last_undegraded":"2023-10-08T16:05:58.511167+0000","last_fullsized":"2023-10-08T16:05:58.511167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:05.248157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303663+0000","last_change":"2023-10-08T16:05:58.303571+0000","last_active":"2023-10-08T16:05:58.303663+0000","last_peered":"2023-10-08T16:05:58.303663+0000","last_clean":"2023-10-08T16:05:58.303663+0000","last_became_active":"2023-10-08T16:05:58.303193+0000","last_became_peered":"2023-10-08T16:05:58.303193+0000","last_unstale":"2023-10-08T16:05:58.303663+0000","last_undegraded":"2023-10-08T16:05:58.303663+0000","last_fullsized":"2023-10-08T16:05:58.303663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:37.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512823+0000","last_change":"2023-10-08T16:05:57.516773+0000","last_active":"2023-10-08T16:05:58.512823+0000","last_peered":"2023-10-08T16:05:58.512823+0000","last_clean":"2023-10-08T16:05:58.512823+0000","last_became_active":"2023-10-08T16:05:57.516270+0000","last_became_peered":"2023-10-08T16:05:57.516270+0000","last_unstale":"2023-10-08T16:05:58.512823+0000","last_undegraded":"2023-10-08T16:05:58.512823+0000","last_fullsized":"2023-10-08T16:05:58.512823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:50.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304101+0000","last_change":"2023-10-08T16:05:58.303538+0000","last_active":"2023-10-08T16:05:58.304101+0000","last_peered":"2023-10-08T16:05:58.304101+0000","last_clean":"2023-10-08T16:05:58.304101+0000","last_became_active":"2023-10-08T16:05:58.301672+0000","last_became_peered":"2023-10-08T16:05:58.301672+0000","last_unstale":"2023-10-08T16:05:58.304101+0000","last_undegraded":"2023-10-08T16:05:58.304101+0000","last_fullsized":"2023-10-08T16:05:58.304101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512805+0000","last_change":"2023-10-08T16:05:57.510698+0000","last_active":"2023-10-08T16:05:58.512805+0000","last_peered":"2023-10-08T16:05:58.512805+0000","last_clean":"2023-10-08T16:05:58.512805+0000","last_became_active":"2023-10-08T16:05:57.510407+0000","last_became_peered":"2023-10-08T16:05:57.510407+0000","last_unstale":"2023-10-08T16:05:58.512805+0000","last_undegraded":"2023-10-08T16:05:58.512805+0000","last_fullsized":"2023-10-08T16:05:58.512805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:36.873523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307942+0000","last_change":"2023-10-08T16:05:58.307588+0000","last_active":"2023-10-08T16:05:58.307942+0000","last_peered":"2023-10-08T16:05:58.307942+0000","last_clean":"2023-10-08T16:05:58.307942+0000","last_became_active":"2023-10-08T16:05:58.307354+0000","last_became_peered":"2023-10-08T16:05:58.307354+0000","last_unstale":"2023-10-08T16:05:58.307942+0000","last_undegraded":"2023-10-08T16:05:58.307942+0000","last_fullsized":"2023-10-08T16:05:58.307942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:49.137795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.299514+0000","last_change":"2023-10-08T16:05:57.508472+0000","last_active":"2023-10-08T16:05:58.299514+0000","last_peered":"2023-10-08T16:05:58.299514+0000","last_clean":"2023-10-08T16:05:58.299514+0000","last_became_active":"2023-10-08T16:05:57.508237+0000","last_became_peered":"2023-10-08T16:05:57.508237+0000","last_unstale":"2023-10-08T16:05:58.299514+0000","last_undegraded":"2023-10-08T16:05:58.299514+0000","last_fullsized":"2023-10-08T16:05:58.299514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:16.708184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297659+0000","last_change":"2023-10-08T16:05:58.297602+0000","last_active":"2023-10-08T16:05:58.297659+0000","last_peered":"2023-10-08T16:05:58.297659+0000","last_clean":"2023-10-08T16:05:58.297659+0000","last_became_active":"2023-10-08T16:05:58.297365+0000","last_became_peered":"2023-10-08T16:05:58.297365+0000","last_unstale":"2023-10-08T16:05:58.297659+0000","last_undegraded":"2023-10-08T16:05:58.297659+0000","last_fullsized":"2023-10-08T16:05:58.297659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:09.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297556+0000","last_change":"2023-10-08T16:05:57.515558+0000","last_active":"2023-10-08T16:05:58.297556+0000","last_peered":"2023-10-08T16:05:58.297556+0000","last_clean":"2023-10-08T16:05:58.297556+0000","last_became_active":"2023-10-08T16:05:57.514842+0000","last_became_peered":"2023-10-08T16:05:57.514842+0000","last_unstale":"2023-10-08T16:05:58.297556+0000","last_undegraded":"2023-10-08T16:05:58.297556+0000","last_fullsized":"2023-10-08T16:05:58.297556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.330221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304118+0000","last_change":"2023-10-08T16:05:58.303684+0000","last_active":"2023-10-08T16:05:58.304118+0000","last_peered":"2023-10-08T16:05:58.304118+0000","last_clean":"2023-10-08T16:05:58.304118+0000","last_became_active":"2023-10-08T16:05:58.302001+0000","last_became_peered":"2023-10-08T16:05:58.302001+0000","last_unstale":"2023-10-08T16:05:58.304118+0000","last_undegraded":"2023-10-08T16:05:58.304118+0000","last_fullsized":"2023-10-08T16:05:58.304118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:22.211164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300961+0000","last_change":"2023-10-08T16:05:57.513550+0000","last_active":"2023-10-08T16:05:58.300961+0000","last_peered":"2023-10-08T16:05:58.300961+0000","last_clean":"2023-10-08T16:05:58.300961+0000","last_became_active":"2023-10-08T16:05:57.513368+0000","last_became_peered":"2023-10-08T16:05:57.513368+0000","last_unstale":"2023-10-08T16:05:58.300961+0000","last_undegraded":"2023-10-08T16:05:58.300961+0000","last_fullsized":"2023-10-08T16:05:58.300961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:11.876677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304801+0000","last_change":"2023-10-08T16:05:58.304728+0000","last_active":"2023-10-08T16:05:58.304801+0000","last_peered":"2023-10-08T16:05:58.304801+0000","last_clean":"2023-10-08T16:05:58.304801+0000","last_became_active":"2023-10-08T16:05:58.303674+0000","last_became_peered":"2023-10-08T16:05:58.303674+0000","last_unstale":"2023-10-08T16:05:58.304801+0000","last_undegraded":"2023-10-08T16:05:58.304801+0000","last_fullsized":"2023-10-08T16:05:58.304801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:05:57.511149+0000","last_change":"2023-10-08T16:05:57.511047+0000","last_active":"2023-10-08T16:05:57.511149+0000","last_peered":"2023-10-08T16:05:57.511149+0000","last_clean":"2023-10-08T16:05:57.511149+0000","last_became_active":"2023-10-08T16:05:57.510178+0000","last_became_peered":"2023-10-08T16:05:57.510178+0000","last_unstale":"2023-10-08T16:05:57.511149+0000","last_undegraded":"2023-10-08T16:05:57.511149+0000","last_fullsized":"2023-10-08T16:05:57.511149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:59.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305842+0000","last_change":"2023-10-08T16:05:58.305760+0000","last_active":"2023-10-08T16:05:58.305842+0000","last_peered":"2023-10-08T16:05:58.305842+0000","last_clean":"2023-10-08T16:05:58.305842+0000","last_became_active":"2023-10-08T16:05:58.305451+0000","last_became_peered":"2023-10-08T16:05:58.305451+0000","last_unstale":"2023-10-08T16:05:58.305842+0000","last_undegraded":"2023-10-08T16:05:58.305842+0000","last_fullsized":"2023-10-08T16:05:58.305842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:21.706615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.511562+0000","last_change":"2023-10-08T16:05:57.513393+0000","last_active":"2023-10-08T16:05:58.511562+0000","last_peered":"2023-10-08T16:05:58.511562+0000","last_clean":"2023-10-08T16:05:58.511562+0000","last_became_active":"2023-10-08T16:05:57.513171+0000","last_became_peered":"2023-10-08T16:05:57.513171+0000","last_unstale":"2023-10-08T16:05:58.511562+0000","last_undegraded":"2023-10-08T16:05:58.511562+0000","last_fullsized":"2023-10-08T16:05:58.511562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:11.876677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296807+0000","last_change":"2023-10-08T16:05:58.296725+0000","last_active":"2023-10-08T16:05:58.296807+0000","last_peered":"2023-10-08T16:05:58.296807+0000","last_clean":"2023-10-08T16:05:58.296807+0000","last_became_active":"2023-10-08T16:05:58.296047+0000","last_became_peered":"2023-10-08T16:05:58.296047+0000","last_unstale":"2023-10-08T16:05:58.296807+0000","last_undegraded":"2023-10-08T16:05:58.296807+0000","last_fullsized":"2023-10-08T16:05:58.296807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:44.157676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.515653+0000","last_change":"2023-10-08T16:05:57.515814+0000","last_active":"2023-10-08T16:05:58.515653+0000","last_peered":"2023-10-08T16:05:58.515653+0000","last_clean":"2023-10-08T16:05:58.515653+0000","last_became_active":"2023-10-08T16:05:57.515353+0000","last_became_peered":"2023-10-08T16:05:57.515353+0000","last_unstale":"2023-10-08T16:05:58.515653+0000","last_undegraded":"2023-10-08T16:05:58.515653+0000","last_fullsized":"2023-10-08T16:05:58.515653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:36.640315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298997+0000","last_change":"2023-10-08T16:05:58.298742+0000","last_active":"2023-10-08T16:05:58.298997+0000","last_peered":"2023-10-08T16:05:58.298997+0000","last_clean":"2023-10-08T16:05:58.298997+0000","last_became_active":"2023-10-08T16:05:58.297417+0000","last_became_peered":"2023-10-08T16:05:58.297417+0000","last_unstale":"2023-10-08T16:05:58.298997+0000","last_undegraded":"2023-10-08T16:05:58.298997+0000","last_fullsized":"2023-10-08T16:05:58.298997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:17.645955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512435+0000","last_change":"2023-10-08T16:05:57.515697+0000","last_active":"2023-10-08T16:05:58.512435+0000","last_peered":"2023-10-08T16:05:58.512435+0000","last_clean":"2023-10-08T16:05:58.512435+0000","last_became_active":"2023-10-08T16:05:57.515049+0000","last_became_peered":"2023-10-08T16:05:57.515049+0000","last_unstale":"2023-10-08T16:05:58.512435+0000","last_undegraded":"2023-10-08T16:05:58.512435+0000","last_fullsized":"2023-10-08T16:05:58.512435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:09.082166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301054+0000","last_change":"2023-10-08T16:05:58.300995+0000","last_active":"2023-10-08T16:05:58.301054+0000","last_peered":"2023-10-08T16:05:58.301054+0000","last_clean":"2023-10-08T16:05:58.301054+0000","last_became_active":"2023-10-08T16:05:58.300725+0000","last_became_peered":"2023-10-08T16:05:58.300725+0000","last_unstale":"2023-10-08T16:05:58.301054+0000","last_undegraded":"2023-10-08T16:05:58.301054+0000","last_fullsized":"2023-10-08T16:05:58.301054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:22.211164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.292780+0000","last_change":"2023-10-08T16:05:57.516926+0000","last_active":"2023-10-08T16:05:58.292780+0000","last_peered":"2023-10-08T16:05:58.292780+0000","last_clean":"2023-10-08T16:05:58.292780+0000","last_became_active":"2023-10-08T16:05:57.516652+0000","last_became_peered":"2023-10-08T16:05:57.516652+0000","last_unstale":"2023-10-08T16:05:58.292780+0000","last_undegraded":"2023-10-08T16:05:58.292780+0000","last_fullsized":"2023-10-08T16:05:58.292780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:59.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303647+0000","last_change":"2023-10-08T16:05:58.303438+0000","last_active":"2023-10-08T16:05:58.303647+0000","last_peered":"2023-10-08T16:05:58.303647+0000","last_clean":"2023-10-08T16:05:58.303647+0000","last_became_active":"2023-10-08T16:05:58.302889+0000","last_became_peered":"2023-10-08T16:05:58.302889+0000","last_unstale":"2023-10-08T16:05:58.303647+0000","last_undegraded":"2023-10-08T16:05:58.303647+0000","last_fullsized":"2023-10-08T16:05:58.303647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:17.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.295810+0000","last_change":"2023-10-08T16:05:57.514688+0000","last_active":"2023-10-08T16:05:58.295810+0000","last_peered":"2023-10-08T16:05:58.295810+0000","last_clean":"2023-10-08T16:05:58.295810+0000","last_became_active":"2023-10-08T16:05:57.514400+0000","last_became_peered":"2023-10-08T16:05:57.514400+0000","last_unstale":"2023-10-08T16:05:58.295810+0000","last_undegraded":"2023-10-08T16:05:58.295810+0000","last_fullsized":"2023-10-08T16:05:58.295810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:41.927383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.309705+0000","last_change":"2023-10-08T16:05:58.309639+0000","last_active":"2023-10-08T16:05:58.309705+0000","last_peered":"2023-10-08T16:05:58.309705+0000","last_clean":"2023-10-08T16:05:58.309705+0000","last_became_active":"2023-10-08T16:05:58.309026+0000","last_became_peered":"2023-10-08T16:05:58.309026+0000","last_unstale":"2023-10-08T16:05:58.309705+0000","last_undegraded":"2023-10-08T16:05:58.309705+0000","last_fullsized":"2023-10-08T16:05:58.309705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:37.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.514569+0000","last_change":"2023-10-08T16:05:57.515397+0000","last_active":"2023-10-08T16:05:58.514569+0000","last_peered":"2023-10-08T16:05:58.514569+0000","last_clean":"2023-10-08T16:05:58.514569+0000","last_became_active":"2023-10-08T16:05:57.515170+0000","last_became_peered":"2023-10-08T16:05:57.515170+0000","last_unstale":"2023-10-08T16:05:58.514569+0000","last_undegraded":"2023-10-08T16:05:58.514569+0000","last_fullsized":"2023-10-08T16:05:58.514569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:46.849374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298411+0000","last_change":"2023-10-08T16:05:58.298338+0000","last_active":"2023-10-08T16:05:58.298411+0000","last_peered":"2023-10-08T16:05:58.298411+0000","last_clean":"2023-10-08T16:05:58.298411+0000","last_became_active":"2023-10-08T16:05:58.298086+0000","last_became_peered":"2023-10-08T16:05:58.298086+0000","last_unstale":"2023-10-08T16:05:58.298411+0000","last_undegraded":"2023-10-08T16:05:58.298411+0000","last_fullsized":"2023-10-08T16:05:58.298411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:27.910282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.514405+0000","last_change":"2023-10-08T16:05:57.515939+0000","last_active":"2023-10-08T16:05:58.514405+0000","last_peered":"2023-10-08T16:05:58.514405+0000","last_clean":"2023-10-08T16:05:58.514405+0000","last_became_active":"2023-10-08T16:05:57.515294+0000","last_became_peered":"2023-10-08T16:05:57.515294+0000","last_unstale":"2023-10-08T16:05:58.514405+0000","last_undegraded":"2023-10-08T16:05:58.514405+0000","last_fullsized":"2023-10-08T16:05:58.514405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:41.927383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298667+0000","last_change":"2023-10-08T16:05:58.298499+0000","last_active":"2023-10-08T16:05:58.298667+0000","last_peered":"2023-10-08T16:05:58.298667+0000","last_clean":"2023-10-08T16:05:58.298667+0000","last_became_active":"2023-10-08T16:05:58.297910+0000","last_became_peered":"2023-10-08T16:05:58.297910+0000","last_unstale":"2023-10-08T16:05:58.298667+0000","last_undegraded":"2023-10-08T16:05:58.298667+0000","last_fullsized":"2023-10-08T16:05:58.298667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:37.195652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512276+0000","last_change":"2023-10-08T16:05:57.515842+0000","last_active":"2023-10-08T16:05:58.512276+0000","last_peered":"2023-10-08T16:05:58.512276+0000","last_clean":"2023-10-08T16:05:58.512276+0000","last_became_active":"2023-10-08T16:05:57.515328+0000","last_became_peered":"2023-10-08T16:05:57.515328+0000","last_unstale":"2023-10-08T16:05:58.512276+0000","last_undegraded":"2023-10-08T16:05:58.512276+0000","last_fullsized":"2023-10-08T16:05:58.512276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:14.336145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300553+0000","last_change":"2023-10-08T16:05:58.300478+0000","last_active":"2023-10-08T16:05:58.300553+0000","last_peered":"2023-10-08T16:05:58.300553+0000","last_clean":"2023-10-08T16:05:58.300553+0000","last_became_active":"2023-10-08T16:05:58.300087+0000","last_became_peered":"2023-10-08T16:05:58.300087+0000","last_unstale":"2023-10-08T16:05:58.300553+0000","last_undegraded":"2023-10-08T16:05:58.300553+0000","last_fullsized":"2023-10-08T16:05:58.300553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:49.137795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512106+0000","last_change":"2023-10-08T16:05:57.511069+0000","last_active":"2023-10-08T16:05:58.512106+0000","last_peered":"2023-10-08T16:05:58.512106+0000","last_clean":"2023-10-08T16:05:58.512106+0000","last_became_active":"2023-10-08T16:05:57.510635+0000","last_became_peered":"2023-10-08T16:05:57.510635+0000","last_unstale":"2023-10-08T16:05:58.512106+0000","last_undegraded":"2023-10-08T16:05:58.512106+0000","last_fullsized":"2023-10-08T16:05:58.512106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:29.222973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301809+0000","last_change":"2023-10-08T16:05:58.301809+0000","last_active":"2023-10-08T16:05:58.301809+0000","last_peered":"2023-10-08T16:05:58.301809+0000","last_clean":"2023-10-08T16:05:58.301809+0000","last_became_active":"2023-10-08T16:05:58.301365+0000","last_became_peered":"2023-10-08T16:05:58.301365+0000","last_unstale":"2023-10-08T16:05:58.301809+0000","last_undegraded":"2023-10-08T16:05:58.301809+0000","last_fullsized":"2023-10-08T16:05:58.301809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:13.937101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296198+0000","last_change":"2023-10-08T16:05:57.516928+0000","last_active":"2023-10-08T16:05:58.296198+0000","last_peered":"2023-10-08T16:05:58.296198+0000","last_clean":"2023-10-08T16:05:58.296198+0000","last_became_active":"2023-10-08T16:05:57.516557+0000","last_became_peered":"2023-10-08T16:05:57.516557+0000","last_unstale":"2023-10-08T16:05:58.296198+0000","last_undegraded":"2023-10-08T16:05:58.296198+0000","last_fullsized":"2023-10-08T16:05:58.296198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:21.273570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298361+0000","last_change":"2023-10-08T16:05:58.298361+0000","last_active":"2023-10-08T16:05:58.298361+0000","last_peered":"2023-10-08T16:05:58.298361+0000","last_clean":"2023-10-08T16:05:58.298361+0000","last_became_active":"2023-10-08T16:05:58.298144+0000","last_became_peered":"2023-10-08T16:05:58.298144+0000","last_unstale":"2023-10-08T16:05:58.298361+0000","last_undegraded":"2023-10-08T16:05:58.298361+0000","last_fullsized":"2023-10-08T16:05:58.298361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:30.228400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512176+0000","last_change":"2023-10-08T16:05:57.513397+0000","last_active":"2023-10-08T16:05:58.512176+0000","last_peered":"2023-10-08T16:05:58.512176+0000","last_clean":"2023-10-08T16:05:58.512176+0000","last_became_active":"2023-10-08T16:05:57.512731+0000","last_became_peered":"2023-10-08T16:05:57.512731+0000","last_unstale":"2023-10-08T16:05:58.512176+0000","last_undegraded":"2023-10-08T16:05:58.512176+0000","last_fullsized":"2023-10-08T16:05:58.512176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:05.883181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303001+0000","last_change":"2023-10-08T16:05:58.303001+0000","last_active":"2023-10-08T16:05:58.303001+0000","last_peered":"2023-10-08T16:05:58.303001+0000","last_clean":"2023-10-08T16:05:58.303001+0000","last_became_active":"2023-10-08T16:05:58.302256+0000","last_became_peered":"2023-10-08T16:05:58.302256+0000","last_unstale":"2023-10-08T16:05:58.303001+0000","last_undegraded":"2023-10-08T16:05:58.303001+0000","last_fullsized":"2023-10-08T16:05:58.303001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:37.878950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300265+0000","last_change":"2023-10-08T16:05:57.516816+0000","last_active":"2023-10-08T16:05:58.300265+0000","last_peered":"2023-10-08T16:05:58.300265+0000","last_clean":"2023-10-08T16:05:58.300265+0000","last_became_active":"2023-10-08T16:05:57.516581+0000","last_became_peered":"2023-10-08T16:05:57.516581+0000","last_unstale":"2023-10-08T16:05:58.300265+0000","last_undegraded":"2023-10-08T16:05:58.300265+0000","last_fullsized":"2023-10-08T16:05:58.300265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.330221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.301654+0000","last_change":"2023-10-08T16:05:58.301654+0000","last_active":"2023-10-08T16:05:58.301654+0000","last_peered":"2023-10-08T16:05:58.301654+0000","last_clean":"2023-10-08T16:05:58.301654+0000","last_became_active":"2023-10-08T16:05:58.300631+0000","last_became_peered":"2023-10-08T16:05:58.300631+0000","last_unstale":"2023-10-08T16:05:58.301654+0000","last_undegraded":"2023-10-08T16:05:58.301654+0000","last_fullsized":"2023-10-08T16:05:58.301654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:22.278997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.297845+0000","last_change":"2023-10-08T16:05:57.514580+0000","last_active":"2023-10-08T16:05:58.297845+0000","last_peered":"2023-10-08T16:05:58.297845+0000","last_clean":"2023-10-08T16:05:58.297845+0000","last_became_active":"2023-10-08T16:05:57.514163+0000","last_became_peered":"2023-10-08T16:05:57.514163+0000","last_unstale":"2023-10-08T16:05:58.297845+0000","last_undegraded":"2023-10-08T16:05:58.297845+0000","last_fullsized":"2023-10-08T16:05:58.297845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:25.054951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307113+0000","last_change":"2023-10-08T16:05:58.307050+0000","last_active":"2023-10-08T16:05:58.307113+0000","last_peered":"2023-10-08T16:05:58.307113+0000","last_clean":"2023-10-08T16:05:58.307113+0000","last_became_active":"2023-10-08T16:05:58.306705+0000","last_became_peered":"2023-10-08T16:05:58.306705+0000","last_unstale":"2023-10-08T16:05:58.307113+0000","last_undegraded":"2023-10-08T16:05:58.307113+0000","last_fullsized":"2023-10-08T16:05:58.307113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:16.890239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.295739+0000","last_change":"2023-10-08T16:05:57.513465+0000","last_active":"2023-10-08T16:05:58.295739+0000","last_peered":"2023-10-08T16:05:58.295739+0000","last_clean":"2023-10-08T16:05:58.295739+0000","last_became_active":"2023-10-08T16:05:57.513225+0000","last_became_peered":"2023-10-08T16:05:57.513225+0000","last_unstale":"2023-10-08T16:05:58.295739+0000","last_undegraded":"2023-10-08T16:05:58.295739+0000","last_fullsized":"2023-10-08T16:05:58.295739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:05.883181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.302871+0000","last_change":"2023-10-08T16:05:58.302871+0000","last_active":"2023-10-08T16:05:58.302871+0000","last_peered":"2023-10-08T16:05:58.302871+0000","last_clean":"2023-10-08T16:05:58.302871+0000","last_became_active":"2023-10-08T16:05:58.301963+0000","last_became_peered":"2023-10-08T16:05:58.301963+0000","last_unstale":"2023-10-08T16:05:58.302871+0000","last_undegraded":"2023-10-08T16:05:58.302871+0000","last_fullsized":"2023-10-08T16:05:58.302871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:51.380605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.512553+0000","last_change":"2023-10-08T16:05:57.511868+0000","last_active":"2023-10-08T16:05:58.512553+0000","last_peered":"2023-10-08T16:05:58.512553+0000","last_clean":"2023-10-08T16:05:58.512553+0000","last_became_active":"2023-10-08T16:05:57.511522+0000","last_became_peered":"2023-10-08T16:05:57.511522+0000","last_unstale":"2023-10-08T16:05:58.512553+0000","last_undegraded":"2023-10-08T16:05:58.512553+0000","last_fullsized":"2023-10-08T16:05:58.512553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:12.931674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304148+0000","last_change":"2023-10-08T16:05:58.304032+0000","last_active":"2023-10-08T16:05:58.304148+0000","last_peered":"2023-10-08T16:05:58.304148+0000","last_clean":"2023-10-08T16:05:58.304148+0000","last_became_active":"2023-10-08T16:05:58.303254+0000","last_became_peered":"2023-10-08T16:05:58.303254+0000","last_unstale":"2023-10-08T16:05:58.304148+0000","last_undegraded":"2023-10-08T16:05:58.304148+0000","last_fullsized":"2023-10-08T16:05:58.304148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:17.645955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:05:57.513363+0000","last_change":"2023-10-08T16:05:57.513235+0000","last_active":"2023-10-08T16:05:57.513363+0000","last_peered":"2023-10-08T16:05:57.513363+0000","last_clean":"2023-10-08T16:05:57.513363+0000","last_became_active":"2023-10-08T16:05:57.512369+0000","last_became_peered":"2023-10-08T16:05:57.512369+0000","last_unstale":"2023-10-08T16:05:57.513363+0000","last_undegraded":"2023-10-08T16:05:57.513363+0000","last_fullsized":"2023-10-08T16:05:57.513363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:11.876677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.306923+0000","last_change":"2023-10-08T16:05:58.306923+0000","last_active":"2023-10-08T16:05:58.306923+0000","last_peered":"2023-10-08T16:05:58.306923+0000","last_clean":"2023-10-08T16:05:58.306923+0000","last_became_active":"2023-10-08T16:05:58.306708+0000","last_became_peered":"2023-10-08T16:05:58.306708+0000","last_unstale":"2023-10-08T16:05:58.306923+0000","last_undegraded":"2023-10-08T16:05:58.306923+0000","last_fullsized":"2023-10-08T16:05:58.306923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:23.367591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.293496+0000","last_change":"2023-10-08T16:05:57.507380+0000","last_active":"2023-10-08T16:05:58.293496+0000","last_peered":"2023-10-08T16:05:58.293496+0000","last_clean":"2023-10-08T16:05:58.293496+0000","last_became_active":"2023-10-08T16:05:57.507152+0000","last_became_peered":"2023-10-08T16:05:57.507152+0000","last_unstale":"2023-10-08T16:05:58.293496+0000","last_undegraded":"2023-10-08T16:05:58.293496+0000","last_fullsized":"2023-10-08T16:05:58.293496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:21.273570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.305924+0000","last_change":"2023-10-08T16:05:58.305438+0000","last_active":"2023-10-08T16:05:58.305924+0000","last_peered":"2023-10-08T16:05:58.305924+0000","last_clean":"2023-10-08T16:05:58.305924+0000","last_became_active":"2023-10-08T16:05:58.304352+0000","last_became_peered":"2023-10-08T16:05:58.304352+0000","last_unstale":"2023-10-08T16:05:58.305924+0000","last_undegraded":"2023-10-08T16:05:58.305924+0000","last_fullsized":"2023-10-08T16:05:58.305924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:47.854801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T16:05:57.511791+0000","last_change":"2023-10-08T16:05:57.511720+0000","last_active":"2023-10-08T16:05:57.511791+0000","last_peered":"2023-10-08T16:05:57.511791+0000","last_clean":"2023-10-08T16:05:57.511791+0000","last_became_active":"2023-10-08T16:05:57.511565+0000","last_became_peered":"2023-10-08T16:05:57.511565+0000","last_unstale":"2023-10-08T16:05:57.511791+0000","last_undegraded":"2023-10-08T16:05:57.511791+0000","last_fullsized":"2023-10-08T16:05:57.511791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:12.931674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.304721+0000","last_change":"2023-10-08T16:05:58.304721+0000","last_active":"2023-10-08T16:05:58.304721+0000","last_peered":"2023-10-08T16:05:58.304721+0000","last_clean":"2023-10-08T16:05:58.304721+0000","last_became_active":"2023-10-08T16:05:58.304475+0000","last_became_peered":"2023-10-08T16:05:58.304475+0000","last_unstale":"2023-10-08T16:05:58.304721+0000","last_undegraded":"2023-10-08T16:05:58.304721+0000","last_fullsized":"2023-10-08T16:05:58.304721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:37.195652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.293220+0000","last_change":"2023-10-08T16:05:57.511693+0000","last_active":"2023-10-08T16:05:58.293220+0000","last_peered":"2023-10-08T16:05:58.293220+0000","last_clean":"2023-10-08T16:05:58.293220+0000","last_became_active":"2023-10-08T16:05:57.511289+0000","last_became_peered":"2023-10-08T16:05:57.511289+0000","last_unstale":"2023-10-08T16:05:58.293220+0000","last_undegraded":"2023-10-08T16:05:58.293220+0000","last_fullsized":"2023-10-08T16:05:58.293220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:50.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.307662+0000","last_change":"2023-10-08T16:05:58.307523+0000","last_active":"2023-10-08T16:05:58.307662+0000","last_peered":"2023-10-08T16:05:58.307662+0000","last_clean":"2023-10-08T16:05:58.307662+0000","last_became_active":"2023-10-08T16:05:58.306931+0000","last_became_peered":"2023-10-08T16:05:58.306931+0000","last_unstale":"2023-10-08T16:05:58.307662+0000","last_undegraded":"2023-10-08T16:05:58.307662+0000","last_fullsized":"2023-10-08T16:05:58.307662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:57:02.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.294280+0000","last_change":"2023-10-08T16:05:57.514378+0000","last_active":"2023-10-08T16:05:58.294280+0000","last_peered":"2023-10-08T16:05:58.294280+0000","last_clean":"2023-10-08T16:05:58.294280+0000","last_became_active":"2023-10-08T16:05:57.514086+0000","last_became_peered":"2023-10-08T16:05:57.514086+0000","last_unstale":"2023-10-08T16:05:58.294280+0000","last_undegraded":"2023-10-08T16:05:58.294280+0000","last_fullsized":"2023-10-08T16:05:58.294280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:23.802509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.296999+0000","last_change":"2023-10-08T16:05:58.296553+0000","last_active":"2023-10-08T16:05:58.296999+0000","last_peered":"2023-10-08T16:05:58.296999+0000","last_clean":"2023-10-08T16:05:58.296999+0000","last_became_active":"2023-10-08T16:05:58.296314+0000","last_became_peered":"2023-10-08T16:05:58.296314+0000","last_unstale":"2023-10-08T16:05:58.296999+0000","last_undegraded":"2023-10-08T16:05:58.296999+0000","last_fullsized":"2023-10-08T16:05:58.296999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:34:36.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.299951+0000","last_change":"2023-10-08T16:05:57.513932+0000","last_active":"2023-10-08T16:05:58.299951+0000","last_peered":"2023-10-08T16:05:58.299951+0000","last_clean":"2023-10-08T16:05:58.299951+0000","last_became_active":"2023-10-08T16:05:57.513727+0000","last_became_peered":"2023-10-08T16:05:57.513727+0000","last_unstale":"2023-10-08T16:05:58.299951+0000","last_undegraded":"2023-10-08T16:05:58.299951+0000","last_fullsized":"2023-10-08T16:05:58.299951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:20.539371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.303628+0000","last_change":"2023-10-08T16:05:58.302844+0000","last_active":"2023-10-08T16:05:58.303628+0000","last_peered":"2023-10-08T16:05:58.303628+0000","last_clean":"2023-10-08T16:05:58.303628+0000","last_became_active":"2023-10-08T16:05:58.302606+0000","last_became_peered":"2023-10-08T16:05:58.302606+0000","last_unstale":"2023-10-08T16:05:58.303628+0000","last_undegraded":"2023-10-08T16:05:58.303628+0000","last_fullsized":"2023-10-08T16:05:58.303628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:57.495837+0000","last_clean_scrub_stamp":"2023-10-08T16:05:57.495837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:03.980108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.300370+0000","last_change":"2023-10-08T16:05:57.513664+0000","last_active":"2023-10-08T16:05:58.300370+0000","last_peered":"2023-10-08T16:05:58.300370+0000","last_clean":"2023-10-08T16:05:58.300370+0000","last_became_active":"2023-10-08T16:05:57.513512+0000","last_became_peered":"2023-10-08T16:05:57.513512+0000","last_unstale":"2023-10-08T16:05:58.300370+0000","last_undegraded":"2023-10-08T16:05:58.300370+0000","last_fullsized":"2023-10-08T16:05:58.300370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:05:56.490410+0000","last_clean_scrub_stamp":"2023-10-08T16:05:56.490410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:09.082166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T16:05:58.298778+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:05:58.298778+0000","last_peered":"2023-10-08T16:05:58.298778+0000","last_clean":"2023-10-08T16:05:58.298778+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:05:58.298778+0000","last_undegraded":"2023-10-08T16:05:58.298778+0000","last_fullsized":"2023-10-08T16:05:58.298778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46400000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.432}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.751},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.73799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.78600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.77400000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.379}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.311}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34599999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.4929999999999999,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.623},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277063,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.27500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199867361,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.308}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.252}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.307},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.59899999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.623}]},{"osd":3,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.501}]},{"osd":7,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.505}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.63200000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73699999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:06:02.997 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:06:02.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:06:03.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.158+0000 7f45ea0d5700 1 Processor -- start 2023-10-08T16:06:03.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.158+0000 7f45ea0d5700 1 -- start start 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45ea0d5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45e4154440 0x7f45e415da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45ea0d5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415b380 0x7f45e40cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45ea0d5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e415e1e0 con 0x7f45e415af30 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45ea0d5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e415dfd0 con 0x7f45e4154440 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45ea0d5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415e4c0 con 0x7f45e415b380 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45e3fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415b380 0x7f45e40cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45e2ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f45e415af30 0x7f45e4067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:33756/0 (socket says 172.21.15.60:33756) 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45e2ffd700 1 -- 172.21.15.60:0/4279276856 learned_addr learned my addr 172.21.15.60:0/4279276856 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.159+0000 7f45e37fe700 1 --2- 172.21.15.60:0/4279276856 >> v2:172.21.15.144:3300/0 conn(0x7f45e4154440 0x7f45e415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e3fff700 1 -- 172.21.15.60:0/4279276856 >> v2:172.21.15.144:3300/0 conn(0x7f45e4154440 msgr2=0x7f45e415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e3fff700 1 --2- 172.21.15.60:0/4279276856 >> v2:172.21.15.144:3300/0 conn(0x7f45e4154440 0x7f45e415da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e3fff700 1 -- 172.21.15.60:0/4279276856 >> v1:172.21.15.144:6789/0 conn(0x7f45e415af30 legacy=0x7f45e4067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e27fc700 1 -- 172.21.15.60:0/4279276856 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063133704 0 0) 0x7f45e415e1e0 con 0x7f45e415af30 2023-10-08T16:06:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e3fff700 1 -- 172.21.15.60:0/4279276856 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e415e7a0 con 0x7f45e415b380 2023-10-08T16:06:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e3fff700 1 --2- 172.21.15.60:0/4279276856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415b380 0x7f45e40cfa20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009e60 tx=0x7f45dc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ece746fad436a0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e27fc700 1 -- 172.21.15.60:0/4279276856 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00e070 con 0x7f45e415b380 2023-10-08T16:06:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e27fc700 1 -- 172.21.15.60:0/4279276856 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00bb60 con 0x7f45e415b380 2023-10-08T16:06:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.160+0000 7f45e27fc700 1 -- 172.21.15.60:0/4279276856 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc012430 con 0x7f45e415b380 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 -- 172.21.15.60:0/4279276856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415b380 msgr2=0x7f45e40cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/4279276856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415b380 0x7f45e40cfa20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009e60 tx=0x7f45dc009780 comp rx=0 tx=0).stop 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 -- 172.21.15.60:0/4279276856 shutdown_connections 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/4279276856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415b380 0x7f45e40cfa20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/4279276856 >> v2:172.21.15.144:3300/0 conn(0x7f45e4154440 0x7f45e415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 -- 172.21.15.60:0/4279276856 >> 172.21.15.60:0/4279276856 conn(0x7f45e40d0dd0 msgr2=0x7f45e40d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 -- 172.21.15.60:0/4279276856 shutdown_connections 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.161+0000 7f45ea0d5700 1 -- 172.21.15.60:0/4279276856 wait complete. 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.162+0000 7f45ea0d5700 1 Processor -- start 2023-10-08T16:06:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.162+0000 7f45ea0d5700 1 -- start start 2023-10-08T16:06:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45ea0d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 0x7f45e41592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45ea0d5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415af30 0x7f45e416a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45ea0d5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e415b380 0x7f45e4155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45ea0d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e41557e0 con 0x7f45e4154440 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45ea0d5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4154bd0 con 0x7f45e415b380 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45ea0d5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4154eb0 con 0x7f45e415af30 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 0x7f45e41592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 0x7f45e41592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52392/0 (socket says 172.21.15.60:52392) 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 -- 172.21.15.60:0/1206636992 learned_addr learned my addr 172.21.15.60:0/1206636992 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e3fff700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e415b380 0x7f45e4155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e2ffd700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415af30 0x7f45e416a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 -- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415af30 msgr2=0x7f45e416a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415af30 0x7f45e416a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 -- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e415b380 msgr2=0x7f45e4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e415b380 0x7f45e4155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 -- 172.21.15.60:0/1206636992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009a20 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.163+0000 7f45e37fe700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 0x7f45e41592d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f45d400ec80 tx=0x7f45d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.164+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4009690 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.164+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400c850 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.164+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e4155190 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.164+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400cc10 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.164+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e4154810 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.165+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e4155ac0 con 0x7f45e4154440 2023-10-08T16:06:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.165+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45d4013470 con 0x7f45e4154440 2023-10-08T16:06:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.166+0000 7f45cb7fe700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45d0066f30 0x7f45d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.166+0000 7f45e2ffd700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45d0066f30 0x7f45d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.166+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45d4084710 con 0x7f45e4154440 2023-10-08T16:06:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.166+0000 7f45e2ffd700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45d0066f30 0x7f45d00693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45e416d5f0 tx=0x7f45d8007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.170+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45d4051980 con 0x7f45e4154440 2023-10-08T16:06:03.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.444+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f45e41540c0 con 0x7f45e4154440 2023-10-08T16:06:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.448+0000 7f45cb7fe700 1 -- 172.21.15.60:0/1206636992 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f45d4054fa0 con 0x7f45e4154440 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45d0066f30 msgr2=0x7f45d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45d0066f30 0x7f45d00693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45e416d5f0 tx=0x7f45d8007d30 comp rx=0 tx=0).stop 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 msgr2=0x7f45e41592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 0x7f45e41592d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f45d400ec80 tx=0x7f45d40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 shutdown_connections 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45d0066f30 0x7f45d00693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e415b380 0x7f45e4155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e4154440 0x7f45e41592d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 --2- 172.21.15.60:0/1206636992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45e415af30 0x7f45e416a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 >> 172.21.15.60:0/1206636992 conn(0x7f45e40d0dd0 msgr2=0x7f45e40d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 shutdown_connections 2023-10-08T16:06:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.450+0000 7f45ea0d5700 1 -- 172.21.15.60:0/1206636992 wait complete. 2023-10-08T16:06:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:06:03.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:03.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.582+0000 7f531cc29700 1 Processor -- start 2023-10-08T16:06:03.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.582+0000 7f531cc29700 1 -- start start 2023-10-08T16:06:03.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.583+0000 7f531cc29700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5318159e10 0x7f53180b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.583+0000 7f531cc29700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f531815a1e0 0x7f53180b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.583+0000 7f531cc29700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531815db80 con 0x7f53180b1610 2023-10-08T16:06:03.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.583+0000 7f531cc29700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531815e800 con 0x7f531815a1e0 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.583+0000 7f531cc29700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531815de60 con 0x7f5318159e10 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f531815a1e0 0x7f53180b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f531815a1e0 0x7f53180b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52402/0 (socket says 172.21.15.60:52402) 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 -- 172.21.15.60:0/2607256106 learned_addr learned my addr 172.21.15.60:0/2607256106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f531659c700 1 --2- 172.21.15.60:0/2607256106 >> v2:172.21.15.144:3300/0 conn(0x7f5318159e10 0x7f53180b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 -- 172.21.15.60:0/2607256106 >> v2:172.21.15.144:3300/0 conn(0x7f5318159e10 msgr2=0x7f53180b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 --2- 172.21.15.60:0/2607256106 >> v2:172.21.15.144:3300/0 conn(0x7f5318159e10 0x7f53180b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 -- 172.21.15.60:0/2607256106 >> v1:172.21.15.144:6789/0 conn(0x7f53180b1610 legacy=0x7f53180cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 -- 172.21.15.60:0/2607256106 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531815e140 con 0x7f531815a1e0 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f5315d9b700 1 --2- 172.21.15.60:0/2607256106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f531815a1e0 0x7f53180b3260 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5318068a60 tx=0x7f5300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a566ea3079993a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f531559a700 1 -- 172.21.15.60:0/2607256106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300009e70 con 0x7f531815a1e0 2023-10-08T16:06:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f531559a700 1 -- 172.21.15.60:0/2607256106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000b860 con 0x7f531815a1e0 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.584+0000 7f531559a700 1 -- 172.21.15.60:0/2607256106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000bc00 con 0x7f531815a1e0 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 -- 172.21.15.60:0/2607256106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f531815a1e0 msgr2=0x7f53180b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 --2- 172.21.15.60:0/2607256106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f531815a1e0 0x7f53180b3260 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5318068a60 tx=0x7f5300009250 comp rx=0 tx=0).stop 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 -- 172.21.15.60:0/2607256106 shutdown_connections 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 --2- 172.21.15.60:0/2607256106 >> v2:172.21.15.144:3300/0 conn(0x7f5318159e10 0x7f53180b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 --2- 172.21.15.60:0/2607256106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f531815a1e0 0x7f53180b3260 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 -- 172.21.15.60:0/2607256106 >> 172.21.15.60:0/2607256106 conn(0x7f5318067660 msgr2=0x7f5318067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 -- 172.21.15.60:0/2607256106 shutdown_connections 2023-10-08T16:06:03.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.585+0000 7f531cc29700 1 -- 172.21.15.60:0/2607256106 wait complete. 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.586+0000 7f531cc29700 1 Processor -- start 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.586+0000 7f531cc29700 1 -- start start 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 0x7f531816b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5318159e10 0x7f531816a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f531815a1e0 0x7f531816ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53180c6080 con 0x7f53180b1610 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53180c8fc0 con 0x7f531815a1e0 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53180c92a0 con 0x7f5318159e10 2023-10-08T16:06:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 0x7f531816b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 0x7f531816b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52406/0 (socket says 172.21.15.60:52406) 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 -- 172.21.15.60:0/2140346311 learned_addr learned my addr 172.21.15.60:0/2140346311 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f5315d9b700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5318159e10 0x7f531816a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f5316d9d700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f531815a1e0 0x7f531816ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 -- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5318159e10 msgr2=0x7f531816a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5318159e10 0x7f531816a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 -- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f531815a1e0 msgr2=0x7f531816ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f531815a1e0 0x7f531816ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 -- 172.21.15.60:0/2140346311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53000094f0 con 0x7f53180b1610 2023-10-08T16:06:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f5316d9d700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f531815a1e0 0x7f531816ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531659c700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 0x7f531816b640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f531000ec80 tx=0x7f53100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000c850 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531000c9b0 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53180c9580 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000cd50 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.587+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531816acb0 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.588+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531804c3c0 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.589+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5310013680 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.589+0000 7f530e7fc700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f8066f30 0x7f52f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.589+0000 7f5315d9b700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f8066f30 0x7f52f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.589+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5310084b50 con 0x7f53180b1610 2023-10-08T16:06:03.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.590+0000 7f5315d9b700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f8066f30 0x7f52f80693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5318068a60 tx=0x7f5300017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:03.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.593+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5310051dc0 con 0x7f53180b1610 2023-10-08T16:06:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.831+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f531815e420 con 0x7f53180b1610 2023-10-08T16:06:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.832+0000 7f530e7fc700 1 -- 172.21.15.60:0/2140346311 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f5310017090 con 0x7f53180b1610 2023-10-08T16:06:03.832 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:03.832 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:03.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f8066f30 msgr2=0x7f52f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f8066f30 0x7f52f80693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5318068a60 tx=0x7f5300017000 comp rx=0 tx=0).stop 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 msgr2=0x7f531816b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 0x7f531816b640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f531000ec80 tx=0x7f53100091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 shutdown_connections 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f8066f30 0x7f52f80693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f531815a1e0 0x7f531816ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53180b1610 0x7f531816b640 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 --2- 172.21.15.60:0/2140346311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5318159e10 0x7f531816a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 >> 172.21.15.60:0/2140346311 conn(0x7f5318067660 msgr2=0x7f53180b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 shutdown_connections 2023-10-08T16:06:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:03.834+0000 7f531cc29700 1 -- 172.21.15.60:0/2140346311 wait complete. 2023-10-08T16:06:03.836 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:04.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:05:57.900043+0000', 'modified': '2023-10-08T16:06:01.522481+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4944}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4944': {'gid': 4944, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.60:6837/1920991468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 1920991468}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1920991468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:06:04.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:06:04.249 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:06:04.360 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-10-08T16:06:04.360+0000 7fdcb52c2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:06:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.371+0000 7f4e18d7a700 1 Processor -- start 2023-10-08T16:06:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.371+0000 7f4e18d7a700 1 -- start start 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e18d7a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e14159da0 0x7f4e140b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e18d7a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1415a170 0x7f4e14068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e18d7a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1415ea70 con 0x7f4e14069040 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e18d7a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140694e0 con 0x7f4e14159da0 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e18d7a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140b3990 con 0x7f4e1415a170 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e13fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e14069040 0x7f4e140af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53574/0 (socket says 172.21.15.60:53574) 2023-10-08T16:06:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e13fff700 1 -- 172.21.15.60:0/2478958352 learned_addr learned my addr 172.21.15.60:0/2478958352 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e137fe700 1 --2- 172.21.15.60:0/2478958352 >> v2:172.21.15.144:3300/0 conn(0x7f4e14159da0 0x7f4e140b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1415a170 0x7f4e14068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e127fc700 1 -- 172.21.15.60:0/2478958352 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612588925 0 0) 0x7f4e1415ea70 con 0x7f4e14069040 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.372+0000 7f4e127fc700 1 -- 172.21.15.60:0/2478958352 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc003570 con 0x7f4e14069040 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e127fc700 1 -- 172.21.15.60:0/2478958352 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2868765976 0 0) 0x7f4dfc003570 con 0x7f4e14069040 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e137fe700 1 -- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1415a170 msgr2=0x7f4e14068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e137fe700 1 --2- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1415a170 0x7f4e14068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e137fe700 1 -- 172.21.15.60:0/2478958352 >> v1:172.21.15.60:6789/0 conn(0x7f4e14069040 legacy=0x7f4e140af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e137fe700 1 -- 172.21.15.60:0/2478958352 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140b0b70 con 0x7f4e14159da0 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e137fe700 1 --2- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e14159da0 0x7f4e140b2da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e040098e0 tx=0x7f4e040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52e5e2c599b6986 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e127fc700 1 -- 172.21.15.60:0/2478958352 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0017f0 con 0x7f4e14159da0 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e127fc700 1 -- 172.21.15.60:0/2478958352 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04011420 con 0x7f4e14159da0 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e127fc700 1 -- 172.21.15.60:0/2478958352 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e040117c0 con 0x7f4e14159da0 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e18d7a700 1 -- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e14159da0 msgr2=0x7f4e140b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.373+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e14159da0 0x7f4e140b2da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e040098e0 tx=0x7f4e040091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.374+0000 7f4e18d7a700 1 -- 172.21.15.60:0/2478958352 shutdown_connections 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.374+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e14159da0 0x7f4e140b2da0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.374+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/2478958352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1415a170 0x7f4e14068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.374+0000 7f4e18d7a700 1 -- 172.21.15.60:0/2478958352 >> 172.21.15.60:0/2478958352 conn(0x7f4e140d0bc0 msgr2=0x7f4e140d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.374+0000 7f4e18d7a700 1 -- 172.21.15.60:0/2478958352 shutdown_connections 2023-10-08T16:06:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.374+0000 7f4e18d7a700 1 -- 172.21.15.60:0/2478958352 wait complete. 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.375+0000 7f4e18d7a700 1 Processor -- start 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.375+0000 7f4e18d7a700 1 -- start start 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e14069040 0x7f4e140c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 0x7f4e140d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1415a170 0x7f4e140d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1416aa00 con 0x7f4e14159da0 2023-10-08T16:06:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c7520 con 0x7f4e1415a170 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c7240 con 0x7f4e14069040 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 0x7f4e140d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 0x7f4e140d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52408/0 (socket says 172.21.15.60:52408) 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 -- 172.21.15.60:0/558326068 learned_addr learned my addr 172.21.15.60:0/558326068 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e137fe700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e14069040 0x7f4e140c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e13fff700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1415a170 0x7f4e140d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 -- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e14069040 msgr2=0x7f4e140c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e14069040 0x7f4e140c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 -- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1415a170 msgr2=0x7f4e140d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1415a170 0x7f4e140d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 -- 172.21.15.60:0/558326068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04009420 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 0x7f4e140d0f90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800e930 tx=0x7f4e080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/558326068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08013680 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/558326068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080137e0 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1416abe0 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.376+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/558326068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08013b80 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.377+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1416b1a0 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.378+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/558326068 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e0800c3e0 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.378+0000 7f4dfb7fe700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e00066f30 0x7f4e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.378+0000 7f4dfb7fe700 1 -- 172.21.15.60:0/558326068 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e080845b0 con 0x7f4e14159da0 2023-10-08T16:06:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.378+0000 7f4e137fe700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e00066f30 0x7f4e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.379+0000 7f4e137fe700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e00066f30 0x7f4e000693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4e040030c0 tx=0x7f4e04016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.380+0000 7f4e232d4b80 1 Processor -- start 2023-10-08T16:06:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.380+0000 7f4e232d4b80 1 -- start start 2023-10-08T16:06:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b9918aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b990e1a70 con 0x564b991d5480 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b990df270 con 0x564b991885f0 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b990db060 con 0x564b9918ab80 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52410/0 (socket says 172.21.15.60:52410) 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e137fe700 1 -- 172.21.15.60:0/2826365391 learned_addr learned my addr 172.21.15.60:0/2826365391 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.381+0000 7f4e13fff700 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b9918aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e137fe700 1 -- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 msgr2=0x564b9918aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e137fe700 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b9918aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e137fe700 1 -- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 msgr2=0x564b991d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e137fe700 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e137fe700 1 -- 172.21.15.60:0/2826365391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b98f75270 con 0x564b991d5480 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4e137fe700 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991b47d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4e04011840 tx=0x7f4e04022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693a69794edd1c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4df8ff9700 1 -- 172.21.15.60:0/2826365391 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04022070 con 0x564b991d5480 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4df8ff9700 1 -- 172.21.15.60:0/2826365391 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0401c4d0 con 0x564b991d5480 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.382+0000 7f4df8ff9700 1 -- 172.21.15.60:0/2826365391 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0401c680 con 0x564b991d5480 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 -- 172.21.15.60:0/2826365391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 msgr2=0x564b991b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991b47d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4e04011840 tx=0x7f4e04022000 comp rx=0 tx=0).stop 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 -- 172.21.15.60:0/2826365391 shutdown_connections 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b9918aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991b47d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/2826365391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 -- 172.21.15.60:0/2826365391 >> 172.21.15.60:0/2826365391 conn(0x564b9918c0c0 msgr2=0x564b9918c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 -- 172.21.15.60:0/2826365391 shutdown_connections 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 -- 172.21.15.60:0/2826365391 wait complete. 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 -- start start 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.383+0000 7f4e232d4b80 1 Processor -- start 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 0x564b991aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b991b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991d5480 0x564b991b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b99086890 con 0x564b991885f0 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b990a1ea0 con 0x564b991d5480 2023-10-08T16:06:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b98f5de30 con 0x564b9918ab80 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e232d4b80 10 client.0 _ll_register_callbacks cb 0x564b9914e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 0x564b991aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 0x564b991aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52414/0 (socket says 172.21.15.60:52414) 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e137fe700 1 -- 172.21.15.60:0/1231294617 learned_addr learned my addr 172.21.15.60:0/1231294617 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e13fff700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991d5480 0x564b991b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.384+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b991b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e137fe700 1 -- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 msgr2=0x564b991b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e137fe700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b991b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e137fe700 1 -- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991d5480 msgr2=0x564b991b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e137fe700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991d5480 0x564b991b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e137fe700 1 -- 172.21.15.60:0/1231294617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140b0b70 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b991b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e137fe700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 0x564b991aefc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4e040093f0 tx=0x7f4e0402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59309997a6dbe6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4df1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1231294617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04022040 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1231294617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e0400b790 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b9917fcd0 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1231294617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e0400bb60 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e232d4b80 10 client.5127 fetch_fsmap learned FSMap version 18 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x564b98f17fe0 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1231294617 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b9917fcd0 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1231294617 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4e0403b030 con 0x564b991885f0 2023-10-08T16:06:04.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e232d4b80 10 client.5127 fetch_fsmap finished waiting for FSMap version 18 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e232d4b80 10 client.5127 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.385+0000 7f4e232d4b80 20 client.5127 populate_metadata read hostname 'smithi060' 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1980 0x564b991b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4e232d4b80 4 client.5127 mds_command: new command op to 4944 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 --> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b9915caa0 con 0x564b991d1980 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1980 0x564b991b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4df1ffb700 10 client.5127 ms_handle_connect on v2:172.21.15.60:6834/1920991468 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1980 0x564b991b4f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0ab7486ae343af8 server_cookie=da3c5381f42f19ec in_seq=0 out_seq=0 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1231294617 <== mds.0 v2:172.21.15.60:6834/1920991468 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564b9915caa0 con 0x564b991d1980 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.386+0000 7f4df1ffb700 10 client.5127 handle_command_reply: tid=0 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 client.5127 shutdown 2023-10-08T16:06:04.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 msgr2=0x564b991aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 0x564b991aefc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4e040093f0 tx=0x7f4e0402c040 comp rx=0 tx=0).stop 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 shutdown_connections 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991d5480 0x564b991b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991885f0 0x564b991aefc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1980 0x564b991b4f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1231294617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b9918ab80 0x564b991b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4df1ffb700 0 client.5127 ms_handle_reset on v2:172.21.15.60:6834/1920991468 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 >> 172.21.15.60:0/1231294617 conn(0x564b9918c0c0 msgr2=0x564b99181c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 shutdown_connections 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1231294617 wait complete. 2023-10-08T16:06:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.387+0000 7f4e232d4b80 20 client.5127 trim_cache size 0 max 16384 2023-10-08T16:06:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 Processor -- start 2023-10-08T16:06:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 -- start start 2023-10-08T16:06:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 0x564b99187be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991d5480 0x564b991d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b991b8660 con 0x564b9918ab80 2023-10-08T16:06:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b991b67a0 con 0x564b991885f0 2023-10-08T16:06:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.404+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b991d4ef0 con 0x564b991d5480 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 0x564b99187be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 0x564b99187be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52422/0 (socket says 172.21.15.60:52422) 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 -- 172.21.15.60:0/4283901621 learned_addr learned my addr 172.21.15.60:0/4283901621 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 -- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991d5480 msgr2=0x564b991d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991d5480 0x564b991d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 -- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 msgr2=0x564b991b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e137fe700 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 -- 172.21.15.60:0/4283901621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b990a9780 con 0x564b9918ab80 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e137fe700 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 0x564b99187be0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c2e0 tx=0x7f4e08084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83abcee6fa8c5661 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4df97fa700 1 -- 172.21.15.60:0/4283901621 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0806f070 con 0x564b9918ab80 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4df97fa700 1 -- 172.21.15.60:0/4283901621 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08082be0 con 0x564b9918ab80 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.405+0000 7f4df97fa700 1 -- 172.21.15.60:0/4283901621 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08053880 con 0x564b9918ab80 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 -- 172.21.15.60:0/4283901621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 msgr2=0x564b99187be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 0x564b99187be0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c2e0 tx=0x7f4e08084040 comp rx=0 tx=0).stop 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 -- 172.21.15.60:0/4283901621 shutdown_connections 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991d5480 0x564b991d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b991885f0 0x564b991b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/4283901621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b9918ab80 0x564b99187be0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 -- 172.21.15.60:0/4283901621 >> 172.21.15.60:0/4283901621 conn(0x564b9918c0c0 msgr2=0x564b991d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 -- 172.21.15.60:0/4283901621 shutdown_connections 2023-10-08T16:06:04.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 -- 172.21.15.60:0/4283901621 wait complete. 2023-10-08T16:06:04.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 -- start start 2023-10-08T16:06:04.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.406+0000 7f4e232d4b80 1 Processor -- start 2023-10-08T16:06:04.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991885f0 0x564b991b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b9918ab80 0x564b991aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991af500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b991b74e0 con 0x564b991d5480 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b99236e70 con 0x564b9918ab80 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b991b0fb0 con 0x564b991885f0 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e232d4b80 10 client.0 _ll_register_callbacks cb 0x564b9914e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e13fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e13fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52436/0 (socket says 172.21.15.60:52436) 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e13fff700 1 -- 172.21.15.60:0/1069113935 learned_addr learned my addr 172.21.15.60:0/1069113935 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e12ffd700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b9918ab80 0x564b991aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.407+0000 7f4e137fe700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991885f0 0x564b991b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e13fff700 1 -- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991885f0 msgr2=0x564b991b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e13fff700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991885f0 0x564b991b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e13fff700 1 -- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b9918ab80 msgr2=0x564b991aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e13fff700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b9918ab80 0x564b991aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e13fff700 1 -- 172.21.15.60:0/1069113935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1416b1a0 con 0x564b991d5480 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e13fff700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991af500 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0019a0 tx=0x7f4e0c006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1136ca4204ea75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4df1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1069113935 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c007a80 con 0x564b991d5480 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1069113935 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e0c0139a0 con 0x564b991d5480 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e0401c4d0 con 0x564b991d5480 2023-10-08T16:06:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1069113935 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e0c004e70 con 0x564b991d5480 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 10 client.5133 fetch_fsmap learned FSMap version 18 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x564b99090470 con 0x564b991d5480 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1069113935 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0401c4d0 con 0x564b991d5480 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1069113935 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4e0c016450 con 0x564b991d5480 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 10 client.5133 fetch_fsmap finished waiting for FSMap version 18 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 10 client.5133 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 20 client.5133 populate_metadata read hostname 'smithi060' 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1e90 0x564b991d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 4 client.5133 mds_command: new command op to 4944 tid=0[{"prefix": "status"}] 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.408+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 --> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b9907de00 con 0x564b991d1e90 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e137fe700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1e90 0x564b991d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4df1ffb700 10 client.5133 ms_handle_connect on v2:172.21.15.60:6834/1920991468 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e137fe700 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1e90 0x564b991d2260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680abd2d91eaaa9e server_cookie=ff73bbde909b43a1 in_seq=0 out_seq=0 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4df1ffb700 1 -- 172.21.15.60:0/1069113935 <== mds.0 v2:172.21.15.60:6834/1920991468 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564b9907de00 con 0x564b991d1e90 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4df1ffb700 10 client.5133 handle_command_reply: tid=0 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 client.5133 shutdown 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 msgr2=0x564b991af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991af500 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0019a0 tx=0x7f4e0c006040 comp rx=0 tx=0).stop 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 shutdown_connections 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:6834/1920991468,v1:172.21.15.60:6837/1920991468] conn(0x564b991d1e90 0x564b991d2260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x564b991885f0 0x564b991b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b991d5480 0x564b991af500 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4df1ffb700 0 client.5133 ms_handle_reset on v2:172.21.15.60:6834/1920991468 2023-10-08T16:06:04.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 --2- 172.21.15.60:0/1069113935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b9918ab80 0x564b991aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 >> 172.21.15.60:0/1069113935 conn(0x564b9918c0c0 msgr2=0x564b99187be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 shutdown_connections 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 1 -- 172.21.15.60:0/1069113935 wait complete. 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.409+0000 7f4e232d4b80 20 client.5133 trim_cache size 0 max 16384 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4944, 2023-10-08T16:06:04.417 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 5.9047419579999998, 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 18, 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 32, 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 32, 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 20.918024608 2023-10-08T16:06:04.418 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e00066f30 msgr2=0x7f4e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e00066f30 0x7f4e000693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4e040030c0 tx=0x7f4e04016000 comp rx=0 tx=0).stop 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 msgr2=0x7f4e140d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 0x7f4e140d0f90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800e930 tx=0x7f4e080091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 shutdown_connections 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e00066f30 0x7f4e000693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e14069040 0x7f4e140c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e1415a170 0x7f4e140d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 --2- 172.21.15.60:0/558326068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e14159da0 0x7f4e140d0f90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 >> 172.21.15.60:0/558326068 conn(0x7f4e140d0bc0 msgr2=0x7f4e140ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 shutdown_connections 2023-10-08T16:06:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.410+0000 7f4e18d7a700 1 -- 172.21.15.60:0/558326068 wait complete. 2023-10-08T16:06:04.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:06:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.541+0000 7fde9a1c5700 1 Processor -- start 2023-10-08T16:06:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.541+0000 7fde9a1c5700 1 -- start start 2023-10-08T16:06:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde9a1c5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde9415a030 0x7fde9415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde9a1c5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde940cf100 0x7fde940cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde9a1c5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940d1960 con 0x7fde940b40b0 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde9a1c5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde940d0610 con 0x7fde940cf100 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde9a1c5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9415a940 con 0x7fde9415a030 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde989c2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde940cf100 0x7fde940cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde999c4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fde940b40b0 0x7fde940b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53590/0 (socket says 172.21.15.60:53590) 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde999c4700 1 -- 172.21.15.60:0/4132215618 learned_addr learned my addr 172.21.15.60:0/4132215618 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde991c3700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde9415a030 0x7fde9415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde989c2700 1 -- 172.21.15.60:0/4132215618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde9415a030 msgr2=0x7fde9415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde989c2700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde9415a030 0x7fde9415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde989c2700 1 -- 172.21.15.60:0/4132215618 >> v1:172.21.15.60:6789/0 conn(0x7fde940b40b0 legacy=0x7fde940b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde989c2700 1 -- 172.21.15.60:0/4132215618 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940cfab0 con 0x7fde940cf100 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde8bfff700 1 -- 172.21.15.60:0/4132215618 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139764922 0 0) 0x7fde940d1960 con 0x7fde940b40b0 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde991c3700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde9415a030 0x7fde9415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde989c2700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940cf100 0x7fde940cf570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fde840098e0 tx=0x7fde840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4696eb61a23e8db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.542+0000 7fde8bfff700 1 -- 172.21.15.60:0/4132215618 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84009e80 con 0x7fde940cf100 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde8bfff700 1 -- 172.21.15.60:0/4132215618 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400b860 con 0x7fde940cf100 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde8bfff700 1 -- 172.21.15.60:0/4132215618 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400bbe0 con 0x7fde940cf100 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 -- 172.21.15.60:0/4132215618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940cf100 msgr2=0x7fde940cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940cf100 0x7fde940cf570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fde840098e0 tx=0x7fde840091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 -- 172.21.15.60:0/4132215618 shutdown_connections 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde9415a030 0x7fde9415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/4132215618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940cf100 0x7fde940cf570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 -- 172.21.15.60:0/4132215618 >> 172.21.15.60:0/4132215618 conn(0x7fde94067e40 msgr2=0x7fde940d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 -- 172.21.15.60:0/4132215618 shutdown_connections 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.543+0000 7fde9a1c5700 1 -- 172.21.15.60:0/4132215618 wait complete. 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.544+0000 7fde9a1c5700 1 Processor -- start 2023-10-08T16:06:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.544+0000 7fde9a1c5700 1 -- start start 2023-10-08T16:06:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde9a1c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 0x7fde9416d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde9a1c5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde940cf100 0x7fde9416abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde9a1c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde9415a030 0x7fde9409d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde9a1c5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9416b130 con 0x7fde940b40b0 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde9a1c5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9416cc70 con 0x7fde9415a030 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde9a1c5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9416c060 con 0x7fde940cf100 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde991c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 0x7fde9416d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde991c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 0x7fde9416d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52452/0 (socket says 172.21.15.60:52452) 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.545+0000 7fde991c3700 1 -- 172.21.15.60:0/2424511385 learned_addr learned my addr 172.21.15.60:0/2424511385 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde991c3700 1 -- 172.21.15.60:0/2424511385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde940cf100 msgr2=0x7fde9416abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde991c3700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde940cf100 0x7fde9416abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde991c3700 1 -- 172.21.15.60:0/2424511385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde9415a030 msgr2=0x7fde9409d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde991c3700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde9415a030 0x7fde9409d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde991c3700 1 -- 172.21.15.60:0/2424511385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009420 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde991c3700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 0x7fde9416d100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c880 tx=0x7fde90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90005a00 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90005b60 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9416c340 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90011600 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.546+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9416c900 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.547+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9416cf50 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.547+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde900119f0 con 0x7fde940b40b0 2023-10-08T16:06:04.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.548+0000 7fde897fa700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde78066f30 0x7fde780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:04.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.548+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde90084460 con 0x7fde940b40b0 2023-10-08T16:06:04.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.548+0000 7fde989c2700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde78066f30 0x7fde780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:04.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.548+0000 7fde989c2700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde78066f30 0x7fde780693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde940b31b0 tx=0x7fde84017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:04.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.552+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde900516d0 con 0x7fde940b40b0 2023-10-08T16:06:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.790+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde94089300 con 0x7fde940b40b0 2023-10-08T16:06:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.790+0000 7fde897fa700 1 -- 172.21.15.60:0/2424511385 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde90054cf0 con 0x7fde940b40b0 2023-10-08T16:06:04.791 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde78066f30 msgr2=0x7fde780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde78066f30 0x7fde780693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde940b31b0 tx=0x7fde84017000 comp rx=0 tx=0).stop 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 msgr2=0x7fde9416d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 0x7fde9416d100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c880 tx=0x7fde90008040 comp rx=0 tx=0).stop 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 shutdown_connections 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde78066f30 0x7fde780693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde9415a030 0x7fde9409d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde940b40b0 0x7fde9416d100 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 --2- 172.21.15.60:0/2424511385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde940cf100 0x7fde9416abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:04.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 >> 172.21.15.60:0/2424511385 conn(0x7fde94067e40 msgr2=0x7fde940b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:04.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 shutdown_connections 2023-10-08T16:06:04.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:04.792+0000 7fde9a1c5700 1 -- 172.21.15.60:0/2424511385 wait complete. 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:06:04.805 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:04.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:04.806 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:06:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:06:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:04.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:04.826 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:06:04.885 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:06:04.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:04.887 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:06:04.943 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:06:04.943 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:06:04.943 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:06:04.943 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:06:04.943 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:06:04.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:04.944 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:06:04.944 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:06:04.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:06:04.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:06:04.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:06:04.944 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:06:05.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.046 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:06:05.060 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:06:05.060 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:06:05.061 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:05.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:06:05.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:05.126 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:05.181 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:05.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:05.182 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:05.235 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:06:05.235 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:06:05.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:05.317 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:05.317 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:05.336 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:05.336 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:05.336 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:05.336 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:05.336 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:05.337 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:05.337 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:05.337 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:05.358 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:05.358 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:05.358 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:05.358 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:05.358 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:05.358 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:05.359 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:05.359 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:05.359 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:06:05.359 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:06:05.359 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:06:05.361 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:06:05.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:05.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:06:05.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.586+0000 7f9c42569700 1 Processor -- start 2023-10-08T16:06:05.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.586+0000 7f9c42569700 1 -- start start 2023-10-08T16:06:05.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c42569700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c0cf1c0 0x7f9c3c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:05.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c42569700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c3c15a0c0 0x7f9c3c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:05.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c42569700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0cca20 con 0x7f9c3c159cf0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c42569700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c15ea40 con 0x7f9c3c15a0c0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c42569700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c067660 con 0x7f9c3c0cf1c0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c3c15a0c0 0x7f9c3c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c3c15a0c0 0x7f9c3c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52458/0 (socket says 172.21.15.60:52458) 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 -- 172.21.15.60:0/4184913977 learned_addr learned my addr 172.21.15.60:0/4184913977 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c3b7fe700 1 --2- 172.21.15.60:0/4184913977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c0cf1c0 0x7f9c3c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 -- 172.21.15.60:0/4184913977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c0cf1c0 msgr2=0x7f9c3c15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 --2- 172.21.15.60:0/4184913977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c0cf1c0 0x7f9c3c15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 -- 172.21.15.60:0/4184913977 >> v1:172.21.15.144:6789/0 conn(0x7f9c3c159cf0 legacy=0x7f9c3c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 -- 172.21.15.60:0/4184913977 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c067f00 con 0x7f9c3c15a0c0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c40b06700 1 --2- 172.21.15.60:0/4184913977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c15a0c0 0x7f9c3c068390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009f20 tx=0x7f9c34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee162306a65639bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:05.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c3affd700 1 -- 172.21.15.60:0/4184913977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400e070 con 0x7f9c3c15a0c0 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.587+0000 7f9c3affd700 1 -- 172.21.15.60:0/4184913977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3400b9d0 con 0x7f9c3c15a0c0 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c3affd700 1 -- 172.21.15.60:0/4184913977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340092e0 con 0x7f9c3c15a0c0 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 -- 172.21.15.60:0/4184913977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c15a0c0 msgr2=0x7f9c3c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 --2- 172.21.15.60:0/4184913977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c15a0c0 0x7f9c3c068390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009f20 tx=0x7f9c34009840 comp rx=0 tx=0).stop 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 -- 172.21.15.60:0/4184913977 shutdown_connections 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 --2- 172.21.15.60:0/4184913977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c15a0c0 0x7f9c3c068390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 --2- 172.21.15.60:0/4184913977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c0cf1c0 0x7f9c3c15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 -- 172.21.15.60:0/4184913977 >> 172.21.15.60:0/4184913977 conn(0x7f9c3c06c6e0 msgr2=0x7f9c3c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 -- 172.21.15.60:0/4184913977 shutdown_connections 2023-10-08T16:06:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.588+0000 7f9c42569700 1 -- 172.21.15.60:0/4184913977 wait complete. 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.589+0000 7f9c42569700 1 Processor -- start 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.589+0000 7f9c42569700 1 -- start start 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c42569700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cf1c0 0x7f9c3c0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c42569700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 0x7f9c3c0abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c42569700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c15a0c0 0x7f9c3c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c42569700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b1cd0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c42569700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b1fb0 con 0x7f9c3c0cf1c0 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c42569700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b2290 con 0x7f9c3c15a0c0 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 0x7f9c3c0abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 0x7f9c3c0abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52472/0 (socket says 172.21.15.60:52472) 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 -- 172.21.15.60:0/3517415724 learned_addr learned my addr 172.21.15.60:0/3517415724 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c40b06700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c15a0c0 0x7f9c3c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3bfff700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cf1c0 0x7f9c3c0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 -- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c15a0c0 msgr2=0x7f9c3c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c15a0c0 0x7f9c3c1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 -- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cf1c0 msgr2=0x7f9c3c0c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cf1c0 0x7f9c3c0c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.590+0000 7f9c3b7fe700 1 -- 172.21.15.60:0/3517415724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c34009ae0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.591+0000 7f9c3b7fe700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 0x7f9c3c0abbc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000ec50 tx=0x7f9c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.591+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000c850 con 0x7f9c3c159cf0 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.591+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3000c9b0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.591+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c0b2570 con 0x7f9c3c159cf0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.591+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000cd70 con 0x7f9c3c159cf0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.591+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c0c84e0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.592+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c04c3c0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.592+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c30013680 con 0x7f9c3c159cf0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.592+0000 7f9c23fff700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9c28066f30 0x7f9c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.593+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c30084740 con 0x7f9c3c159cf0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.593+0000 7f9c3bfff700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9c28066f30 0x7f9c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:05.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.593+0000 7f9c3bfff700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9c28066f30 0x7f9c280693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c003a80 tx=0x7f9c2c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:05.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.597+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c300519b0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.837+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c3c0ce730 con 0x7f9c3c159cf0 2023-10-08T16:06:05.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.837+0000 7f9c23fff700 1 -- 172.21.15.60:0/3517415724 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9c30054fd0 con 0x7f9c3c159cf0 2023-10-08T16:06:05.837 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:06:05.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9c28066f30 msgr2=0x7f9c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:05.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9c28066f30 0x7f9c280693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c003a80 tx=0x7f9c2c007ec0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 msgr2=0x7f9c3c0abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 0x7f9c3c0abbc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000ec50 tx=0x7f9c300091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 shutdown_connections 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9c28066f30 0x7f9c280693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c3c15a0c0 0x7f9c3c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c3c0cf1c0 0x7f9c3c0c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 --2- 172.21.15.60:0/3517415724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c3c159cf0 0x7f9c3c0abbc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 >> 172.21.15.60:0/3517415724 conn(0x7f9c3c06c6e0 msgr2=0x7f9c3c0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 shutdown_connections 2023-10-08T16:06:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:05.839+0000 7f9c42569700 1 -- 172.21.15.60:0/3517415724 wait complete. 2023-10-08T16:06:05.851 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:06:05.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:06:05.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:06:05.851 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:06:05.852 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:05.852 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:06:05.852 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:06:05.852 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:06:05.852 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:06:05.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.852 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:06:05.869 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:06:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42377sec preferred_lft 42377sec 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:06:05.871 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:06:05.872 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.872 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:05.872 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:06:05.872 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:06:05.872 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:05.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.872 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:06:05.936 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:06:05.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.938 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:06:05.995 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:06:05.995 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:06:05.996 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:06:05.996 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:06:05.996 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:06:05.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:05.996 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:06:05.996 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:06:05.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:06:05.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:06:05.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:06:05.996 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:06:06.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:06.100 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:06:06.115 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:06:06.115 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:06:06.115 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:06:06.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:06.115 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:06:06.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:06.180 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:06.234 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:06:06.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:06.234 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:06.288 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:06:06.288 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:06:06.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:06.367 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:06.368 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:06.386 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:06.386 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:06.386 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:06.387 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:06.387 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:06.387 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:06.387 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:06.387 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:06.408 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:06:06.409 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:06:06.409 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:06:06.410 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:06:06.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:06.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:06.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:06.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.596+0000 7f893f3a0700 1 Processor -- start 2023-10-08T16:06:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.596+0000 7f893f3a0700 1 -- start start 2023-10-08T16:06:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893f3a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f893806a060 0x7f89380ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893f3a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893815a030 0x7f89380ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893f3a0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8938068de0 con 0x7f8938159c60 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893f3a0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380b1460 con 0x7f893806a060 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893f3a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380affc0 con 0x7f893815a030 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893db9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f893806a060 0x7f89380ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893db9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f893806a060 0x7f89380ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52482/0 (socket says 172.21.15.60:52482) 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893db9d700 1 -- 172.21.15.60:0/2737326732 learned_addr learned my addr 172.21.15.60:0/2737326732 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.597+0000 7f893e39e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8938159c60 0x7f893815ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53598/0 (socket says 172.21.15.60:53598) 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893eb9f700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893815a030 0x7f89380ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893db9d700 1 -- 172.21.15.60:0/2737326732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893815a030 msgr2=0x7f89380ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893db9d700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893815a030 0x7f89380ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893db9d700 1 -- 172.21.15.60:0/2737326732 >> v1:172.21.15.60:6789/0 conn(0x7f8938159c60 legacy=0x7f893815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893db9d700 1 -- 172.21.15.60:0/2737326732 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380695f0 con 0x7f893806a060 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893d39c700 1 -- 172.21.15.60:0/2737326732 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252294983 0 0) 0x7f8938068de0 con 0x7f8938159c60 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893eb9f700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893815a030 0x7f89380ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893db9d700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893806a060 0x7f89380ce990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f892c0099b0 tx=0x7f892c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb7c3cd4c52890d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893d39c700 1 -- 172.21.15.60:0/2737326732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00b860 con 0x7f893806a060 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893d39c700 1 -- 172.21.15.60:0/2737326732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00b9c0 con 0x7f893806a060 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893d39c700 1 -- 172.21.15.60:0/2737326732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00bd60 con 0x7f893806a060 2023-10-08T16:06:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893f3a0700 1 -- 172.21.15.60:0/2737326732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893806a060 msgr2=0x7f89380ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.598+0000 7f893f3a0700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893806a060 0x7f89380ce990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f892c0099b0 tx=0x7f892c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.599+0000 7f893f3a0700 1 -- 172.21.15.60:0/2737326732 shutdown_connections 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.599+0000 7f893f3a0700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893815a030 0x7f89380ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.599+0000 7f893f3a0700 1 --2- 172.21.15.60:0/2737326732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893806a060 0x7f89380ce990 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.599+0000 7f893f3a0700 1 -- 172.21.15.60:0/2737326732 >> 172.21.15.60:0/2737326732 conn(0x7f893806c740 msgr2=0x7f8938069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.599+0000 7f893f3a0700 1 -- 172.21.15.60:0/2737326732 shutdown_connections 2023-10-08T16:06:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.599+0000 7f893f3a0700 1 -- 172.21.15.60:0/2737326732 wait complete. 2023-10-08T16:06:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.600+0000 7f893f3a0700 1 Processor -- start 2023-10-08T16:06:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.600+0000 7f893f3a0700 1 -- start start 2023-10-08T16:06:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.600+0000 7f893f3a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893806a060 0x7f893814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.600+0000 7f893f3a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8938159c60 0x7f89380b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893f3a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 0x7f893815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893f3a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893814ce10 con 0x7f893815a030 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893f3a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89380b29f0 con 0x7f8938159c60 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893f3a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380b2cd0 con 0x7f893806a060 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 0x7f893815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 0x7f893815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52492/0 (socket says 172.21.15.60:52492) 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 -- 172.21.15.60:0/4239731510 learned_addr learned my addr 172.21.15.60:0/4239731510 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893db9d700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8938159c60 0x7f89380b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 -- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893806a060 msgr2=0x7f893814c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893806a060 0x7f893814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 -- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8938159c60 msgr2=0x7f89380b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8938159c60 0x7f89380b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 -- 172.21.15.60:0/4239731510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c0094f0 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893eb9f700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 0x7f893815a420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f892800cef0 tx=0x7f8928007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800ae00 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928016420 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89380b2fb0 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280167e0 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.601+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89380b3570 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.602+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89380b3760 con 0x7f893815a030 2023-10-08T16:06:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.603+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8928016bd0 con 0x7f893815a030 2023-10-08T16:06:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.603+0000 7f89367fc700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8924066f30 0x7f89240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.603+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8928012070 con 0x7f893815a030 2023-10-08T16:06:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.603+0000 7f893e39e700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8924066f30 0x7f89240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.603+0000 7f893e39e700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8924066f30 0x7f89240693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f89300011e0 tx=0x7f89300079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.607+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f892804e5a0 con 0x7f893815a030 2023-10-08T16:06:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.847+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f893804bb80 con 0x7f893815a030 2023-10-08T16:06:06.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.848+0000 7f89367fc700 1 -- 172.21.15.60:0/4239731510 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f8928052140 con 0x7f893815a030 2023-10-08T16:06:06.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:06.848 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8924066f30 msgr2=0x7f89240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8924066f30 0x7f89240693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f89300011e0 tx=0x7f89300079b0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 msgr2=0x7f893815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 0x7f893815a420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f892800cef0 tx=0x7f8928007860 comp rx=0 tx=0).stop 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 shutdown_connections 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8924066f30 0x7f89240693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f893806a060 0x7f893814c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f893815a030 0x7f893815a420 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 --2- 172.21.15.60:0/4239731510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8938159c60 0x7f89380b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 >> 172.21.15.60:0/4239731510 conn(0x7f893806c740 msgr2=0x7f893814e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:06.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 shutdown_connections 2023-10-08T16:06:06.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:06.850+0000 7f893f3a0700 1 -- 172.21.15.60:0/4239731510 wait complete. 2023-10-08T16:06:06.852 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:06.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T16:06:07.001 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":4944,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.485598328,"mdsmap_epoch":18,"osdmap_epoch":32,"osdmap_epoch_barrier":32,"uptime":23.498887229000001} 2023-10-08T16:06:07.001 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 4944, "mdsmap_epoch": 18, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "rank_uptime": 8.485598328, "state": "up:active", "uptime": 23.498887229, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:06:07.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-08T16:06:07.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.118+0000 7fb12cfdf700 1 Processor -- start 2023-10-08T16:06:07.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.118+0000 7fb12cfdf700 1 -- start start 2023-10-08T16:06:07.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12cfdf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb128152010 0x7fb12815b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12cfdf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1281523e0 0x7fb12806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12cfdf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb128158e50 0x7fb1280cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12cfdf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12806c010 con 0x7fb128152010 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12cfdf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12806bd10 con 0x7fb128158e50 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12cfdf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815c060 con 0x7fb1281523e0 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb128152010 0x7fb12815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb128152010 0x7fb12815b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52502/0 (socket says 172.21.15.60:52502) 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.119+0000 7fb12659c700 1 -- 172.21.15.60:0/2524120145 learned_addr learned my addr 172.21.15.60:0/2524120145 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb126d9d700 1 --2- 172.21.15.60:0/2524120145 >> v2:172.21.15.144:3300/0 conn(0x7fb128158e50 0x7fb1280cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb125d9b700 1 --2- 172.21.15.60:0/2524120145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1281523e0 0x7fb12806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12659c700 1 -- 172.21.15.60:0/2524120145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1281523e0 msgr2=0x7fb12806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12659c700 1 --2- 172.21.15.60:0/2524120145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1281523e0 0x7fb12806c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12659c700 1 -- 172.21.15.60:0/2524120145 >> v2:172.21.15.144:3300/0 conn(0x7fb128158e50 msgr2=0x7fb1280cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12659c700 1 --2- 172.21.15.60:0/2524120145 >> v2:172.21.15.144:3300/0 conn(0x7fb128158e50 0x7fb1280cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12659c700 1 -- 172.21.15.60:0/2524120145 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12815c340 con 0x7fb128152010 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb126d9d700 1 --2- 172.21.15.60:0/2524120145 >> v2:172.21.15.144:3300/0 conn(0x7fb128158e50 0x7fb1280cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12659c700 1 --2- 172.21.15.60:0/2524120145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128152010 0x7fb12815b810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb128155d40 tx=0x7fb120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455c59344e58b2c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12559a700 1 -- 172.21.15.60:0/2524120145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000b860 con 0x7fb128152010 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12559a700 1 -- 172.21.15.60:0/2524120145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000b9c0 con 0x7fb128152010 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.120+0000 7fb12559a700 1 -- 172.21.15.60:0/2524120145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000bd60 con 0x7fb128152010 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2524120145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128152010 msgr2=0x7fb12815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2524120145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128152010 0x7fb12815b810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb128155d40 tx=0x7fb120009250 comp rx=0 tx=0).stop 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2524120145 shutdown_connections 2023-10-08T16:06:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2524120145 >> v2:172.21.15.144:3300/0 conn(0x7fb128158e50 0x7fb1280cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2524120145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128152010 0x7fb12815b810 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2524120145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1281523e0 0x7fb12806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2524120145 >> 172.21.15.60:0/2524120145 conn(0x7fb128069870 msgr2=0x7fb128069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2524120145 shutdown_connections 2023-10-08T16:06:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.121+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2524120145 wait complete. 2023-10-08T16:06:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.122+0000 7fb12cfdf700 1 Processor -- start 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.122+0000 7fb12cfdf700 1 -- start start 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb128152010 0x7fb128155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281523e0 0x7fb1280b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 0x7fb12815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b3980 con 0x7fb128158e50 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b3c60 con 0x7fb1281523e0 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b3f40 con 0x7fb128152010 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 0x7fb12815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb125d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281523e0 0x7fb1280b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 0x7fb12815d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52514/0 (socket says 172.21.15.60:52514) 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 -- 172.21.15.60:0/2335644360 learned_addr learned my addr 172.21.15.60:0/2335644360 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12659c700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb128152010 0x7fb128155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 -- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb128152010 msgr2=0x7fb128155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb128152010 0x7fb128155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 -- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281523e0 msgr2=0x7fb1280b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281523e0 0x7fb1280b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 -- 172.21.15.60:0/2335644360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1200094f0 con 0x7fb128158e50 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb126d9d700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 0x7fb12815d550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb118009fc0 tx=0x7fb1180099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800dbe0 con 0x7fb128158e50 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800f040 con 0x7fb128158e50 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280b4220 con 0x7fb128158e50 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118015440 con 0x7fb128158e50 2023-10-08T16:06:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.123+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1281559d0 con 0x7fb128158e50 2023-10-08T16:06:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.124+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1280b4740 con 0x7fb128158e50 2023-10-08T16:06:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.125+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb11801e3b0 con 0x7fb128158e50 2023-10-08T16:06:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.125+0000 7fb1167fc700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb108066f30 0x7fb1080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.125+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb118084910 con 0x7fb128158e50 2023-10-08T16:06:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.125+0000 7fb12659c700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb108066f30 0x7fb1080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.126+0000 7fb12659c700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb108066f30 0x7fb1080693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb128155d40 tx=0x7fb120017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:07.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.130+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1280b4740 con 0x7fb128158e50 2023-10-08T16:06:07.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.402+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fb1280b4740 con 0x7fb128158e50 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.402+0000 7fb1167fc700 1 -- 172.21.15.60:0/2335644360 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1619 (secure 0 0 0) 0x7fb1280b4740 con 0x7fb128158e50 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 1600000000, 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 1597703536, 2023-10-08T16:06:07.403 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 2296464, 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 2296464, 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.0014352899743244052, 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "num_osds": 8, 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_osds": 0, 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_omap_osds": 0 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "stats_by_class": { 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "hdd": { 2023-10-08T16:06:07.404 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 1600000000, 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 1597703536, 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 2296464, 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 2296464, 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.0014352899743244052 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": ".mgr", 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1, 2023-10-08T16:06:07.405 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 590368, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 2, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 577, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 590368, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0.00052959454478695989, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 557082176 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_metadata", 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4, 2023-10-08T16:06:07.406 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 2566, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 22, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 3, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 2566, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 2.303066139575094e-06, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 557082176 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_data", 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 5, 2023-10-08T16:06:07.407 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 557082176 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.404+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb108066f30 msgr2=0x7fb1080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.404+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb108066f30 0x7fb1080693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb128155d40 tx=0x7fb120017000 comp rx=0 tx=0).stop 2023-10-08T16:06:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.404+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 msgr2=0x7fb12815d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.404+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 0x7fb12815d550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb118009fc0 tx=0x7fb1180099b0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 shutdown_connections 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb108066f30 0x7fb1080693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb128152010 0x7fb128155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb128158e50 0x7fb12815d550 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 --2- 172.21.15.60:0/2335644360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281523e0 0x7fb1280b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 >> 172.21.15.60:0/2335644360 conn(0x7fb128069870 msgr2=0x7fb128151320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 shutdown_connections 2023-10-08T16:06:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.405+0000 7fb12cfdf700 1 -- 172.21.15.60:0/2335644360 wait complete. 2023-10-08T16:06:07.417 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:06:07.417 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:06:07.417 DEBUG:teuthology.orchestra.run.smithi060:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T16:06:07.417 DEBUG:teuthology.orchestra.run.smithi060:> os.fchmod(fd, 0O666) 2023-10-08T16:06:07.417 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(fd) 2023-10-08T16:06:07.418 DEBUG:teuthology.orchestra.run.smithi060:> os.close(fd) 2023-10-08T16:06:07.418 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:06:07.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:07.673 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:06:07.743 INFO:teuthology.orchestra.run.smithi060.stdout:client4790 2023-10-08T16:06:07.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:07.743 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client4790/osdmap') 2023-10-08T16:06:07.820 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 32 barrier 32 flags 0x588000 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:06:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:06:07.822 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:06:07.822 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:06:07.822 INFO:teuthology.orchestra.run.smithi060.stderr:795 bytes copied, 3.6014e-05 s, 22.1 MB/s 2023-10-08T16:06:07.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-08T16:06:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.982+0000 7f9d9565c700 1 Processor -- start 2023-10-08T16:06:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.983+0000 7f9d9565c700 1 -- start start 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.983+0000 7f9d9565c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.983+0000 7f9d9565c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d90159e80 0x7f9d900cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.983+0000 7f9d9565c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9015e1d0 con 0x7f9d900d1360 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.983+0000 7f9d9565c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9015e4b0 con 0x7f9d90159e80 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.983+0000 7f9d9565c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9015e790 con 0x7f9d900cbc70 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d90159e80 0x7f9d900cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d90159e80 0x7f9d900cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52520/0 (socket says 172.21.15.60:52520) 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 -- 172.21.15.60:0/2558768556 learned_addr learned my addr 172.21.15.60:0/2558768556 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8effd700 1 --2- 172.21.15.60:0/2558768556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 -- 172.21.15.60:0/2558768556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 msgr2=0x7f9d9015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 --2- 172.21.15.60:0/2558768556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 -- 172.21.15.60:0/2558768556 >> v1:172.21.15.144:6789/0 conn(0x7f9d900d1360 legacy=0x7f9d90159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 -- 172.21.15.60:0/2558768556 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900ce850 con 0x7f9d90159e80 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8f7fe700 1 --2- 172.21.15.60:0/2558768556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d90159e80 0x7f9d900cf050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9d800099b0 tx=0x7f9d80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae12e564fcdbbdf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8dffb700 1 -- 172.21.15.60:0/2558768556 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80009ea0 con 0x7f9d90159e80 2023-10-08T16:06:07.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8dffb700 1 -- 172.21.15.60:0/2558768556 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8000b860 con 0x7f9d90159e80 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.984+0000 7f9d8dffb700 1 -- 172.21.15.60:0/2558768556 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000bc00 con 0x7f9d90159e80 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 -- 172.21.15.60:0/2558768556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d90159e80 msgr2=0x7f9d900cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 --2- 172.21.15.60:0/2558768556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d90159e80 0x7f9d900cf050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9d800099b0 tx=0x7f9d80009250 comp rx=0 tx=0).stop 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 -- 172.21.15.60:0/2558768556 shutdown_connections 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 --2- 172.21.15.60:0/2558768556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d90159e80 0x7f9d900cf050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 --2- 172.21.15.60:0/2558768556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 -- 172.21.15.60:0/2558768556 >> 172.21.15.60:0/2558768556 conn(0x7f9d90069650 msgr2=0x7f9d900d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 -- 172.21.15.60:0/2558768556 shutdown_connections 2023-10-08T16:06:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.985+0000 7f9d9565c700 1 -- 172.21.15.60:0/2558768556 wait complete. 2023-10-08T16:06:07.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.986+0000 7f9d9565c700 1 Processor -- start 2023-10-08T16:06:07.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.986+0000 7f9d9565c700 1 -- start start 2023-10-08T16:06:07.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d9565c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d9565c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 0x7f9d900c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d9565c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d90159e80 0x7f9d900c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d9565c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9015cad0 con 0x7f9d900d1360 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d9565c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9015cdb0 con 0x7f9d90159e80 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d9565c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900b4980 con 0x7f9d900cbc70 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 0x7f9d900c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 0x7f9d900c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52534/0 (socket says 172.21.15.60:52534) 2023-10-08T16:06:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 -- 172.21.15.60:0/4106169031 learned_addr learned my addr 172.21.15.60:0/4106169031 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8effd700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8f7fe700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d90159e80 0x7f9d900c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 -- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 msgr2=0x7f9d9014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9014b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 -- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d90159e80 msgr2=0x7f9d900c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d90159e80 0x7f9d900c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 -- 172.21.15.60:0/4106169031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800094f0 con 0x7f9d900d1360 2023-10-08T16:06:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.987+0000 7f9d8e7fc700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 0x7f9d900c8420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c590 tx=0x7f9d7800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.988+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78011590 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.988+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78011710 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.988+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d900b4c60 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.988+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78011ad0 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.988+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9014bb60 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.988+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900b5180 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.989+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d7801b3b0 con 0x7f9d900d1360 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.989+0000 7f9d86ffd700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d70066f30 0x7f9d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.989+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d780839c0 con 0x7f9d900d1360 2023-10-08T16:06:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.989+0000 7f9d8effd700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d70066f30 0x7f9d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.990+0000 7f9d8effd700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d70066f30 0x7f9d700693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800f570 tx=0x7f9d8800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:07.994+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d900b5180 con 0x7f9d900d1360 2023-10-08T16:06:08.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.197+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f9d900b5180 con 0x7f9d900d1360 2023-10-08T16:06:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.543+0000 7f9d86ffd700 1 -- 172.21.15.60:0/4106169031 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v33) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9d900b5180 con 0x7f9d900d1360 2023-10-08T16:06:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.545+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d70066f30 msgr2=0x7f9d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.545+0000 7f9d9565c700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d70066f30 0x7f9d700693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800f570 tx=0x7f9d8800b040 comp rx=0 tx=0).stop 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.545+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 msgr2=0x7f9d900c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.545+0000 7f9d9565c700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 0x7f9d900c8420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c590 tx=0x7f9d7800c8a0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 shutdown_connections 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d70066f30 0x7f9d700693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900cbc70 0x7f9d9014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d90159e80 0x7f9d900c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 --2- 172.21.15.60:0/4106169031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900d1360 0x7f9d900c8420 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 >> 172.21.15.60:0/4106169031 conn(0x7f9d90069650 msgr2=0x7f9d900cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 shutdown_connections 2023-10-08T16:06:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.546+0000 7f9d9565c700 1 -- 172.21.15.60:0/4106169031 wait complete. 2023-10-08T16:06:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:pauserd,pausewr is set 2023-10-08T16:06:08.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-08T16:06:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.678+0000 7fe25cfd3700 1 Processor -- start 2023-10-08T16:06:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.678+0000 7fe25cfd3700 1 -- start start 2023-10-08T16:06:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25cfd3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe258156ea0 0x7fe2580c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25cfd3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe258157270 0x7fe25806f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25cfd3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2580c42b0 con 0x7fe25806e2b0 2023-10-08T16:06:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25cfd3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2580c36a0 con 0x7fe258156ea0 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25cfd3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2580c3980 con 0x7fe258157270 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe258156ea0 0x7fe2580c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe258156ea0 0x7fe2580c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52548/0 (socket says 172.21.15.60:52548) 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe256d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe25806e2b0 0x7fe25806e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53608/0 (socket says 172.21.15.60:53608) 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.679+0000 7fe25659c700 1 -- 172.21.15.60:0/3709645863 learned_addr learned my addr 172.21.15.60:0/3709645863 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe255d9b700 1 --2- 172.21.15.60:0/3709645863 >> v2:172.21.15.144:3300/0 conn(0x7fe258157270 0x7fe25806f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25659c700 1 -- 172.21.15.60:0/3709645863 >> v2:172.21.15.144:3300/0 conn(0x7fe258157270 msgr2=0x7fe25806f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25659c700 1 --2- 172.21.15.60:0/3709645863 >> v2:172.21.15.144:3300/0 conn(0x7fe258157270 0x7fe25806f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25659c700 1 -- 172.21.15.60:0/3709645863 >> v1:172.21.15.60:6789/0 conn(0x7fe25806e2b0 legacy=0x7fe25806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25559a700 1 -- 172.21.15.60:0/3709645863 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025622154 0 0) 0x7fe2580c42b0 con 0x7fe25806e2b0 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25659c700 1 -- 172.21.15.60:0/3709645863 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580c3c60 con 0x7fe258156ea0 2023-10-08T16:06:08.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25659c700 1 --2- 172.21.15.60:0/3709645863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258156ea0 0x7fe2580c30c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe25806dd30 tx=0x7fe248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb844b1186c1584 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25559a700 1 -- 172.21.15.60:0/3709645863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248009e70 con 0x7fe258156ea0 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25559a700 1 -- 172.21.15.60:0/3709645863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800b860 con 0x7fe258156ea0 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.680+0000 7fe25559a700 1 -- 172.21.15.60:0/3709645863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800bc00 con 0x7fe258156ea0 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 -- 172.21.15.60:0/3709645863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258156ea0 msgr2=0x7fe2580c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/3709645863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258156ea0 0x7fe2580c30c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe25806dd30 tx=0x7fe248009250 comp rx=0 tx=0).stop 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 -- 172.21.15.60:0/3709645863 shutdown_connections 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/3709645863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258156ea0 0x7fe2580c30c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/3709645863 >> v2:172.21.15.144:3300/0 conn(0x7fe258157270 0x7fe25806f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 -- 172.21.15.60:0/3709645863 >> 172.21.15.60:0/3709645863 conn(0x7fe2580ca4f0 msgr2=0x7fe2580ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 -- 172.21.15.60:0/3709645863 shutdown_connections 2023-10-08T16:06:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.681+0000 7fe25cfd3700 1 -- 172.21.15.60:0/3709645863 wait complete. 2023-10-08T16:06:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.682+0000 7fe25cfd3700 1 Processor -- start 2023-10-08T16:06:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.682+0000 7fe25cfd3700 1 -- start start 2023-10-08T16:06:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25806e2b0 0x7fe25814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe258156ea0 0x7fe258068290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 0x7fe2580687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25815cac0 con 0x7fe258157270 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580711d0 con 0x7fe25806e2b0 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580708a0 con 0x7fe258156ea0 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 0x7fe2580687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 0x7fe2580687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52564/0 (socket says 172.21.15.60:52564) 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 -- 172.21.15.60:0/24457595 learned_addr learned my addr 172.21.15.60:0/24457595 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25659c700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25806e2b0 0x7fe25814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe255d9b700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe258156ea0 0x7fe258068290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 -- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe258156ea0 msgr2=0x7fe258068290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe258156ea0 0x7fe258068290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 -- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25806e2b0 msgr2=0x7fe25814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:08.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25806e2b0 0x7fe25814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480094f0 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe256d9d700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 0x7fe2580687d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe25000cd50 tx=0x7fe250001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250005df0 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000a8b0 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe258070b80 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000ac70 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.683+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe258150480 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.684+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe258071360 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.685+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe250007300 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.685+0000 7fe24e7fc700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe238066f30 0x7fe2380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.685+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe250084620 con 0x7fe258157270 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.685+0000 7fe25659c700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe238066f30 0x7fe2380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:08.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.686+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=34+}) v3 -- 0x7fe23806ea50 con 0x7fe258157270 2023-10-08T16:06:08.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.686+0000 7fe25659c700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe238066f30 0x7fe2380693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe25806dd30 tx=0x7fe248017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:08.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.690+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe250051910 con 0x7fe258157270 2023-10-08T16:06:08.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:08.894+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fe25804c3c0 con 0x7fe258157270 2023-10-08T16:06:09.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.546+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(34..34 src has 1..34) v4 ==== 280+0+0 (secure 0 0 0) 0x7fe250055cd0 con 0x7fe258157270 2023-10-08T16:06:09.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.546+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=35}) v3 -- 0x7fe23806f340 con 0x7fe258157270 2023-10-08T16:06:09.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.548+0000 7fe24e7fc700 1 -- 172.21.15.60:0/24457595 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe250054f30 con 0x7fe258157270 2023-10-08T16:06:09.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe238066f30 msgr2=0x7fe2380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe238066f30 0x7fe2380693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe25806dd30 tx=0x7fe248017000 comp rx=0 tx=0).stop 2023-10-08T16:06:09.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 msgr2=0x7fe2580687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 0x7fe2580687d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe25000cd50 tx=0x7fe250001b10 comp rx=0 tx=0).stop 2023-10-08T16:06:09.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 shutdown_connections 2023-10-08T16:06:09.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe238066f30 0x7fe2380693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe258157270 0x7fe2580687d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25806e2b0 0x7fe25814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 --2- 172.21.15.60:0/24457595 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe258156ea0 0x7fe258068290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.551+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 >> 172.21.15.60:0/24457595 conn(0x7fe2580ca4f0 msgr2=0x7fe2580cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.552+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 shutdown_connections 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.552+0000 7fe25cfd3700 1 -- 172.21.15.60:0/24457595 wait complete. 2023-10-08T16:06:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:pauserd,pausewr is unset 2023-10-08T16:06:09.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:09.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.687+0000 7fd1ae3d6700 1 Processor -- start 2023-10-08T16:06:09.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.687+0000 7fd1ae3d6700 1 -- start start 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1ae3d6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1a815a620 0x7fd1a815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1ae3d6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a815cbb0 con 0x7fd1a815d580 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1ae3d6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a815bfa0 con 0x7fd1a8157870 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1ae3d6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a815bdb0 con 0x7fd1a815a620 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1a815a620 0x7fd1a815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1a815a620 0x7fd1a815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52576/0 (socket says 172.21.15.60:52576) 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1ac973700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd1a815d580 0x7fd1a8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53618/0 (socket says 172.21.15.60:53618) 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 -- 172.21.15.60:0/2040507060 learned_addr learned my addr 172.21.15.60:0/2040507060 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 -- 172.21.15.60:0/2040507060 >> v1:172.21.15.144:6789/0 conn(0x7fd1a8157870 legacy=0x7fd1a815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 -- 172.21.15.60:0/2040507060 >> v1:172.21.15.60:6789/0 conn(0x7fd1a815d580 legacy=0x7fd1a8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 -- 172.21.15.60:0/2040507060 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a815c280 con 0x7fd1a815a620 2023-10-08T16:06:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a77fe700 1 --2- 172.21.15.60:0/2040507060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a815a620 0x7fd1a815d040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0099b0 tx=0x7fd19c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e0a67f6823c7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.688+0000 7fd1a6ffd700 1 -- 172.21.15.60:0/2040507060 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00b820 con 0x7fd1a815a620 2023-10-08T16:06:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1a6ffd700 1 -- 172.21.15.60:0/2040507060 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00b980 con 0x7fd1a815a620 2023-10-08T16:06:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1a6ffd700 1 -- 172.21.15.60:0/2040507060 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00bd20 con 0x7fd1a815a620 2023-10-08T16:06:09.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/2040507060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a815a620 msgr2=0x7fd1a815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/2040507060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a815a620 0x7fd1a815d040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0099b0 tx=0x7fd19c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/2040507060 shutdown_connections 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/2040507060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a815a620 0x7fd1a815d040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/2040507060 >> 172.21.15.60:0/2040507060 conn(0x7fd1a8068ce0 msgr2=0x7fd1a80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/2040507060 shutdown_connections 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.689+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/2040507060 wait complete. 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.690+0000 7fd1ae3d6700 1 Processor -- start 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.690+0000 7fd1ae3d6700 1 -- start start 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ae3d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 0x7fd1a80b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ae3d6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a815a620 0x7fd1a81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ae3d6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1a815d580 0x7fd1a8152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ae3d6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80b1ec0 con 0x7fd1a8157870 2023-10-08T16:06:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ae3d6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80b21a0 con 0x7fd1a815a620 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ae3d6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80b2480 con 0x7fd1a815d580 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 0x7fd1a80b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 0x7fd1a80b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52578/0 (socket says 172.21.15.60:52578) 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1a7fff700 1 -- 172.21.15.60:0/611429117 learned_addr learned my addr 172.21.15.60:0/611429117 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1a77fe700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a815a620 0x7fd1a81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1ac973700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1a815d580 0x7fd1a8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1a7fff700 1 -- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1a815d580 msgr2=0x7fd1a8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.691+0000 7fd1a7fff700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1a815d580 0x7fd1a8152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1a7fff700 1 -- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a815a620 msgr2=0x7fd1a81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1a7fff700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a815a620 0x7fd1a81521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1a7fff700 1 -- 172.21.15.60:0/611429117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0094f0 con 0x7fd1a8157870 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1a77fe700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a815a620 0x7fd1a81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1ac973700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1a815d580 0x7fd1a8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1a7fff700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 0x7fd1a80b1690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c5d0 tx=0x7fd198007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198011590 con 0x7fd1a8157870 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198011710 con 0x7fd1a8157870 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198011ad0 con 0x7fd1a8157870 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a80b2760 con 0x7fd1a8157870 2023-10-08T16:06:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.692+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a80b1bd0 con 0x7fd1a8157870 2023-10-08T16:06:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.693+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80b2c80 con 0x7fd1a8157870 2023-10-08T16:06:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.693+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd19801c460 con 0x7fd1a8157870 2023-10-08T16:06:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.694+0000 7fd18ffff700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd194066f30 0x7fd1940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.694+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd198084330 con 0x7fd1a8157870 2023-10-08T16:06:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.694+0000 7fd1a77fe700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd194066f30 0x7fd1940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.694+0000 7fd1a77fe700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd194066f30 0x7fd1940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0099b0 tx=0x7fd19c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.698+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1a80b2c80 con 0x7fd1a8157870 2023-10-08T16:06:09.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.895+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a80b2c80 con 0x7fd1a8157870 2023-10-08T16:06:09.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.896+0000 7fd18ffff700 1 -- 172.21.15.60:0/611429117 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd1a80b2c80 con 0x7fd1a8157870 2023-10-08T16:06:09.896 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:09.896 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:09.542341+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd194066f30 msgr2=0x7fd1940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd194066f30 0x7fd1940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0099b0 tx=0x7fd19c016000 comp rx=0 tx=0).stop 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 msgr2=0x7fd1a80b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 0x7fd1a80b1690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c5d0 tx=0x7fd198007f60 comp rx=0 tx=0).stop 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 shutdown_connections 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd194066f30 0x7fd1940693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1a815d580 0x7fd1a8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8157870 0x7fd1a80b1690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 --2- 172.21.15.60:0/611429117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a815a620 0x7fd1a81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 >> 172.21.15.60:0/611429117 conn(0x7fd1a8068ce0 msgr2=0x7fd1a8159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 shutdown_connections 2023-10-08T16:06:09.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:09.898+0000 7fd1ae3d6700 1 -- 172.21.15.60:0/611429117 wait complete. 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> os.fchmod(fd, 0O666) 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(fd) 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> os.close(fd) 2023-10-08T16:06:09.911 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:06:10.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:10.166 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:06:10.236 INFO:teuthology.orchestra.run.smithi060.stdout:client4790 2023-10-08T16:06:10.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:10.236 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client4790/osdmap') 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 32 barrier 32 flags 0x588000 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:06:10.314 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:06:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:06:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:06:10.315 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:06:10.315 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:06:10.316 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:06:10.316 INFO:teuthology.orchestra.run.smithi060.stderr:795 bytes copied, 3.7775e-05 s, 21.0 MB/s 2023-10-08T16:06:10.316 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:10.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 Processor -- start 2023-10-08T16:06:10.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 -- start start 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef180cffa0 0x7fef1806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 0x7fef1806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef180b3d40 con 0x7fef18159e60 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef18069d70 con 0x7fef180cffa0 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.476+0000 7fef1ee60700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180b4300 con 0x7fef1815a230 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef1d3fd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 0x7fef1806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef180cffa0 0x7fef1806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef180cffa0 0x7fef1806a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:47550/0 (socket says 172.21.15.60:47550) 2023-10-08T16:06:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 -- 172.21.15.60:0/4180518986 learned_addr learned my addr 172.21.15.60:0/4180518986 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef1d3fd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 0x7fef1806abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:36818/0 (socket says 172.21.15.60:36818) 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef1cbfc700 1 --1- 172.21.15.60:0/4180518986 >> v1:172.21.15.144:6789/0 conn(0x7fef18159e60 0x7fef180b6890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:33816/0 (socket says 172.21.15.60:33816) 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 -- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 msgr2=0x7fef1806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 --2- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 0x7fef1806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 -- 172.21.15.60:0/4180518986 >> v1:172.21.15.144:6789/0 conn(0x7fef18159e60 legacy=0x7fef180b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 -- 172.21.15.60:0/4180518986 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180d0480 con 0x7fef180cffa0 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef1d3fd700 1 --2- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 0x7fef1806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.477+0000 7fef17fff700 1 --2- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef1806a6a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0099b0 tx=0x7fef0c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90043b59cb9a9549 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef177fe700 1 -- 172.21.15.60:0/4180518986 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c009ea0 con 0x7fef180cffa0 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef177fe700 1 -- 172.21.15.60:0/4180518986 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c00b860 con 0x7fef180cffa0 2023-10-08T16:06:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef177fe700 1 -- 172.21.15.60:0/4180518986 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00bc00 con 0x7fef180cffa0 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 -- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 msgr2=0x7fef1806a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 --2- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef1806a6a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0099b0 tx=0x7fef0c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 -- 172.21.15.60:0/4180518986 shutdown_connections 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 --2- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef1815a230 0x7fef1806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 --2- 172.21.15.60:0/4180518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef1806a6a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 -- 172.21.15.60:0/4180518986 >> 172.21.15.60:0/4180518986 conn(0x7fef180d1a50 msgr2=0x7fef18068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 -- 172.21.15.60:0/4180518986 shutdown_connections 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.478+0000 7fef1ee60700 1 -- 172.21.15.60:0/4180518986 wait complete. 2023-10-08T16:06:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.479+0000 7fef1ee60700 1 Processor -- start 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 -- start start 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef18158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef18159e60 0x7fef180c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 0x7fef18154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef181562b0 con 0x7fef1815a230 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18156500 con 0x7fef180cffa0 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1ee60700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef181567e0 con 0x7fef18159e60 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1d3fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 0x7fef18154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1d3fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 0x7fef18154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52584/0 (socket says 172.21.15.60:52584) 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.480+0000 7fef1d3fd700 1 -- 172.21.15.60:0/2773947014 learned_addr learned my addr 172.21.15.60:0/2773947014 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef17fff700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef18159e60 0x7fef180c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1cbfc700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef18158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1d3fd700 1 -- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef18159e60 msgr2=0x7fef180c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1d3fd700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef18159e60 0x7fef180c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1d3fd700 1 -- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 msgr2=0x7fef18158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1d3fd700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef18158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1d3fd700 1 -- 172.21.15.60:0/2773947014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009420 con 0x7fef1815a230 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef17fff700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef18159e60 0x7fef180c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1d3fd700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 0x7fef18154c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fef0800ea20 tx=0x7fef080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800c850 con 0x7fef1815a230 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0800c9b0 con 0x7fef1815a230 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800cd70 con 0x7fef1815a230 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c0094f0 con 0x7fef1815a230 2023-10-08T16:06:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.481+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef18156da0 con 0x7fef1815a230 2023-10-08T16:06:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.482+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18156f90 con 0x7fef1815a230 2023-10-08T16:06:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.483+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef08013680 con 0x7fef1815a230 2023-10-08T16:06:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.483+0000 7fef14ff9700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef04066f30 0x7fef040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.483+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef08084610 con 0x7fef1815a230 2023-10-08T16:06:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.483+0000 7fef1cbfc700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef04066f30 0x7fef040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.484+0000 7fef1cbfc700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef04066f30 0x7fef040693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef10001f80 tx=0x7fef10005cd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.487+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef08051880 con 0x7fef1815a230 2023-10-08T16:06:10.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.729+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef1804c3c0 con 0x7fef1815a230 2023-10-08T16:06:10.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.730+0000 7fef14ff9700 1 -- 172.21.15.60:0/2773947014 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fef08054ea0 con 0x7fef1815a230 2023-10-08T16:06:10.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:10.730 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:10.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.731+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef04066f30 msgr2=0x7fef040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:10.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.731+0000 7fef1ee60700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef04066f30 0x7fef040693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef10001f80 tx=0x7fef10005cd0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.731+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 msgr2=0x7fef18154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.731+0000 7fef1ee60700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 0x7fef18154c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fef0800ea20 tx=0x7fef080091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 shutdown_connections 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef04066f30 0x7fef040693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1815a230 0x7fef18154c10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef180cffa0 0x7fef18158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 --2- 172.21.15.60:0/2773947014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef18159e60 0x7fef180c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 >> 172.21.15.60:0/2773947014 conn(0x7fef180d1a50 msgr2=0x7fef18068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 shutdown_connections 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:10.732+0000 7fef1ee60700 1 -- 172.21.15.60:0/2773947014 wait complete. 2023-10-08T16:06:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:10.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 34 2023-10-08T16:06:10.880 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-08T16:06:10.880 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:06:10.880 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:06:10.880 DEBUG:teuthology.orchestra.run.smithi060:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T16:06:10.880 DEBUG:teuthology.orchestra.run.smithi060:> os.fchmod(fd, 0O666) 2023-10-08T16:06:10.880 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(fd) 2023-10-08T16:06:10.881 DEBUG:teuthology.orchestra.run.smithi060:> os.close(fd) 2023-10-08T16:06:10.881 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:06:11.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:11.135 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:06:11.205 INFO:teuthology.orchestra.run.smithi060.stdout:client4790 2023-10-08T16:06:11.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:11.206 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client4790/osdmap') 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 34 barrier 34 flags 0x588000 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:06:11.283 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:06:11.284 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:06:11.284 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:06:11.284 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:06:11.284 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:06:11.284 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:06:11.285 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:06:11.285 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:06:11.285 INFO:teuthology.orchestra.run.smithi060.stderr:795 bytes copied, 3.6578e-05 s, 21.7 MB/s 2023-10-08T16:06:11.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:11.285 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:06:11.354 INFO:teuthology.orchestra.run.smithi060.stdout:client4790 2023-10-08T16:06:11.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:11.354 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client4790/osdmap') 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 34 barrier 34 flags 0x588000 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:06:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:06:11.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:06:11.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:06:11.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:06:11.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:06:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:06:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:06:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:795 bytes copied, 4.091e-05 s, 19.4 MB/s 2023-10-08T16:06:11.433 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:06:11.433 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:06:11.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:06:11.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:06:11.551 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:06:11.551 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:06:11.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:11.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:11.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:06:11.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:11.601 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:06:11.623 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:06:11.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:11.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:11.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:06:11.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:11.666 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:06:11.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.840+0000 7f7b0ea15700 1 Processor -- start 2023-10-08T16:06:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.840+0000 7f7b0ea15700 1 -- start start 2023-10-08T16:06:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b0ea15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0806f1a0 0x7f7b080c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b0ea15700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b080b0160 0x7f7b08070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b0ea15700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b080ca270 con 0x7f7b080afd90 2023-10-08T16:06:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b0ea15700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080c87c0 con 0x7f7b080b0160 2023-10-08T16:06:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b0ea15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0806e3e0 con 0x7f7b0806f1a0 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b0cfb2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b080b0160 0x7f7b08070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b07fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7b080afd90 0x7f7b0815b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53632/0 (socket says 172.21.15.60:53632) 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.841+0000 7f7b07fff700 1 -- 172.21.15.60:0/2708022213 learned_addr learned my addr 172.21.15.60:0/2708022213 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b0cfb2700 1 -- 172.21.15.60:0/2708022213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0806f1a0 msgr2=0x7f7b080c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b077fe700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0806f1a0 0x7f7b080c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b06ffd700 1 -- 172.21.15.60:0/2708022213 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418013930 0 0) 0x7f7b080ca270 con 0x7f7b080afd90 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b0cfb2700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0806f1a0 0x7f7b080c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b0cfb2700 1 -- 172.21.15.60:0/2708022213 >> v1:172.21.15.60:6789/0 conn(0x7f7b080afd90 legacy=0x7f7b0815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b0cfb2700 1 -- 172.21.15.60:0/2708022213 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0806e6c0 con 0x7f7b080b0160 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b077fe700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0806f1a0 0x7f7b080c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b0cfb2700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b080b0160 0x7f7b08070700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009e60 tx=0x7f7b00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419e93571d3d660e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b06ffd700 1 -- 172.21.15.60:0/2708022213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000e070 con 0x7f7b080b0160 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b06ffd700 1 -- 172.21.15.60:0/2708022213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000bc30 con 0x7f7b080b0160 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.842+0000 7f7b06ffd700 1 -- 172.21.15.60:0/2708022213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00012430 con 0x7f7b080b0160 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 -- 172.21.15.60:0/2708022213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b080b0160 msgr2=0x7f7b08070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b080b0160 0x7f7b08070700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009e60 tx=0x7f7b00009780 comp rx=0 tx=0).stop 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 -- 172.21.15.60:0/2708022213 shutdown_connections 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b080b0160 0x7f7b08070700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/2708022213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0806f1a0 0x7f7b080c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 -- 172.21.15.60:0/2708022213 >> 172.21.15.60:0/2708022213 conn(0x7f7b080ca4f0 msgr2=0x7f7b080ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 -- 172.21.15.60:0/2708022213 shutdown_connections 2023-10-08T16:06:11.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.843+0000 7f7b0ea15700 1 -- 172.21.15.60:0/2708022213 wait complete. 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.844+0000 7f7b0ea15700 1 Processor -- start 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.844+0000 7f7b0ea15700 1 -- start start 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 0x7f7b08157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b080afd90 0x7f7b080c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b080b0160 0x7f7b0815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080c6aa0 con 0x7f7b0806f1a0 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080c5e90 con 0x7f7b080b0160 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080c6170 con 0x7f7b080afd90 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 0x7f7b08157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 0x7f7b08157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52590/0 (socket says 172.21.15.60:52590) 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 -- 172.21.15.60:0/3694379094 learned_addr learned my addr 172.21.15.60:0/3694379094 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b077fe700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b080afd90 0x7f7b080c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0cfb2700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b080b0160 0x7f7b0815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 -- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b080afd90 msgr2=0x7f7b080c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b080afd90 0x7f7b080c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 -- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b080b0160 msgr2=0x7f7b0815fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b080b0160 0x7f7b0815fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 -- 172.21.15.60:0/3694379094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009a20 con 0x7f7b0806f1a0 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b07fff700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 0x7f7b08157490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c7e0 tx=0x7f7af8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8005b30 con 0x7f7b0806f1a0 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8005c90 con 0x7f7b0806f1a0 2023-10-08T16:06:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b080c6450 con 0x7f7b0806f1a0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.845+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8007300 con 0x7f7b0806f1a0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.846+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b081579d0 con 0x7f7b0806f1a0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.846+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0804c3c0 con 0x7f7b0806f1a0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.847+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7af80076b0 con 0x7f7b0806f1a0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.847+0000 7f7aeffff700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7af4066f30 0x7f7af40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.847+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7af8083a90 con 0x7f7b0806f1a0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.848+0000 7f7b077fe700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7af4066f30 0x7f7af40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.848+0000 7f7b077fe700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7af4066f30 0x7f7af40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b08159fa0 tx=0x7f7afc006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:11.852+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7af8050d00 con 0x7f7b0806f1a0 2023-10-08T16:06:12.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.088+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b080b0ca0 con 0x7f7b0806f1a0 2023-10-08T16:06:12.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.089+0000 7f7aeffff700 1 -- 172.21.15.60:0/3694379094 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f7af8017090 con 0x7f7b0806f1a0 2023-10-08T16:06:12.089 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:12.089 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:12.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7af4066f30 msgr2=0x7f7af40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7af4066f30 0x7f7af40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b08159fa0 tx=0x7f7afc006f90 comp rx=0 tx=0).stop 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 msgr2=0x7f7b08157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 0x7f7b08157490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c7e0 tx=0x7f7af8007df0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 shutdown_connections 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7af4066f30 0x7f7af40693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b080b0160 0x7f7b0815fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b0806f1a0 0x7f7b08157490 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 --2- 172.21.15.60:0/3694379094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b080afd90 0x7f7b080c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 >> 172.21.15.60:0/3694379094 conn(0x7f7b080ca4f0 msgr2=0x7f7b08070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 shutdown_connections 2023-10-08T16:06:12.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.091+0000 7f7b0ea15700 1 -- 172.21.15.60:0/3694379094 wait complete. 2023-10-08T16:06:12.093 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:12.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.221+0000 7ff7c0317700 1 Processor -- start 2023-10-08T16:06:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.221+0000 7ff7c0317700 1 -- start start 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7c0317700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7b815a620 0x7ff7b815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7c0317700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815d580 0x7ff7b8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7c0317700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b815cbb0 con 0x7ff7b8157870 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7c0317700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b815bdb0 con 0x7ff7b815a620 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7c0317700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b815bfa0 con 0x7ff7b815d580 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7be8b4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815d580 0x7ff7b8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7bd8b2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7b815a620 0x7ff7b815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7bd8b2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7b815a620 0x7ff7b815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:47586/0 (socket says 172.21.15.60:47586) 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7bd8b2700 1 -- 172.21.15.60:0/4258328272 learned_addr learned my addr 172.21.15.60:0/4258328272 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7be8b4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815d580 0x7ff7b8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:36854/0 (socket says 172.21.15.60:36854) 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.222+0000 7ff7be0b3700 1 --1- 172.21.15.60:0/4258328272 >> v1:172.21.15.144:6789/0 conn(0x7ff7b8157870 0x7ff7b815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:33822/0 (socket says 172.21.15.60:33822) 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd8b2700 1 -- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815d580 msgr2=0x7ff7b8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd8b2700 1 --2- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815d580 0x7ff7b8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd8b2700 1 -- 172.21.15.60:0/4258328272 >> v1:172.21.15.144:6789/0 conn(0x7ff7b8157870 legacy=0x7ff7b815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd8b2700 1 -- 172.21.15.60:0/4258328272 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b815c280 con 0x7ff7b815a620 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd0b1700 1 -- 172.21.15.60:0/4258328272 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137443967 0 0) 0x7ff7b815cbb0 con 0x7ff7b8157870 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd8b2700 1 --2- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b815a620 0x7ff7b815d040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0099b0 tx=0x7ff7ac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22afc731f9c161e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd0b1700 1 -- 172.21.15.60:0/4258328272 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac009ea0 con 0x7ff7b815a620 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd0b1700 1 -- 172.21.15.60:0/4258328272 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00b860 con 0x7ff7b815a620 2023-10-08T16:06:12.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7bd0b1700 1 -- 172.21.15.60:0/4258328272 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00bc00 con 0x7ff7b815a620 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7c0317700 1 -- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b815a620 msgr2=0x7ff7b815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.223+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b815a620 0x7ff7b815d040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0099b0 tx=0x7ff7ac009250 comp rx=0 tx=0).stop 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.224+0000 7ff7c0317700 1 -- 172.21.15.60:0/4258328272 shutdown_connections 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.224+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815d580 0x7ff7b8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.224+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4258328272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b815a620 0x7ff7b815d040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.224+0000 7ff7c0317700 1 -- 172.21.15.60:0/4258328272 >> 172.21.15.60:0/4258328272 conn(0x7ff7b8068ce0 msgr2=0x7ff7b80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.224+0000 7ff7c0317700 1 -- 172.21.15.60:0/4258328272 shutdown_connections 2023-10-08T16:06:12.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.224+0000 7ff7c0317700 1 -- 172.21.15.60:0/4258328272 wait complete. 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.225+0000 7ff7c0317700 1 Processor -- start 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.225+0000 7ff7c0317700 1 -- start start 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.225+0000 7ff7c0317700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b8157870 0x7ff7b814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.225+0000 7ff7c0317700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 0x7ff7b80d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7c0317700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 0x7ff7b80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7c0317700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816b9e0 con 0x7ff7b815d580 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7c0317700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816c800 con 0x7ff7b8157870 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7c0317700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816bbf0 con 0x7ff7b815a620 2023-10-08T16:06:12.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 0x7ff7b80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7bd8b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 0x7ff7b80d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 0x7ff7b80b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52600/0 (socket says 172.21.15.60:52600) 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 -- 172.21.15.60:0/4100652719 learned_addr learned my addr 172.21.15.60:0/4100652719 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7bd8b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 0x7ff7b80d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:36856/0 (socket says 172.21.15.60:36856) 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be0b3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b8157870 0x7ff7b814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 -- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 msgr2=0x7ff7b80d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 0x7ff7b80d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 -- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b8157870 msgr2=0x7ff7b814a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b8157870 0x7ff7b814a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 -- 172.21.15.60:0/4100652719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0094f0 con 0x7ff7b815d580 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7bd8b2700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 0x7ff7b80d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:12.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7be8b4700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 0x7ff7b80b53d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e900 tx=0x7ff7b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0013680 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0013800 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b816bed0 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0013bc0 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.226+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b816c490 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.227+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b816c970 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.228+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7b00123d0 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.228+0000 7ff7b67fc700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff7a4066f30 0x7ff7a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.228+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7b0084600 con 0x7ff7b815d580 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.228+0000 7ff7be0b3700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff7a4066f30 0x7ff7a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.229+0000 7ff7be0b3700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff7a4066f30 0x7ff7a40693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8001560 tx=0x7ff7a8001b00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.232+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7b0051870 con 0x7ff7b815d580 2023-10-08T16:06:12.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.424+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b804c3c0 con 0x7ff7b815d580 2023-10-08T16:06:12.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.425+0000 7ff7b67fc700 1 -- 172.21.15.60:0/4100652719 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff7b0054e90 con 0x7ff7b815d580 2023-10-08T16:06:12.426 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:12.426 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:09.542341+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff7a4066f30 msgr2=0x7ff7a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff7a4066f30 0x7ff7a40693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8001560 tx=0x7ff7a8001b00 comp rx=0 tx=0).stop 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 msgr2=0x7ff7b80b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 0x7ff7b80b53d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e900 tx=0x7ff7b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 shutdown_connections 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff7a4066f30 0x7ff7a40693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7b815d580 0x7ff7b80b53d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7b8157870 0x7ff7b814a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 --2- 172.21.15.60:0/4100652719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7b815a620 0x7ff7b80d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 >> 172.21.15.60:0/4100652719 conn(0x7ff7b8068ce0 msgr2=0x7ff7b814c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:12.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 shutdown_connections 2023-10-08T16:06:12.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.427+0000 7ff7c0317700 1 -- 172.21.15.60:0/4100652719 wait complete. 2023-10-08T16:06:12.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:05:55.725378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:05:56.877819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:06:12.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:06:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.561+0000 7f252d68b700 1 Processor -- start 2023-10-08T16:06:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f252d68b700 1 -- start start 2023-10-08T16:06:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f252d68b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2528143380 0x7f2528069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f252d68b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2528070e10 0x7f252806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f252d68b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252806aa00 con 0x7f2528143750 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f252d68b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252815da40 con 0x7f2528143380 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f252d68b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252815dd20 con 0x7f2528070e10 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.562+0000 7f2527fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2528143380 0x7f2528069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2528143380 0x7f2528069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48280/0 (socket says 172.21.15.60:48280) 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 -- 172.21.15.60:0/3400125151 learned_addr learned my addr 172.21.15.60:0/3400125151 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f252ce8a700 1 --2- 172.21.15.60:0/3400125151 >> v2:172.21.15.144:3300/0 conn(0x7f2528070e10 0x7f252806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 -- 172.21.15.60:0/3400125151 >> v2:172.21.15.144:3300/0 conn(0x7f2528070e10 msgr2=0x7f252806a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 --2- 172.21.15.60:0/3400125151 >> v2:172.21.15.144:3300/0 conn(0x7f2528070e10 0x7f252806a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 -- 172.21.15.60:0/3400125151 >> v1:172.21.15.144:6789/0 conn(0x7f2528143750 legacy=0x7f2528070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 -- 172.21.15.60:0/3400125151 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252815e000 con 0x7f2528143380 2023-10-08T16:06:12.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2527fff700 1 --2- 172.21.15.60:0/3400125151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143380 0x7f2528069e20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2528071760 tx=0x7f251c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8983d96838c952 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2526ffd700 1 -- 172.21.15.60:0/3400125151 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00b820 con 0x7f2528143380 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2526ffd700 1 -- 172.21.15.60:0/3400125151 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c00b980 con 0x7f2528143380 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.563+0000 7f2526ffd700 1 -- 172.21.15.60:0/3400125151 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00bd20 con 0x7f2528143380 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 -- 172.21.15.60:0/3400125151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143380 msgr2=0x7f2528069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 --2- 172.21.15.60:0/3400125151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143380 0x7f2528069e20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2528071760 tx=0x7f251c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 -- 172.21.15.60:0/3400125151 shutdown_connections 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 --2- 172.21.15.60:0/3400125151 >> v2:172.21.15.144:3300/0 conn(0x7f2528070e10 0x7f252806a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 --2- 172.21.15.60:0/3400125151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143380 0x7f2528069e20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 -- 172.21.15.60:0/3400125151 >> 172.21.15.60:0/3400125151 conn(0x7f25280cd900 msgr2=0x7f25280cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 -- 172.21.15.60:0/3400125151 shutdown_connections 2023-10-08T16:06:12.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.564+0000 7f252d68b700 1 -- 172.21.15.60:0/3400125151 wait complete. 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.565+0000 7f252d68b700 1 Processor -- start 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.565+0000 7f252d68b700 1 -- start start 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252d68b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2528070e10 0x7f25281404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252d68b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2528143380 0x7f25280aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252d68b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 0x7f25280aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252d68b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252815c610 con 0x7f2528143750 2023-10-08T16:06:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252d68b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252815ba00 con 0x7f2528143380 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252d68b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252815bce0 con 0x7f2528070e10 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 0x7f25280aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 0x7f25280aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48290/0 (socket says 172.21.15.60:48290) 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 -- 172.21.15.60:0/1048767125 learned_addr learned my addr 172.21.15.60:0/1048767125 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f2527fff700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2528070e10 0x7f25281404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f25277fe700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2528143380 0x7f25280aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 -- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2528070e10 msgr2=0x7f25281404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2528070e10 0x7f25281404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 -- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2528143380 msgr2=0x7f25280aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2528143380 0x7f25280aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 -- 172.21.15.60:0/1048767125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0094f0 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.566+0000 7f252ce8a700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 0x7f25280aae20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f252000ce80 tx=0x7f2520007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.567+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252000acc0 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.567+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252000ae20 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.567+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252815bfc0 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.567+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520016680 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.567+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252815caa0 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.568+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252815c7c0 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.568+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2520003020 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.568+0000 7f250ffff700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2514066f60 0x7f2514069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.569+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2520012070 con 0x7f2528143750 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.569+0000 7f2527fff700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2514066f60 0x7f2514069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.569+0000 7f2527fff700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2514066f60 0x7f2514069410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2528071760 tx=0x7f251c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.573+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25200524b0 con 0x7f2528143750 2023-10-08T16:06:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.766+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f252804bb80 con 0x7f2528143750 2023-10-08T16:06:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.767+0000 7f250ffff700 1 -- 172.21.15.60:0/1048767125 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2520055ad0 con 0x7f2528143750 2023-10-08T16:06:12.767 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:06:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2514066f60 msgr2=0x7f2514069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2514066f60 0x7f2514069410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2528071760 tx=0x7f251c016000 comp rx=0 tx=0).stop 2023-10-08T16:06:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 msgr2=0x7f25280aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 0x7f25280aae20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f252000ce80 tx=0x7f2520007840 comp rx=0 tx=0).stop 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 shutdown_connections 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2514066f60 0x7f2514069410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2528070e10 0x7f25281404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2528143750 0x7f25280aae20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 --2- 172.21.15.60:0/1048767125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2528143380 0x7f25280aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 >> 172.21.15.60:0/1048767125 conn(0x7f25280cd900 msgr2=0x7f25281423c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 shutdown_connections 2023-10-08T16:06:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.769+0000 7f252d68b700 1 -- 172.21.15.60:0/1048767125 wait complete. 2023-10-08T16:06:12.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:06:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.903+0000 7fd7c7fa6700 1 Processor -- start 2023-10-08T16:06:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.903+0000 7fd7c7fa6700 1 -- start start 2023-10-08T16:06:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c7fa6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c015a730 0x7fd7c00caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c7fa6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd7c00abce0 0x7fd7c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c7fa6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c00c3430 con 0x7fd7c00ab910 2023-10-08T16:06:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c7fa6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c00c9100 con 0x7fd7c00abce0 2023-10-08T16:06:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c7fa6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0158050 con 0x7fd7c015a730 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c6543700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd7c00abce0 0x7fd7c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c5d42700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd7c00ab910 0x7fd7c00c2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37546/0 (socket says 172.21.15.60:37546) 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c5d42700 1 -- 172.21.15.60:0/2535973508 learned_addr learned my addr 172.21.15.60:0/2535973508 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c6543700 1 -- 172.21.15.60:0/2535973508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c015a730 msgr2=0x7fd7c00caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c6543700 1 --2- 172.21.15.60:0/2535973508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c015a730 0x7fd7c00caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c6543700 1 -- 172.21.15.60:0/2535973508 >> v1:172.21.15.60:6789/0 conn(0x7fd7c00ab910 legacy=0x7fd7c00c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c6543700 1 -- 172.21.15.60:0/2535973508 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c015abc0 con 0x7fd7c00abce0 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.904+0000 7fd7c4d40700 1 -- 172.21.15.60:0/2535973508 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312789982 0 0) 0x7fd7c00c3430 con 0x7fd7c00ab910 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c6543700 1 --2- 172.21.15.60:0/2535973508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c00cb970 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009e90 tx=0x7fd7b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af822c3ad845bb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c4d40700 1 -- 172.21.15.60:0/2535973508 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000e070 con 0x7fd7c00abce0 2023-10-08T16:06:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c4d40700 1 -- 172.21.15.60:0/2535973508 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000bbf0 con 0x7fd7c00abce0 2023-10-08T16:06:12.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c4d40700 1 -- 172.21.15.60:0/2535973508 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0012430 con 0x7fd7c00abce0 2023-10-08T16:06:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/2535973508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 msgr2=0x7fd7c00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/2535973508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c00cb970 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009e90 tx=0x7fd7b0009780 comp rx=0 tx=0).stop 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/2535973508 shutdown_connections 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/2535973508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c00cb970 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/2535973508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c015a730 0x7fd7c00caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/2535973508 >> 172.21.15.60:0/2535973508 conn(0x7fd7c0067660 msgr2=0x7fd7c0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/2535973508 shutdown_connections 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.905+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/2535973508 wait complete. 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.906+0000 7fd7c7fa6700 1 Processor -- start 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 -- start start 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c00ab910 0x7fd7c006a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7c015a730 0x7fd7c00ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c006b400 con 0x7fd7c00abce0 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c006ab40 con 0x7fd7c015a730 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c7fa6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c006ae40 con 0x7fd7c00ab910 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c5541700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c5541700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c01529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48312/0 (socket says 172.21.15.60:48312) 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.907+0000 7fd7c5541700 1 -- 172.21.15.60:0/73777772 learned_addr learned my addr 172.21.15.60:0/73777772 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c5541700 1 -- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c00ab910 msgr2=0x7fd7c006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c5541700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c00ab910 0x7fd7c006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c5541700 1 -- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7c015a730 msgr2=0x7fd7c00ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:12.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c6543700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7c015a730 0x7fd7c00ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c5541700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7c015a730 0x7fd7c00ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c5541700 1 -- 172.21.15.60:0/73777772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0009a20 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c6543700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7c015a730 0x7fd7c00ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c5541700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c01529f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400b810 tx=0x7fd7b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400f5f0 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400f770 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c006b120 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400fb30 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.908+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c0152f30 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.909+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00b22d0 con 0x7fd7c00abce0 2023-10-08T16:06:12.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.910+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7b4010480 con 0x7fd7c00abce0 2023-10-08T16:06:12.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.910+0000 7fd7bdffb700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7ac066f60 0x7fd7ac069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:12.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.910+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7b4084450 con 0x7fd7c00abce0 2023-10-08T16:06:12.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.910+0000 7fd7c5d42700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7ac066f60 0x7fd7ac069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:12.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.910+0000 7fd7c5d42700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7ac066f60 0x7fd7ac069410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0157870 tx=0x7fd7b8007bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:12.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:12.914+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7c00b22d0 con 0x7fd7c00abce0 2023-10-08T16:06:13.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.106+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7c00b22d0 con 0x7fd7c00abce0 2023-10-08T16:06:13.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.107+0000 7fd7bdffb700 1 -- 172.21.15.60:0/73777772 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7c00b22d0 con 0x7fd7c00abce0 2023-10-08T16:06:13.107 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:06:13.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7ac066f60 msgr2=0x7fd7ac069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7ac066f60 0x7fd7ac069410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0157870 tx=0x7fd7b8007bd0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 msgr2=0x7fd7c01529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c01529f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400b810 tx=0x7fd7b4009250 comp rx=0 tx=0).stop 2023-10-08T16:06:13.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 shutdown_connections 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7ac066f60 0x7fd7ac069410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7c00ab910 0x7fd7c006a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.108+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7c015a730 0x7fd7c00ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.109+0000 7fd7c7fa6700 1 --2- 172.21.15.60:0/73777772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c00abce0 0x7fd7c01529f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.109+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 >> 172.21.15.60:0/73777772 conn(0x7fd7c0067660 msgr2=0x7fd7c006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.109+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 shutdown_connections 2023-10-08T16:06:13.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.109+0000 7fd7c7fa6700 1 -- 172.21.15.60:0/73777772 wait complete. 2023-10-08T16:06:13.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:06:13.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.242+0000 7f21dacef700 1 Processor -- start 2023-10-08T16:06:13.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.242+0000 7f21dacef700 1 -- start start 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21dacef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21d40b4860 0x7f21d40b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21dacef700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f21d40b4c30 0x7f21d4159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21dacef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d4159fd0 0x7f21d40cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21dacef700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40b14f0 con 0x7f21d40b4860 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21dacef700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40b17d0 con 0x7f21d40b4c30 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21dacef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b1ab0 con 0x7f21d4159fd0 2023-10-08T16:06:13.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21d40b4860 0x7f21d40b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21d40b4860 0x7f21d40b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48322/0 (socket says 172.21.15.60:48322) 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 -- 172.21.15.60:0/159793246 learned_addr learned my addr 172.21.15.60:0/159793246 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d3fff700 1 --2- 172.21.15.60:0/159793246 >> v2:172.21.15.144:3300/0 conn(0x7f21d40b4c30 0x7f21d4159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d928c700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d4159fd0 0x7f21d40cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 -- 172.21.15.60:0/159793246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d4159fd0 msgr2=0x7f21d40cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d4159fd0 0x7f21d40cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 -- 172.21.15.60:0/159793246 >> v2:172.21.15.144:3300/0 conn(0x7f21d40b4c30 msgr2=0x7f21d4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 --2- 172.21.15.60:0/159793246 >> v2:172.21.15.144:3300/0 conn(0x7f21d40b4c30 0x7f21d4159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 -- 172.21.15.60:0/159793246 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40b1d90 con 0x7f21d40b4860 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d928c700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d4159fd0 0x7f21d40cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d3fff700 1 --2- 172.21.15.60:0/159793246 >> v2:172.21.15.144:3300/0 conn(0x7f21d40b4c30 0x7f21d4159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.243+0000 7f21d8a8b700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d40b6700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21d40899c0 tx=0x7f21c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f66cd49aecd0db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21d37fe700 1 -- 172.21.15.60:0/159793246 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c400e070 con 0x7f21d40b4860 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21d37fe700 1 -- 172.21.15.60:0/159793246 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c400bb30 con 0x7f21d40b4860 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21d37fe700 1 -- 172.21.15.60:0/159793246 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40092e0 con 0x7f21d40b4860 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 -- 172.21.15.60:0/159793246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 msgr2=0x7f21d40b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d40b6700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21d40899c0 tx=0x7f21c4009840 comp rx=0 tx=0).stop 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 -- 172.21.15.60:0/159793246 shutdown_connections 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d4159fd0 0x7f21d40cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 --2- 172.21.15.60:0/159793246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d40b6700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 --2- 172.21.15.60:0/159793246 >> v2:172.21.15.144:3300/0 conn(0x7f21d40b4c30 0x7f21d4159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 -- 172.21.15.60:0/159793246 >> 172.21.15.60:0/159793246 conn(0x7f21d409a0f0 msgr2=0x7f21d4067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:13.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 -- 172.21.15.60:0/159793246 shutdown_connections 2023-10-08T16:06:13.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.244+0000 7f21dacef700 1 -- 172.21.15.60:0/159793246 wait complete. 2023-10-08T16:06:13.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.245+0000 7f21dacef700 1 Processor -- start 2023-10-08T16:06:13.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 -- start start 2023-10-08T16:06:13.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d409bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d40b4c30 0x7f21d416d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d4159fd0 0x7f21d416d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d409c070 con 0x7f21d40b4860 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d409c2a0 con 0x7f21d4159fd0 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21dacef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d409c580 con 0x7f21d40b4c30 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21d8a8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d409bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21d8a8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d409bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48336/0 (socket says 172.21.15.60:48336) 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.246+0000 7f21d8a8b700 1 -- 172.21.15.60:0/3376632389 learned_addr learned my addr 172.21.15.60:0/3376632389 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d8a8b700 1 -- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d40b4c30 msgr2=0x7f21d416d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d8a8b700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d40b4c30 0x7f21d416d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d8a8b700 1 -- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d4159fd0 msgr2=0x7f21d416d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d928c700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d4159fd0 0x7f21d416d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d8a8b700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d4159fd0 0x7f21d416d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d8a8b700 1 -- 172.21.15.60:0/3376632389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009ae0 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d928c700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d4159fd0 0x7f21d416d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d8a8b700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d409bb30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21d4068cd0 tx=0x7f21c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4008c20 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4008dc0 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d409c860 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40266b0 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.247+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d409ce20 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.248+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d404c3c0 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.248+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c4003040 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.249+0000 7f21d0ff9700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f21c0066f30 0x7f21c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.249+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21c4085e00 con 0x7f21d40b4860 2023-10-08T16:06:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.249+0000 7f21d3fff700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f21c0066f30 0x7f21c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.249+0000 7f21d3fff700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f21c0066f30 0x7f21c00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006fd0 tx=0x7f21c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.253+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c4053070 con 0x7f21d40b4860 2023-10-08T16:06:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.445+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21d40b2070 con 0x7f21d40b4860 2023-10-08T16:06:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.446+0000 7f21d0ff9700 1 -- 172.21.15.60:0/3376632389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21c4008f30 con 0x7f21d40b4860 2023-10-08T16:06:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:06:13.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f21c0066f30 msgr2=0x7f21c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f21c0066f30 0x7f21c00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006fd0 tx=0x7f21c8008040 comp rx=0 tx=0).stop 2023-10-08T16:06:13.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 msgr2=0x7f21d409bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d409bb30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21d4068cd0 tx=0x7f21c4018000 comp rx=0 tx=0).stop 2023-10-08T16:06:13.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 shutdown_connections 2023-10-08T16:06:13.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f21c0066f30 0x7f21c00693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d4159fd0 0x7f21d416d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40b4860 0x7f21d409bb30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 --2- 172.21.15.60:0/3376632389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21d40b4c30 0x7f21d416d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.447+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 >> 172.21.15.60:0/3376632389 conn(0x7f21d409a0f0 msgr2=0x7f21d415a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.448+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 shutdown_connections 2023-10-08T16:06:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.448+0000 7f21dacef700 1 -- 172.21.15.60:0/3376632389 wait complete. 2023-10-08T16:06:13.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.580+0000 7f8160219700 1 Processor -- start 2023-10-08T16:06:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.580+0000 7f8160219700 1 -- start start 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f8160219700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f815815a2b0 0x7f81580b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f8160219700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580c5d80 con 0x7f81580cfe20 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f8160219700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580c6060 con 0x7f81580d1c30 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f8160219700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8158068470 con 0x7f815815a2b0 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815dfb5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f815815a2b0 0x7f81580b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815e7b6700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f81580cfe20 0x7f81580c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37562/0 (socket says 172.21.15.60:37562) 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815e7b6700 1 -- 172.21.15.60:0/2379605980 learned_addr learned my addr 172.21.15.60:0/2379605980 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815dfb5700 1 -- 172.21.15.60:0/2379605980 >> v1:172.21.15.144:6789/0 conn(0x7f81580d1c30 legacy=0x7f81580cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815dfb5700 1 -- 172.21.15.60:0/2379605980 >> v1:172.21.15.60:6789/0 conn(0x7f81580cfe20 legacy=0x7f81580c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815cfb3700 1 -- 172.21.15.60:0/2379605980 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356480458 0 0) 0x7f81580c5d80 con 0x7f81580cfe20 2023-10-08T16:06:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.581+0000 7f815dfb5700 1 -- 172.21.15.60:0/2379605980 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580c6340 con 0x7f815815a2b0 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f815dfb5700 1 --2- 172.21.15.60:0/2379605980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f815815a2b0 0x7f81580b3da0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81500098d0 tx=0x7f8150009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165d1fb01e266a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f815cfb3700 1 -- 172.21.15.60:0/2379605980 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150009e70 con 0x7f815815a2b0 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f815cfb3700 1 -- 172.21.15.60:0/2379605980 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150005c10 con 0x7f815815a2b0 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f815cfb3700 1 -- 172.21.15.60:0/2379605980 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000b610 con 0x7f815815a2b0 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 -- 172.21.15.60:0/2379605980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f815815a2b0 msgr2=0x7f81580b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 --2- 172.21.15.60:0/2379605980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f815815a2b0 0x7f81580b3da0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81500098d0 tx=0x7f8150009120 comp rx=0 tx=0).stop 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 -- 172.21.15.60:0/2379605980 shutdown_connections 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 --2- 172.21.15.60:0/2379605980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f815815a2b0 0x7f81580b3da0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 -- 172.21.15.60:0/2379605980 >> 172.21.15.60:0/2379605980 conn(0x7f8158067e40 msgr2=0x7f81580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 -- 172.21.15.60:0/2379605980 shutdown_connections 2023-10-08T16:06:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.582+0000 7f8160219700 1 -- 172.21.15.60:0/2379605980 wait complete. 2023-10-08T16:06:13.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.583+0000 7f8160219700 1 Processor -- start 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.583+0000 7f8160219700 1 -- start start 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f8160219700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 0x7f8158159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f8160219700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81580d1c30 0x7f815815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f8160219700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f815815a2b0 0x7f815815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f8160219700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815815b4f0 con 0x7f81580cfe20 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f8160219700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815815f610 con 0x7f81580d1c30 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f8160219700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815815f8f0 con 0x7f815815a2b0 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f815dfb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 0x7f8158159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f815dfb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 0x7f8158159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48368/0 (socket says 172.21.15.60:48368) 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.584+0000 7f815dfb5700 1 -- 172.21.15.60:0/1892036103 learned_addr learned my addr 172.21.15.60:0/1892036103 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:13.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f815dfb5700 1 -- 172.21.15.60:0/1892036103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f815815a2b0 msgr2=0x7f815815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f815dfb5700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f815815a2b0 0x7f815815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f815dfb5700 1 -- 172.21.15.60:0/1892036103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81580d1c30 msgr2=0x7f815815a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f815dfb5700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81580d1c30 0x7f815815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f815dfb5700 1 -- 172.21.15.60:0/1892036103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500093c0 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f815dfb5700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 0x7f8158159af0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8150009160 tx=0x7f8150015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81500065f0 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150006750 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815815fbd0 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815001c430 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.585+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815816a750 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.586+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815816a940 con 0x7f81580cfe20 2023-10-08T16:06:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.586+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8150023070 con 0x7f81580cfe20 2023-10-08T16:06:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.587+0000 7f8155ffb700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8144066f30 0x7f81440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.587+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81500865c0 con 0x7f81580cfe20 2023-10-08T16:06:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.587+0000 7f815d7b4700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8144066f30 0x7f81440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.588+0000 7f815d7b4700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8144066f30 0x7f81440693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81580b5640 tx=0x7f814c006c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.591+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8150053790 con 0x7f81580cfe20 2023-10-08T16:06:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.826+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f815804c3c0 con 0x7f81580cfe20 2023-10-08T16:06:13.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.827+0000 7f8155ffb700 1 -- 172.21.15.60:0/1892036103 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f8150084e60 con 0x7f81580cfe20 2023-10-08T16:06:13.827 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:13.827 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:13.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8144066f30 msgr2=0x7f81440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8144066f30 0x7f81440693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81580b5640 tx=0x7f814c006c60 comp rx=0 tx=0).stop 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 msgr2=0x7f8158159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 0x7f8158159af0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8150009160 tx=0x7f8150015000 comp rx=0 tx=0).stop 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 shutdown_connections 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8144066f30 0x7f81440693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f815815a2b0 0x7f815815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81580cfe20 0x7f8158159af0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 --2- 172.21.15.60:0/1892036103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81580d1c30 0x7f815815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 >> 172.21.15.60:0/1892036103 conn(0x7f8158067e40 msgr2=0x7f815806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:13.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 shutdown_connections 2023-10-08T16:06:13.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.829+0000 7f8160219700 1 -- 172.21.15.60:0/1892036103 wait complete. 2023-10-08T16:06:13.831 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:13.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.959+0000 7f05d0c54700 1 Processor -- start 2023-10-08T16:06:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.959+0000 7f05d0c54700 1 -- start start 2023-10-08T16:06:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05d0c54700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05cc0cd6e0 0x7f05cc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05d0c54700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cdab0 0x7f05cc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05d0c54700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05cc15dda0 0x7f05cc15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05d0c54700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc15e850 con 0x7f05cc0cd6e0 2023-10-08T16:06:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05d0c54700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc0cd030 con 0x7f05cc15dda0 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05d0c54700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0cb7c0 con 0x7f05cc0cdab0 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05cc0cd6e0 0x7f05cc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05cc0cd6e0 0x7f05cc0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48380/0 (socket says 172.21.15.60:48380) 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 -- 172.21.15.60:0/1235593774 learned_addr learned my addr 172.21.15.60:0/1235593774 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05caffd700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cdab0 0x7f05cc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 -- 172.21.15.60:0/1235593774 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cdab0 msgr2=0x7f05cc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cdab0 0x7f05cc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cbfff700 1 --2- 172.21.15.60:0/1235593774 >> v2:172.21.15.144:3300/0 conn(0x7f05cc15dda0 0x7f05cc15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 -- 172.21.15.60:0/1235593774 >> v2:172.21.15.144:3300/0 conn(0x7f05cc15dda0 msgr2=0x7f05cc15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 --2- 172.21.15.60:0/1235593774 >> v2:172.21.15.144:3300/0 conn(0x7f05cc15dda0 0x7f05cc15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05cb7fe700 1 -- 172.21.15.60:0/1235593774 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc15e290 con 0x7f05cc0cd6e0 2023-10-08T16:06:13.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.960+0000 7f05caffd700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cdab0 0x7f05cc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05cb7fe700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cd6e0 0x7f05cc0cbc50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f05cc089ac0 tx=0x7f05bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967b2484834ac1b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05ca7fc700 1 -- 172.21.15.60:0/1235593774 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00b860 con 0x7f05cc0cd6e0 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05ca7fc700 1 -- 172.21.15.60:0/1235593774 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00b9c0 con 0x7f05cc0cd6e0 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05ca7fc700 1 -- 172.21.15.60:0/1235593774 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00bd60 con 0x7f05cc0cd6e0 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 -- 172.21.15.60:0/1235593774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cd6e0 msgr2=0x7f05cc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cd6e0 0x7f05cc0cbc50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f05cc089ac0 tx=0x7f05bc009250 comp rx=0 tx=0).stop 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 -- 172.21.15.60:0/1235593774 shutdown_connections 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 --2- 172.21.15.60:0/1235593774 >> v2:172.21.15.144:3300/0 conn(0x7f05cc15dda0 0x7f05cc15cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cd6e0 0x7f05cc0cbc50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 --2- 172.21.15.60:0/1235593774 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cdab0 0x7f05cc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 -- 172.21.15.60:0/1235593774 >> 172.21.15.60:0/1235593774 conn(0x7f05cc067660 msgr2=0x7f05cc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 -- 172.21.15.60:0/1235593774 shutdown_connections 2023-10-08T16:06:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.961+0000 7f05d0c54700 1 -- 172.21.15.60:0/1235593774 wait complete. 2023-10-08T16:06:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 Processor -- start 2023-10-08T16:06:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 -- start start 2023-10-08T16:06:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cd6e0 0x7f05cc0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 0x7f05cc0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05cc15dda0 0x7f05cc16a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc16b180 con 0x7f05cc0cdab0 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0c81c0 con 0x7f05cc15dda0 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05d0c54700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc16abc0 con 0x7f05cc0cd6e0 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.963+0000 7f05caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 0x7f05cc0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 0x7f05cc0c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48384/0 (socket says 172.21.15.60:48384) 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 -- 172.21.15.60:0/2944988717 learned_addr learned my addr 172.21.15.60:0/2944988717 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05cb7fe700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cd6e0 0x7f05cc0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05cbfff700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05cc15dda0 0x7f05cc16a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 -- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cd6e0 msgr2=0x7f05cc0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cd6e0 0x7f05cc0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 -- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05cc15dda0 msgr2=0x7f05cc16a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05cc15dda0 0x7f05cc16a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 -- 172.21.15.60:0/2944988717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0094f0 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05cbfff700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05cc15dda0 0x7f05cc16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05caffd700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 0x7f05cc0c8650 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c860 tx=0x7f05c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011600 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0011760 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc16aea0 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011b20 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.964+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc0cab90 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.965+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc0c8350 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.965+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05c00193b0 con 0x7f05cc0cdab0 2023-10-08T16:06:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.966+0000 7f05b37fe700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f05b8066f30 0x7f05b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:13.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.966+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05c0084510 con 0x7f05cc0cdab0 2023-10-08T16:06:13.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.966+0000 7f05cb7fe700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f05b8066f30 0x7f05b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:13.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.966+0000 7f05cb7fe700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f05b8066f30 0x7f05b80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05cc089ac0 tx=0x7f05bc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:13.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:13.970+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c0051780 con 0x7f05cc0cdab0 2023-10-08T16:06:14.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.165+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05cc15e570 con 0x7f05cc0cdab0 2023-10-08T16:06:14.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.166+0000 7f05b37fe700 1 -- 172.21.15.60:0/2944988717 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f05c0054da0 con 0x7f05cc0cdab0 2023-10-08T16:06:14.166 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:14.166 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:09.542341+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:14.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f05b8066f30 msgr2=0x7f05b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f05b8066f30 0x7f05b80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05cc089ac0 tx=0x7f05bc017000 comp rx=0 tx=0).stop 2023-10-08T16:06:14.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 msgr2=0x7f05cc0c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 0x7f05cc0c8650 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c860 tx=0x7f05c0008040 comp rx=0 tx=0).stop 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 shutdown_connections 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f05b8066f30 0x7f05b80693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05cc0cd6e0 0x7f05cc0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05cc15dda0 0x7f05cc16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 --2- 172.21.15.60:0/2944988717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05cc0cdab0 0x7f05cc0c8650 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 >> 172.21.15.60:0/2944988717 conn(0x7f05cc067660 msgr2=0x7f05cc0c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 shutdown_connections 2023-10-08T16:06:14.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.168+0000 7f05d0c54700 1 -- 172.21.15.60:0/2944988717 wait complete. 2023-10-08T16:06:14.180 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:06:14.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.298+0000 7fa62495e700 1 Processor -- start 2023-10-08T16:06:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.298+0000 7fa62495e700 1 -- start start 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.299+0000 7fa62495e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa620157820 0x7fa620157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.299+0000 7fa62495e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6200c8f20 0x7fa6200ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.299+0000 7fa62495e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6200ae060 con 0x7fa6200c93c0 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.299+0000 7fa62495e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200afae0 con 0x7fa620157820 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.299+0000 7fa62495e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200c9970 con 0x7fa6200c8f20 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa620157820 0x7fa620157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61e59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6200c8f20 0x7fa6200ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa620157820 0x7fa620157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48390/0 (socket says 172.21.15.60:48390) 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61f59e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa6200c93c0 0x7fa6200cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:44146/0 (socket says 172.21.15.60:44146) 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 -- 172.21.15.60:0/2570262652 learned_addr learned my addr 172.21.15.60:0/2570262652 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61dd9b700 1 -- 172.21.15.60:0/2570262652 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670406573 0 0) 0x7fa6200ae060 con 0x7fa6200c93c0 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61dd9b700 1 -- 172.21.15.60:0/2570262652 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c003570 con 0x7fa6200c93c0 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 -- 172.21.15.60:0/2570262652 >> v2:172.21.15.144:3300/0 conn(0x7fa6200c8f20 msgr2=0x7fa6200ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 --2- 172.21.15.60:0/2570262652 >> v2:172.21.15.144:3300/0 conn(0x7fa6200c8f20 0x7fa6200ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 -- 172.21.15.60:0/2570262652 >> v1:172.21.15.144:6789/0 conn(0x7fa6200c93c0 legacy=0x7fa6200cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 -- 172.21.15.60:0/2570262652 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200c9c50 con 0x7fa620157820 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61ed9d700 1 --2- 172.21.15.60:0/2570262652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa620157820 0x7fa620157bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa6200cf9f0 tx=0x7fa610009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc4687e7241ae79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61dd9b700 1 -- 172.21.15.60:0/2570262652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000b640 con 0x7fa620157820 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61dd9b700 1 -- 172.21.15.60:0/2570262652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000b7a0 con 0x7fa620157820 2023-10-08T16:06:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.300+0000 7fa61dd9b700 1 -- 172.21.15.60:0/2570262652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000bb20 con 0x7fa620157820 2023-10-08T16:06:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 -- 172.21.15.60:0/2570262652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa620157820 msgr2=0x7fa620157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 --2- 172.21.15.60:0/2570262652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa620157820 0x7fa620157bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa6200cf9f0 tx=0x7fa610009250 comp rx=0 tx=0).stop 2023-10-08T16:06:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 -- 172.21.15.60:0/2570262652 shutdown_connections 2023-10-08T16:06:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 --2- 172.21.15.60:0/2570262652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa620157820 0x7fa620157bf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 --2- 172.21.15.60:0/2570262652 >> v2:172.21.15.144:3300/0 conn(0x7fa6200c8f20 0x7fa6200ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 -- 172.21.15.60:0/2570262652 >> 172.21.15.60:0/2570262652 conn(0x7fa62006bc70 msgr2=0x7fa62006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 -- 172.21.15.60:0/2570262652 shutdown_connections 2023-10-08T16:06:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.301+0000 7fa62495e700 1 -- 172.21.15.60:0/2570262652 wait complete. 2023-10-08T16:06:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.303+0000 7fa62495e700 1 Processor -- start 2023-10-08T16:06:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.303+0000 7fa62495e700 1 -- start start 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa62495e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6200c8f20 0x7fa620168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa62495e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 0x7fa620154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa62495e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa620157820 0x7fa6200ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa62495e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201695c0 con 0x7fa6200c93c0 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa62495e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201693b0 con 0x7fa620157820 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa62495e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200b2620 con 0x7fa6200c8f20 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 0x7fa620154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 0x7fa620154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48394/0 (socket says 172.21.15.60:48394) 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 -- 172.21.15.60:0/3820609473 learned_addr learned my addr 172.21.15.60:0/3820609473 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61ed9d700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6200c8f20 0x7fa620168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61f59e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa620157820 0x7fa6200ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 -- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6200c8f20 msgr2=0x7fa620168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6200c8f20 0x7fa620168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 -- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa620157820 msgr2=0x7fa6200ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa620157820 0x7fa6200ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 -- 172.21.15.60:0/3820609473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6100094f0 con 0x7fa6200c93c0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.304+0000 7fa61e59c700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 0x7fa620154e10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa60800ec80 tx=0x7fa6080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.305+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800c850 con 0x7fa6200c93c0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.305+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800c9b0 con 0x7fa6200c93c0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.305+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa620155350 con 0x7fa6200c93c0 2023-10-08T16:06:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.305+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800cd50 con 0x7fa6200c93c0 2023-10-08T16:06:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.305+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6200b1cf0 con 0x7fa6200c93c0 2023-10-08T16:06:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.306+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62006e3e0 con 0x7fa6200c93c0 2023-10-08T16:06:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.306+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa608013680 con 0x7fa6200c93c0 2023-10-08T16:06:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.307+0000 7fa616ffd700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa600066f30 0x7fa6000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.307+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa608084760 con 0x7fa6200c93c0 2023-10-08T16:06:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.307+0000 7fa61ed9d700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa600066f30 0x7fa6000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.307+0000 7fa61ed9d700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa600066f30 0x7fa6000693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6200cf9f0 tx=0x7fa610017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:14.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.311+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6080519d0 con 0x7fa6200c93c0 2023-10-08T16:06:14.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.552+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6200b2790 con 0x7fa6200c93c0 2023-10-08T16:06:14.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.553+0000 7fa616ffd700 1 -- 172.21.15.60:0/3820609473 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fa608054ff0 con 0x7fa6200c93c0 2023-10-08T16:06:14.554 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:14.554 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:14.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa600066f30 msgr2=0x7fa6000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa600066f30 0x7fa6000693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6200cf9f0 tx=0x7fa610017000 comp rx=0 tx=0).stop 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 msgr2=0x7fa620154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 0x7fa620154e10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa60800ec80 tx=0x7fa6080091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 shutdown_connections 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa600066f30 0x7fa6000693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6200c8f20 0x7fa620168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa620157820 0x7fa6200ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 --2- 172.21.15.60:0/3820609473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200c93c0 0x7fa620154e10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 >> 172.21.15.60:0/3820609473 conn(0x7fa62006bc70 msgr2=0x7fa620155aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 shutdown_connections 2023-10-08T16:06:14.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.555+0000 7fa62495e700 1 -- 172.21.15.60:0/3820609473 wait complete. 2023-10-08T16:06:14.557 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:14.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:14.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.687+0000 7f1e47a34700 1 Processor -- start 2023-10-08T16:06:14.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.687+0000 7f1e47a34700 1 -- start start 2023-10-08T16:06:14.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.687+0000 7f1e47a34700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e40157870 0x7f1e4015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.687+0000 7f1e47a34700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e40157c40 0x7f1e40158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e47a34700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4015cbb0 con 0x7f1e4015a620 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e47a34700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4015bfa0 con 0x7f1e40157c40 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e47a34700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4015c280 con 0x7f1e40157870 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e45fd1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e40157c40 0x7f1e40158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e44fcf700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1e4015a620 0x7f1e4015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37568/0 (socket says 172.21.15.60:37568) 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e44fcf700 1 -- 172.21.15.60:0/1774687734 learned_addr learned my addr 172.21.15.60:0/1774687734 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e457d0700 1 --2- 172.21.15.60:0/1774687734 >> v2:172.21.15.144:3300/0 conn(0x7f1e40157870 0x7f1e4015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e45fd1700 1 -- 172.21.15.60:0/1774687734 >> v2:172.21.15.144:3300/0 conn(0x7f1e40157870 msgr2=0x7f1e4015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e45fd1700 1 --2- 172.21.15.60:0/1774687734 >> v2:172.21.15.144:3300/0 conn(0x7f1e40157870 0x7f1e4015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e45fd1700 1 -- 172.21.15.60:0/1774687734 >> v1:172.21.15.60:6789/0 conn(0x7f1e4015a620 legacy=0x7f1e4015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e3ffff700 1 -- 172.21.15.60:0/1774687734 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873538885 0 0) 0x7f1e4015cbb0 con 0x7f1e4015a620 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e45fd1700 1 -- 172.21.15.60:0/1774687734 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4015c560 con 0x7f1e40157c40 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e45fd1700 1 --2- 172.21.15.60:0/1774687734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e40157c40 0x7f1e40158110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1e40069d80 tx=0x7f1e38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f76518803ed816b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e3ffff700 1 -- 172.21.15.60:0/1774687734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800e070 con 0x7f1e40157c40 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e3ffff700 1 -- 172.21.15.60:0/1774687734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3800bc30 con 0x7f1e40157c40 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.688+0000 7f1e3ffff700 1 -- 172.21.15.60:0/1774687734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38012430 con 0x7f1e40157c40 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 -- 172.21.15.60:0/1774687734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e40157c40 msgr2=0x7f1e40158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 --2- 172.21.15.60:0/1774687734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e40157c40 0x7f1e40158110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1e40069d80 tx=0x7f1e38009780 comp rx=0 tx=0).stop 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 -- 172.21.15.60:0/1774687734 shutdown_connections 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 --2- 172.21.15.60:0/1774687734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e40157c40 0x7f1e40158110 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 --2- 172.21.15.60:0/1774687734 >> v2:172.21.15.144:3300/0 conn(0x7f1e40157870 0x7f1e4015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 -- 172.21.15.60:0/1774687734 >> 172.21.15.60:0/1774687734 conn(0x7f1e40068ce0 msgr2=0x7f1e400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 -- 172.21.15.60:0/1774687734 shutdown_connections 2023-10-08T16:06:14.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.689+0000 7f1e47a34700 1 -- 172.21.15.60:0/1774687734 wait complete. 2023-10-08T16:06:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.690+0000 7f1e47a34700 1 Processor -- start 2023-10-08T16:06:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.690+0000 7f1e47a34700 1 -- start start 2023-10-08T16:06:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e47a34700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e40157870 0x7f1e4014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e47a34700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e40157c40 0x7f1e401522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e47a34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 0x7f1e40153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e47a34700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400b19c0 con 0x7f1e4015a620 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e47a34700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e40151e40 con 0x7f1e40157c40 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e47a34700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e40151230 con 0x7f1e40157870 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e45fd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 0x7f1e40153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e45fd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 0x7f1e40153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48408/0 (socket says 172.21.15.60:48408) 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e45fd1700 1 -- 172.21.15.60:0/2184578709 learned_addr learned my addr 172.21.15.60:0/2184578709 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e44fcf700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e40157c40 0x7f1e401522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e457d0700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e40157870 0x7f1e4014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e45fd1700 1 -- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e40157870 msgr2=0x7f1e4014c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.691+0000 7f1e45fd1700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e40157870 0x7f1e4014c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e45fd1700 1 -- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e40157c40 msgr2=0x7f1e401522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e45fd1700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e40157c40 0x7f1e401522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e45fd1700 1 -- 172.21.15.60:0/2184578709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009a20 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e45fd1700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 0x7f1e40153690 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1e4006b530 tx=0x7f1e38019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38027470 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380275d0 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e40151510 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38027990 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.692+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e40151ad0 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.693+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e40151fb0 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.693+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e38024070 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.694+0000 7f1e3d7fa700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e2c066f30 0x7f1e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.694+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e38086b80 con 0x7f1e4015a620 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.694+0000 7f1e457d0700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e2c066f30 0x7f1e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.694+0000 7f1e457d0700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e2c066f30 0x7f1e2c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e30006fd0 tx=0x7f1e30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.698+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e38053df0 con 0x7f1e4015a620 2023-10-08T16:06:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.933+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e4004c3c0 con 0x7f1e4015a620 2023-10-08T16:06:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.933+0000 7f1e3d7fa700 1 -- 172.21.15.60:0/2184578709 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f1e38009880 con 0x7f1e4015a620 2023-10-08T16:06:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:14.934 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:05:57.900043+0000","modified":"2023-10-08T16:06:01.522481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6837/1920991468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1920991468},{"type":"v1","addr":"172.21.15.60:6837","nonce":1920991468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e2c066f30 msgr2=0x7f1e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e2c066f30 0x7f1e2c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e30006fd0 tx=0x7f1e30008040 comp rx=0 tx=0).stop 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 msgr2=0x7f1e40153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 0x7f1e40153690 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1e4006b530 tx=0x7f1e38019000 comp rx=0 tx=0).stop 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 shutdown_connections 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e2c066f30 0x7f1e2c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e40157870 0x7f1e4014c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4015a620 0x7f1e40153690 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 --2- 172.21.15.60:0/2184578709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e40157c40 0x7f1e401522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 >> 172.21.15.60:0/2184578709 conn(0x7f1e40068ce0 msgr2=0x7f1e400b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 shutdown_connections 2023-10-08T16:06:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:14.935+0000 7f1e47a34700 1 -- 172.21.15.60:0/2184578709 wait complete. 2023-10-08T16:06:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-08T16:06:14.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:15.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.065+0000 7fd1a4094700 1 Processor -- start 2023-10-08T16:06:15.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.065+0000 7fd1a4094700 1 -- start start 2023-10-08T16:06:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a4094700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd19c1523e0 0x7fd19c06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a4094700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd19c158e50 0x7fd19c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a4094700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c06c010 con 0x7fd19c152010 2023-10-08T16:06:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a4094700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c06bd10 con 0x7fd19c1523e0 2023-10-08T16:06:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a4094700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c15c060 con 0x7fd19c158e50 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a1e30700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd19c152010 0x7fd19c15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37570/0 (socket says 172.21.15.60:37570) 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a1e30700 1 -- 172.21.15.60:0/1811809342 learned_addr learned my addr 172.21.15.60:0/1811809342 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a162f700 1 --2- 172.21.15.60:0/1811809342 >> v2:172.21.15.60:3300/0 conn(0x7fd19c1523e0 0x7fd19c06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.066+0000 7fd1a2631700 1 --2- 172.21.15.60:0/1811809342 >> v2:172.21.15.144:3300/0 conn(0x7fd19c158e50 0x7fd19c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a162f700 1 -- 172.21.15.60:0/1811809342 >> v2:172.21.15.144:3300/0 conn(0x7fd19c158e50 msgr2=0x7fd19c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a162f700 1 --2- 172.21.15.60:0/1811809342 >> v2:172.21.15.144:3300/0 conn(0x7fd19c158e50 0x7fd19c0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a162f700 1 -- 172.21.15.60:0/1811809342 >> v1:172.21.15.60:6789/0 conn(0x7fd19c152010 legacy=0x7fd19c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a0e2e700 1 -- 172.21.15.60:0/1811809342 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931747810 0 0) 0x7fd19c06c010 con 0x7fd19c152010 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a162f700 1 -- 172.21.15.60:0/1811809342 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c15c340 con 0x7fd19c1523e0 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a162f700 1 --2- 172.21.15.60:0/1811809342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c1523e0 0x7fd19c06c4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd19c06f170 tx=0x7fd1900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eea8b8f953b523 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a0e2e700 1 -- 172.21.15.60:0/1811809342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190011630 con 0x7fd19c1523e0 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a0e2e700 1 -- 172.21.15.60:0/1811809342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190011790 con 0x7fd19c1523e0 2023-10-08T16:06:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a0e2e700 1 -- 172.21.15.60:0/1811809342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190011b30 con 0x7fd19c1523e0 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.067+0000 7fd1a4094700 1 -- 172.21.15.60:0/1811809342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c1523e0 msgr2=0x7fd19c06c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 --2- 172.21.15.60:0/1811809342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c1523e0 0x7fd19c06c4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd19c06f170 tx=0x7fd1900091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 -- 172.21.15.60:0/1811809342 shutdown_connections 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 --2- 172.21.15.60:0/1811809342 >> v2:172.21.15.144:3300/0 conn(0x7fd19c158e50 0x7fd19c0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 --2- 172.21.15.60:0/1811809342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c1523e0 0x7fd19c06c4a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 -- 172.21.15.60:0/1811809342 >> 172.21.15.60:0/1811809342 conn(0x7fd19c069870 msgr2=0x7fd19c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 -- 172.21.15.60:0/1811809342 shutdown_connections 2023-10-08T16:06:15.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.068+0000 7fd1a4094700 1 -- 172.21.15.60:0/1811809342 wait complete. 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 Processor -- start 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 -- start start 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd19c152010 0x7fd19c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19c1523e0 0x7fd19c0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 0x7fd19c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0ce280 con 0x7fd19c158e50 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c155130 con 0x7fd19c152010 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.069+0000 7fd1a4094700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c155410 con 0x7fd19c1523e0 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 0x7fd19c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 0x7fd19c15a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48434/0 (socket says 172.21.15.60:48434) 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 -- 172.21.15.60:0/3999206895 learned_addr learned my addr 172.21.15.60:0/3999206895 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a1e30700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd19c152010 0x7fd19c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a162f700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19c1523e0 0x7fd19c0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 -- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19c1523e0 msgr2=0x7fd19c0c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19c1523e0 0x7fd19c0c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 -- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd19c152010 msgr2=0x7fd19c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd19c152010 0x7fd19c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 -- 172.21.15.60:0/3999206895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190009420 con 0x7fd19c158e50 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a162f700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19c1523e0 0x7fd19c0c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a2631700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 0x7fd19c15a180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009e90 tx=0x7fd18c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00cc20 con 0x7fd19c158e50 2023-10-08T16:06:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00f040 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c0cdf10 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.070+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c014480 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.071+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c0c56d0 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.071+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c0cdd70 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.072+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd18c014830 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.072+0000 7fd199ffb700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd188066f30 0x7fd1880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.072+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd18c084f50 con 0x7fd19c158e50 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.072+0000 7fd1a1e30700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd188066f30 0x7fd1880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.073+0000 7fd1a1e30700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd188066f30 0x7fd1880693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd19400c8f0 tx=0x7fd194009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.077+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd19c0cdd70 con 0x7fd19c158e50 2023-10-08T16:06:15.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.270+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd19c0cdd70 con 0x7fd19c158e50 2023-10-08T16:06:15.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.271+0000 7fd199ffb700 1 -- 172.21.15.60:0/3999206895 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd19c0cdd70 con 0x7fd19c158e50 2023-10-08T16:06:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:15.272 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:09.542341+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:05:55.725378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:05:56.877819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd188066f30 msgr2=0x7fd1880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd188066f30 0x7fd1880693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd19400c8f0 tx=0x7fd194009040 comp rx=0 tx=0).stop 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 msgr2=0x7fd19c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 0x7fd19c15a180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009e90 tx=0x7fd18c00b040 comp rx=0 tx=0).stop 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 shutdown_connections 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd188066f30 0x7fd1880693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c158e50 0x7fd19c15a180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd19c152010 0x7fd19c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 --2- 172.21.15.60:0/3999206895 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19c1523e0 0x7fd19c0c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 >> 172.21.15.60:0/3999206895 conn(0x7fd19c069870 msgr2=0x7fd19c14efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 shutdown_connections 2023-10-08T16:06:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.273+0000 7fd1a4094700 1 -- 172.21.15.60:0/3999206895 wait complete. 2023-10-08T16:06:15.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:06:15.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.405+0000 7fa7117a0700 1 Processor -- start 2023-10-08T16:06:15.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.405+0000 7fa7117a0700 1 -- start start 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa7117a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa70c157c40 0x7fa70c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa7117a0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c15cbb0 con 0x7fa70c15a620 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa7117a0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c15bfa0 con 0x7fa70c157870 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa7117a0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c15bdb0 con 0x7fa70c157c40 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa70c157c40 0x7fa70c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70a7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa70c15a620 0x7fa70c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37586/0 (socket says 172.21.15.60:37586) 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70a7fc700 1 -- 172.21.15.60:0/2731750314 learned_addr learned my addr 172.21.15.60:0/2731750314 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70b7fe700 1 -- 172.21.15.60:0/2731750314 >> v1:172.21.15.144:6789/0 conn(0x7fa70c157870 legacy=0x7fa70c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70b7fe700 1 -- 172.21.15.60:0/2731750314 >> v1:172.21.15.60:6789/0 conn(0x7fa70c15a620 legacy=0x7fa70c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70b7fe700 1 -- 172.21.15.60:0/2731750314 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c15c280 con 0x7fa70c157c40 2023-10-08T16:06:15.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa709ffb700 1 -- 172.21.15.60:0/2731750314 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934875310 0 0) 0x7fa70c15cbb0 con 0x7fa70c15a620 2023-10-08T16:06:15.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.406+0000 7fa70b7fe700 1 --2- 172.21.15.60:0/2731750314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c157c40 0x7fa70c158110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0098e0 tx=0x7fa6fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fab614efa8ce13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa709ffb700 1 -- 172.21.15.60:0/2731750314 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc009e80 con 0x7fa70c157c40 2023-10-08T16:06:15.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa709ffb700 1 -- 172.21.15.60:0/2731750314 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc00b820 con 0x7fa70c157c40 2023-10-08T16:06:15.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa709ffb700 1 -- 172.21.15.60:0/2731750314 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00bba0 con 0x7fa70c157c40 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 -- 172.21.15.60:0/2731750314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c157c40 msgr2=0x7fa70c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 --2- 172.21.15.60:0/2731750314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c157c40 0x7fa70c158110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0098e0 tx=0x7fa6fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 -- 172.21.15.60:0/2731750314 shutdown_connections 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 --2- 172.21.15.60:0/2731750314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c157c40 0x7fa70c158110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 -- 172.21.15.60:0/2731750314 >> 172.21.15.60:0/2731750314 conn(0x7fa70c068ce0 msgr2=0x7fa70c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 -- 172.21.15.60:0/2731750314 shutdown_connections 2023-10-08T16:06:15.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.407+0000 7fa7117a0700 1 -- 172.21.15.60:0/2731750314 wait complete. 2023-10-08T16:06:15.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.408+0000 7fa7117a0700 1 Processor -- start 2023-10-08T16:06:15.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.408+0000 7fa7117a0700 1 -- start start 2023-10-08T16:06:15.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa7117a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa70c157870 0x7fa70c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa7117a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa70c157c40 0x7fa70c16d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa7117a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 0x7fa70c16dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa7117a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c150d90 con 0x7fa70c15a620 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa7117a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c129df0 con 0x7fa70c157870 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa7117a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0b2a10 con 0x7fa70c157c40 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa70b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 0x7fa70c16dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa70b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 0x7fa70c16dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48460/0 (socket says 172.21.15.60:48460) 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.409+0000 7fa70b7fe700 1 -- 172.21.15.60:0/3361520625 learned_addr learned my addr 172.21.15.60:0/3361520625 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70affd700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa70c157870 0x7fa70c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70a7fc700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa70c157c40 0x7fa70c16d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70b7fe700 1 -- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa70c157c40 msgr2=0x7fa70c16d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70b7fe700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa70c157c40 0x7fa70c16d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70b7fe700 1 -- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa70c157870 msgr2=0x7fa70c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70b7fe700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa70c157870 0x7fa70c0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70b7fe700 1 -- 172.21.15.60:0/3361520625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc009420 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70affd700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa70c157870 0x7fa70c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa70b7fe700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 0x7fa70c16dc20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0093f0 tx=0x7fa6fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc01b680 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc01b7e0 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc01bba0 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c0b2cf0 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.410+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c13fdd0 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.411+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c12a270 con 0x7fa70c15a620 2023-10-08T16:06:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.411+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6fc01c450 con 0x7fa70c15a620 2023-10-08T16:06:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.412+0000 7fa702ffd700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6ec066f30 0x7fa6ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.412+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6fc086490 con 0x7fa70c15a620 2023-10-08T16:06:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.412+0000 7fa70affd700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6ec066f30 0x7fa6ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.412+0000 7fa70affd700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6ec066f30 0x7fa6ec0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa704007fd0 tx=0x7fa704009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.416+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6fc053700 con 0x7fa70c15a620 2023-10-08T16:06:15.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.656+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa70c04c3c0 con 0x7fa70c15a620 2023-10-08T16:06:15.657 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:06:15.657+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:06:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.662+0000 7fa702ffd700 1 -- 172.21.15.60:0/3361520625 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa6fc056d20 con 0x7fa70c15a620 2023-10-08T16:06:15.664 INFO:tasks.ceph.mds.c.smithi060.stderr: -3320> 2023-10-08T16:06:04.360+0000 7fdcb52c2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:06:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6ec066f30 msgr2=0x7fa6ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6ec066f30 0x7fa6ec0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa704007fd0 tx=0x7fa704009040 comp rx=0 tx=0).stop 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 msgr2=0x7fa70c16dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 0x7fa70c16dc20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0093f0 tx=0x7fa6fc016000 comp rx=0 tx=0).stop 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 shutdown_connections 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa6ec066f30 0x7fa6ec0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa70c15a620 0x7fa70c16dc20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa70c157870 0x7fa70c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 --2- 172.21.15.60:0/3361520625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa70c157c40 0x7fa70c16d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 >> 172.21.15.60:0/3361520625 conn(0x7fa70c068ce0 msgr2=0x7fa70c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 shutdown_connections 2023-10-08T16:06:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.664+0000 7fa7117a0700 1 -- 172.21.15.60:0/3361520625 wait complete. 2023-10-08T16:06:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:06:15.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:06:15.689 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:06:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.797+0000 7f4050cc1700 1 Processor -- start 2023-10-08T16:06:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 -- start start 2023-10-08T16:06:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f404c154440 0x7f404c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f404c15af30 0x7f404c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15b380 0x7f404c067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c15dfd0 con 0x7f404c154440 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c15e1e0 con 0x7f404c15af30 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.798+0000 7f4050cc1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c15e4c0 con 0x7f404c15b380 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f404c154440 0x7f404c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f404c154440 0x7f404c15da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48476/0 (socket says 172.21.15.60:48476) 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 -- 172.21.15.60:0/3756889853 learned_addr learned my addr 172.21.15.60:0/3756889853 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 -- 172.21.15.60:0/3756889853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15b380 msgr2=0x7f404c067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 --2- 172.21.15.60:0/3756889853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15b380 0x7f404c067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 -- 172.21.15.60:0/3756889853 >> v2:172.21.15.144:3300/0 conn(0x7f404c15af30 msgr2=0x7f404c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 --2- 172.21.15.60:0/3756889853 >> v2:172.21.15.144:3300/0 conn(0x7f404c15af30 0x7f404c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 -- 172.21.15.60:0/3756889853 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c15e7a0 con 0x7f404c154440 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404a59c700 1 --2- 172.21.15.60:0/3756889853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c15da90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f404c0d1ee0 tx=0x7f403c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74844b4660c495a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404959a700 1 -- 172.21.15.60:0/3756889853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00b860 con 0x7f404c154440 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404959a700 1 -- 172.21.15.60:0/3756889853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c00b9c0 con 0x7f404c154440 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.799+0000 7f404959a700 1 -- 172.21.15.60:0/3756889853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00bd80 con 0x7f404c154440 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 -- 172.21.15.60:0/3756889853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 msgr2=0x7f404c15da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3756889853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c15da90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f404c0d1ee0 tx=0x7f403c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 -- 172.21.15.60:0/3756889853 shutdown_connections 2023-10-08T16:06:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3756889853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15b380 0x7f404c067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3756889853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c15da90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3756889853 >> v2:172.21.15.144:3300/0 conn(0x7f404c15af30 0x7f404c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 -- 172.21.15.60:0/3756889853 >> 172.21.15.60:0/3756889853 conn(0x7f404c0d0dd0 msgr2=0x7f404c0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 -- 172.21.15.60:0/3756889853 shutdown_connections 2023-10-08T16:06:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.800+0000 7f4050cc1700 1 -- 172.21.15.60:0/3756889853 wait complete. 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.801+0000 7f4050cc1700 1 Processor -- start 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.801+0000 7f4050cc1700 1 -- start start 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c1426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15af30 0x7f404c0d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f404c15b380 0x7f404c0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c16e6f0 con 0x7f404c154440 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c1549b0 con 0x7f404c15b380 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c154c90 con 0x7f404c15af30 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c1426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c1426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48490/0 (socket says 172.21.15.60:48490) 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 -- 172.21.15.60:0/3875981928 learned_addr learned my addr 172.21.15.60:0/3875981928 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4049d9b700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15af30 0x7f404c0d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404ad9d700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f404c15b380 0x7f404c0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 -- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15af30 msgr2=0x7f404c0d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15af30 0x7f404c0d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 -- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f404c15b380 msgr2=0x7f404c0d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f404c15b380 0x7f404c0d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 -- 172.21.15.60:0/3875981928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0094f0 con 0x7f404c154440 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4049d9b700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15af30 0x7f404c0d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f404a59c700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c1426e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f404c089be0 tx=0x7f403c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c011c40 con 0x7f404c154440 2023-10-08T16:06:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c011dc0 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c154f70 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.802+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c025670 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.803+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c16da50 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.803+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c154810 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.804+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f403c023070 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.804+0000 7f40427fc700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f402c066f30 0x7f402c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.804+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f403c085ad0 con 0x7f404c154440 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.804+0000 7f4049d9b700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f402c066f30 0x7f402c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.805+0000 7f4049d9b700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f402c066f30 0x7f402c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f4034008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:15.809+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f404c154810 con 0x7f404c154440 2023-10-08T16:06:16.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.045+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f404c154810 con 0x7f404c154440 2023-10-08T16:06:16.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.661+0000 7f40427fc700 1 -- 172.21.15.60:0/3875981928 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f404c154810 con 0x7f404c154440 2023-10-08T16:06:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f402c066f30 msgr2=0x7f402c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f402c066f30 0x7f402c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f4034008040 comp rx=0 tx=0).stop 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 msgr2=0x7f404c1426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c1426e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f404c089be0 tx=0x7f403c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 shutdown_connections 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f402c066f30 0x7f402c0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f404c15b380 0x7f404c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f404c154440 0x7f404c1426e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 --2- 172.21.15.60:0/3875981928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f404c15af30 0x7f404c0d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 >> 172.21.15.60:0/3875981928 conn(0x7f404c0d0dd0 msgr2=0x7f404c153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 shutdown_connections 2023-10-08T16:06:16.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.664+0000 7f4050cc1700 1 -- 172.21.15.60:0/3875981928 wait complete. 2023-10-08T16:06:16.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:06:16.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.847+0000 7f82771aa700 1 Processor -- start 2023-10-08T16:06:16.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.847+0000 7f82771aa700 1 -- start start 2023-10-08T16:06:16.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82771aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82701599f0 0x7f827015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82771aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8270070e10 0x7f8270067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82771aa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8270067660 con 0x7f827006f2f0 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82771aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827015e0b0 con 0x7f8270070e10 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82771aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827015e390 con 0x7f82701599f0 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82759a7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f827006f2f0 0x7f8270070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37604/0 (socket says 172.21.15.60:37604) 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82759a7700 1 -- 172.21.15.60:0/1863183349 learned_addr learned my addr 172.21.15.60:0/1863183349 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82769a9700 1 --2- 172.21.15.60:0/1863183349 >> v2:172.21.15.144:3300/0 conn(0x7f8270070e10 0x7f8270067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82761a8700 1 --2- 172.21.15.60:0/1863183349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82701599f0 0x7f827015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82751a6700 1 -- 172.21.15.60:0/1863183349 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789473972 0 0) 0x7f8270067660 con 0x7f827006f2f0 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.848+0000 7f82751a6700 1 -- 172.21.15.60:0/1863183349 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8258003570 con 0x7f827006f2f0 2023-10-08T16:06:16.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82761a8700 1 -- 172.21.15.60:0/1863183349 >> v2:172.21.15.144:3300/0 conn(0x7f8270070e10 msgr2=0x7f8270067dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82761a8700 1 --2- 172.21.15.60:0/1863183349 >> v2:172.21.15.144:3300/0 conn(0x7f8270070e10 0x7f8270067dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82761a8700 1 -- 172.21.15.60:0/1863183349 >> v1:172.21.15.60:6789/0 conn(0x7f827006f2f0 legacy=0x7f8270070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82761a8700 1 -- 172.21.15.60:0/1863183349 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827015e670 con 0x7f82701599f0 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82769a9700 1 --2- 172.21.15.60:0/1863183349 >> v2:172.21.15.144:3300/0 conn(0x7f8270070e10 0x7f8270067dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82761a8700 1 --2- 172.21.15.60:0/1863183349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82701599f0 0x7f827015d860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82680098e0 tx=0x7f82680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3abb6f4ee424597 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82751a6700 1 -- 172.21.15.60:0/1863183349 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268011630 con 0x7f82701599f0 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82751a6700 1 -- 172.21.15.60:0/1863183349 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268011790 con 0x7f82701599f0 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82751a6700 1 -- 172.21.15.60:0/1863183349 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268011b30 con 0x7f82701599f0 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82771aa700 1 -- 172.21.15.60:0/1863183349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82701599f0 msgr2=0x7f827015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.849+0000 7f82771aa700 1 --2- 172.21.15.60:0/1863183349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82701599f0 0x7f827015d860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82680098e0 tx=0x7f82680091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.850+0000 7f82771aa700 1 -- 172.21.15.60:0/1863183349 shutdown_connections 2023-10-08T16:06:16.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.850+0000 7f82771aa700 1 --2- 172.21.15.60:0/1863183349 >> v2:172.21.15.144:3300/0 conn(0x7f8270070e10 0x7f8270067dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.850+0000 7f82771aa700 1 --2- 172.21.15.60:0/1863183349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82701599f0 0x7f827015d860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.850+0000 7f82771aa700 1 -- 172.21.15.60:0/1863183349 >> 172.21.15.60:0/1863183349 conn(0x7f82700cd8f0 msgr2=0x7f82700cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:16.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.850+0000 7f82771aa700 1 -- 172.21.15.60:0/1863183349 shutdown_connections 2023-10-08T16:06:16.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.850+0000 7f82771aa700 1 -- 172.21.15.60:0/1863183349 wait complete. 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 Processor -- start 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 -- start start 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 0x7f82700b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8270070e10 0x7f82700c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82701599f0 0x7f82700af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b1820 con 0x7f827006f2f0 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700c2230 con 0x7f82701599f0 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.851+0000 7f82771aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b1540 con 0x7f8270070e10 2023-10-08T16:06:16.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 0x7f82700b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 0x7f82700b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48498/0 (socket says 172.21.15.60:48498) 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 -- 172.21.15.60:0/1672125113 learned_addr learned my addr 172.21.15.60:0/1672125113 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82759a7700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8270070e10 0x7f82700c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82769a9700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82701599f0 0x7f82700af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 -- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8270070e10 msgr2=0x7f82700c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8270070e10 0x7f82700c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 -- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82701599f0 msgr2=0x7f82700af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82701599f0 0x7f82700af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 -- 172.21.15.60:0/1672125113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260009a20 con 0x7f827006f2f0 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82769a9700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82701599f0 0x7f82700af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:16.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82761a8700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 0x7f82700b3090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f827015e4d0 tx=0x7f8268017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268011b10 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268000cc0 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8268009420 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268025620 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.852+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82700c1ec0 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.853+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82700c1a40 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.854+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8268025a10 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.854+0000 7f826e7fc700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f825c066f30 0x7f825c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.854+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8268085cc0 con 0x7f827006f2f0 2023-10-08T16:06:16.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.854+0000 7f82759a7700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f825c066f30 0x7f825c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:16.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.855+0000 7f82759a7700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f825c066f30 0x7f825c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f82700c1760 tx=0x7f8264009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:16.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:16.858+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82700c1a40 con 0x7f827006f2f0 2023-10-08T16:06:17.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.050+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f82700c1a40 con 0x7f827006f2f0 2023-10-08T16:06:17.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.663+0000 7f826e7fc700 1 -- 172.21.15.60:0/1672125113 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f82700c1a40 con 0x7f827006f2f0 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f825c066f30 msgr2=0x7f825c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f825c066f30 0x7f825c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f82700c1760 tx=0x7f8264009040 comp rx=0 tx=0).stop 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 msgr2=0x7f82700b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 0x7f82700b3090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f827015e4d0 tx=0x7f8268017000 comp rx=0 tx=0).stop 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 shutdown_connections 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f825c066f30 0x7f825c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82701599f0 0x7f82700af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f827006f2f0 0x7f82700b3090 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 --2- 172.21.15.60:0/1672125113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8270070e10 0x7f82700c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 >> 172.21.15.60:0/1672125113 conn(0x7f82700cd8f0 msgr2=0x7f82701582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 shutdown_connections 2023-10-08T16:06:17.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.665+0000 7f82771aa700 1 -- 172.21.15.60:0/1672125113 wait complete. 2023-10-08T16:06:17.667 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:06:17.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:06:17.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.806+0000 7fe795027700 1 Processor -- start 2023-10-08T16:06:17.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.806+0000 7fe795027700 1 -- start start 2023-10-08T16:06:17.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.806+0000 7fe795027700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe790159e50 0x7fe7900b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.806+0000 7fe795027700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900b0d60 con 0x7fe790068cb0 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.806+0000 7fe795027700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900d15b0 con 0x7fe7900b3370 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.806+0000 7fe795027700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7900d1890 con 0x7fe790159e50 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78f59e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe790068cb0 0x7fe7900690e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37616/0 (socket says 172.21.15.60:37616) 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78f59e700 1 -- 172.21.15.60:0/532784701 learned_addr learned my addr 172.21.15.60:0/532784701 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/532784701 >> v2:172.21.15.144:3300/0 conn(0x7fe790159e50 0x7fe7900b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137002 0 0) 0x7fe7900b0d60 con 0x7fe790068cb0 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c003570 con 0x7fe790068cb0 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148839143 0 0) 0x7fe77c003570 con 0x7fe790068cb0 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 >> v2:172.21.15.144:3300/0 conn(0x7fe790159e50 msgr2=0x7fe7900b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 --2- 172.21.15.60:0/532784701 >> v2:172.21.15.144:3300/0 conn(0x7fe790159e50 0x7fe7900b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 >> v1:172.21.15.144:6789/0 conn(0x7fe7900b3370 legacy=0x7fe7900b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900b09f0 con 0x7fe790068cb0 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fe7800017f0 con 0x7fe790068cb0 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 >> v1:172.21.15.60:6789/0 conn(0x7fe790068cb0 legacy=0x7fe7900690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c003a60 0x7fe77c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c004810 0x7fe77c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0051c0 0x7fe77c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900d1890 con 0x7fe77c003a60 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00c0e0 con 0x7fe77c004810 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00c2a0 con 0x7fe77c0051c0 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c003a60 0x7fe77c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.807+0000 7fe78e59c700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c004810 0x7fe77c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78f59e700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0051c0 0x7fe77c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78ed9d700 1 -- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0051c0 msgr2=0x7fe77c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0051c0 0x7fe77c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78ed9d700 1 -- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c004810 msgr2=0x7fe77c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c004810 0x7fe77c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78ed9d700 1 -- 172.21.15.60:0/532784701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c003570 con 0x7fe77c003a60 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78f59e700 1 -- 172.21.15.60:0/532784701 reap_dead start 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c003a60 0x7fe77c003e30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe788009c00 tx=0x7fe7880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bae4018cb40864 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800e710 con 0x7fe77c003a60 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800e870 con 0x7fe77c003a60 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe78dd9b700 1 -- 172.21.15.60:0/532784701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800ec30 con 0x7fe77c003a60 2023-10-08T16:06:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.808+0000 7fe795027700 1 -- 172.21.15.60:0/532784701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c003a60 msgr2=0x7fe77c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.809+0000 7fe795027700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c003a60 0x7fe77c003e30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe788009c00 tx=0x7fe7880091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.809+0000 7fe795027700 1 -- 172.21.15.60:0/532784701 shutdown_connections 2023-10-08T16:06:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.809+0000 7fe795027700 1 --2- 172.21.15.60:0/532784701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c003a60 0x7fe77c003e30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.809+0000 7fe795027700 1 -- 172.21.15.60:0/532784701 >> 172.21.15.60:0/532784701 conn(0x7fe790068130 msgr2=0x7fe7900d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.809+0000 7fe795027700 1 -- 172.21.15.60:0/532784701 shutdown_connections 2023-10-08T16:06:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.809+0000 7fe795027700 1 -- 172.21.15.60:0/532784701 wait complete. 2023-10-08T16:06:17.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.810+0000 7fe795027700 1 Processor -- start 2023-10-08T16:06:17.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.810+0000 7fe795027700 1 -- start start 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c003a60 0x7fe79015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 0x7fe79015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7900cc2e0 0x7fe7900cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900c9730 con 0x7fe790157410 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cccc0 con 0x7fe77c003a60 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cab00 con 0x7fe7900cc2e0 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 0x7fe79015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 0x7fe79015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48502/0 (socket says 172.21.15.60:48502) 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 -- 172.21.15.60:0/3944541472 learned_addr learned my addr 172.21.15.60:0/3944541472 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c003a60 0x7fe79015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78f59e700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7900cc2e0 0x7fe7900cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 -- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7900cc2e0 msgr2=0x7fe7900cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7900cc2e0 0x7fe7900cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 -- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c003a60 msgr2=0x7fe79015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c003a60 0x7fe79015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 -- 172.21.15.60:0/3944541472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79015e570 con 0x7fe790157410 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c003a60 0x7fe79015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78f59e700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7900cc2e0 0x7fe7900cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe78e59c700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 0x7fe79015e030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe778002a10 tx=0x7fe778007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77800f8d0 con 0x7fe790157410 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77800fa50 con 0x7fe790157410 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790157880 con 0x7fe790157410 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77800fe10 con 0x7fe790157410 2023-10-08T16:06:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.811+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79015f160 con 0x7fe790157410 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.812+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7900cacd0 con 0x7fe790157410 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.813+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe778013600 con 0x7fe790157410 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.813+0000 7fe786ffd700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe770066f30 0x7fe7700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.813+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe7780848e0 con 0x7fe790157410 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.813+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe770066f30 0x7fe7700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.813+0000 7fe78ed9d700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe770066f30 0x7fe7700693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7880091e0 tx=0x7fe78801a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:17.817+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe778051cb0 con 0x7fe790157410 2023-10-08T16:06:18.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.009+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe79004c3c0 con 0x7fe790157410 2023-10-08T16:06:18.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.670+0000 7fe786ffd700 1 -- 172.21.15.60:0/3944541472 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe7780170d0 con 0x7fe790157410 2023-10-08T16:06:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.673+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe770066f30 msgr2=0x7fe7700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.673+0000 7fe795027700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe770066f30 0x7fe7700693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7880091e0 tx=0x7fe78801a000 comp rx=0 tx=0).stop 2023-10-08T16:06:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.673+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 msgr2=0x7fe79015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.673+0000 7fe795027700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 0x7fe79015e030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe778002a10 tx=0x7fe778007d10 comp rx=0 tx=0).stop 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.673+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 shutdown_connections 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.673+0000 7fe795027700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe770066f30 0x7fe7700693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.674+0000 7fe795027700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7900cc2e0 0x7fe7900cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.674+0000 7fe795027700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c003a60 0x7fe79015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.674+0000 7fe795027700 1 --2- 172.21.15.60:0/3944541472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe790157410 0x7fe79015e030 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.674+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 >> 172.21.15.60:0/3944541472 conn(0x7fe790068130 msgr2=0x7fe790159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.674+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 shutdown_connections 2023-10-08T16:06:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.674+0000 7fe795027700 1 -- 172.21.15.60:0/3944541472 wait complete. 2023-10-08T16:06:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:06:18.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:06:18.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.811+0000 7ff7774f9700 1 Processor -- start 2023-10-08T16:06:18.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff7774f9700 1 -- start start 2023-10-08T16:06:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff7774f9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7700cd300 0x7ff77015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff7774f9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7700d1470 0x7ff7700cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff7774f9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7701513f0 con 0x7ff7700b6760 2023-10-08T16:06:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff7774f9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77015e7a0 con 0x7ff7700cd300 2023-10-08T16:06:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff7774f9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77015db20 con 0x7ff7700d1470 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff775295700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7700cd300 0x7ff77015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.812+0000 7ff774a94700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff7700b6760 0x7ff7700d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37618/0 (socket says 172.21.15.60:37618) 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff774a94700 1 -- 172.21.15.60:0/3031862296 learned_addr learned my addr 172.21.15.60:0/3031862296 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff775a96700 1 --2- 172.21.15.60:0/3031862296 >> v2:172.21.15.144:3300/0 conn(0x7ff7700d1470 0x7ff7700cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff775295700 1 -- 172.21.15.60:0/3031862296 >> v2:172.21.15.144:3300/0 conn(0x7ff7700d1470 msgr2=0x7ff7700cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff775295700 1 --2- 172.21.15.60:0/3031862296 >> v2:172.21.15.144:3300/0 conn(0x7ff7700d1470 0x7ff7700cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff775295700 1 -- 172.21.15.60:0/3031862296 >> v1:172.21.15.60:6789/0 conn(0x7ff7700b6760 legacy=0x7ff7700d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff775295700 1 -- 172.21.15.60:0/3031862296 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77015de00 con 0x7ff7700cd300 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff76ffff700 1 -- 172.21.15.60:0/3031862296 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070735537 0 0) 0x7ff7701513f0 con 0x7ff7700b6760 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff775295700 1 --2- 172.21.15.60:0/3031862296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff77015afb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff770089a90 tx=0x7ff768009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f36b76385ab9dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff76ffff700 1 -- 172.21.15.60:0/3031862296 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800e070 con 0x7ff7700cd300 2023-10-08T16:06:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff76ffff700 1 -- 172.21.15.60:0/3031862296 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800bc30 con 0x7ff7700cd300 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.813+0000 7ff76ffff700 1 -- 172.21.15.60:0/3031862296 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768012430 con 0x7ff7700cd300 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 -- 172.21.15.60:0/3031862296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 msgr2=0x7ff77015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3031862296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff77015afb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff770089a90 tx=0x7ff768009780 comp rx=0 tx=0).stop 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 -- 172.21.15.60:0/3031862296 shutdown_connections 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3031862296 >> v2:172.21.15.144:3300/0 conn(0x7ff7700d1470 0x7ff7700cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3031862296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff77015afb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 -- 172.21.15.60:0/3031862296 >> 172.21.15.60:0/3031862296 conn(0x7ff770068d90 msgr2=0x7ff770069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 -- 172.21.15.60:0/3031862296 shutdown_connections 2023-10-08T16:06:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.814+0000 7ff7774f9700 1 -- 172.21.15.60:0/3031862296 wait complete. 2023-10-08T16:06:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.815+0000 7ff7774f9700 1 Processor -- start 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.815+0000 7ff7774f9700 1 -- start start 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff7774f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7700b6760 0x7ff7700b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff7774f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff7700c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff7774f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7700d1470 0x7ff7700ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff7774f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700b1b00 con 0x7ff7700cd300 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff7774f9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700b0ef0 con 0x7ff7700b6760 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff7774f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700b11d0 con 0x7ff7700d1470 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff7700c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff7700c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48520/0 (socket says 172.21.15.60:48520) 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 -- 172.21.15.60:0/3240214726 learned_addr learned my addr 172.21.15.60:0/3240214726 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff775295700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7700b6760 0x7ff7700b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff775a96700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7700d1470 0x7ff7700ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 -- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7700d1470 msgr2=0x7ff7700ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7700d1470 0x7ff7700ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 -- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7700b6760 msgr2=0x7ff7700b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7700b6760 0x7ff7700b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 -- 172.21.15.60:0/3240214726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768009a20 con 0x7ff7700cd300 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff774a94700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff7700c6c90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c5b0 tx=0x7ff764001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.816+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764005b30 con 0x7ff7700cd300 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.817+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764005c90 con 0x7ff7700cd300 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.817+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700b14b0 con 0x7ff7700cd300 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.817+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764007300 con 0x7ff7700cd300 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.817+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700c71d0 con 0x7ff7700cd300 2023-10-08T16:06:18.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.818+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77004c3c0 con 0x7ff7700cd300 2023-10-08T16:06:18.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.818+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff76401b3b0 con 0x7ff7700cd300 2023-10-08T16:06:18.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.818+0000 7ff76d7fa700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff75c066f30 0x7ff75c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:18.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.818+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff764083730 con 0x7ff7700cd300 2023-10-08T16:06:18.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.818+0000 7ff775295700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff75c066f30 0x7ff75c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:18.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.819+0000 7ff775295700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff75c066f30 0x7ff75c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff770089a90 tx=0x7ff768019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:18.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:18.823+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff764050ca0 con 0x7ff7700cd300 2023-10-08T16:06:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.015+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff7700b00b0 con 0x7ff7700cd300 2023-10-08T16:06:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.018+0000 7ff76d7fa700 1 -- 172.21.15.60:0/3240214726 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7640542c0 con 0x7ff7700cd300 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.020+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff75c066f30 msgr2=0x7ff75c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff75c066f30 0x7ff75c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff770089a90 tx=0x7ff768019000 comp rx=0 tx=0).stop 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 msgr2=0x7ff7700c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff7700c6c90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c5b0 tx=0x7ff764001070 comp rx=0 tx=0).stop 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 shutdown_connections 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff75c066f30 0x7ff75c0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7700d1470 0x7ff7700ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7700b6760 0x7ff7700b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 --2- 172.21.15.60:0/3240214726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7700cd300 0x7ff7700c6c90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 >> 172.21.15.60:0/3240214726 conn(0x7ff770068d90 msgr2=0x7ff77015a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 shutdown_connections 2023-10-08T16:06:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.021+0000 7ff7774f9700 1 -- 172.21.15.60:0/3240214726 wait complete. 2023-10-08T16:06:19.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-08T16:06:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.151+0000 7f6099a5a700 1 Processor -- start 2023-10-08T16:06:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.151+0000 7f6099a5a700 1 -- start start 2023-10-08T16:06:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6099a5a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60940cbc70 0x7f609415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6099a5a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940d1360 0x7f6094159770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6099a5a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60940cc040 0x7f6094159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6099a5a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609415a1f0 con 0x7f60940cbc70 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6099a5a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609415e1d0 con 0x7f60940cc040 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6099a5a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609415e4b0 con 0x7f60940d1360 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60940cbc70 0x7f609415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60940cbc70 0x7f609415d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48528/0 (socket says 172.21.15.60:48528) 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 -- 172.21.15.60:0/1251025900 learned_addr learned my addr 172.21.15.60:0/1251025900 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f60937fe700 1 --2- 172.21.15.60:0/1251025900 >> v2:172.21.15.144:3300/0 conn(0x7f60940cc040 0x7f6094159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f60927fc700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940d1360 0x7f6094159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 -- 172.21.15.60:0/1251025900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940d1360 msgr2=0x7f6094159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940d1360 0x7f6094159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 -- 172.21.15.60:0/1251025900 >> v2:172.21.15.144:3300/0 conn(0x7f60940cc040 msgr2=0x7f6094159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 --2- 172.21.15.60:0/1251025900 >> v2:172.21.15.144:3300/0 conn(0x7f60940cc040 0x7f6094159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f6092ffd700 1 -- 172.21.15.60:0/1251025900 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609415e790 con 0x7f60940cbc70 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f60937fe700 1 --2- 172.21.15.60:0/1251025900 >> v2:172.21.15.144:3300/0 conn(0x7f60940cc040 0x7f6094159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.152+0000 7f60927fc700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940d1360 0x7f6094159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6092ffd700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415d8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f609415d810 tx=0x7f608c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6932b2b55d6249 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6091ffb700 1 -- 172.21.15.60:0/1251025900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00e070 con 0x7f60940cbc70 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6091ffb700 1 -- 172.21.15.60:0/1251025900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00ba50 con 0x7f60940cbc70 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6091ffb700 1 -- 172.21.15.60:0/1251025900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0092e0 con 0x7f60940cbc70 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 -- 172.21.15.60:0/1251025900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 msgr2=0x7f609415d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415d8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f609415d810 tx=0x7f608c009840 comp rx=0 tx=0).stop 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 -- 172.21.15.60:0/1251025900 shutdown_connections 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 --2- 172.21.15.60:0/1251025900 >> v2:172.21.15.144:3300/0 conn(0x7f60940cc040 0x7f6094159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415d8d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 --2- 172.21.15.60:0/1251025900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940d1360 0x7f6094159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 -- 172.21.15.60:0/1251025900 >> 172.21.15.60:0/1251025900 conn(0x7f6094069650 msgr2=0x7f60940d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:19.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 -- 172.21.15.60:0/1251025900 shutdown_connections 2023-10-08T16:06:19.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.153+0000 7f6099a5a700 1 -- 172.21.15.60:0/1251025900 wait complete. 2023-10-08T16:06:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 Processor -- start 2023-10-08T16:06:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 -- start start 2023-10-08T16:06:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940cc040 0x7f609415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60940d1360 0x7f6094153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609415bd80 con 0x7f60940cbc70 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609415b3b0 con 0x7f60940d1360 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6099a5a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609415ce90 con 0x7f60940cc040 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.155+0000 7f6092ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48544/0 (socket says 172.21.15.60:48544) 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 -- 172.21.15.60:0/4245608360 learned_addr learned my addr 172.21.15.60:0/4245608360 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f60927fc700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940cc040 0x7f609415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f60937fe700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60940d1360 0x7f6094153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 -- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940cc040 msgr2=0x7f609415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940cc040 0x7f609415c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 -- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60940d1360 msgr2=0x7f6094153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60940d1360 0x7f6094153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 -- 172.21.15.60:0/4245608360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009ae0 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6092ffd700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415b840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6094069a50 tx=0x7f608c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c008c60 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c008de0 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609415a7a0 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0266b0 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.156+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609415ade0 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.157+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609404c3c0 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.157+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f608c003040 con 0x7f60940cbc70 2023-10-08T16:06:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.158+0000 7f608affd700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.158+0000 7f60927fc700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.158+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f608c0862f0 con 0x7f60940cbc70 2023-10-08T16:06:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.158+0000 7f60927fc700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6094159d00 tx=0x7f607c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.162+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f608c053910 con 0x7f60940cbc70 2023-10-08T16:06:19.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.433+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f60940ce850 con 0x7f60940cbc70 2023-10-08T16:06:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.672+0000 7f608affd700 1 -- 172.21.15.60:0/4245608360 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v91) v1 ==== 130+0+0 (secure 0 0 0) 0x7f608c056f30 con 0x7f60940cbc70 2023-10-08T16:06:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 msgr2=0x7f60740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6094159d00 tx=0x7f607c008040 comp rx=0 tx=0).stop 2023-10-08T16:06:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 msgr2=0x7f609415b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415b840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6094069a50 tx=0x7f608c018000 comp rx=0 tx=0).stop 2023-10-08T16:06:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 shutdown_connections 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60940d1360 0x7f6094153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60940cbc70 0x7f609415b840 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 --2- 172.21.15.60:0/4245608360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60940cc040 0x7f609415c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 >> 172.21.15.60:0/4245608360 conn(0x7f6094069650 msgr2=0x7f6094159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 shutdown_connections 2023-10-08T16:06:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.674+0000 7f6099a5a700 1 -- 172.21.15.60:0/4245608360 wait complete. 2023-10-08T16:06:19.687 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-08T16:06:19.687 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T16:06:19.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-08T16:06:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.812+0000 7fa08a463700 1 Processor -- start 2023-10-08T16:06:19.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.812+0000 7fa08a463700 1 -- start start 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa08a463700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 0x7fa0840c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa08a463700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0840b1220 0x7fa08406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa08a463700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08415de60 con 0x7fa08406dad0 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa08a463700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08415e140 con 0x7fa0840b1220 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa08a463700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415e420 con 0x7fa0840b0e50 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa088a00700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa08406dad0 0x7fa0840cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37628/0 (socket says 172.21.15.60:37628) 2023-10-08T16:06:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa088a00700 1 -- 172.21.15.60:0/2088994650 learned_addr learned my addr 172.21.15.60:0/2088994650 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa083fff700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 0x7fa0840c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa0837fe700 1 --2- 172.21.15.60:0/2088994650 >> v2:172.21.15.144:3300/0 conn(0x7fa0840b1220 0x7fa08406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270254314 0 0) 0x7fa08415de60 con 0x7fa08406dad0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.813+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa06c003570 con 0x7fa08406dad0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236916927 0 0) 0x7fa06c003570 con 0x7fa08406dad0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 msgr2=0x7fa0840c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 0x7fa0840c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 >> v2:172.21.15.144:3300/0 conn(0x7fa0840b1220 msgr2=0x7fa08406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 --2- 172.21.15.60:0/2088994650 >> v2:172.21.15.144:3300/0 conn(0x7fa0840b1220 0x7fa08406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08415e700 con 0x7fa08406dad0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fa07c0017f0 con 0x7fa08406dad0 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 >> v1:172.21.15.60:6789/0 conn(0x7fa08406dad0 legacy=0x7fa0840cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06c003a60 0x7fa06c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 0x7fa06c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06c004d50 0x7fa06c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415e140 con 0x7fa06c004d50 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415e420 con 0x7fa06c003a60 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c00bae0 con 0x7fa0840b0e50 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06c004d50 0x7fa06c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa083fff700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06c003a60 0x7fa06c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa0837fe700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 0x7fa06c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 -- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 msgr2=0x7fa06c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0840b0e50 0x7fa06c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 -- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06c003a60 msgr2=0x7fa06c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06c003a60 0x7fa06c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 -- 172.21.15.60:0/2088994650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c003570 con 0x7fa06c004d50 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.814+0000 7fa088a00700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06c004d50 0x7fa06c0051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa08406f350 tx=0x7fa0840cd4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d616c6ab8a429c2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0070d0 con 0x7fa06c004d50 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c007230 con 0x7fa06c004d50 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa082ffd700 1 -- 172.21.15.60:0/2088994650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0075f0 con 0x7fa06c004d50 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa08a463700 1 -- 172.21.15.60:0/2088994650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06c004d50 msgr2=0x7fa06c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa08a463700 1 --2- 172.21.15.60:0/2088994650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06c004d50 0x7fa06c0051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa08406f350 tx=0x7fa0840cd4a0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa088a00700 1 -- 172.21.15.60:0/2088994650 reap_dead start 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa08a463700 1 -- 172.21.15.60:0/2088994650 shutdown_connections 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa08a463700 1 -- 172.21.15.60:0/2088994650 >> 172.21.15.60:0/2088994650 conn(0x7fa084069870 msgr2=0x7fa084069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa08a463700 1 -- 172.21.15.60:0/2088994650 shutdown_connections 2023-10-08T16:06:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.815+0000 7fa08a463700 1 -- 172.21.15.60:0/2088994650 wait complete. 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.816+0000 7fa08a463700 1 Processor -- start 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 -- start start 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0841524e0 0x7fa0840b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0840b3700 0x7fa084158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 0x7fa08415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084159420 con 0x7fa084158fb0 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415ae10 con 0x7fa0840b3700 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa08a463700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840b2980 con 0x7fa0841524e0 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa088a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 0x7fa08415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa088a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 0x7fa08415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48562/0 (socket says 172.21.15.60:48562) 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.817+0000 7fa088a00700 1 -- 172.21.15.60:0/1412599261 learned_addr learned my addr 172.21.15.60:0/1412599261 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa083fff700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0841524e0 0x7fa0840b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa0837fe700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0840b3700 0x7fa084158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa088a00700 1 -- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0841524e0 msgr2=0x7fa0840b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa088a00700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0841524e0 0x7fa0840b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa088a00700 1 -- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0840b3700 msgr2=0x7fa084158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa088a00700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0840b3700 0x7fa084158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa088a00700 1 -- 172.21.15.60:0/1412599261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08415a4e0 con 0x7fa084158fb0 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa088a00700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 0x7fa08415b2a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa07c002250 tx=0x7fa07c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0070d0 con 0x7fa084158fb0 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0012d0 con 0x7fa084158fb0 2023-10-08T16:06:19.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08415a7c0 con 0x7fa084158fb0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c007960 con 0x7fa084158fb0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.818+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0840b3b70 con 0x7fa084158fb0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.819+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08404c3c0 con 0x7fa084158fb0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.819+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa07c029460 con 0x7fa084158fb0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.820+0000 7fa06bfff700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa070066f60 0x7fa070069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.820+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa07c086920 con 0x7fa084158fb0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.820+0000 7fa083fff700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa070066f60 0x7fa070069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.820+0000 7fa083fff700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa070066f60 0x7fa070069410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa074006f00 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:19.824+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa07c053e90 con 0x7fa084158fb0 2023-10-08T16:06:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.103+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fa08415af50 con 0x7fa084158fb0 2023-10-08T16:06:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.674+0000 7fa06bfff700 1 -- 172.21.15.60:0/1412599261 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v92) v1 ==== 145+0+0 (secure 0 0 0) 0x7fa07c016070 con 0x7fa084158fb0 2023-10-08T16:06:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa070066f60 msgr2=0x7fa070069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa070066f60 0x7fa070069410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa074006f00 tx=0x7fa074008040 comp rx=0 tx=0).stop 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 msgr2=0x7fa08415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 0x7fa08415b2a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa07c002250 tx=0x7fa07c015000 comp rx=0 tx=0).stop 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 shutdown_connections 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa070066f60 0x7fa070069410 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0841524e0 0x7fa0840b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa084158fb0 0x7fa08415b2a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 --2- 172.21.15.60:0/1412599261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0840b3700 0x7fa084158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 >> 172.21.15.60:0/1412599261 conn(0x7fa084069870 msgr2=0x7fa0840cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 shutdown_connections 2023-10-08T16:06:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.676+0000 7fa08a463700 1 -- 172.21.15.60:0/1412599261 wait complete. 2023-10-08T16:06:20.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T16:06:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_objectstore":"memstore"} 2023-10-08T16:06:20.827 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T16:06:20.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:06:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.948+0000 7fee0ba63700 1 Processor -- start 2023-10-08T16:06:20.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.949+0000 7fee0ba63700 1 -- start start 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee0ba63700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee04154440 0x7fee0415da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee0ba63700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0415e1e0 con 0x7fee0415af30 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee0ba63700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0415e4c0 con 0x7fee0415b380 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee0ba63700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0415dfd0 con 0x7fee04154440 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee097ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee04154440 0x7fee0415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee08ffe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee0415af30 0x7fee04067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37642/0 (socket says 172.21.15.60:37642) 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee08ffe700 1 -- 172.21.15.60:0/1700130796 learned_addr learned my addr 172.21.15.60:0/1700130796 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee097ff700 1 -- 172.21.15.60:0/1700130796 >> v1:172.21.15.144:6789/0 conn(0x7fee0415b380 legacy=0x7fee040cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee097ff700 1 -- 172.21.15.60:0/1700130796 >> v1:172.21.15.60:6789/0 conn(0x7fee0415af30 legacy=0x7fee04067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee097ff700 1 -- 172.21.15.60:0/1700130796 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0415e7a0 con 0x7fee04154440 2023-10-08T16:06:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fedf7fff700 1 -- 172.21.15.60:0/1700130796 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156504362 0 0) 0x7fee0415e1e0 con 0x7fee0415af30 2023-10-08T16:06:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fee097ff700 1 --2- 172.21.15.60:0/1700130796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee04154440 0x7fee0415da90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fedf80098e0 tx=0x7fedf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1140e7153302de6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fedf7fff700 1 -- 172.21.15.60:0/1700130796 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8009e80 con 0x7fee04154440 2023-10-08T16:06:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fedf7fff700 1 -- 172.21.15.60:0/1700130796 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800b860 con 0x7fee04154440 2023-10-08T16:06:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.950+0000 7fedf7fff700 1 -- 172.21.15.60:0/1700130796 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800bbe0 con 0x7fee04154440 2023-10-08T16:06:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 -- 172.21.15.60:0/1700130796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee04154440 msgr2=0x7fee0415da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1700130796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee04154440 0x7fee0415da90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fedf80098e0 tx=0x7fedf80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 -- 172.21.15.60:0/1700130796 shutdown_connections 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1700130796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee04154440 0x7fee0415da90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 -- 172.21.15.60:0/1700130796 >> 172.21.15.60:0/1700130796 conn(0x7fee040d0dd0 msgr2=0x7fee040d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 -- 172.21.15.60:0/1700130796 shutdown_connections 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.951+0000 7fee0ba63700 1 -- 172.21.15.60:0/1700130796 wait complete. 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.952+0000 7fee0ba63700 1 Processor -- start 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.952+0000 7fee0ba63700 1 -- start start 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0ba63700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee04154440 0x7fee04154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0ba63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 0x7fee040b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0ba63700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0415b380 0x7fee0415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0ba63700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b0a10 con 0x7fee0415af30 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0ba63700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b0cf0 con 0x7fee0415b380 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0ba63700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b0fd0 con 0x7fee04154440 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee08ffe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 0x7fee040b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee08ffe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 0x7fee040b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48584/0 (socket says 172.21.15.60:48584) 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee08ffe700 1 -- 172.21.15.60:0/1279988415 learned_addr learned my addr 172.21.15.60:0/1279988415 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee097ff700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee04154440 0x7fee04154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.953+0000 7fee0a000700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0415b380 0x7fee0415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee08ffe700 1 -- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee04154440 msgr2=0x7fee04154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee08ffe700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee04154440 0x7fee04154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee08ffe700 1 -- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0415b380 msgr2=0x7fee0415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee08ffe700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0415b380 0x7fee0415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee08ffe700 1 -- 172.21.15.60:0/1279988415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8009420 con 0x7fee0415af30 2023-10-08T16:06:20.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee08ffe700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 0x7fee040b6800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fee0000c810 tx=0x7fee00007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:20.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00005c00 con 0x7fee0415af30 2023-10-08T16:06:20.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00005d60 con 0x7fee0415af30 2023-10-08T16:06:20.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee040b12b0 con 0x7fee0415af30 2023-10-08T16:06:20.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00007320 con 0x7fee0415af30 2023-10-08T16:06:20.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.954+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040b4a40 con 0x7fee0415af30 2023-10-08T16:06:20.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.955+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee040d0ba0 con 0x7fee0415af30 2023-10-08T16:06:20.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.955+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee0001b3b0 con 0x7fee0415af30 2023-10-08T16:06:20.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.956+0000 7fedf57fa700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fede8066f30 0x7fede80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:20.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.956+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fee00083680 con 0x7fee0415af30 2023-10-08T16:06:20.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.956+0000 7fee097ff700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fede8066f30 0x7fede80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:20.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.956+0000 7fee097ff700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fede8066f30 0x7fede80693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fedf80093f0 tx=0x7fedf8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:20.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:20.960+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee00050bf0 con 0x7fee0415af30 2023-10-08T16:06:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.152+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fee0404c3c0 con 0x7fee0415af30 2023-10-08T16:06:21.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.156+0000 7fedf57fa700 1 -- 172.21.15.60:0/1279988415 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fee000170c0 con 0x7fee0415af30 2023-10-08T16:06:21.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fede8066f30 msgr2=0x7fede80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fede8066f30 0x7fede80693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fedf80093f0 tx=0x7fedf8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 msgr2=0x7fee040b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 0x7fee040b6800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fee0000c810 tx=0x7fee00007d90 comp rx=0 tx=0).stop 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 shutdown_connections 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fede8066f30 0x7fede80693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee04154440 0x7fee04154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0415b380 0x7fee0415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 --2- 172.21.15.60:0/1279988415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0415af30 0x7fee040b6800 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 >> 172.21.15.60:0/1279988415 conn(0x7fee040d0dd0 msgr2=0x7fee0406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 shutdown_connections 2023-10-08T16:06:21.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.158+0000 7fee0ba63700 1 -- 172.21.15.60:0/1279988415 wait complete. 2023-10-08T16:06:21.170 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:06:21.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:06:21.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:06:21.257 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:06:21.257 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:06:21.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.375+0000 7fe26230c700 1 Processor -- start 2023-10-08T16:06:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.375+0000 7fe26230c700 1 -- start start 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe26230c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe26230c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe25c158160 0x7fe25c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe26230c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c069060 con 0x7fe25c0c9560 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe26230c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c15c6e0 con 0x7fe25c158160 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe26230c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c069300 con 0x7fe25c069de0 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe2608a9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe25c158160 0x7fe25c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe2608a9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe25c158160 0x7fe25c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48598/0 (socket says 172.21.15.60:48598) 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe2608a9700 1 -- 172.21.15.60:0/1993630526 learned_addr learned my addr 172.21.15.60:0/1993630526 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.376+0000 7fe25b7fe700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe2608a9700 1 -- 172.21.15.60:0/1993630526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 msgr2=0x7fe25c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe2608a9700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c15bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe2608a9700 1 -- 172.21.15.60:0/1993630526 >> v1:172.21.15.144:6789/0 conn(0x7fe25c0c9560 legacy=0x7fe25c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe2608a9700 1 -- 172.21.15.60:0/1993630526 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c0695e0 con 0x7fe25c158160 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe25b7fe700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe2608a9700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c15c1a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe254009f20 tx=0x7fe254009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efc7b7a082e842 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe25affd700 1 -- 172.21.15.60:0/1993630526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400e070 con 0x7fe25c158160 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe25affd700 1 -- 172.21.15.60:0/1993630526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400ba40 con 0x7fe25c158160 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe25affd700 1 -- 172.21.15.60:0/1993630526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540092e0 con 0x7fe25c158160 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe26230c700 1 -- 172.21.15.60:0/1993630526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 msgr2=0x7fe25c15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe26230c700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c15c1a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe254009f20 tx=0x7fe254009840 comp rx=0 tx=0).stop 2023-10-08T16:06:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe26230c700 1 -- 172.21.15.60:0/1993630526 shutdown_connections 2023-10-08T16:06:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe26230c700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c15c1a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe26230c700 1 --2- 172.21.15.60:0/1993630526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.377+0000 7fe26230c700 1 -- 172.21.15.60:0/1993630526 >> 172.21.15.60:0/1993630526 conn(0x7fe25c067660 msgr2=0x7fe25c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.378+0000 7fe26230c700 1 -- 172.21.15.60:0/1993630526 shutdown_connections 2023-10-08T16:06:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.378+0000 7fe26230c700 1 -- 172.21.15.60:0/1993630526 wait complete. 2023-10-08T16:06:21.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.379+0000 7fe26230c700 1 Processor -- start 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.379+0000 7fe26230c700 1 -- start start 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.379+0000 7fe26230c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25c0c9560 0x7fe25c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0b1f90 con 0x7fe25c158160 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0b1110 con 0x7fe25c0c9560 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c1560e0 con 0x7fe25c069de0 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c0c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48610/0 (socket says 172.21.15.60:48610) 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 -- 172.21.15.60:0/1292793176 learned_addr learned my addr 172.21.15.60:0/1292793176 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe25b7fe700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25c0c9560 0x7fe25c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 -- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 msgr2=0x7fe25c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 -- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25c0c9560 msgr2=0x7fe25c0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25c0c9560 0x7fe25c0b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 -- 172.21.15.60:0/1292793176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009ae0 con 0x7fe25c158160 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe2608a9700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c0c4c90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b6c0 tx=0x7fe254017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540032f0 con 0x7fe25c158160 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254012d30 con 0x7fe25c158160 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c0b1380 con 0x7fe25c158160 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254012ea0 con 0x7fe25c158160 2023-10-08T16:06:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.380+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c0b1940 con 0x7fe25c158160 2023-10-08T16:06:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.381+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c04c3c0 con 0x7fe25c158160 2023-10-08T16:06:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.382+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe25401d900 con 0x7fe25c158160 2023-10-08T16:06:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.382+0000 7fe253fff700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe23c066f30 0x7fe23c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.382+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe254085a00 con 0x7fe25c158160 2023-10-08T16:06:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.382+0000 7fe25bfff700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe23c066f30 0x7fe23c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.383+0000 7fe25bfff700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe23c066f30 0x7fe23c0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe244003a30 tx=0x7fe244007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:21.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.386+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe254052f70 con 0x7fe25c158160 2023-10-08T16:06:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.626+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe25c06a450 con 0x7fe25c158160 2023-10-08T16:06:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.626+0000 7fe253fff700 1 -- 172.21.15.60:0/1292793176 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fe25402ade0 con 0x7fe25c158160 2023-10-08T16:06:21.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:21.627 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2744178948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2744178948},{"type":"v1","addr":"172.21.15.144:6835","nonce":2744178948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/98135300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":98135300},{"type":"v1","addr":"172.21.15.144:6833","nonce":98135300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/623675896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":623675896},{"type":"v1","addr":"172.21.15.60:6836","nonce":623675896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1122721678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1122721678},{"type":"v1","addr":"172.21.15.60:6837","nonce":1122721678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe23c066f30 msgr2=0x7fe23c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe23c066f30 0x7fe23c0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe244003a30 tx=0x7fe244007ea0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 msgr2=0x7fe25c0c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c0c4c90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b6c0 tx=0x7fe254017000 comp rx=0 tx=0).stop 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 shutdown_connections 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe23c066f30 0x7fe23c0693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe25c069de0 0x7fe25c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c158160 0x7fe25c0c4c90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 --2- 172.21.15.60:0/1292793176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe25c0c9560 0x7fe25c0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 >> 172.21.15.60:0/1292793176 conn(0x7fe25c067660 msgr2=0x7fe25c0cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.628+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 shutdown_connections 2023-10-08T16:06:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.629+0000 7fe26230c700 1 -- 172.21.15.60:0/1292793176 wait complete. 2023-10-08T16:06:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 20 2023-10-08T16:06:21.641 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:06:21.641 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:06:21.641 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:06:21.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:06:21.642 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:06:21.642 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:06:21.642 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:06:21.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:06:21.642 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:06:21.642 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:06:21.643 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:06:21.643 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:06:21.643 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:06:21.643 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:06:21.643 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:06:21.643 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:06:21.650 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:06:21.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:06:21.651 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:06:21.651 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:06:21.653 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:06:21.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:06:21.654 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:06:21.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:06:21.692 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:06:21.693 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:21.693 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:06:21.693 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:21.695 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:06:21.695 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:21.696 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:06:21.696 DEBUG:teuthology.parallel:result is None 2023-10-08T16:06:21.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:06:21.768 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:06:21.768 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:06:21.776 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:06:21.776 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:06:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.821+0000 7f522b6f0700 1 Processor -- start 2023-10-08T16:06:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.822+0000 7f522b6f0700 1 -- start start 2023-10-08T16:06:21.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.822+0000 7f522b6f0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5224157270 0x7f52240c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.822+0000 7f522b6f0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52240c42b0 con 0x7f5224156ea0 2023-10-08T16:06:21.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.822+0000 7f522b6f0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52240c36a0 con 0x7f522406e2b0 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.822+0000 7f522b6f0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522406fac0 con 0x7f5224157270 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f522948c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5224156ea0 0x7f522406f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37664/0 (socket says 172.21.15.60:37664) 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f522948c700 1 -- 172.21.15.60:0/1850606007 learned_addr learned my addr 172.21.15.60:0/1850606007 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5228c8b700 1 --2- 172.21.15.60:0/1850606007 >> v2:172.21.15.60:3300/0 conn(0x7f5224157270 0x7f52240c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5223fff700 1 -- 172.21.15.60:0/1850606007 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176595340 0 0) 0x7f52240c42b0 con 0x7f5224156ea0 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5223fff700 1 -- 172.21.15.60:0/1850606007 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f520c003570 con 0x7f5224156ea0 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5228c8b700 1 -- 172.21.15.60:0/1850606007 >> v1:172.21.15.144:6789/0 conn(0x7f522406e2b0 legacy=0x7f522406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5228c8b700 1 -- 172.21.15.60:0/1850606007 >> v1:172.21.15.60:6789/0 conn(0x7f5224156ea0 legacy=0x7f522406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5228c8b700 1 -- 172.21.15.60:0/1850606007 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52240c3980 con 0x7f5224157270 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5228c8b700 1 --2- 172.21.15.60:0/1850606007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224157270 0x7f52240c30c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f52180098e0 tx=0x7f52180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d0ff89e12de455 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5223fff700 1 -- 172.21.15.60:0/1850606007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800b640 con 0x7f5224157270 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5223fff700 1 -- 172.21.15.60:0/1850606007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800b7a0 con 0x7f5224157270 2023-10-08T16:06:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.823+0000 7f5223fff700 1 -- 172.21.15.60:0/1850606007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800bb20 con 0x7f5224157270 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 -- 172.21.15.60:0/1850606007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224157270 msgr2=0x7f52240c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1850606007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224157270 0x7f52240c30c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f52180098e0 tx=0x7f52180091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 -- 172.21.15.60:0/1850606007 shutdown_connections 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1850606007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224157270 0x7f52240c30c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 -- 172.21.15.60:0/1850606007 >> 172.21.15.60:0/1850606007 conn(0x7f52240ca4f0 msgr2=0x7f52240ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 -- 172.21.15.60:0/1850606007 shutdown_connections 2023-10-08T16:06:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.824+0000 7f522b6f0700 1 -- 172.21.15.60:0/1850606007 wait complete. 2023-10-08T16:06:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.825+0000 7f522b6f0700 1 Processor -- start 2023-10-08T16:06:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.825+0000 7f522b6f0700 1 -- start start 2023-10-08T16:06:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522b6f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 0x7f522414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522b6f0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5224156ea0 0x7f52240afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522b6f0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224157270 0x7f52240b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522b6f0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522416b630 con 0x7f522406e2b0 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522b6f0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52240c62c0 con 0x7f5224157270 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522b6f0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522416aa20 con 0x7f5224156ea0 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 0x7f522414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 0x7f522414f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48650/0 (socket says 172.21.15.60:48650) 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 -- 172.21.15.60:0/1377969363 learned_addr learned my addr 172.21.15.60:0/1377969363 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f5229c8d700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224157270 0x7f52240b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f5228c8b700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5224156ea0 0x7f52240afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 -- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5224156ea0 msgr2=0x7f52240afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5224156ea0 0x7f52240afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 -- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224157270 msgr2=0x7f52240b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224157270 0x7f52240b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 -- 172.21.15.60:0/1377969363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009420 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.826+0000 7f522948c700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 0x7f522414f4c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f521c00c7c0 tx=0x7f521c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.827+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c005cd0 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.827+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c005e30 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.827+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c007320 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.827+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522416ad00 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.827+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522416b2c0 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.828+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522404c3c0 con 0x7f522406e2b0 2023-10-08T16:06:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.828+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f521c01b3b0 con 0x7f522406e2b0 2023-10-08T16:06:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.828+0000 7f52217fa700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5210066f30 0x7f52100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.829+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f521c0838d0 con 0x7f522406e2b0 2023-10-08T16:06:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.829+0000 7f5228c8b700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5210066f30 0x7f52100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.829+0000 7f5228c8b700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5210066f30 0x7f52100693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5224157680 tx=0x7f5218017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:21.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:21.833+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f521c050e40 con 0x7f522406e2b0 2023-10-08T16:06:22.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:22.043+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f522406b620 con 0x7f522406e2b0 2023-10-08T16:06:23.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.178+0000 7f52217fa700 1 -- 172.21.15.60:0/1377969363 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f521c017020 con 0x7f522406e2b0 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5210066f30 msgr2=0x7f52100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5210066f30 0x7f52100693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5224157680 tx=0x7f5218017000 comp rx=0 tx=0).stop 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 msgr2=0x7f522414f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 0x7f522414f4c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f521c00c7c0 tx=0x7f521c007e00 comp rx=0 tx=0).stop 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 shutdown_connections 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5210066f30 0x7f52100693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224157270 0x7f52240b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f522406e2b0 0x7f522414f4c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 --2- 172.21.15.60:0/1377969363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5224156ea0 0x7f52240afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.181+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 >> 172.21.15.60:0/1377969363 conn(0x7f52240ca4f0 msgr2=0x7f52240c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.182+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 shutdown_connections 2023-10-08T16:06:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.182+0000 7f522b6f0700 1 -- 172.21.15.60:0/1377969363 wait complete. 2023-10-08T16:06:23.183 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:06:23.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:06:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 Processor -- start 2023-10-08T16:06:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 -- start start 2023-10-08T16:06:23.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3f2815a2b0 0x7f3f280b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3f280cfe20 0x7f3f280ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f280c5d80 con 0x7f3f280d1c30 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f28068470 con 0x7f3f2815a2b0 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.323+0000 7f3f2d941700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f280c6060 con 0x7f3f280cfe20 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3f2815a2b0 0x7f3f280b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3f2815a2b0 0x7f3f280b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58582/0 (socket says 172.21.15.60:58582) 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 -- 172.21.15.60:0/2165623653 learned_addr learned my addr 172.21.15.60:0/2165623653 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f277fe700 1 --2- 172.21.15.60:0/2165623653 >> v2:172.21.15.144:3300/0 conn(0x7f3f280cfe20 0x7f3f280ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 -- 172.21.15.60:0/2165623653 >> v2:172.21.15.144:3300/0 conn(0x7f3f280cfe20 msgr2=0x7f3f280ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 --2- 172.21.15.60:0/2165623653 >> v2:172.21.15.144:3300/0 conn(0x7f3f280cfe20 0x7f3f280ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 -- 172.21.15.60:0/2165623653 >> v1:172.21.15.144:6789/0 conn(0x7f3f280d1c30 legacy=0x7f3f280cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 -- 172.21.15.60:0/2165623653 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280c6340 con 0x7f3f2815a2b0 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f277fe700 1 --2- 172.21.15.60:0/2165623653 >> v2:172.21.15.144:3300/0 conn(0x7f3f280cfe20 0x7f3f280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f26ffd700 1 --2- 172.21.15.60:0/2165623653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f2815a2b0 0x7f3f280b3da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3f28064970 tx=0x7f3f20009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7cefa0a0bd67dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f25ffb700 1 -- 172.21.15.60:0/2165623653 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20005c10 con 0x7f3f2815a2b0 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f25ffb700 1 -- 172.21.15.60:0/2165623653 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f20005d70 con 0x7f3f2815a2b0 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.324+0000 7f3f25ffb700 1 -- 172.21.15.60:0/2165623653 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000b840 con 0x7f3f2815a2b0 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 -- 172.21.15.60:0/2165623653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f2815a2b0 msgr2=0x7f3f280b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 --2- 172.21.15.60:0/2165623653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f2815a2b0 0x7f3f280b3da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3f28064970 tx=0x7f3f20009220 comp rx=0 tx=0).stop 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 -- 172.21.15.60:0/2165623653 shutdown_connections 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 --2- 172.21.15.60:0/2165623653 >> v2:172.21.15.144:3300/0 conn(0x7f3f280cfe20 0x7f3f280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 --2- 172.21.15.60:0/2165623653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f2815a2b0 0x7f3f280b3da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 -- 172.21.15.60:0/2165623653 >> 172.21.15.60:0/2165623653 conn(0x7f3f28067e40 msgr2=0x7f3f280d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 -- 172.21.15.60:0/2165623653 shutdown_connections 2023-10-08T16:06:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.325+0000 7f3f2d941700 1 -- 172.21.15.60:0/2165623653 wait complete. 2023-10-08T16:06:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.326+0000 7f3f2d941700 1 Processor -- start 2023-10-08T16:06:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.326+0000 7f3f2d941700 1 -- start start 2023-10-08T16:06:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f2d941700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3f280cfe20 0x7f3f2814baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f2d941700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 0x7f3f280c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f2d941700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f2815a2b0 0x7f3f280c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f2d941700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280c9220 con 0x7f3f280d1c30 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f2d941700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815ab90 con 0x7f3f2815a2b0 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f2d941700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815dda0 con 0x7f3f280cfe20 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 0x7f3f280c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 0x7f3f280c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58598/0 (socket says 172.21.15.60:58598) 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 -- 172.21.15.60:0/1598092922 learned_addr learned my addr 172.21.15.60:0/1598092922 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f277fe700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f2815a2b0 0x7f3f280c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f26ffd700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3f280cfe20 0x7f3f2814baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 -- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3f280cfe20 msgr2=0x7f3f2814baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3f280cfe20 0x7f3f2814baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 -- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f2815a2b0 msgr2=0x7f3f280c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f2815a2b0 0x7f3f280c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f267fc700 1 -- 172.21.15.60:0/1598092922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009480 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f277fe700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f2815a2b0 0x7f3f280c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.327+0000 7f3f26ffd700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3f280cfe20 0x7f3f2814baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.328+0000 7f3f267fc700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 0x7f3f280c8090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b5e0 tx=0x7f3f100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.328+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000f510 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.328+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000f6b0 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.328+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f280c8c60 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.328+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000fa70 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.328+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2815a820 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.329+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2815a680 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.329+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f1001a400 con 0x7f3f280d1c30 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.330+0000 7f3f1effd700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f08066f30 0x7f3f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.330+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3f10083d30 con 0x7f3f280d1c30 2023-10-08T16:06:23.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.330+0000 7f3f26ffd700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f08066f30 0x7f3f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.330+0000 7f3f26ffd700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f08066f30 0x7f3f080693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f20003080 tx=0x7f3f20015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:23.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.334+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f2815a680 con 0x7f3f280d1c30 2023-10-08T16:06:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.608+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3f2815a680 con 0x7f3f280d1c30 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.608+0000 7f3f1effd700 1 -- 172.21.15.60:0/1598092922 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3f2815a680 con 0x7f3f280d1c30 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:06:23.609 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:06:23.610 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.613 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.614 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:06:23.616 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:06:23.619 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:06:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:06:23.622 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:06:23.623 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:06:23.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:06:23.625 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:06:23.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:23.625 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:23.625 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f08066f30 msgr2=0x7f3f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f08066f30 0x7f3f080693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f20003080 tx=0x7f3f20015000 comp rx=0 tx=0).stop 2023-10-08T16:06:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 msgr2=0x7f3f280c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 0x7f3f280c8090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b5e0 tx=0x7f3f100090f0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 shutdown_connections 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f08066f30 0x7f3f080693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3f280cfe20 0x7f3f2814baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f2815a2b0 0x7f3f280c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 --2- 172.21.15.60:0/1598092922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f280d1c30 0x7f3f280c8090 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 >> 172.21.15.60:0/1598092922 conn(0x7f3f28067e40 msgr2=0x7f3f280ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 shutdown_connections 2023-10-08T16:06:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.611+0000 7f3f2d941700 1 -- 172.21.15.60:0/1598092922 wait complete. 2023-10-08T16:06:23.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:23.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0d1020700 1 Processor -- start 2023-10-08T16:06:23.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0d1020700 1 -- start start 2023-10-08T16:06:23.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0d1020700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0cc157c40 0x7fa0cc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0d1020700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc15cbb0 con 0x7fa0cc15a620 2023-10-08T16:06:23.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0d1020700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc15bfa0 con 0x7fa0cc157870 2023-10-08T16:06:23.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0d1020700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc15bdb0 con 0x7fa0cc157c40 2023-10-08T16:06:23.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0ca59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa0cc15a620 0x7fa0cc15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59362/0 (socket says 172.21.15.60:59362) 2023-10-08T16:06:23.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.747+0000 7fa0ca59c700 1 -- 172.21.15.60:0/87141093 learned_addr learned my addr 172.21.15.60:0/87141093 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:23.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0cb59e700 1 --2- 172.21.15.60:0/87141093 >> v2:172.21.15.144:3300/0 conn(0x7fa0cc157c40 0x7fa0cc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099259911 0 0) 0x7fa0cc15cbb0 con 0x7fa0cc15a620 2023-10-08T16:06:23.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b8003570 con 0x7fa0cc15a620 2023-10-08T16:06:23.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739082003 0 0) 0x7fa0cc15bfa0 con 0x7fa0cc157870 2023-10-08T16:06:23.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0cc15cbb0 con 0x7fa0cc157870 2023-10-08T16:06:23.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016672241 0 0) 0x7fa0b8003570 con 0x7fa0cc15a620 2023-10-08T16:06:23.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 >> v2:172.21.15.144:3300/0 conn(0x7fa0cc157c40 msgr2=0x7fa0cc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:23.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 --2- 172.21.15.60:0/87141093 >> v2:172.21.15.144:3300/0 conn(0x7fa0cc157c40 0x7fa0cc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 >> v1:172.21.15.144:6789/0 conn(0x7fa0cc157870 legacy=0x7fa0cc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc15c280 con 0x7fa0cc15a620 2023-10-08T16:06:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fa0b4001470 con 0x7fa0cc15a620 2023-10-08T16:06:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 >> v1:172.21.15.60:6789/0 conn(0x7fa0cc15a620 legacy=0x7fa0cc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b8003bf0 0x7fa0b8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0b80051c0 0x7fa0b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b800c130 con 0x7fa0b8003bf0 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b800c2a0 con 0x7fa0b8004810 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b800c460 con 0x7fa0b80051c0 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b8003bf0 0x7fa0b8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0ca59c700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.748+0000 7fa0cb59e700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0b80051c0 0x7fa0b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cad9d700 1 -- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0b80051c0 msgr2=0x7fa0b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0b80051c0 0x7fa0b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cad9d700 1 -- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8004810 msgr2=0x7fa0b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8004810 0x7fa0b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cad9d700 1 -- 172.21.15.60:0/87141093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8003570 con 0x7fa0b8003bf0 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cb59e700 1 -- 172.21.15.60:0/87141093 reap_dead start 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b8003bf0 0x7fa0b8003fe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40020f0 tx=0x7fa0c40017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56018e4428418c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4001ab0 con 0x7fa0b8003bf0 2023-10-08T16:06:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4006ba0 con 0x7fa0b8003bf0 2023-10-08T16:06:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0c9d9b700 1 -- 172.21.15.60:0/87141093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c400c870 con 0x7fa0b8003bf0 2023-10-08T16:06:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 -- 172.21.15.60:0/87141093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b8003bf0 msgr2=0x7fa0b8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b8003bf0 0x7fa0b8003fe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40020f0 tx=0x7fa0c40017a0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 -- 172.21.15.60:0/87141093 shutdown_connections 2023-10-08T16:06:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 --2- 172.21.15.60:0/87141093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b8003bf0 0x7fa0b8003fe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 -- 172.21.15.60:0/87141093 >> 172.21.15.60:0/87141093 conn(0x7fa0cc068ce0 msgr2=0x7fa0cc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 -- 172.21.15.60:0/87141093 shutdown_connections 2023-10-08T16:06:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.749+0000 7fa0d1020700 1 -- 172.21.15.60:0/87141093 wait complete. 2023-10-08T16:06:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 Processor -- start 2023-10-08T16:06:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 -- start start 2023-10-08T16:06:23.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8003bf0 0x7fa0cc14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 0x7fa0cc0b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0cc151920 0x7fa0cc151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc153d10 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc1522d0 con 0x7fa0b8003bf0 2023-10-08T16:06:23.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.751+0000 7fa0d1020700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b0740 con 0x7fa0cc151920 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 0x7fa0cc0b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 0x7fa0cc0b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58616/0 (socket says 172.21.15.60:58616) 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 -- 172.21.15.60:0/255680319 learned_addr learned my addr 172.21.15.60:0/255680319 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8003bf0 0x7fa0cc14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0cb59e700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0cc151920 0x7fa0cc151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 -- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0cc151920 msgr2=0x7fa0cc151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0cc151920 0x7fa0cc151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 -- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8003bf0 msgr2=0x7fa0cc14bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8003bf0 0x7fa0cc14bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 -- 172.21.15.60:0/255680319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0b0a20 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0ca59c700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 0x7fa0cc0b1c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4000fd0 tx=0x7fa0b4001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:23.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4011590 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40116f0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4011ab0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc0b0d00 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.752+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc0b12c0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.753+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc0b14e0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.754+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0b401d460 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.754+0000 7fa0c2ffd700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0ac066f30 0x7fa0ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.754+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa0b4084210 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.754+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0ac066f30 0x7fa0ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.755+0000 7fa0cad9d700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0ac066f30 0x7fa0ac0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40020f0 tx=0x7fa0c4015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:23.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.758+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0b40517d0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.955+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0cc04c3c0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.956+0000 7fa0c2ffd700 1 -- 172.21.15.60:0/255680319 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fa0b4054df0 con 0x7fa0cc0b17e0 2023-10-08T16:06:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:23.956 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":42,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:23.175685+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:23.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0ac066f30 msgr2=0x7fa0ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0ac066f30 0x7fa0ac0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40020f0 tx=0x7fa0c4015000 comp rx=0 tx=0).stop 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 msgr2=0x7fa0cc0b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 0x7fa0cc0b1c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4000fd0 tx=0x7fa0b4001df0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 shutdown_connections 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0ac066f30 0x7fa0ac0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0cc151920 0x7fa0cc151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b8003bf0 0x7fa0cc14bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 --2- 172.21.15.60:0/255680319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0cc0b17e0 0x7fa0cc0b1c50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 >> 172.21.15.60:0/255680319 conn(0x7fa0cc068ce0 msgr2=0x7fa0cc0b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 shutdown_connections 2023-10-08T16:06:23.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:23.958+0000 7fa0d1020700 1 -- 172.21.15.60:0/255680319 wait complete. 2023-10-08T16:06:23.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:06:23.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:06:24.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.091+0000 7fd36eff6700 1 Processor -- start 2023-10-08T16:06:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.091+0000 7fd36eff6700 1 -- start start 2023-10-08T16:06:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36eff6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd3680af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36eff6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd36815a290 0x7fd3680afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36eff6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680b0790 con 0x7fd36806a5a0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36eff6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680ce1f0 con 0x7fd36815a290 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36eff6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680b0b20 con 0x7fd368159ec0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36d593700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd36806a5a0 0x7fd36815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59376/0 (socket says 172.21.15.60:59376) 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36d593700 1 -- 172.21.15.60:0/1392182571 learned_addr learned my addr 172.21.15.60:0/1392182571 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd36cd92700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd3680af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.092+0000 7fd367fff700 1 --2- 172.21.15.60:0/1392182571 >> v2:172.21.15.144:3300/0 conn(0x7fd36815a290 0x7fd3680afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd3677fe700 1 -- 172.21.15.60:0/1392182571 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978521583 0 0) 0x7fd3680b0790 con 0x7fd36806a5a0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd3677fe700 1 -- 172.21.15.60:0/1392182571 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd358003570 con 0x7fd36806a5a0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd3677fe700 1 -- 172.21.15.60:0/1392182571 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2068454537 0 0) 0x7fd358003570 con 0x7fd36806a5a0 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd367fff700 1 -- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 msgr2=0x7fd3680af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd367fff700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd3680af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd367fff700 1 -- 172.21.15.60:0/1392182571 >> v1:172.21.15.60:6789/0 conn(0x7fd36806a5a0 legacy=0x7fd36815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd367fff700 1 -- 172.21.15.60:0/1392182571 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680b04b0 con 0x7fd36815a290 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd36cd92700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd3680af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd367fff700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd3680afe80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098e0 tx=0x7fd3540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd28ee601fd3189e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd3677fe700 1 -- 172.21.15.60:0/1392182571 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600017f0 con 0x7fd36815a290 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd3677fe700 1 -- 172.21.15.60:0/1392182571 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354011420 con 0x7fd36815a290 2023-10-08T16:06:24.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.093+0000 7fd3677fe700 1 -- 172.21.15.60:0/1392182571 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3540117c0 con 0x7fd36815a290 2023-10-08T16:06:24.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 -- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 msgr2=0x7fd3680afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd3680afe80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098e0 tx=0x7fd3540091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 -- 172.21.15.60:0/1392182571 shutdown_connections 2023-10-08T16:06:24.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd3680af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 --2- 172.21.15.60:0/1392182571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd3680afe80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 -- 172.21.15.60:0/1392182571 >> 172.21.15.60:0/1392182571 conn(0x7fd3680d1880 msgr2=0x7fd3680cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:24.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 -- 172.21.15.60:0/1392182571 shutdown_connections 2023-10-08T16:06:24.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.094+0000 7fd36eff6700 1 -- 172.21.15.60:0/1392182571 wait complete. 2023-10-08T16:06:24.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.095+0000 7fd36eff6700 1 Processor -- start 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.095+0000 7fd36eff6700 1 -- start start 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36eff6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 0x7fd36815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36eff6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd36816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36eff6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd368154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36eff6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36816dc30 con 0x7fd36806a5a0 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36eff6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36816a930 con 0x7fd36815a290 2023-10-08T16:06:24.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36eff6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36816abb0 con 0x7fd368159ec0 2023-10-08T16:06:24.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 0x7fd36815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 0x7fd36815f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58624/0 (socket says 172.21.15.60:58624) 2023-10-08T16:06:24.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 -- 172.21.15.60:0/3299158108 learned_addr learned my addr 172.21.15.60:0/3299158108 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:24.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36d593700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd368154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd367fff700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd36816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 -- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 msgr2=0x7fd36816a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd36816a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 -- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 msgr2=0x7fd368154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd368154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 -- 172.21.15.60:0/3299158108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c009420 con 0x7fd36806a5a0 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.096+0000 7fd36cd92700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 0x7fd36815f3a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00ec80 tx=0x7fd35c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.097+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00c920 con 0x7fd36806a5a0 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.097+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c00ca80 con 0x7fd36806a5a0 2023-10-08T16:06:24.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.097+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd354009420 con 0x7fd36806a5a0 2023-10-08T16:06:24.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.097+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00ce00 con 0x7fd36806a5a0 2023-10-08T16:06:24.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.097+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36816b170 con 0x7fd36806a5a0 2023-10-08T16:06:24.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.098+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36816da00 con 0x7fd36806a5a0 2023-10-08T16:06:24.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.098+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd35c013680 con 0x7fd36806a5a0 2023-10-08T16:06:24.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.099+0000 7fd364ff9700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd34c066f30 0x7fd34c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.099+0000 7fd367fff700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd34c066f30 0x7fd34c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.099+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd35c0848d0 con 0x7fd36806a5a0 2023-10-08T16:06:24.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.099+0000 7fd367fff700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd34c066f30 0x7fd34c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3540030c0 tx=0x7fd354016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.103+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd35c051e90 con 0x7fd36806a5a0 2023-10-08T16:06:24.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.294+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd36816b360 con 0x7fd36806a5a0 2023-10-08T16:06:24.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.295+0000 7fd364ff9700 1 -- 172.21.15.60:0/3299158108 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd35c0170a0 con 0x7fd36806a5a0 2023-10-08T16:06:24.295 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:06:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd34c066f30 msgr2=0x7fd34c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd34c066f30 0x7fd34c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3540030c0 tx=0x7fd354016000 comp rx=0 tx=0).stop 2023-10-08T16:06:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 msgr2=0x7fd36815f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 0x7fd36815f3a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00ec80 tx=0x7fd35c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 shutdown_connections 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd34c066f30 0x7fd34c0693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd36815a290 0x7fd368154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36806a5a0 0x7fd36815f3a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 --2- 172.21.15.60:0/3299158108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd368159ec0 0x7fd36816a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 >> 172.21.15.60:0/3299158108 conn(0x7fd3680d1880 msgr2=0x7fd368155640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 shutdown_connections 2023-10-08T16:06:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.297+0000 7fd36eff6700 1 -- 172.21.15.60:0/3299158108 wait complete. 2023-10-08T16:06:24.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:06:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.429+0000 7f8e014a2700 1 Processor -- start 2023-10-08T16:06:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.429+0000 7f8e014a2700 1 -- start start 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8e014a2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8dfc06a130 0x7f8dfc0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8e014a2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8dfc0b3d20 0x7f8dfc0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8e014a2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc0cece0 con 0x7f8dfc069d60 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8e014a2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0cefc0 con 0x7f8dfc0b3d20 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8e014a2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0cf2a0 con 0x7f8dfc06a130 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8dfc069d60 0x7f8dfc068ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59378/0 (socket says 172.21.15.60:59378) 2023-10-08T16:06:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfaffd700 1 -- 172.21.15.60:0/4280723873 learned_addr learned my addr 172.21.15.60:0/4280723873 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfb7fe700 1 --2- 172.21.15.60:0/4280723873 >> v2:172.21.15.60:3300/0 conn(0x7f8dfc0b3d20 0x7f8dfc0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfa7fc700 1 --2- 172.21.15.60:0/4280723873 >> v2:172.21.15.144:3300/0 conn(0x7f8dfc06a130 0x7f8dfc0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfb7fe700 1 -- 172.21.15.60:0/4280723873 >> v2:172.21.15.144:3300/0 conn(0x7f8dfc06a130 msgr2=0x7f8dfc0b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfb7fe700 1 --2- 172.21.15.60:0/4280723873 >> v2:172.21.15.144:3300/0 conn(0x7f8dfc06a130 0x7f8dfc0b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfb7fe700 1 -- 172.21.15.60:0/4280723873 >> v1:172.21.15.60:6789/0 conn(0x7f8dfc069d60 legacy=0x7f8dfc068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.430+0000 7f8dfb7fe700 1 -- 172.21.15.60:0/4280723873 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0cf580 con 0x7f8dfc0b3d20 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8dfb7fe700 1 --2- 172.21.15.60:0/4280723873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc0b3d20 0x7f8dfc0b4180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0cf860 tx=0x7f8df40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9413d028f174926 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8df9ffb700 1 -- 172.21.15.60:0/4280723873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400b6b0 con 0x7f8dfc0b3d20 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8df9ffb700 1 -- 172.21.15.60:0/4280723873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400b810 con 0x7f8dfc0b3d20 2023-10-08T16:06:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8df9ffb700 1 -- 172.21.15.60:0/4280723873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400bbb0 con 0x7f8dfc0b3d20 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 -- 172.21.15.60:0/4280723873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc0b3d20 msgr2=0x7f8dfc0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4280723873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc0b3d20 0x7f8dfc0b4180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0cf860 tx=0x7f8df40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 -- 172.21.15.60:0/4280723873 shutdown_connections 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4280723873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc0b3d20 0x7f8dfc0b4180 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4280723873 >> v2:172.21.15.144:3300/0 conn(0x7f8dfc06a130 0x7f8dfc0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 -- 172.21.15.60:0/4280723873 >> 172.21.15.60:0/4280723873 conn(0x7f8dfc070700 msgr2=0x7f8dfc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 -- 172.21.15.60:0/4280723873 shutdown_connections 2023-10-08T16:06:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.431+0000 7f8e014a2700 1 -- 172.21.15.60:0/4280723873 wait complete. 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 Processor -- start 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 -- start start 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 0x7f8dfc0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06a130 0x7f8dfc155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dfc0b3d20 0x7f8dfc169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c8de0 con 0x7f8dfc069d60 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c8000 con 0x7f8dfc06a130 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8e014a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c8260 con 0x7f8dfc0b3d20 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.433+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 0x7f8dfc0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 0x7f8dfc0c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58634/0 (socket says 172.21.15.60:58634) 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 -- 172.21.15.60:0/4240156977 learned_addr learned my addr 172.21.15.60:0/4240156977 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfa7fc700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06a130 0x7f8dfc155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfb7fe700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dfc0b3d20 0x7f8dfc169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 -- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dfc0b3d20 msgr2=0x7f8dfc169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dfc0b3d20 0x7f8dfc169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 -- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06a130 msgr2=0x7f8dfc155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06a130 0x7f8dfc155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 -- 172.21.15.60:0/4240156977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009420 con 0x7f8dfc069d60 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfb7fe700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dfc0b3d20 0x7f8dfc169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfa7fc700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06a130 0x7f8dfc155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8dfaffd700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 0x7f8dfc0c5a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00cd30 tx=0x7f8dec001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec004bb0 con 0x7f8dfc069d60 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec004d10 con 0x7f8dfc069d60 2023-10-08T16:06:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00adc0 con 0x7f8dfc069d60 2023-10-08T16:06:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc0c8540 con 0x7f8dfc069d60 2023-10-08T16:06:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.434+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc0c8b80 con 0x7f8dfc069d60 2023-10-08T16:06:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.435+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc0ce530 con 0x7f8dfc069d60 2023-10-08T16:06:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.435+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8dec007300 con 0x7f8dfc069d60 2023-10-08T16:06:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.436+0000 7f8de2ffd700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8de8066f30 0x7f8de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.436+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8dec083bd0 con 0x7f8dfc069d60 2023-10-08T16:06:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.436+0000 7f8dfa7fc700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8de8066f30 0x7f8de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.436+0000 7f8dfa7fc700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8de8066f30 0x7f8de80693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc156700 tx=0x7f8df0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.440+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dec051210 con 0x7f8dfc069d60 2023-10-08T16:06:24.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.635+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8dfc0c6000 con 0x7f8dfc069d60 2023-10-08T16:06:24.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.636+0000 7f8de2ffd700 1 -- 172.21.15.60:0/4240156977 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8dec018090 con 0x7f8dfc069d60 2023-10-08T16:06:24.636 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:24.636 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:06:24.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:24.636 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:06:24.636 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:06:24.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:24.637 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:06:24.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8de8066f30 msgr2=0x7f8de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8de8066f30 0x7f8de80693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc156700 tx=0x7f8df0008040 comp rx=0 tx=0).stop 2023-10-08T16:06:24.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 msgr2=0x7f8dfc0c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 0x7f8dfc0c5a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00cd30 tx=0x7f8dec001ad0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 shutdown_connections 2023-10-08T16:06:24.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8de8066f30 0x7f8de80693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dfc0b3d20 0x7f8dfc169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dfc069d60 0x7f8dfc0c5a00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 --2- 172.21.15.60:0/4240156977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06a130 0x7f8dfc155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.637+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 >> 172.21.15.60:0/4240156977 conn(0x7f8dfc070700 msgr2=0x7f8dfc068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.638+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 shutdown_connections 2023-10-08T16:06:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.638+0000 7f8e014a2700 1 -- 172.21.15.60:0/4240156977 wait complete. 2023-10-08T16:06:24.650 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:06:24.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:06:24.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.773+0000 7f771339a700 1 Processor -- start 2023-10-08T16:06:24.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.773+0000 7f771339a700 1 -- start start 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f771339a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f770c159c10 0x7f770c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f771339a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c159fe0 0x7f770c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f771339a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0d0140 con 0x7f770c0ce800 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f771339a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0cf340 con 0x7f770c159c10 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f771339a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0cf530 con 0x7f770c159fe0 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f770c159c10 0x7f770c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f770c159c10 0x7f770c0cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58644/0 (socket says 172.21.15.60:58644) 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 -- 172.21.15.60:0/1162346799 learned_addr learned my addr 172.21.15.60:0/1162346799 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7711b97700 1 --2- 172.21.15.60:0/1162346799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c159fe0 0x7f770c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 -- 172.21.15.60:0/1162346799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c159fe0 msgr2=0x7f770c0cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 --2- 172.21.15.60:0/1162346799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c159fe0 0x7f770c0cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 -- 172.21.15.60:0/1162346799 >> v1:172.21.15.144:6789/0 conn(0x7f770c0ce800 legacy=0x7f770c0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 -- 172.21.15.60:0/1162346799 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0cf810 con 0x7f770c159c10 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.774+0000 7f7712398700 1 --2- 172.21.15.60:0/1162346799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c0cd5b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7704009f20 tx=0x7f7704009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7e358447e00cb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f7711396700 1 -- 172.21.15.60:0/1162346799 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400e070 con 0x7f770c159c10 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f7711396700 1 -- 172.21.15.60:0/1162346799 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400ba80 con 0x7f770c159c10 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f7711396700 1 -- 172.21.15.60:0/1162346799 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040092e0 con 0x7f770c159c10 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 -- 172.21.15.60:0/1162346799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 msgr2=0x7f770c0cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 --2- 172.21.15.60:0/1162346799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c0cd5b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7704009f20 tx=0x7f7704009840 comp rx=0 tx=0).stop 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 -- 172.21.15.60:0/1162346799 shutdown_connections 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 --2- 172.21.15.60:0/1162346799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c0cd5b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 --2- 172.21.15.60:0/1162346799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c159fe0 0x7f770c0cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 -- 172.21.15.60:0/1162346799 >> 172.21.15.60:0/1162346799 conn(0x7f770c0696b0 msgr2=0x7f770c067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:24.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 -- 172.21.15.60:0/1162346799 shutdown_connections 2023-10-08T16:06:24.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.775+0000 7f771339a700 1 -- 172.21.15.60:0/1162346799 wait complete. 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.776+0000 7f771339a700 1 Processor -- start 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.776+0000 7f771339a700 1 -- start start 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f771339a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c0ce800 0x7f770c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f771339a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c1490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f771339a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770c159fe0 0x7f770c1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f771339a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c14e5c0 con 0x7f770c159c10 2023-10-08T16:06:24.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f771339a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c149b30 con 0x7f770c159fe0 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f771339a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c14d5d0 con 0x7f770c0ce800 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c1490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c1490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58652/0 (socket says 172.21.15.60:58652) 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 -- 172.21.15.60:0/1584609586 learned_addr learned my addr 172.21.15.60:0/1584609586 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7712b99700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770c159fe0 0x7f770c1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7712398700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c0ce800 0x7f770c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 -- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c0ce800 msgr2=0x7f770c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c0ce800 0x7f770c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 -- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770c159fe0 msgr2=0x7f770c1495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770c159fe0 0x7f770c1495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7711b97700 1 -- 172.21.15.60:0/1584609586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7704009ae0 con 0x7f770c159c10 2023-10-08T16:06:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.777+0000 7f7712b99700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770c159fe0 0x7f770c1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.778+0000 7f7711b97700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c1490b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f770000d860 tx=0x7f7700008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.778+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700009610 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.778+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7700009770 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.778+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c14db00 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.778+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700009b30 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.778+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c14e0c0 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.779+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c14e280 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.779+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f770001e460 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.779+0000 7f770a7fc700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76f8066f30 0x7f76f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.780+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7700084800 con 0x7f770c159c10 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.780+0000 7f7712398700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76f8066f30 0x7f76f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.780+0000 7f7712398700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76f8066f30 0x7f76f80693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7704009880 tx=0x7f7704018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.784+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7700051dc0 con 0x7f770c159c10 2023-10-08T16:06:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:24.977+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f770c0cfb40 con 0x7f770c159c10 2023-10-08T16:06:25.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.689+0000 7f770a7fc700 1 -- 172.21.15.60:0/1584609586 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f77000553e0 con 0x7f770c159c10 2023-10-08T16:06:25.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76f8066f30 msgr2=0x7f76f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:25.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76f8066f30 0x7f76f80693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7704009880 tx=0x7f7704018000 comp rx=0 tx=0).stop 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 msgr2=0x7f770c1490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c1490b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f770000d860 tx=0x7f7700008040 comp rx=0 tx=0).stop 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 shutdown_connections 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76f8066f30 0x7f76f80693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f770c0ce800 0x7f770c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770c159fe0 0x7f770c1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 --2- 172.21.15.60:0/1584609586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770c159c10 0x7f770c1490b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 >> 172.21.15.60:0/1584609586 conn(0x7f770c0696b0 msgr2=0x7f770c0cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 shutdown_connections 2023-10-08T16:06:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.693+0000 7f771339a700 1 -- 172.21.15.60:0/1584609586 wait complete. 2023-10-08T16:06:25.695 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:06:25.707 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:06:25.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.835+0000 7fe445280700 1 Processor -- start 2023-10-08T16:06:25.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.836+0000 7fe445280700 1 -- start start 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.836+0000 7fe445280700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 0x7fe4400af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.836+0000 7fe445280700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe44015a290 0x7fe4400afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.836+0000 7fe445280700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4400b0790 con 0x7fe44006a5a0 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.836+0000 7fe445280700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4400ce1f0 con 0x7fe44015a290 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.836+0000 7fe445280700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400b0b20 con 0x7fe440159ec0 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 0x7fe4400af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43e7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe44015a290 0x7fe4400afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 0x7fe4400af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50578/0 (socket says 172.21.15.60:50578) 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43effd700 1 -- 172.21.15.60:0/3257650451 learned_addr learned my addr 172.21.15.60:0/3257650451 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43f7fe700 1 --1- 172.21.15.60:0/3257650451 >> v1:172.21.15.144:6789/0 conn(0x7fe44006a5a0 0x7fe44015db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:49614/0 (socket says 172.21.15.60:49614) 2023-10-08T16:06:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43e7fc700 1 -- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 msgr2=0x7fe4400af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43e7fc700 1 --2- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 0x7fe4400af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43e7fc700 1 -- 172.21.15.60:0/3257650451 >> v1:172.21.15.144:6789/0 conn(0x7fe44006a5a0 legacy=0x7fe44015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43e7fc700 1 -- 172.21.15.60:0/3257650451 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4400b04b0 con 0x7fe44015a290 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43effd700 1 --2- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 0x7fe4400af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43e7fc700 1 --2- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe44015a290 0x7fe4400afe80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4280098e0 tx=0x7fe4280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da17e95cc7577c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43dffb700 1 -- 172.21.15.60:0/3257650451 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800b640 con 0x7fe44015a290 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.837+0000 7fe43dffb700 1 -- 172.21.15.60:0/3257650451 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42800b7a0 con 0x7fe44015a290 2023-10-08T16:06:25.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe43dffb700 1 -- 172.21.15.60:0/3257650451 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800bb40 con 0x7fe44015a290 2023-10-08T16:06:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 -- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe44015a290 msgr2=0x7fe4400afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 --2- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe44015a290 0x7fe4400afe80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4280098e0 tx=0x7fe4280091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 -- 172.21.15.60:0/3257650451 shutdown_connections 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 --2- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe440159ec0 0x7fe4400af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 --2- 172.21.15.60:0/3257650451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe44015a290 0x7fe4400afe80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 -- 172.21.15.60:0/3257650451 >> 172.21.15.60:0/3257650451 conn(0x7fe4400d1880 msgr2=0x7fe4400cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 -- 172.21.15.60:0/3257650451 shutdown_connections 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.838+0000 7fe445280700 1 -- 172.21.15.60:0/3257650451 wait complete. 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.839+0000 7fe445280700 1 Processor -- start 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.839+0000 7fe445280700 1 -- start start 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe445280700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe44006a5a0 0x7fe440149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe445280700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe440159ec0 0x7fe44015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe445280700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 0x7fe4400b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe445280700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400c8ba0 con 0x7fe44015a290 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe445280700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400c7f90 con 0x7fe440159ec0 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe445280700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400c8270 con 0x7fe44006a5a0 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe43f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 0x7fe4400b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe43f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 0x7fe4400b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58658/0 (socket says 172.21.15.60:58658) 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe43f7fe700 1 -- 172.21.15.60:0/151606078 learned_addr learned my addr 172.21.15.60:0/151606078 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe43e7fc700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe440159ec0 0x7fe44015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe43effd700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe44006a5a0 0x7fe440149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.840+0000 7fe43f7fe700 1 -- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe44006a5a0 msgr2=0x7fe440149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe43f7fe700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe44006a5a0 0x7fe440149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe43f7fe700 1 -- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe440159ec0 msgr2=0x7fe44015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe43f7fe700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe440159ec0 0x7fe44015d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:25.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe43f7fe700 1 -- 172.21.15.60:0/151606078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009ae0 con 0x7fe44015a290 2023-10-08T16:06:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe43f7fe700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 0x7fe4400b4b20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c4e0 tx=0x7fe438007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43800ce90 con 0x7fe44015a290 2023-10-08T16:06:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe438005a70 con 0x7fe44015a290 2023-10-08T16:06:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe428009420 con 0x7fe44015a290 2023-10-08T16:06:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438005e10 con 0x7fe44015a290 2023-10-08T16:06:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.841+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4400c8830 con 0x7fe44015a290 2023-10-08T16:06:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.842+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44004c3c0 con 0x7fe44015a290 2023-10-08T16:06:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.843+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4380072e0 con 0x7fe44015a290 2023-10-08T16:06:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.843+0000 7fe436ffd700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe420066f30 0x7fe4200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.843+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe438083a90 con 0x7fe44015a290 2023-10-08T16:06:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.843+0000 7fe43effd700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe420066f30 0x7fe4200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.843+0000 7fe43effd700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe420066f30 0x7fe4200693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe4300072d0 tx=0x7fe43000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:25.847+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe438050f60 con 0x7fe44015a290 2023-10-08T16:06:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.043+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe4400c8ce0 con 0x7fe44015a290 2023-10-08T16:06:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.693+0000 7fe436ffd700 1 -- 172.21.15.60:0/151606078 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe4380170d0 con 0x7fe44015a290 2023-10-08T16:06:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe420066f30 msgr2=0x7fe4200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe420066f30 0x7fe4200693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe4300072d0 tx=0x7fe43000b040 comp rx=0 tx=0).stop 2023-10-08T16:06:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 msgr2=0x7fe4400b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 0x7fe4400b4b20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c4e0 tx=0x7fe438007f50 comp rx=0 tx=0).stop 2023-10-08T16:06:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 shutdown_connections 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe420066f30 0x7fe4200693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe44006a5a0 0x7fe440149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe44015a290 0x7fe4400b4b20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 --2- 172.21.15.60:0/151606078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe440159ec0 0x7fe44015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.700+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 >> 172.21.15.60:0/151606078 conn(0x7fe4400d1880 msgr2=0x7fe4400cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.701+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 shutdown_connections 2023-10-08T16:06:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.701+0000 7fe445280700 1 -- 172.21.15.60:0/151606078 wait complete. 2023-10-08T16:06:26.704 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:06:26.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:06:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.843+0000 7f14b8486700 1 Processor -- start 2023-10-08T16:06:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.843+0000 7f14b8486700 1 -- start start 2023-10-08T16:06:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.844+0000 7f14b8486700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14b00b3570 0x7f14b015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.844+0000 7f14b8486700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 0x7f14b00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.844+0000 7f14b8486700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00b14f0 con 0x7f14b00b4860 2023-10-08T16:06:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.844+0000 7f14b8486700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b00b17d0 con 0x7f14b00b3570 2023-10-08T16:06:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.844+0000 7f14b8486700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00b1ab0 con 0x7f14b00b4c30 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 0x7f14b00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b5a21700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14b00b3570 0x7f14b015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 0x7f14b00b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50602/0 (socket says 172.21.15.60:50602) 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 -- 172.21.15.60:0/1286346959 learned_addr learned my addr 172.21.15.60:0/1286346959 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 -- 172.21.15.60:0/1286346959 >> v2:172.21.15.144:3300/0 conn(0x7f14b00b3570 msgr2=0x7f14b015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 --2- 172.21.15.60:0/1286346959 >> v2:172.21.15.144:3300/0 conn(0x7f14b00b3570 0x7f14b015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 -- 172.21.15.60:0/1286346959 >> v1:172.21.15.144:6789/0 conn(0x7f14b00b4860 legacy=0x7f14b0159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b5220700 1 -- 172.21.15.60:0/1286346959 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594220242 0 0) 0x7f14b00b14f0 con 0x7f14b00b4860 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 -- 172.21.15.60:0/1286346959 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00b1d90 con 0x7f14b00b4c30 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b5a21700 1 --2- 172.21.15.60:0/1286346959 >> v2:172.21.15.144:3300/0 conn(0x7f14b00b3570 0x7f14b015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.845+0000 7f14b6a23700 1 --2- 172.21.15.60:0/1286346959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 0x7f14b00b6700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009f20 tx=0x7f14a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a8b60eedeef63d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b5220700 1 -- 172.21.15.60:0/1286346959 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000e070 con 0x7f14b00b4c30 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b5220700 1 -- 172.21.15.60:0/1286346959 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000ba60 con 0x7f14b00b4c30 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b5220700 1 -- 172.21.15.60:0/1286346959 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00092e0 con 0x7f14b00b4c30 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 -- 172.21.15.60:0/1286346959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 msgr2=0x7f14b00b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 --2- 172.21.15.60:0/1286346959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 0x7f14b00b6700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009f20 tx=0x7f14a0009840 comp rx=0 tx=0).stop 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 -- 172.21.15.60:0/1286346959 shutdown_connections 2023-10-08T16:06:26.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 --2- 172.21.15.60:0/1286346959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b4c30 0x7f14b00b6700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 --2- 172.21.15.60:0/1286346959 >> v2:172.21.15.144:3300/0 conn(0x7f14b00b3570 0x7f14b015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 -- 172.21.15.60:0/1286346959 >> 172.21.15.60:0/1286346959 conn(0x7f14b009a0f0 msgr2=0x7f14b0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:26.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 -- 172.21.15.60:0/1286346959 shutdown_connections 2023-10-08T16:06:26.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.846+0000 7f14b8486700 1 -- 172.21.15.60:0/1286346959 wait complete. 2023-10-08T16:06:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.847+0000 7f14b8486700 1 Processor -- start 2023-10-08T16:06:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.847+0000 7f14b8486700 1 -- start start 2023-10-08T16:06:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b8486700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b3570 0x7f14b0159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b8486700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 0x7f14b009de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b8486700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b00b4c30 0x7f14b016db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b8486700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00ae250 con 0x7f14b00b4860 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b8486700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b016d400 con 0x7f14b00b4c30 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b8486700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00ad9b0 con 0x7f14b00b3570 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b5a21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 0x7f14b009de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b5a21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 0x7f14b009de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58672/0 (socket says 172.21.15.60:58672) 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b5a21700 1 -- 172.21.15.60:0/1881548430 learned_addr learned my addr 172.21.15.60:0/1881548430 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.848+0000 7f14b6222700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b3570 0x7f14b0159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b6a23700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b00b4c30 0x7f14b016db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b5a21700 1 -- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b3570 msgr2=0x7f14b0159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b5a21700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b3570 0x7f14b0159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b5a21700 1 -- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b00b4c30 msgr2=0x7f14b016db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b5a21700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b00b4c30 0x7f14b016db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b5a21700 1 -- 172.21.15.60:0/1881548430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009420 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b6222700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b3570 0x7f14b0159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b6a23700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b00b4c30 0x7f14b016db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b5a21700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 0x7f14b009de20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ec80 tx=0x7f14a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400c9d0 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400cb30 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400ceb0 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a0009ae0 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.849+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b016d610 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.850+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b004c3c0 con 0x7f14b00b4860 2023-10-08T16:06:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.850+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a4013680 con 0x7f14b00b4860 2023-10-08T16:06:26.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.851+0000 7f14ae7fc700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:26.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.851+0000 7f14b6222700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:26.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.851+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f14a4084920 con 0x7f14b00b4860 2023-10-08T16:06:26.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.851+0000 7f14b6222700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14a8007fd0 tx=0x7f14a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:26.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:26.856+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a4051bf0 con 0x7f14b00b4860 2023-10-08T16:06:27.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.092+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f14b00b2070 con 0x7f14b00b4860 2023-10-08T16:06:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.696+0000 7f14ae7fc700 1 -- 172.21.15.60:0/1881548430 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f14a4055210 con 0x7f14b00b4860 2023-10-08T16:06:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.701+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f149c066f30 msgr2=0x7f149c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.701+0000 7f14b8486700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14a8007fd0 tx=0x7f14a8009040 comp rx=0 tx=0).stop 2023-10-08T16:06:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.701+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 msgr2=0x7f14b009de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.701+0000 7f14b8486700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 0x7f14b009de20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ec80 tx=0x7f14a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.702+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 shutdown_connections 2023-10-08T16:06:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.702+0000 7f14b8486700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.702+0000 7f14b8486700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14b00b3570 0x7f14b0159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.702+0000 7f14b8486700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b00b4c30 0x7f14b016db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.702+0000 7f14b8486700 1 --2- 172.21.15.60:0/1881548430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00b4860 0x7f14b009de20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.702+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 >> 172.21.15.60:0/1881548430 conn(0x7f14b009a0f0 msgr2=0x7f14b015a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.703+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 shutdown_connections 2023-10-08T16:06:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.703+0000 7f14b8486700 1 -- 172.21.15.60:0/1881548430 wait complete. 2023-10-08T16:06:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 6 and data pool 7 2023-10-08T16:06:27.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 Processor -- start 2023-10-08T16:06:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 -- start start 2023-10-08T16:06:27.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7ec157870 0x7fb7ec15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7ec15a620 0x7fb7ec15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15d580 0x7fb7ec158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec15cbb0 con 0x7fb7ec15a620 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec15bfa0 con 0x7fb7ec157870 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.848+0000 7fb7f1010700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec15c280 con 0x7fb7ec15d580 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7ec15a620 0x7fb7ec15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7ec15a620 0x7fb7ec15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58674/0 (socket says 172.21.15.60:58674) 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 -- 172.21.15.60:0/4015377550 learned_addr learned my addr 172.21.15.60:0/4015377550 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ead9d700 1 --2- 172.21.15.60:0/4015377550 >> v2:172.21.15.144:3300/0 conn(0x7fb7ec157870 0x7fb7ec15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7eb59e700 1 --2- 172.21.15.60:0/4015377550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15d580 0x7fb7ec158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 -- 172.21.15.60:0/4015377550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15d580 msgr2=0x7fb7ec158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/4015377550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15d580 0x7fb7ec158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 -- 172.21.15.60:0/4015377550 >> v2:172.21.15.144:3300/0 conn(0x7fb7ec157870 msgr2=0x7fb7ec15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/4015377550 >> v2:172.21.15.144:3300/0 conn(0x7fb7ec157870 0x7fb7ec15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 -- 172.21.15.60:0/4015377550 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec15c560 con 0x7fb7ec15a620 2023-10-08T16:06:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/4015377550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec15a620 0x7fb7ec15d040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec069d80 tx=0x7fb7d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9834aa2ef254787 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7e9d9b700 1 -- 172.21.15.60:0/4015377550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400b640 con 0x7fb7ec15a620 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7e9d9b700 1 -- 172.21.15.60:0/4015377550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400b7a0 con 0x7fb7ec15a620 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.849+0000 7fb7e9d9b700 1 -- 172.21.15.60:0/4015377550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400bb60 con 0x7fb7ec15a620 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 -- 172.21.15.60:0/4015377550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec15a620 msgr2=0x7fb7ec15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 --2- 172.21.15.60:0/4015377550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec15a620 0x7fb7ec15d040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec069d80 tx=0x7fb7d4009250 comp rx=0 tx=0).stop 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 -- 172.21.15.60:0/4015377550 shutdown_connections 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 --2- 172.21.15.60:0/4015377550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15d580 0x7fb7ec158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 --2- 172.21.15.60:0/4015377550 >> v2:172.21.15.144:3300/0 conn(0x7fb7ec157870 0x7fb7ec15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 --2- 172.21.15.60:0/4015377550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec15a620 0x7fb7ec15d040 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 -- 172.21.15.60:0/4015377550 >> 172.21.15.60:0/4015377550 conn(0x7fb7ec068ce0 msgr2=0x7fb7ec0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 -- 172.21.15.60:0/4015377550 shutdown_connections 2023-10-08T16:06:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.850+0000 7fb7f1010700 1 -- 172.21.15.60:0/4015377550 wait complete. 2023-10-08T16:06:27.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.851+0000 7fb7f1010700 1 Processor -- start 2023-10-08T16:06:27.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.851+0000 7fb7f1010700 1 -- start start 2023-10-08T16:06:27.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7f1010700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 0x7fb7ec149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7f1010700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15a620 0x7fb7ec0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7f1010700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7ec15d580 0x7fb7ec14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7f1010700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0b2290 con 0x7fb7ec157870 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7f1010700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0b2570 con 0x7fb7ec15d580 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7f1010700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0b2850 con 0x7fb7ec15a620 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 0x7fb7ec149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 0x7fb7ec149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58690/0 (socket says 172.21.15.60:58690) 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 -- 172.21.15.60:0/2963595844 learned_addr learned my addr 172.21.15.60:0/2963595844 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7eb59e700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7ec15d580 0x7fb7ec14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15a620 0x7fb7ec0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 -- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15a620 msgr2=0x7fb7ec0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15a620 0x7fb7ec0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 -- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7ec15d580 msgr2=0x7fb7ec14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7ec15d580 0x7fb7ec14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ead9d700 1 -- 172.21.15.60:0/2963595844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094f0 con 0x7fb7ec157870 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7eb59e700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7ec15d580 0x7fb7ec14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.852+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15a620 0x7fb7ec0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.853+0000 7fb7ead9d700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 0x7fb7ec149560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009ef0 tx=0x7fb7e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.853+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400cc50 con 0x7fb7ec157870 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.853+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400f040 con 0x7fb7ec157870 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.853+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec0b2b30 con 0x7fb7ec157870 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.853+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4014480 con 0x7fb7ec157870 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.853+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec0b1df0 con 0x7fb7ec157870 2023-10-08T16:06:27.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.854+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec0b2d70 con 0x7fb7ec157870 2023-10-08T16:06:27.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.854+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7e40147f0 con 0x7fb7ec157870 2023-10-08T16:06:27.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.854+0000 7fb7e2ffd700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb7cc066f30 0x7fb7cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:27.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.855+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7e4084fe0 con 0x7fb7ec157870 2023-10-08T16:06:27.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.855+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb7cc066f30 0x7fb7cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:27.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.855+0000 7fb7ea59c700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb7cc066f30 0x7fb7cc0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec069d80 tx=0x7fb7d4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:27.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:27.859+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7ec0b2d70 con 0x7fb7ec157870 2023-10-08T16:06:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.050+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7ec0b2d70 con 0x7fb7ec157870 2023-10-08T16:06:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.051+0000 7fb7e2ffd700 1 -- 172.21.15.60:0/2963595844 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fb7ec0b2d70 con 0x7fb7ec157870 2023-10-08T16:06:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:28.052 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:27.093308+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:25.007166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:26.073203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb7cc066f30 msgr2=0x7fb7cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb7cc066f30 0x7fb7cc0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec069d80 tx=0x7fb7d4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 msgr2=0x7fb7ec149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 0x7fb7ec149560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009ef0 tx=0x7fb7e400b040 comp rx=0 tx=0).stop 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 shutdown_connections 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb7cc066f30 0x7fb7cc0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7ec15d580 0x7fb7ec14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7ec157870 0x7fb7ec149560 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 --2- 172.21.15.60:0/2963595844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7ec15a620 0x7fb7ec0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 >> 172.21.15.60:0/2963595844 conn(0x7fb7ec068ce0 msgr2=0x7fb7ec15a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:28.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 shutdown_connections 2023-10-08T16:06:28.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.053+0000 7fb7f1010700 1 -- 172.21.15.60:0/2963595844 wait complete. 2023-10-08T16:06:28.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.184+0000 7f1e17059700 1 Processor -- start 2023-10-08T16:06:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.184+0000 7f1e17059700 1 -- start start 2023-10-08T16:06:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.185+0000 7f1e17059700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e10157870 0x7f1e1015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.185+0000 7f1e17059700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1015cbb0 con 0x7f1e10157c40 2023-10-08T16:06:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.185+0000 7f1e17059700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1015bfa0 con 0x7f1e1015a620 2023-10-08T16:06:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.185+0000 7f1e17059700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1015c280 con 0x7f1e10157870 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.185+0000 7f1e155f6700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1e10157c40 0x7f1e10158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59394/0 (socket says 172.21.15.60:59394) 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.185+0000 7f1e155f6700 1 -- 172.21.15.60:0/3325857730 learned_addr learned my addr 172.21.15.60:0/3325857730 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377424025 0 0) 0x7f1e1015cbb0 con 0x7f1e10157c40 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3325857730 >> v2:172.21.15.144:3300/0 conn(0x7f1e10157870 0x7f1e1015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dfc003570 con 0x7f1e10157c40 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906214179 0 0) 0x7f1dfc003570 con 0x7f1e10157c40 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 >> v2:172.21.15.144:3300/0 conn(0x7f1e10157870 msgr2=0x7f1e1015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 --2- 172.21.15.60:0/3325857730 >> v2:172.21.15.144:3300/0 conn(0x7f1e10157870 0x7f1e1015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 >> v1:172.21.15.144:6789/0 conn(0x7f1e1015a620 legacy=0x7f1e1015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1015c560 con 0x7f1e10157c40 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f1e08001470 con 0x7f1e10157c40 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 >> v1:172.21.15.60:6789/0 conn(0x7f1e10157c40 legacy=0x7f1e10158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc004810 0x7f1dfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0051c0 0x7f1dfc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1015c280 con 0x7f1dfc003a60 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc00c160 con 0x7f1dfc004810 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc00c320 con 0x7f1dfc0051c0 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e0ffff700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc004810 0x7f1dfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.186+0000 7f1e155f6700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0051c0 0x7f1dfc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e14df5700 1 -- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0051c0 msgr2=0x7f1dfc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1dfc0051c0 0x7f1dfc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e14df5700 1 -- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc004810 msgr2=0x7f1dfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dfc004810 0x7f1dfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e14df5700 1 -- 172.21.15.60:0/3325857730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc003570 con 0x7f1dfc003a60 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e155f6700 1 -- 172.21.15.60:0/3325857730 reap_dead start 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009c00 tx=0x7f1df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be018ea4b8747ac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800e710 con 0x7f1dfc003a60 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df800e870 con 0x7f1dfc003a60 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e0f7fe700 1 -- 172.21.15.60:0/3325857730 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800ec30 con 0x7f1dfc003a60 2023-10-08T16:06:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 -- 172.21.15.60:0/3325857730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 msgr2=0x7f1dfc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009c00 tx=0x7f1df80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 -- 172.21.15.60:0/3325857730 shutdown_connections 2023-10-08T16:06:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 --2- 172.21.15.60:0/3325857730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 -- 172.21.15.60:0/3325857730 >> 172.21.15.60:0/3325857730 conn(0x7f1e10068ce0 msgr2=0x7f1e100690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 -- 172.21.15.60:0/3325857730 shutdown_connections 2023-10-08T16:06:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.187+0000 7f1e17059700 1 -- 172.21.15.60:0/3325857730 wait complete. 2023-10-08T16:06:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 Processor -- start 2023-10-08T16:06:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 -- start start 2023-10-08T16:06:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1e101487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e100a9170 0x7f1e100a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e100a7b50 0x7f1e10160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100a8ce0 con 0x7f1dfc003a60 2023-10-08T16:06:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100a80d0 con 0x7f1e100a7b50 2023-10-08T16:06:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.189+0000 7f1e17059700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100a83b0 con 0x7f1e100a9170 2023-10-08T16:06:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1e101487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1e101487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58716/0 (socket says 172.21.15.60:58716) 2023-10-08T16:06:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 -- 172.21.15.60:0/3243421499 learned_addr learned my addr 172.21.15.60:0/3243421499 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e155f6700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e100a7b50 0x7f1e10160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e0ffff700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e100a9170 0x7f1e100a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 -- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e100a9170 msgr2=0x7f1e100a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e100a9170 0x7f1e100a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 -- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e100a7b50 msgr2=0x7f1e10160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e100a7b50 0x7f1e10160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 -- 172.21.15.60:0/3243421499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100a8690 con 0x7f1dfc003a60 2023-10-08T16:06:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e14df5700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1e101487f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c130 tx=0x7f1df801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8022070 con 0x7f1dfc003a60 2023-10-08T16:06:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df800e9e0 con 0x7f1dfc003a60 2023-10-08T16:06:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e100a8970 con 0x7f1dfc003a60 2023-10-08T16:06:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df801c450 con 0x7f1dfc003a60 2023-10-08T16:06:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.190+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e10148d30 con 0x7f1dfc003a60 2023-10-08T16:06:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.191+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e100cdc90 con 0x7f1dfc003a60 2023-10-08T16:06:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.192+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1df801c8a0 con 0x7f1dfc003a60 2023-10-08T16:06:28.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.192+0000 7f1e0cff9700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1df0066f30 0x7f1df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.192+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1df8085b70 con 0x7f1dfc003a60 2023-10-08T16:06:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.192+0000 7f1e0ffff700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1df0066f30 0x7f1df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.192+0000 7f1e0ffff700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1df0066f30 0x7f1df00693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1e1015f8e0 tx=0x7f1e00001640 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.196+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1df8052ea0 con 0x7f1dfc003a60 2023-10-08T16:06:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.394+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e1004c3c0 con 0x7f1dfc003a60 2023-10-08T16:06:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.395+0000 7f1e0cff9700 1 -- 172.21.15.60:0/3243421499 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f1df802b090 con 0x7f1dfc003a60 2023-10-08T16:06:28.395 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:28.396 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:27.093308+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:25.007166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:26.073203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:28.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1df0066f30 msgr2=0x7f1df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1df0066f30 0x7f1df00693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1e1015f8e0 tx=0x7f1e00001640 comp rx=0 tx=0).stop 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 msgr2=0x7f1e101487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1e101487f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c130 tx=0x7f1df801a000 comp rx=0 tx=0).stop 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 shutdown_connections 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1df0066f30 0x7f1df00693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e100a7b50 0x7f1e10160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc003a60 0x7f1e101487f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 --2- 172.21.15.60:0/3243421499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e100a9170 0x7f1e100a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 >> 172.21.15.60:0/3243421499 conn(0x7f1e10068ce0 msgr2=0x7f1e100690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 shutdown_connections 2023-10-08T16:06:28.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.397+0000 7f1e17059700 1 -- 172.21.15.60:0/3243421499 wait complete. 2023-10-08T16:06:28.410 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:06:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.532+0000 7f5615fd6700 1 Processor -- start 2023-10-08T16:06:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.532+0000 7f5615fd6700 1 -- start start 2023-10-08T16:06:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5615fd6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56100cce30 0x7f561015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5615fd6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56100b6580 0x7f561006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5615fd6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561006ac90 con 0x7f561006a830 2023-10-08T16:06:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5615fd6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56100b4d70 con 0x7f56100cce30 2023-10-08T16:06:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5615fd6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56100cd8d0 con 0x7f56100b6580 2023-10-08T16:06:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5614fd4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56100cce30 0x7f561015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f56157d5700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f561006a830 0x7f561015d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59402/0 (socket says 172.21.15.60:59402) 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f56157d5700 1 -- 172.21.15.60:0/3371545813 learned_addr learned my addr 172.21.15.60:0/3371545813 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f560ffff700 1 --2- 172.21.15.60:0/3371545813 >> v2:172.21.15.144:3300/0 conn(0x7f56100b6580 0x7f561006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f560f7fe700 1 -- 172.21.15.60:0/3371545813 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798691380 0 0) 0x7f5608001490 con 0x7f561006a830 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f560f7fe700 1 -- 172.21.15.60:0/3371545813 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5600003570 con 0x7f561006a830 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5614fd4700 1 -- 172.21.15.60:0/3371545813 >> v2:172.21.15.144:3300/0 conn(0x7f56100b6580 msgr2=0x7f561006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5614fd4700 1 --2- 172.21.15.60:0/3371545813 >> v2:172.21.15.144:3300/0 conn(0x7f56100b6580 0x7f561006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5614fd4700 1 -- 172.21.15.60:0/3371545813 >> v1:172.21.15.60:6789/0 conn(0x7f561006a830 legacy=0x7f561015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f5614fd4700 1 -- 172.21.15.60:0/3371545813 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56100b4440 con 0x7f56100cce30 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.533+0000 7f560ffff700 1 --2- 172.21.15.60:0/3371545813 >> v2:172.21.15.144:3300/0 conn(0x7f56100b6580 0x7f561006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5614fd4700 1 --2- 172.21.15.60:0/3371545813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56100cce30 0x7f561015aca0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5610089bc0 tx=0x7f56040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92374f8c91b445a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:28.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f560f7fe700 1 -- 172.21.15.60:0/3371545813 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604011630 con 0x7f56100cce30 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f560f7fe700 1 -- 172.21.15.60:0/3371545813 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604011790 con 0x7f56100cce30 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f560f7fe700 1 -- 172.21.15.60:0/3371545813 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604011b30 con 0x7f56100cce30 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 -- 172.21.15.60:0/3371545813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56100cce30 msgr2=0x7f561015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 --2- 172.21.15.60:0/3371545813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56100cce30 0x7f561015aca0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5610089bc0 tx=0x7f56040091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 -- 172.21.15.60:0/3371545813 shutdown_connections 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 --2- 172.21.15.60:0/3371545813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56100cce30 0x7f561015aca0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 --2- 172.21.15.60:0/3371545813 >> v2:172.21.15.144:3300/0 conn(0x7f56100b6580 0x7f561006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 -- 172.21.15.60:0/3371545813 >> 172.21.15.60:0/3371545813 conn(0x7f5610068cb0 msgr2=0x7f56100690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 -- 172.21.15.60:0/3371545813 shutdown_connections 2023-10-08T16:06:28.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.534+0000 7f5615fd6700 1 -- 172.21.15.60:0/3371545813 wait complete. 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.535+0000 7f5615fd6700 1 Processor -- start 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 -- start start 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 0x7f561014e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56100b6580 0x7f5610156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56100cce30 0x7f5610154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100d0290 con 0x7f561006a830 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100cf980 con 0x7f56100cce30 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5615fd6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5610154110 con 0x7f56100b6580 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5614fd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 0x7f561014e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5614fd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 0x7f561014e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58726/0 (socket says 172.21.15.60:58726) 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.536+0000 7f5614fd4700 1 -- 172.21.15.60:0/2180816252 learned_addr learned my addr 172.21.15.60:0/2180816252 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f560ffff700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56100b6580 0x7f5610156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f56157d5700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56100cce30 0x7f5610154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5614fd4700 1 -- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56100b6580 msgr2=0x7f5610156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5614fd4700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56100b6580 0x7f5610156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5614fd4700 1 -- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56100cce30 msgr2=0x7f5610154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5614fd4700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56100cce30 0x7f5610154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5614fd4700 1 -- 172.21.15.60:0/2180816252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604009420 con 0x7f561006a830 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f560ffff700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56100b6580 0x7f5610156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f56157d5700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56100cce30 0x7f5610154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5614fd4700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 0x7f561014e8d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f561006b300 tx=0x7f5604017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604011b10 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56040233f0 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56100cfc40 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604023790 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.537+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561014ee10 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.538+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5610089550 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.539+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56040193b0 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.539+0000 7f560cff9700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f55f4066f30 0x7f55f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.539+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56040859f0 con 0x7f561006a830 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.539+0000 7f560ffff700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f55f4066f30 0x7f55f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.539+0000 7f560ffff700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f55f4066f30 0x7f55f40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55fc006f00 tx=0x7f55fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.543+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5604052c60 con 0x7f561006a830 2023-10-08T16:06:28.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:28.787+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f56100b4720 con 0x7f561006a830 2023-10-08T16:06:29.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.716+0000 7f560cff9700 1 -- 172.21.15.60:0/2180816252 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f56040150b0 con 0x7f561006a830 2023-10-08T16:06:29.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.718+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f55f4066f30 msgr2=0x7f55f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:29.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.718+0000 7f5615fd6700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f55f4066f30 0x7f55f40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55fc006f00 tx=0x7f55fc008040 comp rx=0 tx=0).stop 2023-10-08T16:06:29.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.718+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 msgr2=0x7f561014e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:29.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.718+0000 7f5615fd6700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 0x7f561014e8d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f561006b300 tx=0x7f5604017000 comp rx=0 tx=0).stop 2023-10-08T16:06:29.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 shutdown_connections 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f55f4066f30 0x7f55f40693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56100cce30 0x7f5610154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561006a830 0x7f561014e8d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 --2- 172.21.15.60:0/2180816252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56100b6580 0x7f5610156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 >> 172.21.15.60:0/2180816252 conn(0x7f5610068cb0 msgr2=0x7f5610150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 shutdown_connections 2023-10-08T16:06:29.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.719+0000 7f5615fd6700 1 -- 172.21.15.60:0/2180816252 wait complete. 2023-10-08T16:06:29.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:06:29.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.862+0000 7f38c705b700 1 Processor -- start 2023-10-08T16:06:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.862+0000 7f38c705b700 1 -- start start 2023-10-08T16:06:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c705b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c705b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38c00b6580 0x7f38c006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c705b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00b4d70 con 0x7f38c006a830 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c705b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c006ac70 con 0x7f38c00b6580 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c705b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00cd8d0 con 0x7f38c00cce30 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c5858700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38c00b6580 0x7f38c006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c685a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f38c006a830 0x7f38c015d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59418/0 (socket says 172.21.15.60:59418) 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c685a700 1 -- 172.21.15.60:0/3423520007 learned_addr learned my addr 172.21.15.60:0/3423520007 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c6059700 1 --2- 172.21.15.60:0/3423520007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c5858700 1 -- 172.21.15.60:0/3423520007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 msgr2=0x7f38c015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c5858700 1 --2- 172.21.15.60:0/3423520007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c5858700 1 -- 172.21.15.60:0/3423520007 >> v1:172.21.15.60:6789/0 conn(0x7f38c006a830 legacy=0x7f38c015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c5057700 1 -- 172.21.15.60:0/3423520007 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900437597 0 0) 0x7f38c00b4d70 con 0x7f38c006a830 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.863+0000 7f38c5858700 1 -- 172.21.15.60:0/3423520007 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00b4440 con 0x7f38c00b6580 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c5858700 1 --2- 172.21.15.60:0/3423520007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c006a2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f38b40098e0 tx=0x7f38b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3921e77fdd4428e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c5057700 1 -- 172.21.15.60:0/3423520007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4009e80 con 0x7f38c00b6580 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c5057700 1 -- 172.21.15.60:0/3423520007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b400b860 con 0x7f38c00b6580 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c5057700 1 -- 172.21.15.60:0/3423520007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400bbe0 con 0x7f38c00b6580 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 -- 172.21.15.60:0/3423520007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 msgr2=0x7f38c006a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 --2- 172.21.15.60:0/3423520007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c006a2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f38b40098e0 tx=0x7f38b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 -- 172.21.15.60:0/3423520007 shutdown_connections 2023-10-08T16:06:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 --2- 172.21.15.60:0/3423520007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c015aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 --2- 172.21.15.60:0/3423520007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c006a2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 -- 172.21.15.60:0/3423520007 >> 172.21.15.60:0/3423520007 conn(0x7f38c0068cb0 msgr2=0x7f38c00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 -- 172.21.15.60:0/3423520007 shutdown_connections 2023-10-08T16:06:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.864+0000 7f38c705b700 1 -- 172.21.15.60:0/3423520007 wait complete. 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.865+0000 7f38c705b700 1 Processor -- start 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.865+0000 7f38c705b700 1 -- start start 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c705b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38c006a830 0x7f38c00b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c705b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c0154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c705b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c0153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c705b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00b0ce0 con 0x7f38c00b6580 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c705b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0152c70 con 0x7f38c006a830 2023-10-08T16:06:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c705b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01531d0 con 0x7f38c00cce30 2023-10-08T16:06:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c5858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c0154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c5858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c0154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58756/0 (socket says 172.21.15.60:58756) 2023-10-08T16:06:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.866+0000 7f38c5858700 1 -- 172.21.15.60:0/1424987361 learned_addr learned my addr 172.21.15.60:0/1424987361 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c6059700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38c006a830 0x7f38c00b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c685a700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c0153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c5858700 1 -- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 msgr2=0x7f38c0153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c5858700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c0153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c5858700 1 -- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38c006a830 msgr2=0x7f38c00b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c5858700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38c006a830 0x7f38c00b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c5858700 1 -- 172.21.15.60:0/1424987361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4009420 con 0x7f38c00b6580 2023-10-08T16:06:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c6059700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38c006a830 0x7f38c00b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c5858700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c0154900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f38b4013000 tx=0x7f38b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:29.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400bbe0 con 0x7f38c00b6580 2023-10-08T16:06:29.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4011420 con 0x7f38c00b6580 2023-10-08T16:06:29.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40117c0 con 0x7f38c00b6580 2023-10-08T16:06:29.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c00b0720 con 0x7f38c00b6580 2023-10-08T16:06:29.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.867+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c0152e60 con 0x7f38c00b6580 2023-10-08T16:06:29.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.868+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0153380 con 0x7f38c00b6580 2023-10-08T16:06:29.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.868+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38b4011b70 con 0x7f38c00b6580 2023-10-08T16:06:29.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.869+0000 7f38be7fc700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f38ac066f30 0x7f38ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:29.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.869+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38b4085c90 con 0x7f38c00b6580 2023-10-08T16:06:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.869+0000 7f38c6059700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f38ac066f30 0x7f38ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.869+0000 7f38c6059700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f38ac066f30 0x7f38ac0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f38b8006fd0 tx=0x7f38b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:29.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:29.873+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38c0153380 con 0x7f38c00b6580 2023-10-08T16:06:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.108+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f38c0153340 con 0x7f38c00b6580 2023-10-08T16:06:30.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.716+0000 7f38be7fc700 1 -- 172.21.15.60:0/1424987361 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f38b4052f00 con 0x7f38c00b6580 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f38ac066f30 msgr2=0x7f38ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f38ac066f30 0x7f38ac0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f38b8006fd0 tx=0x7f38b8008040 comp rx=0 tx=0).stop 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 msgr2=0x7f38c0154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c0154900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f38b4013000 tx=0x7f38b4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 shutdown_connections 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f38ac066f30 0x7f38ac0693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38c00cce30 0x7f38c0153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38c006a830 0x7f38c00b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 --2- 172.21.15.60:0/1424987361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c00b6580 0x7f38c0154900 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 >> 172.21.15.60:0/1424987361 conn(0x7f38c0068cb0 msgr2=0x7f38c0150480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:30.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 shutdown_connections 2023-10-08T16:06:30.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.719+0000 7f38c705b700 1 -- 172.21.15.60:0/1424987361 wait complete. 2023-10-08T16:06:30.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:30.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.854+0000 7fa775c35700 1 Processor -- start 2023-10-08T16:06:30.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.854+0000 7fa775c35700 1 -- start start 2023-10-08T16:06:30.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa775c35700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa77015a2b0 0x7fa7700b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:30.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa775c35700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7700cfe20 0x7fa7700ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:30.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa775c35700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7700c5d80 con 0x7fa7700d1c30 2023-10-08T16:06:30.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa775c35700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa770068470 con 0x7fa7700cfe20 2023-10-08T16:06:30.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa775c35700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7700c6060 con 0x7fa77015a2b0 2023-10-08T16:06:30.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7700cfe20 0x7fa7700ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa7700d1c30 0x7fa7700cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59420/0 (socket says 172.21.15.60:59420) 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76effd700 1 -- 172.21.15.60:0/450720497 learned_addr learned my addr 172.21.15.60:0/450720497 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76f7fe700 1 --2- 172.21.15.60:0/450720497 >> v2:172.21.15.144:3300/0 conn(0x7fa77015a2b0 0x7fa7700b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76ffff700 1 -- 172.21.15.60:0/450720497 >> v2:172.21.15.144:3300/0 conn(0x7fa77015a2b0 msgr2=0x7fa7700b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76ffff700 1 --2- 172.21.15.60:0/450720497 >> v2:172.21.15.144:3300/0 conn(0x7fa77015a2b0 0x7fa7700b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76ffff700 1 -- 172.21.15.60:0/450720497 >> v1:172.21.15.60:6789/0 conn(0x7fa7700d1c30 legacy=0x7fa7700cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76e7fc700 1 -- 172.21.15.60:0/450720497 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045773200 0 0) 0x7fa7700c5d80 con 0x7fa7700d1c30 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76ffff700 1 -- 172.21.15.60:0/450720497 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700c6340 con 0x7fa7700cfe20 2023-10-08T16:06:30.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.855+0000 7fa76ffff700 1 --2- 172.21.15.60:0/450720497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700ccdd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa770089220 tx=0x7fa768009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48416ecfde9f8731 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa76e7fc700 1 -- 172.21.15.60:0/450720497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800e070 con 0x7fa7700cfe20 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa76e7fc700 1 -- 172.21.15.60:0/450720497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76800bc30 con 0x7fa7700cfe20 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa76e7fc700 1 -- 172.21.15.60:0/450720497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768012430 con 0x7fa7700cfe20 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 -- 172.21.15.60:0/450720497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 msgr2=0x7fa7700ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 --2- 172.21.15.60:0/450720497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700ccdd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa770089220 tx=0x7fa768009780 comp rx=0 tx=0).stop 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 -- 172.21.15.60:0/450720497 shutdown_connections 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 --2- 172.21.15.60:0/450720497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700ccdd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 --2- 172.21.15.60:0/450720497 >> v2:172.21.15.144:3300/0 conn(0x7fa77015a2b0 0x7fa7700b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 -- 172.21.15.60:0/450720497 >> 172.21.15.60:0/450720497 conn(0x7fa770067e40 msgr2=0x7fa7700d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 -- 172.21.15.60:0/450720497 shutdown_connections 2023-10-08T16:06:30.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.856+0000 7fa775c35700 1 -- 172.21.15.60:0/450720497 wait complete. 2023-10-08T16:06:30.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 Processor -- start 2023-10-08T16:06:30.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 -- start start 2023-10-08T16:06:30.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:30.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7700d1c30 0x7fa770152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:30.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa77015a2b0 0x7fa770153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:30.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700b5cb0 con 0x7fa7700cfe20 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700b4e00 con 0x7fa77015a2b0 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa775c35700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700b50a0 con 0x7fa7700d1c30 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58774/0 (socket says 172.21.15.60:58774) 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.858+0000 7fa76f7fe700 1 -- 172.21.15.60:0/46193835 learned_addr learned my addr 172.21.15.60:0/46193835 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76ffff700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa77015a2b0 0x7fa770153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76effd700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7700d1c30 0x7fa770152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76f7fe700 1 -- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7700d1c30 msgr2=0x7fa770152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76f7fe700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7700d1c30 0x7fa770152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76f7fe700 1 -- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa77015a2b0 msgr2=0x7fa770153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76f7fe700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa77015a2b0 0x7fa770153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:30.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76f7fe700 1 -- 172.21.15.60:0/46193835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009a20 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76effd700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7700d1c30 0x7fa770152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa76f7fe700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700b48c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa76000d840 tx=0x7fa760008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760014620 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760014780 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760014b40 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700b5380 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.859+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7700b5940 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.860+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77004c3c0 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.860+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa76001d400 con 0x7fa7700cfe20 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.861+0000 7fa7577fe700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa75c066f30 0x7fa75c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:30.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.861+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa760084da0 con 0x7fa7700cfe20 2023-10-08T16:06:30.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.861+0000 7fa76effd700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa75c066f30 0x7fa75c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:30.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.861+0000 7fa76effd700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa75c066f30 0x7fa75c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7700d2000 tx=0x7fa764009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:30.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:30.865+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa760052010 con 0x7fa7700cfe20 2023-10-08T16:06:31.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.100+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa770064a00 con 0x7fa7700cfe20 2023-10-08T16:06:31.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.101+0000 7fa7577fe700 1 -- 172.21.15.60:0/46193835 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fa760055630 con 0x7fa7700cfe20 2023-10-08T16:06:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:31.101 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:06:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa75c066f30 msgr2=0x7fa75c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa75c066f30 0x7fa75c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7700d2000 tx=0x7fa764009040 comp rx=0 tx=0).stop 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 msgr2=0x7fa7700b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700b48c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa76000d840 tx=0x7fa760008040 comp rx=0 tx=0).stop 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 shutdown_connections 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa75c066f30 0x7fa75c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa77015a2b0 0x7fa770153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7700cfe20 0x7fa7700b48c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 --2- 172.21.15.60:0/46193835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7700d1c30 0x7fa770152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 >> 172.21.15.60:0/46193835 conn(0x7fa770067e40 msgr2=0x7fa7700c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 shutdown_connections 2023-10-08T16:06:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.103+0000 7fa775c35700 1 -- 172.21.15.60:0/46193835 wait complete. 2023-10-08T16:06:31.105 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:06:31.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:31.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.234+0000 7f6ce65c4700 1 Processor -- start 2023-10-08T16:06:31.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.234+0000 7f6ce65c4700 1 -- start start 2023-10-08T16:06:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6ce65c4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ce015a1e0 0x7f6ce00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6ce65c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce00b3430 0x7f6ce00cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6ce65c4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce015db80 con 0x7f6ce0159e10 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6ce65c4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce015e800 con 0x7f6ce015a1e0 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6ce65c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce015de60 con 0x7f6ce00b3430 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ce015a1e0 0x7f6ce00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6ce0159e10 0x7f6ce00b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59430/0 (socket says 172.21.15.60:59430) 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdffff700 1 -- 172.21.15.60:0/2870319884 learned_addr learned my addr 172.21.15.60:0/2870319884 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6ce4b61700 1 --2- 172.21.15.60:0/2870319884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce00b3430 0x7f6ce00cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2870319884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce00b3430 msgr2=0x7f6ce00cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdf7fe700 1 --2- 172.21.15.60:0/2870319884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce00b3430 0x7f6ce00cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2870319884 >> v1:172.21.15.60:6789/0 conn(0x7f6ce0159e10 legacy=0x7f6ce00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdeffd700 1 -- 172.21.15.60:0/2870319884 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538392375 0 0) 0x7f6ce015db80 con 0x7f6ce0159e10 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2870319884 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce015e140 con 0x7f6ce015a1e0 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdf7fe700 1 --2- 172.21.15.60:0/2870319884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce015a1e0 0x7f6ce00cd740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40098e0 tx=0x7f6cd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6936dcd6fcdf8f51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdeffd700 1 -- 172.21.15.60:0/2870319884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4009e80 con 0x7f6ce015a1e0 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdeffd700 1 -- 172.21.15.60:0/2870319884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400b860 con 0x7f6ce015a1e0 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.235+0000 7f6cdeffd700 1 -- 172.21.15.60:0/2870319884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400bbe0 con 0x7f6ce015a1e0 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2870319884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce015a1e0 msgr2=0x7f6ce00cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2870319884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce015a1e0 0x7f6ce00cd740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40098e0 tx=0x7f6cd40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2870319884 shutdown_connections 2023-10-08T16:06:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2870319884 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce00b3430 0x7f6ce00cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2870319884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce015a1e0 0x7f6ce00cd740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2870319884 >> 172.21.15.60:0/2870319884 conn(0x7f6ce0067660 msgr2=0x7f6ce0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2870319884 shutdown_connections 2023-10-08T16:06:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.236+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2870319884 wait complete. 2023-10-08T16:06:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.237+0000 7f6ce65c4700 1 Processor -- start 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.237+0000 7f6ce65c4700 1 -- start start 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce65c4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce00b3430 0x7f6ce00c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce65c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 0x7f6ce00ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce65c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce015a1e0 0x7f6ce00d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce65c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00c5730 con 0x7f6ce0159e10 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce65c4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00c59d0 con 0x7f6ce00b3430 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce65c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00c5cb0 con 0x7f6ce015a1e0 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 0x7f6ce00ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 0x7f6ce00ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58790/0 (socket says 172.21.15.60:58790) 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2521480578 learned_addr learned my addr 172.21.15.60:0/2521480578 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdffff700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce00b3430 0x7f6ce00c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6ce4b61700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce015a1e0 0x7f6ce00d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce015a1e0 msgr2=0x7f6ce00d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce015a1e0 0x7f6ce00d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce00b3430 msgr2=0x7f6ce00c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce00b3430 0x7f6ce00c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.238+0000 7f6cdf7fe700 1 -- 172.21.15.60:0/2521480578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009420 con 0x7f6ce0159e10 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6cdffff700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce00b3430 0x7f6ce00c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6ce4b61700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce015a1e0 0x7f6ce00d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6cdf7fe700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 0x7f6ce00ca7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4013000 tx=0x7f6cd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400bbe0 con 0x7f6ce0159e10 2023-10-08T16:06:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd4011420 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce00c5f90 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40117a0 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.239+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce00c97c0 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.240+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce00c64b0 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.240+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cd4011b90 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.241+0000 7f6cc7fff700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.241+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6cd40859a0 con 0x7f6ce0159e10 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.241+0000 7f6cdffff700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.241+0000 7f6cdffff700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ccc066f30 0x7f6ccc0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00018d0 tx=0x7f6cd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.245+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ce00c64b0 con 0x7f6ce0159e10 2023-10-08T16:06:31.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.437+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce00c64b0 con 0x7f6ce0159e10 2023-10-08T16:06:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.438+0000 7f6cc7fff700 1 -- 172.21.15.60:0/2521480578 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f6ce00c64b0 con 0x7f6ce0159e10 2023-10-08T16:06:31.438 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:31.439 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":46,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:28.693707+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:25.007166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:26.073203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ccc066f30 msgr2=0x7f6ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ccc066f30 0x7f6ccc0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00018d0 tx=0x7f6cd0009040 comp rx=0 tx=0).stop 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 msgr2=0x7f6ce00ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 0x7f6ce00ca7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4013000 tx=0x7f6cd4017000 comp rx=0 tx=0).stop 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 shutdown_connections 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ce015a1e0 0x7f6ce00d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce00b3430 0x7f6ce00c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 --2- 172.21.15.60:0/2521480578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0159e10 0x7f6ce00ca7a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 >> 172.21.15.60:0/2521480578 conn(0x7f6ce0067660 msgr2=0x7f6ce00cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:31.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 shutdown_connections 2023-10-08T16:06:31.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.440+0000 7f6ce65c4700 1 -- 172.21.15.60:0/2521480578 wait complete. 2023-10-08T16:06:31.453 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:06:31.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.572+0000 7f02fb098700 1 Processor -- start 2023-10-08T16:06:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.572+0000 7f02fb098700 1 -- start start 2023-10-08T16:06:31.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02fb098700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 0x7f02f4161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02fb098700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f40c9cb0 con 0x7f02f40c75c0 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02fb098700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f40c90a0 con 0x7f02f40abae0 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02fb098700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c9380 con 0x7f02f40ade00 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f02f40c75c0 0x7f02f40c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59434/0 (socket says 172.21.15.60:59434) 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f3fff700 1 -- 172.21.15.60:0/3298648019 learned_addr learned my addr 172.21.15.60:0/3298648019 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f9635700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 0x7f02f4161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163049282 0 0) 0x7f02f40c9cb0 con 0x7f02f40c75c0 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e0003570 con 0x7f02f40c75c0 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994012540 0 0) 0x7f02e0003570 con 0x7f02f40c75c0 2023-10-08T16:06:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 msgr2=0x7f02f4161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 0x7f02f4161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 >> v1:172.21.15.144:6789/0 conn(0x7f02f40abae0 legacy=0x7f02f40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40c9660 con 0x7f02f40c75c0 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f02dc001470 con 0x7f02f40c75c0 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 >> v1:172.21.15.60:6789/0 conn(0x7f02f40c75c0 legacy=0x7f02f40c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e0003a90 0x7f02e0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 0x7f02e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c9380 con 0x7f02e0004810 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e000bb40 con 0x7f02e0003a90 2023-10-08T16:06:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.573+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e000bd00 con 0x7f02f40ade00 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f8e34700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e0003a90 0x7f02e0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f9635700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 0x7f02e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 -- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 msgr2=0x7f02e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40ade00 0x7f02e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 -- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e0003a90 msgr2=0x7f02e0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e0003a90 0x7f02e0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 -- 172.21.15.60:0/3298648019 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0003570 con 0x7f02e0004810 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f3fff700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02e0004c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c390 tx=0x7f02dc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd77c2498d45834 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00cc60 con 0x7f02e0004810 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc00cdc0 con 0x7f02e0004810 2023-10-08T16:06:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.574+0000 7f02f37fe700 1 -- 172.21.15.60:0/3298648019 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc005b70 con 0x7f02e0004810 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02fb098700 1 -- 172.21.15.60:0/3298648019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 msgr2=0x7f02e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02fb098700 1 --2- 172.21.15.60:0/3298648019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02e0004c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c390 tx=0x7f02dc001e70 comp rx=0 tx=0).stop 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02f9635700 1 -- 172.21.15.60:0/3298648019 reap_dead start 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02fb098700 1 -- 172.21.15.60:0/3298648019 shutdown_connections 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02fb098700 1 -- 172.21.15.60:0/3298648019 >> 172.21.15.60:0/3298648019 conn(0x7f02f4067660 msgr2=0x7f02f4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02fb098700 1 -- 172.21.15.60:0/3298648019 shutdown_connections 2023-10-08T16:06:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.575+0000 7f02fb098700 1 -- 172.21.15.60:0/3298648019 wait complete. 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.576+0000 7f02fb098700 1 Processor -- start 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.576+0000 7f02fb098700 1 -- start start 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02fb098700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02f40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02fb098700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f4169b80 0x7f02f414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02fb098700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40c2f00 0x7f02f40aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02fb098700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c39c0 con 0x7f02e0004810 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02fb098700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c3ca0 con 0x7f02f4169b80 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02fb098700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c3f80 con 0x7f02f40c2f00 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02f40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02f40cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58800/0 (socket says 172.21.15.60:58800) 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 -- 172.21.15.60:0/4161151411 learned_addr learned my addr 172.21.15.60:0/4161151411 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f3fff700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f4169b80 0x7f02f414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f9635700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40c2f00 0x7f02f40aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 -- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40c2f00 msgr2=0x7f02f40aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40c2f00 0x7f02f40aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 -- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f4169b80 msgr2=0x7f02f414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f4169b80 0x7f02f414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 -- 172.21.15.60:0/4161151411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40c4260 con 0x7f02e0004810 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f8e34700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02f40cd320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00ed80 tx=0x7f02ec0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.577+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00eee0 con 0x7f02e0004810 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.578+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00ca60 con 0x7f02e0004810 2023-10-08T16:06:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.578+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f40c4540 con 0x7f02e0004810 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.578+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00ce00 con 0x7f02e0004810 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.578+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f414e1e0 con 0x7f02e0004810 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.578+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f40c4780 con 0x7f02e0004810 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.579+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02ec015640 con 0x7f02e0004810 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.580+0000 7f02f0ff9700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f02d4066f30 0x7f02d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.580+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02ec085780 con 0x7f02e0004810 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.580+0000 7f02f3fff700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f02d4066f30 0x7f02d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.580+0000 7f02f3fff700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f02d4066f30 0x7f02d40693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02dc001ed0 tx=0x7f02dc015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.583+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02ec052a70 con 0x7f02e0004810 2023-10-08T16:06:31.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.771+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02f40c3e10 con 0x7f02d4066f30 2023-10-08T16:06:31.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.779+0000 7f02f0ff9700 1 -- 172.21.15.60:0/4161151411 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285128 (secure 0 0 0) 0x7f02f40c3e10 con 0x7f02d4066f30 2023-10-08T16:06:31.783 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:31.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.782+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f02d4066f30 msgr2=0x7f02d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.782+0000 7f02fb098700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f02d4066f30 0x7f02d40693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02dc001ed0 tx=0x7f02dc015000 comp rx=0 tx=0).stop 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.782+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 msgr2=0x7f02f40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.782+0000 7f02fb098700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02f40cd320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00ed80 tx=0x7f02ec0016d0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.782+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 shutdown_connections 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f02d4066f30 0x7f02d40693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02f40c2f00 0x7f02f40aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e0004810 0x7f02f40cd320 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 --2- 172.21.15.60:0/4161151411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f4169b80 0x7f02f414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 >> 172.21.15.60:0/4161151411 conn(0x7f02f4067660 msgr2=0x7f02f4069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 shutdown_connections 2023-10-08T16:06:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.783+0000 7f02fb098700 1 -- 172.21.15.60:0/4161151411 wait complete. 2023-10-08T16:06:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:06:31.795 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-08T16:06:31.578195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559631,"statfs":{"total":1600000000,"available":1597062540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.890921"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715467+0000","last_change":"2023-10-08T16:06:27.715396+0000","last_active":"2023-10-08T16:06:27.715467+0000","last_peered":"2023-10-08T16:06:27.715467+0000","last_clean":"2023-10-08T16:06:27.715467+0000","last_became_active":"2023-10-08T16:06:27.715141+0000","last_became_peered":"2023-10-08T16:06:27.715141+0000","last_unstale":"2023-10-08T16:06:27.715467+0000","last_undegraded":"2023-10-08T16:06:27.715467+0000","last_fullsized":"2023-10-08T16:06:27.715467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:57.462405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707920+0000","last_change":"2023-10-08T16:06:27.707855+0000","last_active":"2023-10-08T16:06:27.707920+0000","last_peered":"2023-10-08T16:06:27.707920+0000","last_clean":"2023-10-08T16:06:27.707920+0000","last_became_active":"2023-10-08T16:06:27.707587+0000","last_became_peered":"2023-10-08T16:06:27.707587+0000","last_unstale":"2023-10-08T16:06:27.707920+0000","last_undegraded":"2023-10-08T16:06:27.707920+0000","last_fullsized":"2023-10-08T16:06:27.707920+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:24.825692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715615+0000","last_change":"2023-10-08T16:06:27.715295+0000","last_active":"2023-10-08T16:06:27.715615+0000","last_peered":"2023-10-08T16:06:27.715615+0000","last_clean":"2023-10-08T16:06:27.715615+0000","last_became_active":"2023-10-08T16:06:27.714719+0000","last_became_peered":"2023-10-08T16:06:27.714719+0000","last_unstale":"2023-10-08T16:06:27.715615+0000","last_undegraded":"2023-10-08T16:06:27.715615+0000","last_fullsized":"2023-10-08T16:06:27.715615+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:36.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.711871+0000","last_change":"2023-10-08T16:06:27.711741+0000","last_active":"2023-10-08T16:06:27.711871+0000","last_peered":"2023-10-08T16:06:27.711871+0000","last_clean":"2023-10-08T16:06:27.711871+0000","last_became_active":"2023-10-08T16:06:27.707610+0000","last_became_peered":"2023-10-08T16:06:27.707610+0000","last_unstale":"2023-10-08T16:06:27.711871+0000","last_undegraded":"2023-10-08T16:06:27.711871+0000","last_fullsized":"2023-10-08T16:06:27.711871+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:47.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717423+0000","last_change":"2023-10-08T16:06:27.716750+0000","last_active":"2023-10-08T16:06:27.717423+0000","last_peered":"2023-10-08T16:06:27.717423+0000","last_clean":"2023-10-08T16:06:27.717423+0000","last_became_active":"2023-10-08T16:06:27.716466+0000","last_became_peered":"2023-10-08T16:06:27.716466+0000","last_unstale":"2023-10-08T16:06:27.717423+0000","last_undegraded":"2023-10-08T16:06:27.717423+0000","last_fullsized":"2023-10-08T16:06:27.717423+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:47.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709284+0000","last_change":"2023-10-08T16:06:27.709193+0000","last_active":"2023-10-08T16:06:27.709284+0000","last_peered":"2023-10-08T16:06:27.709284+0000","last_clean":"2023-10-08T16:06:27.709284+0000","last_became_active":"2023-10-08T16:06:27.708923+0000","last_became_peered":"2023-10-08T16:06:27.708923+0000","last_unstale":"2023-10-08T16:06:27.709284+0000","last_undegraded":"2023-10-08T16:06:27.709284+0000","last_fullsized":"2023-10-08T16:06:27.709284+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:45.527728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707920+0000","last_change":"2023-10-08T16:06:27.707869+0000","last_active":"2023-10-08T16:06:27.707920+0000","last_peered":"2023-10-08T16:06:27.707920+0000","last_clean":"2023-10-08T16:06:27.707920+0000","last_became_active":"2023-10-08T16:06:27.707664+0000","last_became_peered":"2023-10-08T16:06:27.707664+0000","last_unstale":"2023-10-08T16:06:27.707920+0000","last_undegraded":"2023-10-08T16:06:27.707920+0000","last_fullsized":"2023-10-08T16:06:27.707920+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:24.825692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713722+0000","last_change":"2023-10-08T16:06:27.713390+0000","last_active":"2023-10-08T16:06:27.713722+0000","last_peered":"2023-10-08T16:06:27.713722+0000","last_clean":"2023-10-08T16:06:27.713722+0000","last_became_active":"2023-10-08T16:06:27.713007+0000","last_became_peered":"2023-10-08T16:06:27.713007+0000","last_unstale":"2023-10-08T16:06:27.713722+0000","last_undegraded":"2023-10-08T16:06:27.713722+0000","last_fullsized":"2023-10-08T16:06:27.713722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:51.653992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712870+0000","last_change":"2023-10-08T16:06:27.712816+0000","last_active":"2023-10-08T16:06:27.712870+0000","last_peered":"2023-10-08T16:06:27.712870+0000","last_clean":"2023-10-08T16:06:27.712870+0000","last_became_active":"2023-10-08T16:06:27.712297+0000","last_became_peered":"2023-10-08T16:06:27.712297+0000","last_unstale":"2023-10-08T16:06:27.712870+0000","last_undegraded":"2023-10-08T16:06:27.712870+0000","last_fullsized":"2023-10-08T16:06:27.712870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:36.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.720329+0000","last_change":"2023-10-08T16:06:27.720261+0000","last_active":"2023-10-08T16:06:27.720329+0000","last_peered":"2023-10-08T16:06:27.720329+0000","last_clean":"2023-10-08T16:06:27.720329+0000","last_became_active":"2023-10-08T16:06:27.719210+0000","last_became_peered":"2023-10-08T16:06:27.719210+0000","last_unstale":"2023-10-08T16:06:27.720329+0000","last_undegraded":"2023-10-08T16:06:27.720329+0000","last_fullsized":"2023-10-08T16:06:27.720329+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:32:18.557567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716604+0000","last_change":"2023-10-08T16:06:27.714030+0000","last_active":"2023-10-08T16:06:27.716604+0000","last_peered":"2023-10-08T16:06:27.716604+0000","last_clean":"2023-10-08T16:06:27.716604+0000","last_became_active":"2023-10-08T16:06:27.713784+0000","last_became_peered":"2023-10-08T16:06:27.713784+0000","last_unstale":"2023-10-08T16:06:27.716604+0000","last_undegraded":"2023-10-08T16:06:27.716604+0000","last_fullsized":"2023-10-08T16:06:27.716604+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:37.654360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.704460+0000","last_change":"2023-10-08T16:06:27.704341+0000","last_active":"2023-10-08T16:06:27.704460+0000","last_peered":"2023-10-08T16:06:27.704460+0000","last_clean":"2023-10-08T16:06:27.704460+0000","last_became_active":"2023-10-08T16:06:27.703481+0000","last_became_peered":"2023-10-08T16:06:27.703481+0000","last_unstale":"2023-10-08T16:06:27.704460+0000","last_undegraded":"2023-10-08T16:06:27.704460+0000","last_fullsized":"2023-10-08T16:06:27.704460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:36.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.702301+0000","last_change":"2023-10-08T16:06:27.702130+0000","last_active":"2023-10-08T16:06:27.702301+0000","last_peered":"2023-10-08T16:06:27.702301+0000","last_clean":"2023-10-08T16:06:27.702301+0000","last_became_active":"2023-10-08T16:06:27.701814+0000","last_became_peered":"2023-10-08T16:06:27.701814+0000","last_unstale":"2023-10-08T16:06:27.702301+0000","last_undegraded":"2023-10-08T16:06:27.702301+0000","last_fullsized":"2023-10-08T16:06:27.702301+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:53.515636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712733+0000","last_change":"2023-10-08T16:06:27.712668+0000","last_active":"2023-10-08T16:06:27.712733+0000","last_peered":"2023-10-08T16:06:27.712733+0000","last_clean":"2023-10-08T16:06:27.712733+0000","last_became_active":"2023-10-08T16:06:27.711977+0000","last_became_peered":"2023-10-08T16:06:27.711977+0000","last_unstale":"2023-10-08T16:06:27.712733+0000","last_undegraded":"2023-10-08T16:06:27.712733+0000","last_fullsized":"2023-10-08T16:06:27.712733+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:01.082611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705326+0000","last_change":"2023-10-08T16:06:27.704494+0000","last_active":"2023-10-08T16:06:27.705326+0000","last_peered":"2023-10-08T16:06:27.705326+0000","last_clean":"2023-10-08T16:06:27.705326+0000","last_became_active":"2023-10-08T16:06:27.704260+0000","last_became_peered":"2023-10-08T16:06:27.704260+0000","last_unstale":"2023-10-08T16:06:27.705326+0000","last_undegraded":"2023-10-08T16:06:27.705326+0000","last_fullsized":"2023-10-08T16:06:27.705326+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:02.810573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715971+0000","last_change":"2023-10-08T16:06:27.715306+0000","last_active":"2023-10-08T16:06:27.715971+0000","last_peered":"2023-10-08T16:06:27.715971+0000","last_clean":"2023-10-08T16:06:27.715971+0000","last_became_active":"2023-10-08T16:06:27.714867+0000","last_became_peered":"2023-10-08T16:06:27.714867+0000","last_unstale":"2023-10-08T16:06:27.715971+0000","last_undegraded":"2023-10-08T16:06:27.715971+0000","last_fullsized":"2023-10-08T16:06:27.715971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:52.890183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709534+0000","last_change":"2023-10-08T16:06:27.709429+0000","last_active":"2023-10-08T16:06:27.709534+0000","last_peered":"2023-10-08T16:06:27.709534+0000","last_clean":"2023-10-08T16:06:27.709534+0000","last_became_active":"2023-10-08T16:06:27.708836+0000","last_became_peered":"2023-10-08T16:06:27.708836+0000","last_unstale":"2023-10-08T16:06:27.709534+0000","last_undegraded":"2023-10-08T16:06:27.709534+0000","last_fullsized":"2023-10-08T16:06:27.709534+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:24.904876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715631+0000","last_change":"2023-10-08T16:06:27.715453+0000","last_active":"2023-10-08T16:06:27.715631+0000","last_peered":"2023-10-08T16:06:27.715631+0000","last_clean":"2023-10-08T16:06:27.715631+0000","last_became_active":"2023-10-08T16:06:27.715017+0000","last_became_peered":"2023-10-08T16:06:27.715017+0000","last_unstale":"2023-10-08T16:06:27.715631+0000","last_undegraded":"2023-10-08T16:06:27.715631+0000","last_fullsized":"2023-10-08T16:06:27.715631+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:56.619754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714085+0000","last_change":"2023-10-08T16:06:27.713019+0000","last_active":"2023-10-08T16:06:27.714085+0000","last_peered":"2023-10-08T16:06:27.714085+0000","last_clean":"2023-10-08T16:06:27.714085+0000","last_became_active":"2023-10-08T16:06:27.712367+0000","last_became_peered":"2023-10-08T16:06:27.712367+0000","last_unstale":"2023-10-08T16:06:27.714085+0000","last_undegraded":"2023-10-08T16:06:27.714085+0000","last_fullsized":"2023-10-08T16:06:27.714085+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:43.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714296+0000","last_change":"2023-10-08T16:06:27.714238+0000","last_active":"2023-10-08T16:06:27.714296+0000","last_peered":"2023-10-08T16:06:27.714296+0000","last_clean":"2023-10-08T16:06:27.714296+0000","last_became_active":"2023-10-08T16:06:27.714017+0000","last_became_peered":"2023-10-08T16:06:27.714017+0000","last_unstale":"2023-10-08T16:06:27.714296+0000","last_undegraded":"2023-10-08T16:06:27.714296+0000","last_fullsized":"2023-10-08T16:06:27.714296+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:30.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701632+0000","last_change":"2023-10-08T16:06:27.701561+0000","last_active":"2023-10-08T16:06:27.701632+0000","last_peered":"2023-10-08T16:06:27.701632+0000","last_clean":"2023-10-08T16:06:27.701632+0000","last_became_active":"2023-10-08T16:06:27.701285+0000","last_became_peered":"2023-10-08T16:06:27.701285+0000","last_unstale":"2023-10-08T16:06:27.701632+0000","last_undegraded":"2023-10-08T16:06:27.701632+0000","last_fullsized":"2023-10-08T16:06:27.701632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:13.287182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717460+0000","last_change":"2023-10-08T16:06:27.717380+0000","last_active":"2023-10-08T16:06:27.717460+0000","last_peered":"2023-10-08T16:06:27.717460+0000","last_clean":"2023-10-08T16:06:27.717460+0000","last_became_active":"2023-10-08T16:06:27.716607+0000","last_became_peered":"2023-10-08T16:06:27.716607+0000","last_unstale":"2023-10-08T16:06:27.717460+0000","last_undegraded":"2023-10-08T16:06:27.717460+0000","last_fullsized":"2023-10-08T16:06:27.717460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:57.462405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706518+0000","last_change":"2023-10-08T16:06:27.706456+0000","last_active":"2023-10-08T16:06:27.706518+0000","last_peered":"2023-10-08T16:06:27.706518+0000","last_clean":"2023-10-08T16:06:27.706518+0000","last_became_active":"2023-10-08T16:06:27.706268+0000","last_became_peered":"2023-10-08T16:06:27.706268+0000","last_unstale":"2023-10-08T16:06:27.706518+0000","last_undegraded":"2023-10-08T16:06:27.706518+0000","last_fullsized":"2023-10-08T16:06:27.706518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:03.511667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714066+0000","last_change":"2023-10-08T16:06:27.712890+0000","last_active":"2023-10-08T16:06:27.714066+0000","last_peered":"2023-10-08T16:06:27.714066+0000","last_clean":"2023-10-08T16:06:27.714066+0000","last_became_active":"2023-10-08T16:06:27.711820+0000","last_became_peered":"2023-10-08T16:06:27.711820+0000","last_unstale":"2023-10-08T16:06:27.714066+0000","last_undegraded":"2023-10-08T16:06:27.714066+0000","last_fullsized":"2023-10-08T16:06:27.714066+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:38.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714026+0000","last_change":"2023-10-08T16:06:27.712621+0000","last_active":"2023-10-08T16:06:27.714026+0000","last_peered":"2023-10-08T16:06:27.714026+0000","last_clean":"2023-10-08T16:06:27.714026+0000","last_became_active":"2023-10-08T16:06:27.706875+0000","last_became_peered":"2023-10-08T16:06:27.706875+0000","last_unstale":"2023-10-08T16:06:27.714026+0000","last_undegraded":"2023-10-08T16:06:27.714026+0000","last_fullsized":"2023-10-08T16:06:27.714026+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:33.337615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703896+0000","last_change":"2023-10-08T16:06:27.703767+0000","last_active":"2023-10-08T16:06:27.703896+0000","last_peered":"2023-10-08T16:06:27.703896+0000","last_clean":"2023-10-08T16:06:27.703896+0000","last_became_active":"2023-10-08T16:06:27.703461+0000","last_became_peered":"2023-10-08T16:06:27.703461+0000","last_unstale":"2023-10-08T16:06:27.703896+0000","last_undegraded":"2023-10-08T16:06:27.703896+0000","last_fullsized":"2023-10-08T16:06:27.703896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:48.767066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709665+0000","last_change":"2023-10-08T16:06:27.709608+0000","last_active":"2023-10-08T16:06:27.709665+0000","last_peered":"2023-10-08T16:06:27.709665+0000","last_clean":"2023-10-08T16:06:27.709665+0000","last_became_active":"2023-10-08T16:06:27.709154+0000","last_became_peered":"2023-10-08T16:06:27.709154+0000","last_unstale":"2023-10-08T16:06:27.709665+0000","last_undegraded":"2023-10-08T16:06:27.709665+0000","last_fullsized":"2023-10-08T16:06:27.709665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:23.361433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703338+0000","last_change":"2023-10-08T16:06:27.701980+0000","last_active":"2023-10-08T16:06:27.703338+0000","last_peered":"2023-10-08T16:06:27.703338+0000","last_clean":"2023-10-08T16:06:27.703338+0000","last_became_active":"2023-10-08T16:06:27.701126+0000","last_became_peered":"2023-10-08T16:06:27.701126+0000","last_unstale":"2023-10-08T16:06:27.703338+0000","last_undegraded":"2023-10-08T16:06:27.703338+0000","last_fullsized":"2023-10-08T16:06:27.703338+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:50.088934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703338+0000","last_change":"2023-10-08T16:06:27.703274+0000","last_active":"2023-10-08T16:06:27.703338+0000","last_peered":"2023-10-08T16:06:27.703338+0000","last_clean":"2023-10-08T16:06:27.703338+0000","last_became_active":"2023-10-08T16:06:27.703049+0000","last_became_peered":"2023-10-08T16:06:27.703049+0000","last_unstale":"2023-10-08T16:06:27.703338+0000","last_undegraded":"2023-10-08T16:06:27.703338+0000","last_fullsized":"2023-10-08T16:06:27.703338+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:38.606892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713967+0000","last_change":"2023-10-08T16:06:27.713212+0000","last_active":"2023-10-08T16:06:27.713967+0000","last_peered":"2023-10-08T16:06:27.713967+0000","last_clean":"2023-10-08T16:06:27.713967+0000","last_became_active":"2023-10-08T16:06:27.711030+0000","last_became_peered":"2023-10-08T16:06:27.711030+0000","last_unstale":"2023-10-08T16:06:27.713967+0000","last_undegraded":"2023-10-08T16:06:27.713967+0000","last_fullsized":"2023-10-08T16:06:27.713967+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:17.391814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705345+0000","last_change":"2023-10-08T16:06:27.704777+0000","last_active":"2023-10-08T16:06:27.705345+0000","last_peered":"2023-10-08T16:06:27.705345+0000","last_clean":"2023-10-08T16:06:27.705345+0000","last_became_active":"2023-10-08T16:06:27.704384+0000","last_became_peered":"2023-10-08T16:06:27.704384+0000","last_unstale":"2023-10-08T16:06:27.705345+0000","last_undegraded":"2023-10-08T16:06:27.705345+0000","last_fullsized":"2023-10-08T16:06:27.705345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:40.948921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.699968+0000","last_change":"2023-10-08T16:06:27.699853+0000","last_active":"2023-10-08T16:06:27.699968+0000","last_peered":"2023-10-08T16:06:27.699968+0000","last_clean":"2023-10-08T16:06:27.699968+0000","last_became_active":"2023-10-08T16:06:27.699604+0000","last_became_peered":"2023-10-08T16:06:27.699604+0000","last_unstale":"2023-10-08T16:06:27.699968+0000","last_undegraded":"2023-10-08T16:06:27.699968+0000","last_fullsized":"2023-10-08T16:06:27.699968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:34.121234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701022+0000","last_change":"2023-10-08T16:06:27.700825+0000","last_active":"2023-10-08T16:06:27.701022+0000","last_peered":"2023-10-08T16:06:27.701022+0000","last_clean":"2023-10-08T16:06:27.701022+0000","last_became_active":"2023-10-08T16:06:27.700192+0000","last_became_peered":"2023-10-08T16:06:27.700192+0000","last_unstale":"2023-10-08T16:06:27.701022+0000","last_undegraded":"2023-10-08T16:06:27.701022+0000","last_fullsized":"2023-10-08T16:06:27.701022+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:09.034819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716763+0000","last_change":"2023-10-08T16:06:26.706667+0000","last_active":"2023-10-08T16:06:27.716763+0000","last_peered":"2023-10-08T16:06:27.716763+0000","last_clean":"2023-10-08T16:06:27.716763+0000","last_became_active":"2023-10-08T16:06:26.706445+0000","last_became_peered":"2023-10-08T16:06:26.706445+0000","last_unstale":"2023-10-08T16:06:27.716763+0000","last_undegraded":"2023-10-08T16:06:27.716763+0000","last_fullsized":"2023-10-08T16:06:27.716763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:22.855740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705695+0000","last_change":"2023-10-08T16:06:27.705470+0000","last_active":"2023-10-08T16:06:27.705695+0000","last_peered":"2023-10-08T16:06:27.705695+0000","last_clean":"2023-10-08T16:06:27.705695+0000","last_became_active":"2023-10-08T16:06:27.705189+0000","last_became_peered":"2023-10-08T16:06:27.705189+0000","last_unstale":"2023-10-08T16:06:27.705695+0000","last_undegraded":"2023-10-08T16:06:27.705695+0000","last_fullsized":"2023-10-08T16:06:27.705695+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:48.275891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714319+0000","last_change":"2023-10-08T16:06:26.708648+0000","last_active":"2023-10-08T16:06:27.714319+0000","last_peered":"2023-10-08T16:06:27.714319+0000","last_clean":"2023-10-08T16:06:27.714319+0000","last_became_active":"2023-10-08T16:06:26.708389+0000","last_became_peered":"2023-10-08T16:06:26.708389+0000","last_unstale":"2023-10-08T16:06:27.714319+0000","last_undegraded":"2023-10-08T16:06:27.714319+0000","last_fullsized":"2023-10-08T16:06:27.714319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:16.567187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703357+0000","last_change":"2023-10-08T16:06:27.702144+0000","last_active":"2023-10-08T16:06:27.703357+0000","last_peered":"2023-10-08T16:06:27.703357+0000","last_clean":"2023-10-08T16:06:27.703357+0000","last_became_active":"2023-10-08T16:06:27.701923+0000","last_became_peered":"2023-10-08T16:06:27.701923+0000","last_unstale":"2023-10-08T16:06:27.703357+0000","last_undegraded":"2023-10-08T16:06:27.703357+0000","last_fullsized":"2023-10-08T16:06:27.703357+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:17.391814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715909+0000","last_change":"2023-10-08T16:06:26.700276+0000","last_active":"2023-10-08T16:06:27.715909+0000","last_peered":"2023-10-08T16:06:27.715909+0000","last_clean":"2023-10-08T16:06:27.715909+0000","last_became_active":"2023-10-08T16:06:26.699904+0000","last_became_peered":"2023-10-08T16:06:26.699904+0000","last_unstale":"2023-10-08T16:06:27.715909+0000","last_undegraded":"2023-10-08T16:06:27.715909+0000","last_fullsized":"2023-10-08T16:06:27.715909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:31.774543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701170+0000","last_change":"2023-10-08T16:06:27.701070+0000","last_active":"2023-10-08T16:06:27.701170+0000","last_peered":"2023-10-08T16:06:27.701170+0000","last_clean":"2023-10-08T16:06:27.701170+0000","last_became_active":"2023-10-08T16:06:27.700801+0000","last_became_peered":"2023-10-08T16:06:27.700801+0000","last_unstale":"2023-10-08T16:06:27.701170+0000","last_undegraded":"2023-10-08T16:06:27.701170+0000","last_fullsized":"2023-10-08T16:06:27.701170+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:52.890183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.710492+0000","last_change":"2023-10-08T16:06:26.704991+0000","last_active":"2023-10-08T16:06:27.710492+0000","last_peered":"2023-10-08T16:06:27.710492+0000","last_clean":"2023-10-08T16:06:27.710492+0000","last_became_active":"2023-10-08T16:06:26.704745+0000","last_became_peered":"2023-10-08T16:06:26.704745+0000","last_unstale":"2023-10-08T16:06:27.710492+0000","last_undegraded":"2023-10-08T16:06:27.710492+0000","last_fullsized":"2023-10-08T16:06:27.710492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:22.855740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.711012+0000","last_change":"2023-10-08T16:06:27.710947+0000","last_active":"2023-10-08T16:06:27.711012+0000","last_peered":"2023-10-08T16:06:27.711012+0000","last_clean":"2023-10-08T16:06:27.711012+0000","last_became_active":"2023-10-08T16:06:27.710328+0000","last_became_peered":"2023-10-08T16:06:27.710328+0000","last_unstale":"2023-10-08T16:06:27.711012+0000","last_undegraded":"2023-10-08T16:06:27.711012+0000","last_fullsized":"2023-10-08T16:06:27.711012+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:39.751608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.718291+0000","last_change":"2023-10-08T16:06:26.702616+0000","last_active":"2023-10-08T16:06:27.718291+0000","last_peered":"2023-10-08T16:06:27.718291+0000","last_clean":"2023-10-08T16:06:27.718291+0000","last_became_active":"2023-10-08T16:06:26.702382+0000","last_became_peered":"2023-10-08T16:06:26.702382+0000","last_unstale":"2023-10-08T16:06:27.718291+0000","last_undegraded":"2023-10-08T16:06:27.718291+0000","last_fullsized":"2023-10-08T16:06:27.718291+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:00.078062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717292+0000","last_change":"2023-10-08T16:06:27.717231+0000","last_active":"2023-10-08T16:06:27.717292+0000","last_peered":"2023-10-08T16:06:27.717292+0000","last_clean":"2023-10-08T16:06:27.717292+0000","last_became_active":"2023-10-08T16:06:27.716239+0000","last_became_peered":"2023-10-08T16:06:27.716239+0000","last_unstale":"2023-10-08T16:06:27.717292+0000","last_undegraded":"2023-10-08T16:06:27.717292+0000","last_fullsized":"2023-10-08T16:06:27.717292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:48.275891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715538+0000","last_change":"2023-10-08T16:06:26.708077+0000","last_active":"2023-10-08T16:06:27.715538+0000","last_peered":"2023-10-08T16:06:27.715538+0000","last_clean":"2023-10-08T16:06:27.715538+0000","last_became_active":"2023-10-08T16:06:26.707837+0000","last_became_peered":"2023-10-08T16:06:26.707837+0000","last_unstale":"2023-10-08T16:06:27.715538+0000","last_undegraded":"2023-10-08T16:06:27.715538+0000","last_fullsized":"2023-10-08T16:06:27.715538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:32.333067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.720215+0000","last_change":"2023-10-08T16:06:27.720095+0000","last_active":"2023-10-08T16:06:27.720215+0000","last_peered":"2023-10-08T16:06:27.720215+0000","last_clean":"2023-10-08T16:06:27.720215+0000","last_became_active":"2023-10-08T16:06:27.718840+0000","last_became_peered":"2023-10-08T16:06:27.718840+0000","last_unstale":"2023-10-08T16:06:27.720215+0000","last_undegraded":"2023-10-08T16:06:27.720215+0000","last_fullsized":"2023-10-08T16:06:27.720215+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:09.506992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697650+0000","last_change":"2023-10-08T16:06:26.703341+0000","last_active":"2023-10-08T16:06:27.697650+0000","last_peered":"2023-10-08T16:06:27.697650+0000","last_clean":"2023-10-08T16:06:27.697650+0000","last_became_active":"2023-10-08T16:06:26.702893+0000","last_became_peered":"2023-10-08T16:06:26.702893+0000","last_unstale":"2023-10-08T16:06:27.697650+0000","last_undegraded":"2023-10-08T16:06:27.697650+0000","last_fullsized":"2023-10-08T16:06:27.697650+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:08.030270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713973+0000","last_change":"2023-10-08T16:06:27.712083+0000","last_active":"2023-10-08T16:06:27.713973+0000","last_peered":"2023-10-08T16:06:27.713973+0000","last_clean":"2023-10-08T16:06:27.713973+0000","last_became_active":"2023-10-08T16:06:27.706826+0000","last_became_peered":"2023-10-08T16:06:27.706826+0000","last_unstale":"2023-10-08T16:06:27.713973+0000","last_undegraded":"2023-10-08T16:06:27.713973+0000","last_fullsized":"2023-10-08T16:06:27.713973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:12.777501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707287+0000","last_change":"2023-10-08T16:06:26.705475+0000","last_active":"2023-10-08T16:06:27.707287+0000","last_peered":"2023-10-08T16:06:27.707287+0000","last_clean":"2023-10-08T16:06:27.707287+0000","last_became_active":"2023-10-08T16:06:26.704838+0000","last_became_peered":"2023-10-08T16:06:26.704838+0000","last_unstale":"2023-10-08T16:06:27.707287+0000","last_undegraded":"2023-10-08T16:06:27.707287+0000","last_fullsized":"2023-10-08T16:06:27.707287+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:29.751225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.718505+0000","last_change":"2023-10-08T16:06:27.718369+0000","last_active":"2023-10-08T16:06:27.718505+0000","last_peered":"2023-10-08T16:06:27.718505+0000","last_clean":"2023-10-08T16:06:27.718505+0000","last_became_active":"2023-10-08T16:06:27.718125+0000","last_became_peered":"2023-10-08T16:06:27.718125+0000","last_unstale":"2023-10-08T16:06:27.718505+0000","last_undegraded":"2023-10-08T16:06:27.718505+0000","last_fullsized":"2023-10-08T16:06:27.718505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:50.088934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701107+0000","last_change":"2023-10-08T16:06:26.706917+0000","last_active":"2023-10-08T16:06:27.701107+0000","last_peered":"2023-10-08T16:06:27.701107+0000","last_clean":"2023-10-08T16:06:27.701107+0000","last_became_active":"2023-10-08T16:06:26.703588+0000","last_became_peered":"2023-10-08T16:06:26.703588+0000","last_unstale":"2023-10-08T16:06:27.701107+0000","last_undegraded":"2023-10-08T16:06:27.701107+0000","last_fullsized":"2023-10-08T16:06:27.701107+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:11.772953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.708760+0000","last_change":"2023-10-08T16:06:27.708662+0000","last_active":"2023-10-08T16:06:27.708760+0000","last_peered":"2023-10-08T16:06:27.708760+0000","last_clean":"2023-10-08T16:06:27.708760+0000","last_became_active":"2023-10-08T16:06:27.708417+0000","last_became_peered":"2023-10-08T16:06:27.708417+0000","last_unstale":"2023-10-08T16:06:27.708760+0000","last_undegraded":"2023-10-08T16:06:27.708760+0000","last_fullsized":"2023-10-08T16:06:27.708760+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:51.653992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706108+0000","last_change":"2023-10-08T16:06:26.705404+0000","last_active":"2023-10-08T16:06:27.706108+0000","last_peered":"2023-10-08T16:06:27.706108+0000","last_clean":"2023-10-08T16:06:27.706108+0000","last_became_active":"2023-10-08T16:06:26.705171+0000","last_became_peered":"2023-10-08T16:06:26.705171+0000","last_unstale":"2023-10-08T16:06:27.706108+0000","last_undegraded":"2023-10-08T16:06:27.706108+0000","last_fullsized":"2023-10-08T16:06:27.706108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:11.973316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.708191+0000","last_change":"2023-10-08T16:06:27.707810+0000","last_active":"2023-10-08T16:06:27.708191+0000","last_peered":"2023-10-08T16:06:27.708191+0000","last_clean":"2023-10-08T16:06:27.708191+0000","last_became_active":"2023-10-08T16:06:27.707588+0000","last_became_peered":"2023-10-08T16:06:27.707588+0000","last_unstale":"2023-10-08T16:06:27.708191+0000","last_undegraded":"2023-10-08T16:06:27.708191+0000","last_fullsized":"2023-10-08T16:06:27.708191+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:22.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716927+0000","last_change":"2023-10-08T16:06:26.707311+0000","last_active":"2023-10-08T16:06:27.716927+0000","last_peered":"2023-10-08T16:06:27.716927+0000","last_clean":"2023-10-08T16:06:27.716927+0000","last_became_active":"2023-10-08T16:06:26.707078+0000","last_became_peered":"2023-10-08T16:06:26.707078+0000","last_unstale":"2023-10-08T16:06:27.716927+0000","last_undegraded":"2023-10-08T16:06:27.716927+0000","last_fullsized":"2023-10-08T16:06:27.716927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:36.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712119+0000","last_change":"2023-10-08T16:06:27.711173+0000","last_active":"2023-10-08T16:06:27.712119+0000","last_peered":"2023-10-08T16:06:27.712119+0000","last_clean":"2023-10-08T16:06:27.712119+0000","last_became_active":"2023-10-08T16:06:27.710923+0000","last_became_peered":"2023-10-08T16:06:27.710923+0000","last_unstale":"2023-10-08T16:06:27.712119+0000","last_undegraded":"2023-10-08T16:06:27.712119+0000","last_fullsized":"2023-10-08T16:06:27.712119+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:47.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.719808+0000","last_change":"2023-10-08T16:06:26.703488+0000","last_active":"2023-10-08T16:06:27.719808+0000","last_peered":"2023-10-08T16:06:27.719808+0000","last_clean":"2023-10-08T16:06:27.719808+0000","last_became_active":"2023-10-08T16:06:26.703200+0000","last_became_peered":"2023-10-08T16:06:26.703200+0000","last_unstale":"2023-10-08T16:06:27.719808+0000","last_undegraded":"2023-10-08T16:06:27.719808+0000","last_fullsized":"2023-10-08T16:06:27.719808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:01.357347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715954+0000","last_change":"2023-10-08T16:06:27.715129+0000","last_active":"2023-10-08T16:06:27.715954+0000","last_peered":"2023-10-08T16:06:27.715954+0000","last_clean":"2023-10-08T16:06:27.715954+0000","last_became_active":"2023-10-08T16:06:27.706906+0000","last_became_peered":"2023-10-08T16:06:27.706906+0000","last_unstale":"2023-10-08T16:06:27.715954+0000","last_undegraded":"2023-10-08T16:06:27.715954+0000","last_fullsized":"2023-10-08T16:06:27.715954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:09.034819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716985+0000","last_change":"2023-10-08T16:06:26.706376+0000","last_active":"2023-10-08T16:06:27.716985+0000","last_peered":"2023-10-08T16:06:27.716985+0000","last_clean":"2023-10-08T16:06:27.716985+0000","last_became_active":"2023-10-08T16:06:26.706133+0000","last_became_peered":"2023-10-08T16:06:26.706133+0000","last_unstale":"2023-10-08T16:06:27.716985+0000","last_undegraded":"2023-10-08T16:06:27.716985+0000","last_fullsized":"2023-10-08T16:06:27.716985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:16.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716693+0000","last_change":"2023-10-08T16:06:27.714538+0000","last_active":"2023-10-08T16:06:27.716693+0000","last_peered":"2023-10-08T16:06:27.716693+0000","last_clean":"2023-10-08T16:06:27.716693+0000","last_became_active":"2023-10-08T16:06:27.713443+0000","last_became_peered":"2023-10-08T16:06:27.713443+0000","last_unstale":"2023-10-08T16:06:27.716693+0000","last_undegraded":"2023-10-08T16:06:27.716693+0000","last_fullsized":"2023-10-08T16:06:27.716693+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:24.825692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707573+0000","last_change":"2023-10-08T16:06:26.701006+0000","last_active":"2023-10-08T16:06:27.707573+0000","last_peered":"2023-10-08T16:06:27.707573+0000","last_clean":"2023-10-08T16:06:27.707573+0000","last_became_active":"2023-10-08T16:06:26.700753+0000","last_became_peered":"2023-10-08T16:06:26.700753+0000","last_unstale":"2023-10-08T16:06:27.707573+0000","last_undegraded":"2023-10-08T16:06:27.707573+0000","last_fullsized":"2023-10-08T16:06:27.707573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:41:48.225748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705896+0000","last_change":"2023-10-08T16:06:27.705439+0000","last_active":"2023-10-08T16:06:27.705896+0000","last_peered":"2023-10-08T16:06:27.705896+0000","last_clean":"2023-10-08T16:06:27.705896+0000","last_became_active":"2023-10-08T16:06:27.705202+0000","last_became_peered":"2023-10-08T16:06:27.705202+0000","last_unstale":"2023-10-08T16:06:27.705896+0000","last_undegraded":"2023-10-08T16:06:27.705896+0000","last_fullsized":"2023-10-08T16:06:27.705896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.698477+0000","last_change":"2023-10-08T16:06:26.705383+0000","last_active":"2023-10-08T16:06:27.698477+0000","last_peered":"2023-10-08T16:06:27.698477+0000","last_clean":"2023-10-08T16:06:27.698477+0000","last_became_active":"2023-10-08T16:06:26.705021+0000","last_became_peered":"2023-10-08T16:06:26.705021+0000","last_unstale":"2023-10-08T16:06:27.698477+0000","last_undegraded":"2023-10-08T16:06:27.698477+0000","last_fullsized":"2023-10-08T16:06:27.698477+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:35.961984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707266+0000","last_change":"2023-10-08T16:06:27.707191+0000","last_active":"2023-10-08T16:06:27.707266+0000","last_peered":"2023-10-08T16:06:27.707266+0000","last_clean":"2023-10-08T16:06:27.707266+0000","last_became_active":"2023-10-08T16:06:27.706392+0000","last_became_peered":"2023-10-08T16:06:27.706392+0000","last_unstale":"2023-10-08T16:06:27.707266+0000","last_undegraded":"2023-10-08T16:06:27.707266+0000","last_fullsized":"2023-10-08T16:06:27.707266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:09.506992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.718919+0000","last_change":"2023-10-08T16:06:26.706843+0000","last_active":"2023-10-08T16:06:27.718919+0000","last_peered":"2023-10-08T16:06:27.718919+0000","last_clean":"2023-10-08T16:06:27.718919+0000","last_became_active":"2023-10-08T16:06:26.706370+0000","last_became_peered":"2023-10-08T16:06:26.706370+0000","last_unstale":"2023-10-08T16:06:27.718919+0000","last_undegraded":"2023-10-08T16:06:27.718919+0000","last_fullsized":"2023-10-08T16:06:27.718919+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:47.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.702271+0000","last_change":"2023-10-08T16:06:27.701381+0000","last_active":"2023-10-08T16:06:27.702271+0000","last_peered":"2023-10-08T16:06:27.702271+0000","last_clean":"2023-10-08T16:06:27.702271+0000","last_became_active":"2023-10-08T16:06:27.701148+0000","last_became_peered":"2023-10-08T16:06:27.701148+0000","last_unstale":"2023-10-08T16:06:27.702271+0000","last_undegraded":"2023-10-08T16:06:27.702271+0000","last_fullsized":"2023-10-08T16:06:27.702271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:23.067150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712193+0000","last_change":"2023-10-08T16:06:26.696603+0000","last_active":"2023-10-08T16:06:27.712193+0000","last_peered":"2023-10-08T16:06:27.712193+0000","last_clean":"2023-10-08T16:06:27.712193+0000","last_became_active":"2023-10-08T16:06:26.696327+0000","last_became_peered":"2023-10-08T16:06:26.696327+0000","last_unstale":"2023-10-08T16:06:27.712193+0000","last_undegraded":"2023-10-08T16:06:27.712193+0000","last_fullsized":"2023-10-08T16:06:27.712193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:00.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712582+0000","last_change":"2023-10-08T16:06:27.712522+0000","last_active":"2023-10-08T16:06:27.712582+0000","last_peered":"2023-10-08T16:06:27.712582+0000","last_clean":"2023-10-08T16:06:27.712582+0000","last_became_active":"2023-10-08T16:06:27.711461+0000","last_became_peered":"2023-10-08T16:06:27.711461+0000","last_unstale":"2023-10-08T16:06:27.712582+0000","last_undegraded":"2023-10-08T16:06:27.712582+0000","last_fullsized":"2023-10-08T16:06:27.712582+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:39.751608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717171+0000","last_change":"2023-10-08T16:06:26.708289+0000","last_active":"2023-10-08T16:06:27.717171+0000","last_peered":"2023-10-08T16:06:27.717171+0000","last_clean":"2023-10-08T16:06:27.717171+0000","last_became_active":"2023-10-08T16:06:26.707906+0000","last_became_peered":"2023-10-08T16:06:26.707906+0000","last_unstale":"2023-10-08T16:06:27.717171+0000","last_undegraded":"2023-10-08T16:06:27.717171+0000","last_fullsized":"2023-10-08T16:06:27.717171+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:31.774543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.700238+0000","last_change":"2023-10-08T16:06:27.700180+0000","last_active":"2023-10-08T16:06:27.700238+0000","last_peered":"2023-10-08T16:06:27.700238+0000","last_clean":"2023-10-08T16:06:27.700238+0000","last_became_active":"2023-10-08T16:06:27.699990+0000","last_became_peered":"2023-10-08T16:06:27.699990+0000","last_unstale":"2023-10-08T16:06:27.700238+0000","last_undegraded":"2023-10-08T16:06:27.700238+0000","last_fullsized":"2023-10-08T16:06:27.700238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:37.654360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716981+0000","last_change":"2023-10-08T16:06:26.702628+0000","last_active":"2023-10-08T16:06:27.716981+0000","last_peered":"2023-10-08T16:06:27.716981+0000","last_clean":"2023-10-08T16:06:27.716981+0000","last_became_active":"2023-10-08T16:06:26.702396+0000","last_became_peered":"2023-10-08T16:06:26.702396+0000","last_unstale":"2023-10-08T16:06:27.716981+0000","last_undegraded":"2023-10-08T16:06:27.716981+0000","last_fullsized":"2023-10-08T16:06:27.716981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.507118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.702530+0000","last_change":"2023-10-08T16:06:27.702465+0000","last_active":"2023-10-08T16:06:27.702530+0000","last_peered":"2023-10-08T16:06:27.702530+0000","last_clean":"2023-10-08T16:06:27.702530+0000","last_became_active":"2023-10-08T16:06:27.702238+0000","last_became_peered":"2023-10-08T16:06:27.702238+0000","last_unstale":"2023-10-08T16:06:27.702530+0000","last_undegraded":"2023-10-08T16:06:27.702530+0000","last_fullsized":"2023-10-08T16:06:27.702530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:17.571736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.698566+0000","last_change":"2023-10-08T16:06:26.705246+0000","last_active":"2023-10-08T16:06:27.698566+0000","last_peered":"2023-10-08T16:06:27.698566+0000","last_clean":"2023-10-08T16:06:27.698566+0000","last_became_active":"2023-10-08T16:06:26.704552+0000","last_became_peered":"2023-10-08T16:06:26.704552+0000","last_unstale":"2023-10-08T16:06:27.698566+0000","last_undegraded":"2023-10-08T16:06:27.698566+0000","last_fullsized":"2023-10-08T16:06:27.698566+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:38.747060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707272+0000","last_change":"2023-10-08T16:06:27.707216+0000","last_active":"2023-10-08T16:06:27.707272+0000","last_peered":"2023-10-08T16:06:27.707272+0000","last_clean":"2023-10-08T16:06:27.707272+0000","last_became_active":"2023-10-08T16:06:27.707051+0000","last_became_peered":"2023-10-08T16:06:27.707051+0000","last_unstale":"2023-10-08T16:06:27.707272+0000","last_undegraded":"2023-10-08T16:06:27.707272+0000","last_fullsized":"2023-10-08T16:06:27.707272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:15:11.297992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714834+0000","last_change":"2023-10-08T16:06:26.702438+0000","last_active":"2023-10-08T16:06:27.714834+0000","last_peered":"2023-10-08T16:06:27.714834+0000","last_clean":"2023-10-08T16:06:27.714834+0000","last_became_active":"2023-10-08T16:06:26.702202+0000","last_became_peered":"2023-10-08T16:06:26.702202+0000","last_unstale":"2023-10-08T16:06:27.714834+0000","last_undegraded":"2023-10-08T16:06:27.714834+0000","last_fullsized":"2023-10-08T16:06:27.714834+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.271342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.704056+0000","last_change":"2023-10-08T16:06:27.703981+0000","last_active":"2023-10-08T16:06:27.704056+0000","last_peered":"2023-10-08T16:06:27.704056+0000","last_clean":"2023-10-08T16:06:27.704056+0000","last_became_active":"2023-10-08T16:06:27.703767+0000","last_became_peered":"2023-10-08T16:06:27.703767+0000","last_unstale":"2023-10-08T16:06:27.704056+0000","last_undegraded":"2023-10-08T16:06:27.704056+0000","last_fullsized":"2023-10-08T16:06:27.704056+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:43.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697757+0000","last_change":"2023-10-08T16:06:26.705587+0000","last_active":"2023-10-08T16:06:27.697757+0000","last_peered":"2023-10-08T16:06:27.697757+0000","last_clean":"2023-10-08T16:06:27.697757+0000","last_became_active":"2023-10-08T16:06:26.705396+0000","last_became_peered":"2023-10-08T16:06:26.705396+0000","last_unstale":"2023-10-08T16:06:27.697757+0000","last_undegraded":"2023-10-08T16:06:27.697757+0000","last_fullsized":"2023-10-08T16:06:27.697757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:42.965653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709184+0000","last_change":"2023-10-08T16:06:27.709113+0000","last_active":"2023-10-08T16:06:27.709184+0000","last_peered":"2023-10-08T16:06:27.709184+0000","last_clean":"2023-10-08T16:06:27.709184+0000","last_became_active":"2023-10-08T16:06:27.708879+0000","last_became_peered":"2023-10-08T16:06:27.708879+0000","last_unstale":"2023-10-08T16:06:27.709184+0000","last_undegraded":"2023-10-08T16:06:27.709184+0000","last_fullsized":"2023-10-08T16:06:27.709184+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:47.782477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707178+0000","last_change":"2023-10-08T16:06:26.705570+0000","last_active":"2023-10-08T16:06:27.707178+0000","last_peered":"2023-10-08T16:06:27.707178+0000","last_clean":"2023-10-08T16:06:27.707178+0000","last_became_active":"2023-10-08T16:06:26.705331+0000","last_became_peered":"2023-10-08T16:06:26.705331+0000","last_unstale":"2023-10-08T16:06:27.707178+0000","last_undegraded":"2023-10-08T16:06:27.707178+0000","last_fullsized":"2023-10-08T16:06:27.707178+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:32.333067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.720548+0000","last_change":"2023-10-08T16:06:27.720488+0000","last_active":"2023-10-08T16:06:27.720548+0000","last_peered":"2023-10-08T16:06:27.720548+0000","last_clean":"2023-10-08T16:06:27.720548+0000","last_became_active":"2023-10-08T16:06:27.719856+0000","last_became_peered":"2023-10-08T16:06:27.719856+0000","last_unstale":"2023-10-08T16:06:27.720548+0000","last_undegraded":"2023-10-08T16:06:27.720548+0000","last_fullsized":"2023-10-08T16:06:27.720548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:23.361433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707670+0000","last_change":"2023-10-08T16:06:26.704482+0000","last_active":"2023-10-08T16:06:27.707670+0000","last_peered":"2023-10-08T16:06:27.707670+0000","last_clean":"2023-10-08T16:06:27.707670+0000","last_became_active":"2023-10-08T16:06:26.703947+0000","last_became_peered":"2023-10-08T16:06:26.703947+0000","last_unstale":"2023-10-08T16:06:27.707670+0000","last_undegraded":"2023-10-08T16:06:27.707670+0000","last_fullsized":"2023-10-08T16:06:27.707670+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.271342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713954+0000","last_change":"2023-10-08T16:06:27.711958+0000","last_active":"2023-10-08T16:06:27.713954+0000","last_peered":"2023-10-08T16:06:27.713954+0000","last_clean":"2023-10-08T16:06:27.713954+0000","last_became_active":"2023-10-08T16:06:27.711608+0000","last_became_peered":"2023-10-08T16:06:27.711608+0000","last_unstale":"2023-10-08T16:06:27.713954+0000","last_undegraded":"2023-10-08T16:06:27.713954+0000","last_fullsized":"2023-10-08T16:06:27.713954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:58.927881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.698426+0000","last_change":"2023-10-08T16:06:26.708986+0000","last_active":"2023-10-08T16:06:27.698426+0000","last_peered":"2023-10-08T16:06:27.698426+0000","last_clean":"2023-10-08T16:06:27.698426+0000","last_became_active":"2023-10-08T16:06:26.708757+0000","last_became_peered":"2023-10-08T16:06:26.708757+0000","last_unstale":"2023-10-08T16:06:27.698426+0000","last_undegraded":"2023-10-08T16:06:27.698426+0000","last_fullsized":"2023-10-08T16:06:27.698426+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:22.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716727+0000","last_change":"2023-10-08T16:06:27.715190+0000","last_active":"2023-10-08T16:06:27.716727+0000","last_peered":"2023-10-08T16:06:27.716727+0000","last_clean":"2023-10-08T16:06:27.716727+0000","last_became_active":"2023-10-08T16:06:27.714774+0000","last_became_peered":"2023-10-08T16:06:27.714774+0000","last_unstale":"2023-10-08T16:06:27.716727+0000","last_undegraded":"2023-10-08T16:06:27.716727+0000","last_fullsized":"2023-10-08T16:06:27.716727+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:55.722430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706212+0000","last_change":"2023-10-08T16:06:26.705484+0000","last_active":"2023-10-08T16:06:27.706212+0000","last_peered":"2023-10-08T16:06:27.706212+0000","last_clean":"2023-10-08T16:06:27.706212+0000","last_became_active":"2023-10-08T16:06:26.705247+0000","last_became_peered":"2023-10-08T16:06:26.705247+0000","last_unstale":"2023-10-08T16:06:27.706212+0000","last_undegraded":"2023-10-08T16:06:27.706212+0000","last_fullsized":"2023-10-08T16:06:27.706212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:08.030270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.710435+0000","last_change":"2023-10-08T16:06:27.710011+0000","last_active":"2023-10-08T16:06:27.710435+0000","last_peered":"2023-10-08T16:06:27.710435+0000","last_clean":"2023-10-08T16:06:27.710435+0000","last_became_active":"2023-10-08T16:06:27.709754+0000","last_became_peered":"2023-10-08T16:06:27.709754+0000","last_unstale":"2023-10-08T16:06:27.710435+0000","last_undegraded":"2023-10-08T16:06:27.710435+0000","last_fullsized":"2023-10-08T16:06:27.710435+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:50.088934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697425+0000","last_change":"2023-10-08T16:06:26.700128+0000","last_active":"2023-10-08T16:06:27.697425+0000","last_peered":"2023-10-08T16:06:27.697425+0000","last_clean":"2023-10-08T16:06:27.697425+0000","last_became_active":"2023-10-08T16:06:26.699593+0000","last_became_peered":"2023-10-08T16:06:26.699593+0000","last_unstale":"2023-10-08T16:06:27.697425+0000","last_undegraded":"2023-10-08T16:06:27.697425+0000","last_fullsized":"2023-10-08T16:06:27.697425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:32.333067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707070+0000","last_change":"2023-10-08T16:06:27.706965+0000","last_active":"2023-10-08T16:06:27.707070+0000","last_peered":"2023-10-08T16:06:27.707070+0000","last_clean":"2023-10-08T16:06:27.707070+0000","last_became_active":"2023-10-08T16:06:27.701539+0000","last_became_peered":"2023-10-08T16:06:27.701539+0000","last_unstale":"2023-10-08T16:06:27.707070+0000","last_undegraded":"2023-10-08T16:06:27.707070+0000","last_fullsized":"2023-10-08T16:06:27.707070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:38:48.467864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.708080+0000","last_change":"2023-10-08T16:06:26.705463+0000","last_active":"2023-10-08T16:06:27.708080+0000","last_peered":"2023-10-08T16:06:27.708080+0000","last_clean":"2023-10-08T16:06:27.708080+0000","last_became_active":"2023-10-08T16:06:26.705232+0000","last_became_peered":"2023-10-08T16:06:26.705232+0000","last_unstale":"2023-10-08T16:06:27.708080+0000","last_undegraded":"2023-10-08T16:06:27.708080+0000","last_fullsized":"2023-10-08T16:06:27.708080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.507118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705931+0000","last_change":"2023-10-08T16:06:27.705678+0000","last_active":"2023-10-08T16:06:27.705931+0000","last_peered":"2023-10-08T16:06:27.705931+0000","last_clean":"2023-10-08T16:06:27.705931+0000","last_became_active":"2023-10-08T16:06:27.705006+0000","last_became_peered":"2023-10-08T16:06:27.705006+0000","last_unstale":"2023-10-08T16:06:27.705931+0000","last_undegraded":"2023-10-08T16:06:27.705931+0000","last_fullsized":"2023-10-08T16:06:27.705931+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.681922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703498+0000","last_change":"2023-10-08T16:06:26.710029+0000","last_active":"2023-10-08T16:06:27.703498+0000","last_peered":"2023-10-08T16:06:27.703498+0000","last_clean":"2023-10-08T16:06:27.703498+0000","last_became_active":"2023-10-08T16:06:26.709828+0000","last_became_peered":"2023-10-08T16:06:26.709828+0000","last_unstale":"2023-10-08T16:06:27.703498+0000","last_undegraded":"2023-10-08T16:06:27.703498+0000","last_fullsized":"2023-10-08T16:06:27.703498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:37.155804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703307+0000","last_change":"2023-10-08T16:06:27.701658+0000","last_active":"2023-10-08T16:06:27.703307+0000","last_peered":"2023-10-08T16:06:27.703307+0000","last_clean":"2023-10-08T16:06:27.703307+0000","last_became_active":"2023-10-08T16:06:27.701404+0000","last_became_peered":"2023-10-08T16:06:27.701404+0000","last_unstale":"2023-10-08T16:06:27.703307+0000","last_undegraded":"2023-10-08T16:06:27.703307+0000","last_fullsized":"2023-10-08T16:06:27.703307+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:01.082611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697206+0000","last_change":"2023-10-08T16:06:26.708162+0000","last_active":"2023-10-08T16:06:27.697206+0000","last_peered":"2023-10-08T16:06:27.697206+0000","last_clean":"2023-10-08T16:06:27.697206+0000","last_became_active":"2023-10-08T16:06:26.707930+0000","last_became_peered":"2023-10-08T16:06:26.707930+0000","last_unstale":"2023-10-08T16:06:27.697206+0000","last_undegraded":"2023-10-08T16:06:27.697206+0000","last_fullsized":"2023-10-08T16:06:27.697206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:11.772953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.710816+0000","last_change":"2023-10-08T16:06:27.710709+0000","last_active":"2023-10-08T16:06:27.710816+0000","last_peered":"2023-10-08T16:06:27.710816+0000","last_clean":"2023-10-08T16:06:27.710816+0000","last_became_active":"2023-10-08T16:06:27.709941+0000","last_became_peered":"2023-10-08T16:06:27.709941+0000","last_unstale":"2023-10-08T16:06:27.710816+0000","last_undegraded":"2023-10-08T16:06:27.710816+0000","last_fullsized":"2023-10-08T16:06:27.710816+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:01.082611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707185+0000","last_change":"2023-10-08T16:06:26.706973+0000","last_active":"2023-10-08T16:06:27.707185+0000","last_peered":"2023-10-08T16:06:27.707185+0000","last_clean":"2023-10-08T16:06:27.707185+0000","last_became_active":"2023-10-08T16:06:26.706737+0000","last_became_peered":"2023-10-08T16:06:26.706737+0000","last_unstale":"2023-10-08T16:06:27.707185+0000","last_undegraded":"2023-10-08T16:06:27.707185+0000","last_fullsized":"2023-10-08T16:06:27.707185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:46.777928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713387+0000","last_change":"2023-10-08T16:06:27.713240+0000","last_active":"2023-10-08T16:06:27.713387+0000","last_peered":"2023-10-08T16:06:27.713387+0000","last_clean":"2023-10-08T16:06:27.713387+0000","last_became_active":"2023-10-08T16:06:27.707929+0000","last_became_peered":"2023-10-08T16:06:27.707929+0000","last_unstale":"2023-10-08T16:06:27.713387+0000","last_undegraded":"2023-10-08T16:06:27.713387+0000","last_fullsized":"2023-10-08T16:06:27.713387+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:17.391814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717122+0000","last_change":"2023-10-08T16:06:26.703185+0000","last_active":"2023-10-08T16:06:27.717122+0000","last_peered":"2023-10-08T16:06:27.717122+0000","last_clean":"2023-10-08T16:06:27.717122+0000","last_became_active":"2023-10-08T16:06:26.702911+0000","last_became_peered":"2023-10-08T16:06:26.702911+0000","last_unstale":"2023-10-08T16:06:27.717122+0000","last_undegraded":"2023-10-08T16:06:27.717122+0000","last_fullsized":"2023-10-08T16:06:27.717122+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:51.885635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706351+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:06:27.706351+0000","last_peered":"2023-10-08T16:06:27.706351+0000","last_clean":"2023-10-08T16:06:27.706351+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:06:27.706351+0000","last_undegraded":"2023-10-08T16:06:27.706351+0000","last_fullsized":"2023-10-08T16:06:27.706351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":790,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194522,"statfs":{"total":200000000,"available":199190528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.5}]},{"osd":1,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":214,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195097,"statfs":{"total":200000000,"available":199780342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.56200000000000006}]},{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.40200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.32700000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199780916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.31}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.26700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.4929999999999999,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":790,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194522,"statfs":{"total":200000000,"available":199190584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.60299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.628},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.63800000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.76800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195097,"statfs":{"total":200000000,"available":199779428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.377}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51900000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.434}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":214,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199780376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.308},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.627}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195097,"statfs":{"total":200000000,"available":199779450,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.74199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.92700000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.58999999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199780916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.433}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.377},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38600000000000001}]}]}],"pool_statfs":[]}} 2023-10-08T16:06:31.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:06:31.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.955+0000 7f00dee36700 1 Processor -- start 2023-10-08T16:06:31.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.955+0000 7f00dee36700 1 -- start start 2023-10-08T16:06:31.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dee36700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00d80cdab0 0x7f00d815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dee36700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f00d815dda0 0x7f00d815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dee36700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80cb7c0 con 0x7f00d80cd6e0 2023-10-08T16:06:31.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dee36700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d815e850 con 0x7f00d815dda0 2023-10-08T16:06:31.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dee36700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d80cc360 con 0x7f00d80cdab0 2023-10-08T16:06:31.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00de635700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f00d815dda0 0x7f00d815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dde34700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f00d80cd6e0 0x7f00d80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59448/0 (socket says 172.21.15.60:59448) 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dde34700 1 -- 172.21.15.60:0/1371458745 learned_addr learned my addr 172.21.15.60:0/1371458745 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dd633700 1 --2- 172.21.15.60:0/1371458745 >> v2:172.21.15.144:3300/0 conn(0x7f00d80cdab0 0x7f00d815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00de635700 1 -- 172.21.15.60:0/1371458745 >> v2:172.21.15.144:3300/0 conn(0x7f00d80cdab0 msgr2=0x7f00d815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00de635700 1 --2- 172.21.15.60:0/1371458745 >> v2:172.21.15.144:3300/0 conn(0x7f00d80cdab0 0x7f00d815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00de635700 1 -- 172.21.15.60:0/1371458745 >> v1:172.21.15.60:6789/0 conn(0x7f00d80cd6e0 legacy=0x7f00d80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00de635700 1 -- 172.21.15.60:0/1371458745 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d815e290 con 0x7f00d815dda0 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.956+0000 7f00dce32700 1 -- 172.21.15.60:0/1371458745 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862827062 0 0) 0x7f00d80cb7c0 con 0x7f00d80cd6e0 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00de635700 1 --2- 172.21.15.60:0/1371458745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d815cbd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f00d80b6c70 tx=0x7f00c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcac80654fb846b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dce32700 1 -- 172.21.15.60:0/1371458745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800e070 con 0x7f00d815dda0 2023-10-08T16:06:31.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dce32700 1 -- 172.21.15.60:0/1371458745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c800bb60 con 0x7f00d815dda0 2023-10-08T16:06:31.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dce32700 1 -- 172.21.15.60:0/1371458745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8012430 con 0x7f00d815dda0 2023-10-08T16:06:31.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 -- 172.21.15.60:0/1371458745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 msgr2=0x7f00d815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 --2- 172.21.15.60:0/1371458745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d815cbd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f00d80b6c70 tx=0x7f00c8009780 comp rx=0 tx=0).stop 2023-10-08T16:06:31.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 -- 172.21.15.60:0/1371458745 shutdown_connections 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 --2- 172.21.15.60:0/1371458745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d815cbd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 --2- 172.21.15.60:0/1371458745 >> v2:172.21.15.144:3300/0 conn(0x7f00d80cdab0 0x7f00d815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 -- 172.21.15.60:0/1371458745 >> 172.21.15.60:0/1371458745 conn(0x7f00d8067660 msgr2=0x7f00d8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 -- 172.21.15.60:0/1371458745 shutdown_connections 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.957+0000 7f00dee36700 1 -- 172.21.15.60:0/1371458745 wait complete. 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.958+0000 7f00dee36700 1 Processor -- start 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.958+0000 7f00dee36700 1 -- start start 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00dee36700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00d80cd6e0 0x7f00d814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00dee36700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d80cdab0 0x7f00d80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00dee36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00dee36700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80b4d40 con 0x7f00d815dda0 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00dee36700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d814d050 con 0x7f00d80cdab0 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00dee36700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80c8a50 con 0x7f00d80cd6e0 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00de635700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00de635700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d80b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58810/0 (socket says 172.21.15.60:58810) 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.959+0000 7f00de635700 1 -- 172.21.15.60:0/771567222 learned_addr learned my addr 172.21.15.60:0/771567222 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00de635700 1 -- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00d80cd6e0 msgr2=0x7f00d814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00dde34700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00d80cd6e0 0x7f00d814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00dd633700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d80cdab0 0x7f00d80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00de635700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00d80cd6e0 0x7f00d814cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00de635700 1 -- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d80cdab0 msgr2=0x7f00d80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00de635700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d80cdab0 0x7f00d80b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:31.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00de635700 1 -- 172.21.15.60:0/771567222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8009a20 con 0x7f00d815dda0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00de635700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d80b2450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f00d80c7b10 tx=0x7f00c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8012e20 con 0x7f00d815dda0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c801d630 con 0x7f00d815dda0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d80c8d30 con 0x7f00d815dda0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c801d9f0 con 0x7f00d815dda0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.960+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d80c92f0 con 0x7f00d815dda0 2023-10-08T16:06:31.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.961+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d80b4ef0 con 0x7f00d815dda0 2023-10-08T16:06:31.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.962+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00c8024070 con 0x7f00d815dda0 2023-10-08T16:06:31.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.962+0000 7f00d5ffb700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00c4066f30 0x7f00c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:31.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.962+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00c8086d90 con 0x7f00d815dda0 2023-10-08T16:06:31.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.962+0000 7f00dde34700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00c4066f30 0x7f00c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:31.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.963+0000 7f00dde34700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00c4066f30 0x7f00c40693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00d0007fd0 tx=0x7f00d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:31.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:31.966+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00c8054000 con 0x7f00d815dda0 2023-10-08T16:06:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.153+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00d815db80 con 0x7f00c4066f30 2023-10-08T16:06:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.161+0000 7f00d5ffb700 1 -- 172.21.15.60:0/771567222 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285128 (secure 0 0 0) 0x7f00d815db80 con 0x7f00c4066f30 2023-10-08T16:06:32.165 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00c4066f30 msgr2=0x7f00c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00c4066f30 0x7f00c40693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00d0007fd0 tx=0x7f00d0009040 comp rx=0 tx=0).stop 2023-10-08T16:06:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 msgr2=0x7f00d80b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d80b2450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f00d80c7b10 tx=0x7f00c8019000 comp rx=0 tx=0).stop 2023-10-08T16:06:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 shutdown_connections 2023-10-08T16:06:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00c4066f30 0x7f00c40693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00d80cd6e0 0x7f00d814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00d815dda0 0x7f00d80b2450 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 --2- 172.21.15.60:0/771567222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d80cdab0 0x7f00d80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 >> 172.21.15.60:0/771567222 conn(0x7f00d8067660 msgr2=0x7f00d814d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 shutdown_connections 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.165+0000 7f00dee36700 1 -- 172.21.15.60:0/771567222 wait complete. 2023-10-08T16:06:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:06:32.177 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-08T16:06:31.578195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2868,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559631,"statfs":{"total":1600000000,"available":1597062540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.890921"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715467+0000","last_change":"2023-10-08T16:06:27.715396+0000","last_active":"2023-10-08T16:06:27.715467+0000","last_peered":"2023-10-08T16:06:27.715467+0000","last_clean":"2023-10-08T16:06:27.715467+0000","last_became_active":"2023-10-08T16:06:27.715141+0000","last_became_peered":"2023-10-08T16:06:27.715141+0000","last_unstale":"2023-10-08T16:06:27.715467+0000","last_undegraded":"2023-10-08T16:06:27.715467+0000","last_fullsized":"2023-10-08T16:06:27.715467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:57.462405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707920+0000","last_change":"2023-10-08T16:06:27.707855+0000","last_active":"2023-10-08T16:06:27.707920+0000","last_peered":"2023-10-08T16:06:27.707920+0000","last_clean":"2023-10-08T16:06:27.707920+0000","last_became_active":"2023-10-08T16:06:27.707587+0000","last_became_peered":"2023-10-08T16:06:27.707587+0000","last_unstale":"2023-10-08T16:06:27.707920+0000","last_undegraded":"2023-10-08T16:06:27.707920+0000","last_fullsized":"2023-10-08T16:06:27.707920+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:24.825692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715615+0000","last_change":"2023-10-08T16:06:27.715295+0000","last_active":"2023-10-08T16:06:27.715615+0000","last_peered":"2023-10-08T16:06:27.715615+0000","last_clean":"2023-10-08T16:06:27.715615+0000","last_became_active":"2023-10-08T16:06:27.714719+0000","last_became_peered":"2023-10-08T16:06:27.714719+0000","last_unstale":"2023-10-08T16:06:27.715615+0000","last_undegraded":"2023-10-08T16:06:27.715615+0000","last_fullsized":"2023-10-08T16:06:27.715615+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:36.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.711871+0000","last_change":"2023-10-08T16:06:27.711741+0000","last_active":"2023-10-08T16:06:27.711871+0000","last_peered":"2023-10-08T16:06:27.711871+0000","last_clean":"2023-10-08T16:06:27.711871+0000","last_became_active":"2023-10-08T16:06:27.707610+0000","last_became_peered":"2023-10-08T16:06:27.707610+0000","last_unstale":"2023-10-08T16:06:27.711871+0000","last_undegraded":"2023-10-08T16:06:27.711871+0000","last_fullsized":"2023-10-08T16:06:27.711871+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:47.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717423+0000","last_change":"2023-10-08T16:06:27.716750+0000","last_active":"2023-10-08T16:06:27.717423+0000","last_peered":"2023-10-08T16:06:27.717423+0000","last_clean":"2023-10-08T16:06:27.717423+0000","last_became_active":"2023-10-08T16:06:27.716466+0000","last_became_peered":"2023-10-08T16:06:27.716466+0000","last_unstale":"2023-10-08T16:06:27.717423+0000","last_undegraded":"2023-10-08T16:06:27.717423+0000","last_fullsized":"2023-10-08T16:06:27.717423+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:47.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709284+0000","last_change":"2023-10-08T16:06:27.709193+0000","last_active":"2023-10-08T16:06:27.709284+0000","last_peered":"2023-10-08T16:06:27.709284+0000","last_clean":"2023-10-08T16:06:27.709284+0000","last_became_active":"2023-10-08T16:06:27.708923+0000","last_became_peered":"2023-10-08T16:06:27.708923+0000","last_unstale":"2023-10-08T16:06:27.709284+0000","last_undegraded":"2023-10-08T16:06:27.709284+0000","last_fullsized":"2023-10-08T16:06:27.709284+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:45.527728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707920+0000","last_change":"2023-10-08T16:06:27.707869+0000","last_active":"2023-10-08T16:06:27.707920+0000","last_peered":"2023-10-08T16:06:27.707920+0000","last_clean":"2023-10-08T16:06:27.707920+0000","last_became_active":"2023-10-08T16:06:27.707664+0000","last_became_peered":"2023-10-08T16:06:27.707664+0000","last_unstale":"2023-10-08T16:06:27.707920+0000","last_undegraded":"2023-10-08T16:06:27.707920+0000","last_fullsized":"2023-10-08T16:06:27.707920+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:24.825692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713722+0000","last_change":"2023-10-08T16:06:27.713390+0000","last_active":"2023-10-08T16:06:27.713722+0000","last_peered":"2023-10-08T16:06:27.713722+0000","last_clean":"2023-10-08T16:06:27.713722+0000","last_became_active":"2023-10-08T16:06:27.713007+0000","last_became_peered":"2023-10-08T16:06:27.713007+0000","last_unstale":"2023-10-08T16:06:27.713722+0000","last_undegraded":"2023-10-08T16:06:27.713722+0000","last_fullsized":"2023-10-08T16:06:27.713722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:51.653992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712870+0000","last_change":"2023-10-08T16:06:27.712816+0000","last_active":"2023-10-08T16:06:27.712870+0000","last_peered":"2023-10-08T16:06:27.712870+0000","last_clean":"2023-10-08T16:06:27.712870+0000","last_became_active":"2023-10-08T16:06:27.712297+0000","last_became_peered":"2023-10-08T16:06:27.712297+0000","last_unstale":"2023-10-08T16:06:27.712870+0000","last_undegraded":"2023-10-08T16:06:27.712870+0000","last_fullsized":"2023-10-08T16:06:27.712870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:36.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.720329+0000","last_change":"2023-10-08T16:06:27.720261+0000","last_active":"2023-10-08T16:06:27.720329+0000","last_peered":"2023-10-08T16:06:27.720329+0000","last_clean":"2023-10-08T16:06:27.720329+0000","last_became_active":"2023-10-08T16:06:27.719210+0000","last_became_peered":"2023-10-08T16:06:27.719210+0000","last_unstale":"2023-10-08T16:06:27.720329+0000","last_undegraded":"2023-10-08T16:06:27.720329+0000","last_fullsized":"2023-10-08T16:06:27.720329+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:32:18.557567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716604+0000","last_change":"2023-10-08T16:06:27.714030+0000","last_active":"2023-10-08T16:06:27.716604+0000","last_peered":"2023-10-08T16:06:27.716604+0000","last_clean":"2023-10-08T16:06:27.716604+0000","last_became_active":"2023-10-08T16:06:27.713784+0000","last_became_peered":"2023-10-08T16:06:27.713784+0000","last_unstale":"2023-10-08T16:06:27.716604+0000","last_undegraded":"2023-10-08T16:06:27.716604+0000","last_fullsized":"2023-10-08T16:06:27.716604+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:37.654360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.704460+0000","last_change":"2023-10-08T16:06:27.704341+0000","last_active":"2023-10-08T16:06:27.704460+0000","last_peered":"2023-10-08T16:06:27.704460+0000","last_clean":"2023-10-08T16:06:27.704460+0000","last_became_active":"2023-10-08T16:06:27.703481+0000","last_became_peered":"2023-10-08T16:06:27.703481+0000","last_unstale":"2023-10-08T16:06:27.704460+0000","last_undegraded":"2023-10-08T16:06:27.704460+0000","last_fullsized":"2023-10-08T16:06:27.704460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:36.966533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.702301+0000","last_change":"2023-10-08T16:06:27.702130+0000","last_active":"2023-10-08T16:06:27.702301+0000","last_peered":"2023-10-08T16:06:27.702301+0000","last_clean":"2023-10-08T16:06:27.702301+0000","last_became_active":"2023-10-08T16:06:27.701814+0000","last_became_peered":"2023-10-08T16:06:27.701814+0000","last_unstale":"2023-10-08T16:06:27.702301+0000","last_undegraded":"2023-10-08T16:06:27.702301+0000","last_fullsized":"2023-10-08T16:06:27.702301+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:53.515636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712733+0000","last_change":"2023-10-08T16:06:27.712668+0000","last_active":"2023-10-08T16:06:27.712733+0000","last_peered":"2023-10-08T16:06:27.712733+0000","last_clean":"2023-10-08T16:06:27.712733+0000","last_became_active":"2023-10-08T16:06:27.711977+0000","last_became_peered":"2023-10-08T16:06:27.711977+0000","last_unstale":"2023-10-08T16:06:27.712733+0000","last_undegraded":"2023-10-08T16:06:27.712733+0000","last_fullsized":"2023-10-08T16:06:27.712733+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:01.082611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705326+0000","last_change":"2023-10-08T16:06:27.704494+0000","last_active":"2023-10-08T16:06:27.705326+0000","last_peered":"2023-10-08T16:06:27.705326+0000","last_clean":"2023-10-08T16:06:27.705326+0000","last_became_active":"2023-10-08T16:06:27.704260+0000","last_became_peered":"2023-10-08T16:06:27.704260+0000","last_unstale":"2023-10-08T16:06:27.705326+0000","last_undegraded":"2023-10-08T16:06:27.705326+0000","last_fullsized":"2023-10-08T16:06:27.705326+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:02.810573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715971+0000","last_change":"2023-10-08T16:06:27.715306+0000","last_active":"2023-10-08T16:06:27.715971+0000","last_peered":"2023-10-08T16:06:27.715971+0000","last_clean":"2023-10-08T16:06:27.715971+0000","last_became_active":"2023-10-08T16:06:27.714867+0000","last_became_peered":"2023-10-08T16:06:27.714867+0000","last_unstale":"2023-10-08T16:06:27.715971+0000","last_undegraded":"2023-10-08T16:06:27.715971+0000","last_fullsized":"2023-10-08T16:06:27.715971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:52.890183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709534+0000","last_change":"2023-10-08T16:06:27.709429+0000","last_active":"2023-10-08T16:06:27.709534+0000","last_peered":"2023-10-08T16:06:27.709534+0000","last_clean":"2023-10-08T16:06:27.709534+0000","last_became_active":"2023-10-08T16:06:27.708836+0000","last_became_peered":"2023-10-08T16:06:27.708836+0000","last_unstale":"2023-10-08T16:06:27.709534+0000","last_undegraded":"2023-10-08T16:06:27.709534+0000","last_fullsized":"2023-10-08T16:06:27.709534+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:24.904876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715631+0000","last_change":"2023-10-08T16:06:27.715453+0000","last_active":"2023-10-08T16:06:27.715631+0000","last_peered":"2023-10-08T16:06:27.715631+0000","last_clean":"2023-10-08T16:06:27.715631+0000","last_became_active":"2023-10-08T16:06:27.715017+0000","last_became_peered":"2023-10-08T16:06:27.715017+0000","last_unstale":"2023-10-08T16:06:27.715631+0000","last_undegraded":"2023-10-08T16:06:27.715631+0000","last_fullsized":"2023-10-08T16:06:27.715631+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:56.619754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714085+0000","last_change":"2023-10-08T16:06:27.713019+0000","last_active":"2023-10-08T16:06:27.714085+0000","last_peered":"2023-10-08T16:06:27.714085+0000","last_clean":"2023-10-08T16:06:27.714085+0000","last_became_active":"2023-10-08T16:06:27.712367+0000","last_became_peered":"2023-10-08T16:06:27.712367+0000","last_unstale":"2023-10-08T16:06:27.714085+0000","last_undegraded":"2023-10-08T16:06:27.714085+0000","last_fullsized":"2023-10-08T16:06:27.714085+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:43.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714296+0000","last_change":"2023-10-08T16:06:27.714238+0000","last_active":"2023-10-08T16:06:27.714296+0000","last_peered":"2023-10-08T16:06:27.714296+0000","last_clean":"2023-10-08T16:06:27.714296+0000","last_became_active":"2023-10-08T16:06:27.714017+0000","last_became_peered":"2023-10-08T16:06:27.714017+0000","last_unstale":"2023-10-08T16:06:27.714296+0000","last_undegraded":"2023-10-08T16:06:27.714296+0000","last_fullsized":"2023-10-08T16:06:27.714296+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:30.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701632+0000","last_change":"2023-10-08T16:06:27.701561+0000","last_active":"2023-10-08T16:06:27.701632+0000","last_peered":"2023-10-08T16:06:27.701632+0000","last_clean":"2023-10-08T16:06:27.701632+0000","last_became_active":"2023-10-08T16:06:27.701285+0000","last_became_peered":"2023-10-08T16:06:27.701285+0000","last_unstale":"2023-10-08T16:06:27.701632+0000","last_undegraded":"2023-10-08T16:06:27.701632+0000","last_fullsized":"2023-10-08T16:06:27.701632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:13.287182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717460+0000","last_change":"2023-10-08T16:06:27.717380+0000","last_active":"2023-10-08T16:06:27.717460+0000","last_peered":"2023-10-08T16:06:27.717460+0000","last_clean":"2023-10-08T16:06:27.717460+0000","last_became_active":"2023-10-08T16:06:27.716607+0000","last_became_peered":"2023-10-08T16:06:27.716607+0000","last_unstale":"2023-10-08T16:06:27.717460+0000","last_undegraded":"2023-10-08T16:06:27.717460+0000","last_fullsized":"2023-10-08T16:06:27.717460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:57.462405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706518+0000","last_change":"2023-10-08T16:06:27.706456+0000","last_active":"2023-10-08T16:06:27.706518+0000","last_peered":"2023-10-08T16:06:27.706518+0000","last_clean":"2023-10-08T16:06:27.706518+0000","last_became_active":"2023-10-08T16:06:27.706268+0000","last_became_peered":"2023-10-08T16:06:27.706268+0000","last_unstale":"2023-10-08T16:06:27.706518+0000","last_undegraded":"2023-10-08T16:06:27.706518+0000","last_fullsized":"2023-10-08T16:06:27.706518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:03.511667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714066+0000","last_change":"2023-10-08T16:06:27.712890+0000","last_active":"2023-10-08T16:06:27.714066+0000","last_peered":"2023-10-08T16:06:27.714066+0000","last_clean":"2023-10-08T16:06:27.714066+0000","last_became_active":"2023-10-08T16:06:27.711820+0000","last_became_peered":"2023-10-08T16:06:27.711820+0000","last_unstale":"2023-10-08T16:06:27.714066+0000","last_undegraded":"2023-10-08T16:06:27.714066+0000","last_fullsized":"2023-10-08T16:06:27.714066+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:38.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714026+0000","last_change":"2023-10-08T16:06:27.712621+0000","last_active":"2023-10-08T16:06:27.714026+0000","last_peered":"2023-10-08T16:06:27.714026+0000","last_clean":"2023-10-08T16:06:27.714026+0000","last_became_active":"2023-10-08T16:06:27.706875+0000","last_became_peered":"2023-10-08T16:06:27.706875+0000","last_unstale":"2023-10-08T16:06:27.714026+0000","last_undegraded":"2023-10-08T16:06:27.714026+0000","last_fullsized":"2023-10-08T16:06:27.714026+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:33.337615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703896+0000","last_change":"2023-10-08T16:06:27.703767+0000","last_active":"2023-10-08T16:06:27.703896+0000","last_peered":"2023-10-08T16:06:27.703896+0000","last_clean":"2023-10-08T16:06:27.703896+0000","last_became_active":"2023-10-08T16:06:27.703461+0000","last_became_peered":"2023-10-08T16:06:27.703461+0000","last_unstale":"2023-10-08T16:06:27.703896+0000","last_undegraded":"2023-10-08T16:06:27.703896+0000","last_fullsized":"2023-10-08T16:06:27.703896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:48.767066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709665+0000","last_change":"2023-10-08T16:06:27.709608+0000","last_active":"2023-10-08T16:06:27.709665+0000","last_peered":"2023-10-08T16:06:27.709665+0000","last_clean":"2023-10-08T16:06:27.709665+0000","last_became_active":"2023-10-08T16:06:27.709154+0000","last_became_peered":"2023-10-08T16:06:27.709154+0000","last_unstale":"2023-10-08T16:06:27.709665+0000","last_undegraded":"2023-10-08T16:06:27.709665+0000","last_fullsized":"2023-10-08T16:06:27.709665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:23.361433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703338+0000","last_change":"2023-10-08T16:06:27.701980+0000","last_active":"2023-10-08T16:06:27.703338+0000","last_peered":"2023-10-08T16:06:27.703338+0000","last_clean":"2023-10-08T16:06:27.703338+0000","last_became_active":"2023-10-08T16:06:27.701126+0000","last_became_peered":"2023-10-08T16:06:27.701126+0000","last_unstale":"2023-10-08T16:06:27.703338+0000","last_undegraded":"2023-10-08T16:06:27.703338+0000","last_fullsized":"2023-10-08T16:06:27.703338+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:50.088934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703338+0000","last_change":"2023-10-08T16:06:27.703274+0000","last_active":"2023-10-08T16:06:27.703338+0000","last_peered":"2023-10-08T16:06:27.703338+0000","last_clean":"2023-10-08T16:06:27.703338+0000","last_became_active":"2023-10-08T16:06:27.703049+0000","last_became_peered":"2023-10-08T16:06:27.703049+0000","last_unstale":"2023-10-08T16:06:27.703338+0000","last_undegraded":"2023-10-08T16:06:27.703338+0000","last_fullsized":"2023-10-08T16:06:27.703338+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:38.606892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713967+0000","last_change":"2023-10-08T16:06:27.713212+0000","last_active":"2023-10-08T16:06:27.713967+0000","last_peered":"2023-10-08T16:06:27.713967+0000","last_clean":"2023-10-08T16:06:27.713967+0000","last_became_active":"2023-10-08T16:06:27.711030+0000","last_became_peered":"2023-10-08T16:06:27.711030+0000","last_unstale":"2023-10-08T16:06:27.713967+0000","last_undegraded":"2023-10-08T16:06:27.713967+0000","last_fullsized":"2023-10-08T16:06:27.713967+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:17.391814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705345+0000","last_change":"2023-10-08T16:06:27.704777+0000","last_active":"2023-10-08T16:06:27.705345+0000","last_peered":"2023-10-08T16:06:27.705345+0000","last_clean":"2023-10-08T16:06:27.705345+0000","last_became_active":"2023-10-08T16:06:27.704384+0000","last_became_peered":"2023-10-08T16:06:27.704384+0000","last_unstale":"2023-10-08T16:06:27.705345+0000","last_undegraded":"2023-10-08T16:06:27.705345+0000","last_fullsized":"2023-10-08T16:06:27.705345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:40.948921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.699968+0000","last_change":"2023-10-08T16:06:27.699853+0000","last_active":"2023-10-08T16:06:27.699968+0000","last_peered":"2023-10-08T16:06:27.699968+0000","last_clean":"2023-10-08T16:06:27.699968+0000","last_became_active":"2023-10-08T16:06:27.699604+0000","last_became_peered":"2023-10-08T16:06:27.699604+0000","last_unstale":"2023-10-08T16:06:27.699968+0000","last_undegraded":"2023-10-08T16:06:27.699968+0000","last_fullsized":"2023-10-08T16:06:27.699968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:34.121234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701022+0000","last_change":"2023-10-08T16:06:27.700825+0000","last_active":"2023-10-08T16:06:27.701022+0000","last_peered":"2023-10-08T16:06:27.701022+0000","last_clean":"2023-10-08T16:06:27.701022+0000","last_became_active":"2023-10-08T16:06:27.700192+0000","last_became_peered":"2023-10-08T16:06:27.700192+0000","last_unstale":"2023-10-08T16:06:27.701022+0000","last_undegraded":"2023-10-08T16:06:27.701022+0000","last_fullsized":"2023-10-08T16:06:27.701022+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:09.034819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716763+0000","last_change":"2023-10-08T16:06:26.706667+0000","last_active":"2023-10-08T16:06:27.716763+0000","last_peered":"2023-10-08T16:06:27.716763+0000","last_clean":"2023-10-08T16:06:27.716763+0000","last_became_active":"2023-10-08T16:06:26.706445+0000","last_became_peered":"2023-10-08T16:06:26.706445+0000","last_unstale":"2023-10-08T16:06:27.716763+0000","last_undegraded":"2023-10-08T16:06:27.716763+0000","last_fullsized":"2023-10-08T16:06:27.716763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:22.855740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705695+0000","last_change":"2023-10-08T16:06:27.705470+0000","last_active":"2023-10-08T16:06:27.705695+0000","last_peered":"2023-10-08T16:06:27.705695+0000","last_clean":"2023-10-08T16:06:27.705695+0000","last_became_active":"2023-10-08T16:06:27.705189+0000","last_became_peered":"2023-10-08T16:06:27.705189+0000","last_unstale":"2023-10-08T16:06:27.705695+0000","last_undegraded":"2023-10-08T16:06:27.705695+0000","last_fullsized":"2023-10-08T16:06:27.705695+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:48.275891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714319+0000","last_change":"2023-10-08T16:06:26.708648+0000","last_active":"2023-10-08T16:06:27.714319+0000","last_peered":"2023-10-08T16:06:27.714319+0000","last_clean":"2023-10-08T16:06:27.714319+0000","last_became_active":"2023-10-08T16:06:26.708389+0000","last_became_peered":"2023-10-08T16:06:26.708389+0000","last_unstale":"2023-10-08T16:06:27.714319+0000","last_undegraded":"2023-10-08T16:06:27.714319+0000","last_fullsized":"2023-10-08T16:06:27.714319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:16.567187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703357+0000","last_change":"2023-10-08T16:06:27.702144+0000","last_active":"2023-10-08T16:06:27.703357+0000","last_peered":"2023-10-08T16:06:27.703357+0000","last_clean":"2023-10-08T16:06:27.703357+0000","last_became_active":"2023-10-08T16:06:27.701923+0000","last_became_peered":"2023-10-08T16:06:27.701923+0000","last_unstale":"2023-10-08T16:06:27.703357+0000","last_undegraded":"2023-10-08T16:06:27.703357+0000","last_fullsized":"2023-10-08T16:06:27.703357+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:17.391814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715909+0000","last_change":"2023-10-08T16:06:26.700276+0000","last_active":"2023-10-08T16:06:27.715909+0000","last_peered":"2023-10-08T16:06:27.715909+0000","last_clean":"2023-10-08T16:06:27.715909+0000","last_became_active":"2023-10-08T16:06:26.699904+0000","last_became_peered":"2023-10-08T16:06:26.699904+0000","last_unstale":"2023-10-08T16:06:27.715909+0000","last_undegraded":"2023-10-08T16:06:27.715909+0000","last_fullsized":"2023-10-08T16:06:27.715909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:31.774543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701170+0000","last_change":"2023-10-08T16:06:27.701070+0000","last_active":"2023-10-08T16:06:27.701170+0000","last_peered":"2023-10-08T16:06:27.701170+0000","last_clean":"2023-10-08T16:06:27.701170+0000","last_became_active":"2023-10-08T16:06:27.700801+0000","last_became_peered":"2023-10-08T16:06:27.700801+0000","last_unstale":"2023-10-08T16:06:27.701170+0000","last_undegraded":"2023-10-08T16:06:27.701170+0000","last_fullsized":"2023-10-08T16:06:27.701170+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:52.890183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.710492+0000","last_change":"2023-10-08T16:06:26.704991+0000","last_active":"2023-10-08T16:06:27.710492+0000","last_peered":"2023-10-08T16:06:27.710492+0000","last_clean":"2023-10-08T16:06:27.710492+0000","last_became_active":"2023-10-08T16:06:26.704745+0000","last_became_peered":"2023-10-08T16:06:26.704745+0000","last_unstale":"2023-10-08T16:06:27.710492+0000","last_undegraded":"2023-10-08T16:06:27.710492+0000","last_fullsized":"2023-10-08T16:06:27.710492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:22.855740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.711012+0000","last_change":"2023-10-08T16:06:27.710947+0000","last_active":"2023-10-08T16:06:27.711012+0000","last_peered":"2023-10-08T16:06:27.711012+0000","last_clean":"2023-10-08T16:06:27.711012+0000","last_became_active":"2023-10-08T16:06:27.710328+0000","last_became_peered":"2023-10-08T16:06:27.710328+0000","last_unstale":"2023-10-08T16:06:27.711012+0000","last_undegraded":"2023-10-08T16:06:27.711012+0000","last_fullsized":"2023-10-08T16:06:27.711012+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:39.751608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.718291+0000","last_change":"2023-10-08T16:06:26.702616+0000","last_active":"2023-10-08T16:06:27.718291+0000","last_peered":"2023-10-08T16:06:27.718291+0000","last_clean":"2023-10-08T16:06:27.718291+0000","last_became_active":"2023-10-08T16:06:26.702382+0000","last_became_peered":"2023-10-08T16:06:26.702382+0000","last_unstale":"2023-10-08T16:06:27.718291+0000","last_undegraded":"2023-10-08T16:06:27.718291+0000","last_fullsized":"2023-10-08T16:06:27.718291+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:00.078062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717292+0000","last_change":"2023-10-08T16:06:27.717231+0000","last_active":"2023-10-08T16:06:27.717292+0000","last_peered":"2023-10-08T16:06:27.717292+0000","last_clean":"2023-10-08T16:06:27.717292+0000","last_became_active":"2023-10-08T16:06:27.716239+0000","last_became_peered":"2023-10-08T16:06:27.716239+0000","last_unstale":"2023-10-08T16:06:27.717292+0000","last_undegraded":"2023-10-08T16:06:27.717292+0000","last_fullsized":"2023-10-08T16:06:27.717292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:48.275891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715538+0000","last_change":"2023-10-08T16:06:26.708077+0000","last_active":"2023-10-08T16:06:27.715538+0000","last_peered":"2023-10-08T16:06:27.715538+0000","last_clean":"2023-10-08T16:06:27.715538+0000","last_became_active":"2023-10-08T16:06:26.707837+0000","last_became_peered":"2023-10-08T16:06:26.707837+0000","last_unstale":"2023-10-08T16:06:27.715538+0000","last_undegraded":"2023-10-08T16:06:27.715538+0000","last_fullsized":"2023-10-08T16:06:27.715538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:32.333067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.720215+0000","last_change":"2023-10-08T16:06:27.720095+0000","last_active":"2023-10-08T16:06:27.720215+0000","last_peered":"2023-10-08T16:06:27.720215+0000","last_clean":"2023-10-08T16:06:27.720215+0000","last_became_active":"2023-10-08T16:06:27.718840+0000","last_became_peered":"2023-10-08T16:06:27.718840+0000","last_unstale":"2023-10-08T16:06:27.720215+0000","last_undegraded":"2023-10-08T16:06:27.720215+0000","last_fullsized":"2023-10-08T16:06:27.720215+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:09.506992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697650+0000","last_change":"2023-10-08T16:06:26.703341+0000","last_active":"2023-10-08T16:06:27.697650+0000","last_peered":"2023-10-08T16:06:27.697650+0000","last_clean":"2023-10-08T16:06:27.697650+0000","last_became_active":"2023-10-08T16:06:26.702893+0000","last_became_peered":"2023-10-08T16:06:26.702893+0000","last_unstale":"2023-10-08T16:06:27.697650+0000","last_undegraded":"2023-10-08T16:06:27.697650+0000","last_fullsized":"2023-10-08T16:06:27.697650+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:08.030270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713973+0000","last_change":"2023-10-08T16:06:27.712083+0000","last_active":"2023-10-08T16:06:27.713973+0000","last_peered":"2023-10-08T16:06:27.713973+0000","last_clean":"2023-10-08T16:06:27.713973+0000","last_became_active":"2023-10-08T16:06:27.706826+0000","last_became_peered":"2023-10-08T16:06:27.706826+0000","last_unstale":"2023-10-08T16:06:27.713973+0000","last_undegraded":"2023-10-08T16:06:27.713973+0000","last_fullsized":"2023-10-08T16:06:27.713973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:12.777501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707287+0000","last_change":"2023-10-08T16:06:26.705475+0000","last_active":"2023-10-08T16:06:27.707287+0000","last_peered":"2023-10-08T16:06:27.707287+0000","last_clean":"2023-10-08T16:06:27.707287+0000","last_became_active":"2023-10-08T16:06:26.704838+0000","last_became_peered":"2023-10-08T16:06:26.704838+0000","last_unstale":"2023-10-08T16:06:27.707287+0000","last_undegraded":"2023-10-08T16:06:27.707287+0000","last_fullsized":"2023-10-08T16:06:27.707287+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:29.751225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.718505+0000","last_change":"2023-10-08T16:06:27.718369+0000","last_active":"2023-10-08T16:06:27.718505+0000","last_peered":"2023-10-08T16:06:27.718505+0000","last_clean":"2023-10-08T16:06:27.718505+0000","last_became_active":"2023-10-08T16:06:27.718125+0000","last_became_peered":"2023-10-08T16:06:27.718125+0000","last_unstale":"2023-10-08T16:06:27.718505+0000","last_undegraded":"2023-10-08T16:06:27.718505+0000","last_fullsized":"2023-10-08T16:06:27.718505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:50.088934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.701107+0000","last_change":"2023-10-08T16:06:26.706917+0000","last_active":"2023-10-08T16:06:27.701107+0000","last_peered":"2023-10-08T16:06:27.701107+0000","last_clean":"2023-10-08T16:06:27.701107+0000","last_became_active":"2023-10-08T16:06:26.703588+0000","last_became_peered":"2023-10-08T16:06:26.703588+0000","last_unstale":"2023-10-08T16:06:27.701107+0000","last_undegraded":"2023-10-08T16:06:27.701107+0000","last_fullsized":"2023-10-08T16:06:27.701107+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:11.772953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.708760+0000","last_change":"2023-10-08T16:06:27.708662+0000","last_active":"2023-10-08T16:06:27.708760+0000","last_peered":"2023-10-08T16:06:27.708760+0000","last_clean":"2023-10-08T16:06:27.708760+0000","last_became_active":"2023-10-08T16:06:27.708417+0000","last_became_peered":"2023-10-08T16:06:27.708417+0000","last_unstale":"2023-10-08T16:06:27.708760+0000","last_undegraded":"2023-10-08T16:06:27.708760+0000","last_fullsized":"2023-10-08T16:06:27.708760+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:51.653992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706108+0000","last_change":"2023-10-08T16:06:26.705404+0000","last_active":"2023-10-08T16:06:27.706108+0000","last_peered":"2023-10-08T16:06:27.706108+0000","last_clean":"2023-10-08T16:06:27.706108+0000","last_became_active":"2023-10-08T16:06:26.705171+0000","last_became_peered":"2023-10-08T16:06:26.705171+0000","last_unstale":"2023-10-08T16:06:27.706108+0000","last_undegraded":"2023-10-08T16:06:27.706108+0000","last_fullsized":"2023-10-08T16:06:27.706108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:11.973316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.708191+0000","last_change":"2023-10-08T16:06:27.707810+0000","last_active":"2023-10-08T16:06:27.708191+0000","last_peered":"2023-10-08T16:06:27.708191+0000","last_clean":"2023-10-08T16:06:27.708191+0000","last_became_active":"2023-10-08T16:06:27.707588+0000","last_became_peered":"2023-10-08T16:06:27.707588+0000","last_unstale":"2023-10-08T16:06:27.708191+0000","last_undegraded":"2023-10-08T16:06:27.708191+0000","last_fullsized":"2023-10-08T16:06:27.708191+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:22.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716927+0000","last_change":"2023-10-08T16:06:26.707311+0000","last_active":"2023-10-08T16:06:27.716927+0000","last_peered":"2023-10-08T16:06:27.716927+0000","last_clean":"2023-10-08T16:06:27.716927+0000","last_became_active":"2023-10-08T16:06:26.707078+0000","last_became_peered":"2023-10-08T16:06:26.707078+0000","last_unstale":"2023-10-08T16:06:27.716927+0000","last_undegraded":"2023-10-08T16:06:27.716927+0000","last_fullsized":"2023-10-08T16:06:27.716927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:36.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712119+0000","last_change":"2023-10-08T16:06:27.711173+0000","last_active":"2023-10-08T16:06:27.712119+0000","last_peered":"2023-10-08T16:06:27.712119+0000","last_clean":"2023-10-08T16:06:27.712119+0000","last_became_active":"2023-10-08T16:06:27.710923+0000","last_became_peered":"2023-10-08T16:06:27.710923+0000","last_unstale":"2023-10-08T16:06:27.712119+0000","last_undegraded":"2023-10-08T16:06:27.712119+0000","last_fullsized":"2023-10-08T16:06:27.712119+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:47.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.719808+0000","last_change":"2023-10-08T16:06:26.703488+0000","last_active":"2023-10-08T16:06:27.719808+0000","last_peered":"2023-10-08T16:06:27.719808+0000","last_clean":"2023-10-08T16:06:27.719808+0000","last_became_active":"2023-10-08T16:06:26.703200+0000","last_became_peered":"2023-10-08T16:06:26.703200+0000","last_unstale":"2023-10-08T16:06:27.719808+0000","last_undegraded":"2023-10-08T16:06:27.719808+0000","last_fullsized":"2023-10-08T16:06:27.719808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:01.357347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.715954+0000","last_change":"2023-10-08T16:06:27.715129+0000","last_active":"2023-10-08T16:06:27.715954+0000","last_peered":"2023-10-08T16:06:27.715954+0000","last_clean":"2023-10-08T16:06:27.715954+0000","last_became_active":"2023-10-08T16:06:27.706906+0000","last_became_peered":"2023-10-08T16:06:27.706906+0000","last_unstale":"2023-10-08T16:06:27.715954+0000","last_undegraded":"2023-10-08T16:06:27.715954+0000","last_fullsized":"2023-10-08T16:06:27.715954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:09.034819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716985+0000","last_change":"2023-10-08T16:06:26.706376+0000","last_active":"2023-10-08T16:06:27.716985+0000","last_peered":"2023-10-08T16:06:27.716985+0000","last_clean":"2023-10-08T16:06:27.716985+0000","last_became_active":"2023-10-08T16:06:26.706133+0000","last_became_peered":"2023-10-08T16:06:26.706133+0000","last_unstale":"2023-10-08T16:06:27.716985+0000","last_undegraded":"2023-10-08T16:06:27.716985+0000","last_fullsized":"2023-10-08T16:06:27.716985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:16.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716693+0000","last_change":"2023-10-08T16:06:27.714538+0000","last_active":"2023-10-08T16:06:27.716693+0000","last_peered":"2023-10-08T16:06:27.716693+0000","last_clean":"2023-10-08T16:06:27.716693+0000","last_became_active":"2023-10-08T16:06:27.713443+0000","last_became_peered":"2023-10-08T16:06:27.713443+0000","last_unstale":"2023-10-08T16:06:27.716693+0000","last_undegraded":"2023-10-08T16:06:27.716693+0000","last_fullsized":"2023-10-08T16:06:27.716693+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:24.825692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707573+0000","last_change":"2023-10-08T16:06:26.701006+0000","last_active":"2023-10-08T16:06:27.707573+0000","last_peered":"2023-10-08T16:06:27.707573+0000","last_clean":"2023-10-08T16:06:27.707573+0000","last_became_active":"2023-10-08T16:06:26.700753+0000","last_became_peered":"2023-10-08T16:06:26.700753+0000","last_unstale":"2023-10-08T16:06:27.707573+0000","last_undegraded":"2023-10-08T16:06:27.707573+0000","last_fullsized":"2023-10-08T16:06:27.707573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:41:48.225748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705896+0000","last_change":"2023-10-08T16:06:27.705439+0000","last_active":"2023-10-08T16:06:27.705896+0000","last_peered":"2023-10-08T16:06:27.705896+0000","last_clean":"2023-10-08T16:06:27.705896+0000","last_became_active":"2023-10-08T16:06:27.705202+0000","last_became_peered":"2023-10-08T16:06:27.705202+0000","last_unstale":"2023-10-08T16:06:27.705896+0000","last_undegraded":"2023-10-08T16:06:27.705896+0000","last_fullsized":"2023-10-08T16:06:27.705896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.698477+0000","last_change":"2023-10-08T16:06:26.705383+0000","last_active":"2023-10-08T16:06:27.698477+0000","last_peered":"2023-10-08T16:06:27.698477+0000","last_clean":"2023-10-08T16:06:27.698477+0000","last_became_active":"2023-10-08T16:06:26.705021+0000","last_became_peered":"2023-10-08T16:06:26.705021+0000","last_unstale":"2023-10-08T16:06:27.698477+0000","last_undegraded":"2023-10-08T16:06:27.698477+0000","last_fullsized":"2023-10-08T16:06:27.698477+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:35.961984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707266+0000","last_change":"2023-10-08T16:06:27.707191+0000","last_active":"2023-10-08T16:06:27.707266+0000","last_peered":"2023-10-08T16:06:27.707266+0000","last_clean":"2023-10-08T16:06:27.707266+0000","last_became_active":"2023-10-08T16:06:27.706392+0000","last_became_peered":"2023-10-08T16:06:27.706392+0000","last_unstale":"2023-10-08T16:06:27.707266+0000","last_undegraded":"2023-10-08T16:06:27.707266+0000","last_fullsized":"2023-10-08T16:06:27.707266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:09.506992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.718919+0000","last_change":"2023-10-08T16:06:26.706843+0000","last_active":"2023-10-08T16:06:27.718919+0000","last_peered":"2023-10-08T16:06:27.718919+0000","last_clean":"2023-10-08T16:06:27.718919+0000","last_became_active":"2023-10-08T16:06:26.706370+0000","last_became_peered":"2023-10-08T16:06:26.706370+0000","last_unstale":"2023-10-08T16:06:27.718919+0000","last_undegraded":"2023-10-08T16:06:27.718919+0000","last_fullsized":"2023-10-08T16:06:27.718919+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:47.762518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.702271+0000","last_change":"2023-10-08T16:06:27.701381+0000","last_active":"2023-10-08T16:06:27.702271+0000","last_peered":"2023-10-08T16:06:27.702271+0000","last_clean":"2023-10-08T16:06:27.702271+0000","last_became_active":"2023-10-08T16:06:27.701148+0000","last_became_peered":"2023-10-08T16:06:27.701148+0000","last_unstale":"2023-10-08T16:06:27.702271+0000","last_undegraded":"2023-10-08T16:06:27.702271+0000","last_fullsized":"2023-10-08T16:06:27.702271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:23.067150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712193+0000","last_change":"2023-10-08T16:06:26.696603+0000","last_active":"2023-10-08T16:06:27.712193+0000","last_peered":"2023-10-08T16:06:27.712193+0000","last_clean":"2023-10-08T16:06:27.712193+0000","last_became_active":"2023-10-08T16:06:26.696327+0000","last_became_peered":"2023-10-08T16:06:26.696327+0000","last_unstale":"2023-10-08T16:06:27.712193+0000","last_undegraded":"2023-10-08T16:06:27.712193+0000","last_fullsized":"2023-10-08T16:06:27.712193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:00.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.712582+0000","last_change":"2023-10-08T16:06:27.712522+0000","last_active":"2023-10-08T16:06:27.712582+0000","last_peered":"2023-10-08T16:06:27.712582+0000","last_clean":"2023-10-08T16:06:27.712582+0000","last_became_active":"2023-10-08T16:06:27.711461+0000","last_became_peered":"2023-10-08T16:06:27.711461+0000","last_unstale":"2023-10-08T16:06:27.712582+0000","last_undegraded":"2023-10-08T16:06:27.712582+0000","last_fullsized":"2023-10-08T16:06:27.712582+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:39.751608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717171+0000","last_change":"2023-10-08T16:06:26.708289+0000","last_active":"2023-10-08T16:06:27.717171+0000","last_peered":"2023-10-08T16:06:27.717171+0000","last_clean":"2023-10-08T16:06:27.717171+0000","last_became_active":"2023-10-08T16:06:26.707906+0000","last_became_peered":"2023-10-08T16:06:26.707906+0000","last_unstale":"2023-10-08T16:06:27.717171+0000","last_undegraded":"2023-10-08T16:06:27.717171+0000","last_fullsized":"2023-10-08T16:06:27.717171+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:31.774543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.700238+0000","last_change":"2023-10-08T16:06:27.700180+0000","last_active":"2023-10-08T16:06:27.700238+0000","last_peered":"2023-10-08T16:06:27.700238+0000","last_clean":"2023-10-08T16:06:27.700238+0000","last_became_active":"2023-10-08T16:06:27.699990+0000","last_became_peered":"2023-10-08T16:06:27.699990+0000","last_unstale":"2023-10-08T16:06:27.700238+0000","last_undegraded":"2023-10-08T16:06:27.700238+0000","last_fullsized":"2023-10-08T16:06:27.700238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:37.654360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716981+0000","last_change":"2023-10-08T16:06:26.702628+0000","last_active":"2023-10-08T16:06:27.716981+0000","last_peered":"2023-10-08T16:06:27.716981+0000","last_clean":"2023-10-08T16:06:27.716981+0000","last_became_active":"2023-10-08T16:06:26.702396+0000","last_became_peered":"2023-10-08T16:06:26.702396+0000","last_unstale":"2023-10-08T16:06:27.716981+0000","last_undegraded":"2023-10-08T16:06:27.716981+0000","last_fullsized":"2023-10-08T16:06:27.716981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.507118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.702530+0000","last_change":"2023-10-08T16:06:27.702465+0000","last_active":"2023-10-08T16:06:27.702530+0000","last_peered":"2023-10-08T16:06:27.702530+0000","last_clean":"2023-10-08T16:06:27.702530+0000","last_became_active":"2023-10-08T16:06:27.702238+0000","last_became_peered":"2023-10-08T16:06:27.702238+0000","last_unstale":"2023-10-08T16:06:27.702530+0000","last_undegraded":"2023-10-08T16:06:27.702530+0000","last_fullsized":"2023-10-08T16:06:27.702530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:17.571736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.698566+0000","last_change":"2023-10-08T16:06:26.705246+0000","last_active":"2023-10-08T16:06:27.698566+0000","last_peered":"2023-10-08T16:06:27.698566+0000","last_clean":"2023-10-08T16:06:27.698566+0000","last_became_active":"2023-10-08T16:06:26.704552+0000","last_became_peered":"2023-10-08T16:06:26.704552+0000","last_unstale":"2023-10-08T16:06:27.698566+0000","last_undegraded":"2023-10-08T16:06:27.698566+0000","last_fullsized":"2023-10-08T16:06:27.698566+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:38.747060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707272+0000","last_change":"2023-10-08T16:06:27.707216+0000","last_active":"2023-10-08T16:06:27.707272+0000","last_peered":"2023-10-08T16:06:27.707272+0000","last_clean":"2023-10-08T16:06:27.707272+0000","last_became_active":"2023-10-08T16:06:27.707051+0000","last_became_peered":"2023-10-08T16:06:27.707051+0000","last_unstale":"2023-10-08T16:06:27.707272+0000","last_undegraded":"2023-10-08T16:06:27.707272+0000","last_fullsized":"2023-10-08T16:06:27.707272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:15:11.297992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.714834+0000","last_change":"2023-10-08T16:06:26.702438+0000","last_active":"2023-10-08T16:06:27.714834+0000","last_peered":"2023-10-08T16:06:27.714834+0000","last_clean":"2023-10-08T16:06:27.714834+0000","last_became_active":"2023-10-08T16:06:26.702202+0000","last_became_peered":"2023-10-08T16:06:26.702202+0000","last_unstale":"2023-10-08T16:06:27.714834+0000","last_undegraded":"2023-10-08T16:06:27.714834+0000","last_fullsized":"2023-10-08T16:06:27.714834+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.271342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.704056+0000","last_change":"2023-10-08T16:06:27.703981+0000","last_active":"2023-10-08T16:06:27.704056+0000","last_peered":"2023-10-08T16:06:27.704056+0000","last_clean":"2023-10-08T16:06:27.704056+0000","last_became_active":"2023-10-08T16:06:27.703767+0000","last_became_peered":"2023-10-08T16:06:27.703767+0000","last_unstale":"2023-10-08T16:06:27.704056+0000","last_undegraded":"2023-10-08T16:06:27.704056+0000","last_fullsized":"2023-10-08T16:06:27.704056+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:43.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697757+0000","last_change":"2023-10-08T16:06:26.705587+0000","last_active":"2023-10-08T16:06:27.697757+0000","last_peered":"2023-10-08T16:06:27.697757+0000","last_clean":"2023-10-08T16:06:27.697757+0000","last_became_active":"2023-10-08T16:06:26.705396+0000","last_became_peered":"2023-10-08T16:06:26.705396+0000","last_unstale":"2023-10-08T16:06:27.697757+0000","last_undegraded":"2023-10-08T16:06:27.697757+0000","last_fullsized":"2023-10-08T16:06:27.697757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:42.965653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.709184+0000","last_change":"2023-10-08T16:06:27.709113+0000","last_active":"2023-10-08T16:06:27.709184+0000","last_peered":"2023-10-08T16:06:27.709184+0000","last_clean":"2023-10-08T16:06:27.709184+0000","last_became_active":"2023-10-08T16:06:27.708879+0000","last_became_peered":"2023-10-08T16:06:27.708879+0000","last_unstale":"2023-10-08T16:06:27.709184+0000","last_undegraded":"2023-10-08T16:06:27.709184+0000","last_fullsized":"2023-10-08T16:06:27.709184+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:47.782477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707178+0000","last_change":"2023-10-08T16:06:26.705570+0000","last_active":"2023-10-08T16:06:27.707178+0000","last_peered":"2023-10-08T16:06:27.707178+0000","last_clean":"2023-10-08T16:06:27.707178+0000","last_became_active":"2023-10-08T16:06:26.705331+0000","last_became_peered":"2023-10-08T16:06:26.705331+0000","last_unstale":"2023-10-08T16:06:27.707178+0000","last_undegraded":"2023-10-08T16:06:27.707178+0000","last_fullsized":"2023-10-08T16:06:27.707178+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:32.333067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.720548+0000","last_change":"2023-10-08T16:06:27.720488+0000","last_active":"2023-10-08T16:06:27.720548+0000","last_peered":"2023-10-08T16:06:27.720548+0000","last_clean":"2023-10-08T16:06:27.720548+0000","last_became_active":"2023-10-08T16:06:27.719856+0000","last_became_peered":"2023-10-08T16:06:27.719856+0000","last_unstale":"2023-10-08T16:06:27.720548+0000","last_undegraded":"2023-10-08T16:06:27.720548+0000","last_fullsized":"2023-10-08T16:06:27.720548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:23.361433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707670+0000","last_change":"2023-10-08T16:06:26.704482+0000","last_active":"2023-10-08T16:06:27.707670+0000","last_peered":"2023-10-08T16:06:27.707670+0000","last_clean":"2023-10-08T16:06:27.707670+0000","last_became_active":"2023-10-08T16:06:26.703947+0000","last_became_peered":"2023-10-08T16:06:26.703947+0000","last_unstale":"2023-10-08T16:06:27.707670+0000","last_undegraded":"2023-10-08T16:06:27.707670+0000","last_fullsized":"2023-10-08T16:06:27.707670+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.271342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713954+0000","last_change":"2023-10-08T16:06:27.711958+0000","last_active":"2023-10-08T16:06:27.713954+0000","last_peered":"2023-10-08T16:06:27.713954+0000","last_clean":"2023-10-08T16:06:27.713954+0000","last_became_active":"2023-10-08T16:06:27.711608+0000","last_became_peered":"2023-10-08T16:06:27.711608+0000","last_unstale":"2023-10-08T16:06:27.713954+0000","last_undegraded":"2023-10-08T16:06:27.713954+0000","last_fullsized":"2023-10-08T16:06:27.713954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:58.927881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.698426+0000","last_change":"2023-10-08T16:06:26.708986+0000","last_active":"2023-10-08T16:06:27.698426+0000","last_peered":"2023-10-08T16:06:27.698426+0000","last_clean":"2023-10-08T16:06:27.698426+0000","last_became_active":"2023-10-08T16:06:26.708757+0000","last_became_peered":"2023-10-08T16:06:26.708757+0000","last_unstale":"2023-10-08T16:06:27.698426+0000","last_undegraded":"2023-10-08T16:06:27.698426+0000","last_fullsized":"2023-10-08T16:06:27.698426+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:22.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.716727+0000","last_change":"2023-10-08T16:06:27.715190+0000","last_active":"2023-10-08T16:06:27.716727+0000","last_peered":"2023-10-08T16:06:27.716727+0000","last_clean":"2023-10-08T16:06:27.716727+0000","last_became_active":"2023-10-08T16:06:27.714774+0000","last_became_peered":"2023-10-08T16:06:27.714774+0000","last_unstale":"2023-10-08T16:06:27.716727+0000","last_undegraded":"2023-10-08T16:06:27.716727+0000","last_fullsized":"2023-10-08T16:06:27.716727+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:55.722430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706212+0000","last_change":"2023-10-08T16:06:26.705484+0000","last_active":"2023-10-08T16:06:27.706212+0000","last_peered":"2023-10-08T16:06:27.706212+0000","last_clean":"2023-10-08T16:06:27.706212+0000","last_became_active":"2023-10-08T16:06:26.705247+0000","last_became_peered":"2023-10-08T16:06:26.705247+0000","last_unstale":"2023-10-08T16:06:27.706212+0000","last_undegraded":"2023-10-08T16:06:27.706212+0000","last_fullsized":"2023-10-08T16:06:27.706212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:08.030270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.710435+0000","last_change":"2023-10-08T16:06:27.710011+0000","last_active":"2023-10-08T16:06:27.710435+0000","last_peered":"2023-10-08T16:06:27.710435+0000","last_clean":"2023-10-08T16:06:27.710435+0000","last_became_active":"2023-10-08T16:06:27.709754+0000","last_became_peered":"2023-10-08T16:06:27.709754+0000","last_unstale":"2023-10-08T16:06:27.710435+0000","last_undegraded":"2023-10-08T16:06:27.710435+0000","last_fullsized":"2023-10-08T16:06:27.710435+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:50.088934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697425+0000","last_change":"2023-10-08T16:06:26.700128+0000","last_active":"2023-10-08T16:06:27.697425+0000","last_peered":"2023-10-08T16:06:27.697425+0000","last_clean":"2023-10-08T16:06:27.697425+0000","last_became_active":"2023-10-08T16:06:26.699593+0000","last_became_peered":"2023-10-08T16:06:26.699593+0000","last_unstale":"2023-10-08T16:06:27.697425+0000","last_undegraded":"2023-10-08T16:06:27.697425+0000","last_fullsized":"2023-10-08T16:06:27.697425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:32.333067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707070+0000","last_change":"2023-10-08T16:06:27.706965+0000","last_active":"2023-10-08T16:06:27.707070+0000","last_peered":"2023-10-08T16:06:27.707070+0000","last_clean":"2023-10-08T16:06:27.707070+0000","last_became_active":"2023-10-08T16:06:27.701539+0000","last_became_peered":"2023-10-08T16:06:27.701539+0000","last_unstale":"2023-10-08T16:06:27.707070+0000","last_undegraded":"2023-10-08T16:06:27.707070+0000","last_fullsized":"2023-10-08T16:06:27.707070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:38:48.467864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.708080+0000","last_change":"2023-10-08T16:06:26.705463+0000","last_active":"2023-10-08T16:06:27.708080+0000","last_peered":"2023-10-08T16:06:27.708080+0000","last_clean":"2023-10-08T16:06:27.708080+0000","last_became_active":"2023-10-08T16:06:26.705232+0000","last_became_peered":"2023-10-08T16:06:26.705232+0000","last_unstale":"2023-10-08T16:06:27.708080+0000","last_undegraded":"2023-10-08T16:06:27.708080+0000","last_fullsized":"2023-10-08T16:06:27.708080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.507118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.705931+0000","last_change":"2023-10-08T16:06:27.705678+0000","last_active":"2023-10-08T16:06:27.705931+0000","last_peered":"2023-10-08T16:06:27.705931+0000","last_clean":"2023-10-08T16:06:27.705931+0000","last_became_active":"2023-10-08T16:06:27.705006+0000","last_became_peered":"2023-10-08T16:06:27.705006+0000","last_unstale":"2023-10-08T16:06:27.705931+0000","last_undegraded":"2023-10-08T16:06:27.705931+0000","last_fullsized":"2023-10-08T16:06:27.705931+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.681922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703498+0000","last_change":"2023-10-08T16:06:26.710029+0000","last_active":"2023-10-08T16:06:27.703498+0000","last_peered":"2023-10-08T16:06:27.703498+0000","last_clean":"2023-10-08T16:06:27.703498+0000","last_became_active":"2023-10-08T16:06:26.709828+0000","last_became_peered":"2023-10-08T16:06:26.709828+0000","last_unstale":"2023-10-08T16:06:27.703498+0000","last_undegraded":"2023-10-08T16:06:27.703498+0000","last_fullsized":"2023-10-08T16:06:27.703498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:37.155804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.703307+0000","last_change":"2023-10-08T16:06:27.701658+0000","last_active":"2023-10-08T16:06:27.703307+0000","last_peered":"2023-10-08T16:06:27.703307+0000","last_clean":"2023-10-08T16:06:27.703307+0000","last_became_active":"2023-10-08T16:06:27.701404+0000","last_became_peered":"2023-10-08T16:06:27.701404+0000","last_unstale":"2023-10-08T16:06:27.703307+0000","last_undegraded":"2023-10-08T16:06:27.703307+0000","last_fullsized":"2023-10-08T16:06:27.703307+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:01.082611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.697206+0000","last_change":"2023-10-08T16:06:26.708162+0000","last_active":"2023-10-08T16:06:27.697206+0000","last_peered":"2023-10-08T16:06:27.697206+0000","last_clean":"2023-10-08T16:06:27.697206+0000","last_became_active":"2023-10-08T16:06:26.707930+0000","last_became_peered":"2023-10-08T16:06:26.707930+0000","last_unstale":"2023-10-08T16:06:27.697206+0000","last_undegraded":"2023-10-08T16:06:27.697206+0000","last_fullsized":"2023-10-08T16:06:27.697206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:11.772953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.710816+0000","last_change":"2023-10-08T16:06:27.710709+0000","last_active":"2023-10-08T16:06:27.710816+0000","last_peered":"2023-10-08T16:06:27.710816+0000","last_clean":"2023-10-08T16:06:27.710816+0000","last_became_active":"2023-10-08T16:06:27.709941+0000","last_became_peered":"2023-10-08T16:06:27.709941+0000","last_unstale":"2023-10-08T16:06:27.710816+0000","last_undegraded":"2023-10-08T16:06:27.710816+0000","last_fullsized":"2023-10-08T16:06:27.710816+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:01.082611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.707185+0000","last_change":"2023-10-08T16:06:26.706973+0000","last_active":"2023-10-08T16:06:27.707185+0000","last_peered":"2023-10-08T16:06:27.707185+0000","last_clean":"2023-10-08T16:06:27.707185+0000","last_became_active":"2023-10-08T16:06:26.706737+0000","last_became_peered":"2023-10-08T16:06:26.706737+0000","last_unstale":"2023-10-08T16:06:27.707185+0000","last_undegraded":"2023-10-08T16:06:27.707185+0000","last_fullsized":"2023-10-08T16:06:27.707185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:46.777928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.713387+0000","last_change":"2023-10-08T16:06:27.713240+0000","last_active":"2023-10-08T16:06:27.713387+0000","last_peered":"2023-10-08T16:06:27.713387+0000","last_clean":"2023-10-08T16:06:27.713387+0000","last_became_active":"2023-10-08T16:06:27.707929+0000","last_became_peered":"2023-10-08T16:06:27.707929+0000","last_unstale":"2023-10-08T16:06:27.713387+0000","last_undegraded":"2023-10-08T16:06:27.713387+0000","last_fullsized":"2023-10-08T16:06:27.713387+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:26.687336+0000","last_clean_scrub_stamp":"2023-10-08T16:06:26.687336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:17.391814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.717122+0000","last_change":"2023-10-08T16:06:26.703185+0000","last_active":"2023-10-08T16:06:27.717122+0000","last_peered":"2023-10-08T16:06:27.717122+0000","last_clean":"2023-10-08T16:06:27.717122+0000","last_became_active":"2023-10-08T16:06:26.702911+0000","last_became_peered":"2023-10-08T16:06:26.702911+0000","last_unstale":"2023-10-08T16:06:27.717122+0000","last_undegraded":"2023-10-08T16:06:27.717122+0000","last_fullsized":"2023-10-08T16:06:27.717122+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:06:25.682787+0000","last_clean_scrub_stamp":"2023-10-08T16:06:25.682787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:51.885635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-08T16:06:27.706351+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:06:27.706351+0000","last_peered":"2023-10-08T16:06:27.706351+0000","last_clean":"2023-10-08T16:06:27.706351+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:06:27.706351+0000","last_undegraded":"2023-10-08T16:06:27.706351+0000","last_fullsized":"2023-10-08T16:06:27.706351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":790,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194522,"statfs":{"total":200000000,"available":199190528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.5}]},{"osd":1,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":214,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195097,"statfs":{"total":200000000,"available":199780342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.56200000000000006}]},{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.40200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.32700000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199780916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.31}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.26700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.4929999999999999,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":790,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194522,"statfs":{"total":200000000,"available":199190584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.60299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.628},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.63800000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.76800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195097,"statfs":{"total":200000000,"available":199779428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.377}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51900000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.434}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":214,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199780376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.308},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.627}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195097,"statfs":{"total":200000000,"available":199779450,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.74199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.92700000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.58999999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199780916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.433}]},{"osd":6,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.377},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38600000000000001}]}]}],"pool_statfs":[]}} 2023-10-08T16:06:32.183 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:06:32.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:06:32.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.343+0000 7f5050ba2700 1 Processor -- start 2023-10-08T16:06:32.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.343+0000 7f5050ba2700 1 -- start start 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f5050ba2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f504c15b990 0x7f504c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f5050ba2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c0b14f0 con 0x7f504c0b3570 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f5050ba2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c0b17d0 con 0x7f504c0b4860 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f5050ba2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c0b1ab0 con 0x7f504c15b990 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f504ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f504c15b990 0x7f504c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f5049d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f504c0b3570 0x7f504c0cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43730/0 (socket says 172.21.15.60:43730) 2023-10-08T16:06:32.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.344+0000 7f5049d9b700 1 -- 172.21.15.60:0/1171399098 learned_addr learned my addr 172.21.15.60:0/1171399098 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:32.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504ad9d700 1 -- 172.21.15.60:0/1171399098 >> v1:172.21.15.144:6789/0 conn(0x7f504c0b4860 legacy=0x7f504c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504ad9d700 1 -- 172.21.15.60:0/1171399098 >> v1:172.21.15.60:6789/0 conn(0x7f504c0b3570 legacy=0x7f504c0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504ad9d700 1 -- 172.21.15.60:0/1171399098 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0b1d90 con 0x7f504c15b990 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504959a700 1 -- 172.21.15.60:0/1171399098 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810217794 0 0) 0x7f504c0b17d0 con 0x7f504c0b4860 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504ad9d700 1 --2- 172.21.15.60:0/1171399098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c15a1a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f503c0098e0 tx=0x7f503c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6b65dcc02cf055 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504959a700 1 -- 172.21.15.60:0/1171399098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c009e80 con 0x7f504c15b990 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504959a700 1 -- 172.21.15.60:0/1171399098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00b8f0 con 0x7f504c15b990 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f504959a700 1 -- 172.21.15.60:0/1171399098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00bc70 con 0x7f504c15b990 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f5050ba2700 1 -- 172.21.15.60:0/1171399098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 msgr2=0x7f504c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.345+0000 7f5050ba2700 1 --2- 172.21.15.60:0/1171399098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c15a1a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f503c0098e0 tx=0x7f503c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.346+0000 7f5050ba2700 1 -- 172.21.15.60:0/1171399098 shutdown_connections 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.346+0000 7f5050ba2700 1 --2- 172.21.15.60:0/1171399098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c15a1a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.346+0000 7f5050ba2700 1 -- 172.21.15.60:0/1171399098 >> 172.21.15.60:0/1171399098 conn(0x7f504c09a0f0 msgr2=0x7f504c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:32.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.346+0000 7f5050ba2700 1 -- 172.21.15.60:0/1171399098 shutdown_connections 2023-10-08T16:06:32.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.346+0000 7f5050ba2700 1 -- 172.21.15.60:0/1171399098 wait complete. 2023-10-08T16:06:32.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.347+0000 7f5050ba2700 1 Processor -- start 2023-10-08T16:06:32.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.347+0000 7f5050ba2700 1 -- start start 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.347+0000 7f5050ba2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f504c0b3570 0x7f504c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.347+0000 7f5050ba2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f504c0b4860 0x7f504c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5050ba2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5050ba2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c160970 con 0x7f504c15b990 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5050ba2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c15fab0 con 0x7f504c0b4860 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5050ba2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c15fd60 con 0x7f504c0b3570 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34958/0 (socket says 172.21.15.60:34958) 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 -- 172.21.15.60:0/134890764 learned_addr learned my addr 172.21.15.60:0/134890764 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5049d9b700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f504c0b4860 0x7f504c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504a59c700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f504c0b3570 0x7f504c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 -- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f504c0b3570 msgr2=0x7f504c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f504c0b3570 0x7f504c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 -- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f504c0b4860 msgr2=0x7f504c151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f504c0b4860 0x7f504c151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 -- 172.21.15.60:0/134890764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c009420 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504a59c700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f504c0b3570 0x7f504c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f504ad9d700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c151e40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f504c068cd0 tx=0x7f503c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c01f070 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00bb30 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c160040 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c025670 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.348+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c160600 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.349+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c160ae0 con 0x7f504c15b990 2023-10-08T16:06:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.350+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f503c023070 con 0x7f504c15b990 2023-10-08T16:06:32.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.350+0000 7f50427fc700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f502c066f30 0x7f502c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.350+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f503c085d30 con 0x7f504c15b990 2023-10-08T16:06:32.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.350+0000 7f504a59c700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f502c066f30 0x7f502c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.351+0000 7f504a59c700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f502c066f30 0x7f502c0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f504400e360 tx=0x7f5044009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:32.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.354+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f503c052fa0 con 0x7f504c15b990 2023-10-08T16:06:32.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:32.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:32.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.632+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f504c04c3c0 con 0x7f504c15b990 2023-10-08T16:06:32.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.635+0000 7f50427fc700 1 -- 172.21.15.60:0/134890764 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f503c0150e0 con 0x7f504c15b990 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f502c066f30 msgr2=0x7f502c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f502c066f30 0x7f502c0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f504400e360 tx=0x7f5044009040 comp rx=0 tx=0).stop 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 msgr2=0x7f504c151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c151e40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f504c068cd0 tx=0x7f503c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 shutdown_connections 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f502c066f30 0x7f502c0693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f504c0b3570 0x7f504c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c15b990 0x7f504c151e40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 --2- 172.21.15.60:0/134890764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f504c0b4860 0x7f504c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 >> 172.21.15.60:0/134890764 conn(0x7f504c09a0f0 msgr2=0x7f504c15bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:32.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 shutdown_connections 2023-10-08T16:06:32.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.637+0000 7f5050ba2700 1 -- 172.21.15.60:0/134890764 wait complete. 2023-10-08T16:06:32.639 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:06:32.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:32.685 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-10-08T16:06:32.684+0000 7f44eb725700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:06:32.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.769+0000 7fd904a4b700 1 Processor -- start 2023-10-08T16:06:32.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.769+0000 7fd904a4b700 1 -- start start 2023-10-08T16:06:32.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd904a4b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 0x7fd9000c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd904a4b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 0x7fd9000cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd904a4b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90015a730 con 0x7fd90015a2e0 2023-10-08T16:06:32.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd904a4b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000ae320 con 0x7fd9000cc410 2023-10-08T16:06:32.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd904a4b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000ad710 con 0x7fd900159f10 2023-10-08T16:06:32.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 0x7fd9000c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8ff59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 0x7fd9000cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fe59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd90015a2e0 0x7fd9000cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:42028/0 (socket says 172.21.15.60:42028) 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 0x7fd9000c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:52884/0 (socket says 172.21.15.60:52884) 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8ff59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 0x7fd9000cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:44484/0 (socket says 172.21.15.60:44484) 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fe59c700 1 -- 172.21.15.60:0/1331627031 learned_addr learned my addr 172.21.15.60:0/1331627031 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fed9d700 1 -- 172.21.15.60:0/1331627031 >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 msgr2=0x7fd9000cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fed9d700 1 --2- 172.21.15.60:0/1331627031 >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 0x7fd9000cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fed9d700 1 -- 172.21.15.60:0/1331627031 >> v1:172.21.15.144:6789/0 conn(0x7fd90015a2e0 legacy=0x7fd9000cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8fed9d700 1 -- 172.21.15.60:0/1331627031 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000ad9f0 con 0x7fd900159f10 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.770+0000 7fd8ff59e700 1 --2- 172.21.15.60:0/1331627031 >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 0x7fd9000cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd8fed9d700 1 --2- 172.21.15.60:0/1331627031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 0x7fd9000c59e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80098e0 tx=0x7fd8f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea882153749196a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:32.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd8fdd9b700 1 -- 172.21.15.60:0/1331627031 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800b640 con 0x7fd900159f10 2023-10-08T16:06:32.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd8fdd9b700 1 -- 172.21.15.60:0/1331627031 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800b7a0 con 0x7fd900159f10 2023-10-08T16:06:32.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd8fdd9b700 1 -- 172.21.15.60:0/1331627031 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800bb40 con 0x7fd900159f10 2023-10-08T16:06:32.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd904a4b700 1 -- 172.21.15.60:0/1331627031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 msgr2=0x7fd9000c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd904a4b700 1 --2- 172.21.15.60:0/1331627031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 0x7fd9000c59e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80098e0 tx=0x7fd8f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd904a4b700 1 -- 172.21.15.60:0/1331627031 shutdown_connections 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd904a4b700 1 --2- 172.21.15.60:0/1331627031 >> v2:172.21.15.144:3300/0 conn(0x7fd9000cc410 0x7fd9000cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd904a4b700 1 --2- 172.21.15.60:0/1331627031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd900159f10 0x7fd9000c59e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.771+0000 7fd904a4b700 1 -- 172.21.15.60:0/1331627031 >> 172.21.15.60:0/1331627031 conn(0x7fd900067e40 msgr2=0x7fd9000d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.772+0000 7fd904a4b700 1 -- 172.21.15.60:0/1331627031 shutdown_connections 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.772+0000 7fd904a4b700 1 -- 172.21.15.60:0/1331627031 wait complete. 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 Processor -- start 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 -- start start 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9000cc410 0x7fd90016df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 0x7fd9000c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015a2e0 0x7fd9000c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90016a950 con 0x7fd900159f10 2023-10-08T16:06:32.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90016ac20 con 0x7fd90015a2e0 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.773+0000 7fd904a4b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c7f20 con 0x7fd9000cc410 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 0x7fd9000c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 0x7fd9000c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34972/0 (socket says 172.21.15.60:34972) 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 -- 172.21.15.60:0/480812984 learned_addr learned my addr 172.21.15.60:0/480812984 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fed9d700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9000cc410 0x7fd90016df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8ff59e700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015a2e0 0x7fd9000c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 -- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9000cc410 msgr2=0x7fd90016df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9000cc410 0x7fd90016df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 -- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015a2e0 msgr2=0x7fd9000c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015a2e0 0x7fd9000c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 -- 172.21.15.60:0/480812984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009a20 con 0x7fd900159f10 2023-10-08T16:06:32.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8fe59c700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 0x7fd9000c98c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c560 tx=0x7fd8e8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:32.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8005b30 con 0x7fd900159f10 2023-10-08T16:06:32.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8005cb0 con 0x7fd900159f10 2023-10-08T16:06:32.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f8009420 con 0x7fd900159f10 2023-10-08T16:06:32.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8007320 con 0x7fd900159f10 2023-10-08T16:06:32.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.774+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90016ebd0 con 0x7fd900159f10 2023-10-08T16:06:32.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.775+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd900089300 con 0x7fd900159f10 2023-10-08T16:06:32.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.776+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8e8007690 con 0x7fd900159f10 2023-10-08T16:06:32.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.776+0000 7fd8f6ffd700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8e0066f30 0x7fd8e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:32.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.776+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8e80836e0 con 0x7fd900159f10 2023-10-08T16:06:32.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.776+0000 7fd8fed9d700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8e0066f30 0x7fd8e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:32.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.777+0000 7fd8fed9d700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8e0066f30 0x7fd8e00693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80093f0 tx=0x7fd8f8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:32.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:32.780+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8e8050a10 con 0x7fd900159f10 2023-10-08T16:06:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.017+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd90015a730 con 0x7fd900159f10 2023-10-08T16:06:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.017+0000 7fd8f6ffd700 1 -- 172.21.15.60:0/480812984 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fd90015a730 con 0x7fd900159f10 2023-10-08T16:06:33.018 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:33.018 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8e0066f30 msgr2=0x7fd8e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8e0066f30 0x7fd8e00693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80093f0 tx=0x7fd8f8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 msgr2=0x7fd9000c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 0x7fd9000c98c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c560 tx=0x7fd8e8001020 comp rx=0 tx=0).stop 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 shutdown_connections 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd8e0066f30 0x7fd8e00693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9000cc410 0x7fd90016df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90015a2e0 0x7fd9000c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 --2- 172.21.15.60:0/480812984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900159f10 0x7fd9000c98c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 >> 172.21.15.60:0/480812984 conn(0x7fd900067e40 msgr2=0x7fd9000c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 shutdown_connections 2023-10-08T16:06:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.019+0000 7fd904a4b700 1 -- 172.21.15.60:0/480812984 wait complete. 2023-10-08T16:06:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:06:33.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:06:27.093610+0000', 'modified': '2023-10-08T16:06:30.715322+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/1769619712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6833', 'nonce': 1769619712}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1769619712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:06:33.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:06:33.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T16:06:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.556+0000 7f499b01e700 1 Processor -- start 2023-10-08T16:06:33.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.556+0000 7f499b01e700 1 -- start start 2023-10-08T16:06:33.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f499b01e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49940c9af0 0x7f499406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f499b01e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940ca0b0 con 0x7f49941510f0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f499b01e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4994068a10 con 0x7f4994070700 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f499b01e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4994068cf0 con 0x7f49940c9af0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f4998dba700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f49941510f0 0x7f499415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43738/0 (socket says 172.21.15.60:43738) 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f4998dba700 1 -- 172.21.15.60:0/4233419825 learned_addr learned my addr 172.21.15.60:0/4233419825 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.557+0000 7f4993fff700 1 --2- 172.21.15.60:0/4233419825 >> v2:172.21.15.144:3300/0 conn(0x7f49940c9af0 0x7f499406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092645754 0 0) 0x7f49940ca0b0 con 0x7f49941510f0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c003570 con 0x7f49941510f0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716172024 0 0) 0x7f4994068a10 con 0x7f4994070700 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49940ca0b0 con 0x7f4994070700 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420126975 0 0) 0x7f497c003570 con 0x7f49941510f0 2023-10-08T16:06:33.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f4993fff700 1 -- 172.21.15.60:0/4233419825 >> v1:172.21.15.144:6789/0 conn(0x7f4994070700 legacy=0x7f4994070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f4993fff700 1 -- 172.21.15.60:0/4233419825 >> v1:172.21.15.60:6789/0 conn(0x7f49941510f0 legacy=0x7f499415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f4993fff700 1 -- 172.21.15.60:0/4233419825 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940cb230 con 0x7f49940c9af0 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f4993fff700 1 --2- 172.21.15.60:0/4233419825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499406ecc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49880098e0 tx=0x7f49880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5498d1c12783c229 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0017f0 con 0x7f49940c9af0 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4988011420 con 0x7f49940c9af0 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.558+0000 7f49937fe700 1 -- 172.21.15.60:0/4233419825 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880117a0 con 0x7f49940c9af0 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 -- 172.21.15.60:0/4233419825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 msgr2=0x7f499406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 --2- 172.21.15.60:0/4233419825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499406ecc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49880098e0 tx=0x7f49880091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 -- 172.21.15.60:0/4233419825 shutdown_connections 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 --2- 172.21.15.60:0/4233419825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499406ecc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 -- 172.21.15.60:0/4233419825 >> 172.21.15.60:0/4233419825 conn(0x7f49940ca4f0 msgr2=0x7f49940ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 -- 172.21.15.60:0/4233419825 shutdown_connections 2023-10-08T16:06:33.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.559+0000 7f499b01e700 1 -- 172.21.15.60:0/4233419825 wait complete. 2023-10-08T16:06:33.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.560+0000 7f499b01e700 1 Processor -- start 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.560+0000 7f499b01e700 1 -- start start 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f499b01e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 0x7f49941505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f499b01e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499416e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f499b01e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49941510f0 0x7f4994159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f499b01e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4994150b10 con 0x7f4994070700 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f499b01e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499416ef00 con 0x7f49940c9af0 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f499b01e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499416f1e0 con 0x7f49941510f0 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 0x7f49941505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 0x7f49941505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34984/0 (socket says 172.21.15.60:34984) 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 -- 172.21.15.60:0/1645575972 learned_addr learned my addr 172.21.15.60:0/1645575972 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4993fff700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499416e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f49995bb700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49941510f0 0x7f4994159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 -- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49941510f0 msgr2=0x7f4994159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49941510f0 0x7f4994159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 -- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 msgr2=0x7f499416e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499416e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f4998dba700 1 -- 172.21.15.60:0/1645575972 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009420 con 0x7f4994070700 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.561+0000 7f49995bb700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49941510f0 0x7f4994159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.562+0000 7f4998dba700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 0x7f49941505d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f498c00cbc0 tx=0x7f498c007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.562+0000 7f4990ff9700 1 -- 172.21.15.60:0/1645575972 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c004dc0 con 0x7f4994070700 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.562+0000 7f4990ff9700 1 -- 172.21.15.60:0/1645575972 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c00a620 con 0x7f4994070700 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.562+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4994154f70 con 0x7f4994070700 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.562+0000 7f4990ff9700 1 -- 172.21.15.60:0/1645575972 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00a9e0 con 0x7f4994070700 2023-10-08T16:06:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.562+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940c5ff0 con 0x7f4994070700 2023-10-08T16:06:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.563+0000 7f4990ff9700 1 -- 172.21.15.60:0/1645575972 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f498c00ad50 con 0x7f4994070700 2023-10-08T16:06:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.564+0000 7f4990ff9700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4980066f30 0x7f49800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.564+0000 7f4990ff9700 1 -- 172.21.15.60:0/1645575972 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f498c083d10 con 0x7f4994070700 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.564+0000 7f4993fff700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4980066f30 0x7f49800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.564+0000 7f4993fff700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4980066f30 0x7f49800693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49880093f0 tx=0x7f4988016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 Processor -- start 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 -- start start 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f12be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 0x55c11f154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f154f60 0x55c11f127cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f082a70 con 0x55c11f175d00 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f080270 con 0x55c11f12ba50 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c11f07c060 con 0x55c11f154f60 2023-10-08T16:06:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.566+0000 7f4993fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 0x55c11f154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 0x55c11f154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34992/0 (socket says 172.21.15.60:34992) 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 -- 172.21.15.60:0/2275368413 learned_addr learned my addr 172.21.15.60:0/2275368413 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4998dba700 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f12be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f49995bb700 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f154f60 0x55c11f127cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 -- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f154f60 msgr2=0x55c11f127cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f154f60 0x55c11f127cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 -- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 msgr2=0x55c11f12be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f12be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 -- 172.21.15.60:0/2275368413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c11ef16270 con 0x55c11f175d00 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4998dba700 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f12be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4993fff700 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 0x55c11f154a20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4988011c60 tx=0x7f4988022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca12194cac30d560 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4979ffb700 1 -- 172.21.15.60:0/2275368413 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988022070 con 0x55c11f175d00 2023-10-08T16:06:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4979ffb700 1 -- 172.21.15.60:0/2275368413 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498801c8e0 con 0x55c11f175d00 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.567+0000 7f4979ffb700 1 -- 172.21.15.60:0/2275368413 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498801ca50 con 0x55c11f175d00 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 -- 172.21.15.60:0/2275368413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 msgr2=0x55c11f154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 0x55c11f154a20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4988011c60 tx=0x7f4988022000 comp rx=0 tx=0).stop 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 -- 172.21.15.60:0/2275368413 shutdown_connections 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f154f60 0x55c11f127cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f12be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 --2- 172.21.15.60:0/2275368413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f175d00 0x55c11f154a20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 -- 172.21.15.60:0/2275368413 >> 172.21.15.60:0/2275368413 conn(0x55c11f12d370 msgr2=0x55c11f12d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 -- 172.21.15.60:0/2275368413 shutdown_connections 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 -- 172.21.15.60:0/2275368413 wait complete. 2023-10-08T16:06:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.568+0000 7f49a4316b80 1 -- start start 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 Processor -- start 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 0x55c11f16c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f175580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f175d00 0x55c11f16eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f027890 con 0x55c11f12ba50 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f042ea0 con 0x55c11f154f60 2023-10-08T16:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c11eefee30 con 0x55c11f175d00 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f49a4316b80 10 client.0 _ll_register_callbacks cb 0x55c11f0ef110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f4998dba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 0x55c11f16c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f4998dba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 0x55c11f16c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35006/0 (socket says 172.21.15.60:35006) 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.569+0000 7f4998dba700 1 -- 172.21.15.60:0/3281417669 learned_addr learned my addr 172.21.15.60:0/3281417669 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4993fff700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f175580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49995bb700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f175d00 0x55c11f16eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4998dba700 1 -- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f175d00 msgr2=0x55c11f16eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4998dba700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f175d00 0x55c11f16eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4998dba700 1 -- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 msgr2=0x55c11f175580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4998dba700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f175580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4998dba700 1 -- 172.21.15.60:0/3281417669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940cb230 con 0x55c11f12ba50 2023-10-08T16:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4998dba700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 0x55c11f16c470 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f498c054bd0 tx=0x7f498c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba99727a7624950 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4972ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4972ffd700 1 -- 172.21.15.60:0/3281417669 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c05bbe0 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4972ffd700 1 -- 172.21.15.60:0/3281417669 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f498c058bd0 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c11f120b70 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4972ffd700 1 -- 172.21.15.60:0/3281417669 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f498c05b750 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 10 client.5496 fetch_fsmap learned FSMap version 25 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c11eeb8fe0 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4972ffd700 1 -- 172.21.15.60:0/3281417669 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c11f120b70 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f4972ffd700 1 -- 172.21.15.60:0/3281417669 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f498c050a30 con 0x55c11f12ba50 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 10 client.5496 fetch_fsmap finished waiting for FSMap version 25 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 10 client.5496 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 20 client.5496 populate_metadata read hostname 'smithi060' 2023-10-08T16:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.570+0000 7f49a4316b80 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f15b410 0x55c11f15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.571+0000 7f49a4316b80 4 client.5496 mds_command: new command op to 5361 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.571+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 --> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c11f0fdaa0 con 0x55c11f15b410 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.571+0000 7f4993fff700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f15b410 0x55c11f15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.571+0000 7f4993fff700 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f15b410 0x55c11f15b7e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e76ca501fddb7819 server_cookie=9cb06cf392c2c6cd in_seq=0 out_seq=0 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.571+0000 7f4972ffd700 10 client.5496 ms_handle_connect on v2:172.21.15.144:6833/1769619712 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f4972ffd700 1 -- 172.21.15.60:0/3281417669 <== mds.0 v2:172.21.15.144:6833/1769619712 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c11f0fdaa0 con 0x55c11f15b410 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f4972ffd700 10 client.5496 handle_command_reply: tid=0 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 client.5496 shutdown 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 msgr2=0x55c11f16c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 0x55c11f16c470 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f498c054bd0 tx=0x7f498c01e040 comp rx=0 tx=0).stop 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 shutdown_connections 2023-10-08T16:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f15b410 0x55c11f15b7e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f175d00 0x55c11f16eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12ba50 0x55c11f16c470 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 --2- 172.21.15.60:0/3281417669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f175580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f4972ffd700 0 client.5496 ms_handle_reset on v2:172.21.15.144:6833/1769619712 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 >> 172.21.15.60:0/3281417669 conn(0x55c11f12d370 msgr2=0x55c11f171550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 shutdown_connections 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 1 -- 172.21.15.60:0/3281417669 wait complete. 2023-10-08T16:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.572+0000 7f49a4316b80 20 client.5496 trim_cache size 0 max 16384 2023-10-08T16:06:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.589+0000 7f49a4316b80 1 Processor -- start 2023-10-08T16:06:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.589+0000 7f49a4316b80 1 -- start start 2023-10-08T16:06:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12d370 0x55c11f12eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f1848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 0x55c11f128640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49a4316b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f12ea60 con 0x55c11f154f60 2023-10-08T16:06:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f129cd0 con 0x55c11f12ba50 2023-10-08T16:06:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c11f10b510 con 0x55c11f12d370 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 0x55c11f128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 0x55c11f128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35016/0 (socket says 172.21.15.60:35016) 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 -- 172.21.15.60:0/1663019780 learned_addr learned my addr 172.21.15.60:0/1663019780 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 -- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12d370 msgr2=0x55c11f12eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12d370 0x55c11f12eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f4993fff700 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f1848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 -- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 msgr2=0x55c11f1848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.590+0000 7f49995bb700 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f1848f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49995bb700 1 -- 172.21.15.60:0/1663019780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c11f04a780 con 0x55c11f154f60 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49995bb700 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 0x55c11f128640 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4994071210 tx=0x7f4984009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7688cf23458ccc98 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f497a7fc700 1 -- 172.21.15.60:0/1663019780 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984015410 con 0x55c11f154f60 2023-10-08T16:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f497a7fc700 1 -- 172.21.15.60:0/1663019780 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498400d070 con 0x55c11f154f60 2023-10-08T16:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f497a7fc700 1 -- 172.21.15.60:0/1663019780 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840157c0 con 0x55c11f154f60 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 -- 172.21.15.60:0/1663019780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 msgr2=0x55c11f128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 0x55c11f128640 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4994071210 tx=0x7f4984009040 comp rx=0 tx=0).stop 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 -- 172.21.15.60:0/1663019780 shutdown_connections 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12d370 0x55c11f12eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f154f60 0x55c11f128640 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 --2- 172.21.15.60:0/1663019780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f12ba50 0x55c11f1848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 -- 172.21.15.60:0/1663019780 >> 172.21.15.60:0/1663019780 conn(0x55c11f12afa0 msgr2=0x55c11f1244b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 -- 172.21.15.60:0/1663019780 shutdown_connections 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.591+0000 7f49a4316b80 1 -- 172.21.15.60:0/1663019780 wait complete. 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.592+0000 7f49a4316b80 1 -- start start 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.592+0000 7f49a4316b80 1 Processor -- start 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12ba50 0x55c11f1db940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 0x55c11f128540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f128a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f168690 con 0x55c11f12d370 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c11f1d9de0 con 0x55c11f154f60 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c11f1d8d90 con 0x55c11f12ba50 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49a4316b80 10 client.0 _ll_register_callbacks cb 0x55c11f0ef110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 0x55c11f128540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 0x55c11f128540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35024/0 (socket says 172.21.15.60:35024) 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 -- 172.21.15.60:0/322082480 learned_addr learned my addr 172.21.15.60:0/322082480 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4998dba700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12ba50 0x55c11f1db940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f49995bb700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 -- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12ba50 msgr2=0x55c11f1db940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12ba50 0x55c11f1db940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 -- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 msgr2=0x55c11f128a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f128a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 -- 172.21.15.60:0/322082480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940ca0b0 con 0x55c11f12d370 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4993fff700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 0x55c11f128540 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4988009ed0 tx=0x7f4988036040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdf4da9534a8dbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.593+0000 7f4972ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f4972ffd700 1 -- 172.21.15.60:0/322082480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988022040 con 0x55c11f12d370 2023-10-08T16:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f4972ffd700 1 -- 172.21.15.60:0/322082480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f498801ce40 con 0x55c11f12d370 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c11f12e370 con 0x55c11f12d370 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f4972ffd700 1 -- 172.21.15.60:0/322082480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4988011e70 con 0x55c11f12d370 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 10 client.5502 fetch_fsmap learned FSMap version 25 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c11f031470 con 0x55c11f12d370 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f4972ffd700 1 -- 172.21.15.60:0/322082480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c11f12e370 con 0x55c11f12d370 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f4972ffd700 1 -- 172.21.15.60:0/322082480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4988040900 con 0x55c11f12d370 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 10 client.5502 fetch_fsmap finished waiting for FSMap version 25 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 10 client.5502 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 20 client.5502 populate_metadata read hostname 'smithi060' 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f175d00 0x55c11f183590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 4 client.5502 mds_command: new command op to 5361 tid=0[{"prefix": "status"}] 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 --> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f498801c8e0 con 0x55c11f175d00 2023-10-08T16:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.594+0000 7f4998dba700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f175d00 0x55c11f183590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f4972ffd700 10 client.5502 ms_handle_connect on v2:172.21.15.144:6833/1769619712 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f4998dba700 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f175d00 0x55c11f183590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cdd00e16f570b89 server_cookie=86145154277fd35b in_seq=0 out_seq=0 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f4972ffd700 1 -- 172.21.15.60:0/322082480 <== mds.0 v2:172.21.15.144:6833/1769619712 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f498801c8e0 con 0x55c11f175d00 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f4972ffd700 10 client.5502 handle_command_reply: tid=0 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 client.5502 shutdown 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 msgr2=0x55c11f128540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 0x55c11f128540 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4988009ed0 tx=0x7f4988036040 comp rx=0 tx=0).stop 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 shutdown_connections 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:6833/1769619712,v1:172.21.15.144:6835/1769619712] conn(0x55c11f175d00 0x55c11f183590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c11f12ba50 0x55c11f1db940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c11f154f60 0x55c11f128a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f4972ffd700 0 client.5502 ms_handle_reset on v2:172.21.15.144:6833/1769619712 2023-10-08T16:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 --2- 172.21.15.60:0/322082480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c11f12d370 0x55c11f128540 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 >> 172.21.15.60:0/322082480 conn(0x55c11f12afa0 msgr2=0x55c11f12c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 shutdown_connections 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 1 -- 172.21.15.60:0/322082480 wait complete. 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.595+0000 7f49a4316b80 20 client.5502 trim_cache size 0 max 16384 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 5361, 2023-10-08T16:06:33.602 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 5.9018302519999999, 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 25, 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 46, 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 46, 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11.817799395 2023-10-08T16:06:33.603 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4980066f30 msgr2=0x7f49800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4980066f30 0x7f49800693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49880093f0 tx=0x7f4988016000 comp rx=0 tx=0).stop 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 msgr2=0x7f49941505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 0x7f49941505d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f498c00cbc0 tx=0x7f498c007d20 comp rx=0 tx=0).stop 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 shutdown_connections 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4980066f30 0x7f49800693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49941510f0 0x7f4994159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4994070700 0x7f49941505d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 --2- 172.21.15.60:0/1645575972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49940c9af0 0x7f499416e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 >> 172.21.15.60:0/1645575972 conn(0x7f49940ca4f0 msgr2=0x7f49940cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 shutdown_connections 2023-10-08T16:06:33.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.596+0000 7f499b01e700 1 -- 172.21.15.60:0/1645575972 wait complete. 2023-10-08T16:06:33.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:06:33.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.727+0000 7fa7d759e700 1 Processor -- start 2023-10-08T16:06:33.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.727+0000 7fa7d759e700 1 -- start start 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7d80cdab0 0x7fa7d815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d80cb7c0 con 0x7fa7d80cd6e0 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d759e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d815e290 con 0x7fa7d815dda0 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d815e850 con 0x7fa7d80cdab0 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7d80cdab0 0x7fa7d815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa7d80cd6e0 0x7fa7d80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43740/0 (socket says 172.21.15.60:43740) 2023-10-08T16:06:33.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d659c700 1 -- 172.21.15.60:0/1765503616 learned_addr learned my addr 172.21.15.60:0/1765503616 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/1765503616 >> v1:172.21.15.144:6789/0 conn(0x7fa7d815dda0 legacy=0x7fa7d815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/1765503616 >> v1:172.21.15.60:6789/0 conn(0x7fa7d80cd6e0 legacy=0x7fa7d80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/1765503616 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d815e570 con 0x7fa7d80cdab0 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d559a700 1 -- 172.21.15.60:0/1765503616 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838684833 0 0) 0x7fa7d80cb7c0 con 0x7fa7d80cd6e0 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d5d9b700 1 --2- 172.21.15.60:0/1765503616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d815d860 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e8fc87b893a500 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d559a700 1 -- 172.21.15.60:0/1765503616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0009e80 con 0x7fa7d80cdab0 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d559a700 1 -- 172.21.15.60:0/1765503616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000b860 con 0x7fa7d80cdab0 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.728+0000 7fa7d559a700 1 -- 172.21.15.60:0/1765503616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000bbe0 con 0x7fa7d80cdab0 2023-10-08T16:06:33.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 -- 172.21.15.60:0/1765503616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 msgr2=0x7fa7d815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 --2- 172.21.15.60:0/1765503616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d815d860 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 -- 172.21.15.60:0/1765503616 shutdown_connections 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 --2- 172.21.15.60:0/1765503616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d815d860 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 -- 172.21.15.60:0/1765503616 >> 172.21.15.60:0/1765503616 conn(0x7fa7d8067660 msgr2=0x7fa7d8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 -- 172.21.15.60:0/1765503616 shutdown_connections 2023-10-08T16:06:33.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.729+0000 7fa7d759e700 1 -- 172.21.15.60:0/1765503616 wait complete. 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.730+0000 7fa7d759e700 1 Processor -- start 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.730+0000 7fa7d759e700 1 -- start start 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d80cd6e0 0x7fa7d8151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d815dda0 0x7fa7d814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80cc360 con 0x7fa7d80cdab0 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80c7eb0 con 0x7fa7d815dda0 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8151560 con 0x7fa7d80cd6e0 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35052/0 (socket says 172.21.15.60:35052) 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/55194002 learned_addr learned my addr 172.21.15.60:0/55194002 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d6d9d700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d815dda0 0x7fa7d814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d659c700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d80cd6e0 0x7fa7d8151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d80cd6e0 msgr2=0x7fa7d8151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d80cd6e0 0x7fa7d8151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d815dda0 msgr2=0x7fa7d814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d815dda0 0x7fa7d814fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 -- 172.21.15.60:0/55194002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0009420 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.731+0000 7fa7d5d9b700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d814f580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00093f0 tx=0x7fa7c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.732+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c001f070 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.732+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000b9d0 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.732+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d80b4990 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.732+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0025670 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.732+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d80b4f50 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.733+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d8089280 con 0x7fa7d80cdab0 2023-10-08T16:06:33.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.733+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7c0023070 con 0x7fa7d80cdab0 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.733+0000 7fa7ce7fc700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7b8066f30 0x7fa7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.733+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7c0085c00 con 0x7fa7d80cdab0 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.733+0000 7fa7d659c700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7b8066f30 0x7fa7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:33.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.734+0000 7fa7d659c700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7b8066f30 0x7fa7b80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80011e0 tx=0x7fa7c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:33.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.738+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7c008c080 con 0x7fa7d80cdab0 2023-10-08T16:06:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.974+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7d80b52f0 con 0x7fa7d80cdab0 2023-10-08T16:06:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.974+0000 7fa7ce7fc700 1 -- 172.21.15.60:0/55194002 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa7c0015070 con 0x7fa7d80cdab0 2023-10-08T16:06:33.975 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:06:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7b8066f30 msgr2=0x7fa7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7b8066f30 0x7fa7b80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80011e0 tx=0x7fa7c8009040 comp rx=0 tx=0).stop 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 msgr2=0x7fa7d814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d814f580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00093f0 tx=0x7fa7c0017000 comp rx=0 tx=0).stop 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 shutdown_connections 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7b8066f30 0x7fa7b80693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d80cd6e0 0x7fa7d8151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d815dda0 0x7fa7d814fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 --2- 172.21.15.60:0/55194002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d80cdab0 0x7fa7d814f580 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 >> 172.21.15.60:0/55194002 conn(0x7fa7d8067660 msgr2=0x7fa7d80c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 shutdown_connections 2023-10-08T16:06:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:33.976+0000 7fa7d759e700 1 -- 172.21.15.60:0/55194002 wait complete. 2023-10-08T16:06:33.988 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:06:33.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:06:33.988 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:06:33.988 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:06:33.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:33.989 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:06:33.989 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:06:33.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:06:33.989 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:33.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:33.989 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:06:34.004 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:34.004 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:06:34.005 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:34.006 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:06:34.007 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:34.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:34.008 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:06:34.068 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:06:34.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:34.070 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:06:34.126 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:06:34.127 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:06:34.127 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:06:34.127 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:06:34.127 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:06:34.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:34.127 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:06:34.127 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:06:34.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:06:34.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:06:34.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:06:34.128 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:06:34.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:34.229 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:06:34.243 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:06:34.244 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:06:34.244 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:34.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:34.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:06:34.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:34.310 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:34.365 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:06:34.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:34.365 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:34.419 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:06:34.419 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:06:34.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:34.500 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:34.500 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:34.519 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:34.519 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:34.520 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:34.520 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:34.520 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:34.520 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:34.520 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:34.520 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:06:34.542 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:06:34.544 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:06:34.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:34.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:34.610 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:06:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.770+0000 7fa8db86b700 1 Processor -- start 2023-10-08T16:06:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.770+0000 7fa8db86b700 1 -- start start 2023-10-08T16:06:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8db86b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d40b3430 0x7fa8d4164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8db86b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d415db80 con 0x7fa8d415a1e0 2023-10-08T16:06:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8db86b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d415de60 con 0x7fa8d4159e10 2023-10-08T16:06:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8db86b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415e800 con 0x7fa8d40b3430 2023-10-08T16:06:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8d8e06700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8d415a1e0 0x7fa8d40cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43756/0 (socket says 172.21.15.60:43756) 2023-10-08T16:06:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8d8e06700 1 -- 172.21.15.60:0/2285069559 learned_addr learned my addr 172.21.15.60:0/2285069559 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.771+0000 7fa8d9e08700 1 --2- 172.21.15.60:0/2285069559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d40b3430 0x7fa8d4164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236216474 0 0) 0x7fa8d415db80 con 0x7fa8d415a1e0 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc003570 con 0x7fa8d415a1e0 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842905000 0 0) 0x7fa8d415de60 con 0x7fa8d4159e10 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d415db80 con 0x7fa8d4159e10 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d9e08700 1 -- 172.21.15.60:0/2285069559 >> v1:172.21.15.144:6789/0 conn(0x7fa8d4159e10 legacy=0x7fa8d40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d9e08700 1 -- 172.21.15.60:0/2285069559 >> v1:172.21.15.60:6789/0 conn(0x7fa8d415a1e0 legacy=0x7fa8d40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d9e08700 1 -- 172.21.15.60:0/2285069559 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d415e140 con 0x7fa8d40b3430 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d9e08700 1 --2- 172.21.15.60:0/2285069559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d40b3430 0x7fa8d4164e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009e90 tx=0x7fa8c4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1cc22d15ad70f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400e070 con 0x7fa8d40b3430 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c400bb80 con 0x7fa8d40b3430 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.772+0000 7fa8d3fff700 1 -- 172.21.15.60:0/2285069559 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4012430 con 0x7fa8d40b3430 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 -- 172.21.15.60:0/2285069559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d40b3430 msgr2=0x7fa8d4164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2285069559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d40b3430 0x7fa8d4164e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009e90 tx=0x7fa8c4009780 comp rx=0 tx=0).stop 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 -- 172.21.15.60:0/2285069559 shutdown_connections 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2285069559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d40b3430 0x7fa8d4164e20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 -- 172.21.15.60:0/2285069559 >> 172.21.15.60:0/2285069559 conn(0x7fa8d4067660 msgr2=0x7fa8d4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 -- 172.21.15.60:0/2285069559 shutdown_connections 2023-10-08T16:06:34.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.773+0000 7fa8db86b700 1 -- 172.21.15.60:0/2285069559 wait complete. 2023-10-08T16:06:34.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.774+0000 7fa8db86b700 1 Processor -- start 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.774+0000 7fa8db86b700 1 -- start start 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8db86b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40b3430 0x7fa8d40c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8db86b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 0x7fa8d40c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8db86b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d415a1e0 0x7fa8d40c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8db86b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40c7600 con 0x7fa8d4159e10 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8db86b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d416c1e0 con 0x7fa8d40b3430 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8db86b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d416c4c0 con 0x7fa8d415a1e0 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 0x7fa8d40c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 0x7fa8d40c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35054/0 (socket says 172.21.15.60:35054) 2023-10-08T16:06:34.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 -- 172.21.15.60:0/2247278072 learned_addr learned my addr 172.21.15.60:0/2247278072 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d9e08700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d415a1e0 0x7fa8d40c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d9607700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40b3430 0x7fa8d40c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 -- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d415a1e0 msgr2=0x7fa8d40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d415a1e0 0x7fa8d40c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 -- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40b3430 msgr2=0x7fa8d40c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40b3430 0x7fa8d40c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 -- 172.21.15.60:0/2247278072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4009a20 con 0x7fa8d4159e10 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d9e08700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d415a1e0 0x7fa8d40c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d9607700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40b3430 0x7fa8d40c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.775+0000 7fa8d8e06700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 0x7fa8d40c8660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80058d0 tx=0x7fa8c8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.776+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8005b30 con 0x7fa8d4159e10 2023-10-08T16:06:34.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.776+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8005c90 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.776+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d416c7a0 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.776+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80072e0 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.776+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d416cd60 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.776+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d40caf90 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.777+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8c8007690 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.777+0000 7fa8d17fa700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8c0066f30 0x7fa8c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.777+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8c8083930 con 0x7fa8d4159e10 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.777+0000 7fa8d9607700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8c0066f30 0x7fa8c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:34.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.778+0000 7fa8d9607700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8c0066f30 0x7fa8c00693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007fd0 tx=0x7fa8cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:34.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:34.782+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8c804b5a0 con 0x7fa8d4159e10 2023-10-08T16:06:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.022+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8d416cf80 con 0x7fa8d4159e10 2023-10-08T16:06:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.022+0000 7fa8d17fa700 1 -- 172.21.15.60:0/2247278072 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa8c8017020 con 0x7fa8d4159e10 2023-10-08T16:06:35.022 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8c0066f30 msgr2=0x7fa8c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8c0066f30 0x7fa8c00693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007fd0 tx=0x7fa8cc009040 comp rx=0 tx=0).stop 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 msgr2=0x7fa8d40c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 0x7fa8d40c8660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80058d0 tx=0x7fa8c8007e10 comp rx=0 tx=0).stop 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 shutdown_connections 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8c0066f30 0x7fa8c00693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8d415a1e0 0x7fa8d40c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40b3430 0x7fa8d40c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 --2- 172.21.15.60:0/2247278072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8d4159e10 0x7fa8d40c8660 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 >> 172.21.15.60:0/2247278072 conn(0x7fa8d4067660 msgr2=0x7fa8d4159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:35.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 shutdown_connections 2023-10-08T16:06:35.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.024+0000 7fa8db86b700 1 -- 172.21.15.60:0/2247278072 wait complete. 2023-10-08T16:06:35.036 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:06:35.037 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:06:35.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.037 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:06:35.055 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:06:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:06:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:06:35.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.059 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:06:35.124 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:06:35.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.126 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:06:35.185 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:06:35.185 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:06:35.185 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:06:35.185 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:06:35.185 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:06:35.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.186 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:06:35.186 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:06:35.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:06:35.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:06:35.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:06:35.186 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:06:35.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.291 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:06:35.306 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:06:35.306 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:06:35.306 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:06:35.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.307 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:06:35.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:35.371 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:35.426 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:06:35.426 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:06:35.427 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:35.480 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:06:35.480 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:06:35.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:35.560 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:35.560 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:35.579 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:35.580 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:35.601 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:06:35.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:06:35.604 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:06:35.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:35.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:35.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.795+0000 7fcf96933700 1 Processor -- start 2023-10-08T16:06:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.795+0000 7fcf96933700 1 -- start start 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96933700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf900d0970 0x7fcf9015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96933700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf90153e50 0x7fcf90154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96933700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900cf0c0 con 0x7fcf9015aea0 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96933700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9015e8f0 con 0x7fcf90153e50 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96933700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015b340 con 0x7fcf900d0970 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf90153e50 0x7fcf90154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf90153e50 0x7fcf90154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35056/0 (socket says 172.21.15.60:35056) 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 -- 172.21.15.60:0/3135671859 learned_addr learned my addr 172.21.15.60:0/3135671859 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf95931700 1 --2- 172.21.15.60:0/3135671859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf900d0970 0x7fcf9015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 -- 172.21.15.60:0/3135671859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf900d0970 msgr2=0x7fcf9015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 --2- 172.21.15.60:0/3135671859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf900d0970 0x7fcf9015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 -- 172.21.15.60:0/3135671859 >> v1:172.21.15.144:6789/0 conn(0x7fcf9015aea0 legacy=0x7fcf900d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.796+0000 7fcf96132700 1 -- 172.21.15.60:0/3135671859 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9015e050 con 0x7fcf90153e50 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96132700 1 --2- 172.21.15.60:0/3135671859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf90154280 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcf880099b0 tx=0x7fcf88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbd6f25f4a2f117 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf9492f700 1 -- 172.21.15.60:0/3135671859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88009ea0 con 0x7fcf90153e50 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf9492f700 1 -- 172.21.15.60:0/3135671859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8800b860 con 0x7fcf90153e50 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf9492f700 1 -- 172.21.15.60:0/3135671859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8800bc00 con 0x7fcf90153e50 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 -- 172.21.15.60:0/3135671859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 msgr2=0x7fcf90154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 --2- 172.21.15.60:0/3135671859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf90154280 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcf880099b0 tx=0x7fcf88009250 comp rx=0 tx=0).stop 2023-10-08T16:06:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 -- 172.21.15.60:0/3135671859 shutdown_connections 2023-10-08T16:06:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 --2- 172.21.15.60:0/3135671859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf90154280 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 --2- 172.21.15.60:0/3135671859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf900d0970 0x7fcf9015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 -- 172.21.15.60:0/3135671859 >> 172.21.15.60:0/3135671859 conn(0x7fcf90068c00 msgr2=0x7fcf90069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 -- 172.21.15.60:0/3135671859 shutdown_connections 2023-10-08T16:06:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.797+0000 7fcf96933700 1 -- 172.21.15.60:0/3135671859 wait complete. 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.798+0000 7fcf96933700 1 Processor -- start 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.798+0000 7fcf96933700 1 -- start start 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96933700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf900d0970 0x7fcf9014aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96933700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf900b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96933700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9015aea0 0x7fcf900b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96933700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90169f00 con 0x7fcf90153e50 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96933700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9016a1e0 con 0x7fcf900d0970 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96933700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9016a4c0 con 0x7fcf9015aea0 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf95130700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf900b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf95130700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf900b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35068/0 (socket says 172.21.15.60:35068) 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf95130700 1 -- 172.21.15.60:0/2256528216 learned_addr learned my addr 172.21.15.60:0/2256528216 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf96132700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9015aea0 0x7fcf900b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.799+0000 7fcf95931700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf900d0970 0x7fcf9014aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf95130700 1 -- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9015aea0 msgr2=0x7fcf900b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf95130700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9015aea0 0x7fcf900b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf95130700 1 -- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf900d0970 msgr2=0x7fcf9014aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf95130700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf900d0970 0x7fcf9014aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf95130700 1 -- 172.21.15.60:0/2256528216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880094f0 con 0x7fcf90153e50 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf95130700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf900b1fe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c4e0 tx=0x7fcf8400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84011590 con 0x7fcf90153e50 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84011710 con 0x7fcf90153e50 2023-10-08T16:06:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84011ad0 con 0x7fcf90153e50 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9016a7a0 con 0x7fcf90153e50 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.800+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9014b000 con 0x7fcf90153e50 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.801+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf90089290 con 0x7fcf90153e50 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.801+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf8401b3b0 con 0x7fcf90153e50 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.802+0000 7fcf8dffb700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf7c066f30 0x7fcf7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.802+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf840838c0 con 0x7fcf90153e50 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.802+0000 7fcf95931700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf7c066f30 0x7fcf7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.802+0000 7fcf95931700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf7c066f30 0x7fcf7c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000f570 tx=0x7fcf8000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:35.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:35.806+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf84050b30 con 0x7fcf90153e50 2023-10-08T16:06:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.044+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf9016aca0 con 0x7fcf90153e50 2023-10-08T16:06:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.045+0000 7fcf8dffb700 1 -- 172.21.15.60:0/2256528216 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fcf84017070 con 0x7fcf90153e50 2023-10-08T16:06:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:36.052 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:06:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf7c066f30 msgr2=0x7fcf7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf7c066f30 0x7fcf7c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000f570 tx=0x7fcf8000b040 comp rx=0 tx=0).stop 2023-10-08T16:06:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 msgr2=0x7fcf900b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf900b1fe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c4e0 tx=0x7fcf8400c7f0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 shutdown_connections 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf7c066f30 0x7fcf7c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9015aea0 0x7fcf900b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf900d0970 0x7fcf9014aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 --2- 172.21.15.60:0/2256528216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf90153e50 0x7fcf900b1fe0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 >> 172.21.15.60:0/2256528216 conn(0x7fcf90068c00 msgr2=0x7fcf900b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 shutdown_connections 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:36.047+0000 7fcf96933700 1 -- 172.21.15.60:0/2256528216 wait complete. 2023-10-08T16:06:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:06:36.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-08T16:06:36.193 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":5361,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4898294740000004,"mdsmap_epoch":25,"osdmap_epoch":46,"osdmap_epoch_barrier":46,"uptime":14.405800424000001} 2023-10-08T16:06:36.193 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 5361, "mdsmap_epoch": 25, "osdmap_epoch": 46, "osdmap_epoch_barrier": 46, "rank_uptime": 8.489829474, "state": "up:active", "uptime": 14.405800424, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:06:36.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:06:36.328 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:06:36.370 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:06:36.370 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-08T16:06:36.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:36.370 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-08T16:06:37.767 INFO:teuthology.orchestra.run.smithi060.stderr:265+0 records in 2023-10-08T16:06:37.767 INFO:teuthology.orchestra.run.smithi060.stderr:265+0 records out 2023-10-08T16:06:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.37834 s, 202 MB/s 2023-10-08T16:06:37.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:37.769 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-08T16:06:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:292+0 records in 2023-10-08T16:06:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:292+0 records out 2023-10-08T16:06:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.52567 s, 201 MB/s 2023-10-08T16:06:39.312 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-08T16:06:39.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.430+0000 7f7bfc9fe700 1 Processor -- start 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.430+0000 7f7bfc9fe700 1 -- start start 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.431+0000 7f7bfc9fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 0x7f7bf80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.431+0000 7f7bfc9fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 0x7f7bf80b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.431+0000 7f7bfc9fe700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf80cf2e0 con 0x7f7bf8159be0 2023-10-08T16:06:39.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.431+0000 7f7bfc9fe700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80701f0 con 0x7f7bf8159fb0 2023-10-08T16:06:39.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.431+0000 7f7bfc9fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8067800 con 0x7f7bf80cee90 2023-10-08T16:06:39.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 0x7f7bf80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 0x7f7bf80b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 0x7f7bf80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:44606/0 (socket says 172.21.15.60:44606) 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 0x7f7bf80b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:53004/0 (socket says 172.21.15.60:53004) 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf659c700 1 -- 172.21.15.60:0/3861350782 learned_addr learned my addr 172.21.15.60:0/3861350782 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf6d9d700 1 --1- 172.21.15.60:0/3861350782 >> v1:172.21.15.144:6789/0 conn(0x7f7bf8159be0 0x7f7bf8068db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:42092/0 (socket says 172.21.15.60:42092) 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 -- 172.21.15.60:0/3861350782 >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 msgr2=0x7f7bf80ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 --2- 172.21.15.60:0/3861350782 >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 0x7f7bf80ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 -- 172.21.15.60:0/3861350782 >> v1:172.21.15.144:6789/0 conn(0x7f7bf8159be0 legacy=0x7f7bf8068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 -- 172.21.15.60:0/3861350782 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8067ae0 con 0x7f7bf80cee90 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf659c700 1 --2- 172.21.15.60:0/3861350782 >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 0x7f7bf80ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf759e700 1 --2- 172.21.15.60:0/3861350782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 0x7f7bf80b3c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009e60 tx=0x7f7be8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efb39f18346bc55 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf5d9b700 1 -- 172.21.15.60:0/3861350782 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800e070 con 0x7f7bf80cee90 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf5d9b700 1 -- 172.21.15.60:0/3861350782 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800bb60 con 0x7f7bf80cee90 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.432+0000 7f7bf5d9b700 1 -- 172.21.15.60:0/3861350782 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8012430 con 0x7f7bf80cee90 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3861350782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 msgr2=0x7f7bf80b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3861350782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 0x7f7bf80b3c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009e60 tx=0x7f7be8009780 comp rx=0 tx=0).stop 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3861350782 shutdown_connections 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3861350782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf80cee90 0x7f7bf80b3c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3861350782 >> v2:172.21.15.144:3300/0 conn(0x7f7bf8159fb0 0x7f7bf80ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3861350782 >> 172.21.15.60:0/3861350782 conn(0x7f7bf806bc70 msgr2=0x7f7bf806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3861350782 shutdown_connections 2023-10-08T16:06:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.433+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3861350782 wait complete. 2023-10-08T16:06:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.434+0000 7f7bfc9fe700 1 Processor -- start 2023-10-08T16:06:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.434+0000 7f7bfc9fe700 1 -- start start 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bfc9fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 0x7f7bf80c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bfc9fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bf8159be0 0x7f7bf80c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bfc9fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf8159fb0 0x7f7bf80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bfc9fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80c7fc0 con 0x7f7bf80cee90 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bfc9fe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80c73b0 con 0x7f7bf8159be0 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bfc9fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80c7690 con 0x7f7bf8159fb0 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 0x7f7bf80c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 0x7f7bf80c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35078/0 (socket says 172.21.15.60:35078) 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 -- 172.21.15.60:0/3117966413 learned_addr learned my addr 172.21.15.60:0/3117966413 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf659c700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bf8159be0 0x7f7bf80c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf759e700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf8159fb0 0x7f7bf80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 -- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf8159fb0 msgr2=0x7f7bf80ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf8159fb0 0x7f7bf80ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 -- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bf8159be0 msgr2=0x7f7bf80c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bf8159be0 0x7f7bf80c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf6d9d700 1 -- 172.21.15.60:0/3117966413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00094f0 con 0x7f7bf80cee90 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.435+0000 7f7bf659c700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bf8159be0 0x7f7bf80c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.436+0000 7f7bf6d9d700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 0x7f7bf80c6cf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000c7c0 tx=0x7f7bf0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.436+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0005a70 con 0x7f7bf80cee90 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.436+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf0005bf0 con 0x7f7bf80cee90 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.436+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be8009a20 con 0x7f7bf80cee90 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.436+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00070f0 con 0x7f7bf80cee90 2023-10-08T16:06:39.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.436+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf80c7c50 con 0x7f7bf80cee90 2023-10-08T16:06:39.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.437+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf80c82a0 con 0x7f7bf80cee90 2023-10-08T16:06:39.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.437+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bf0007460 con 0x7f7bf80cee90 2023-10-08T16:06:39.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.438+0000 7f7beeffd700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bd8066f30 0x7f7bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:39.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.438+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bf0083fd0 con 0x7f7bf80cee90 2023-10-08T16:06:39.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.438+0000 7f7bf659c700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bd8066f30 0x7f7bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:39.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.438+0000 7f7bf659c700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bd8066f30 0x7f7bd80693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7be0006d40 tx=0x7f7be0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:39.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.442+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bf00512c0 con 0x7f7bf80cee90 2023-10-08T16:06:39.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.636+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7bf804bb80 con 0x7f7bf80cee90 2023-10-08T16:06:39.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.637+0000 7f7beeffd700 1 -- 172.21.15.60:0/3117966413 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f7bf0064e20 con 0x7f7bf80cee90 2023-10-08T16:06:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:39.637 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 46, 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:28.693707+0000", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "16", 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "45", 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "46", 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:39.721 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:39.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bd8066f30 msgr2=0x7f7bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bd8066f30 0x7f7bd80693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7be0006d40 tx=0x7f7be0008040 comp rx=0 tx=0).stop 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 msgr2=0x7f7bf80c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 0x7f7bf80c6cf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000c7c0 tx=0x7f7bf0007f70 comp rx=0 tx=0).stop 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 shutdown_connections 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bd8066f30 0x7f7bd80693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bf8159fb0 0x7f7bf80ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bf80cee90 0x7f7bf80c6cf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 --2- 172.21.15.60:0/3117966413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bf8159be0 0x7f7bf80c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 >> 172.21.15.60:0/3117966413 conn(0x7f7bf806bc70 msgr2=0x7f7bf80cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 shutdown_connections 2023-10-08T16:06:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:39.639+0000 7f7bfc9fe700 1 -- 172.21.15.60:0/3117966413 wait complete. 2023-10-08T16:06:39.724 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:06:41.304 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:06:41.303+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-08T16:06:44.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:44.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.857+0000 7f0b5d26e700 1 Processor -- start 2023-10-08T16:06:44.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.857+0000 7f0b5d26e700 1 -- start start 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.858+0000 7f0b5d26e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 0x7f0b58158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.858+0000 7f0b5d26e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5815cbb0 con 0x7f0b58157870 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.858+0000 7f0b5d26e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5815bfa0 con 0x7f0b5815a620 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.858+0000 7f0b5d26e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5815bdb0 con 0x7f0b58157c40 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.858+0000 7f0b56ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0b58157870 0x7f0b5815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59512/0 (socket says 172.21.15.60:59512) 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.858+0000 7f0b56ffd700 1 -- 172.21.15.60:0/1285891582 learned_addr learned my addr 172.21.15.60:0/1285891582 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b577fe700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 0x7f0b58158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631344784 0 0) 0x7f0b5815cbb0 con 0x7f0b58157870 2023-10-08T16:06:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b44003570 con 0x7f0b58157870 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754148224 0 0) 0x7f0b44003570 con 0x7f0b58157870 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 msgr2=0x7f0b58158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 0x7f0b58158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 >> v1:172.21.15.144:6789/0 conn(0x7f0b5815a620 legacy=0x7f0b5815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5815c280 con 0x7f0b58157870 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f0b480017f0 con 0x7f0b58157870 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 >> v1:172.21.15.60:6789/0 conn(0x7f0b58157870 legacy=0x7f0b5815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44003a90 0x7f0b44003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b44004810 0x7f0b44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 0x7f0b440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400bb10 con 0x7f0b44004810 2023-10-08T16:06:44.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400bc50 con 0x7f0b44003a90 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400be10 con 0x7f0b58157c40 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b567fc700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b44004810 0x7f0b44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b56ffd700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44003a90 0x7f0b44003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.859+0000 7f0b577fe700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 0x7f0b440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b567fc700 1 -- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 msgr2=0x7f0b440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b567fc700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58157c40 0x7f0b440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b567fc700 1 -- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44003a90 msgr2=0x7f0b44003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b567fc700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44003a90 0x7f0b44003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b567fc700 1 -- 172.21.15.60:0/1285891582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44003570 con 0x7f0b44004810 2023-10-08T16:06:44.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b567fc700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b44004810 0x7f0b44004c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0b40001970 tx=0x7f0b40007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8503d0fde70e75c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000c5d0 con 0x7f0b44004810 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000c750 con 0x7f0b44004810 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b55ffb700 1 -- 172.21.15.60:0/1285891582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000cb10 con 0x7f0b44004810 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b5d26e700 1 -- 172.21.15.60:0/1285891582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b44004810 msgr2=0x7f0b44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/1285891582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b44004810 0x7f0b44004c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0b40001970 tx=0x7f0b40007d10 comp rx=0 tx=0).stop 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.860+0000 7f0b577fe700 1 -- 172.21.15.60:0/1285891582 reap_dead start 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.861+0000 7f0b5d26e700 1 -- 172.21.15.60:0/1285891582 shutdown_connections 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.861+0000 7f0b5d26e700 1 -- 172.21.15.60:0/1285891582 >> 172.21.15.60:0/1285891582 conn(0x7f0b58068ce0 msgr2=0x7f0b580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.861+0000 7f0b5d26e700 1 -- 172.21.15.60:0/1285891582 shutdown_connections 2023-10-08T16:06:44.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.861+0000 7f0b5d26e700 1 -- 172.21.15.60:0/1285891582 wait complete. 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.862+0000 7f0b5d26e700 1 Processor -- start 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.862+0000 7f0b5d26e700 1 -- start start 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b5d26e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44004810 0x7f0b5814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b5d26e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 0x7f0b581389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b5d26e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58138ef0 0x7f0b580b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b5d26e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58139390 con 0x7f0b5814df60 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b5d26e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58152770 con 0x7f0b44004810 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b5d26e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58151b60 con 0x7f0b58138ef0 2023-10-08T16:06:44.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 0x7f0b581389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 0x7f0b581389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52836/0 (socket says 172.21.15.60:52836) 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 -- 172.21.15.60:0/52255161 learned_addr learned my addr 172.21.15.60:0/52255161 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b56ffd700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44004810 0x7f0b5814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b577fe700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58138ef0 0x7f0b580b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 -- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58138ef0 msgr2=0x7f0b580b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58138ef0 0x7f0b580b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 -- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44004810 msgr2=0x7f0b5814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44004810 0x7f0b5814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 -- 172.21.15.60:0/52255161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58151e40 con 0x7f0b5814df60 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b567fc700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 0x7f0b581389b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c3c0 tx=0x7f0b40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40007af0 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.863+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000c5d0 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.864+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b58152120 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.864+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000cb10 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.864+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b580b2af0 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.865+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b58152900 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.865+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b40019070 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.865+0000 7f0b4effd700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b38066f30 0x7f0b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.865+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b40085b90 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.865+0000 7f0b56ffd700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b38066f30 0x7f0b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.865+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f0b3806ea50 con 0x7f0b5814df60 2023-10-08T16:06:44.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.866+0000 7f0b56ffd700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b38066f30 0x7f0b380693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0b48001580 tx=0x7f0b48006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:44.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:44.870+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b40022020 con 0x7f0b5814df60 2023-10-08T16:06:45.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.065+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0b5804c3c0 con 0x7f0b5814df60 2023-10-08T16:06:45.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.066+0000 7f0b4effd700 1 -- 172.21.15.60:0/52255161 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7f0b40017070 con 0x7f0b5814df60 2023-10-08T16:06:45.067 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:45.067 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:45.067 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 49, 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:43.319336+0000", 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:45.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:45.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:45.070 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:45.071 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:45.072 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:45.073 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:45.075 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:45.076 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.077 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:45.078 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:45.079 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:45.080 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:45.081 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:45.082 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:45.083 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:45.084 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:45.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:45.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:45.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:45.089 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:45.090 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:45.090 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:45.090 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:45.090 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:45.090 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.092 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:45.094 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:45.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.096 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:45.101 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:45.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.105 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.107 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.109 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:45.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.117 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.124 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.130 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:45.131 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:45.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:45.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.137 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:45.138 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.141 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.143 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.144 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.145 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:45.145 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.145 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.145 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.146 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.146 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.146 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.146 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.146 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.147 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.147 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.147 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.147 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.148 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:45.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:45.151 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.153 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:45.155 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.156 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.157 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.158 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:06:45.160 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.161 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.162 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b38066f30 msgr2=0x7f0b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b38066f30 0x7f0b380693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0b48001580 tx=0x7f0b48006040 comp rx=0 tx=0).stop 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 msgr2=0x7f0b581389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 0x7f0b581389b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c3c0 tx=0x7f0b40015000 comp rx=0 tx=0).stop 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 shutdown_connections 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b38066f30 0x7f0b380693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b58138ef0 0x7f0b580b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b44004810 0x7f0b5814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 --2- 172.21.15.60:0/52255161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b5814df60 0x7f0b581389b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 >> 172.21.15.60:0/52255161 conn(0x7f0b58068ce0 msgr2=0x7f0b580d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 shutdown_connections 2023-10-08T16:06:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.068+0000 7f0b5d26e700 1 -- 172.21.15.60:0/52255161 wait complete. 2023-10-08T16:06:45.165 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-08T16:06:45.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:45.166 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-08T16:06:45.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:06:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-08T16:06:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:06:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:06:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.233669 s, 224 MB/s 2023-10-08T16:06:45.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:45.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.539+0000 7fda51ecc700 1 Processor -- start 2023-10-08T16:06:45.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.539+0000 7fda51ecc700 1 -- start start 2023-10-08T16:06:45.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda51ecc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 0x7fda4c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda51ecc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 0x7fda4c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda51ecc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4c15cbb0 con 0x7fda4c157870 2023-10-08T16:06:45.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda51ecc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4c15bdb0 con 0x7fda4c15d580 2023-10-08T16:06:45.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda51ecc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c15bfa0 con 0x7fda4c15a620 2023-10-08T16:06:45.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 0x7fda4c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 0x7fda4c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 0x7fda4c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:57752/0 (socket says 172.21.15.60:57752) 2023-10-08T16:06:45.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4b7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fda4c157870 0x7fda4c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:59696/0 (socket says 172.21.15.60:59696) 2023-10-08T16:06:45.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 -- 172.21.15.60:0/2046986049 learned_addr learned my addr 172.21.15.60:0/2046986049 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 0x7fda4c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:45296/0 (socket says 172.21.15.60:45296) 2023-10-08T16:06:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 -- 172.21.15.60:0/2046986049 >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 msgr2=0x7fda4c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 --2- 172.21.15.60:0/2046986049 >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 0x7fda4c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 -- 172.21.15.60:0/2046986049 >> v1:172.21.15.144:6789/0 conn(0x7fda4c157870 legacy=0x7fda4c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 -- 172.21.15.60:0/2046986049 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c15c280 con 0x7fda4c15a620 2023-10-08T16:06:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4bfff700 1 --2- 172.21.15.60:0/2046986049 >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 0x7fda4c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.540+0000 7fda4affd700 1 --2- 172.21.15.60:0/2046986049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 0x7fda4c15d040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0099b0 tx=0x7fda3c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8128885713b3537 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda4a7fc700 1 -- 172.21.15.60:0/2046986049 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c009ea0 con 0x7fda4c15a620 2023-10-08T16:06:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda4a7fc700 1 -- 172.21.15.60:0/2046986049 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c00b860 con 0x7fda4c15a620 2023-10-08T16:06:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda4a7fc700 1 -- 172.21.15.60:0/2046986049 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c00bc00 con 0x7fda4c15a620 2023-10-08T16:06:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 -- 172.21.15.60:0/2046986049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 msgr2=0x7fda4c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 --2- 172.21.15.60:0/2046986049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 0x7fda4c15d040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0099b0 tx=0x7fda3c009250 comp rx=0 tx=0).stop 2023-10-08T16:06:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 -- 172.21.15.60:0/2046986049 shutdown_connections 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 --2- 172.21.15.60:0/2046986049 >> v2:172.21.15.144:3300/0 conn(0x7fda4c15d580 0x7fda4c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 --2- 172.21.15.60:0/2046986049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15a620 0x7fda4c15d040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 -- 172.21.15.60:0/2046986049 >> 172.21.15.60:0/2046986049 conn(0x7fda4c068ce0 msgr2=0x7fda4c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 -- 172.21.15.60:0/2046986049 shutdown_connections 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.541+0000 7fda51ecc700 1 -- 172.21.15.60:0/2046986049 wait complete. 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.542+0000 7fda51ecc700 1 Processor -- start 2023-10-08T16:06:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 -- start start 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4c157870 0x7fda4c0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 0x7fda4c0cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15d580 0x7fda4c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0cb930 con 0x7fda4c15a620 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0cd620 con 0x7fda4c157870 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda51ecc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0c6d50 con 0x7fda4c15d580 2023-10-08T16:06:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda4affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 0x7fda4c0cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda4affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 0x7fda4c0cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52842/0 (socket says 172.21.15.60:52842) 2023-10-08T16:06:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.543+0000 7fda4affd700 1 -- 172.21.15.60:0/1594077066 learned_addr learned my addr 172.21.15.60:0/1594077066 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4bfff700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15d580 0x7fda4c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4b7fe700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4c157870 0x7fda4c0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4affd700 1 -- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15d580 msgr2=0x7fda4c0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4affd700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15d580 0x7fda4c0c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4affd700 1 -- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4c157870 msgr2=0x7fda4c0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4affd700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4c157870 0x7fda4c0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4affd700 1 -- 172.21.15.60:0/1594077066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44009a20 con 0x7fda4c15a620 2023-10-08T16:06:45.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4b7fe700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4c157870 0x7fda4c0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:45.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda4affd700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 0x7fda4c0cd0e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fda4c15c0e0 tx=0x7fda3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:45.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c00bbe0 con 0x7fda4c15a620 2023-10-08T16:06:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c011420 con 0x7fda4c15a620 2023-10-08T16:06:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c0094f0 con 0x7fda4c15a620 2023-10-08T16:06:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0117c0 con 0x7fda4c15a620 2023-10-08T16:06:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.544+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c0ccc50 con 0x7fda4c15a620 2023-10-08T16:06:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.545+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4c0ccde0 con 0x7fda4c15a620 2023-10-08T16:06:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.546+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda3c011bb0 con 0x7fda4c15a620 2023-10-08T16:06:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.546+0000 7fda337fe700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda38066f30 0x7fda380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.546+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda3c085f10 con 0x7fda4c15a620 2023-10-08T16:06:45.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.546+0000 7fda4b7fe700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda38066f30 0x7fda380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.546+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7fda3806ea50 con 0x7fda4c15a620 2023-10-08T16:06:45.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.546+0000 7fda4b7fe700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda38066f30 0x7fda380693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fda40007fd0 tx=0x7fda40007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:45.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.550+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda3c011e60 con 0x7fda4c15a620 2023-10-08T16:06:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.747+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fda4c04c3c0 con 0x7fda4c15a620 2023-10-08T16:06:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.748+0000 7fda337fe700 1 -- 172.21.15.60:0/1594077066 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fda3c015070 con 0x7fda4c15a620 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 49, 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:43.319336+0000", 2023-10-08T16:06:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:45.751 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:45.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:45.753 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:45.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:45.755 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:45.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:45.757 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:45.758 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:45.760 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:45.761 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:45.762 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:45.763 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.764 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:45.765 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:45.766 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:45.767 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:45.768 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:45.769 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:45.770 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:45.771 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:45.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.773 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.777 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.780 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:45.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:45.792 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.793 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.796 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:45.799 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.800 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:45.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.813 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.814 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:45.819 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:45.820 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:45.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:45.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:45.826 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.827 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:45.828 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.829 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:45.830 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.831 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.832 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:45.833 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:45.834 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:45.836 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:45.837 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:45.837 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:45.837 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:45.837 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:45.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:45.837 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda38066f30 msgr2=0x7fda380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda38066f30 0x7fda380693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fda40007fd0 tx=0x7fda40007e10 comp rx=0 tx=0).stop 2023-10-08T16:06:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 msgr2=0x7fda4c0cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 0x7fda4c0cd0e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fda4c15c0e0 tx=0x7fda3c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 shutdown_connections 2023-10-08T16:06:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda38066f30 0x7fda380693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda4c15d580 0x7fda4c0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda4c157870 0x7fda4c0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 --2- 172.21.15.60:0/1594077066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda4c15a620 0x7fda4c0cd0e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 >> 172.21.15.60:0/1594077066 conn(0x7fda4c068ce0 msgr2=0x7fda4c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 shutdown_connections 2023-10-08T16:06:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.750+0000 7fda51ecc700 1 -- 172.21.15.60:0/1594077066 wait complete. 2023-10-08T16:06:45.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.960+0000 7f97b863c700 1 Processor -- start 2023-10-08T16:06:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.960+0000 7f97b863c700 1 -- start start 2023-10-08T16:06:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b863c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f97b0159e10 0x7f97b00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b863c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b015a1e0 0x7f97b00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b863c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b015db80 con 0x7f97b00b1610 2023-10-08T16:06:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b863c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b015e800 con 0x7f97b0159e10 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b863c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b015de60 con 0x7f97b015a1e0 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b6bd9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f97b00b1610 0x7f97b00cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59514/0 (socket says 172.21.15.60:59514) 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b6bd9700 1 -- 172.21.15.60:0/760588182 learned_addr learned my addr 172.21.15.60:0/760588182 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b5bd7700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b015a1e0 0x7f97b00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b63d8700 1 --2- 172.21.15.60:0/760588182 >> v2:172.21.15.144:3300/0 conn(0x7f97b0159e10 0x7f97b00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.961+0000 7f97b53d6700 1 -- 172.21.15.60:0/760588182 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371054765 0 0) 0x7f97b015db80 con 0x7f97b00b1610 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b53d6700 1 -- 172.21.15.60:0/760588182 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9798003570 con 0x7f97b00b1610 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b63d8700 1 -- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b015a1e0 msgr2=0x7f97b00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b63d8700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b015a1e0 0x7f97b00b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b63d8700 1 -- 172.21.15.60:0/760588182 >> v1:172.21.15.60:6789/0 conn(0x7f97b00b1610 legacy=0x7f97b00cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b63d8700 1 -- 172.21.15.60:0/760588182 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b015e140 con 0x7f97b0159e10 2023-10-08T16:06:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b5bd7700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b015a1e0 0x7f97b00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b63d8700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00b2d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97a80098e0 tx=0x7f97a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be15ca9898fbab66 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b53d6700 1 -- 172.21.15.60:0/760588182 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8011630 con 0x7f97b0159e10 2023-10-08T16:06:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b53d6700 1 -- 172.21.15.60:0/760588182 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8011790 con 0x7f97b0159e10 2023-10-08T16:06:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.962+0000 7f97b53d6700 1 -- 172.21.15.60:0/760588182 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8011b30 con 0x7f97b0159e10 2023-10-08T16:06:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 -- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 msgr2=0x7f97b00b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00b2d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97a80098e0 tx=0x7f97a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 -- 172.21.15.60:0/760588182 shutdown_connections 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00b2d20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 --2- 172.21.15.60:0/760588182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b015a1e0 0x7f97b00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 -- 172.21.15.60:0/760588182 >> 172.21.15.60:0/760588182 conn(0x7f97b0067660 msgr2=0x7f97b0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 -- 172.21.15.60:0/760588182 shutdown_connections 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.963+0000 7f97b863c700 1 -- 172.21.15.60:0/760588182 wait complete. 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.964+0000 7f97b863c700 1 Processor -- start 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.964+0000 7f97b863c700 1 -- start start 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b863c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b00b1610 0x7f97b00ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b863c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b863c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 0x7f97b0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b863c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00c9cc0 con 0x7f97b015a1e0 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b863c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b016ad40 con 0x7f97b0159e10 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b863c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00c9390 con 0x7f97b00b1610 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 0x7f97b0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 0x7f97b0157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52850/0 (socket says 172.21.15.60:52850) 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 -- 172.21.15.60:0/1159250250 learned_addr learned my addr 172.21.15.60:0/1159250250 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b5bd7700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b63d8700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b00b1610 0x7f97b00ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 -- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b00b1610 msgr2=0x7f97b00ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b00b1610 0x7f97b00ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 -- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 msgr2=0x7f97b00d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 -- 172.21.15.60:0/1159250250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4009420 con 0x7f97b015a1e0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97b6bd9700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 0x7f97b0157cd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97a000cca0 tx=0x7f97a0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.965+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000a8d0 con 0x7f97b015a1e0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.966+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000aa30 con 0x7f97b015a1e0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.966+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a8009420 con 0x7f97b015a1e0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.966+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000adb0 con 0x7f97b015a1e0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.966+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b00c9950 con 0x7f97b015a1e0 2023-10-08T16:06:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.966+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b004c3c0 con 0x7f97b015a1e0 2023-10-08T16:06:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.967+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97a0007300 con 0x7f97b015a1e0 2023-10-08T16:06:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.967+0000 7f97ae7fc700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f979c066f30 0x7f979c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.967+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97a0084880 con 0x7f97b015a1e0 2023-10-08T16:06:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.967+0000 7f97b63d8700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f979c066f30 0x7f979c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.968+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f979c06ea50 con 0x7f97b015a1e0 2023-10-08T16:06:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.968+0000 7f97b63d8700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f979c066f30 0x7f979c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97a80091e0 tx=0x7f97a8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:45.971+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a0051b70 con 0x7f97b015a1e0 2023-10-08T16:06:46.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.210+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97b015e420 con 0x7f97b015a1e0 2023-10-08T16:06:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.211+0000 7f97ae7fc700 1 -- 172.21.15.60:0/1159250250 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f97a0055190 con 0x7f97b015a1e0 2023-10-08T16:06:46.212 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:46.212 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:06:46.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f979c066f30 msgr2=0x7f979c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f979c066f30 0x7f979c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97a80091e0 tx=0x7f97a8017000 comp rx=0 tx=0).stop 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 msgr2=0x7f97b0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 0x7f97b0157cd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97a000cca0 tx=0x7f97a0001ae0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 shutdown_connections 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f979c066f30 0x7f979c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97b00b1610 0x7f97b00ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97b015a1e0 0x7f97b0157cd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 --2- 172.21.15.60:0/1159250250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0159e10 0x7f97b00d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 >> 172.21.15.60:0/1159250250 conn(0x7f97b0067660 msgr2=0x7f97b00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 shutdown_connections 2023-10-08T16:06:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.213+0000 7f97b863c700 1 -- 172.21.15.60:0/1159250250 wait complete. 2023-10-08T16:06:46.216 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:06:46.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-08T16:06:46.373 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":5361,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.669014757999999,"mdsmap_epoch":25,"osdmap_epoch":49,"osdmap_epoch_barrier":49,"uptime":24.584986042000001} 2023-10-08T16:06:46.373 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 5361, "mdsmap_epoch": 25, "osdmap_epoch": 49, "osdmap_epoch_barrier": 49, "rank_uptime": 18.669014758, "state": "up:active", "uptime": 24.584986042, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:06:46.373 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:06:46.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:46.373 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T16:06:46.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:06:46.389 INFO:teuthology.orchestra.run.smithi060.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-08T16:06:46.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:46.390 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-08T16:06:46.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:46.446 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-08T16:06:46.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.664+0000 7fcd8104c700 1 Processor -- start 2023-10-08T16:06:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.664+0000 7fcd8104c700 1 -- start start 2023-10-08T16:06:46.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.664+0000 7fcd8104c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c159e10 0x7fcd7c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:46.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.664+0000 7fcd8104c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c15db80 con 0x7fcd7c15a1e0 2023-10-08T16:06:46.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.664+0000 7fcd8104c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c15de60 con 0x7fcd7c0cde50 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.664+0000 7fcd8104c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c15e800 con 0x7fcd7c159e10 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcd7c15a1e0 0x7fcd7c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59522/0 (socket says 172.21.15.60:59522) 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7a59c700 1 -- 172.21.15.60:0/807259651 learned_addr learned my addr 172.21.15.60:0/807259651 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7ad9d700 1 --2- 172.21.15.60:0/807259651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c159e10 0x7fcd7c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449564463 0 0) 0x7fcd7c15db80 con 0x7fcd7c15a1e0 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd68003570 con 0x7fcd7c15a1e0 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594599548 0 0) 0x7fcd7c15de60 con 0x7fcd7c0cde50 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd7c15db80 con 0x7fcd7c0cde50 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/807259651 >> v1:172.21.15.144:6789/0 conn(0x7fcd7c0cde50 legacy=0x7fcd7c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/807259651 >> v1:172.21.15.60:6789/0 conn(0x7fcd7c15a1e0 legacy=0x7fcd7c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/807259651 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c15e140 con 0x7fcd7c159e10 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd7ad9d700 1 --2- 172.21.15.60:0/807259651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c159e10 0x7fcd7c0b2d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009910 tx=0x7fcd6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b830538a78bacfa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:46.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c011630 con 0x7fcd7c159e10 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c011790 con 0x7fcd7c159e10 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.665+0000 7fcd79d9b700 1 -- 172.21.15.60:0/807259651 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c011b30 con 0x7fcd7c159e10 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 -- 172.21.15.60:0/807259651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c159e10 msgr2=0x7fcd7c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 --2- 172.21.15.60:0/807259651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c159e10 0x7fcd7c0b2d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009910 tx=0x7fcd6c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 -- 172.21.15.60:0/807259651 shutdown_connections 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 --2- 172.21.15.60:0/807259651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c159e10 0x7fcd7c0b2d20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 -- 172.21.15.60:0/807259651 >> 172.21.15.60:0/807259651 conn(0x7fcd7c067660 msgr2=0x7fcd7c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 -- 172.21.15.60:0/807259651 shutdown_connections 2023-10-08T16:06:46.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.666+0000 7fcd8104c700 1 -- 172.21.15.60:0/807259651 wait complete. 2023-10-08T16:06:46.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.667+0000 7fcd8104c700 1 Processor -- start 2023-10-08T16:06:46.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.667+0000 7fcd8104c700 1 -- start start 2023-10-08T16:06:46.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd8104c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 0x7fcd7c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd8104c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd7c159e10 0x7fcd7c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd8104c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c15a1e0 0x7fcd7c0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd8104c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c15b7f0 con 0x7fcd7c0cde50 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd8104c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c15c050 con 0x7fcd7c159e10 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd8104c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0ca1f0 con 0x7fcd7c15a1e0 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 0x7fcd7c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 0x7fcd7c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52854/0 (socket says 172.21.15.60:52854) 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/1956096612 learned_addr learned my addr 172.21.15.60:0/1956096612 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7b59e700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c15a1e0 0x7fcd7c0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7a59c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd7c159e10 0x7fcd7c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:46.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c15a1e0 msgr2=0x7fcd7c0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c15a1e0 0x7fcd7c0c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd7c159e10 msgr2=0x7fcd7c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd7c159e10 0x7fcd7c156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 -- 172.21.15.60:0/1956096612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009420 con 0x7fcd7c0cde50 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7a59c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd7c159e10 0x7fcd7c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.668+0000 7fcd7ad9d700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 0x7fcd7c0c4760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009f00 tx=0x7fcd6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.669+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c01f070 con 0x7fcd7c0cde50 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.669+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c000bc0 con 0x7fcd7c0cde50 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.669+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c15ba00 con 0x7fcd7c0cde50 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.669+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c025420 con 0x7fcd7c0cde50 2023-10-08T16:06:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.669+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0c4ca0 con 0x7fcd7c0cde50 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.670+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c04c3c0 con 0x7fcd7c0cde50 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.670+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd6c023070 con 0x7fcd7c0cde50 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.670+0000 7fcd72ffd700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.670+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd6c085840 con 0x7fcd7c0cde50 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.670+0000 7fcd7a59c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.671+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7fcd5c06ea50 con 0x7fcd7c0cde50 2023-10-08T16:06:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.671+0000 7fcd7a59c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd5c066f30 0x7fcd5c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcd640010e0 tx=0x7fcd64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:46.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.675+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd6c02a060 con 0x7fcd7c0cde50 2023-10-08T16:06:46.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.871+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcd7c15e420 con 0x7fcd7c0cde50 2023-10-08T16:06:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.872+0000 7fcd72ffd700 1 -- 172.21.15.60:0/1956096612 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fcd6c015020 con 0x7fcd7c0cde50 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 49, 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:43.319336+0000", 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:46.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:46.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:46.876 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:46.877 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:46.878 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:46.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:46.880 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:46.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:46.883 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:46.963 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd5c066f30 msgr2=0x7fcd5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd5c066f30 0x7fcd5c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcd640010e0 tx=0x7fcd64009040 comp rx=0 tx=0).stop 2023-10-08T16:06:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 msgr2=0x7fcd7c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 0x7fcd7c0c4760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009f00 tx=0x7fcd6c017000 comp rx=0 tx=0).stop 2023-10-08T16:06:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 shutdown_connections 2023-10-08T16:06:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7c15a1e0 0x7fcd7c0c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0cde50 0x7fcd7c0c4760 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 --2- 172.21.15.60:0/1956096612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd7c159e10 0x7fcd7c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 >> 172.21.15.60:0/1956096612 conn(0x7fcd7c067660 msgr2=0x7fcd7c1571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 shutdown_connections 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:46.874+0000 7fcd8104c700 1 -- 172.21.15.60:0/1956096612 wait complete. 2023-10-08T16:06:46.965 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:06:48.297 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:06:48.297+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-08T16:06:51.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.098+0000 7f47b78f2700 1 Processor -- start 2023-10-08T16:06:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.099+0000 7f47b78f2700 1 -- start start 2023-10-08T16:06:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.099+0000 7f47b78f2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f47b00cfe20 0x7f47b00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.099+0000 7f47b78f2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00c5d80 con 0x7f47b00d1c30 2023-10-08T16:06:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b78f2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00c6060 con 0x7f47b015a2b0 2023-10-08T16:06:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b78f2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b0068470 con 0x7f47b00cfe20 2023-10-08T16:06:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b4e8d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f47b00d1c30 0x7f47b00cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59526/0 (socket says 172.21.15.60:59526) 2023-10-08T16:06:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b4e8d700 1 -- 172.21.15.60:0/3112727176 learned_addr learned my addr 172.21.15.60:0/3112727176 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b5e8f700 1 --2- 172.21.15.60:0/3112727176 >> v2:172.21.15.144:3300/0 conn(0x7f47b00cfe20 0x7f47b00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47affff700 1 -- 172.21.15.60:0/3112727176 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061063932 0 0) 0x7f47b00c5d80 con 0x7f47b00d1c30 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47affff700 1 -- 172.21.15.60:0/3112727176 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4798003570 con 0x7f47b00d1c30 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b5e8f700 1 -- 172.21.15.60:0/3112727176 >> v1:172.21.15.144:6789/0 conn(0x7f47b015a2b0 legacy=0x7f47b00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47affff700 1 -- 172.21.15.60:0/3112727176 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4162160736 0 0) 0x7f4798003570 con 0x7f47b00d1c30 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b5e8f700 1 -- 172.21.15.60:0/3112727176 >> v1:172.21.15.60:6789/0 conn(0x7f47b00d1c30 legacy=0x7f47b00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b5e8f700 1 -- 172.21.15.60:0/3112727176 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00c6340 con 0x7f47b00cfe20 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.100+0000 7f47b5e8f700 1 --2- 172.21.15.60:0/3112727176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b00cfe20 0x7f47b00ccdd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47a80098e0 tx=0x7f47a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a58bfd6e7d3cc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47affff700 1 -- 172.21.15.60:0/3112727176 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4001470 con 0x7f47b00cfe20 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47affff700 1 -- 172.21.15.60:0/3112727176 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8011420 con 0x7f47b00cfe20 2023-10-08T16:06:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47affff700 1 -- 172.21.15.60:0/3112727176 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80117c0 con 0x7f47b00cfe20 2023-10-08T16:06:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 -- 172.21.15.60:0/3112727176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b00cfe20 msgr2=0x7f47b00ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 --2- 172.21.15.60:0/3112727176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b00cfe20 0x7f47b00ccdd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47a80098e0 tx=0x7f47a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 -- 172.21.15.60:0/3112727176 shutdown_connections 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 --2- 172.21.15.60:0/3112727176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b00cfe20 0x7f47b00ccdd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 -- 172.21.15.60:0/3112727176 >> 172.21.15.60:0/3112727176 conn(0x7f47b0067e40 msgr2=0x7f47b00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 -- 172.21.15.60:0/3112727176 shutdown_connections 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.101+0000 7f47b78f2700 1 -- 172.21.15.60:0/3112727176 wait complete. 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.102+0000 7f47b78f2700 1 Processor -- start 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.102+0000 7f47b78f2700 1 -- start start 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b78f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 0x7f47b00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b78f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47b00d1c30 0x7f47b015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b78f2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b015a2b0 0x7f47b0155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b78f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b015f2a0 con 0x7f47b00cfe20 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b78f2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b015a680 con 0x7f47b015a2b0 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b78f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00ca220 con 0x7f47b00d1c30 2023-10-08T16:06:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b568e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 0x7f47b00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b568e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 0x7f47b00c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52862/0 (socket says 172.21.15.60:52862) 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.103+0000 7f47b568e700 1 -- 172.21.15.60:0/2990663181 learned_addr learned my addr 172.21.15.60:0/2990663181 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b4e8d700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47b00d1c30 0x7f47b015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b5e8f700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b015a2b0 0x7f47b0155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b568e700 1 -- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47b00d1c30 msgr2=0x7f47b015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b568e700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47b00d1c30 0x7f47b015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b568e700 1 -- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b015a2b0 msgr2=0x7f47b0155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b568e700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b015a2b0 0x7f47b0155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b568e700 1 -- 172.21.15.60:0/2990663181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009420 con 0x7f47b00cfe20 2023-10-08T16:06:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b5e8f700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b015a2b0 0x7f47b0155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b4e8d700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47b00d1c30 0x7f47b015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b568e700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 0x7f47b00c9c10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f47a000cd50 tx=0x7f47a0001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000ab70 con 0x7f47b00cfe20 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000acf0 con 0x7f47b00cfe20 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b00ca500 con 0x7f47b00cfe20 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0012670 con 0x7f47b00cfe20 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.104+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00caac0 con 0x7f47b00cfe20 2023-10-08T16:06:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.105+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b015a8a0 con 0x7f47b00cfe20 2023-10-08T16:06:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.105+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47a0012a60 con 0x7f47b00cfe20 2023-10-08T16:06:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.106+0000 7f47ad7fa700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.106+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f47a0084d60 con 0x7f47b00cfe20 2023-10-08T16:06:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.106+0000 7f47b4e8d700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.106+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f479c06eb10 con 0x7f47b00cfe20 2023-10-08T16:06:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.106+0000 7f47b4e8d700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f479c066f30 0x7f479c0693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ca150 tx=0x7f47a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.110+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47b015a8a0 con 0x7f47b00cfe20 2023-10-08T16:06:52.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.315+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f47b004c3c0 con 0x7f47b00cfe20 2023-10-08T16:06:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.316+0000 7f47ad7fa700 1 -- 172.21.15.60:0/2990663181 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+32777 (secure 0 0 0) 0x7f47a0051f90 con 0x7f47b00cfe20 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 51, 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:51.356729+0000", 2023-10-08T16:06:52.318 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:52.319 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "luminous", 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:52.321 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:52.322 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:52.325 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:52.327 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:52.328 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:52.329 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:52.330 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:52.331 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:52.332 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:52.333 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:52.334 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.335 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "47", 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:52.336 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:52.337 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:52.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.340 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.341 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.351 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.352 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.353 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.355 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:52.359 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:52.361 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:52.365 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.366 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:52.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:52.373 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.378 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.379 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:52.384 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:52.385 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:52.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.393 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.395 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.396 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:52.397 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [ 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pgid": "7.9", 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "mappings": [ 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.398 INFO:teuthology.orchestra.run.smithi060.stdout: "from": 0, 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "to": 4 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "pgid": "7.2d", 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "mappings": [ 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "from": 0, 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "to": 5 2023-10-08T16:06:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:52.402 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f479c066f30 msgr2=0x7f479c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f479c066f30 0x7f479c0693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ca150 tx=0x7f47a4009040 comp rx=0 tx=0).stop 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 msgr2=0x7f47b00c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 0x7f47b00c9c10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f47a000cd50 tx=0x7f47a0001b80 comp rx=0 tx=0).stop 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 shutdown_connections 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b015a2b0 0x7f47b0155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47b00cfe20 0x7f47b00c9c10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 --2- 172.21.15.60:0/2990663181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47b00d1c30 0x7f47b015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 >> 172.21.15.60:0/2990663181 conn(0x7f47b0067e40 msgr2=0x7f47b00b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 shutdown_connections 2023-10-08T16:06:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:52.318+0000 7f47b78f2700 1 -- 172.21.15.60:0/2990663181 wait complete. 2023-10-08T16:06:52.405 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:06:53.298 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:06:53.298+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-08T16:06:56.424 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:06:56.423+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-10-08T16:06:57.406 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 Processor -- start 2023-10-08T16:06:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 -- start start 2023-10-08T16:06:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f47d415a2b0 0x7f47d40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47d40d1c30 0x7f47d40cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d40c5d80 con 0x7f47d415a680 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d4068470 con 0x7f47d40d1c30 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.540+0000 7f47d966b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d40c6060 con 0x7f47d415a2b0 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47d40d1c30 0x7f47d40cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47d40d1c30 0x7f47d40cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34578/0 (socket says 172.21.15.60:34578) 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 -- 172.21.15.60:0/3307573611 learned_addr learned my addr 172.21.15.60:0/3307573611 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d2ffd700 1 --2- 172.21.15.60:0/3307573611 >> v2:172.21.15.144:3300/0 conn(0x7f47d415a2b0 0x7f47d40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 -- 172.21.15.60:0/3307573611 >> v2:172.21.15.144:3300/0 conn(0x7f47d415a2b0 msgr2=0x7f47d40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 --2- 172.21.15.60:0/3307573611 >> v2:172.21.15.144:3300/0 conn(0x7f47d415a2b0 0x7f47d40b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 -- 172.21.15.60:0/3307573611 >> v1:172.21.15.144:6789/0 conn(0x7f47d415a680 legacy=0x7f47d40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 -- 172.21.15.60:0/3307573611 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40c6340 con 0x7f47d40d1c30 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d27fc700 1 --2- 172.21.15.60:0/3307573611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40cf710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f47d4089220 tx=0x7f47bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32df75da0de7567f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d1ffb700 1 -- 172.21.15.60:0/3307573611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00b860 con 0x7f47d40d1c30 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d1ffb700 1 -- 172.21.15.60:0/3307573611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00b9c0 con 0x7f47d40d1c30 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.541+0000 7f47d1ffb700 1 -- 172.21.15.60:0/3307573611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00bd60 con 0x7f47d40d1c30 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 -- 172.21.15.60:0/3307573611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 msgr2=0x7f47d40cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 --2- 172.21.15.60:0/3307573611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40cf710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f47d4089220 tx=0x7f47bc009250 comp rx=0 tx=0).stop 2023-10-08T16:06:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 -- 172.21.15.60:0/3307573611 shutdown_connections 2023-10-08T16:06:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 --2- 172.21.15.60:0/3307573611 >> v2:172.21.15.144:3300/0 conn(0x7f47d415a2b0 0x7f47d40b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 --2- 172.21.15.60:0/3307573611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40cf710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 -- 172.21.15.60:0/3307573611 >> 172.21.15.60:0/3307573611 conn(0x7f47d4067e40 msgr2=0x7f47d40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 -- 172.21.15.60:0/3307573611 shutdown_connections 2023-10-08T16:06:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.542+0000 7f47d966b700 1 -- 172.21.15.60:0/3307573611 wait complete. 2023-10-08T16:06:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.543+0000 7f47d966b700 1 Processor -- start 2023-10-08T16:06:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.543+0000 7f47d966b700 1 -- start start 2023-10-08T16:06:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d966b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d966b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47d415a2b0 0x7f47d4155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d966b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d415a680 0x7f47d40b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d966b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d415ac60 con 0x7f47d40d1c30 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d966b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d415e530 con 0x7f47d415a680 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d966b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d415e810 con 0x7f47d415a2b0 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34580/0 (socket says 172.21.15.60:34580) 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 -- 172.21.15.60:0/2149680974 learned_addr learned my addr 172.21.15.60:0/2149680974 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d37fe700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d415a680 0x7f47d40b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d27fc700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47d415a2b0 0x7f47d4155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 -- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47d415a2b0 msgr2=0x7f47d4155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47d415a2b0 0x7f47d4155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 -- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d415a680 msgr2=0x7f47d40b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d415a680 0x7f47d40b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.544+0000 7f47d2ffd700 1 -- 172.21.15.60:0/2149680974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0094f0 con 0x7f47d40d1c30 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.545+0000 7f47d2ffd700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40ca250 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f47cc007fb0 tx=0x7f47cc0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.545+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc00ebf0 con 0x7f47d40d1c30 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.545+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc00ed50 con 0x7f47d40d1c30 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.545+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d415eaf0 con 0x7f47d40d1c30 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.545+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc014670 con 0x7f47d40d1c30 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.545+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d40c9af0 con 0x7f47d40d1c30 2023-10-08T16:06:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.546+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d404c3c0 con 0x7f47d40d1c30 2023-10-08T16:06:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.546+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47cc0149e0 con 0x7f47d40d1c30 2023-10-08T16:06:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.547+0000 7f47caffd700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f47b4066f30 0x7f47b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.547+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f47cc084c60 con 0x7f47d40d1c30 2023-10-08T16:06:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.547+0000 7f47d27fc700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f47b4066f30 0x7f47b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.547+0000 7f47d27fc700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f47b4066f30 0x7f47b40693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f47d4089220 tx=0x7f47bc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.551+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47cc051df0 con 0x7f47d40d1c30 2023-10-08T16:06:57.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.745+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f47d4064a00 con 0x7f47d40d1c30 2023-10-08T16:06:57.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.746+0000 7f47caffd700 1 -- 172.21.15.60:0/2149680974 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+32634 (secure 0 0 0) 0x7f47cc055410 con 0x7f47d40d1c30 2023-10-08T16:06:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:57.747 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 53, 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:54.371404+0000", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "luminous", 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:57.750 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:57.751 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:57.752 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:57.753 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.754 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:57.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:57.756 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:57.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2023-10-08T16:06:57.758 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:57.759 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:57.760 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:57.761 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:57.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:57.763 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:57.764 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:57.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:57.766 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.768 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:57.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.770 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.772 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.773 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:57.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:57.777 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:57.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.783 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:57.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:57.788 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.789 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:57.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:57.801 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.802 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:57.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.811 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:57.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:57.815 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:57.820 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.821 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.823 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.824 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.825 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:57.827 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [ 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "pgid": "7.9", 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "mappings": [ 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "from": 0, 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "to": 4 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "pgid": "7.2d", 2023-10-08T16:06:57.828 INFO:teuthology.orchestra.run.smithi060.stdout: "mappings": [ 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "from": 0, 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "to": 5 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:57.829 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:57.830 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:57.831 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:57.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f47b4066f30 msgr2=0x7f47b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f47b4066f30 0x7f47b40693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f47d4089220 tx=0x7f47bc017000 comp rx=0 tx=0).stop 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 msgr2=0x7f47d40ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40ca250 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f47cc007fb0 tx=0x7f47cc0098b0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 shutdown_connections 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f47b4066f30 0x7f47b40693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d415a680 0x7f47d40b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d40d1c30 0x7f47d40ca250 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 --2- 172.21.15.60:0/2149680974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47d415a2b0 0x7f47d4155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 >> 172.21.15.60:0/2149680974 conn(0x7f47d4067e40 msgr2=0x7f47d40cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 shutdown_connections 2023-10-08T16:06:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.748+0000 7f47d966b700 1 -- 172.21.15.60:0/2149680974 wait complete. 2023-10-08T16:06:57.834 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T16:06:57.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:06:57.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef9df5700 1 Processor -- start 2023-10-08T16:06:57.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef9df5700 1 -- start start 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef9df5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ef41577d0 0x7f1ef40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef9df5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef415c360 con 0x7f1ef4157ba0 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef9df5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef415b790 con 0x7f1ef406ac30 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef9df5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef415ba30 con 0x7f1ef41577d0 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.952+0000 7f1ef2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1ef4157ba0 0x7f1ef406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42790/0 (socket says 172.21.15.60:42790) 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef2ffd700 1 -- 172.21.15.60:0/2085348276 learned_addr learned my addr 172.21.15.60:0/2085348276 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/2085348276 >> v2:172.21.15.144:3300/0 conn(0x7f1ef41577d0 0x7f1ef40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef27fc700 1 -- 172.21.15.60:0/2085348276 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229437101 0 0) 0x7f1ef415c360 con 0x7f1ef4157ba0 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef27fc700 1 -- 172.21.15.60:0/2085348276 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1edc003570 con 0x7f1ef4157ba0 2023-10-08T16:06:57.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef27fc700 1 -- 172.21.15.60:0/2085348276 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3207890921 0 0) 0x7f1edc003570 con 0x7f1ef4157ba0 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef37fe700 1 -- 172.21.15.60:0/2085348276 >> v1:172.21.15.144:6789/0 conn(0x7f1ef406ac30 legacy=0x7f1ef415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef37fe700 1 -- 172.21.15.60:0/2085348276 >> v1:172.21.15.60:6789/0 conn(0x7f1ef4157ba0 legacy=0x7f1ef406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef37fe700 1 -- 172.21.15.60:0/2085348276 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef415bd10 con 0x7f1ef41577d0 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/2085348276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef41577d0 0x7f1ef40cd770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098e0 tx=0x7f1ee40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=689084bdadb50ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef27fc700 1 -- 172.21.15.60:0/2085348276 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8001470 con 0x7f1ef41577d0 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef27fc700 1 -- 172.21.15.60:0/2085348276 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4011420 con 0x7f1ef41577d0 2023-10-08T16:06:57.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.953+0000 7f1ef27fc700 1 -- 172.21.15.60:0/2085348276 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40117c0 con 0x7f1ef41577d0 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 -- 172.21.15.60:0/2085348276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef41577d0 msgr2=0x7f1ef40cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/2085348276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef41577d0 0x7f1ef40cd770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098e0 tx=0x7f1ee40091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 -- 172.21.15.60:0/2085348276 shutdown_connections 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/2085348276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef41577d0 0x7f1ef40cd770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 -- 172.21.15.60:0/2085348276 >> 172.21.15.60:0/2085348276 conn(0x7f1ef4068ce0 msgr2=0x7f1ef40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 -- 172.21.15.60:0/2085348276 shutdown_connections 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.954+0000 7f1ef9df5700 1 -- 172.21.15.60:0/2085348276 wait complete. 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.955+0000 7f1ef9df5700 1 Processor -- start 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.955+0000 7f1ef9df5700 1 -- start start 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef9df5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef406ac30 0x7f1ef4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef9df5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ef41577d0 0x7f1ef40b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef9df5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 0x7f1ef416b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef9df5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4155020 con 0x7f1ef4157ba0 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef9df5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40a7840 con 0x7f1ef406ac30 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef9df5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40b0ea0 con 0x7f1ef41577d0 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 0x7f1ef416b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 0x7f1ef416b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34594/0 (socket says 172.21.15.60:34594) 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 -- 172.21.15.60:0/1474461893 learned_addr learned my addr 172.21.15.60:0/1474461893 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef2ffd700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ef41577d0 0x7f1ef40b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef406ac30 0x7f1ef4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 -- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ef41577d0 msgr2=0x7f1ef40b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ef41577d0 0x7f1ef40b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 -- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef406ac30 msgr2=0x7f1ef4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef406ac30 0x7f1ef4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.956+0000 7f1ef3fff700 1 -- 172.21.15.60:0/1474461893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4009420 con 0x7f1ef4157ba0 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef406ac30 0x7f1ef4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1ef2ffd700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ef41577d0 0x7f1ef40b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1ef3fff700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 0x7f1ef416b4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c910 tx=0x7f1eec0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00ce50 con 0x7f1ef4157ba0 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec00a7e0 con 0x7f1ef4157ba0 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00ab80 con 0x7f1ef4157ba0 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef40b1180 con 0x7f1ef4157ba0 2023-10-08T16:06:57.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.957+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef40b0b00 con 0x7f1ef4157ba0 2023-10-08T16:06:57.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.958+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef40b16a0 con 0x7f1ef4157ba0 2023-10-08T16:06:57.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.958+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eec012420 con 0x7f1ef4157ba0 2023-10-08T16:06:57.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.959+0000 7f1edb7fe700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1ee0066f30 0x7f1ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:57.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.959+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1ee0066f30 0x7f1ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:57.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.959+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1eec0847c0 con 0x7f1ef4157ba0 2023-10-08T16:06:57.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.959+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1ee0066f30 0x7f1ee00693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400a010 tx=0x7f1ee4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:57.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:57.963+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ef40b16a0 con 0x7f1ef4157ba0 2023-10-08T16:06:58.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.156+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1ef40a7610 con 0x7f1ef4157ba0 2023-10-08T16:06:58.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.157+0000 7f1edb7fe700 1 -- 172.21.15.60:0/1474461893 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+32634 (secure 0 0 0) 0x7f1ef40a7610 con 0x7f1ef4157ba0 2023-10-08T16:06:58.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:58.159 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 53, 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:06:54.371404+0000", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:06:58.160 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 7, 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "luminous", 2023-10-08T16:06:58.161 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:58.163 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:58.164 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:58.165 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:58.166 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.167 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:25.007166+0000", 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:58.168 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:06:58.169 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:58.170 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:58.171 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:58.172 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:06:58.173 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:06:26.073203+0000", 2023-10-08T16:06:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:06:58.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2023-10-08T16:06:58.176 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:06:58.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:06:58.178 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:06:58.179 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:58.180 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.183 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:06:58.186 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:06:58.189 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.192 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.192 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.192 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:06:58.192 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:06:58.193 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.194 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:06:58.195 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.197 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.201 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:06:58.202 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:06:58.205 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:06:58.206 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.207 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:06:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.223 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.225 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 44, 2023-10-08T16:06:58.227 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:06:58.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:06:58.230 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:06:58.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:06:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.233 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.234 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:06:58.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:06:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.238 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:06:58.239 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [ 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "pgid": "7.9", 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "mappings": [ 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "from": 0, 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: "to": 4 2023-10-08T16:06:58.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: "pgid": "7.2d", 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: "mappings": [ 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: "from": 0, 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: "to": 5 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.241 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:06:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:06:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1ee0066f30 msgr2=0x7f1ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1ee0066f30 0x7f1ee00693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400a010 tx=0x7f1ee4016000 comp rx=0 tx=0).stop 2023-10-08T16:06:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 msgr2=0x7f1ef416b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 0x7f1ef416b4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c910 tx=0x7f1eec0016b0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 shutdown_connections 2023-10-08T16:06:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1ee0066f30 0x7f1ee00693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef4157ba0 0x7f1ef416b4a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef406ac30 0x7f1ef4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 --2- 172.21.15.60:0/1474461893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ef41577d0 0x7f1ef40b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 >> 172.21.15.60:0/1474461893 conn(0x7f1ef4068ce0 msgr2=0x7f1ef415ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:58.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 shutdown_connections 2023-10-08T16:06:58.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.160+0000 7f1ef9df5700 1 -- 172.21.15.60:0/1474461893 wait complete. 2023-10-08T16:06:58.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:58.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.364+0000 7f2e4357b700 1 Processor -- start 2023-10-08T16:06:58.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.365+0000 7f2e4357b700 1 -- start start 2023-10-08T16:06:58.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e4357b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e3c157870 0x7f2e3c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:58.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e4357b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e3c15a620 0x7f2e3c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e4357b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c15cbb0 con 0x7f2e3c15d580 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e4357b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c15bfa0 con 0x7f2e3c15a620 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e4357b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c15c280 con 0x7f2e3c157870 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e3c15a620 0x7f2e3c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e3c15a620 0x7f2e3c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34606/0 (socket says 172.21.15.60:34606) 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 -- 172.21.15.60:0/2978013508 learned_addr learned my addr 172.21.15.60:0/2978013508 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e41317700 1 --2- 172.21.15.60:0/2978013508 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c157870 0x7f2e3c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 -- 172.21.15.60:0/2978013508 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c157870 msgr2=0x7f2e3c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 --2- 172.21.15.60:0/2978013508 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c157870 0x7f2e3c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 -- 172.21.15.60:0/2978013508 >> v1:172.21.15.144:6789/0 conn(0x7f2e3c15d580 legacy=0x7f2e3c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 -- 172.21.15.60:0/2978013508 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c15c560 con 0x7f2e3c15a620 2023-10-08T16:06:58.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e40b16700 1 --2- 172.21.15.60:0/2978013508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c15a620 0x7f2e3c15d040 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c069d80 tx=0x7f2e38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837350168152fc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e33fff700 1 -- 172.21.15.60:0/2978013508 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800b860 con 0x7f2e3c15a620 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e33fff700 1 -- 172.21.15.60:0/2978013508 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3800b9c0 con 0x7f2e3c15a620 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.366+0000 7f2e33fff700 1 -- 172.21.15.60:0/2978013508 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800bd60 con 0x7f2e3c15a620 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 -- 172.21.15.60:0/2978013508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c15a620 msgr2=0x7f2e3c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 --2- 172.21.15.60:0/2978013508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c15a620 0x7f2e3c15d040 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c069d80 tx=0x7f2e38009250 comp rx=0 tx=0).stop 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 -- 172.21.15.60:0/2978013508 shutdown_connections 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 --2- 172.21.15.60:0/2978013508 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c157870 0x7f2e3c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 --2- 172.21.15.60:0/2978013508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c15a620 0x7f2e3c15d040 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 -- 172.21.15.60:0/2978013508 >> 172.21.15.60:0/2978013508 conn(0x7f2e3c068ce0 msgr2=0x7f2e3c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 -- 172.21.15.60:0/2978013508 shutdown_connections 2023-10-08T16:06:58.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.367+0000 7f2e4357b700 1 -- 172.21.15.60:0/2978013508 wait complete. 2023-10-08T16:06:58.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.368+0000 7f2e4357b700 1 Processor -- start 2023-10-08T16:06:58.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.368+0000 7f2e4357b700 1 -- start start 2023-10-08T16:06:58.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e4357b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 0x7f2e3c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e4357b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c15a620 0x7f2e3c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e4357b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c15d580 0x7f2e3c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e4357b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1538f0 con 0x7f2e3c157870 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e4357b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c152a30 con 0x7f2e3c15a620 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e4357b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c152ce0 con 0x7f2e3c15d580 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 0x7f2e3c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 0x7f2e3c151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34616/0 (socket says 172.21.15.60:34616) 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 -- 172.21.15.60:0/3525683566 learned_addr learned my addr 172.21.15.60:0/3525683566 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 -- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c15d580 msgr2=0x7f2e3c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c15d580 0x7f2e3c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 -- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c15a620 msgr2=0x7f2e3c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e40b16700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c15a620 0x7f2e3c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c15a620 0x7f2e3c1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 -- 172.21.15.60:0/3525683566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e380094f0 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.369+0000 7f2e41317700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 0x7f2e3c151fb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00d890 tx=0x7f2e2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.370+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c00b600 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.370+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c00b760 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.370+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c152fc0 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.370+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c00bae0 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.370+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c153580 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.371+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c04c3c0 con 0x7f2e3c157870 2023-10-08T16:06:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.371+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e2c01e460 con 0x7f2e3c157870 2023-10-08T16:06:58.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.371+0000 7f2e317fa700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e20066f30 0x7f2e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:58.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.372+0000 7f2e40b16700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e20066f30 0x7f2e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:58.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.372+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2e2c084c20 con 0x7f2e3c157870 2023-10-08T16:06:58.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.372+0000 7f2e40b16700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e20066f30 0x7f2e200693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c069d80 tx=0x7f2e38017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.376+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e2c051e50 con 0x7f2e3c157870 2023-10-08T16:06:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.612+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e3c15c840 con 0x7f2e3c157870 2023-10-08T16:06:58.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.612+0000 7f2e317fa700 1 -- 172.21.15.60:0/3525683566 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2e2c055470 con 0x7f2e3c157870 2023-10-08T16:06:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:58.614 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e20066f30 msgr2=0x7f2e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e20066f30 0x7f2e200693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c069d80 tx=0x7f2e38017000 comp rx=0 tx=0).stop 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 msgr2=0x7f2e3c151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 0x7f2e3c151fb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00d890 tx=0x7f2e2c008040 comp rx=0 tx=0).stop 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 shutdown_connections 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e20066f30 0x7f2e200693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c15d580 0x7f2e3c0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c157870 0x7f2e3c151fb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 --2- 172.21.15.60:0/3525683566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c15a620 0x7f2e3c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 >> 172.21.15.60:0/3525683566 conn(0x7f2e3c068ce0 msgr2=0x7f2e3c1584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 shutdown_connections 2023-10-08T16:06:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:58.614+0000 7f2e4357b700 1 -- 172.21.15.60:0/3525683566 wait complete. 2023-10-08T16:06:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:06:58.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-08T16:06:58.777 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":5361,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.073242449999999,"mdsmap_epoch":25,"osdmap_epoch":53,"osdmap_epoch_barrier":49,"uptime":36.989212350999999} 2023-10-08T16:06:58.777 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 5361, "mdsmap_epoch": 25, "osdmap_epoch": 53, "osdmap_epoch_barrier": 49, "rank_uptime": 31.07324245, "state": "up:active", "uptime": 36.989212351, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:06:58.777 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:06:58.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:58.778 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-08T16:06:59.075 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:06:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:06:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.280309 s, 187 MB/s 2023-10-08T16:06:59.076 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:06:59.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:06:59.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:06:59.151 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:06:59.152 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:06:59.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:59.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:06:59.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:06:59.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.219 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:06:59.237 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:06:59.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:06:59.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:06:59.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:06:59.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:06:59.275 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:06:59.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:06:59.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.447+0000 7fc954846700 1 Processor -- start 2023-10-08T16:06:59.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.447+0000 7fc954846700 1 -- start start 2023-10-08T16:06:59.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc954846700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9500b0e50 0x7fc9500c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc954846700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc9500cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc954846700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95015de60 con 0x7fc9500b1220 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc954846700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9500cbed0 con 0x7fc9500b0e50 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc954846700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95015e140 con 0x7fc9500cb4f0 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc94dd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc9500b1220 0x7fc95006d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42806/0 (socket says 172.21.15.60:42806) 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.448+0000 7fc94dd9b700 1 -- 172.21.15.60:0/1571802050 learned_addr learned my addr 172.21.15.60:0/1571802050 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94e59c700 1 --2- 172.21.15.60:0/1571802050 >> v2:172.21.15.144:3300/0 conn(0x7fc9500b0e50 0x7fc9500c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94ed9d700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc9500cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536238573 0 0) 0x7fc95015de60 con 0x7fc9500b1220 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc93c003570 con 0x7fc9500b1220 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591820936 0 0) 0x7fc93c003570 con 0x7fc9500b1220 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 msgr2=0x7fc9500cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc9500cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 >> v2:172.21.15.144:3300/0 conn(0x7fc9500b0e50 msgr2=0x7fc9500c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 --2- 172.21.15.60:0/1571802050 >> v2:172.21.15.144:3300/0 conn(0x7fc9500b0e50 0x7fc9500c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95015e420 con 0x7fc9500b1220 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fc938001470 con 0x7fc9500b1220 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 >> v1:172.21.15.60:6789/0 conn(0x7fc9500b1220 legacy=0x7fc95006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc93c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc93c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93c004d50 0x7fc93c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500cbed0 con 0x7fc93c003fe0 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95015e140 con 0x7fc93c004d50 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c00bb40 con 0x7fc9500cb4f0 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc93c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94e59c700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc93c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.449+0000 7fc94ed9d700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93c004d50 0x7fc93c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94dd9b700 1 -- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 msgr2=0x7fc93c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc93c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94dd9b700 1 -- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93c004d50 msgr2=0x7fc93c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93c004d50 0x7fc93c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94dd9b700 1 -- 172.21.15.60:0/1571802050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c003570 con 0x7fc93c003fe0 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94e59c700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9500cb4f0 0x7fc93c003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc93c004810 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9500b1680 tx=0x7fc938001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd24cb4b00ce8be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800cc30 con 0x7fc93c003fe0 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93800cdb0 con 0x7fc93c003fe0 2023-10-08T16:06:59.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94d59a700 1 -- 172.21.15.60:0/1571802050 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938005b70 con 0x7fc93c003fe0 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc954846700 1 -- 172.21.15.60:0/1571802050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 msgr2=0x7fc93c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc954846700 1 --2- 172.21.15.60:0/1571802050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc93c004810 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9500b1680 tx=0x7fc938001e90 comp rx=0 tx=0).stop 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc94ed9d700 1 -- 172.21.15.60:0/1571802050 reap_dead start 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc954846700 1 -- 172.21.15.60:0/1571802050 shutdown_connections 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.450+0000 7fc954846700 1 -- 172.21.15.60:0/1571802050 >> 172.21.15.60:0/1571802050 conn(0x7fc950069870 msgr2=0x7fc950069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.451+0000 7fc954846700 1 -- 172.21.15.60:0/1571802050 shutdown_connections 2023-10-08T16:06:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.451+0000 7fc954846700 1 -- 172.21.15.60:0/1571802050 wait complete. 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 Processor -- start 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 -- start start 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc950153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc95015cb70 0x7fc9500c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9500c6850 0x7fc9500c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95015d2e0 con 0x7fc93c003fe0 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950158a50 con 0x7fc9500c6850 2023-10-08T16:06:59.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc954846700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950153e90 con 0x7fc95015cb70 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc94e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc950153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc94e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc950153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34644/0 (socket says 172.21.15.60:34644) 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.452+0000 7fc94e59c700 1 -- 172.21.15.60:0/1945304694 learned_addr learned my addr 172.21.15.60:0/1945304694 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94ed9d700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9500c6850 0x7fc9500c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc95015cb70 0x7fc9500c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94e59c700 1 -- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc95015cb70 msgr2=0x7fc9500c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94e59c700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc95015cb70 0x7fc9500c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94e59c700 1 -- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9500c6850 msgr2=0x7fc9500c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94e59c700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9500c6850 0x7fc9500c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94e59c700 1 -- 172.21.15.60:0/1945304694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500c7200 con 0x7fc93c003fe0 2023-10-08T16:06:59.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc94e59c700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc950153950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc948011da0 tx=0x7fc9480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94800fb40 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94800fca0 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9500c6130 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94801d480 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.453+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc950158c40 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.454+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9500b0c50 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.454+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc94801d8b0 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.455+0000 7fc9467fc700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc930066f30 0x7fc9300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.455+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fc948018070 con 0x7fc93c003fe0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.455+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc930066f30 0x7fc9300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.455+0000 7fc94dd9b700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc930066f30 0x7fc9300693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc938001ed0 tx=0x7fc938015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.459+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc948052760 con 0x7fc93c003fe0 2023-10-08T16:06:59.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.696+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc95004c3c0 con 0x7fc93c003fe0 2023-10-08T16:06:59.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.697+0000 7fc9467fc700 1 -- 172.21.15.60:0/1945304694 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc948055d80 con 0x7fc93c003fe0 2023-10-08T16:06:59.699 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:06:59.699 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc930066f30 msgr2=0x7fc9300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc930066f30 0x7fc9300693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc938001ed0 tx=0x7fc938015000 comp rx=0 tx=0).stop 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 msgr2=0x7fc950153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc950153950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc948011da0 tx=0x7fc9480091a0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 shutdown_connections 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc930066f30 0x7fc9300693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9500c6850 0x7fc9500c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93c003fe0 0x7fc950153950 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 --2- 172.21.15.60:0/1945304694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc95015cb70 0x7fc9500c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 >> 172.21.15.60:0/1945304694 conn(0x7fc950069870 msgr2=0x7fc9500cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 shutdown_connections 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.699+0000 7fc954846700 1 -- 172.21.15.60:0/1945304694 wait complete. 2023-10-08T16:06:59.702 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:06:59.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:06:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.834+0000 7f7e54fab700 1 Processor -- start 2023-10-08T16:06:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.834+0000 7f7e54fab700 1 -- start start 2023-10-08T16:06:59.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.835+0000 7f7e54fab700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e50156980 0x7f7e500ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.835+0000 7f7e54fab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e500cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.835+0000 7f7e54fab700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e500ad5c0 con 0x7f7e50156d50 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.835+0000 7f7e54fab700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e500ac9b0 con 0x7f7e50156980 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.835+0000 7f7e54fab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500acc90 con 0x7f7e500cd420 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.835+0000 7f7e4f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e50156980 0x7f7e500ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e50156980 0x7f7e500ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34656/0 (socket says 172.21.15.60:34656) 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 -- 172.21.15.60:0/927290135 learned_addr learned my addr 172.21.15.60:0/927290135 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4effd700 1 --2- 172.21.15.60:0/927290135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e500cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 -- 172.21.15.60:0/927290135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 msgr2=0x7f7e500cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 --2- 172.21.15.60:0/927290135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e500cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 -- 172.21.15.60:0/927290135 >> v1:172.21.15.144:6789/0 conn(0x7f7e50156d50 legacy=0x7f7e5015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 -- 172.21.15.60:0/927290135 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500acf70 con 0x7f7e50156980 2023-10-08T16:06:59.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4f7fe700 1 --2- 172.21.15.60:0/927290135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156980 0x7f7e500ac0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099b0 tx=0x7f7e40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5443bb7904b94ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4e7fc700 1 -- 172.21.15.60:0/927290135 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40009ea0 con 0x7f7e50156980 2023-10-08T16:06:59.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4e7fc700 1 -- 172.21.15.60:0/927290135 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000b860 con 0x7f7e50156980 2023-10-08T16:06:59.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.836+0000 7f7e4e7fc700 1 -- 172.21.15.60:0/927290135 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000bc00 con 0x7f7e50156980 2023-10-08T16:06:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 -- 172.21.15.60:0/927290135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156980 msgr2=0x7f7e500ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 --2- 172.21.15.60:0/927290135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156980 0x7f7e500ac0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099b0 tx=0x7f7e40009250 comp rx=0 tx=0).stop 2023-10-08T16:06:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 -- 172.21.15.60:0/927290135 shutdown_connections 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 --2- 172.21.15.60:0/927290135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156980 0x7f7e500ac0d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 --2- 172.21.15.60:0/927290135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e500cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 -- 172.21.15.60:0/927290135 >> 172.21.15.60:0/927290135 conn(0x7f7e500680e0 msgr2=0x7f7e500cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 -- 172.21.15.60:0/927290135 shutdown_connections 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.837+0000 7f7e54fab700 1 -- 172.21.15.60:0/927290135 wait complete. 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.838+0000 7f7e54fab700 1 Processor -- start 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.838+0000 7f7e54fab700 1 -- start start 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e54fab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e50150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e54fab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e50156980 0x7f7e5016a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e54fab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 0x7f7e5006daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e54fab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5006a8d0 con 0x7f7e50156d50 2023-10-08T16:06:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e54fab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50157ed0 con 0x7f7e50156980 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e54fab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501572c0 con 0x7f7e500cd420 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 0x7f7e5006daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 0x7f7e5006daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34658/0 (socket says 172.21.15.60:34658) 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 -- 172.21.15.60:0/3535781041 learned_addr learned my addr 172.21.15.60:0/3535781041 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4effd700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e50156980 0x7f7e5016a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4f7fe700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e50150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 -- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 msgr2=0x7f7e50150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e50150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 -- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e50156980 msgr2=0x7f7e5016a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e50156980 0x7f7e5016a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.839+0000 7f7e4ffff700 1 -- 172.21.15.60:0/3535781041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400094f0 con 0x7f7e50156d50 2023-10-08T16:06:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.840+0000 7f7e4ffff700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 0x7f7e5006daa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c840 tx=0x7f7e48001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.840+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48012630 con 0x7f7e50156d50 2023-10-08T16:06:59.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.840+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e480127b0 con 0x7f7e50156d50 2023-10-08T16:06:59.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.840+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e501575a0 con 0x7f7e50156d50 2023-10-08T16:06:59.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.840+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48012b70 con 0x7f7e50156d50 2023-10-08T16:06:59.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.840+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e50157b60 con 0x7f7e50156d50 2023-10-08T16:06:59.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.841+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50158060 con 0x7f7e50156d50 2023-10-08T16:06:59.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.841+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e48003030 con 0x7f7e50156d50 2023-10-08T16:06:59.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.842+0000 7f7e377fe700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7e3c066f30 0x7f7e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:06:59.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.842+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7e48084630 con 0x7f7e50156d50 2023-10-08T16:06:59.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.842+0000 7f7e4f7fe700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7e3c066f30 0x7f7e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:06:59.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.842+0000 7f7e4f7fe700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7e3c066f30 0x7f7e3c0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099b0 tx=0x7f7e40017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:06:59.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:06:59.846+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e480517c0 con 0x7f7e50156d50 2023-10-08T16:07:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.039+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e5004bb80 con 0x7f7e50156d50 2023-10-08T16:07:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.039+0000 7f7e377fe700 1 -- 172.21.15.60:0/3535781041 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f7e48054de0 con 0x7f7e50156d50 2023-10-08T16:07:00.041 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:00.041 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:54.371404+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:25.007166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:26.073203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7e3c066f30 msgr2=0x7f7e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7e3c066f30 0x7f7e3c0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099b0 tx=0x7f7e40017000 comp rx=0 tx=0).stop 2023-10-08T16:07:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 msgr2=0x7f7e5006daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 0x7f7e5006daa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c840 tx=0x7f7e48001670 comp rx=0 tx=0).stop 2023-10-08T16:07:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 shutdown_connections 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7e3c066f30 0x7f7e3c0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e500cd420 0x7f7e50150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e50156d50 0x7f7e5006daa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 --2- 172.21.15.60:0/3535781041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e50156980 0x7f7e5016a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 >> 172.21.15.60:0/3535781041 conn(0x7f7e500680e0 msgr2=0x7f7e501518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 shutdown_connections 2023-10-08T16:07:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.041+0000 7f7e54fab700 1 -- 172.21.15.60:0/3535781041 wait complete. 2023-10-08T16:07:00.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:06:25.007166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:06:26.073203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:07:00.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:00.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.177+0000 7fce6d04b700 1 Processor -- start 2023-10-08T16:07:00.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.177+0000 7fce6d04b700 1 -- start start 2023-10-08T16:07:00.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce6d04b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce6815b9a0 0x7fce680caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce6d04b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6815c8d0 con 0x7fce68152300 2023-10-08T16:07:00.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce6d04b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce680c9370 con 0x7fce6806d370 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce6d04b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce680b1400 con 0x7fce6815b9a0 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce66d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce68152300 0x7fce68158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42820/0 (socket says 172.21.15.60:42820) 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce66d9d700 1 -- 172.21.15.60:0/2605229567 learned_addr learned my addr 172.21.15.60:0/2605229567 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce6659c700 1 --2- 172.21.15.60:0/2605229567 >> v2:172.21.15.144:3300/0 conn(0x7fce6815b9a0 0x7fce680caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.178+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279147818 0 0) 0x7fce6815c8d0 con 0x7fce68152300 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce54003570 con 0x7fce68152300 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169248238 0 0) 0x7fce680c9370 con 0x7fce6806d370 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6815c8d0 con 0x7fce6806d370 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093782192 0 0) 0x7fce54003570 con 0x7fce68152300 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce6659c700 1 -- 172.21.15.60:0/2605229567 >> v1:172.21.15.144:6789/0 conn(0x7fce6806d370 legacy=0x7fce6806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce6659c700 1 -- 172.21.15.60:0/2605229567 >> v1:172.21.15.60:6789/0 conn(0x7fce68152300 legacy=0x7fce68158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce6659c700 1 -- 172.21.15.60:0/2605229567 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6815c030 con 0x7fce6815b9a0 2023-10-08T16:07:00.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce6659c700 1 --2- 172.21.15.60:0/2605229567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce6815b9a0 0x7fce680caaf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce500098e0 tx=0x7fce500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3b4dd76bfb7f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58001470 con 0x7fce6815b9a0 2023-10-08T16:07:00.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50011420 con 0x7fce6815b9a0 2023-10-08T16:07:00.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.179+0000 7fce65d9b700 1 -- 172.21.15.60:0/2605229567 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500117c0 con 0x7fce6815b9a0 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 -- 172.21.15.60:0/2605229567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce6815b9a0 msgr2=0x7fce680caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 --2- 172.21.15.60:0/2605229567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce6815b9a0 0x7fce680caaf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce500098e0 tx=0x7fce500091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 -- 172.21.15.60:0/2605229567 shutdown_connections 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 --2- 172.21.15.60:0/2605229567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce6815b9a0 0x7fce680caaf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 -- 172.21.15.60:0/2605229567 >> 172.21.15.60:0/2605229567 conn(0x7fce68069870 msgr2=0x7fce68069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 -- 172.21.15.60:0/2605229567 shutdown_connections 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.180+0000 7fce6d04b700 1 -- 172.21.15.60:0/2605229567 wait complete. 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.181+0000 7fce6d04b700 1 Processor -- start 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.181+0000 7fce6d04b700 1 -- start start 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 0x7fce6814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce68152300 0x7fce680b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce6815b9a0 0x7fce680b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce680b4360 con 0x7fce6806d370 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6814b310 con 0x7fce68152300 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6814b5f0 con 0x7fce6815b9a0 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 0x7fce6814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 0x7fce6814aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34662/0 (socket says 172.21.15.60:34662) 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 -- 172.21.15.60:0/1785482273 learned_addr learned my addr 172.21.15.60:0/1785482273 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6659c700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce68152300 0x7fce680b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6759e700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce6815b9a0 0x7fce680b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 -- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce6815b9a0 msgr2=0x7fce680b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce6815b9a0 0x7fce680b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 -- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce68152300 msgr2=0x7fce680b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce68152300 0x7fce680b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 -- 172.21.15.60:0/1785482273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009420 con 0x7fce6806d370 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce66d9d700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 0x7fce6814aaa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce5800cb70 tx=0x7fce58001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800ce80 con 0x7fce6806d370 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce58007360 con 0x7fce6806d370 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6814b8d0 con 0x7fce6806d370 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.182+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58007700 con 0x7fce6806d370 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.183+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6814afe0 con 0x7fce6806d370 2023-10-08T16:07:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.183+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6804c3c0 con 0x7fce6806d370 2023-10-08T16:07:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.184+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce58004a40 con 0x7fce6806d370 2023-10-08T16:07:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.184+0000 7fce5effd700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fce48066f30 0x7fce480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.185+0000 7fce6659c700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fce48066f30 0x7fce480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.185+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fce58083960 con 0x7fce6806d370 2023-10-08T16:07:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.185+0000 7fce6659c700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fce48066f30 0x7fce480693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce500093f0 tx=0x7fce50016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.189+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce58050c10 con 0x7fce6806d370 2023-10-08T16:07:00.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.381+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce680cdf10 con 0x7fce6806d370 2023-10-08T16:07:00.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.381+0000 7fce5effd700 1 -- 172.21.15.60:0/1785482273 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce58018020 con 0x7fce6806d370 2023-10-08T16:07:00.383 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fce48066f30 msgr2=0x7fce480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fce48066f30 0x7fce480693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce500093f0 tx=0x7fce50016000 comp rx=0 tx=0).stop 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 msgr2=0x7fce6814aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 0x7fce6814aaa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce5800cb70 tx=0x7fce58001b50 comp rx=0 tx=0).stop 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 shutdown_connections 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fce48066f30 0x7fce480693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce6815b9a0 0x7fce680b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6806d370 0x7fce6814aaa0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 --2- 172.21.15.60:0/1785482273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce68152300 0x7fce680b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 >> 172.21.15.60:0/1785482273 conn(0x7fce68069870 msgr2=0x7fce680cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 shutdown_connections 2023-10-08T16:07:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.383+0000 7fce6d04b700 1 -- 172.21.15.60:0/1785482273 wait complete. 2023-10-08T16:07:00.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:07:00.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.517+0000 7fd11abda700 1 Processor -- start 2023-10-08T16:07:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.517+0000 7fd11abda700 1 -- start start 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.518+0000 7fd11abda700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd114159e60 0x7fd11415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.518+0000 7fd11abda700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1140697c0 0x7fd1140af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.518+0000 7fd11abda700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11415ea90 con 0x7fd11415a230 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.518+0000 7fd11abda700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1140d1cf0 con 0x7fd114159e60 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.518+0000 7fd11abda700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b3100 con 0x7fd1140697c0 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd119177700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1140697c0 0x7fd1140af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd118976700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd114159e60 0x7fd11415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd113fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd11415a230 0x7fd1140690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:55768/0 (socket says 172.21.15.60:55768) 2023-10-08T16:07:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd113fff700 1 -- 172.21.15.60:0/3997052620 learned_addr learned my addr 172.21.15.60:0/3997052620 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd118976700 1 -- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1140697c0 msgr2=0x7fd1140af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd118976700 1 --2- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1140697c0 0x7fd1140af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd118976700 1 -- 172.21.15.60:0/3997052620 >> v1:172.21.15.144:6789/0 conn(0x7fd11415a230 legacy=0x7fd1140690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd118976700 1 -- 172.21.15.60:0/3997052620 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140d10e0 con 0x7fd114159e60 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd119177700 1 --2- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1140697c0 0x7fd1140af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd1137fe700 1 -- 172.21.15.60:0/3997052620 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128732872 0 0) 0x7fd11415ea90 con 0x7fd11415a230 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd118976700 1 --2- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd114159e60 0x7fd11415e550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd1080098e0 tx=0x7fd1080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8075bc4961641769 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd1137fe700 1 -- 172.21.15.60:0/3997052620 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800b640 con 0x7fd114159e60 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd1137fe700 1 -- 172.21.15.60:0/3997052620 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10800b7a0 con 0x7fd114159e60 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.519+0000 7fd1137fe700 1 -- 172.21.15.60:0/3997052620 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800bb40 con 0x7fd114159e60 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 -- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd114159e60 msgr2=0x7fd11415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 --2- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd114159e60 0x7fd11415e550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd1080098e0 tx=0x7fd1080091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 -- 172.21.15.60:0/3997052620 shutdown_connections 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 --2- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1140697c0 0x7fd1140af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 --2- 172.21.15.60:0/3997052620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd114159e60 0x7fd11415e550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 -- 172.21.15.60:0/3997052620 >> 172.21.15.60:0/3997052620 conn(0x7fd114070700 msgr2=0x7fd114070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 -- 172.21.15.60:0/3997052620 shutdown_connections 2023-10-08T16:07:00.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.520+0000 7fd11abda700 1 -- 172.21.15.60:0/3997052620 wait complete. 2023-10-08T16:07:00.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.521+0000 7fd11abda700 1 Processor -- start 2023-10-08T16:07:00.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.521+0000 7fd11abda700 1 -- start start 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd11abda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 0x7fd1141593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd11abda700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd114159e60 0x7fd11415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd11abda700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd11415a230 0x7fd11415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd11abda700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11415f6f0 con 0x7fd1140697c0 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd11abda700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140c4ef0 con 0x7fd11415a230 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd11abda700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140c5a50 con 0x7fd114159e60 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 0x7fd1141593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 0x7fd1141593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34678/0 (socket says 172.21.15.60:34678) 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 -- 172.21.15.60:0/37374930 learned_addr learned my addr 172.21.15.60:0/37374930 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd119177700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd11415a230 0x7fd11415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd113fff700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd114159e60 0x7fd11415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 -- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd114159e60 msgr2=0x7fd11415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd114159e60 0x7fd11415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 -- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd11415a230 msgr2=0x7fd11415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd11415a230 0x7fd11415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.522+0000 7fd118976700 1 -- 172.21.15.60:0/37374930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009a20 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.523+0000 7fd118976700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 0x7fd1141593b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1080093f0 tx=0x7fd108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.523+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800bb20 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.523+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108000c90 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.523+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108011670 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.523+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd108009420 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.523+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140c5400 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.524+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11404c3c0 con 0x7fd1140697c0 2023-10-08T16:07:00.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.524+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd108011a60 con 0x7fd1140697c0 2023-10-08T16:07:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.525+0000 7fd110ff9700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.525+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fd108085de0 con 0x7fd1140697c0 2023-10-08T16:07:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.525+0000 7fd113fff700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.525+0000 7fd113fff700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd0f8066f30 0x7fd0f80693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1140cda90 tx=0x7fd100007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.529+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd108053010 con 0x7fd1140697c0 2023-10-08T16:07:00.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.726+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1140cb590 con 0x7fd1140697c0 2023-10-08T16:07:00.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.726+0000 7fd110ff9700 1 -- 172.21.15.60:0/37374930 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd108056630 con 0x7fd1140697c0 2023-10-08T16:07:00.727 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd0f8066f30 msgr2=0x7fd0f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd0f8066f30 0x7fd0f80693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1140cda90 tx=0x7fd100007f50 comp rx=0 tx=0).stop 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 msgr2=0x7fd1141593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 0x7fd1141593b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1080093f0 tx=0x7fd108017000 comp rx=0 tx=0).stop 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 shutdown_connections 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd11415a230 0x7fd11415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1140697c0 0x7fd1141593b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 --2- 172.21.15.60:0/37374930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd114159e60 0x7fd11415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 >> 172.21.15.60:0/37374930 conn(0x7fd114070700 msgr2=0x7fd114070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 shutdown_connections 2023-10-08T16:07:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.728+0000 7fd11abda700 1 -- 172.21.15.60:0/37374930 wait complete. 2023-10-08T16:07:00.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:07:00.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.862+0000 7f3ddea19700 1 Processor -- start 2023-10-08T16:07:00.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.862+0000 7f3ddea19700 1 -- start start 2023-10-08T16:07:00.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.862+0000 7f3ddea19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4860 0x7f3dd80b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3ddea19700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3dd80b4c30 0x7f3dd8159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3ddea19700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80b14f0 con 0x7f3dd8159fd0 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3ddea19700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80b17d0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3ddea19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80b1ab0 con 0x7f3dd80b4860 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3dd80b4c30 0x7f3dd8159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3dd80b4c30 0x7f3dd8159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34686/0 (socket says 172.21.15.60:34686) 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 -- 172.21.15.60:0/1211750500 learned_addr learned my addr 172.21.15.60:0/1211750500 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd7fff700 1 --2- 172.21.15.60:0/1211750500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4860 0x7f3dd80b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 -- 172.21.15.60:0/1211750500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4860 msgr2=0x7f3dd80b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 --2- 172.21.15.60:0/1211750500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4860 0x7f3dd80b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 -- 172.21.15.60:0/1211750500 >> v1:172.21.15.144:6789/0 conn(0x7f3dd8159fd0 legacy=0x7f3dd80cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 -- 172.21.15.60:0/1211750500 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80b1d90 con 0x7f3dd80b4c30 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd77fe700 1 --2- 172.21.15.60:0/1211750500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd80b4c30 0x7f3dd8159a90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80099b0 tx=0x7f3dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2346c77d6ac8d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd6ffd700 1 -- 172.21.15.60:0/1211750500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8009ea0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd6ffd700 1 -- 172.21.15.60:0/1211750500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800b8f0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.863+0000 7f3dd6ffd700 1 -- 172.21.15.60:0/1211750500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800bc90 con 0x7f3dd80b4c30 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 -- 172.21.15.60:0/1211750500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd80b4c30 msgr2=0x7f3dd8159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 --2- 172.21.15.60:0/1211750500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd80b4c30 0x7f3dd8159a90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80099b0 tx=0x7f3dc8009250 comp rx=0 tx=0).stop 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 -- 172.21.15.60:0/1211750500 shutdown_connections 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 --2- 172.21.15.60:0/1211750500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4860 0x7f3dd80b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 --2- 172.21.15.60:0/1211750500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd80b4c30 0x7f3dd8159a90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 -- 172.21.15.60:0/1211750500 >> 172.21.15.60:0/1211750500 conn(0x7f3dd809a0f0 msgr2=0x7f3dd8067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:00.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 -- 172.21.15.60:0/1211750500 shutdown_connections 2023-10-08T16:07:00.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.864+0000 7f3ddea19700 1 -- 172.21.15.60:0/1211750500 wait complete. 2023-10-08T16:07:00.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.865+0000 7f3ddea19700 1 Processor -- start 2023-10-08T16:07:00.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.865+0000 7f3ddea19700 1 -- start start 2023-10-08T16:07:00.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddea19700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b4860 0x7f3dd8169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddea19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4c30 0x7f3dd80abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddea19700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 0x7f3dd80ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddea19700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd816ad00 con 0x7f3dd8159fd0 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddea19700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81544f0 con 0x7f3dd80b4860 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddea19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8153bc0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddcfb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 0x7f3dd80ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddcfb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 0x7f3dd80ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34694/0 (socket says 172.21.15.60:34694) 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddcfb6700 1 -- 172.21.15.60:0/3041780434 learned_addr learned my addr 172.21.15.60:0/3041780434 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd77fe700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4c30 0x7f3dd80abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd7fff700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b4860 0x7f3dd8169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd77fe700 1 -- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b4860 msgr2=0x7f3dd8169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd77fe700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b4860 0x7f3dd8169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd77fe700 1 -- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 msgr2=0x7f3dd80ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:00.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd77fe700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 0x7f3dd80ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3dd77fe700 1 -- 172.21.15.60:0/3041780434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc80094f0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.866+0000 7f3ddcfb6700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 0x7f3dd80ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.867+0000 7f3dd77fe700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4c30 0x7f3dd80abe80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80d1ed0 tx=0x7f3dc8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.867+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800bc70 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.867+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8011420 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.867+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd8153ea0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.867+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80117a0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.867+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd8169b80 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.868+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd804c3c0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.868+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3dc8011bd0 con 0x7f3dd80b4c30 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.869+0000 7f3dcffff700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3db8066f30 0x7f3db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:00.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.869+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3dc8085e50 con 0x7f3dd80b4c30 2023-10-08T16:07:00.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.869+0000 7f3dd7fff700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3db8066f30 0x7f3db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:00.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.869+0000 7f3dd7fff700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3db8066f30 0x7f3db80693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009da0 tx=0x7f3dc0009120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:00.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:00.873+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dc8053080 con 0x7f3dd80b4c30 2023-10-08T16:07:01.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.064+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dd8154630 con 0x7f3dd80b4c30 2023-10-08T16:07:01.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.065+0000 7f3dcffff700 1 -- 172.21.15.60:0/3041780434 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3dc80150a0 con 0x7f3dd80b4c30 2023-10-08T16:07:01.066 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:07:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3db8066f30 msgr2=0x7f3db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3db8066f30 0x7f3db80693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009da0 tx=0x7f3dc0009120 comp rx=0 tx=0).stop 2023-10-08T16:07:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4c30 msgr2=0x7f3dd80abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4c30 0x7f3dd80abe80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80d1ed0 tx=0x7f3dc8017000 comp rx=0 tx=0).stop 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 shutdown_connections 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3db8066f30 0x7f3db80693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dd8159fd0 0x7f3dd80ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b4860 0x7f3dd8169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 --2- 172.21.15.60:0/3041780434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3dd80b4c30 0x7f3dd80abe80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 >> 172.21.15.60:0/3041780434 conn(0x7f3dd809a0f0 msgr2=0x7f3dd815b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 shutdown_connections 2023-10-08T16:07:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.067+0000 7f3ddea19700 1 -- 172.21.15.60:0/3041780434 wait complete. 2023-10-08T16:07:01.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.197+0000 7ff10f55c700 1 Processor -- start 2023-10-08T16:07:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10f55c700 1 -- start start 2023-10-08T16:07:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10f55c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff108157ba0 0x7ff10806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10f55c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff10815b0d0 0x7ff10806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10f55c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10815c360 con 0x7ff1081577d0 2023-10-08T16:07:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10f55c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10815b790 con 0x7ff10815b0d0 2023-10-08T16:07:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10f55c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10815d800 con 0x7ff108157ba0 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10d2f8700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff1081577d0 0x7ff1080cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42836/0 (socket says 172.21.15.60:42836) 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.198+0000 7ff10d2f8700 1 -- 172.21.15.60:0/1092181956 learned_addr learned my addr 172.21.15.60:0/1092181956 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10daf9700 1 --2- 172.21.15.60:0/1092181956 >> v2:172.21.15.60:3300/0 conn(0x7ff10815b0d0 0x7ff10806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10caf7700 1 --2- 172.21.15.60:0/1092181956 >> v2:172.21.15.144:3300/0 conn(0x7ff108157ba0 0x7ff10806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff107fff700 1 -- 172.21.15.60:0/1092181956 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639409986 0 0) 0x7ff10815c360 con 0x7ff1081577d0 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff107fff700 1 -- 172.21.15.60:0/1092181956 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f0003570 con 0x7ff1081577d0 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10daf9700 1 -- 172.21.15.60:0/1092181956 >> v2:172.21.15.144:3300/0 conn(0x7ff108157ba0 msgr2=0x7ff10806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10daf9700 1 --2- 172.21.15.60:0/1092181956 >> v2:172.21.15.144:3300/0 conn(0x7ff108157ba0 0x7ff10806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10daf9700 1 -- 172.21.15.60:0/1092181956 >> v1:172.21.15.60:6789/0 conn(0x7ff1081577d0 legacy=0x7ff1080cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10daf9700 1 -- 172.21.15.60:0/1092181956 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10815ba30 con 0x7ff10815b0d0 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10caf7700 1 --2- 172.21.15.60:0/1092181956 >> v2:172.21.15.144:3300/0 conn(0x7ff108157ba0 0x7ff10806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff10daf9700 1 --2- 172.21.15.60:0/1092181956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff10815b0d0 0x7ff10806aa60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff1080b38b0 tx=0x7ff100009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e398976b5f9b4185 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff107fff700 1 -- 172.21.15.60:0/1092181956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10000e070 con 0x7ff10815b0d0 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff107fff700 1 -- 172.21.15.60:0/1092181956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10000bb60 con 0x7ff10815b0d0 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.199+0000 7ff107fff700 1 -- 172.21.15.60:0/1092181956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100012430 con 0x7ff10815b0d0 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 -- 172.21.15.60:0/1092181956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff10815b0d0 msgr2=0x7ff10806aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 --2- 172.21.15.60:0/1092181956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff10815b0d0 0x7ff10806aa60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff1080b38b0 tx=0x7ff100009780 comp rx=0 tx=0).stop 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 -- 172.21.15.60:0/1092181956 shutdown_connections 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 --2- 172.21.15.60:0/1092181956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff10815b0d0 0x7ff10806aa60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 --2- 172.21.15.60:0/1092181956 >> v2:172.21.15.144:3300/0 conn(0x7ff108157ba0 0x7ff10806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 -- 172.21.15.60:0/1092181956 >> 172.21.15.60:0/1092181956 conn(0x7ff108068ce0 msgr2=0x7ff1080690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 -- 172.21.15.60:0/1092181956 shutdown_connections 2023-10-08T16:07:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.200+0000 7ff10f55c700 1 -- 172.21.15.60:0/1092181956 wait complete. 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.201+0000 7ff10f55c700 1 Processor -- start 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.201+0000 7ff10f55c700 1 -- start start 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10f55c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 0x7ff1081418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10f55c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff108157ba0 0x7ff1080cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10f55c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff10815b0d0 0x7ff108155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10f55c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080b3380 con 0x7ff1081577d0 2023-10-08T16:07:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10f55c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080d1250 con 0x7ff108157ba0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10f55c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080cfdc0 con 0x7ff10815b0d0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 0x7ff1081418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 0x7ff1081418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34704/0 (socket says 172.21.15.60:34704) 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 -- 172.21.15.60:0/3975502574 learned_addr learned my addr 172.21.15.60:0/3975502574 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10caf7700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff108157ba0 0x7ff1080cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10daf9700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff10815b0d0 0x7ff108155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 -- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff10815b0d0 msgr2=0x7ff108155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff10815b0d0 0x7ff108155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 -- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff108157ba0 msgr2=0x7ff1080cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff108157ba0 0x7ff1080cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 -- 172.21.15.60:0/3975502574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100009a20 con 0x7ff1081577d0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff10d2f8700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 0x7ff1081418a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c7c0 tx=0x7ff0f8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.202+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8005b30 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.203+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8005c90 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.203+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1080d0640 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.203+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8007340 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.203+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1080d0c00 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.204+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1080d15e0 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.204+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0f801b400 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.204+0000 7ff1057fa700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff0f4066f30 0x7ff0f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.204+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff0f8084080 con 0x7ff1081577d0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.204+0000 7ff10caf7700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff0f4066f30 0x7ff0f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.205+0000 7ff10caf7700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff0f4066f30 0x7ff0f40693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc006f00 tx=0x7ff0fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.209+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1080d15e0 con 0x7ff1081577d0 2023-10-08T16:07:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.444+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff10804c3c0 con 0x7ff1081577d0 2023-10-08T16:07:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.445+0000 7ff1057fa700 1 -- 172.21.15.60:0/3975502574 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7ff0f8051330 con 0x7ff1081577d0 2023-10-08T16:07:01.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:01.447 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:07:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff0f4066f30 msgr2=0x7ff0f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff0f4066f30 0x7ff0f40693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc006f00 tx=0x7ff0fc008040 comp rx=0 tx=0).stop 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 msgr2=0x7ff1081418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 0x7ff1081418a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c7c0 tx=0x7ff0f8007e00 comp rx=0 tx=0).stop 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 shutdown_connections 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff0f4066f30 0x7ff0f40693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff10815b0d0 0x7ff108155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1081577d0 0x7ff1081418a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 --2- 172.21.15.60:0/3975502574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff108157ba0 0x7ff1080cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 >> 172.21.15.60:0/3975502574 conn(0x7ff108068ce0 msgr2=0x7ff1080690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 shutdown_connections 2023-10-08T16:07:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.447+0000 7ff10f55c700 1 -- 172.21.15.60:0/3975502574 wait complete. 2023-10-08T16:07:01.450 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:07:01.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.578+0000 7f7581083700 1 Processor -- start 2023-10-08T16:07:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.578+0000 7f7581083700 1 -- start start 2023-10-08T16:07:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7581083700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f757c067660 0x7f757c067a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7581083700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c067fc0 con 0x7f757c068de0 2023-10-08T16:07:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7581083700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c069450 con 0x7f757c159f80 2023-10-08T16:07:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7581083700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c15a350 con 0x7f757c067660 2023-10-08T16:07:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7580882700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f757c067660 0x7f757c067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f757b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f757c068de0 0x7f757c0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42842/0 (socket says 172.21.15.60:42842) 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f757b7fe700 1 -- 172.21.15.60:0/1734415791 learned_addr learned my addr 172.21.15.60:0/1734415791 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7580882700 1 -- 172.21.15.60:0/1734415791 >> v1:172.21.15.144:6789/0 conn(0x7f757c159f80 legacy=0x7f757c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7580882700 1 -- 172.21.15.60:0/1734415791 >> v1:172.21.15.60:6789/0 conn(0x7f757c068de0 legacy=0x7f757c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f757affd700 1 -- 172.21.15.60:0/1734415791 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240467665 0 0) 0x7f757c069450 con 0x7f757c159f80 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7580882700 1 -- 172.21.15.60:0/1734415791 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0cb580 con 0x7f757c067660 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f7580882700 1 --2- 172.21.15.60:0/1734415791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c067660 0x7f757c067a80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7574009e60 tx=0x7f7574009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2898644fb79e9dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f757affd700 1 -- 172.21.15.60:0/1734415791 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400e070 con 0x7f757c067660 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f757affd700 1 -- 172.21.15.60:0/1734415791 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400bb30 con 0x7f757c067660 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.579+0000 7f757affd700 1 -- 172.21.15.60:0/1734415791 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574012430 con 0x7f757c067660 2023-10-08T16:07:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 -- 172.21.15.60:0/1734415791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c067660 msgr2=0x7f757c067a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 --2- 172.21.15.60:0/1734415791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c067660 0x7f757c067a80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7574009e60 tx=0x7f7574009780 comp rx=0 tx=0).stop 2023-10-08T16:07:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 -- 172.21.15.60:0/1734415791 shutdown_connections 2023-10-08T16:07:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 --2- 172.21.15.60:0/1734415791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c067660 0x7f757c067a80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 -- 172.21.15.60:0/1734415791 >> 172.21.15.60:0/1734415791 conn(0x7f757c06c700 msgr2=0x7f757c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 -- 172.21.15.60:0/1734415791 shutdown_connections 2023-10-08T16:07:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.580+0000 7f7581083700 1 -- 172.21.15.60:0/1734415791 wait complete. 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.581+0000 7f7581083700 1 Processor -- start 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.581+0000 7f7581083700 1 -- start start 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7581083700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f757c067660 0x7f757c16b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7581083700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 0x7f757c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7581083700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f757c159f80 0x7f757c0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7581083700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c069730 con 0x7f757c068de0 2023-10-08T16:07:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7581083700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c153e20 con 0x7f757c159f80 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7581083700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c151940 con 0x7f757c067660 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f757b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 0x7f757c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f757b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 0x7f757c0b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34716/0 (socket says 172.21.15.60:34716) 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f757b7fe700 1 -- 172.21.15.60:0/2244284653 learned_addr learned my addr 172.21.15.60:0/2244284653 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f7580882700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f757c159f80 0x7f757c0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f757bfff700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f757c067660 0x7f757c16b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f757b7fe700 1 -- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f757c067660 msgr2=0x7f757c16b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.582+0000 7f757b7fe700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f757c067660 0x7f757c16b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f757b7fe700 1 -- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f757c159f80 msgr2=0x7f757c0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f757b7fe700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f757c159f80 0x7f757c0b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f757b7fe700 1 -- 172.21.15.60:0/2244284653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009a20 con 0x7f757c068de0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f757b7fe700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 0x7f757c0b3320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f757000c7e0 tx=0x7f7570007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570005b30 con 0x7f757c068de0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570005c90 con 0x7f757c068de0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c16a900 con 0x7f757c068de0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570007340 con 0x7f757c068de0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.583+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c16aec0 con 0x7f757c068de0 2023-10-08T16:07:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.584+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c153f70 con 0x7f757c068de0 2023-10-08T16:07:01.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.584+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f757001b400 con 0x7f757c068de0 2023-10-08T16:07:01.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.585+0000 7f7563fff700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.585+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7570084050 con 0x7f757c068de0 2023-10-08T16:07:01.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.585+0000 7f757bfff700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.585+0000 7f757bfff700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f756c0038a0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.589+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f757c153f70 con 0x7f757c068de0 2023-10-08T16:07:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.779+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f757c153f70 con 0x7f757c068de0 2023-10-08T16:07:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.780+0000 7f7563fff700 1 -- 172.21.15.60:0/2244284653 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f757c153f70 con 0x7f757c068de0 2023-10-08T16:07:01.782 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:01.782 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:54.371404+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:25.007166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:26.073203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7568066f30 msgr2=0x7f75680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f756c0038a0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 msgr2=0x7f757c0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 0x7f757c0b3320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f757000c7e0 tx=0x7f7570007e70 comp rx=0 tx=0).stop 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 shutdown_connections 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f757c067660 0x7f757c16b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f757c159f80 0x7f757c0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 --2- 172.21.15.60:0/2244284653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c068de0 0x7f757c0b3320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 >> 172.21.15.60:0/2244284653 conn(0x7f757c06c700 msgr2=0x7f757c0b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 shutdown_connections 2023-10-08T16:07:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.782+0000 7f7581083700 1 -- 172.21.15.60:0/2244284653 wait complete. 2023-10-08T16:07:01.796 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:07:01.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 Processor -- start 2023-10-08T16:07:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 -- start start 2023-10-08T16:07:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4704159e10 0x7f47040b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f470415a1e0 0x7f47040b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f47040cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470415e800 con 0x7f470415a1e0 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470415db80 con 0x7f4704159e10 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.914+0000 7f470a86f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470415de60 con 0x7f47040b1610 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f470415a1e0 0x7f47040b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f470415a1e0 0x7f47040b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34722/0 (socket says 172.21.15.60:34722) 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 -- 172.21.15.60:0/2234745139 learned_addr learned my addr 172.21.15.60:0/2234745139 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f4708e0c700 1 --2- 172.21.15.60:0/2234745139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f47040cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f4703fff700 1 --2- 172.21.15.60:0/2234745139 >> v2:172.21.15.144:3300/0 conn(0x7f4704159e10 0x7f47040b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 -- 172.21.15.60:0/2234745139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 msgr2=0x7f47040cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 --2- 172.21.15.60:0/2234745139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f47040cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 -- 172.21.15.60:0/2234745139 >> v2:172.21.15.144:3300/0 conn(0x7f4704159e10 msgr2=0x7f47040b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 --2- 172.21.15.60:0/2234745139 >> v2:172.21.15.144:3300/0 conn(0x7f4704159e10 0x7f47040b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 -- 172.21.15.60:0/2234745139 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470415e140 con 0x7f470415a1e0 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f4703fff700 1 --2- 172.21.15.60:0/2234745139 >> v2:172.21.15.144:3300/0 conn(0x7f4704159e10 0x7f47040b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f47037fe700 1 --2- 172.21.15.60:0/2234745139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f470415a1e0 0x7f47040b3260 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4704068a60 tx=0x7f46f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4539ac6c86b489 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f4702ffd700 1 -- 172.21.15.60:0/2234745139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400b860 con 0x7f470415a1e0 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f4702ffd700 1 -- 172.21.15.60:0/2234745139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400b9c0 con 0x7f470415a1e0 2023-10-08T16:07:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.915+0000 7f4702ffd700 1 -- 172.21.15.60:0/2234745139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400bd60 con 0x7f470415a1e0 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 -- 172.21.15.60:0/2234745139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f470415a1e0 msgr2=0x7f47040b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 --2- 172.21.15.60:0/2234745139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f470415a1e0 0x7f47040b3260 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4704068a60 tx=0x7f46f4009250 comp rx=0 tx=0).stop 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 -- 172.21.15.60:0/2234745139 shutdown_connections 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 --2- 172.21.15.60:0/2234745139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f47040cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 --2- 172.21.15.60:0/2234745139 >> v2:172.21.15.144:3300/0 conn(0x7f4704159e10 0x7f47040b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 --2- 172.21.15.60:0/2234745139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f470415a1e0 0x7f47040b3260 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 -- 172.21.15.60:0/2234745139 >> 172.21.15.60:0/2234745139 conn(0x7f4704067660 msgr2=0x7f4704067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 -- 172.21.15.60:0/2234745139 shutdown_connections 2023-10-08T16:07:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.916+0000 7f470a86f700 1 -- 172.21.15.60:0/2234745139 wait complete. 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.917+0000 7f470a86f700 1 Processor -- start 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.917+0000 7f470a86f700 1 -- start start 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f470a86f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f4704157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f470a86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 0x7f4704157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f470a86f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f470415a1e0 0x7f47040c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f470a86f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470416d2b0 con 0x7f4704159e10 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f470a86f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040c80c0 con 0x7f470415a1e0 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f470a86f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470416d570 con 0x7f47040b1610 2023-10-08T16:07:01.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 0x7f4704157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 0x7f4704157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34726/0 (socket says 172.21.15.60:34726) 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 -- 172.21.15.60:0/3244983837 learned_addr learned my addr 172.21.15.60:0/3244983837 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f4703fff700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f4704157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f4708e0c700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f470415a1e0 0x7f47040c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 -- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 msgr2=0x7f4704157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f4704157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 -- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f470415a1e0 msgr2=0x7f47040c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f470415a1e0 0x7f47040c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 -- 172.21.15.60:0/3244983837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40094f0 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f47037fe700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 0x7f4704157b80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4704089c80 tx=0x7f46f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4011dc0 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.918+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4024440 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.919+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4024800 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.919+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470416d850 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.919+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470416e050 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.920+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470404c3c0 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.920+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46f401a420 con 0x7f4704159e10 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.920+0000 7f46fbfff700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46e4066f30 0x7f46e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.921+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f46f40863e0 con 0x7f4704159e10 2023-10-08T16:07:01.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.921+0000 7f4703fff700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46e4066f30 0x7f46e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:01.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.921+0000 7f4703fff700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46e4066f30 0x7f46e40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00adc0 tx=0x7f46ec006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:01.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:01.925+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46f4053610 con 0x7f4704159e10 2023-10-08T16:07:02.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.161+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f470415e420 con 0x7f4704159e10 2023-10-08T16:07:02.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.162+0000 7f46fbfff700 1 -- 172.21.15.60:0/3244983837 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f46f4056c30 con 0x7f4704159e10 2023-10-08T16:07:02.163 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:02.164 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46e4066f30 msgr2=0x7f46e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46e4066f30 0x7f46e40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00adc0 tx=0x7f46ec006f90 comp rx=0 tx=0).stop 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 msgr2=0x7f4704157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 0x7f4704157b80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4704089c80 tx=0x7f46f4017000 comp rx=0 tx=0).stop 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 shutdown_connections 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46e4066f30 0x7f46e40693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47040b1610 0x7f4704157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f470415a1e0 0x7f47040c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 --2- 172.21.15.60:0/3244983837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4704159e10 0x7f4704157b80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 >> 172.21.15.60:0/3244983837 conn(0x7f4704067660 msgr2=0x7f470415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:02.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 shutdown_connections 2023-10-08T16:07:02.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.164+0000 7f470a86f700 1 -- 172.21.15.60:0/3244983837 wait complete. 2023-10-08T16:07:02.167 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:07:02.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.294+0000 7f69b0415700 1 Processor -- start 2023-10-08T16:07:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.294+0000 7f69b0415700 1 -- start start 2023-10-08T16:07:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69b0415700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69a8159cf0 0x7f69a815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69b0415700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69b0415700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a80cca20 con 0x7f69a815a0c0 2023-10-08T16:07:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69b0415700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a815ea40 con 0x7f69a8159cf0 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69b0415700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8067660 con 0x7f69a80cf1c0 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69ae1b1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69a8159cf0 0x7f69a815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69ae1b1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69a8159cf0 0x7f69a815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34732/0 (socket says 172.21.15.60:34732) 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69ae1b1700 1 -- 172.21.15.60:0/3562812601 learned_addr learned my addr 172.21.15.60:0/3562812601 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.295+0000 7f69ae9b2700 1 --2- 172.21.15.60:0/3562812601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ae1b1700 1 -- 172.21.15.60:0/3562812601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 msgr2=0x7f69a8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ae1b1700 1 --2- 172.21.15.60:0/3562812601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ae1b1700 1 -- 172.21.15.60:0/3562812601 >> v1:172.21.15.144:6789/0 conn(0x7f69a815a0c0 legacy=0x7f69a80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ae1b1700 1 -- 172.21.15.60:0/3562812601 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8067f00 con 0x7f69a8159cf0 2023-10-08T16:07:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ae1b1700 1 --2- 172.21.15.60:0/3562812601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a815e500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f69a00099b0 tx=0x7f69a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e754212ceb4f5d6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ad1af700 1 -- 172.21.15.60:0/3562812601 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0009ea0 con 0x7f69a8159cf0 2023-10-08T16:07:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ad1af700 1 -- 172.21.15.60:0/3562812601 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a000b860 con 0x7f69a8159cf0 2023-10-08T16:07:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69ad1af700 1 -- 172.21.15.60:0/3562812601 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a000bc00 con 0x7f69a8159cf0 2023-10-08T16:07:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69b0415700 1 -- 172.21.15.60:0/3562812601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 msgr2=0x7f69a815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.296+0000 7f69b0415700 1 --2- 172.21.15.60:0/3562812601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a815e500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f69a00099b0 tx=0x7f69a0009250 comp rx=0 tx=0).stop 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.297+0000 7f69b0415700 1 -- 172.21.15.60:0/3562812601 shutdown_connections 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.297+0000 7f69b0415700 1 --2- 172.21.15.60:0/3562812601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.297+0000 7f69b0415700 1 --2- 172.21.15.60:0/3562812601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a815e500 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.297+0000 7f69b0415700 1 -- 172.21.15.60:0/3562812601 >> 172.21.15.60:0/3562812601 conn(0x7f69a806c6e0 msgr2=0x7f69a8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.297+0000 7f69b0415700 1 -- 172.21.15.60:0/3562812601 shutdown_connections 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.297+0000 7f69b0415700 1 -- 172.21.15.60:0/3562812601 wait complete. 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.298+0000 7f69b0415700 1 Processor -- start 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.298+0000 7f69b0415700 1 -- start start 2023-10-08T16:07:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a80ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69a815a0c0 0x7f69a80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8158530 con 0x7f69a8159cf0 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8157920 con 0x7f69a815a0c0 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8157c00 con 0x7f69a80cf1c0 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a80ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a80ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34744/0 (socket says 172.21.15.60:34744) 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 -- 172.21.15.60:0/2072428088 learned_addr learned my addr 172.21.15.60:0/2072428088 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ae1b1700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ae9b2700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69a815a0c0 0x7f69a80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 -- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 msgr2=0x7f69a8154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 -- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69a815a0c0 msgr2=0x7f69a80ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69a815a0c0 0x7f69a80ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 -- 172.21.15.60:0/2072428088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00094f0 con 0x7f69a8159cf0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69ad9b0700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a80ab410 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f699800c4e0 tx=0x7f699800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998011590 con 0x7f69a8159cf0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6998011710 con 0x7f69a8159cf0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998011ad0 con 0x7f69a8159cf0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a8157ee0 con 0x7f69a8159cf0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.299+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a8154ed0 con 0x7f69a8159cf0 2023-10-08T16:07:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.300+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a804c3c0 con 0x7f69a8159cf0 2023-10-08T16:07:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.301+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f699801b3b0 con 0x7f69a8159cf0 2023-10-08T16:07:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.301+0000 7f699e7fc700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f698c066f30 0x7f698c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.301+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f69980839d0 con 0x7f69a8159cf0 2023-10-08T16:07:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.302+0000 7f69ae1b1700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f698c066f30 0x7f698c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.302+0000 7f69ae1b1700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f698c066f30 0x7f698c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f69a00099b0 tx=0x7f69a0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.306+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6998050b60 con 0x7f69a8159cf0 2023-10-08T16:07:02.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:02.488 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.543+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69a80ce730 con 0x7f69a8159cf0 2023-10-08T16:07:02.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.543+0000 7f699e7fc700 1 -- 172.21.15.60:0/2072428088 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f6998017070 con 0x7f69a8159cf0 2023-10-08T16:07:02.545 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:02.545 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:06:27.093610+0000","modified":"2023-10-08T16:06:30.715322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1769619712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1769619712},{"type":"v1","addr":"172.21.15.144:6835","nonce":1769619712}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.545+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f698c066f30 msgr2=0x7f698c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.545+0000 7f69b0415700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f698c066f30 0x7f698c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f69a00099b0 tx=0x7f69a0017000 comp rx=0 tx=0).stop 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 msgr2=0x7f69a80ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a80ab410 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f699800c4e0 tx=0x7f699800c7f0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 shutdown_connections 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f698c066f30 0x7f698c0693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69a80cf1c0 0x7f69a8154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69a815a0c0 0x7f69a80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 --2- 172.21.15.60:0/2072428088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69a8159cf0 0x7f69a80ab410 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 >> 172.21.15.60:0/2072428088 conn(0x7f69a806c6e0 msgr2=0x7f69a8068d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:02.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 shutdown_connections 2023-10-08T16:07:02.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.546+0000 7f69b0415700 1 -- 172.21.15.60:0/2072428088 wait complete. 2023-10-08T16:07:02.549 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2023-10-08T16:07:02.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.677+0000 7f0e011ee700 1 Processor -- start 2023-10-08T16:07:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.677+0000 7f0e011ee700 1 -- start start 2023-10-08T16:07:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e011ee700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc06aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e011ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0dfc068ae0 0x7f0dfc070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e011ee700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc06a050 con 0x7f0dfc068710 2023-10-08T16:07:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e011ee700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c9c20 con 0x7f0dfc068ae0 2023-10-08T16:07:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e011ee700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0acdc0 con 0x7f0dfc06f660 2023-10-08T16:07:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0dfbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0dfc068710 0x7f0dfc0c9510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60664/0 (socket says 172.21.15.60:60664) 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0dfbfff700 1 -- 172.21.15.60:0/2375502325 learned_addr learned my addr 172.21.15.60:0/2375502325 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e009ed700 1 --2- 172.21.15.60:0/2375502325 >> v2:172.21.15.60:3300/0 conn(0x7f0dfc068ae0 0x7f0dfc070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0dfb7fe700 1 --2- 172.21.15.60:0/2375502325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc06aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0dfaffd700 1 -- 172.21.15.60:0/2375502325 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940922760 0 0) 0x7f0dfc06a050 con 0x7f0dfc068710 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0dfaffd700 1 -- 172.21.15.60:0/2375502325 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de8003570 con 0x7f0dfc068710 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e009ed700 1 -- 172.21.15.60:0/2375502325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 msgr2=0x7f0dfc06aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e009ed700 1 --2- 172.21.15.60:0/2375502325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc06aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e009ed700 1 -- 172.21.15.60:0/2375502325 >> v1:172.21.15.60:6789/0 conn(0x7f0dfc068710 legacy=0x7f0dfc0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.678+0000 7f0e009ed700 1 -- 172.21.15.60:0/2375502325 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0c9e00 con 0x7f0dfc068ae0 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e009ed700 1 --2- 172.21.15.60:0/2375502325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc070700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009e60 tx=0x7f0df4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503cac64bdc29b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0dfaffd700 1 -- 172.21.15.60:0/2375502325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df400e070 con 0x7f0dfc068ae0 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0dfaffd700 1 -- 172.21.15.60:0/2375502325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df400bb60 con 0x7f0dfc068ae0 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0dfaffd700 1 -- 172.21.15.60:0/2375502325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4012430 con 0x7f0dfc068ae0 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 -- 172.21.15.60:0/2375502325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 msgr2=0x7f0dfc070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2375502325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc070700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009e60 tx=0x7f0df4009780 comp rx=0 tx=0).stop 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 -- 172.21.15.60:0/2375502325 shutdown_connections 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2375502325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc070700 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2375502325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc06aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 -- 172.21.15.60:0/2375502325 >> 172.21.15.60:0/2375502325 conn(0x7f0dfc0cd8f0 msgr2=0x7f0dfc0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 -- 172.21.15.60:0/2375502325 shutdown_connections 2023-10-08T16:07:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.679+0000 7f0e011ee700 1 -- 172.21.15.60:0/2375502325 wait complete. 2023-10-08T16:07:02.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.680+0000 7f0e011ee700 1 Processor -- start 2023-10-08T16:07:02.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 -- start start 2023-10-08T16:07:02.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc068710 0x7f0dfc157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc155510 con 0x7f0dfc068ae0 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0b3080 con 0x7f0dfc068710 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.681+0000 7f0e011ee700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc154ec0 con 0x7f0dfc06f660 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55302/0 (socket says 172.21.15.60:55302) 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 -- 172.21.15.60:0/2936551357 learned_addr learned my addr 172.21.15.60:0/2936551357 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0e009ed700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfbfff700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc068710 0x7f0dfc157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 -- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 msgr2=0x7f0dfc0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 -- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc068710 msgr2=0x7f0dfc157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc068710 0x7f0dfc157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 -- 172.21.15.60:0/2936551357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4009a20 con 0x7f0dfc068ae0 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0e009ed700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0dfb7fe700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc169ca0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0de400d860 tx=0x7f0de4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:02.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4009610 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4009770 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4009b30 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc1551a0 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.682+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc0c6a70 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.683+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc154d20 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.684+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0de401e460 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.684+0000 7f0df3fff700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ddc066f30 0x7f0ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.684+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0de4084b90 con 0x7f0dfc068ae0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.684+0000 7f0dfbfff700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ddc066f30 0x7f0ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:02.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.685+0000 7f0dfbfff700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ddc066f30 0x7f0ddc0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0058d0 tx=0x7f0dec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:02.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.688+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dfc154d20 con 0x7f0dfc068ae0 2023-10-08T16:07:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.882+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dfc154d20 con 0x7f0dfc068ae0 2023-10-08T16:07:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.883+0000 7f0df3fff700 1 -- 172.21.15.60:0/2936551357 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f0dfc154d20 con 0x7f0dfc068ae0 2023-10-08T16:07:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:02.884 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:06:54.371404+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:06:25.007166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:06:26.073203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:02.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ddc066f30 msgr2=0x7f0ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ddc066f30 0x7f0ddc0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0058d0 tx=0x7f0dec009040 comp rx=0 tx=0).stop 2023-10-08T16:07:02.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 msgr2=0x7f0dfc169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc169ca0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0de400d860 tx=0x7f0de4008040 comp rx=0 tx=0).stop 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 shutdown_connections 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0ddc066f30 0x7f0ddc0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0dfc06f660 0x7f0dfc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc068710 0x7f0dfc157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.884+0000 7f0e011ee700 1 --2- 172.21.15.60:0/2936551357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dfc068ae0 0x7f0dfc169ca0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.885+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 >> 172.21.15.60:0/2936551357 conn(0x7f0dfc0cd8f0 msgr2=0x7f0dfc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.885+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 shutdown_connections 2023-10-08T16:07:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:02.885+0000 7f0e011ee700 1 -- 172.21.15.60:0/2936551357 wait complete. 2023-10-08T16:07:02.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:07:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.016+0000 7f173060e700 1 Processor -- start 2023-10-08T16:07:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.016+0000 7f173060e700 1 -- start start 2023-10-08T16:07:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.017+0000 7f173060e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17281577d0 0x7f17280cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.017+0000 7f173060e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1728157ba0 0x7f172806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.017+0000 7f173060e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172815c360 con 0x7f172815b0d0 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.017+0000 7f173060e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172815b790 con 0x7f17281577d0 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.017+0000 7f173060e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172815d800 con 0x7f1728157ba0 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17281577d0 0x7f17280cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17281577d0 0x7f17280cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55304/0 (socket says 172.21.15.60:55304) 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 -- 172.21.15.60:0/3008131108 learned_addr learned my addr 172.21.15.60:0/3008131108 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172dba9700 1 --2- 172.21.15.60:0/3008131108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1728157ba0 0x7f172806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172d3a8700 1 -- 172.21.15.60:0/3008131108 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089479210 0 0) 0x7f172815c360 con 0x7f172815b0d0 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 -- 172.21.15.60:0/3008131108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1728157ba0 msgr2=0x7f172806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 --2- 172.21.15.60:0/3008131108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1728157ba0 0x7f172806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 -- 172.21.15.60:0/3008131108 >> v1:172.21.15.144:6789/0 conn(0x7f172815b0d0 legacy=0x7f172815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 -- 172.21.15.60:0/3008131108 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172815ba30 con 0x7f17281577d0 2023-10-08T16:07:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172e3aa700 1 --2- 172.21.15.60:0/3008131108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17281577d0 0x7f17280cd770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1718009f20 tx=0x7f1718009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6cd27033290e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172d3a8700 1 -- 172.21.15.60:0/3008131108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800e070 con 0x7f17281577d0 2023-10-08T16:07:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172d3a8700 1 -- 172.21.15.60:0/3008131108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800b9d0 con 0x7f17281577d0 2023-10-08T16:07:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.018+0000 7f172d3a8700 1 -- 172.21.15.60:0/3008131108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180092e0 con 0x7f17281577d0 2023-10-08T16:07:03.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 -- 172.21.15.60:0/3008131108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17281577d0 msgr2=0x7f17280cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 --2- 172.21.15.60:0/3008131108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17281577d0 0x7f17280cd770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1718009f20 tx=0x7f1718009840 comp rx=0 tx=0).stop 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 -- 172.21.15.60:0/3008131108 shutdown_connections 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 --2- 172.21.15.60:0/3008131108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17281577d0 0x7f17280cd770 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 --2- 172.21.15.60:0/3008131108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1728157ba0 0x7f172806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 -- 172.21.15.60:0/3008131108 >> 172.21.15.60:0/3008131108 conn(0x7f1728068ce0 msgr2=0x7f17280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 -- 172.21.15.60:0/3008131108 shutdown_connections 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.019+0000 7f173060e700 1 -- 172.21.15.60:0/3008131108 wait complete. 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.020+0000 7f173060e700 1 Processor -- start 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.020+0000 7f173060e700 1 -- start start 2023-10-08T16:07:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17281577d0 0x7f172816af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1728157ba0 0x7f17280b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 0x7f172814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b1aa0 con 0x7f172815b0d0 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b0fd0 con 0x7f1728157ba0 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b20c0 con 0x7f17281577d0 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 0x7f172814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172dba9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1728157ba0 0x7f17280b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172e3aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17281577d0 0x7f172816af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 0x7f172814bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55310/0 (socket says 172.21.15.60:55310) 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 -- 172.21.15.60:0/43808071 learned_addr learned my addr 172.21.15.60:0/43808071 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 -- 172.21.15.60:0/43808071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17281577d0 msgr2=0x7f172816af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17281577d0 0x7f172816af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 -- 172.21.15.60:0/43808071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1728157ba0 msgr2=0x7f17280b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1728157ba0 0x7f17280b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 -- 172.21.15.60:0/43808071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009ae0 con 0x7f172815b0d0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f172ebab700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 0x7f172814bc70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f172000c5d0 tx=0x7f1720007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720011590 con 0x7f172815b0d0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17200116f0 con 0x7f172815b0d0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280b1200 con 0x7f172815b0d0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720011ab0 con 0x7f172815b0d0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.021+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280b17c0 con 0x7f172815b0d0 2023-10-08T16:07:03.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.022+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172804c3c0 con 0x7f172815b0d0 2023-10-08T16:07:03.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.023+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f172001b3b0 con 0x7f172815b0d0 2023-10-08T16:07:03.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.023+0000 7f17267fc700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1714066f30 0x7f17140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.023+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1720083980 con 0x7f172815b0d0 2023-10-08T16:07:03.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.023+0000 7f172e3aa700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1714066f30 0x7f17140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.024+0000 7f172e3aa700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1714066f30 0x7f17140693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1718009880 tx=0x7f1718018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.027+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1720050bb0 con 0x7f172815b0d0 2023-10-08T16:07:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.264+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17280b2200 con 0x7f172815b0d0 2023-10-08T16:07:03.266 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:07:03.265+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:07:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.270+0000 7f17267fc700 1 -- 172.21.15.60:0/43808071 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1720017070 con 0x7f172815b0d0 2023-10-08T16:07:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1714066f30 msgr2=0x7f17140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1714066f30 0x7f17140693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1718009880 tx=0x7f1718018000 comp rx=0 tx=0).stop 2023-10-08T16:07:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 msgr2=0x7f172814bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 0x7f172814bc70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f172000c5d0 tx=0x7f1720007d70 comp rx=0 tx=0).stop 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 shutdown_connections 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1714066f30 0x7f17140693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17281577d0 0x7f172816af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f172815b0d0 0x7f172814bc70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 --2- 172.21.15.60:0/43808071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1728157ba0 0x7f17280b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 >> 172.21.15.60:0/43808071 conn(0x7f1728068ce0 msgr2=0x7f172814c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 shutdown_connections 2023-10-08T16:07:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.272+0000 7f173060e700 1 -- 172.21.15.60:0/43808071 wait complete. 2023-10-08T16:07:03.275 INFO:tasks.ceph.mds.b.smithi144.stderr: -9043> 2023-10-08T16:06:32.684+0000 7f44eb725700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:07:03.275 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:07:03.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:07:03.305 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:07:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.405+0000 7fbcd1ff4700 1 Processor -- start 2023-10-08T16:07:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.405+0000 7fbcd1ff4700 1 -- start start 2023-10-08T16:07:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbcd1ff4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbccc159e60 0x7fbccc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbcd1ff4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbccc15a230 0x7fbccc0690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbcd1ff4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc15ea90 con 0x7fbccc0695f0 2023-10-08T16:07:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbcd1ff4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0d1cf0 con 0x7fbccc15a230 2023-10-08T16:07:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbcd1ff4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc069a30 con 0x7fbccc159e60 2023-10-08T16:07:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbccaffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbccc15a230 0x7fbccc0690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbccbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbccc0695f0 0x7fbccc0af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60668/0 (socket says 172.21.15.60:60668) 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.406+0000 7fbccbfff700 1 -- 172.21.15.60:0/4247036253 learned_addr learned my addr 172.21.15.60:0/4247036253 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccb7fe700 1 --2- 172.21.15.60:0/4247036253 >> v2:172.21.15.144:3300/0 conn(0x7fbccc159e60 0x7fbccc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccaffd700 1 -- 172.21.15.60:0/4247036253 >> v2:172.21.15.144:3300/0 conn(0x7fbccc159e60 msgr2=0x7fbccc15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccaffd700 1 --2- 172.21.15.60:0/4247036253 >> v2:172.21.15.144:3300/0 conn(0x7fbccc159e60 0x7fbccc15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccaffd700 1 -- 172.21.15.60:0/4247036253 >> v1:172.21.15.60:6789/0 conn(0x7fbccc0695f0 legacy=0x7fbccc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccaffd700 1 -- 172.21.15.60:0/4247036253 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0b3100 con 0x7fbccc15a230 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbcca7fc700 1 -- 172.21.15.60:0/4247036253 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811408740 0 0) 0x7fbccc15ea90 con 0x7fbccc0695f0 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccb7fe700 1 --2- 172.21.15.60:0/4247036253 >> v2:172.21.15.144:3300/0 conn(0x7fbccc159e60 0x7fbccc15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbccaffd700 1 --2- 172.21.15.60:0/4247036253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc0690b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0cdf30 tx=0x7fbcc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9160697e5bdfae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbcca7fc700 1 -- 172.21.15.60:0/4247036253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000b6b0 con 0x7fbccc15a230 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbcca7fc700 1 -- 172.21.15.60:0/4247036253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000b810 con 0x7fbccc15a230 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.407+0000 7fbcca7fc700 1 -- 172.21.15.60:0/4247036253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000bbb0 con 0x7fbccc15a230 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/4247036253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 msgr2=0x7fbccc0690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/4247036253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc0690b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0cdf30 tx=0x7fbcc00091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/4247036253 shutdown_connections 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/4247036253 >> v2:172.21.15.144:3300/0 conn(0x7fbccc159e60 0x7fbccc15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/4247036253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc0690b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/4247036253 >> 172.21.15.60:0/4247036253 conn(0x7fbccc070700 msgr2=0x7fbccc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:03.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/4247036253 shutdown_connections 2023-10-08T16:07:03.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.408+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/4247036253 wait complete. 2023-10-08T16:07:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.409+0000 7fbcd1ff4700 1 Processor -- start 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.409+0000 7fbcd1ff4700 1 -- start start 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbccc0695f0 0x7fbccc153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbccc159e60 0x7fbccc0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0c8860 con 0x7fbccc15a230 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0c8b40 con 0x7fbccc0695f0 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0c8e20 con 0x7fbccc159e60 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc1589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55324/0 (socket says 172.21.15.60:55324) 2023-10-08T16:07:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 -- 172.21.15.60:0/547152606 learned_addr learned my addr 172.21.15.60:0/547152606 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccb7fe700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbccc0695f0 0x7fbccc153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccaffd700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbccc159e60 0x7fbccc0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 -- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbccc159e60 msgr2=0x7fbccc0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbccc159e60 0x7fbccc0c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 -- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbccc0695f0 msgr2=0x7fbccc153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbccc0695f0 0x7fbccc153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 -- 172.21.15.60:0/547152606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0009420 con 0x7fbccc15a230 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbccbfff700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc1589f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400cc90 tx=0x7fbcc4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400a8b0 con 0x7fbccc15a230 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc400aa10 con 0x7fbccc15a230 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc0c9100 con 0x7fbccc15a230 2023-10-08T16:07:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.410+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400add0 con 0x7fbccc15a230 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.411+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc0c9900 con 0x7fbccc15a230 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.411+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc04c3c0 con 0x7fbccc15a230 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.412+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcc4007300 con 0x7fbccc15a230 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.412+0000 7fbcb37fe700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbcb8066f30 0x7fbcb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.412+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fbcc40848e0 con 0x7fbccc15a230 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.412+0000 7fbccb7fe700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbcb8066f30 0x7fbcb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.413+0000 7fbccb7fe700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbcb8066f30 0x7fbcb80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00adc0 tx=0x7fbcbc006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.416+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcc4051b40 con 0x7fbccc15a230 2023-10-08T16:07:03.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:03.654+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbccc0cb590 con 0x7fbccc15a230 2023-10-08T16:07:04.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.304+0000 7fbcb37fe700 1 -- 172.21.15.60:0/547152606 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbcc4055160 con 0x7fbccc15a230 2023-10-08T16:07:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbcb8066f30 msgr2=0x7fbcb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbcb8066f30 0x7fbcb80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00adc0 tx=0x7fbcbc006f90 comp rx=0 tx=0).stop 2023-10-08T16:07:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 msgr2=0x7fbccc1589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc1589f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400cc90 tx=0x7fbcc4001a80 comp rx=0 tx=0).stop 2023-10-08T16:07:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 shutdown_connections 2023-10-08T16:07:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbcb8066f30 0x7fbcb80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc15a230 0x7fbccc1589f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbccc0695f0 0x7fbccc153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 --2- 172.21.15.60:0/547152606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbccc159e60 0x7fbccc0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.306+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 >> 172.21.15.60:0/547152606 conn(0x7fbccc070700 msgr2=0x7fbccc067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.307+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 shutdown_connections 2023-10-08T16:07:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.307+0000 7fbcd1ff4700 1 -- 172.21.15.60:0/547152606 wait complete. 2023-10-08T16:07:04.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:07:04.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.447+0000 7fd44f169700 1 Processor -- start 2023-10-08T16:07:04.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.447+0000 7fd44f169700 1 -- start start 2023-10-08T16:07:04.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.447+0000 7fd44f169700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd448159e50 0x7fd4480b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.447+0000 7fd44f169700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4480b0d60 con 0x7fd4480b3370 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.447+0000 7fd44f169700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4480d15b0 con 0x7fd448068cb0 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.447+0000 7fd44f169700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4480d1890 con 0x7fd448159e50 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd44cf05700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd448159e50 0x7fd4480b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd447fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4480b3370 0x7fd4480b11f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60670/0 (socket says 172.21.15.60:60670) 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd447fff700 1 -- 172.21.15.60:0/4200461275 learned_addr learned my addr 172.21.15.60:0/4200461275 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd44cf05700 1 -- 172.21.15.60:0/4200461275 >> v1:172.21.15.144:6789/0 conn(0x7fd448068cb0 legacy=0x7fd4480690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd44cf05700 1 -- 172.21.15.60:0/4200461275 >> v1:172.21.15.60:6789/0 conn(0x7fd4480b3370 legacy=0x7fd4480b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd44cf05700 1 -- 172.21.15.60:0/4200461275 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480b09f0 con 0x7fd448159e50 2023-10-08T16:07:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd4477fe700 1 -- 172.21.15.60:0/4200461275 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883039306 0 0) 0x7fd4480b0d60 con 0x7fd4480b3370 2023-10-08T16:07:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd44cf05700 1 --2- 172.21.15.60:0/4200461275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448159e50 0x7fd4480b2e30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd4400098e0 tx=0x7fd4400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee95a8730c79511b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd4477fe700 1 -- 172.21.15.60:0/4200461275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440009e80 con 0x7fd448159e50 2023-10-08T16:07:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd4477fe700 1 -- 172.21.15.60:0/4200461275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44000b860 con 0x7fd448159e50 2023-10-08T16:07:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.448+0000 7fd4477fe700 1 -- 172.21.15.60:0/4200461275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000bbe0 con 0x7fd448159e50 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 -- 172.21.15.60:0/4200461275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448159e50 msgr2=0x7fd4480b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 --2- 172.21.15.60:0/4200461275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448159e50 0x7fd4480b2e30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd4400098e0 tx=0x7fd4400091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 -- 172.21.15.60:0/4200461275 shutdown_connections 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 --2- 172.21.15.60:0/4200461275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448159e50 0x7fd4480b2e30 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 -- 172.21.15.60:0/4200461275 >> 172.21.15.60:0/4200461275 conn(0x7fd448068130 msgr2=0x7fd4480d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 -- 172.21.15.60:0/4200461275 shutdown_connections 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.449+0000 7fd44f169700 1 -- 172.21.15.60:0/4200461275 wait complete. 2023-10-08T16:07:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.450+0000 7fd44f169700 1 Processor -- start 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.450+0000 7fd44f169700 1 -- start start 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44f169700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 0x7fd448158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44f169700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4480b3370 0x7fd4480cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44f169700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd448159e50 0x7fd44816a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44f169700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480cb060 con 0x7fd448068cb0 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44f169700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480c90a0 con 0x7fd448159e50 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44f169700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480c9380 con 0x7fd4480b3370 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 0x7fd448158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 0x7fd448158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55342/0 (socket says 172.21.15.60:55342) 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 -- 172.21.15.60:0/1567781686 learned_addr learned my addr 172.21.15.60:0/1567781686 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd447fff700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4480b3370 0x7fd4480cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 -- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4480b3370 msgr2=0x7fd4480cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4480b3370 0x7fd4480cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44d706700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd448159e50 0x7fd44816a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 -- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd448159e50 msgr2=0x7fd44816a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd448159e50 0x7fd44816a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44cf05700 1 -- 172.21.15.60:0/1567781686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440009420 con 0x7fd448068cb0 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd447fff700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4480b3370 0x7fd4480cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.451+0000 7fd44d706700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd448159e50 0x7fd44816a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.452+0000 7fd44cf05700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 0x7fd448158160 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd4480d0cd0 tx=0x7fd440017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.452+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44001f070 con 0x7fd448068cb0 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.452+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440011420 con 0x7fd448068cb0 2023-10-08T16:07:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.452+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4480c9660 con 0x7fd448068cb0 2023-10-08T16:07:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.452+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000bbe0 con 0x7fd448068cb0 2023-10-08T16:07:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.452+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4480c8d50 con 0x7fd448068cb0 2023-10-08T16:07:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.453+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44804c3c0 con 0x7fd448068cb0 2023-10-08T16:07:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.453+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd440011a50 con 0x7fd448068cb0 2023-10-08T16:07:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.454+0000 7fd444ff9700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.454+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fd440085ac0 con 0x7fd448068cb0 2023-10-08T16:07:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.454+0000 7fd447fff700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.454+0000 7fd447fff700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd438000f80 tx=0x7fd438009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.458+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd440052ca0 con 0x7fd448068cb0 2023-10-08T16:07:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:04.652+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4480b4b30 con 0x7fd448068cb0 2023-10-08T16:07:05.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.501+0000 7fd444ff9700 1 -- 172.21.15.60:0/1567781686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd4400562c0 con 0x7fd448068cb0 2023-10-08T16:07:05.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 msgr2=0x7fd4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:05.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd438000f80 tx=0x7fd438009040 comp rx=0 tx=0).stop 2023-10-08T16:07:05.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 msgr2=0x7fd448158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 0x7fd448158160 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd4480d0cd0 tx=0x7fd440017000 comp rx=0 tx=0).stop 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 shutdown_connections 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd448159e50 0x7fd44816a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448068cb0 0x7fd448158160 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 --2- 172.21.15.60:0/1567781686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd4480b3370 0x7fd4480cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 >> 172.21.15.60:0/1567781686 conn(0x7fd448068130 msgr2=0x7fd4480b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 shutdown_connections 2023-10-08T16:07:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.504+0000 7fd44f169700 1 -- 172.21.15.60:0/1567781686 wait complete. 2023-10-08T16:07:05.507 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:07:05.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:07:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.650+0000 7f995068b700 1 Processor -- start 2023-10-08T16:07:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.650+0000 7f995068b700 1 -- start start 2023-10-08T16:07:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.650+0000 7f995068b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9948156de0 0x7f99480cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f995068b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480ac440 con 0x7f99480c9df0 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f995068b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480abe80 con 0x7f9948156a10 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f995068b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99480ac160 con 0x7f9948156de0 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994dc26700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9948156de0 0x7f99480cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994ec28700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f99480c9df0 0x7f99480c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60682/0 (socket says 172.21.15.60:60682) 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994ec28700 1 -- 172.21.15.60:0/2314870837 learned_addr learned my addr 172.21.15.60:0/2314870837 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994dc26700 1 -- 172.21.15.60:0/2314870837 >> v1:172.21.15.144:6789/0 conn(0x7f9948156a10 legacy=0x7f99480ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994dc26700 1 -- 172.21.15.60:0/2314870837 >> v1:172.21.15.60:6789/0 conn(0x7f99480c9df0 legacy=0x7f99480c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994dc26700 1 -- 172.21.15.60:0/2314870837 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99480c7050 con 0x7f9948156de0 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994d425700 1 -- 172.21.15.60:0/2314870837 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153330165 0 0) 0x7f99480ac440 con 0x7f99480c9df0 2023-10-08T16:07:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994dc26700 1 --2- 172.21.15.60:0/2314870837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156de0 0x7f99480cb990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f993c00bb90 tx=0x7f993c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9435846cba3e7214 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994d425700 1 -- 172.21.15.60:0/2314870837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00db60 con 0x7f9948156de0 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994d425700 1 -- 172.21.15.60:0/2314870837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00dcc0 con 0x7f9948156de0 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.651+0000 7f994d425700 1 -- 172.21.15.60:0/2314870837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0106a0 con 0x7f9948156de0 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 -- 172.21.15.60:0/2314870837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156de0 msgr2=0x7f99480cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 --2- 172.21.15.60:0/2314870837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156de0 0x7f99480cb990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f993c00bb90 tx=0x7f993c00b430 comp rx=0 tx=0).stop 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 -- 172.21.15.60:0/2314870837 shutdown_connections 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 --2- 172.21.15.60:0/2314870837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156de0 0x7f99480cb990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 -- 172.21.15.60:0/2314870837 >> 172.21.15.60:0/2314870837 conn(0x7f99480cd450 msgr2=0x7f99480c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 -- 172.21.15.60:0/2314870837 shutdown_connections 2023-10-08T16:07:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.652+0000 7f995068b700 1 -- 172.21.15.60:0/2314870837 wait complete. 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.653+0000 7f995068b700 1 Processor -- start 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.653+0000 7f995068b700 1 -- start start 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f995068b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99480c9df0 0x7f994814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f995068b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 0x7f99480ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f995068b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9948156de0 0x7f99480ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f995068b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480c6660 con 0x7f9948156a10 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f995068b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480c59e0 con 0x7f99480c9df0 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f995068b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99480c5cc0 con 0x7f9948156de0 2023-10-08T16:07:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 0x7f99480ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 0x7f99480ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55354/0 (socket says 172.21.15.60:55354) 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 -- 172.21.15.60:0/209678832 learned_addr learned my addr 172.21.15.60:0/209678832 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994e427700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99480c9df0 0x7f994814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994ec28700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9948156de0 0x7f99480ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 -- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9948156de0 msgr2=0x7f99480ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9948156de0 0x7f99480ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 -- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99480c9df0 msgr2=0x7f994814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99480c9df0 0x7f994814a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 -- 172.21.15.60:0/209678832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c00b6d0 con 0x7f9948156a10 2023-10-08T16:07:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994e427700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99480c9df0 0x7f994814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.654+0000 7f994dc26700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 0x7f99480ae230 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b6a0 tx=0x7f993c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.655+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c018970 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.655+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c01d050 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.655+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c018d40 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.655+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99480c5fa0 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.655+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99480c56b0 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.656+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994804c3c0 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.656+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f993c023680 con 0x7f9948156a10 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.656+0000 7f99467fc700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9934066f30 0x7f99340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.657+0000 7f994e427700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9934066f30 0x7f99340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:05.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.657+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f993c014070 con 0x7f9948156a10 2023-10-08T16:07:05.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.657+0000 7f994e427700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9934066f30 0x7f99340693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9940007fd0 tx=0x7f9940009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:05.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.661+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f993c056130 con 0x7f9948156a10 2023-10-08T16:07:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:05.858+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f99480af3f0 con 0x7f9948156a10 2023-10-08T16:07:06.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.509+0000 7f99467fc700 1 -- 172.21.15.60:0/209678832 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f993c059750 con 0x7f9948156a10 2023-10-08T16:07:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.512+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9934066f30 msgr2=0x7f99340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9934066f30 0x7f99340693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9940007fd0 tx=0x7f9940009040 comp rx=0 tx=0).stop 2023-10-08T16:07:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 msgr2=0x7f99480ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 0x7f99480ae230 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b6a0 tx=0x7f993c01a000 comp rx=0 tx=0).stop 2023-10-08T16:07:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 shutdown_connections 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9934066f30 0x7f99340693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9948156de0 0x7f99480ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99480c9df0 0x7f994814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 --2- 172.21.15.60:0/209678832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9948156a10 0x7f99480ae230 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 >> 172.21.15.60:0/209678832 conn(0x7f99480cd450 msgr2=0x7f99480c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 shutdown_connections 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.513+0000 7f995068b700 1 -- 172.21.15.60:0/209678832 wait complete. 2023-10-08T16:07:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:07:06.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:07:06.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.655+0000 7f7d78041700 1 Processor -- start 2023-10-08T16:07:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.655+0000 7f7d78041700 1 -- start start 2023-10-08T16:07:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d78041700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 0x7f7d700d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d78041700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d701513f0 con 0x7f7d700d12a0 2023-10-08T16:07:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d78041700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700d1700 con 0x7f7d700cd300 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d78041700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7015e7a0 con 0x7f7d7015afb0 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d765de700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7d700d12a0 0x7f7d700cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60690/0 (socket says 172.21.15.60:60690) 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d765de700 1 -- 172.21.15.60:0/3934495044 learned_addr learned my addr 172.21.15.60:0/3934495044 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.656+0000 7f7d755dc700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 0x7f7d700d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620981528 0 0) 0x7f7d701513f0 con 0x7f7d700d12a0 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d58003570 con 0x7f7d700d12a0 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061328086 0 0) 0x7f7d60001490 con 0x7f7d700cd300 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d701513f0 con 0x7f7d700cd300 2023-10-08T16:07:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2107269880 0 0) 0x7f7d58003570 con 0x7f7d700d12a0 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 msgr2=0x7f7d700d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 0x7f7d700d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 >> v1:172.21.15.144:6789/0 conn(0x7f7d700cd300 legacy=0x7f7d700b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7015b400 con 0x7f7d700d12a0 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f7d68001470 con 0x7f7d700d12a0 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 >> v1:172.21.15.60:6789/0 conn(0x7f7d700d12a0 legacy=0x7f7d700cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d58003c20 0x7f7d58004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 0x7f7d58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d58004d50 0x7f7d580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7015e7a0 con 0x7f7d58004d50 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5800bb40 con 0x7f7d58003c20 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5800bd00 con 0x7f7d7015afb0 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d765de700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d58004d50 0x7f7d580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d75ddd700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d58003c20 0x7f7d58004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d755dc700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 0x7f7d58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d765de700 1 -- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 msgr2=0x7f7d58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d765de700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7015afb0 0x7f7d58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d765de700 1 -- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d58003c20 msgr2=0x7f7d58004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d765de700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d58003c20 0x7f7d58004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.657+0000 7f7d765de700 1 -- 172.21.15.60:0/3934495044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58003570 con 0x7f7d58004d50 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d765de700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d58004d50 0x7f7d580051c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800c2d0 tx=0x7f7d70154ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f233780a5951dd1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800cc00 con 0x7f7d58004d50 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800cd60 con 0x7f7d58004d50 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d74ddb700 1 -- 172.21.15.60:0/3934495044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68005b70 con 0x7f7d58004d50 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d78041700 1 -- 172.21.15.60:0/3934495044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d58004d50 msgr2=0x7f7d580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d78041700 1 --2- 172.21.15.60:0/3934495044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d58004d50 0x7f7d580051c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800c2d0 tx=0x7f7d70154ac0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d765de700 1 -- 172.21.15.60:0/3934495044 reap_dead start 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d78041700 1 -- 172.21.15.60:0/3934495044 shutdown_connections 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d78041700 1 -- 172.21.15.60:0/3934495044 >> 172.21.15.60:0/3934495044 conn(0x7f7d70068d90 msgr2=0x7f7d70069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d78041700 1 -- 172.21.15.60:0/3934495044 shutdown_connections 2023-10-08T16:07:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.658+0000 7f7d78041700 1 -- 172.21.15.60:0/3934495044 wait complete. 2023-10-08T16:07:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 Processor -- start 2023-10-08T16:07:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 -- start start 2023-10-08T16:07:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 0x7f7d7015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d7014c280 0x7f7d700b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d700b0bb0 0x7f7d7015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b1610 con 0x7f7d70147a40 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b1050 con 0x7f7d7014c280 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d78041700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b1330 con 0x7f7d700b0bb0 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d75ddd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 0x7f7d7015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d75ddd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 0x7f7d7015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55368/0 (socket says 172.21.15.60:55368) 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.660+0000 7f7d75ddd700 1 -- 172.21.15.60:0/2902407600 learned_addr learned my addr 172.21.15.60:0/2902407600 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d755dc700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d7014c280 0x7f7d700b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d765de700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d700b0bb0 0x7f7d7015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d75ddd700 1 -- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d700b0bb0 msgr2=0x7f7d7015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d75ddd700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d700b0bb0 0x7f7d7015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d75ddd700 1 -- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d7014c280 msgr2=0x7f7d700b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d75ddd700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d7014c280 0x7f7d700b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d75ddd700 1 -- 172.21.15.60:0/2902407600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7015c4a0 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d75ddd700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 0x7f7d7015cca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000ef10 tx=0x7f7d60001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60019070 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000cc40 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7015c780 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60015430 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.661+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d70147e10 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.662+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7004c3c0 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.662+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d600157e0 con 0x7f7d70147a40 2023-10-08T16:07:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.663+0000 7f7d6dffb700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7d5c066f30 0x7f7d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.663+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7d600848d0 con 0x7f7d70147a40 2023-10-08T16:07:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.663+0000 7f7d755dc700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7d5c066f30 0x7f7d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.663+0000 7f7d755dc700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7d5c066f30 0x7f7d5c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7d7015c250 tx=0x7f7d640091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.667+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d60051e40 con 0x7f7d70147a40 2023-10-08T16:07:06.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.859+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7d700d1700 con 0x7f7d70147a40 2023-10-08T16:07:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.863+0000 7f7d6dffb700 1 -- 172.21.15.60:0/2902407600 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d700d1700 con 0x7f7d70147a40 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7d5c066f30 msgr2=0x7f7d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7d5c066f30 0x7f7d5c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7d7015c250 tx=0x7f7d640091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 msgr2=0x7f7d7015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 0x7f7d7015cca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000ef10 tx=0x7f7d60001930 comp rx=0 tx=0).stop 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 shutdown_connections 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7d5c066f30 0x7f7d5c0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d700b0bb0 0x7f7d7015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d70147a40 0x7f7d7015cca0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 --2- 172.21.15.60:0/2902407600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d7014c280 0x7f7d700b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 >> 172.21.15.60:0/2902407600 conn(0x7f7d70068d90 msgr2=0x7f7d70159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 shutdown_connections 2023-10-08T16:07:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.865+0000 7f7d78041700 1 -- 172.21.15.60:0/2902407600 wait complete. 2023-10-08T16:07:06.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-08T16:07:06.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.996+0000 7fbded2e8700 1 Processor -- start 2023-10-08T16:07:06.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.996+0000 7fbded2e8700 1 -- start start 2023-10-08T16:07:06.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbded2e8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbde8159e10 0x7fbde80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbded2e8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbde815a1e0 0x7fbde80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:06.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbded2e8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde815db80 con 0x7fbde80b1610 2023-10-08T16:07:06.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbded2e8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde815e800 con 0x7fbde8159e10 2023-10-08T16:07:06.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbded2e8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde815de60 con 0x7fbde815a1e0 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbde8159e10 0x7fbde80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbde8159e10 0x7fbde80b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55370/0 (socket says 172.21.15.60:55370) 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 -- 172.21.15.60:0/2768147737 learned_addr learned my addr 172.21.15.60:0/2768147737 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde67fc700 1 --2- 172.21.15.60:0/2768147737 >> v2:172.21.15.144:3300/0 conn(0x7fbde815a1e0 0x7fbde80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 -- 172.21.15.60:0/2768147737 >> v2:172.21.15.144:3300/0 conn(0x7fbde815a1e0 msgr2=0x7fbde80b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 --2- 172.21.15.60:0/2768147737 >> v2:172.21.15.144:3300/0 conn(0x7fbde815a1e0 0x7fbde80b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 -- 172.21.15.60:0/2768147737 >> v1:172.21.15.144:6789/0 conn(0x7fbde80b1610 legacy=0x7fbde80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.997+0000 7fbde6ffd700 1 -- 172.21.15.60:0/2768147737 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde815e140 con 0x7fbde8159e10 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbde6ffd700 1 --2- 172.21.15.60:0/2768147737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8159e10 0x7fbde80b2d20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbde8068580 tx=0x7fbdd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7edb03bac087b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbde5ffb700 1 -- 172.21.15.60:0/2768147737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800e070 con 0x7fbde8159e10 2023-10-08T16:07:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbde5ffb700 1 -- 172.21.15.60:0/2768147737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd800ba10 con 0x7fbde8159e10 2023-10-08T16:07:07.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbde5ffb700 1 -- 172.21.15.60:0/2768147737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80092e0 con 0x7fbde8159e10 2023-10-08T16:07:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 -- 172.21.15.60:0/2768147737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8159e10 msgr2=0x7fbde80b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 --2- 172.21.15.60:0/2768147737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8159e10 0x7fbde80b2d20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbde8068580 tx=0x7fbdd8009840 comp rx=0 tx=0).stop 2023-10-08T16:07:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 -- 172.21.15.60:0/2768147737 shutdown_connections 2023-10-08T16:07:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 --2- 172.21.15.60:0/2768147737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8159e10 0x7fbde80b2d20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 --2- 172.21.15.60:0/2768147737 >> v2:172.21.15.144:3300/0 conn(0x7fbde815a1e0 0x7fbde80b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 -- 172.21.15.60:0/2768147737 >> 172.21.15.60:0/2768147737 conn(0x7fbde8067660 msgr2=0x7fbde8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 -- 172.21.15.60:0/2768147737 shutdown_connections 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:06.998+0000 7fbded2e8700 1 -- 172.21.15.60:0/2768147737 wait complete. 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 Processor -- start 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 -- start start 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 0x7fbde81469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbde8159e10 0x7fbde815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbde815a1e0 0x7fbde815d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8158860 con 0x7fbde80b1610 2023-10-08T16:07:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80ce870 con 0x7fbde815a1e0 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.000+0000 7fbded2e8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80ceb50 con 0x7fbde8159e10 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 0x7fbde81469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 0x7fbde81469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55372/0 (socket says 172.21.15.60:55372) 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 -- 172.21.15.60:0/443442560 learned_addr learned my addr 172.21.15.60:0/443442560 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde77fe700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbde815a1e0 0x7fbde815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde67fc700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbde8159e10 0x7fbde815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 -- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbde8159e10 msgr2=0x7fbde815cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbde8159e10 0x7fbde815cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 -- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbde815a1e0 msgr2=0x7fbde815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbde815a1e0 0x7fbde815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 -- 172.21.15.60:0/443442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8009ae0 con 0x7fbde80b1610 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbde6ffd700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 0x7fbde81469a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbde8089c80 tx=0x7fbdd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80094e0 con 0x7fbde80b1610 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8012850 con 0x7fbde80b1610 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde80c6ec0 con 0x7fbde80b1610 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8012bf0 con 0x7fbde80b1610 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.001+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde80c7480 con 0x7fbde80b1610 2023-10-08T16:07:07.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.002+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde804c3c0 con 0x7fbde80b1610 2023-10-08T16:07:07.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.003+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdd8012d50 con 0x7fbde80b1610 2023-10-08T16:07:07.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.003+0000 7fbddeffd700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbdc8066f30 0x7fbdc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.003+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbdd8085a80 con 0x7fbde80b1610 2023-10-08T16:07:07.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.003+0000 7fbde67fc700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbdc8066f30 0x7fbdc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.003+0000 7fbde67fc700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbdc8066f30 0x7fbdc80693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbde8158f90 tx=0x7fbdd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.007+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdd8052ff0 con 0x7fbde80b1610 2023-10-08T16:07:07.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.282+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fbde815e420 con 0x7fbde80b1610 2023-10-08T16:07:07.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.510+0000 7fbddeffd700 1 -- 172.21.15.60:0/443442560 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v137) v1 ==== 142+0+0 (secure 0 0 0) 0x7fbdd8056610 con 0x7fbde80b1610 2023-10-08T16:07:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbdc8066f30 msgr2=0x7fbdc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbdc8066f30 0x7fbdc80693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbde8158f90 tx=0x7fbdd0008040 comp rx=0 tx=0).stop 2023-10-08T16:07:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 msgr2=0x7fbde81469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 0x7fbde81469a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbde8089c80 tx=0x7fbdd8017000 comp rx=0 tx=0).stop 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 shutdown_connections 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbdc8066f30 0x7fbdc80693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbde815a1e0 0x7fbde815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde80b1610 0x7fbde81469a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 --2- 172.21.15.60:0/443442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbde8159e10 0x7fbde815cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 >> 172.21.15.60:0/443442560 conn(0x7fbde8067660 msgr2=0x7fbde8159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 shutdown_connections 2023-10-08T16:07:07.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.513+0000 7fbded2e8700 1 -- 172.21.15.60:0/443442560 wait complete. 2023-10-08T16:07:07.526 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-08T16:07:07.526 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T16:07:07.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-08T16:07:07.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.644+0000 7fae930ab700 1 Processor -- start 2023-10-08T16:07:07.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.645+0000 7fae930ab700 1 -- start start 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.645+0000 7fae930ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 0x7fae8c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.645+0000 7fae930ab700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c15c360 con 0x7fae8c06ac30 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.645+0000 7fae930ab700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c15b790 con 0x7fae8c157ba0 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.645+0000 7fae930ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c15ba30 con 0x7fae8c1577d0 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.645+0000 7fae91648700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fae8c06ac30 0x7fae8c15c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60706/0 (socket says 172.21.15.60:60706) 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae91648700 1 -- 172.21.15.60:0/3106558758 learned_addr learned my addr 172.21.15.60:0/3106558758 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae90e47700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 0x7fae8c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572056499 0 0) 0x7fae8c15c360 con 0x7fae8c06ac30 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae78003570 con 0x7fae8c06ac30 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935505024 0 0) 0x7fae78003570 con 0x7fae8c06ac30 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 msgr2=0x7fae8c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 0x7fae8c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 >> v1:172.21.15.144:6789/0 conn(0x7fae8c157ba0 legacy=0x7fae8c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c15bd10 con 0x7fae8c06ac30 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fae84001470 con 0x7fae8c06ac30 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 >> v1:172.21.15.60:6789/0 conn(0x7fae8c06ac30 legacy=0x7fae8c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 0x7fae78003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae78003fd0 0x7fae78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae78004d50 0x7fae780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c15ba30 con 0x7fae78004d50 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7800bb40 con 0x7fae78003fd0 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7800bd00 con 0x7fae8c1577d0 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae91648700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae78004d50 0x7fae780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae90e47700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 0x7fae78003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.646+0000 7fae8bfff700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae78003fd0 0x7fae78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 -- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 msgr2=0x7fae78003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c1577d0 0x7fae78003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 -- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae78003fd0 msgr2=0x7fae78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae78003fd0 0x7fae78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 -- 172.21.15.60:0/3106558758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78003570 con 0x7fae78004d50 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae78004d50 0x7fae780051c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fae8400c2a0 tx=0x7fae84001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56893155380f9ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400cb90 con 0x7fae78004d50 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400ccf0 con 0x7fae78004d50 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae8b7fe700 1 -- 172.21.15.60:0/3106558758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84005b70 con 0x7fae78004d50 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae930ab700 1 -- 172.21.15.60:0/3106558758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae78004d50 msgr2=0x7fae780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae930ab700 1 --2- 172.21.15.60:0/3106558758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae78004d50 0x7fae780051c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fae8400c2a0 tx=0x7fae84001df0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae91648700 1 -- 172.21.15.60:0/3106558758 reap_dead start 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae930ab700 1 -- 172.21.15.60:0/3106558758 shutdown_connections 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.647+0000 7fae930ab700 1 -- 172.21.15.60:0/3106558758 >> 172.21.15.60:0/3106558758 conn(0x7fae8c068ce0 msgr2=0x7fae8c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:07.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.648+0000 7fae930ab700 1 -- 172.21.15.60:0/3106558758 shutdown_connections 2023-10-08T16:07:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.648+0000 7fae930ab700 1 -- 172.21.15.60:0/3106558758 wait complete. 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 Processor -- start 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 -- start start 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 0x7fae8c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c16b4e0 0x7fae8c0a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae8c16b950 0x7fae8c0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0a8500 con 0x7fae8c154610 2023-10-08T16:07:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0a7610 con 0x7fae8c16b950 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.649+0000 7fae930ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0a78f0 con 0x7fae8c16b4e0 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 0x7fae8c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 0x7fae8c0b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55390/0 (socket says 172.21.15.60:55390) 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 -- 172.21.15.60:0/3699599628 learned_addr learned my addr 172.21.15.60:0/3699599628 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae91648700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae8c16b950 0x7fae8c0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae8bfff700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c16b4e0 0x7fae8c0a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 -- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c16b4e0 msgr2=0x7fae8c0a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c16b4e0 0x7fae8c0a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 -- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae8c16b950 msgr2=0x7fae8c0a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae8c16b950 0x7fae8c0a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 -- 172.21.15.60:0/3699599628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0a7bd0 con 0x7fae8c154610 2023-10-08T16:07:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae90e47700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 0x7fae8c0b1ff0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fae74006ac0 tx=0x7fae740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7400f940 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7400faa0 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c0a7eb0 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7400fe20 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.650+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c16b1e0 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.651+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c04c3c0 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.652+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae74014650 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.652+0000 7fae88ff9700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae6c066f30 0x7fae6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.652+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fae74018030 con 0x7fae8c154610 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.652+0000 7fae8bfff700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae6c066f30 0x7fae6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.653+0000 7fae8bfff700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae6c066f30 0x7fae6c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae7c004290 tx=0x7fae7c0016d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:07.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.656+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae740521a0 con 0x7fae8c154610 2023-10-08T16:07:07.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:07.928+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fae8c15bff0 con 0x7fae8c154610 2023-10-08T16:07:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.519+0000 7fae88ff9700 1 -- 172.21.15.60:0/3699599628 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v138) v1 ==== 137+0+0 (secure 0 0 0) 0x7fae740220d0 con 0x7fae8c154610 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae6c066f30 msgr2=0x7fae6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae6c066f30 0x7fae6c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae7c004290 tx=0x7fae7c0016d0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 msgr2=0x7fae8c0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 0x7fae8c0b1ff0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fae74006ac0 tx=0x7fae740091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 shutdown_connections 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae6c066f30 0x7fae6c0693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae8c16b950 0x7fae8c0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae8c154610 0x7fae8c0b1ff0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 --2- 172.21.15.60:0/3699599628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae8c16b4e0 0x7fae8c0a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 >> 172.21.15.60:0/3699599628 conn(0x7fae8c068ce0 msgr2=0x7fae8c0b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 shutdown_connections 2023-10-08T16:07:08.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.521+0000 7fae930ab700 1 -- 172.21.15.60:0/3699599628 wait complete. 2023-10-08T16:07:08.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T16:07:08.673 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_objectstore":"memstore"} 2023-10-08T16:07:08.673 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T16:07:08.674 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:07:08.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.794+0000 7f887d948700 1 Processor -- start 2023-10-08T16:07:08.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.794+0000 7f887d948700 1 -- start start 2023-10-08T16:07:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f887d948700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 0x7f887815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f887d948700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887815ea90 con 0x7f88780697c0 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f887d948700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780b3100 con 0x7f887815a230 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f887d948700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780d1cf0 con 0x7f8878159e60 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f88777fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88780697c0 0x7f88780af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60720/0 (socket says 172.21.15.60:60720) 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f88777fe700 1 -- 172.21.15.60:0/1082645107 learned_addr learned my addr 172.21.15.60:0/1082645107 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8876ffd700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 0x7f887815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469610959 0 0) 0x7f887815ea90 con 0x7f88780697c0 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8860003570 con 0x7f88780697c0 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520746585 0 0) 0x7f8860003570 con 0x7f88780697c0 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 msgr2=0x7f887815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 0x7f887815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 >> v1:172.21.15.144:6789/0 conn(0x7f887815a230 legacy=0x7f88780690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780d10e0 con 0x7f88780697c0 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.795+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f8870001470 con 0x7f88780697c0 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 >> v1:172.21.15.60:6789/0 conn(0x7f88780697c0 legacy=0x7f88780af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8860003a90 0x7f8860003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 0x7f8860004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8860004d50 0x7f88600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780d1cf0 con 0x7f8860004d50 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886000bb70 con 0x7f8860003a90 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886000bd30 con 0x7f8878159e60 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8860004d50 0x7f88600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8876ffd700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8860003a90 0x7f8860003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88767fc700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 0x7f8860004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 -- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 msgr2=0x7f8860004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8878159e60 0x7f8860004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 -- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8860003a90 msgr2=0x7f8860003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8860003a90 0x7f8860003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 -- 172.21.15.60:0/1082645107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860003570 con 0x7f8860004d50 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f88777fe700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8860004d50 0x7f88600051c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8878069bc0 tx=0x7f8870001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9042372915604c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000cc30 con 0x7f8860004d50 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000cd90 con 0x7f8860004d50 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.796+0000 7f8875ffb700 1 -- 172.21.15.60:0/1082645107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870005b50 con 0x7f8860004d50 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f887d948700 1 -- 172.21.15.60:0/1082645107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8860004d50 msgr2=0x7f88600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f887d948700 1 --2- 172.21.15.60:0/1082645107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8860004d50 0x7f88600051c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8878069bc0 tx=0x7f8870001e50 comp rx=0 tx=0).stop 2023-10-08T16:07:08.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f88777fe700 1 -- 172.21.15.60:0/1082645107 reap_dead start 2023-10-08T16:07:08.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f887d948700 1 -- 172.21.15.60:0/1082645107 shutdown_connections 2023-10-08T16:07:08.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f887d948700 1 -- 172.21.15.60:0/1082645107 >> 172.21.15.60:0/1082645107 conn(0x7f8878070700 msgr2=0x7f8878070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:08.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f887d948700 1 -- 172.21.15.60:0/1082645107 shutdown_connections 2023-10-08T16:07:08.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.797+0000 7f887d948700 1 -- 172.21.15.60:0/1082645107 wait complete. 2023-10-08T16:07:08.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.798+0000 7f887d948700 1 Processor -- start 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.798+0000 7f887d948700 1 -- start start 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f887d948700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88781583c0 0x7f8878158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f887d948700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 0x7f887815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f887d948700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f887815d960 0x7f887815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f887d948700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887815d470 con 0x7f88780c54b0 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f887d948700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780c6560 con 0x7f887815d960 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f887d948700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887815e390 con 0x7f88781583c0 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 0x7f887815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 0x7f887815a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55396/0 (socket says 172.21.15.60:55396) 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 -- 172.21.15.60:0/160507298 learned_addr learned my addr 172.21.15.60:0/160507298 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:08.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f8876ffd700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88781583c0 0x7f8878158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88777fe700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f887815d960 0x7f887815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 -- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88781583c0 msgr2=0x7f8878158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88781583c0 0x7f8878158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 -- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f887815d960 msgr2=0x7f887815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f887815d960 0x7f887815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.799+0000 7f88767fc700 1 -- 172.21.15.60:0/160507298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887815e670 con 0x7f88780c54b0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.800+0000 7f88767fc700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 0x7f887815a690 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f886c002950 tx=0x7f886c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.800+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0033b0 con 0x7f88780c54b0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.800+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c006820 con 0x7f88780c54b0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.800+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88780c61f0 con 0x7f88780c54b0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.800+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c006bc0 con 0x7f88780c54b0 2023-10-08T16:07:08.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.800+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887815abd0 con 0x7f88780c54b0 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.801+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88780c66f0 con 0x7f88780c54b0 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.801+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f886c007020 con 0x7f88780c54b0 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.801+0000 7f885effd700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8864066f30 0x7f88640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.802+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f886c0840f0 con 0x7f88780c54b0 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.802+0000 7f8876ffd700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8864066f30 0x7f88640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.802+0000 7f8876ffd700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8864066f30 0x7f88640693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f88680094d0 tx=0x7f886800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:08.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.806+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f886c051660 con 0x7f88780c54b0 2023-10-08T16:07:08.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:08.998+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f887804c3c0 con 0x7f88780c54b0 2023-10-08T16:07:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.001+0000 7f885effd700 1 -- 172.21.15.60:0/160507298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f886c054c80 con 0x7f88780c54b0 2023-10-08T16:07:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8864066f30 msgr2=0x7f88640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8864066f30 0x7f88640693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f88680094d0 tx=0x7f886800b040 comp rx=0 tx=0).stop 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 msgr2=0x7f887815a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 0x7f887815a690 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f886c002950 tx=0x7f886c007d30 comp rx=0 tx=0).stop 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 shutdown_connections 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8864066f30 0x7f88640693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88781583c0 0x7f8878158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f887815d960 0x7f887815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 --2- 172.21.15.60:0/160507298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88780c54b0 0x7f887815a690 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 >> 172.21.15.60:0/160507298 conn(0x7f8878070700 msgr2=0x7f8878159410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 shutdown_connections 2023-10-08T16:07:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.003+0000 7f887d948700 1 -- 172.21.15.60:0/160507298 wait complete. 2023-10-08T16:07:09.016 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:07:09.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:07:09.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:07:09.118 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:07:09.118 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:07:09.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:09.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.235+0000 7f29c0535700 1 Processor -- start 2023-10-08T16:07:09.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.235+0000 7f29c0535700 1 -- start start 2023-10-08T16:07:09.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29c0535700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29b81523e0 0x7f29b806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29c0535700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b8158e50 0x7f29b80cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29c0535700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b806c010 con 0x7f29b8152010 2023-10-08T16:07:09.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29c0535700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b806bd10 con 0x7f29b81523e0 2023-10-08T16:07:09.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29c0535700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b815c060 con 0x7f29b8158e50 2023-10-08T16:07:09.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29bdad0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29b81523e0 0x7f29b806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29bdad0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29b81523e0 0x7f29b806c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55398/0 (socket says 172.21.15.60:55398) 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29bdad0700 1 -- 172.21.15.60:0/8689093 learned_addr learned my addr 172.21.15.60:0/8689093 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.236+0000 7f29bead2700 1 --2- 172.21.15.60:0/8689093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b8158e50 0x7f29b80cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bdad0700 1 -- 172.21.15.60:0/8689093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b8158e50 msgr2=0x7f29b80cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bdad0700 1 --2- 172.21.15.60:0/8689093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b8158e50 0x7f29b80cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bdad0700 1 -- 172.21.15.60:0/8689093 >> v1:172.21.15.144:6789/0 conn(0x7f29b8152010 legacy=0x7f29b815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bdad0700 1 -- 172.21.15.60:0/8689093 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b815c340 con 0x7f29b81523e0 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bdad0700 1 --2- 172.21.15.60:0/8689093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b81523e0 0x7f29b806c4a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099b0 tx=0x7f29ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3661629d0d9d9376 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bd2cf700 1 -- 172.21.15.60:0/8689093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00b860 con 0x7f29b81523e0 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bd2cf700 1 -- 172.21.15.60:0/8689093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00b9c0 con 0x7f29b81523e0 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29bd2cf700 1 -- 172.21.15.60:0/8689093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00bd60 con 0x7f29b81523e0 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29c0535700 1 -- 172.21.15.60:0/8689093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b81523e0 msgr2=0x7f29b806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.237+0000 7f29c0535700 1 --2- 172.21.15.60:0/8689093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b81523e0 0x7f29b806c4a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099b0 tx=0x7f29ac009250 comp rx=0 tx=0).stop 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.238+0000 7f29c0535700 1 -- 172.21.15.60:0/8689093 shutdown_connections 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.238+0000 7f29c0535700 1 --2- 172.21.15.60:0/8689093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b8158e50 0x7f29b80cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.238+0000 7f29c0535700 1 --2- 172.21.15.60:0/8689093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b81523e0 0x7f29b806c4a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.238+0000 7f29c0535700 1 -- 172.21.15.60:0/8689093 >> 172.21.15.60:0/8689093 conn(0x7f29b8069870 msgr2=0x7f29b8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.238+0000 7f29c0535700 1 -- 172.21.15.60:0/8689093 shutdown_connections 2023-10-08T16:07:09.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.238+0000 7f29c0535700 1 -- 172.21.15.60:0/8689093 wait complete. 2023-10-08T16:07:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 Processor -- start 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 -- start start 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 0x7f29b814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b81523e0 0x7f29b815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b8158e50 0x7f29b815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8168f40 con 0x7f29b8152010 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8168330 con 0x7f29b8158e50 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.239+0000 7f29c0535700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8168610 con 0x7f29b81523e0 2023-10-08T16:07:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 0x7f29b814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 0x7f29b814dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55406/0 (socket says 172.21.15.60:55406) 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 -- 172.21.15.60:0/1234783379 learned_addr learned my addr 172.21.15.60:0/1234783379 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29bead2700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b8158e50 0x7f29b815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29bdad0700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b81523e0 0x7f29b815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 -- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b81523e0 msgr2=0x7f29b815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b81523e0 0x7f29b815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 -- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b8158e50 msgr2=0x7f29b815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b8158e50 0x7f29b815ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 -- 172.21.15.60:0/1234783379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0094f0 con 0x7f29b8152010 2023-10-08T16:07:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29bead2700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b8158e50 0x7f29b815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29be2d1700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 0x7f29b814dc20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c790 tx=0x7f29b0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011590 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0011710 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b81688f0 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011ad0 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.240+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b814e160 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.241+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b804c3c0 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.242+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29b001b3b0 con 0x7f29b8152010 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.242+0000 7f29b67fc700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f29a4066f30 0x7f29a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.242+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f29b0083750 con 0x7f29b8152010 2023-10-08T16:07:09.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.242+0000 7f29bdad0700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f29a4066f30 0x7f29a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.243+0000 7f29bdad0700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f29a4066f30 0x7f29a40693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099b0 tx=0x7f29ac017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.246+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29b0050cc0 con 0x7f29b8152010 2023-10-08T16:07:09.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.483+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b806d690 con 0x7f29b8152010 2023-10-08T16:07:09.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.483+0000 7f29b67fc700 1 -- 172.21.15.60:0/1234783379 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f29b0017020 con 0x7f29b8152010 2023-10-08T16:07:09.485 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:09.485 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/787533131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":787533131},{"type":"v1","addr":"172.21.15.144:6834","nonce":787533131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1225235932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1225235932},{"type":"v1","addr":"172.21.15.60:6835","nonce":1225235932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3912431967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3912431967},{"type":"v1","addr":"172.21.15.60:6837","nonce":3912431967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1349696358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1349696358},{"type":"v1","addr":"172.21.15.144:6835","nonce":1349696358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-08T16:07:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f29a4066f30 msgr2=0x7f29a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f29a4066f30 0x7f29a40693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099b0 tx=0x7f29ac017000 comp rx=0 tx=0).stop 2023-10-08T16:07:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 msgr2=0x7f29b814dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 0x7f29b814dc20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c790 tx=0x7f29b0007f40 comp rx=0 tx=0).stop 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 shutdown_connections 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f29a4066f30 0x7f29a40693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b8158e50 0x7f29b815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b8152010 0x7f29b814dc20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 --2- 172.21.15.60:0/1234783379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29b81523e0 0x7f29b815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 >> 172.21.15.60:0/1234783379 conn(0x7f29b8069870 msgr2=0x7f29b80cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.485+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 shutdown_connections 2023-10-08T16:07:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.486+0000 7f29c0535700 1 -- 172.21.15.60:0/1234783379 wait complete. 2023-10-08T16:07:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2023-10-08T16:07:09.501 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:07:09.501 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:07:09.501 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:07:09.502 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:09.502 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:07:09.502 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:07:09.502 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:07:09.502 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:09.503 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:07:09.503 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:07:09.503 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:07:09.503 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:09.503 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:07:09.503 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:07:09.504 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:07:09.504 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:07:09.510 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:07:09.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:07:09.511 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:07:09.511 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:07:09.516 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:07:09.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:07:09.517 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:07:09.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:07:09.553 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:07:09.553 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:09.554 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:07:09.554 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:09.558 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:07:09.559 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:09.559 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:07:09.559 DEBUG:teuthology.parallel:result is None 2023-10-08T16:07:09.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:07:09.630 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:07:09.630 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:07:09.639 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:07:09.640 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:07:09.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.685+0000 7f1165745700 1 Processor -- start 2023-10-08T16:07:09.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.685+0000 7f1165745700 1 -- start start 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f1165745700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11600d1710 0x7f116006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f1165745700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116006ac90 con 0x7f1160159d50 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f1165745700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11600cf0e0 con 0x7f116006a830 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f1165745700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11600d1b60 con 0x7f11600d1710 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f115e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11600d1710 0x7f116006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f115effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1160159d50 0x7f11600af790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60754/0 (socket says 172.21.15.60:60754) 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.686+0000 7f115effd700 1 -- 172.21.15.60:0/498408167 learned_addr learned my addr 172.21.15.60:0/498408167 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115e7fc700 1 -- 172.21.15.60:0/498408167 >> v1:172.21.15.144:6789/0 conn(0x7f116006a830 legacy=0x7f11600cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115e7fc700 1 -- 172.21.15.60:0/498408167 >> v1:172.21.15.60:6789/0 conn(0x7f1160159d50 legacy=0x7f11600af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115e7fc700 1 -- 172.21.15.60:0/498408167 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600ce820 con 0x7f11600d1710 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115dffb700 1 -- 172.21.15.60:0/498408167 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125356456 0 0) 0x7f11600cf0e0 con 0x7f116006a830 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115e7fc700 1 --2- 172.21.15.60:0/498408167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11600d1710 0x7f116006a2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f11480098e0 tx=0x7f11480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea2b1453bbf886 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115dffb700 1 -- 172.21.15.60:0/498408167 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148009e80 con 0x7f11600d1710 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115dffb700 1 -- 172.21.15.60:0/498408167 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800b760 con 0x7f11600d1710 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f115dffb700 1 -- 172.21.15.60:0/498408167 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800bae0 con 0x7f11600d1710 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f1165745700 1 -- 172.21.15.60:0/498408167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11600d1710 msgr2=0x7f116006a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f1165745700 1 --2- 172.21.15.60:0/498408167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11600d1710 0x7f116006a2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f11480098e0 tx=0x7f11480091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f1165745700 1 -- 172.21.15.60:0/498408167 shutdown_connections 2023-10-08T16:07:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f1165745700 1 --2- 172.21.15.60:0/498408167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11600d1710 0x7f116006a2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f1165745700 1 -- 172.21.15.60:0/498408167 >> 172.21.15.60:0/498408167 conn(0x7f1160069630 msgr2=0x7f11600d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:09.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.687+0000 7f1165745700 1 -- 172.21.15.60:0/498408167 shutdown_connections 2023-10-08T16:07:09.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.688+0000 7f1165745700 1 -- 172.21.15.60:0/498408167 wait complete. 2023-10-08T16:07:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 Processor -- start 2023-10-08T16:07:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 -- start start 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f116006a830 0x7f1160153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11600d1710 0x7f11600b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 0x7f11600b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116015bbc0 con 0x7f1160159d50 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116015b890 con 0x7f11600d1710 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.689+0000 7f1165745700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11600c9050 con 0x7f116006a830 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 0x7f11600b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 0x7f11600b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55424/0 (socket says 172.21.15.60:55424) 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 -- 172.21.15.60:0/2264774282 learned_addr learned my addr 172.21.15.60:0/2264774282 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115e7fc700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11600d1710 0x7f11600b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115effd700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f116006a830 0x7f1160153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 -- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f116006a830 msgr2=0x7f1160153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f116006a830 0x7f1160153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 -- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11600d1710 msgr2=0x7f11600b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11600d1710 0x7f11600b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 -- 172.21.15.60:0/2264774282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148009420 con 0x7f1160159d50 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f115f7fe700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 0x7f11600b16b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1150001560 tx=0x7f1150001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150004160 con 0x7f1160159d50 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000a7e0 con 0x7f1160159d50 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11600c9330 con 0x7f1160159d50 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000aba0 con 0x7f1160159d50 2023-10-08T16:07:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.690+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11600c9610 con 0x7f1160159d50 2023-10-08T16:07:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.691+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116015bd30 con 0x7f1160159d50 2023-10-08T16:07:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.692+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1150012420 con 0x7f1160159d50 2023-10-08T16:07:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.692+0000 7f1156ffd700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1140066f30 0x7f11400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.692+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1150084000 con 0x7f1160159d50 2023-10-08T16:07:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.692+0000 7f115effd700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1140066f30 0x7f11400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.693+0000 7f115effd700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1140066f30 0x7f11400693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11580058d0 tx=0x7f1158009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.697+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1150051570 con 0x7f1160159d50 2023-10-08T16:07:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:09.904+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f11600b3290 con 0x7f1160159d50 2023-10-08T16:07:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.528+0000 7f1156ffd700 1 -- 172.21.15.60:0/2264774282 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1150054b90 con 0x7f1160159d50 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1140066f30 msgr2=0x7f11400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1140066f30 0x7f11400693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11580058d0 tx=0x7f1158009040 comp rx=0 tx=0).stop 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 msgr2=0x7f11600b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 0x7f11600b16b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1150001560 tx=0x7f1150001770 comp rx=0 tx=0).stop 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 shutdown_connections 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1140066f30 0x7f11400693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f116006a830 0x7f1160153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1160159d50 0x7f11600b16b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 --2- 172.21.15.60:0/2264774282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11600d1710 0x7f11600b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 >> 172.21.15.60:0/2264774282 conn(0x7f1160069630 msgr2=0x7f1160154730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 shutdown_connections 2023-10-08T16:07:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.531+0000 7f1165745700 1 -- 172.21.15.60:0/2264774282 wait complete. 2023-10-08T16:07:10.534 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:07:10.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:07:10.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.668+0000 7f18e4b9d700 1 Processor -- start 2023-10-08T16:07:10.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.668+0000 7f18e4b9d700 1 -- start start 2023-10-08T16:07:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18e4b9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18e0069a30 0x7f18e00cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18e4b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18e00c76b0 0x7f18e00cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18e4b9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00a9d30 con 0x7f18e0155f40 2023-10-08T16:07:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18e4b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00aab70 con 0x7f18e00c76b0 2023-10-08T16:07:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18e4b9d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00a9f60 con 0x7f18e0069a30 2023-10-08T16:07:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18dffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18e00c76b0 0x7f18e00cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18df7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f18e0155f40 0x7f18e0069320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60768/0 (socket says 172.21.15.60:60768) 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18df7fe700 1 -- 172.21.15.60:0/675887120 learned_addr learned my addr 172.21.15.60:0/675887120 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.669+0000 7f18deffd700 1 --2- 172.21.15.60:0/675887120 >> v2:172.21.15.144:3300/0 conn(0x7f18e0069a30 0x7f18e00cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18dffff700 1 -- 172.21.15.60:0/675887120 >> v2:172.21.15.144:3300/0 conn(0x7f18e0069a30 msgr2=0x7f18e00cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18dffff700 1 --2- 172.21.15.60:0/675887120 >> v2:172.21.15.144:3300/0 conn(0x7f18e0069a30 0x7f18e00cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18dffff700 1 -- 172.21.15.60:0/675887120 >> v1:172.21.15.60:6789/0 conn(0x7f18e0155f40 legacy=0x7f18e0069320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18dffff700 1 -- 172.21.15.60:0/675887120 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00aa240 con 0x7f18e00c76b0 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18de7fc700 1 -- 172.21.15.60:0/675887120 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041698095 0 0) 0x7f18e00a9d30 con 0x7f18e0155f40 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18dffff700 1 --2- 172.21.15.60:0/675887120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e00c76b0 0x7f18e00cc4a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18e006afc0 tx=0x7f18d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a08c07bc4d921 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18de7fc700 1 -- 172.21.15.60:0/675887120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800b740 con 0x7f18e00c76b0 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18de7fc700 1 -- 172.21.15.60:0/675887120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800b8a0 con 0x7f18e00c76b0 2023-10-08T16:07:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18de7fc700 1 -- 172.21.15.60:0/675887120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800bc40 con 0x7f18e00c76b0 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18e4b9d700 1 -- 172.21.15.60:0/675887120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e00c76b0 msgr2=0x7f18e00cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/675887120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e00c76b0 0x7f18e00cc4a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18e006afc0 tx=0x7f18d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18e4b9d700 1 -- 172.21.15.60:0/675887120 shutdown_connections 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/675887120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e00c76b0 0x7f18e00cc4a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/675887120 >> v2:172.21.15.144:3300/0 conn(0x7f18e0069a30 0x7f18e00cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.670+0000 7f18e4b9d700 1 -- 172.21.15.60:0/675887120 >> 172.21.15.60:0/675887120 conn(0x7f18e00cd070 msgr2=0x7f18e00cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.671+0000 7f18e4b9d700 1 -- 172.21.15.60:0/675887120 shutdown_connections 2023-10-08T16:07:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.671+0000 7f18e4b9d700 1 -- 172.21.15.60:0/675887120 wait complete. 2023-10-08T16:07:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 Processor -- start 2023-10-08T16:07:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 -- start start 2023-10-08T16:07:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 0x7f18e015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18e00c76b0 0x7f18e014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e0155f40 0x7f18e00c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0157840 con 0x7f18e0069a30 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c5ae0 con 0x7f18e0155f40 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.672+0000 7f18e4b9d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0157560 con 0x7f18e00c76b0 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 0x7f18e015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 0x7f18e015a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55440/0 (socket says 172.21.15.60:55440) 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 -- 172.21.15.60:0/2419281203 learned_addr learned my addr 172.21.15.60:0/2419281203 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18dffff700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e0155f40 0x7f18e00c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 -- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18e00c76b0 msgr2=0x7f18e014ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18e00c76b0 0x7f18e014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 -- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e0155f40 msgr2=0x7f18e00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e0155f40 0x7f18e00c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 -- 172.21.15.60:0/2419281203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009420 con 0x7f18e0069a30 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18dffff700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e0155f40 0x7f18e00c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18df7fe700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 0x7f18e015a550 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f18d000cca0 tx=0x7f18d0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000ab30 con 0x7f18e0069a30 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000ac90 con 0x7f18e0069a30 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00c5d50 con 0x7f18e0069a30 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0007300 con 0x7f18e0069a30 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.673+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00c6310 con 0x7f18e0069a30 2023-10-08T16:07:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.674+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00c6530 con 0x7f18e0069a30 2023-10-08T16:07:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.675+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18d00076f0 con 0x7f18e0069a30 2023-10-08T16:07:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.675+0000 7f18d77fe700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18c0066f30 0x7f18c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.675+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f18d00846d0 con 0x7f18e0069a30 2023-10-08T16:07:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.675+0000 7f18deffd700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18c0066f30 0x7f18c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.675+0000 7f18deffd700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18c0066f30 0x7f18c00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18e0168eb0 tx=0x7f18c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.679+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18d0051d10 con 0x7f18e0069a30 2023-10-08T16:07:10.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.952+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f18e00aa520 con 0x7f18e0069a30 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.952+0000 7f18d77fe700 1 -- 172.21.15.60:0/2419281203 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f18d0055330 con 0x7f18e0069a30 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:07:10.954 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:07:10.959 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.960 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:07:10.962 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:07:10.963 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:07:10.965 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.966 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:07:10.967 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:07:10.969 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:07:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18c0066f30 msgr2=0x7f18c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18c0066f30 0x7f18c00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18e0168eb0 tx=0x7f18c8008040 comp rx=0 tx=0).stop 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 msgr2=0x7f18e015a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 0x7f18e015a550 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f18d000cca0 tx=0x7f18d0001a30 comp rx=0 tx=0).stop 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 shutdown_connections 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18c0066f30 0x7f18c00693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e0155f40 0x7f18e00c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18e0069a30 0x7f18e015a550 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 --2- 172.21.15.60:0/2419281203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18e00c76b0 0x7f18e014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 >> 172.21.15.60:0/2419281203 conn(0x7f18e00cd070 msgr2=0x7f18e00c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 shutdown_connections 2023-10-08T16:07:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:10.955+0000 7f18e4b9d700 1 -- 172.21.15.60:0/2419281203 wait complete. 2023-10-08T16:07:10.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:11.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.089+0000 7ffba65d4700 1 Processor -- start 2023-10-08T16:07:11.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.089+0000 7ffba65d4700 1 -- start start 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba65d4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffba00cd6e0 0x7ffba00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba65d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba00cdab0 0x7ffba015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba65d4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffba015dda0 0x7ffba015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba65d4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba015e850 con 0x7ffba00cd6e0 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba65d4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba00cd030 con 0x7ffba015dda0 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba65d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00cb7c0 con 0x7ffba00cdab0 2023-10-08T16:07:11.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffba00cd6e0 0x7ffba00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffba00cd6e0 0x7ffba00cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55442/0 (socket says 172.21.15.60:55442) 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 -- 172.21.15.60:0/943179885 learned_addr learned my addr 172.21.15.60:0/943179885 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba4dd1700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba00cdab0 0x7ffba015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba5dd3700 1 --2- 172.21.15.60:0/943179885 >> v2:172.21.15.144:3300/0 conn(0x7ffba015dda0 0x7ffba015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 -- 172.21.15.60:0/943179885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba00cdab0 msgr2=0x7ffba015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba00cdab0 0x7ffba015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 -- 172.21.15.60:0/943179885 >> v2:172.21.15.144:3300/0 conn(0x7ffba015dda0 msgr2=0x7ffba015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 --2- 172.21.15.60:0/943179885 >> v2:172.21.15.144:3300/0 conn(0x7ffba015dda0 0x7ffba015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba55d2700 1 -- 172.21.15.60:0/943179885 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba015e290 con 0x7ffba00cd6e0 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.090+0000 7ffba4dd1700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba00cdab0 0x7ffba015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:11.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba5dd3700 1 --2- 172.21.15.60:0/943179885 >> v2:172.21.15.144:3300/0 conn(0x7ffba015dda0 0x7ffba015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba55d2700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cd6e0 0x7ffba00cbc50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffba0089ac0 tx=0x7ffb90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c270a05e56a1cd1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffb9ffff700 1 -- 172.21.15.60:0/943179885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9000e070 con 0x7ffba00cd6e0 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffb9ffff700 1 -- 172.21.15.60:0/943179885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9000ba50 con 0x7ffba00cd6e0 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffb9ffff700 1 -- 172.21.15.60:0/943179885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900092e0 con 0x7ffba00cd6e0 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 -- 172.21.15.60:0/943179885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cd6e0 msgr2=0x7ffba00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cd6e0 0x7ffba00cbc50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffba0089ac0 tx=0x7ffb90009840 comp rx=0 tx=0).stop 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 -- 172.21.15.60:0/943179885 shutdown_connections 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 --2- 172.21.15.60:0/943179885 >> v2:172.21.15.144:3300/0 conn(0x7ffba015dda0 0x7ffba015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cd6e0 0x7ffba00cbc50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 --2- 172.21.15.60:0/943179885 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba00cdab0 0x7ffba015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.091+0000 7ffba65d4700 1 -- 172.21.15.60:0/943179885 >> 172.21.15.60:0/943179885 conn(0x7ffba0067660 msgr2=0x7ffba0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.092+0000 7ffba65d4700 1 -- 172.21.15.60:0/943179885 shutdown_connections 2023-10-08T16:07:11.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.092+0000 7ffba65d4700 1 -- 172.21.15.60:0/943179885 wait complete. 2023-10-08T16:07:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 Processor -- start 2023-10-08T16:07:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 -- start start 2023-10-08T16:07:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cd6e0 0x7ffba00b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 0x7ffba015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba015dda0 0x7ffba01588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00b5b60 con 0x7ffba00cdab0 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00b4f50 con 0x7ffba00cd6e0 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.093+0000 7ffba65d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00b5230 con 0x7ffba015dda0 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 0x7ffba015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 0x7ffba015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55444/0 (socket says 172.21.15.60:55444) 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 -- 172.21.15.60:0/820529341 learned_addr learned my addr 172.21.15.60:0/820529341 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba55d2700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cd6e0 0x7ffba00b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba5dd3700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba015dda0 0x7ffba01588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 -- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba015dda0 msgr2=0x7ffba01588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba015dda0 0x7ffba01588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 -- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cd6e0 msgr2=0x7ffba00b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cd6e0 0x7ffba00b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 -- 172.21.15.60:0/820529341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90009ae0 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba5dd3700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba015dda0 0x7ffba01588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba4dd1700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 0x7ffba015b090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400e8d0 tx=0x7ffb94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94013410 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94013570 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba00b5510 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94013910 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.094+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba015b5d0 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.095+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba00b5cd0 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.096+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb94013d00 con 0x7ffba00cdab0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.096+0000 7ffb9d7fa700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb8c066f30 0x7ffb8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.096+0000 7ffba55d2700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb8c066f30 0x7ffb8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.096+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffb94083f30 con 0x7ffba00cdab0 2023-10-08T16:07:11.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.097+0000 7ffba55d2700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb8c066f30 0x7ffb8c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb90009880 tx=0x7ffb90018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.100+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb940514f0 con 0x7ffba00cdab0 2023-10-08T16:07:11.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.295+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffba015e570 con 0x7ffba00cdab0 2023-10-08T16:07:11.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.295+0000 7ffb9d7fa700 1 -- 172.21.15.60:0/820529341 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+12134 (secure 0 0 0) 0x7ffb94054b10 con 0x7ffba00cdab0 2023-10-08T16:07:11.297 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:11.297 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:07:10.534720+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb8c066f30 msgr2=0x7ffb8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb8c066f30 0x7ffb8c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb90009880 tx=0x7ffb90018000 comp rx=0 tx=0).stop 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 msgr2=0x7ffba015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 0x7ffba015b090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400e8d0 tx=0x7ffb94008040 comp rx=0 tx=0).stop 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 shutdown_connections 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffb8c066f30 0x7ffb8c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffba015dda0 0x7ffba01588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffba00cd6e0 0x7ffba00b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 --2- 172.21.15.60:0/820529341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffba00cdab0 0x7ffba015b090 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 >> 172.21.15.60:0/820529341 conn(0x7ffba0067660 msgr2=0x7ffba01567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 shutdown_connections 2023-10-08T16:07:11.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.297+0000 7ffba65d4700 1 -- 172.21.15.60:0/820529341 wait complete. 2023-10-08T16:07:11.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:07:11.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:07:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.432+0000 7f83e3cca700 1 Processor -- start 2023-10-08T16:07:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.432+0000 7f83e3cca700 1 -- start start 2023-10-08T16:07:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.433+0000 7f83e3cca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.433+0000 7f83e3cca700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83dc0697c0 0x7f83dc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.433+0000 7f83e3cca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc15ea90 con 0x7f83dc15a230 2023-10-08T16:07:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.433+0000 7f83e3cca700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0d1cf0 con 0x7f83dc0697c0 2023-10-08T16:07:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.433+0000 7f83e3cca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b3100 con 0x7f83dc159e60 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e2267700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83dc0697c0 0x7f83dc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:39978/0 (socket says 172.21.15.60:39978) 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1265700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f83dc15a230 0x7f83dc0690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:42694/0 (socket says 172.21.15.60:42694) 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 -- 172.21.15.60:0/2102495905 learned_addr learned my addr 172.21.15.60:0/2102495905 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e0a64700 1 -- 172.21.15.60:0/2102495905 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410665131 0 0) 0x7f83dc15ea90 con 0x7f83dc15a230 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e0a64700 1 -- 172.21.15.60:0/2102495905 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c4003570 con 0x7f83dc15a230 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 -- 172.21.15.60:0/2102495905 >> v2:172.21.15.144:3300/0 conn(0x7f83dc0697c0 msgr2=0x7f83dc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 --2- 172.21.15.60:0/2102495905 >> v2:172.21.15.144:3300/0 conn(0x7f83dc0697c0 0x7f83dc0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 -- 172.21.15.60:0/2102495905 >> v1:172.21.15.144:6789/0 conn(0x7f83dc15a230 legacy=0x7f83dc0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 -- 172.21.15.60:0/2102495905 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0d10e0 con 0x7f83dc159e60 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e2267700 1 --2- 172.21.15.60:0/2102495905 >> v2:172.21.15.144:3300/0 conn(0x7f83dc0697c0 0x7f83dc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e1a66700 1 --2- 172.21.15.60:0/2102495905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc15e550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83d40099b0 tx=0x7f83d4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c07a16461cb39828 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.434+0000 7f83e0a64700 1 -- 172.21.15.60:0/2102495905 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d400b680 con 0x7f83dc159e60 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e0a64700 1 -- 172.21.15.60:0/2102495905 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d400b7e0 con 0x7f83dc159e60 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e0a64700 1 -- 172.21.15.60:0/2102495905 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d400bb60 con 0x7f83dc159e60 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 -- 172.21.15.60:0/2102495905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 msgr2=0x7f83dc15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 --2- 172.21.15.60:0/2102495905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc15e550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83d40099b0 tx=0x7f83d4009250 comp rx=0 tx=0).stop 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 -- 172.21.15.60:0/2102495905 shutdown_connections 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 --2- 172.21.15.60:0/2102495905 >> v2:172.21.15.144:3300/0 conn(0x7f83dc0697c0 0x7f83dc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 --2- 172.21.15.60:0/2102495905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc15e550 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 -- 172.21.15.60:0/2102495905 >> 172.21.15.60:0/2102495905 conn(0x7f83dc070700 msgr2=0x7f83dc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 -- 172.21.15.60:0/2102495905 shutdown_connections 2023-10-08T16:07:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.435+0000 7f83e3cca700 1 -- 172.21.15.60:0/2102495905 wait complete. 2023-10-08T16:07:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.436+0000 7f83e3cca700 1 Processor -- start 2023-10-08T16:07:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.436+0000 7f83e3cca700 1 -- start start 2023-10-08T16:07:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e3cca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83dc0697c0 0x7f83dc1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e3cca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e3cca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 0x7f83dc0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e3cca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc15d650 con 0x7f83dc15a230 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e3cca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc16a520 con 0x7f83dc0697c0 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e3cca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc16a7c0 con 0x7f83dc159e60 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 0x7f83dc0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 0x7f83dc0b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55452/0 (socket says 172.21.15.60:55452) 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 -- 172.21.15.60:0/1113485874 learned_addr learned my addr 172.21.15.60:0/1113485874 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e1a66700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83dc0697c0 0x7f83dc1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e1265700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 -- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 msgr2=0x7f83dc0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc0b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 -- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83dc0697c0 msgr2=0x7f83dc1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83dc0697c0 0x7f83dc1583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.437+0000 7f83e2267700 1 -- 172.21.15.60:0/1113485874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc009a20 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.438+0000 7f83e2267700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 0x7f83dc0b0c80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009ec0 tx=0x7f83cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.438+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00cb70 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.438+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00f040 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.438+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d40094f0 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.438+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc014480 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.438+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc16ad80 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.439+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc0b3380 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.439+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83cc003020 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.440+0000 7f83d9ffb700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83c8066f30 0x7f83c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.440+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f83cc084ae0 con 0x7f83dc15a230 2023-10-08T16:07:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.440+0000 7f83e1a66700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83c8066f30 0x7f83c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.440+0000 7f83e1a66700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83c8066f30 0x7f83c80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83d40099b0 tx=0x7f83d4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.444+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83cc052000 con 0x7f83dc15a230 2023-10-08T16:07:11.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.642+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83dc04c3c0 con 0x7f83dc15a230 2023-10-08T16:07:11.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.643+0000 7f83d9ffb700 1 -- 172.21.15.60:0/1113485874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83cc055620 con 0x7f83dc15a230 2023-10-08T16:07:11.644 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:07:11.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83c8066f30 msgr2=0x7f83c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83c8066f30 0x7f83c80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83d40099b0 tx=0x7f83d4017000 comp rx=0 tx=0).stop 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 msgr2=0x7f83dc0b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 0x7f83dc0b0c80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009ec0 tx=0x7f83cc00b040 comp rx=0 tx=0).stop 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 shutdown_connections 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83c8066f30 0x7f83c80693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83dc15a230 0x7f83dc0b0c80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83dc0697c0 0x7f83dc1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 --2- 172.21.15.60:0/1113485874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83dc159e60 0x7f83dc0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 >> 172.21.15.60:0/1113485874 conn(0x7f83dc070700 msgr2=0x7f83dc0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 shutdown_connections 2023-10-08T16:07:11.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.645+0000 7f83e3cca700 1 -- 172.21.15.60:0/1113485874 wait complete. 2023-10-08T16:07:11.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:07:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.775+0000 7fba7f444700 1 Processor -- start 2023-10-08T16:07:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.775+0000 7fba7f444700 1 -- start start 2023-10-08T16:07:11.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7f444700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7815a620 0x7fba7815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7f444700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7815cbb0 con 0x7fba7815d580 2023-10-08T16:07:11.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7f444700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7815bfa0 con 0x7fba78157870 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7f444700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7815bdb0 con 0x7fba7815a620 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7d9e1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fba7815d580 0x7fba78158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60772/0 (socket says 172.21.15.60:60772) 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7d9e1700 1 -- 172.21.15.60:0/3215880002 learned_addr learned my addr 172.21.15.60:0/3215880002 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba7c9df700 1 --2- 172.21.15.60:0/3215880002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7815a620 0x7fba7815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678921146 0 0) 0x7fba7815cbb0 con 0x7fba7815d580 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba64003570 con 0x7fba7815d580 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551267432 0 0) 0x7fba7815bfa0 con 0x7fba78157870 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.776+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba7815cbb0 con 0x7fba78157870 2023-10-08T16:07:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7c9df700 1 -- 172.21.15.60:0/3215880002 >> v1:172.21.15.144:6789/0 conn(0x7fba78157870 legacy=0x7fba7815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7c9df700 1 -- 172.21.15.60:0/3215880002 >> v1:172.21.15.60:6789/0 conn(0x7fba7815d580 legacy=0x7fba78158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7c9df700 1 -- 172.21.15.60:0/3215880002 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7815c280 con 0x7fba7815a620 2023-10-08T16:07:11.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7c9df700 1 --2- 172.21.15.60:0/3215880002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7815a620 0x7fba7815d040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba68009910 tx=0x7fba680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738df26d8a17daed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68011630 con 0x7fba7815a620 2023-10-08T16:07:11.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68011790 con 0x7fba7815a620 2023-10-08T16:07:11.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba6ffff700 1 -- 172.21.15.60:0/3215880002 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68011b30 con 0x7fba7815a620 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7f444700 1 -- 172.21.15.60:0/3215880002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7815a620 msgr2=0x7fba7815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7f444700 1 --2- 172.21.15.60:0/3215880002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7815a620 0x7fba7815d040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba68009910 tx=0x7fba680091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.777+0000 7fba7f444700 1 -- 172.21.15.60:0/3215880002 shutdown_connections 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.778+0000 7fba7f444700 1 --2- 172.21.15.60:0/3215880002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7815a620 0x7fba7815d040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.778+0000 7fba7f444700 1 -- 172.21.15.60:0/3215880002 >> 172.21.15.60:0/3215880002 conn(0x7fba78068ce0 msgr2=0x7fba780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.778+0000 7fba7f444700 1 -- 172.21.15.60:0/3215880002 shutdown_connections 2023-10-08T16:07:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.778+0000 7fba7f444700 1 -- 172.21.15.60:0/3215880002 wait complete. 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.779+0000 7fba7f444700 1 Processor -- start 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.779+0000 7fba7f444700 1 -- start start 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.779+0000 7fba7f444700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78157870 0x7fba78158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7815a620 0x7fba780b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 0x7fba780b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b18f0 con 0x7fba7815d580 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780cf670 con 0x7fba7815a620 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba78159540 con 0x7fba78157870 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 0x7fba780b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 0x7fba780b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55454/0 (socket says 172.21.15.60:55454) 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 -- 172.21.15.60:0/1064552491 learned_addr learned my addr 172.21.15.60:0/1064552491 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7c9df700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7815a620 0x7fba780b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d1e0700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78157870 0x7fba78158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 -- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78157870 msgr2=0x7fba78158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78157870 0x7fba78158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 -- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7815a620 msgr2=0x7fba780b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7815a620 0x7fba780b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 -- 172.21.15.60:0/1064552491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68009420 con 0x7fba7815d580 2023-10-08T16:07:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7d9e1700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 0x7fba780b0c00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fba70001460 tx=0x7fba70001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000a910 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7000aa70 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba78159820 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000ae30 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.780+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7814fb50 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.781+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba78159d40 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.782+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba70007300 con 0x7fba7815d580 2023-10-08T16:07:11.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.782+0000 7fba6d7fa700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:11.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.782+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fba70084570 con 0x7fba7815d580 2023-10-08T16:07:11.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.782+0000 7fba7d1e0700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:11.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.783+0000 7fba7d1e0700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba5c066f30 0x7fba5c0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba74003870 tx=0x7fba74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:11.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.786+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba78159d40 con 0x7fba7815d580 2023-10-08T16:07:11.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.980+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fba78159d40 con 0x7fba7815d580 2023-10-08T16:07:11.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.980+0000 7fba6d7fa700 1 -- 172.21.15.60:0/1064552491 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+65 (secure 0 0 0) 0x7fba78159d40 con 0x7fba7815d580 2023-10-08T16:07:11.982 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:11.982 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:07:11.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:07:11.982 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:07:11.982 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:07:11.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:07:11.983 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:07:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.982+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba5c066f30 msgr2=0x7fba5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.982+0000 7fba7f444700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba5c066f30 0x7fba5c0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba74003870 tx=0x7fba74009040 comp rx=0 tx=0).stop 2023-10-08T16:07:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.982+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 msgr2=0x7fba780b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.982+0000 7fba7f444700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 0x7fba780b0c00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fba70001460 tx=0x7fba70001a20 comp rx=0 tx=0).stop 2023-10-08T16:07:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 shutdown_connections 2023-10-08T16:07:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78157870 0x7fba78158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7815d580 0x7fba780b0c00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 --2- 172.21.15.60:0/1064552491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7815a620 0x7fba780b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 >> 172.21.15.60:0/1064552491 conn(0x7fba78068ce0 msgr2=0x7fba78160850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 shutdown_connections 2023-10-08T16:07:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:11.983+0000 7fba7f444700 1 -- 172.21.15.60:0/1064552491 wait complete. 2023-10-08T16:07:11.996 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:07:11.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:07:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.118+0000 7fbabfb16700 1 Processor -- start 2023-10-08T16:07:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.118+0000 7fbabfb16700 1 -- start start 2023-10-08T16:07:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabfb16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 0x7fbab806ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabfb16700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbab81431f0 0x7fbab8143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabfb16700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab80c8640 con 0x7fbab8070d20 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabfb16700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab80c8e80 con 0x7fbab81431f0 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabfb16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab806f630 con 0x7fbab8070950 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabd0b1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbab8070d20 0x7fbab8067e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60776/0 (socket says 172.21.15.60:60776) 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabd0b1700 1 -- 172.21.15.60:0/1021725753 learned_addr learned my addr 172.21.15.60:0/1021725753 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabe0b3700 1 --2- 172.21.15.60:0/1021725753 >> v2:172.21.15.144:3300/0 conn(0x7fbab81431f0 0x7fbab8143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 0x7fbab806ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580664066 0 0) 0x7fbab80c8640 con 0x7fbab8070d20 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa0003570 con 0x7fbab8070d20 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3905283410 0 0) 0x7fbaa0003570 con 0x7fbab8070d20 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 msgr2=0x7fbab806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 0x7fbab806ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 >> v2:172.21.15.144:3300/0 conn(0x7fbab81431f0 msgr2=0x7fbab8143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 --2- 172.21.15.60:0/1021725753 >> v2:172.21.15.144:3300/0 conn(0x7fbab81431f0 0x7fbab8143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80c8870 con 0x7fbab8070d20 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fbaac001470 con 0x7fbab8070d20 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.119+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 >> v1:172.21.15.60:6789/0 conn(0x7fbab8070d20 legacy=0x7fbab8067e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa0003a60 0x7fbaa0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa0004810 0x7fbaa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 0x7fbaa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab80c8e80 con 0x7fbaa0003a60 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab806f630 con 0x7fbaa0004810 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa000ba60 con 0x7fbab8070950 2023-10-08T16:07:12.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa0003a60 0x7fbaa0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd0b1700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa0004810 0x7fbaa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabe0b3700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 0x7fbaa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 -- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 msgr2=0x7fbaa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbab8070950 0x7fbaa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 -- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa0004810 msgr2=0x7fbaa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa0004810 0x7fbaa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 -- 172.21.15.60:0/1021725753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0003570 con 0x7fbaa0003a60 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa0003a60 0x7fbaa0003e70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009c30 tx=0x7fbab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578de934ed5ce8ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000e710 con 0x7fbaa0003a60 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab000e870 con 0x7fbaa0003a60 2023-10-08T16:07:12.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.120+0000 7fbabc8b0700 1 -- 172.21.15.60:0/1021725753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000ec30 con 0x7fbaa0003a60 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabfb16700 1 -- 172.21.15.60:0/1021725753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa0003a60 msgr2=0x7fbaa0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabfb16700 1 --2- 172.21.15.60:0/1021725753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa0003a60 0x7fbaa0003e70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009c30 tx=0x7fbab00091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabe0b3700 1 -- 172.21.15.60:0/1021725753 reap_dead start 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabfb16700 1 -- 172.21.15.60:0/1021725753 shutdown_connections 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabfb16700 1 -- 172.21.15.60:0/1021725753 >> 172.21.15.60:0/1021725753 conn(0x7fbab80ce570 msgr2=0x7fbab80ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabfb16700 1 -- 172.21.15.60:0/1021725753 shutdown_connections 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.121+0000 7fbabfb16700 1 -- 172.21.15.60:0/1021725753 wait complete. 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.122+0000 7fbabfb16700 1 Processor -- start 2023-10-08T16:07:12.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.122+0000 7fbabfb16700 1 -- start start 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0003a60 0x7fbab8158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbab815ed50 0x7fbab815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 0x7fbab815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab80b3850 con 0x7fbab815c730 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab815f700 con 0x7fbab815ed50 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8160540 con 0x7fbaa0003a60 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 0x7fbab815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 0x7fbab815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55476/0 (socket says 172.21.15.60:55476) 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 -- 172.21.15.60:0/3175847839 learned_addr learned my addr 172.21.15.60:0/3175847839 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0003a60 0x7fbab8158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabd0b1700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbab815ed50 0x7fbab815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 -- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0003a60 msgr2=0x7fbab8158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0003a60 0x7fbab8158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 -- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbab815ed50 msgr2=0x7fbab815f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbab815ed50 0x7fbab815f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 -- 172.21.15.60:0/3175847839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab815d0c0 con 0x7fbab815c730 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0003a60 0x7fbab8158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabe0b3700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 0x7fbab815cb80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbab80c8df0 tx=0x7fbaa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800e070 con 0x7fbab815c730 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa8011c30 con 0x7fbab815c730 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab815f930 con 0x7fbab815c730 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.123+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8016470 con 0x7fbab815c730 2023-10-08T16:07:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.124+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab815fef0 con 0x7fbab815c730 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.125+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab81606f0 con 0x7fbab815c730 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.125+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaa8016820 con 0x7fbab815c730 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.125+0000 7fbab5ffb700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.125+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbaa8084db0 con 0x7fbab815c730 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.125+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.126+0000 7fbabd8b2700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbaa4066f30 0x7fbaa40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbab00091e0 tx=0x7fbab001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.130+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbab81606f0 con 0x7fbab815c730 2023-10-08T16:07:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.321+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbab81606b0 con 0x7fbab815c730 2023-10-08T16:07:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.531+0000 7fbab5ffb700 1 -- 172.21.15.60:0/3175847839 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbaa8052370 con 0x7fbab815c730 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbaa4066f30 msgr2=0x7fbaa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbaa4066f30 0x7fbaa40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbab00091e0 tx=0x7fbab001a000 comp rx=0 tx=0).stop 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 msgr2=0x7fbab815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 0x7fbab815cb80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbab80c8df0 tx=0x7fbaa800b040 comp rx=0 tx=0).stop 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 shutdown_connections 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0003a60 0x7fbab8158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbab815c730 0x7fbab815cb80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 --2- 172.21.15.60:0/3175847839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbab815ed50 0x7fbab815f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 >> 172.21.15.60:0/3175847839 conn(0x7fbab80ce570 msgr2=0x7fbab80c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 shutdown_connections 2023-10-08T16:07:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.535+0000 7fbabfb16700 1 -- 172.21.15.60:0/3175847839 wait complete. 2023-10-08T16:07:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:07:12.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:07:12.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.674+0000 7efd287ea700 1 Processor -- start 2023-10-08T16:07:12.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.674+0000 7efd287ea700 1 -- start start 2023-10-08T16:07:12.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.675+0000 7efd287ea700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd20152300 0x7efd2015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.675+0000 7efd287ea700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2015c8d0 con 0x7efd2006d370 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.675+0000 7efd287ea700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd200c9370 con 0x7efd20158df0 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.675+0000 7efd287ea700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd200b1400 con 0x7efd20152300 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26586700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd20152300 0x7efd2015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26d87700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efd2006d370 0x7efd2006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48166/0 (socket says 172.21.15.60:48166) 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26586700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd20152300 0x7efd2015b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49142/0 (socket says 172.21.15.60:49142) 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26d87700 1 -- 172.21.15.60:0/4107025503 learned_addr learned my addr 172.21.15.60:0/4107025503 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26586700 1 -- 172.21.15.60:0/4107025503 >> v1:172.21.15.144:6789/0 conn(0x7efd20158df0 legacy=0x7efd200caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26586700 1 -- 172.21.15.60:0/4107025503 >> v1:172.21.15.60:6789/0 conn(0x7efd2006d370 legacy=0x7efd2006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26586700 1 -- 172.21.15.60:0/4107025503 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2015c030 con 0x7efd20152300 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd25584700 1 -- 172.21.15.60:0/4107025503 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856306893 0 0) 0x7efd2015c8d0 con 0x7efd2006d370 2023-10-08T16:07:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd26586700 1 --2- 172.21.15.60:0/4107025503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2015b9a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e60 tx=0x7efd1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8b9f14dec78e34 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd25584700 1 -- 172.21.15.60:0/4107025503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00e070 con 0x7efd20152300 2023-10-08T16:07:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd25584700 1 -- 172.21.15.60:0/4107025503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c00bc30 con 0x7efd20152300 2023-10-08T16:07:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.676+0000 7efd25584700 1 -- 172.21.15.60:0/4107025503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c012430 con 0x7efd20152300 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 -- 172.21.15.60:0/4107025503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 msgr2=0x7efd2015b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 --2- 172.21.15.60:0/4107025503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2015b9a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e60 tx=0x7efd1c009780 comp rx=0 tx=0).stop 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 -- 172.21.15.60:0/4107025503 shutdown_connections 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 --2- 172.21.15.60:0/4107025503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2015b9a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 -- 172.21.15.60:0/4107025503 >> 172.21.15.60:0/4107025503 conn(0x7efd20069870 msgr2=0x7efd20069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 -- 172.21.15.60:0/4107025503 shutdown_connections 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.677+0000 7efd287ea700 1 -- 172.21.15.60:0/4107025503 wait complete. 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.678+0000 7efd287ea700 1 Processor -- start 2023-10-08T16:07:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.678+0000 7efd287ea700 1 -- start start 2023-10-08T16:07:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd287ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd2006d370 0x7efd20141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd287ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2016b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd287ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd20158df0 0x7efd2016b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd287ea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200c8ba0 con 0x7efd20152300 2023-10-08T16:07:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd287ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200c7770 con 0x7efd20158df0 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd287ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200c6b60 con 0x7efd2006d370 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd25d85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2016b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd25d85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2016b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49156/0 (socket says 172.21.15.60:49156) 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.679+0000 7efd25d85700 1 -- 172.21.15.60:0/38721900 learned_addr learned my addr 172.21.15.60:0/38721900 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd26d87700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd20158df0 0x7efd2016b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd26586700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd2006d370 0x7efd20141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd25d85700 1 -- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd2006d370 msgr2=0x7efd20141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd25d85700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd2006d370 0x7efd20141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd25d85700 1 -- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd20158df0 msgr2=0x7efd2016b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd25d85700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd20158df0 0x7efd2016b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd25d85700 1 -- 172.21.15.60:0/38721900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009a20 con 0x7efd20152300 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd26d87700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd20158df0 0x7efd2016b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd26586700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd2006d370 0x7efd20141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd25d85700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2016b420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efd1000c4e0 tx=0x7efd1000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10011590 con 0x7efd20152300 2023-10-08T16:07:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd10011710 con 0x7efd20152300 2023-10-08T16:07:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200c6e40 con 0x7efd20152300 2023-10-08T16:07:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10011ad0 con 0x7efd20152300 2023-10-08T16:07:12.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.680+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200c7400 con 0x7efd20152300 2023-10-08T16:07:12.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.681+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2004c3c0 con 0x7efd20152300 2023-10-08T16:07:12.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.681+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd1001b3b0 con 0x7efd20152300 2023-10-08T16:07:12.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.682+0000 7efd167fc700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:12.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.682+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5223+0+0 (secure 0 0 0) 0x7efd100837d0 con 0x7efd20152300 2023-10-08T16:07:12.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.682+0000 7efd26586700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:12.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.682+0000 7efd26586700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e60 tx=0x7efd1c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.686+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd10050c20 con 0x7efd20152300 2023-10-08T16:07:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:12.879+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efd200cdf10 con 0x7efd20152300 2023-10-08T16:07:13.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.535+0000 7efd167fc700 1 -- 172.21.15.60:0/38721900 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7efd10017070 con 0x7efd20152300 2023-10-08T16:07:13.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 msgr2=0x7efd040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e60 tx=0x7efd1c019000 comp rx=0 tx=0).stop 2023-10-08T16:07:13.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 msgr2=0x7efd2016b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2016b420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efd1000c4e0 tx=0x7efd1000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 shutdown_connections 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd2006d370 0x7efd20141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd20158df0 0x7efd2016b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 --2- 172.21.15.60:0/38721900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd20152300 0x7efd2016b420 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 >> 172.21.15.60:0/38721900 conn(0x7efd20069870 msgr2=0x7efd200cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.539+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 shutdown_connections 2023-10-08T16:07:13.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.540+0000 7efd287ea700 1 -- 172.21.15.60:0/38721900 wait complete. 2023-10-08T16:07:13.545 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:07:13.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:07:13.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.685+0000 7f79129fe700 1 Processor -- start 2023-10-08T16:07:13.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.685+0000 7f79129fe700 1 -- start start 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f79129fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f79129fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f790c15a290 0x7f790c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f79129fe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c0b0790 con 0x7f790c06a5a0 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f79129fe700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0ce1f0 con 0x7f790c15a290 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f79129fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0b0b20 con 0x7f790c159ec0 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f7910f9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f790c06a5a0 0x7f790c15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48172/0 (socket says 172.21.15.60:48172) 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f7910f9b700 1 -- 172.21.15.60:0/1500651450 learned_addr learned my addr 172.21.15.60:0/1500651450 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790bfff700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790b7fe700 1 --2- 172.21.15.60:0/1500651450 >> v2:172.21.15.144:3300/0 conn(0x7f790c15a290 0x7f790c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790affd700 1 -- 172.21.15.60:0/1500651450 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640529879 0 0) 0x7f790c0b0790 con 0x7f790c06a5a0 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790affd700 1 -- 172.21.15.60:0/1500651450 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f4003570 con 0x7f790c06a5a0 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790b7fe700 1 -- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 msgr2=0x7f790c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790b7fe700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790b7fe700 1 -- 172.21.15.60:0/1500651450 >> v1:172.21.15.60:6789/0 conn(0x7f790c06a5a0 legacy=0x7f790c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790b7fe700 1 -- 172.21.15.60:0/1500651450 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0b04b0 con 0x7f790c15a290 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.686+0000 7f790bfff700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f790b7fe700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0afe80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098e0 tx=0x7f78fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1277876a810dcc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f790affd700 1 -- 172.21.15.60:0/1500651450 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011630 con 0x7f790c15a290 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f790affd700 1 -- 172.21.15.60:0/1500651450 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc011790 con 0x7f790c15a290 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f790affd700 1 -- 172.21.15.60:0/1500651450 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011b30 con 0x7f790c15a290 2023-10-08T16:07:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 -- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 msgr2=0x7f790c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0afe80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098e0 tx=0x7f78fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 -- 172.21.15.60:0/1500651450 shutdown_connections 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 --2- 172.21.15.60:0/1500651450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0afe80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 -- 172.21.15.60:0/1500651450 >> 172.21.15.60:0/1500651450 conn(0x7f790c0d1880 msgr2=0x7f790c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 -- 172.21.15.60:0/1500651450 shutdown_connections 2023-10-08T16:07:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.687+0000 7f79129fe700 1 -- 172.21.15.60:0/1500651450 wait complete. 2023-10-08T16:07:13.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.688+0000 7f79129fe700 1 Processor -- start 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 -- start start 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 0x7f790c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c154eb0 con 0x7f790c06a5a0 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c8510 con 0x7f790c15a290 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f79129fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c8ee0 con 0x7f790c159ec0 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f790bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 0x7f790c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f790bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 0x7f790c148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49166/0 (socket says 172.21.15.60:49166) 2023-10-08T16:07:13.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.689+0000 7f790bfff700 1 -- 172.21.15.60:0/1720605322 learned_addr learned my addr 172.21.15.60:0/1720605322 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f7910f9b700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790b7fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790bfff700 1 -- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 msgr2=0x7f790c0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790bfff700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790bfff700 1 -- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 msgr2=0x7f790c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790bfff700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790bfff700 1 -- 172.21.15.60:0/1720605322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009420 con 0x7f790c06a5a0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f790bfff700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 0x7f790c148b80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f790000ec80 tx=0x7f79000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000c9d0 con 0x7f790c06a5a0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790000cb30 con 0x7f790c06a5a0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc009420 con 0x7f790c06a5a0 2023-10-08T16:07:13.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000ceb0 con 0x7f790c06a5a0 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.690+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c16aea0 con 0x7f790c06a5a0 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.691+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0c87f0 con 0x7f790c06a5a0 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.692+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7900013680 con 0x7f790c06a5a0 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.692+0000 7f78f3fff700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78f8066f30 0x7f78f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.692+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7900084930 con 0x7f790c06a5a0 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.692+0000 7f790b7fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78f8066f30 0x7f78f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.692+0000 7f790b7fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78f8066f30 0x7f78f80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0091e0 tx=0x7f78fc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:13.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.697+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7900051c00 con 0x7f790c06a5a0 2023-10-08T16:07:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:13.936+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f790c04c3c0 con 0x7f790c06a5a0 2023-10-08T16:07:14.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.550+0000 7f78f3fff700 1 -- 172.21.15.60:0/1720605322 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7900055220 con 0x7f790c06a5a0 2023-10-08T16:07:14.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78f8066f30 msgr2=0x7f78f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78f8066f30 0x7f78f80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0091e0 tx=0x7f78fc017000 comp rx=0 tx=0).stop 2023-10-08T16:07:14.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 msgr2=0x7f790c148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 0x7f790c148b80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f790000ec80 tx=0x7f79000091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 shutdown_connections 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78f8066f30 0x7f78f80693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790c15a290 0x7f790c0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f790c06a5a0 0x7f790c148b80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 --2- 172.21.15.60:0/1720605322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f790c159ec0 0x7f790c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.556+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 >> 172.21.15.60:0/1720605322 conn(0x7f790c0d1880 msgr2=0x7f790c0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.557+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 shutdown_connections 2023-10-08T16:07:14.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.557+0000 7f79129fe700 1 -- 172.21.15.60:0/1720605322 wait complete. 2023-10-08T16:07:14.561 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 8 and data pool 9 2023-10-08T16:07:14.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:14.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.692+0000 7f93ab59e700 1 Processor -- start 2023-10-08T16:07:14.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.692+0000 7f93ab59e700 1 -- start start 2023-10-08T16:07:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93ab59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 0x7f93ac15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93ab59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f93ac15dda0 0x7f93ac15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93ab59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0cb7c0 con 0x7f93ac0cd6e0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93ab59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac15e850 con 0x7f93ac15dda0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93ab59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cc360 con 0x7f93ac0cdab0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93aa59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f93ac0cd6e0 0x7f93ac0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48180/0 (socket says 172.21.15.60:48180) 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93aa59c700 1 -- 172.21.15.60:0/2411498383 learned_addr learned my addr 172.21.15.60:0/2411498383 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93a9d9b700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 0x7f93ac15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93aad9d700 1 --2- 172.21.15.60:0/2411498383 >> v2:172.21.15.144:3300/0 conn(0x7f93ac15dda0 0x7f93ac15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364527199 0 0) 0x7f93ac0cb7c0 con 0x7f93ac0cd6e0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.693+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9398003570 con 0x7f93ac0cd6e0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108568648 0 0) 0x7f9398003570 con 0x7f93ac0cd6e0 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 msgr2=0x7f93ac15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 0x7f93ac15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 >> v2:172.21.15.144:3300/0 conn(0x7f93ac15dda0 msgr2=0x7f93ac15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 --2- 172.21.15.60:0/2411498383 >> v2:172.21.15.144:3300/0 conn(0x7f93ac15dda0 0x7f93ac15cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac15e290 con 0x7f93ac0cd6e0 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f939c0017f0 con 0x7f93ac0cd6e0 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 >> v1:172.21.15.60:6789/0 conn(0x7f93ac0cd6e0 legacy=0x7f93ac0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9398003a60 0x7f9398003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 0x7f9398004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac15e850 con 0x7f9398004d50 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cc360 con 0x7f9398003a60 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939800ba60 con 0x7f93ac0cdab0 2023-10-08T16:07:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aa59c700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9398003a60 0x7f9398003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a9d9b700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 0x7f9398004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 -- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 msgr2=0x7f9398004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0cdab0 0x7f9398004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 -- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9398003a60 msgr2=0x7f9398003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9398003a60 0x7f9398003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 -- 172.21.15.60:0/2411498383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398003570 con 0x7f9398004d50 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93aad9d700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93980051c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009c00 tx=0x7f93a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446f738850574a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400e6b0 con 0x7f9398004d50 2023-10-08T16:07:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400e810 con 0x7f9398004d50 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.694+0000 7f93a959a700 1 -- 172.21.15.60:0/2411498383 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400ebd0 con 0x7f9398004d50 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93ab59e700 1 -- 172.21.15.60:0/2411498383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 msgr2=0x7f93980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2411498383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93980051c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009c00 tx=0x7f93a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93aad9d700 1 -- 172.21.15.60:0/2411498383 reap_dead start 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93ab59e700 1 -- 172.21.15.60:0/2411498383 shutdown_connections 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93ab59e700 1 -- 172.21.15.60:0/2411498383 >> 172.21.15.60:0/2411498383 conn(0x7f93ac067660 msgr2=0x7f93ac067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93ab59e700 1 -- 172.21.15.60:0/2411498383 shutdown_connections 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.695+0000 7f93ab59e700 1 -- 172.21.15.60:0/2411498383 wait complete. 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.696+0000 7f93ab59e700 1 Processor -- start 2023-10-08T16:07:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.696+0000 7f93ab59e700 1 -- start start 2023-10-08T16:07:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93ab59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93ac0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93ab59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93ac0c7d20 0x7f93ac0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93ab59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0ca110 0x7f93ac0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93ab59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0c86d0 con 0x7f9398004d50 2023-10-08T16:07:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93ab59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0b2490 con 0x7f93ac0c7d20 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93ab59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0b1880 con 0x7f93ac0ca110 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93ac0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93ac0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49184/0 (socket says 172.21.15.60:49184) 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 -- 172.21.15.60:0/2894503217 learned_addr learned my addr 172.21.15.60:0/2894503217 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aad9d700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0ca110 0x7f93ac0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93a9d9b700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93ac0c7d20 0x7f93ac0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 -- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0ca110 msgr2=0x7f93ac0ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0ca110 0x7f93ac0ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 -- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93ac0c7d20 msgr2=0x7f93ac0c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93ac0c7d20 0x7f93ac0c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 -- 172.21.15.60:0/2894503217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0b1b60 con 0x7f9398004d50 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.697+0000 7f93aa59c700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93ac0b1050 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f939c007bc0 tx=0x7f93ac0ccaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.698+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0133f0 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.698+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c013570 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.698+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac0b1e40 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.698+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c013930 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.698+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0b1590 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.699+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac089b50 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.699+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f939c013ca0 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.700+0000 7f93a27fc700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f938c066f30 0x7f938c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.700+0000 7f93a9d9b700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f938c066f30 0x7f938c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.700+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f939c085370 con 0x7f9398004d50 2023-10-08T16:07:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.700+0000 7f93a9d9b700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f938c066f30 0x7f938c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93ac1503c0 tx=0x7f9394008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.704+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f939c0525e0 con 0x7f9398004d50 2023-10-08T16:07:14.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.898+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93ac04bb80 con 0x7f9398004d50 2023-10-08T16:07:14.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.899+0000 7f93a27fc700 1 -- 172.21.15.60:0/2894503217 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f939c055c00 con 0x7f9398004d50 2023-10-08T16:07:14.900 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:14.901 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:07:13.938242+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:12.352982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:12.910290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f938c066f30 msgr2=0x7f938c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f938c066f30 0x7f938c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f93ac1503c0 tx=0x7f9394008040 comp rx=0 tx=0).stop 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 msgr2=0x7f93ac0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93ac0b1050 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f939c007bc0 tx=0x7f93ac0ccaf0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 shutdown_connections 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f938c066f30 0x7f938c0693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93ac0ca110 0x7f93ac0ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398004d50 0x7f93ac0b1050 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 --2- 172.21.15.60:0/2894503217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93ac0c7d20 0x7f93ac0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:14.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 >> 172.21.15.60:0/2894503217 conn(0x7f93ac067660 msgr2=0x7f93ac15d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:14.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 shutdown_connections 2023-10-08T16:07:14.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:14.901+0000 7f93ab59e700 1 -- 172.21.15.60:0/2894503217 wait complete. 2023-10-08T16:07:14.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:15.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.032+0000 7fa7b22a4700 1 Processor -- start 2023-10-08T16:07:15.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.032+0000 7fa7b22a4700 1 -- start start 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b22a4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa7ac15a330 0x7fa7ac156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b22a4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7ac06da90 0x7fa7ac156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b22a4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac157c30 con 0x7fa7ac156570 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b22a4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac1584f0 con 0x7fa7ac06da90 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b22a4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac1573c0 con 0x7fa7ac15a330 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b0841700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7ac06da90 0x7fa7ac156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b0841700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7ac06da90 0x7fa7ac156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49200/0 (socket says 172.21.15.60:49200) 2023-10-08T16:07:15.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7b0841700 1 -- 172.21.15.60:0/3342731943 learned_addr learned my addr 172.21.15.60:0/3342731943 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.033+0000 7fa7ab7fe700 1 --2- 172.21.15.60:0/3342731943 >> v2:172.21.15.144:3300/0 conn(0x7fa7ac15a330 0x7fa7ac156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b0841700 1 -- 172.21.15.60:0/3342731943 >> v2:172.21.15.144:3300/0 conn(0x7fa7ac15a330 msgr2=0x7fa7ac156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b0841700 1 --2- 172.21.15.60:0/3342731943 >> v2:172.21.15.144:3300/0 conn(0x7fa7ac15a330 0x7fa7ac156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b0841700 1 -- 172.21.15.60:0/3342731943 >> v1:172.21.15.144:6789/0 conn(0x7fa7ac156570 legacy=0x7fa7ac06d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b0841700 1 -- 172.21.15.60:0/3342731943 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac157670 con 0x7fa7ac06da90 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b0841700 1 --2- 172.21.15.60:0/3342731943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac06da90 0x7fa7ac156e80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac06cd60 tx=0x7fa7a400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720ee3a496ccb84a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7aaffd700 1 -- 172.21.15.60:0/3342731943 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4010070 con 0x7fa7ac06da90 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7aaffd700 1 -- 172.21.15.60:0/3342731943 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a400dde0 con 0x7fa7ac06da90 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7aaffd700 1 -- 172.21.15.60:0/3342731943 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a400b320 con 0x7fa7ac06da90 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3342731943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac06da90 msgr2=0x7fa7ac156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3342731943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac06da90 0x7fa7ac156e80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac06cd60 tx=0x7fa7a400ba50 comp rx=0 tx=0).stop 2023-10-08T16:07:15.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3342731943 shutdown_connections 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3342731943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac06da90 0x7fa7ac156e80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3342731943 >> v2:172.21.15.144:3300/0 conn(0x7fa7ac15a330 0x7fa7ac156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3342731943 >> 172.21.15.60:0/3342731943 conn(0x7fa7ac067660 msgr2=0x7fa7ac067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3342731943 shutdown_connections 2023-10-08T16:07:15.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.034+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3342731943 wait complete. 2023-10-08T16:07:15.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.035+0000 7fa7b22a4700 1 Processor -- start 2023-10-08T16:07:15.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 -- start start 2023-10-08T16:07:15.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7ac06da90 0x7fa7ac154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7ac156570 0x7fa7ac0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 0x7fa7ac167350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b2560 con 0x7fa7ac15a330 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1543d0 con 0x7fa7ac156570 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b22a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1537c0 con 0x7fa7ac06da90 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.036+0000 7fa7b0841700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 0x7fa7ac167350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 0x7fa7ac167350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49212/0 (socket says 172.21.15.60:49212) 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 -- 172.21.15.60:0/3200794111 learned_addr learned my addr 172.21.15.60:0/3200794111 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7abfff700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7ac06da90 0x7fa7ac154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7ab7fe700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7ac156570 0x7fa7ac0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 -- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7ac06da90 msgr2=0x7fa7ac154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7ac06da90 0x7fa7ac154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 -- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7ac156570 msgr2=0x7fa7ac0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7ac156570 0x7fa7ac0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 -- 172.21.15.60:0/3200794111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a400bcf0 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7ab7fe700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7ac156570 0x7fa7ac0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7abfff700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7ac06da90 0x7fa7ac154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b0841700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 0x7fa7ac167350 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4014000 tx=0x7fa7a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40032f0 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a400ae80 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac153aa0 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a401e830 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.037+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac154060 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.038+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac154540 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.039+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7a4003040 con 0x7fa7ac15a330 2023-10-08T16:07:15.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.039+0000 7fa793fff700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa798066f30 0x7fa7980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.039+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7a4088300 con 0x7fa7ac15a330 2023-10-08T16:07:15.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.039+0000 7fa7abfff700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa798066f30 0x7fa7980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.039+0000 7fa7abfff700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa798066f30 0x7fa7980693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0007fd0 tx=0x7fa7a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.043+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a4055570 con 0x7fa7ac15a330 2023-10-08T16:07:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.237+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7ac04c3c0 con 0x7fa7ac15a330 2023-10-08T16:07:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.238+0000 7fa793fff700 1 -- 172.21.15.60:0/3200794111 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fa7a4058b90 con 0x7fa7ac15a330 2023-10-08T16:07:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:15.240 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:07:13.938242+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:12.352982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:12.910290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa798066f30 msgr2=0x7fa7980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa798066f30 0x7fa7980693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0007fd0 tx=0x7fa7a0009040 comp rx=0 tx=0).stop 2023-10-08T16:07:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 msgr2=0x7fa7ac167350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 0x7fa7ac167350 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4014000 tx=0x7fa7a401a000 comp rx=0 tx=0).stop 2023-10-08T16:07:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 shutdown_connections 2023-10-08T16:07:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa798066f30 0x7fa7980693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7ac06da90 0x7fa7ac154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.240+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac15a330 0x7fa7ac167350 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.241+0000 7fa7b22a4700 1 --2- 172.21.15.60:0/3200794111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7ac156570 0x7fa7ac0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.241+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 >> 172.21.15.60:0/3200794111 conn(0x7fa7ac067660 msgr2=0x7fa7ac0ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.241+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 shutdown_connections 2023-10-08T16:07:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.241+0000 7fa7b22a4700 1 -- 172.21.15.60:0/3200794111 wait complete. 2023-10-08T16:07:15.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:07:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.375+0000 7f60d3e0b700 1 Processor -- start 2023-10-08T16:07:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.375+0000 7f60d3e0b700 1 -- start start 2023-10-08T16:07:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d3e0b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60cc15afb0 0x7f60cc0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d3e0b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc1513f0 con 0x7f60cc0cd300 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d3e0b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0d1700 con 0x7f60cc0d12a0 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d3e0b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc15e7a0 con 0x7f60cc15afb0 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d1ba7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f60cc0cd300 0x7f60cc0b6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48192/0 (socket says 172.21.15.60:48192) 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d1ba7700 1 -- 172.21.15.60:0/2640925634 learned_addr learned my addr 172.21.15.60:0/2640925634 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190142258 0 0) 0x7f60cc1513f0 con 0x7f60cc0cd300 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b8003570 con 0x7f60cc0cd300 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d13a6700 1 --2- 172.21.15.60:0/2640925634 >> v2:172.21.15.144:3300/0 conn(0x7f60cc15afb0 0x7f60cc0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3569510176 0 0) 0x7f60b8003570 con 0x7f60cc0cd300 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 >> v2:172.21.15.144:3300/0 conn(0x7f60cc15afb0 msgr2=0x7f60cc0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 --2- 172.21.15.60:0/2640925634 >> v2:172.21.15.144:3300/0 conn(0x7f60cc15afb0 0x7f60cc0d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 >> v1:172.21.15.144:6789/0 conn(0x7f60cc0d12a0 legacy=0x7f60cc0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc15db20 con 0x7f60cc0cd300 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f60c8001470 con 0x7f60cc0cd300 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 >> v1:172.21.15.60:6789/0 conn(0x7f60cc0cd300 legacy=0x7f60cc0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b8003a60 0x7f60b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b80051c0 0x7f60b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc15e7a0 con 0x7f60b8004810 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800c0d0 con 0x7f60b8003a60 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.376+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800c290 con 0x7f60b80051c0 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d1ba7700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b8003a60 0x7f60b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d23a8700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b80051c0 0x7f60b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 -- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b80051c0 msgr2=0x7f60b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b80051c0 0x7f60b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 -- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b8003a60 msgr2=0x7f60b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b8003a60 0x7f60b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 -- 172.21.15.60:0/2640925634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8003570 con 0x7f60b8004810 2023-10-08T16:07:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d23a8700 1 -- 172.21.15.60:0/2640925634 reap_dead start 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d13a6700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60b8004c80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009c00 tx=0x7f60bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0335682d41f1edc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00e710 con 0x7f60b8004810 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00e870 con 0x7f60b8004810 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.377+0000 7f60d0ba5700 1 -- 172.21.15.60:0/2640925634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00ec30 con 0x7f60b8004810 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 -- 172.21.15.60:0/2640925634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 msgr2=0x7f60b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60b8004c80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009c00 tx=0x7f60bc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 -- 172.21.15.60:0/2640925634 shutdown_connections 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/2640925634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60b8004c80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 -- 172.21.15.60:0/2640925634 >> 172.21.15.60:0/2640925634 conn(0x7f60cc068d90 msgr2=0x7f60cc069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 -- 172.21.15.60:0/2640925634 shutdown_connections 2023-10-08T16:07:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.378+0000 7f60d3e0b700 1 -- 172.21.15.60:0/2640925634 wait complete. 2023-10-08T16:07:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.379+0000 7f60d3e0b700 1 Processor -- start 2023-10-08T16:07:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.379+0000 7f60d3e0b700 1 -- start start 2023-10-08T16:07:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60cc16a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60cc154b00 0x7f60cc14f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60cc0b25e0 0x7f60cc15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc16a990 con 0x7f60b8004810 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc155070 con 0x7f60cc154b00 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc155350 con 0x7f60cc0b25e0 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60cc16a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60cc16a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49238/0 (socket says 172.21.15.60:49238) 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 -- 172.21.15.60:0/510269106 learned_addr learned my addr 172.21.15.60:0/510269106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d13a6700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60cc154b00 0x7f60cc14f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d23a8700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60cc0b25e0 0x7f60cc15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 -- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60cc0b25e0 msgr2=0x7f60cc15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60cc0b25e0 0x7f60cc15cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 -- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60cc154b00 msgr2=0x7f60cc14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60cc154b00 0x7f60cc14f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 -- 172.21.15.60:0/510269106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc155630 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d1ba7700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60cc16a450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f60c800eb90 tx=0x7f60c8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8005e70 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c800c7e0 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc155910 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.380+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800cba0 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.381+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0b2a80 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.381+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc155b30 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.382+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60c801d460 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.382+0000 7f60c1ffb700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f60b0066f30 0x7f60b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.382+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60c80844e0 con 0x7f60b8004810 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.382+0000 7f60d13a6700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f60b0066f30 0x7f60b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.383+0000 7f60d13a6700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f60b0066f30 0x7f60b00693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60cc15d980 tx=0x7f60bc01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.386+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60c8051750 con 0x7f60b8004810 2023-10-08T16:07:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:15.629+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f60cc04c3c0 con 0x7f60b8004810 2023-10-08T16:07:16.531 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-10-08T16:07:16.530+0000 7fe1c75e6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:07:16.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.558+0000 7f60c1ffb700 1 -- 172.21.15.60:0/510269106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f60c8054d70 con 0x7f60b8004810 2023-10-08T16:07:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f60b0066f30 msgr2=0x7f60b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f60b0066f30 0x7f60b00693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60cc15d980 tx=0x7f60bc01a000 comp rx=0 tx=0).stop 2023-10-08T16:07:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 msgr2=0x7f60cc16a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60cc16a450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f60c800eb90 tx=0x7f60c8001c70 comp rx=0 tx=0).stop 2023-10-08T16:07:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 shutdown_connections 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f60b0066f30 0x7f60b00693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60cc0b25e0 0x7f60cc15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60b8004810 0x7f60cc16a450 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 --2- 172.21.15.60:0/510269106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60cc154b00 0x7f60cc14f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 >> 172.21.15.60:0/510269106 conn(0x7f60cc068d90 msgr2=0x7f60cc15a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 shutdown_connections 2023-10-08T16:07:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.561+0000 7f60d3e0b700 1 -- 172.21.15.60:0/510269106 wait complete. 2023-10-08T16:07:16.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:07:16.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.701+0000 7fbb23cca700 1 Processor -- start 2023-10-08T16:07:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.701+0000 7fbb23cca700 1 -- start start 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c159e60 0x7fbb1c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb1c0697c0 0x7fbb1c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c15ea90 con 0x7fbb1c15a230 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c0d1cf0 con 0x7fbb1c0697c0 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0b3100 con 0x7fbb1c159e60 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb22267700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb1c0697c0 0x7fbb1c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb21265700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbb1c15a230 0x7fbb1c0690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48202/0 (socket says 172.21.15.60:48202) 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb21265700 1 -- 172.21.15.60:0/2359837824 learned_addr learned my addr 172.21.15.60:0/2359837824 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb21a66700 1 --2- 172.21.15.60:0/2359837824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c159e60 0x7fbb1c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb22267700 1 -- 172.21.15.60:0/2359837824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c159e60 msgr2=0x7fbb1c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb22267700 1 --2- 172.21.15.60:0/2359837824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c159e60 0x7fbb1c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb22267700 1 -- 172.21.15.60:0/2359837824 >> v1:172.21.15.60:6789/0 conn(0x7fbb1c15a230 legacy=0x7fbb1c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb22267700 1 -- 172.21.15.60:0/2359837824 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0d10e0 con 0x7fbb1c0697c0 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb20a64700 1 -- 172.21.15.60:0/2359837824 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014384854 0 0) 0x7fbb1c15ea90 con 0x7fbb1c15a230 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb22267700 1 --2- 172.21.15.60:0/2359837824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0af730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e60 tx=0x7fbb0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed8a185c548b137 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb20a64700 1 -- 172.21.15.60:0/2359837824 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00e070 con 0x7fbb1c0697c0 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb20a64700 1 -- 172.21.15.60:0/2359837824 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00bc30 con 0x7fbb1c0697c0 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb20a64700 1 -- 172.21.15.60:0/2359837824 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c012430 con 0x7fbb1c0697c0 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 -- 172.21.15.60:0/2359837824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c0697c0 msgr2=0x7fbb1c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.703+0000 7fbb23cca700 1 --2- 172.21.15.60:0/2359837824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0af730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e60 tx=0x7fbb0c009780 comp rx=0 tx=0).stop 2023-10-08T16:07:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.704+0000 7fbb23cca700 1 -- 172.21.15.60:0/2359837824 shutdown_connections 2023-10-08T16:07:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.704+0000 7fbb23cca700 1 --2- 172.21.15.60:0/2359837824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0af730 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.704+0000 7fbb23cca700 1 --2- 172.21.15.60:0/2359837824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c159e60 0x7fbb1c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.704+0000 7fbb23cca700 1 -- 172.21.15.60:0/2359837824 >> 172.21.15.60:0/2359837824 conn(0x7fbb1c070700 msgr2=0x7fbb1c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.704+0000 7fbb23cca700 1 -- 172.21.15.60:0/2359837824 shutdown_connections 2023-10-08T16:07:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.704+0000 7fbb23cca700 1 -- 172.21.15.60:0/2359837824 wait complete. 2023-10-08T16:07:16.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 Processor -- start 2023-10-08T16:07:16.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 -- start start 2023-10-08T16:07:16.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 0x7fbb1c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c15a230 0x7fbb1c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0c69b0 con 0x7fbb1c159e60 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c159810 con 0x7fbb1c0697c0 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.705+0000 7fbb23cca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0c5da0 con 0x7fbb1c15a230 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 0x7fbb1c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 0x7fbb1c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49256/0 (socket says 172.21.15.60:49256) 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 -- 172.21.15.60:0/3810674264 learned_addr learned my addr 172.21.15.60:0/3810674264 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb22267700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c15a230 0x7fbb1c0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21a66700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 -- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c15a230 msgr2=0x7fbb1c0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c15a230 0x7fbb1c0c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 -- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb1c0697c0 msgr2=0x7fbb1c0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 -- 172.21.15.60:0/3810674264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c009a20 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb22267700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c15a230 0x7fbb1c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21a66700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb21265700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 0x7fbb1c15c480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000c810 tx=0x7fbb10007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10005c00 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb10005d60 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c0c6080 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10007320 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.706+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c0c6640 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.707+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0c6b20 con 0x7fbb1c159e60 2023-10-08T16:07:16.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.708+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb1001b400 con 0x7fbb1c159e60 2023-10-08T16:07:16.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.708+0000 7fbb19ffb700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb08066f30 0x7fbb080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:16.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.708+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb10084010 con 0x7fbb1c159e60 2023-10-08T16:07:16.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.708+0000 7fbb21a66700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb08066f30 0x7fbb080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:16.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.709+0000 7fbb21a66700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb08066f30 0x7fbb080693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbb14006fd0 tx=0x7fbb14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:16.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.712+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb10051300 con 0x7fbb1c159e60 2023-10-08T16:07:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:16.953+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbb1c04c3c0 con 0x7fbb1c159e60 2023-10-08T16:07:17.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.560+0000 7fbb19ffb700 1 -- 172.21.15.60:0/3810674264 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbb10054920 con 0x7fbb1c159e60 2023-10-08T16:07:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb08066f30 msgr2=0x7fbb080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb08066f30 0x7fbb080693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbb14006fd0 tx=0x7fbb14008040 comp rx=0 tx=0).stop 2023-10-08T16:07:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 msgr2=0x7fbb1c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 0x7fbb1c15c480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000c810 tx=0x7fbb10007db0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 shutdown_connections 2023-10-08T16:07:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb08066f30 0x7fbb080693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb1c15a230 0x7fbb1c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb1c0697c0 0x7fbb1c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 --2- 172.21.15.60:0/3810674264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb1c159e60 0x7fbb1c15c480 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 >> 172.21.15.60:0/3810674264 conn(0x7fbb1c070700 msgr2=0x7fbb1c0cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 shutdown_connections 2023-10-08T16:07:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.563+0000 7fbb23cca700 1 -- 172.21.15.60:0/3810674264 wait complete. 2023-10-08T16:07:17.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:17.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 Processor -- start 2023-10-08T16:07:17.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 -- start start 2023-10-08T16:07:17.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f87e00b0890 0x7f87e00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e0067d70 0x7f87e0159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00cb370 con 0x7f87e00cbd40 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00b0c60 con 0x7f87e00b0890 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.700+0000 7f87e5b86700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e006a1e0 con 0x7f87e0067d70 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87df7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f87e00b0890 0x7f87e00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87deffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f87e00cbd40 0x7f87e0067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48204/0 (socket says 172.21.15.60:48204) 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87deffd700 1 -- 172.21.15.60:0/29917082 learned_addr learned my addr 172.21.15.60:0/29917082 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87dffff700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e0067d70 0x7f87e0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87df7fe700 1 -- 172.21.15.60:0/29917082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e0067d70 msgr2=0x7f87e0159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87df7fe700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e0067d70 0x7f87e0159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87df7fe700 1 -- 172.21.15.60:0/29917082 >> v1:172.21.15.60:6789/0 conn(0x7f87e00cbd40 legacy=0x7f87e0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87df7fe700 1 -- 172.21.15.60:0/29917082 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e006cb80 con 0x7f87e00b0890 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87de7fc700 1 -- 172.21.15.60:0/29917082 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457521423 0 0) 0x7f87e00cb370 con 0x7f87e00cbd40 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87dffff700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e0067d70 0x7f87e0159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87df7fe700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e00b0890 0x7f87e00cb800 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009e60 tx=0x7f87d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5bb4bc74018470 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87de7fc700 1 -- 172.21.15.60:0/29917082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d000e070 con 0x7f87e00b0890 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87de7fc700 1 -- 172.21.15.60:0/29917082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d000bc30 con 0x7f87e00b0890 2023-10-08T16:07:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.701+0000 7f87de7fc700 1 -- 172.21.15.60:0/29917082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0012430 con 0x7f87e00b0890 2023-10-08T16:07:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 -- 172.21.15.60:0/29917082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e00b0890 msgr2=0x7f87e00cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e00b0890 0x7f87e00cb800 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009e60 tx=0x7f87d0009780 comp rx=0 tx=0).stop 2023-10-08T16:07:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 -- 172.21.15.60:0/29917082 shutdown_connections 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e0067d70 0x7f87e0159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 --2- 172.21.15.60:0/29917082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e00b0890 0x7f87e00cb800 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 -- 172.21.15.60:0/29917082 >> 172.21.15.60:0/29917082 conn(0x7f87e006fe50 msgr2=0x7f87e0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 -- 172.21.15.60:0/29917082 shutdown_connections 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.702+0000 7f87e5b86700 1 -- 172.21.15.60:0/29917082 wait complete. 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.703+0000 7f87e5b86700 1 Processor -- start 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.703+0000 7f87e5b86700 1 -- start start 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87e5b86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 0x7f87e00c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87e5b86700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e00b0890 0x7f87e00b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87e5b86700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e00cbd40 0x7f87e015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87e5b86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00c7b70 con 0x7f87e0067d70 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87e5b86700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00c6d10 con 0x7f87e00b0890 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87e5b86700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00b2820 con 0x7f87e00cbd40 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 0x7f87e00c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 0x7f87e00c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49280/0 (socket says 172.21.15.60:49280) 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 -- 172.21.15.60:0/1300770841 learned_addr learned my addr 172.21.15.60:0/1300770841 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87deffd700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e00b0890 0x7f87e00b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87dffff700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e00cbd40 0x7f87e015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 -- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e00cbd40 msgr2=0x7f87e015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e00cbd40 0x7f87e015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 -- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e00b0890 msgr2=0x7f87e00b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e00b0890 0x7f87e00b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.704+0000 7f87df7fe700 1 -- 172.21.15.60:0/1300770841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009a20 con 0x7f87e0067d70 2023-10-08T16:07:17.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.705+0000 7f87df7fe700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 0x7f87e00c67d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f87e006ab60 tx=0x7f87d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:17.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.705+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0012e40 con 0x7f87e0067d70 2023-10-08T16:07:17.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.705+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0027470 con 0x7f87e0067d70 2023-10-08T16:07:17.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.705+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e00c6f60 con 0x7f87e0067d70 2023-10-08T16:07:17.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.705+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0027830 con 0x7f87e0067d70 2023-10-08T16:07:17.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.705+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e00c7520 con 0x7f87e0067d70 2023-10-08T16:07:17.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.706+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e004c3c0 con 0x7f87e0067d70 2023-10-08T16:07:17.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.706+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87d0024070 con 0x7f87e0067d70 2023-10-08T16:07:17.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.706+0000 7f87d77fe700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f87c0066f30 0x7f87c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:17.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.707+0000 7f87deffd700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f87c0066f30 0x7f87c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:17.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.707+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87d0086af0 con 0x7f87e0067d70 2023-10-08T16:07:17.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.707+0000 7f87deffd700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f87c0066f30 0x7f87c00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87e016d880 tx=0x7f87c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:17.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.711+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87d0053d60 con 0x7f87e0067d70 2023-10-08T16:07:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.946+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87e006cdc0 con 0x7f87e0067d70 2023-10-08T16:07:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.947+0000 7f87d77fe700 1 -- 172.21.15.60:0/1300770841 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f87d002c090 con 0x7f87e0067d70 2023-10-08T16:07:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:17.947 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:07:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f87c0066f30 msgr2=0x7f87c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f87c0066f30 0x7f87c00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87e016d880 tx=0x7f87c8009040 comp rx=0 tx=0).stop 2023-10-08T16:07:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 msgr2=0x7f87e00c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 0x7f87e00c67d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f87e006ab60 tx=0x7f87d0019000 comp rx=0 tx=0).stop 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 shutdown_connections 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f87c0066f30 0x7f87c00693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e00cbd40 0x7f87e015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87e0067d70 0x7f87e00c67d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 --2- 172.21.15.60:0/1300770841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e00b0890 0x7f87e00b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 >> 172.21.15.60:0/1300770841 conn(0x7f87e006fe50 msgr2=0x7f87e015bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 shutdown_connections 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:17.949+0000 7f87e5b86700 1 -- 172.21.15.60:0/1300770841 wait complete. 2023-10-08T16:07:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:07:17.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:07:18.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.079+0000 7fde63a91700 1 Processor -- start 2023-10-08T16:07:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.079+0000 7fde63a91700 1 -- start start 2023-10-08T16:07:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde63a91700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde63a91700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde5c15a0c0 0x7fde5c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde63a91700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0cca20 con 0x7fde5c159cf0 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde63a91700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c15ea40 con 0x7fde5c15a0c0 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde63a91700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c067660 con 0x7fde5c0cf1c0 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde6202e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde5c15a0c0 0x7fde5c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde6202e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde5c15a0c0 0x7fde5c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49288/0 (socket says 172.21.15.60:49288) 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.080+0000 7fde6202e700 1 -- 172.21.15.60:0/3032428486 learned_addr learned my addr 172.21.15.60:0/3032428486 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6102c700 1 --2- 172.21.15.60:0/3032428486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6202e700 1 -- 172.21.15.60:0/3032428486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 msgr2=0x7fde5c15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6202e700 1 --2- 172.21.15.60:0/3032428486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6202e700 1 -- 172.21.15.60:0/3032428486 >> v1:172.21.15.144:6789/0 conn(0x7fde5c159cf0 legacy=0x7fde5c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6202e700 1 -- 172.21.15.60:0/3032428486 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c067f00 con 0x7fde5c15a0c0 2023-10-08T16:07:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6202e700 1 --2- 172.21.15.60:0/3032428486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c068390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fde540099b0 tx=0x7fde54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665955004c53433a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6082b700 1 -- 172.21.15.60:0/3032428486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54009ea0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6082b700 1 -- 172.21.15.60:0/3032428486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400b860 con 0x7fde5c15a0c0 2023-10-08T16:07:18.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.081+0000 7fde6082b700 1 -- 172.21.15.60:0/3032428486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400bc00 con 0x7fde5c15a0c0 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 -- 172.21.15.60:0/3032428486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 msgr2=0x7fde5c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 --2- 172.21.15.60:0/3032428486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c068390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fde540099b0 tx=0x7fde54009250 comp rx=0 tx=0).stop 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 -- 172.21.15.60:0/3032428486 shutdown_connections 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 --2- 172.21.15.60:0/3032428486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c068390 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 --2- 172.21.15.60:0/3032428486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 -- 172.21.15.60:0/3032428486 >> 172.21.15.60:0/3032428486 conn(0x7fde5c06c6e0 msgr2=0x7fde5c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 -- 172.21.15.60:0/3032428486 shutdown_connections 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.082+0000 7fde63a91700 1 -- 172.21.15.60:0/3032428486 wait complete. 2023-10-08T16:07:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.083+0000 7fde63a91700 1 Processor -- start 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.083+0000 7fde63a91700 1 -- start start 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5c159cf0 0x7fde5c0abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b1cd0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b1fb0 con 0x7fde5c159cf0 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b2290 con 0x7fde5c0cf1c0 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49294/0 (socket says 172.21.15.60:49294) 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 -- 172.21.15.60:0/4097805867 learned_addr learned my addr 172.21.15.60:0/4097805867 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6182d700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6102c700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5c159cf0 0x7fde5c0abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 -- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 msgr2=0x7fde5c0c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c0c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 -- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5c159cf0 msgr2=0x7fde5c0abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5c159cf0 0x7fde5c0abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 -- 172.21.15.60:0/4097805867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540094f0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde6202e700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c1551d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fde5c06de20 tx=0x7fde54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400baa0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54025420 con 0x7fde5c15a0c0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540257e0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.084+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c0b2570 con 0x7fde5c15a0c0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.085+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c0c84e0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.086+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c04c3c0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.086+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde54023070 con 0x7fde5c15a0c0 2023-10-08T16:07:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.086+0000 7fde59ffb700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.086+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde54085ba0 con 0x7fde5c15a0c0 2023-10-08T16:07:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.086+0000 7fde6182d700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.087+0000 7fde6182d700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007fd0 tx=0x7fde4c0016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.091+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde54052e10 con 0x7fde5c15a0c0 2023-10-08T16:07:18.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.284+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde5c0ce730 con 0x7fde5c15a0c0 2023-10-08T16:07:18.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.284+0000 7fde59ffb700 1 -- 172.21.15.60:0/4097805867 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fde5402a090 con 0x7fde5c15a0c0 2023-10-08T16:07:18.285 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:18.285 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":64,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:07:15.536710+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:12.352982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:12.910290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:07:18.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde48066f30 msgr2=0x7fde480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007fd0 tx=0x7fde4c0016f0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 msgr2=0x7fde5c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c1551d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fde5c06de20 tx=0x7fde54017000 comp rx=0 tx=0).stop 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 shutdown_connections 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde5c0cf1c0 0x7fde5c0c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde5c15a0c0 0x7fde5c1551d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 --2- 172.21.15.60:0/4097805867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5c159cf0 0x7fde5c0abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 >> 172.21.15.60:0/4097805867 conn(0x7fde5c06c6e0 msgr2=0x7fde5c0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 shutdown_connections 2023-10-08T16:07:18.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.287+0000 7fde63a91700 1 -- 172.21.15.60:0/4097805867 wait complete. 2023-10-08T16:07:18.299 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:07:18.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:07:18.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.418+0000 7f4d8b59e700 1 Processor -- start 2023-10-08T16:07:18.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.418+0000 7f4d8b59e700 1 -- start start 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8b59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0b1f00 0x7f4d8c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d8c068240 0x7f4d8c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8b59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0b4bf0 con 0x7f4d8c159db0 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0b5790 con 0x7f4d8c068240 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8b59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0ae9b0 con 0x7f4d8c0b1f00 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d8c068240 0x7f4d8c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d8c068240 0x7f4d8c0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49302/0 (socket says 172.21.15.60:49302) 2023-10-08T16:07:18.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/1395257146 learned_addr learned my addr 172.21.15.60:0/1395257146 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d89d9b700 1 --2- 172.21.15.60:0/1395257146 >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0b1f00 0x7f4d8c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/1395257146 >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0b1f00 msgr2=0x7f4d8c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 --2- 172.21.15.60:0/1395257146 >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0b1f00 0x7f4d8c0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/1395257146 >> v1:172.21.15.144:6789/0 conn(0x7f4d8c159db0 legacy=0x7f4d8c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.419+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/1395257146 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0b59e0 con 0x7f4d8c068240 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8ad9d700 1 --2- 172.21.15.60:0/1395257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c068240 0x7f4d8c0aee40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c08a020 tx=0x7f4d7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b766ec9caef2b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8959a700 1 -- 172.21.15.60:0/1395257146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00b820 con 0x7f4d8c068240 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8959a700 1 -- 172.21.15.60:0/1395257146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00b980 con 0x7f4d8c068240 2023-10-08T16:07:18.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8959a700 1 -- 172.21.15.60:0/1395257146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00bd20 con 0x7f4d8c068240 2023-10-08T16:07:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 -- 172.21.15.60:0/1395257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c068240 msgr2=0x7f4d8c0aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/1395257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c068240 0x7f4d8c0aee40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c08a020 tx=0x7f4d7c009250 comp rx=0 tx=0).stop 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 -- 172.21.15.60:0/1395257146 shutdown_connections 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/1395257146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c068240 0x7f4d8c0aee40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/1395257146 >> v2:172.21.15.144:3300/0 conn(0x7f4d8c0b1f00 0x7f4d8c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 -- 172.21.15.60:0/1395257146 >> 172.21.15.60:0/1395257146 conn(0x7f4d8c067e40 msgr2=0x7f4d8c0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 -- 172.21.15.60:0/1395257146 shutdown_connections 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.420+0000 7f4d8b59e700 1 -- 172.21.15.60:0/1395257146 wait complete. 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.421+0000 7f4d8b59e700 1 Processor -- start 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.421+0000 7f4d8b59e700 1 -- start start 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d8c068240 0x7f4d8c169bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0b1f00 0x7f4d8c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 0x7f4d8c09cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c16d190 con 0x7f4d8c159db0 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8b59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c16dff0 con 0x7f4d8c0b1f00 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c16d3e0 con 0x7f4d8c068240 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 0x7f4d8c09cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 0x7f4d8c09cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49310/0 (socket says 172.21.15.60:49310) 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.422+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/3896868038 learned_addr learned my addr 172.21.15.60:0/3896868038 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d89d9b700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0b1f00 0x7f4d8c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8a59c700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d8c068240 0x7f4d8c169bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d8c068240 msgr2=0x7f4d8c169bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8ad9d700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d8c068240 0x7f4d8c169bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0b1f00 msgr2=0x7f4d8c1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8ad9d700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0b1f00 0x7f4d8c1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8ad9d700 1 -- 172.21.15.60:0/3896868038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0094f0 con 0x7f4d8c159db0 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8ad9d700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 0x7f4d8c09cb10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01b450 con 0x7f4d8c159db0 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c020070 con 0x7f4d8c159db0 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c16d6c0 con 0x7f4d8c159db0 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01b820 con 0x7f4d8c159db0 2023-10-08T16:07:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.423+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c16dc80 con 0x7f4d8c159db0 2023-10-08T16:07:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.424+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c06ace0 con 0x7f4d8c159db0 2023-10-08T16:07:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.424+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d7c022030 con 0x7f4d8c159db0 2023-10-08T16:07:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.425+0000 7f4d827fc700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d6c066f30 0x7f4d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.425+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d7c086620 con 0x7f4d8c159db0 2023-10-08T16:07:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.425+0000 7f4d8a59c700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d6c066f30 0x7f4d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.425+0000 7f4d8a59c700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d6c066f30 0x7f4d6c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009fd0 tx=0x7f4d84009600 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.429+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d7c0537f0 con 0x7f4d8c159db0 2023-10-08T16:07:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.623+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d8c06ace0 con 0x7f4d6c066f30 2023-10-08T16:07:18.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.632+0000 7f4d827fc700 1 -- 172.21.15.60:0/3896868038 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285032 (secure 0 0 0) 0x7f4d8c06ace0 con 0x7f4d6c066f30 2023-10-08T16:07:18.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d6c066f30 msgr2=0x7f4d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d6c066f30 0x7f4d6c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009fd0 tx=0x7f4d84009600 comp rx=0 tx=0).stop 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 msgr2=0x7f4d8c09cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 0x7f4d8c09cb10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c016000 comp rx=0 tx=0).stop 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 shutdown_connections 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d6c066f30 0x7f4d6c0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d8c068240 0x7f4d8c169bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d8c159db0 0x7f4d8c09cb10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 --2- 172.21.15.60:0/3896868038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d8c0b1f00 0x7f4d8c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 >> 172.21.15.60:0/3896868038 conn(0x7f4d8c067e40 msgr2=0x7f4d8c155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 shutdown_connections 2023-10-08T16:07:18.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.635+0000 7f4d8b59e700 1 -- 172.21.15.60:0/3896868038 wait complete. 2023-10-08T16:07:18.639 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:07:18.647 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-08T16:07:17.587386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558836,"statfs":{"total":1600000000,"available":1596248804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056205"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547382+0000","last_change":"2023-10-08T16:07:14.547382+0000","last_active":"2023-10-08T16:07:14.547382+0000","last_peered":"2023-10-08T16:07:14.547382+0000","last_clean":"2023-10-08T16:07:14.547382+0000","last_became_active":"2023-10-08T16:07:14.546723+0000","last_became_peered":"2023-10-08T16:07:14.546723+0000","last_unstale":"2023-10-08T16:07:14.547382+0000","last_undegraded":"2023-10-08T16:07:14.547382+0000","last_fullsized":"2023-10-08T16:07:14.547382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:57.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549841+0000","last_change":"2023-10-08T16:07:14.549549+0000","last_active":"2023-10-08T16:07:14.549841+0000","last_peered":"2023-10-08T16:07:14.549841+0000","last_clean":"2023-10-08T16:07:14.549841+0000","last_became_active":"2023-10-08T16:07:14.549175+0000","last_became_peered":"2023-10-08T16:07:14.549175+0000","last_unstale":"2023-10-08T16:07:14.549841+0000","last_undegraded":"2023-10-08T16:07:14.549841+0000","last_fullsized":"2023-10-08T16:07:14.549841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:57.583434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549874+0000","last_change":"2023-10-08T16:07:14.549874+0000","last_active":"2023-10-08T16:07:14.549874+0000","last_peered":"2023-10-08T16:07:14.549874+0000","last_clean":"2023-10-08T16:07:14.549874+0000","last_became_active":"2023-10-08T16:07:14.549367+0000","last_became_peered":"2023-10-08T16:07:14.549367+0000","last_unstale":"2023-10-08T16:07:14.549874+0000","last_undegraded":"2023-10-08T16:07:14.549874+0000","last_fullsized":"2023-10-08T16:07:14.549874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:00.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545039+0000","last_change":"2023-10-08T16:07:14.544799+0000","last_active":"2023-10-08T16:07:14.545039+0000","last_peered":"2023-10-08T16:07:14.545039+0000","last_clean":"2023-10-08T16:07:14.545039+0000","last_became_active":"2023-10-08T16:07:14.544465+0000","last_became_peered":"2023-10-08T16:07:14.544465+0000","last_unstale":"2023-10-08T16:07:14.545039+0000","last_undegraded":"2023-10-08T16:07:14.545039+0000","last_fullsized":"2023-10-08T16:07:14.545039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:29:53.746244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543246+0000","last_change":"2023-10-08T16:07:14.543246+0000","last_active":"2023-10-08T16:07:14.543246+0000","last_peered":"2023-10-08T16:07:14.543246+0000","last_clean":"2023-10-08T16:07:14.543246+0000","last_became_active":"2023-10-08T16:07:14.542974+0000","last_became_peered":"2023-10-08T16:07:14.542974+0000","last_unstale":"2023-10-08T16:07:14.543246+0000","last_undegraded":"2023-10-08T16:07:14.543246+0000","last_fullsized":"2023-10-08T16:07:14.543246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:31.257215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551198+0000","last_change":"2023-10-08T16:07:14.548759+0000","last_active":"2023-10-08T16:07:14.551198+0000","last_peered":"2023-10-08T16:07:14.551198+0000","last_clean":"2023-10-08T16:07:14.551198+0000","last_became_active":"2023-10-08T16:07:14.548497+0000","last_became_peered":"2023-10-08T16:07:14.548497+0000","last_unstale":"2023-10-08T16:07:14.551198+0000","last_undegraded":"2023-10-08T16:07:14.551198+0000","last_fullsized":"2023-10-08T16:07:14.551198+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:05.701056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.553185+0000","last_change":"2023-10-08T16:07:14.553185+0000","last_active":"2023-10-08T16:07:14.553185+0000","last_peered":"2023-10-08T16:07:14.553185+0000","last_clean":"2023-10-08T16:07:14.553185+0000","last_became_active":"2023-10-08T16:07:14.552879+0000","last_became_peered":"2023-10-08T16:07:14.552879+0000","last_unstale":"2023-10-08T16:07:14.553185+0000","last_undegraded":"2023-10-08T16:07:14.553185+0000","last_fullsized":"2023-10-08T16:07:14.553185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:32.009208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552442+0000","last_change":"2023-10-08T16:07:14.552365+0000","last_active":"2023-10-08T16:07:14.552442+0000","last_peered":"2023-10-08T16:07:14.552442+0000","last_clean":"2023-10-08T16:07:14.552442+0000","last_became_active":"2023-10-08T16:07:14.551907+0000","last_became_peered":"2023-10-08T16:07:14.551907+0000","last_unstale":"2023-10-08T16:07:14.552442+0000","last_undegraded":"2023-10-08T16:07:14.552442+0000","last_fullsized":"2023-10-08T16:07:14.552442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:50:28.617545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552392+0000","last_change":"2023-10-08T16:07:14.552392+0000","last_active":"2023-10-08T16:07:14.552392+0000","last_peered":"2023-10-08T16:07:14.552392+0000","last_clean":"2023-10-08T16:07:14.552392+0000","last_became_active":"2023-10-08T16:07:14.552171+0000","last_became_peered":"2023-10-08T16:07:14.552171+0000","last_unstale":"2023-10-08T16:07:14.552392+0000","last_undegraded":"2023-10-08T16:07:14.552392+0000","last_fullsized":"2023-10-08T16:07:14.552392+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:50.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547378+0000","last_change":"2023-10-08T16:07:14.547378+0000","last_active":"2023-10-08T16:07:14.547378+0000","last_peered":"2023-10-08T16:07:14.547378+0000","last_clean":"2023-10-08T16:07:14.547378+0000","last_became_active":"2023-10-08T16:07:14.547160+0000","last_became_peered":"2023-10-08T16:07:14.547160+0000","last_unstale":"2023-10-08T16:07:14.547378+0000","last_undegraded":"2023-10-08T16:07:14.547378+0000","last_fullsized":"2023-10-08T16:07:14.547378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:48.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548767+0000","last_change":"2023-10-08T16:07:14.548767+0000","last_active":"2023-10-08T16:07:14.548767+0000","last_peered":"2023-10-08T16:07:14.548767+0000","last_clean":"2023-10-08T16:07:14.548767+0000","last_became_active":"2023-10-08T16:07:14.547888+0000","last_became_peered":"2023-10-08T16:07:14.547888+0000","last_unstale":"2023-10-08T16:07:14.548767+0000","last_undegraded":"2023-10-08T16:07:14.548767+0000","last_fullsized":"2023-10-08T16:07:14.548767+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:28.760310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550579+0000","last_change":"2023-10-08T16:07:14.550196+0000","last_active":"2023-10-08T16:07:14.550579+0000","last_peered":"2023-10-08T16:07:14.550579+0000","last_clean":"2023-10-08T16:07:14.550579+0000","last_became_active":"2023-10-08T16:07:14.549850+0000","last_became_peered":"2023-10-08T16:07:14.549850+0000","last_unstale":"2023-10-08T16:07:14.550579+0000","last_undegraded":"2023-10-08T16:07:14.550579+0000","last_fullsized":"2023-10-08T16:07:14.550579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:21.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550969+0000","last_change":"2023-10-08T16:07:14.550969+0000","last_active":"2023-10-08T16:07:14.550969+0000","last_peered":"2023-10-08T16:07:14.550969+0000","last_clean":"2023-10-08T16:07:14.550969+0000","last_became_active":"2023-10-08T16:07:14.550640+0000","last_became_peered":"2023-10-08T16:07:14.550640+0000","last_unstale":"2023-10-08T16:07:14.550969+0000","last_undegraded":"2023-10-08T16:07:14.550969+0000","last_fullsized":"2023-10-08T16:07:14.550969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:53.337281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549187+0000","last_change":"2023-10-08T16:07:14.549187+0000","last_active":"2023-10-08T16:07:14.549187+0000","last_peered":"2023-10-08T16:07:14.549187+0000","last_clean":"2023-10-08T16:07:14.549187+0000","last_became_active":"2023-10-08T16:07:14.548969+0000","last_became_peered":"2023-10-08T16:07:14.548969+0000","last_unstale":"2023-10-08T16:07:14.549187+0000","last_undegraded":"2023-10-08T16:07:14.549187+0000","last_fullsized":"2023-10-08T16:07:14.549187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:22.856136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549763+0000","last_change":"2023-10-08T16:07:14.549763+0000","last_active":"2023-10-08T16:07:14.549763+0000","last_peered":"2023-10-08T16:07:14.549763+0000","last_clean":"2023-10-08T16:07:14.549763+0000","last_became_active":"2023-10-08T16:07:14.549495+0000","last_became_peered":"2023-10-08T16:07:14.549495+0000","last_unstale":"2023-10-08T16:07:14.549763+0000","last_undegraded":"2023-10-08T16:07:14.549763+0000","last_fullsized":"2023-10-08T16:07:14.549763+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.244300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546058+0000","last_change":"2023-10-08T16:07:14.545816+0000","last_active":"2023-10-08T16:07:14.546058+0000","last_peered":"2023-10-08T16:07:14.546058+0000","last_clean":"2023-10-08T16:07:14.546058+0000","last_became_active":"2023-10-08T16:07:14.545517+0000","last_became_peered":"2023-10-08T16:07:14.545517+0000","last_unstale":"2023-10-08T16:07:14.546058+0000","last_undegraded":"2023-10-08T16:07:14.546058+0000","last_fullsized":"2023-10-08T16:07:14.546058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:21.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550738+0000","last_change":"2023-10-08T16:07:14.550316+0000","last_active":"2023-10-08T16:07:14.550738+0000","last_peered":"2023-10-08T16:07:14.550738+0000","last_clean":"2023-10-08T16:07:14.550738+0000","last_became_active":"2023-10-08T16:07:14.549773+0000","last_became_peered":"2023-10-08T16:07:14.549773+0000","last_unstale":"2023-10-08T16:07:14.550738+0000","last_undegraded":"2023-10-08T16:07:14.550738+0000","last_fullsized":"2023-10-08T16:07:14.550738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:45:31.602211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549723+0000","last_change":"2023-10-08T16:07:14.549723+0000","last_active":"2023-10-08T16:07:14.549723+0000","last_peered":"2023-10-08T16:07:14.549723+0000","last_clean":"2023-10-08T16:07:14.549723+0000","last_became_active":"2023-10-08T16:07:14.549049+0000","last_became_peered":"2023-10-08T16:07:14.549049+0000","last_unstale":"2023-10-08T16:07:14.549723+0000","last_undegraded":"2023-10-08T16:07:14.549723+0000","last_fullsized":"2023-10-08T16:07:14.549723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:21.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.555620+0000","last_change":"2023-10-08T16:07:14.555620+0000","last_active":"2023-10-08T16:07:14.555620+0000","last_peered":"2023-10-08T16:07:14.555620+0000","last_clean":"2023-10-08T16:07:14.555620+0000","last_became_active":"2023-10-08T16:07:14.555393+0000","last_became_peered":"2023-10-08T16:07:14.555393+0000","last_unstale":"2023-10-08T16:07:14.555620+0000","last_undegraded":"2023-10-08T16:07:14.555620+0000","last_fullsized":"2023-10-08T16:07:14.555620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:04.377982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549390+0000","last_change":"2023-10-08T16:07:14.549320+0000","last_active":"2023-10-08T16:07:14.549390+0000","last_peered":"2023-10-08T16:07:14.549390+0000","last_clean":"2023-10-08T16:07:14.549390+0000","last_became_active":"2023-10-08T16:07:14.549084+0000","last_became_peered":"2023-10-08T16:07:14.549084+0000","last_unstale":"2023-10-08T16:07:14.549390+0000","last_undegraded":"2023-10-08T16:07:14.549390+0000","last_fullsized":"2023-10-08T16:07:14.549390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:22:18.706760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551728+0000","last_change":"2023-10-08T16:07:14.551728+0000","last_active":"2023-10-08T16:07:14.551728+0000","last_peered":"2023-10-08T16:07:14.551728+0000","last_clean":"2023-10-08T16:07:14.551728+0000","last_became_active":"2023-10-08T16:07:14.551509+0000","last_became_peered":"2023-10-08T16:07:14.551509+0000","last_unstale":"2023-10-08T16:07:14.551728+0000","last_undegraded":"2023-10-08T16:07:14.551728+0000","last_fullsized":"2023-10-08T16:07:14.551728+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:51.311824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.554022+0000","last_change":"2023-10-08T16:07:14.553960+0000","last_active":"2023-10-08T16:07:14.554022+0000","last_peered":"2023-10-08T16:07:14.554022+0000","last_clean":"2023-10-08T16:07:14.554022+0000","last_became_active":"2023-10-08T16:07:14.550100+0000","last_became_peered":"2023-10-08T16:07:14.550100+0000","last_unstale":"2023-10-08T16:07:14.554022+0000","last_undegraded":"2023-10-08T16:07:14.554022+0000","last_fullsized":"2023-10-08T16:07:14.554022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:35.606888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546112+0000","last_change":"2023-10-08T16:07:14.546112+0000","last_active":"2023-10-08T16:07:14.546112+0000","last_peered":"2023-10-08T16:07:14.546112+0000","last_clean":"2023-10-08T16:07:14.546112+0000","last_became_active":"2023-10-08T16:07:14.545852+0000","last_became_peered":"2023-10-08T16:07:14.545852+0000","last_unstale":"2023-10-08T16:07:14.546112+0000","last_undegraded":"2023-10-08T16:07:14.546112+0000","last_fullsized":"2023-10-08T16:07:14.546112+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.244300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546061+0000","last_change":"2023-10-08T16:07:14.546061+0000","last_active":"2023-10-08T16:07:14.546061+0000","last_peered":"2023-10-08T16:07:14.546061+0000","last_clean":"2023-10-08T16:07:14.546061+0000","last_became_active":"2023-10-08T16:07:14.545814+0000","last_became_peered":"2023-10-08T16:07:14.545814+0000","last_unstale":"2023-10-08T16:07:14.546061+0000","last_undegraded":"2023-10-08T16:07:14.546061+0000","last_fullsized":"2023-10-08T16:07:14.546061+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:51.561774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547466+0000","last_change":"2023-10-08T16:07:14.547466+0000","last_active":"2023-10-08T16:07:14.547466+0000","last_peered":"2023-10-08T16:07:14.547466+0000","last_clean":"2023-10-08T16:07:14.547466+0000","last_became_active":"2023-10-08T16:07:14.547214+0000","last_became_peered":"2023-10-08T16:07:14.547214+0000","last_unstale":"2023-10-08T16:07:14.547466+0000","last_undegraded":"2023-10-08T16:07:14.547466+0000","last_fullsized":"2023-10-08T16:07:14.547466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:11:21.008899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552165+0000","last_change":"2023-10-08T16:07:14.552075+0000","last_active":"2023-10-08T16:07:14.552165+0000","last_peered":"2023-10-08T16:07:14.552165+0000","last_clean":"2023-10-08T16:07:14.552165+0000","last_became_active":"2023-10-08T16:07:14.551548+0000","last_became_peered":"2023-10-08T16:07:14.551548+0000","last_unstale":"2023-10-08T16:07:14.552165+0000","last_undegraded":"2023-10-08T16:07:14.552165+0000","last_fullsized":"2023-10-08T16:07:14.552165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:20.520398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547559+0000","last_change":"2023-10-08T16:07:14.546801+0000","last_active":"2023-10-08T16:07:14.547559+0000","last_peered":"2023-10-08T16:07:14.547559+0000","last_clean":"2023-10-08T16:07:14.547559+0000","last_became_active":"2023-10-08T16:07:14.546271+0000","last_became_peered":"2023-10-08T16:07:14.546271+0000","last_unstale":"2023-10-08T16:07:14.547559+0000","last_undegraded":"2023-10-08T16:07:14.547559+0000","last_fullsized":"2023-10-08T16:07:14.547559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:51.311824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543645+0000","last_change":"2023-10-08T16:07:14.543645+0000","last_active":"2023-10-08T16:07:14.543645+0000","last_peered":"2023-10-08T16:07:14.543645+0000","last_clean":"2023-10-08T16:07:14.543645+0000","last_became_active":"2023-10-08T16:07:14.543427+0000","last_became_peered":"2023-10-08T16:07:14.543427+0000","last_unstale":"2023-10-08T16:07:14.543645+0000","last_undegraded":"2023-10-08T16:07:14.543645+0000","last_fullsized":"2023-10-08T16:07:14.543645+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:55.133957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.554738+0000","last_change":"2023-10-08T16:07:14.554677+0000","last_active":"2023-10-08T16:07:14.554738+0000","last_peered":"2023-10-08T16:07:14.554738+0000","last_clean":"2023-10-08T16:07:14.554738+0000","last_became_active":"2023-10-08T16:07:14.554468+0000","last_became_peered":"2023-10-08T16:07:14.554468+0000","last_unstale":"2023-10-08T16:07:14.554738+0000","last_undegraded":"2023-10-08T16:07:14.554738+0000","last_fullsized":"2023-10-08T16:07:14.554738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:34.904301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550215+0000","last_change":"2023-10-08T16:07:14.550215+0000","last_active":"2023-10-08T16:07:14.550215+0000","last_peered":"2023-10-08T16:07:14.550215+0000","last_clean":"2023-10-08T16:07:14.550215+0000","last_became_active":"2023-10-08T16:07:14.549594+0000","last_became_peered":"2023-10-08T16:07:14.549594+0000","last_unstale":"2023-10-08T16:07:14.550215+0000","last_undegraded":"2023-10-08T16:07:14.550215+0000","last_fullsized":"2023-10-08T16:07:14.550215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:32.544387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545265+0000","last_change":"2023-10-08T16:07:14.545265+0000","last_active":"2023-10-08T16:07:14.545265+0000","last_peered":"2023-10-08T16:07:14.545265+0000","last_clean":"2023-10-08T16:07:14.545265+0000","last_became_active":"2023-10-08T16:07:14.545035+0000","last_became_peered":"2023-10-08T16:07:14.545035+0000","last_unstale":"2023-10-08T16:07:14.545265+0000","last_undegraded":"2023-10-08T16:07:14.545265+0000","last_fullsized":"2023-10-08T16:07:14.545265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:51.833428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547577+0000","last_change":"2023-10-08T16:07:14.546938+0000","last_active":"2023-10-08T16:07:14.547577+0000","last_peered":"2023-10-08T16:07:14.547577+0000","last_clean":"2023-10-08T16:07:14.547577+0000","last_became_active":"2023-10-08T16:07:14.546575+0000","last_became_peered":"2023-10-08T16:07:14.546575+0000","last_unstale":"2023-10-08T16:07:14.547577+0000","last_undegraded":"2023-10-08T16:07:14.547577+0000","last_fullsized":"2023-10-08T16:07:14.547577+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:43.671758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547595+0000","last_change":"2023-10-08T16:07:14.547234+0000","last_active":"2023-10-08T16:07:14.547595+0000","last_peered":"2023-10-08T16:07:14.547595+0000","last_clean":"2023-10-08T16:07:14.547595+0000","last_became_active":"2023-10-08T16:07:14.546517+0000","last_became_peered":"2023-10-08T16:07:14.546517+0000","last_unstale":"2023-10-08T16:07:14.547595+0000","last_undegraded":"2023-10-08T16:07:14.547595+0000","last_fullsized":"2023-10-08T16:07:14.547595+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:27.670317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560997+0000","last_change":"2023-10-08T16:07:13.545582+0000","last_active":"2023-10-08T16:07:14.560997+0000","last_peered":"2023-10-08T16:07:14.560997+0000","last_clean":"2023-10-08T16:07:14.560997+0000","last_became_active":"2023-10-08T16:07:13.544938+0000","last_became_peered":"2023-10-08T16:07:13.544938+0000","last_unstale":"2023-10-08T16:07:14.560997+0000","last_undegraded":"2023-10-08T16:07:14.560997+0000","last_fullsized":"2023-10-08T16:07:14.560997+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:31.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547544+0000","last_change":"2023-10-08T16:07:14.547544+0000","last_active":"2023-10-08T16:07:14.547544+0000","last_peered":"2023-10-08T16:07:14.547544+0000","last_clean":"2023-10-08T16:07:14.547544+0000","last_became_active":"2023-10-08T16:07:14.545672+0000","last_became_peered":"2023-10-08T16:07:14.545672+0000","last_unstale":"2023-10-08T16:07:14.547544+0000","last_undegraded":"2023-10-08T16:07:14.547544+0000","last_fullsized":"2023-10-08T16:07:14.547544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:46.119258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560227+0000","last_change":"2023-10-08T16:07:13.549206+0000","last_active":"2023-10-08T16:07:14.560227+0000","last_peered":"2023-10-08T16:07:14.560227+0000","last_clean":"2023-10-08T16:07:14.560227+0000","last_became_active":"2023-10-08T16:07:13.547250+0000","last_became_peered":"2023-10-08T16:07:13.547250+0000","last_unstale":"2023-10-08T16:07:14.560227+0000","last_undegraded":"2023-10-08T16:07:14.560227+0000","last_fullsized":"2023-10-08T16:07:14.560227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:42.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551236+0000","last_change":"2023-10-08T16:07:14.549790+0000","last_active":"2023-10-08T16:07:14.551236+0000","last_peered":"2023-10-08T16:07:14.551236+0000","last_clean":"2023-10-08T16:07:14.551236+0000","last_became_active":"2023-10-08T16:07:14.549571+0000","last_became_peered":"2023-10-08T16:07:14.549571+0000","last_unstale":"2023-10-08T16:07:14.551236+0000","last_undegraded":"2023-10-08T16:07:14.551236+0000","last_fullsized":"2023-10-08T16:07:14.551236+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:44.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557285+0000","last_change":"2023-10-08T16:07:13.546721+0000","last_active":"2023-10-08T16:07:14.557285+0000","last_peered":"2023-10-08T16:07:14.557285+0000","last_clean":"2023-10-08T16:07:14.557285+0000","last_became_active":"2023-10-08T16:07:13.546170+0000","last_became_peered":"2023-10-08T16:07:13.546170+0000","last_unstale":"2023-10-08T16:07:14.557285+0000","last_undegraded":"2023-10-08T16:07:14.557285+0000","last_fullsized":"2023-10-08T16:07:14.557285+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:49.848072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551219+0000","last_change":"2023-10-08T16:07:14.549197+0000","last_active":"2023-10-08T16:07:14.551219+0000","last_peered":"2023-10-08T16:07:14.551219+0000","last_clean":"2023-10-08T16:07:14.551219+0000","last_became_active":"2023-10-08T16:07:14.548984+0000","last_became_peered":"2023-10-08T16:07:14.548984+0000","last_unstale":"2023-10-08T16:07:14.551219+0000","last_undegraded":"2023-10-08T16:07:14.551219+0000","last_fullsized":"2023-10-08T16:07:14.551219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:44.668779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557543+0000","last_change":"2023-10-08T16:07:13.550729+0000","last_active":"2023-10-08T16:07:14.557543+0000","last_peered":"2023-10-08T16:07:14.557543+0000","last_clean":"2023-10-08T16:07:14.557543+0000","last_became_active":"2023-10-08T16:07:13.550413+0000","last_became_peered":"2023-10-08T16:07:13.550413+0000","last_unstale":"2023-10-08T16:07:14.557543+0000","last_undegraded":"2023-10-08T16:07:14.557543+0000","last_fullsized":"2023-10-08T16:07:14.557543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:37.830140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552382+0000","last_change":"2023-10-08T16:07:14.552227+0000","last_active":"2023-10-08T16:07:14.552382+0000","last_peered":"2023-10-08T16:07:14.552382+0000","last_clean":"2023-10-08T16:07:14.552382+0000","last_became_active":"2023-10-08T16:07:14.551662+0000","last_became_peered":"2023-10-08T16:07:14.551662+0000","last_unstale":"2023-10-08T16:07:14.552382+0000","last_undegraded":"2023-10-08T16:07:14.552382+0000","last_fullsized":"2023-10-08T16:07:14.552382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:03.176723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'1","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.542874+0000","last_change":"2023-10-08T16:07:13.548671+0000","last_active":"2023-10-08T16:07:14.542874+0000","last_peered":"2023-10-08T16:07:14.542874+0000","last_clean":"2023-10-08T16:07:14.542874+0000","last_became_active":"2023-10-08T16:07:13.548265+0000","last_became_peered":"2023-10-08T16:07:13.548265+0000","last_unstale":"2023-10-08T16:07:14.542874+0000","last_undegraded":"2023-10-08T16:07:14.542874+0000","last_fullsized":"2023-10-08T16:07:14.542874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:47.710445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549822+0000","last_change":"2023-10-08T16:07:14.549399+0000","last_active":"2023-10-08T16:07:14.549822+0000","last_peered":"2023-10-08T16:07:14.549822+0000","last_clean":"2023-10-08T16:07:14.549822+0000","last_became_active":"2023-10-08T16:07:14.548682+0000","last_became_peered":"2023-10-08T16:07:14.548682+0000","last_unstale":"2023-10-08T16:07:14.549822+0000","last_undegraded":"2023-10-08T16:07:14.549822+0000","last_fullsized":"2023-10-08T16:07:14.549822+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:37.720092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560577+0000","last_change":"2023-10-08T16:07:13.545431+0000","last_active":"2023-10-08T16:07:14.560577+0000","last_peered":"2023-10-08T16:07:14.560577+0000","last_clean":"2023-10-08T16:07:14.560577+0000","last_became_active":"2023-10-08T16:07:13.544545+0000","last_became_peered":"2023-10-08T16:07:13.544545+0000","last_unstale":"2023-10-08T16:07:14.560577+0000","last_undegraded":"2023-10-08T16:07:14.560577+0000","last_fullsized":"2023-10-08T16:07:14.560577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:15.981800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545140+0000","last_change":"2023-10-08T16:07:14.545140+0000","last_active":"2023-10-08T16:07:14.545140+0000","last_peered":"2023-10-08T16:07:14.545140+0000","last_clean":"2023-10-08T16:07:14.545140+0000","last_became_active":"2023-10-08T16:07:14.544910+0000","last_became_peered":"2023-10-08T16:07:14.544910+0000","last_unstale":"2023-10-08T16:07:14.545140+0000","last_undegraded":"2023-10-08T16:07:14.545140+0000","last_fullsized":"2023-10-08T16:07:14.545140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:43.205276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.541318+0000","last_change":"2023-10-08T16:07:13.550479+0000","last_active":"2023-10-08T16:07:14.541318+0000","last_peered":"2023-10-08T16:07:14.541318+0000","last_clean":"2023-10-08T16:07:14.541318+0000","last_became_active":"2023-10-08T16:07:13.550238+0000","last_became_peered":"2023-10-08T16:07:13.550238+0000","last_unstale":"2023-10-08T16:07:14.541318+0000","last_undegraded":"2023-10-08T16:07:14.541318+0000","last_fullsized":"2023-10-08T16:07:14.541318+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:38.727137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551258+0000","last_change":"2023-10-08T16:07:14.551198+0000","last_active":"2023-10-08T16:07:14.551258+0000","last_peered":"2023-10-08T16:07:14.551258+0000","last_clean":"2023-10-08T16:07:14.551258+0000","last_became_active":"2023-10-08T16:07:14.550950+0000","last_became_peered":"2023-10-08T16:07:14.550950+0000","last_unstale":"2023-10-08T16:07:14.551258+0000","last_undegraded":"2023-10-08T16:07:14.551258+0000","last_fullsized":"2023-10-08T16:07:14.551258+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:28.147597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.544190+0000","last_change":"2023-10-08T16:07:13.544114+0000","last_active":"2023-10-08T16:07:13.544190+0000","last_peered":"2023-10-08T16:07:13.544190+0000","last_clean":"2023-10-08T16:07:13.544190+0000","last_became_active":"2023-10-08T16:07:13.543445+0000","last_became_peered":"2023-10-08T16:07:13.543445+0000","last_unstale":"2023-10-08T16:07:13.544190+0000","last_undegraded":"2023-10-08T16:07:13.544190+0000","last_fullsized":"2023-10-08T16:07:13.544190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:51.593758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548432+0000","last_change":"2023-10-08T16:07:14.548432+0000","last_active":"2023-10-08T16:07:14.548432+0000","last_peered":"2023-10-08T16:07:14.548432+0000","last_clean":"2023-10-08T16:07:14.548432+0000","last_became_active":"2023-10-08T16:07:14.548147+0000","last_became_peered":"2023-10-08T16:07:14.548147+0000","last_unstale":"2023-10-08T16:07:14.548432+0000","last_undegraded":"2023-10-08T16:07:14.548432+0000","last_fullsized":"2023-10-08T16:07:14.548432+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:00.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.553126+0000","last_change":"2023-10-08T16:07:13.553017+0000","last_active":"2023-10-08T16:07:13.553126+0000","last_peered":"2023-10-08T16:07:13.553126+0000","last_clean":"2023-10-08T16:07:13.553126+0000","last_became_active":"2023-10-08T16:07:13.552430+0000","last_became_peered":"2023-10-08T16:07:13.552430+0000","last_unstale":"2023-10-08T16:07:13.553126+0000","last_undegraded":"2023-10-08T16:07:13.553126+0000","last_fullsized":"2023-10-08T16:07:13.553126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:50.557925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546871+0000","last_change":"2023-10-08T16:07:14.546871+0000","last_active":"2023-10-08T16:07:14.546871+0000","last_peered":"2023-10-08T16:07:14.546871+0000","last_clean":"2023-10-08T16:07:14.546871+0000","last_became_active":"2023-10-08T16:07:14.545994+0000","last_became_peered":"2023-10-08T16:07:14.545994+0000","last_unstale":"2023-10-08T16:07:14.546871+0000","last_undegraded":"2023-10-08T16:07:14.546871+0000","last_fullsized":"2023-10-08T16:07:14.546871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:16.139915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543020+0000","last_change":"2023-10-08T16:07:13.550323+0000","last_active":"2023-10-08T16:07:14.543020+0000","last_peered":"2023-10-08T16:07:14.543020+0000","last_clean":"2023-10-08T16:07:14.543020+0000","last_became_active":"2023-10-08T16:07:13.550038+0000","last_became_peered":"2023-10-08T16:07:13.550038+0000","last_unstale":"2023-10-08T16:07:14.543020+0000","last_undegraded":"2023-10-08T16:07:14.543020+0000","last_fullsized":"2023-10-08T16:07:14.543020+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:19.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551218+0000","last_change":"2023-10-08T16:07:14.551218+0000","last_active":"2023-10-08T16:07:14.551218+0000","last_peered":"2023-10-08T16:07:14.551218+0000","last_clean":"2023-10-08T16:07:14.551218+0000","last_became_active":"2023-10-08T16:07:14.550972+0000","last_became_peered":"2023-10-08T16:07:14.550972+0000","last_unstale":"2023-10-08T16:07:14.551218+0000","last_undegraded":"2023-10-08T16:07:14.551218+0000","last_fullsized":"2023-10-08T16:07:14.551218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:43.205276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"63'3","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.561097+0000","last_change":"2023-10-08T16:07:13.549500+0000","last_active":"2023-10-08T16:07:14.561097+0000","last_peered":"2023-10-08T16:07:14.561097+0000","last_clean":"2023-10-08T16:07:14.561097+0000","last_became_active":"2023-10-08T16:07:13.548613+0000","last_became_peered":"2023-10-08T16:07:13.548613+0000","last_unstale":"2023-10-08T16:07:14.561097+0000","last_undegraded":"2023-10-08T16:07:14.561097+0000","last_fullsized":"2023-10-08T16:07:14.561097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:42.201427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545194+0000","last_change":"2023-10-08T16:07:14.545194+0000","last_active":"2023-10-08T16:07:14.545194+0000","last_peered":"2023-10-08T16:07:14.545194+0000","last_clean":"2023-10-08T16:07:14.545194+0000","last_became_active":"2023-10-08T16:07:14.544967+0000","last_became_peered":"2023-10-08T16:07:14.544967+0000","last_unstale":"2023-10-08T16:07:14.545194+0000","last_undegraded":"2023-10-08T16:07:14.545194+0000","last_fullsized":"2023-10-08T16:07:14.545194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:22.856136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'6","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.558831+0000","last_change":"2023-10-08T16:07:13.548839+0000","last_active":"2023-10-08T16:07:14.558831+0000","last_peered":"2023-10-08T16:07:14.558831+0000","last_clean":"2023-10-08T16:07:14.558831+0000","last_became_active":"2023-10-08T16:07:13.548197+0000","last_became_peered":"2023-10-08T16:07:13.548197+0000","last_unstale":"2023-10-08T16:07:14.558831+0000","last_undegraded":"2023-10-08T16:07:14.558831+0000","last_fullsized":"2023-10-08T16:07:14.558831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:42.201427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552548+0000","last_change":"2023-10-08T16:07:14.552376+0000","last_active":"2023-10-08T16:07:14.552548+0000","last_peered":"2023-10-08T16:07:14.552548+0000","last_clean":"2023-10-08T16:07:14.552548+0000","last_became_active":"2023-10-08T16:07:14.551855+0000","last_became_peered":"2023-10-08T16:07:14.551855+0000","last_unstale":"2023-10-08T16:07:14.552548+0000","last_undegraded":"2023-10-08T16:07:14.552548+0000","last_fullsized":"2023-10-08T16:07:14.552548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:32.544387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560494+0000","last_change":"2023-10-08T16:07:13.546950+0000","last_active":"2023-10-08T16:07:14.560494+0000","last_peered":"2023-10-08T16:07:14.560494+0000","last_clean":"2023-10-08T16:07:14.560494+0000","last_became_active":"2023-10-08T16:07:13.546723+0000","last_became_peered":"2023-10-08T16:07:13.546723+0000","last_unstale":"2023-10-08T16:07:14.560494+0000","last_undegraded":"2023-10-08T16:07:14.560494+0000","last_fullsized":"2023-10-08T16:07:14.560494+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:31.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546427+0000","last_change":"2023-10-08T16:07:14.546427+0000","last_active":"2023-10-08T16:07:14.546427+0000","last_peered":"2023-10-08T16:07:14.546427+0000","last_clean":"2023-10-08T16:07:14.546427+0000","last_became_active":"2023-10-08T16:07:14.545799+0000","last_became_peered":"2023-10-08T16:07:14.545799+0000","last_unstale":"2023-10-08T16:07:14.546427+0000","last_undegraded":"2023-10-08T16:07:14.546427+0000","last_fullsized":"2023-10-08T16:07:14.546427+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:50.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.551683+0000","last_change":"2023-10-08T16:07:13.551620+0000","last_active":"2023-10-08T16:07:13.551683+0000","last_peered":"2023-10-08T16:07:13.551683+0000","last_clean":"2023-10-08T16:07:13.551683+0000","last_became_active":"2023-10-08T16:07:13.551406+0000","last_became_peered":"2023-10-08T16:07:13.551406+0000","last_unstale":"2023-10-08T16:07:13.551683+0000","last_undegraded":"2023-10-08T16:07:13.551683+0000","last_fullsized":"2023-10-08T16:07:13.551683+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:11.523064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548514+0000","last_change":"2023-10-08T16:07:14.548514+0000","last_active":"2023-10-08T16:07:14.548514+0000","last_peered":"2023-10-08T16:07:14.548514+0000","last_clean":"2023-10-08T16:07:14.548514+0000","last_became_active":"2023-10-08T16:07:14.548034+0000","last_became_peered":"2023-10-08T16:07:14.548034+0000","last_unstale":"2023-10-08T16:07:14.548514+0000","last_undegraded":"2023-10-08T16:07:14.548514+0000","last_fullsized":"2023-10-08T16:07:14.548514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:51.522840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.542162+0000","last_change":"2023-10-08T16:07:13.546025+0000","last_active":"2023-10-08T16:07:14.542162+0000","last_peered":"2023-10-08T16:07:14.542162+0000","last_clean":"2023-10-08T16:07:14.542162+0000","last_became_active":"2023-10-08T16:07:13.545815+0000","last_became_peered":"2023-10-08T16:07:13.545815+0000","last_unstale":"2023-10-08T16:07:14.542162+0000","last_undegraded":"2023-10-08T16:07:14.542162+0000","last_fullsized":"2023-10-08T16:07:14.542162+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:27.756461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545082+0000","last_change":"2023-10-08T16:07:14.545082+0000","last_active":"2023-10-08T16:07:14.545082+0000","last_peered":"2023-10-08T16:07:14.545082+0000","last_clean":"2023-10-08T16:07:14.545082+0000","last_became_active":"2023-10-08T16:07:14.544861+0000","last_became_peered":"2023-10-08T16:07:14.544861+0000","last_unstale":"2023-10-08T16:07:14.545082+0000","last_undegraded":"2023-10-08T16:07:14.545082+0000","last_fullsized":"2023-10-08T16:07:14.545082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:43.744487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"63'8","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.559879+0000","last_change":"2023-10-08T16:07:13.549677+0000","last_active":"2023-10-08T16:07:14.559879+0000","last_peered":"2023-10-08T16:07:14.559879+0000","last_clean":"2023-10-08T16:07:14.559879+0000","last_became_active":"2023-10-08T16:07:13.549068+0000","last_became_peered":"2023-10-08T16:07:13.549068+0000","last_unstale":"2023-10-08T16:07:14.559879+0000","last_undegraded":"2023-10-08T16:07:14.559879+0000","last_fullsized":"2023-10-08T16:07:14.559879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:52.333432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550383+0000","last_change":"2023-10-08T16:07:14.550383+0000","last_active":"2023-10-08T16:07:14.550383+0000","last_peered":"2023-10-08T16:07:14.550383+0000","last_clean":"2023-10-08T16:07:14.550383+0000","last_became_active":"2023-10-08T16:07:14.549931+0000","last_became_peered":"2023-10-08T16:07:14.549931+0000","last_unstale":"2023-10-08T16:07:14.550383+0000","last_undegraded":"2023-10-08T16:07:14.550383+0000","last_fullsized":"2023-10-08T16:07:14.550383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:46.119258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.559773+0000","last_change":"2023-10-08T16:07:13.549394+0000","last_active":"2023-10-08T16:07:14.559773+0000","last_peered":"2023-10-08T16:07:14.559773+0000","last_clean":"2023-10-08T16:07:14.559773+0000","last_became_active":"2023-10-08T16:07:13.548977+0000","last_became_peered":"2023-10-08T16:07:13.548977+0000","last_unstale":"2023-10-08T16:07:14.559773+0000","last_undegraded":"2023-10-08T16:07:14.559773+0000","last_fullsized":"2023-10-08T16:07:14.559773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:21.640650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550492+0000","last_change":"2023-10-08T16:07:14.547173+0000","last_active":"2023-10-08T16:07:14.550492+0000","last_peered":"2023-10-08T16:07:14.550492+0000","last_clean":"2023-10-08T16:07:14.550492+0000","last_became_active":"2023-10-08T16:07:14.545351+0000","last_became_peered":"2023-10-08T16:07:14.545351+0000","last_unstale":"2023-10-08T16:07:14.550492+0000","last_undegraded":"2023-10-08T16:07:14.550492+0000","last_fullsized":"2023-10-08T16:07:14.550492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:43.744487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557932+0000","last_change":"2023-10-08T16:07:13.546912+0000","last_active":"2023-10-08T16:07:14.557932+0000","last_peered":"2023-10-08T16:07:14.557932+0000","last_clean":"2023-10-08T16:07:14.557932+0000","last_became_active":"2023-10-08T16:07:13.546489+0000","last_became_peered":"2023-10-08T16:07:13.546489+0000","last_unstale":"2023-10-08T16:07:14.557932+0000","last_undegraded":"2023-10-08T16:07:14.557932+0000","last_fullsized":"2023-10-08T16:07:14.557932+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:50.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.554117+0000","last_change":"2023-10-08T16:07:14.554076+0000","last_active":"2023-10-08T16:07:14.554117+0000","last_peered":"2023-10-08T16:07:14.554117+0000","last_clean":"2023-10-08T16:07:14.554117+0000","last_became_active":"2023-10-08T16:07:14.550535+0000","last_became_peered":"2023-10-08T16:07:14.550535+0000","last_unstale":"2023-10-08T16:07:14.554117+0000","last_undegraded":"2023-10-08T16:07:14.554117+0000","last_fullsized":"2023-10-08T16:07:14.554117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:37.988708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557994+0000","last_change":"2023-10-08T16:07:13.550606+0000","last_active":"2023-10-08T16:07:14.557994+0000","last_peered":"2023-10-08T16:07:14.557994+0000","last_clean":"2023-10-08T16:07:14.557994+0000","last_became_active":"2023-10-08T16:07:13.550105+0000","last_became_peered":"2023-10-08T16:07:13.550105+0000","last_unstale":"2023-10-08T16:07:14.557994+0000","last_undegraded":"2023-10-08T16:07:14.557994+0000","last_fullsized":"2023-10-08T16:07:14.557994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:45.115409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547003+0000","last_change":"2023-10-08T16:07:14.547003+0000","last_active":"2023-10-08T16:07:14.547003+0000","last_peered":"2023-10-08T16:07:14.547003+0000","last_clean":"2023-10-08T16:07:14.547003+0000","last_became_active":"2023-10-08T16:07:14.546347+0000","last_became_peered":"2023-10-08T16:07:14.546347+0000","last_unstale":"2023-10-08T16:07:14.547003+0000","last_undegraded":"2023-10-08T16:07:14.547003+0000","last_fullsized":"2023-10-08T16:07:14.547003+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:22.644499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543584+0000","last_change":"2023-10-08T16:07:13.550452+0000","last_active":"2023-10-08T16:07:14.543584+0000","last_peered":"2023-10-08T16:07:14.543584+0000","last_clean":"2023-10-08T16:07:14.543584+0000","last_became_active":"2023-10-08T16:07:13.550203+0000","last_became_peered":"2023-10-08T16:07:13.550203+0000","last_unstale":"2023-10-08T16:07:14.543584+0000","last_undegraded":"2023-10-08T16:07:14.543584+0000","last_fullsized":"2023-10-08T16:07:14.543584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:45.115409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550532+0000","last_change":"2023-10-08T16:07:14.547307+0000","last_active":"2023-10-08T16:07:14.550532+0000","last_peered":"2023-10-08T16:07:14.550532+0000","last_clean":"2023-10-08T16:07:14.550532+0000","last_became_active":"2023-10-08T16:07:14.546920+0000","last_became_peered":"2023-10-08T16:07:14.546920+0000","last_unstale":"2023-10-08T16:07:14.550532+0000","last_undegraded":"2023-10-08T16:07:14.550532+0000","last_fullsized":"2023-10-08T16:07:14.550532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:22.644499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560280+0000","last_change":"2023-10-08T16:07:13.546428+0000","last_active":"2023-10-08T16:07:14.560280+0000","last_peered":"2023-10-08T16:07:14.560280+0000","last_clean":"2023-10-08T16:07:14.560280+0000","last_became_active":"2023-10-08T16:07:13.545924+0000","last_became_peered":"2023-10-08T16:07:13.545924+0000","last_unstale":"2023-10-08T16:07:14.560280+0000","last_undegraded":"2023-10-08T16:07:14.560280+0000","last_fullsized":"2023-10-08T16:07:14.560280+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:20.636508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548048+0000","last_change":"2023-10-08T16:07:14.547889+0000","last_active":"2023-10-08T16:07:14.548048+0000","last_peered":"2023-10-08T16:07:14.548048+0000","last_clean":"2023-10-08T16:07:14.548048+0000","last_became_active":"2023-10-08T16:07:14.547529+0000","last_became_peered":"2023-10-08T16:07:14.547529+0000","last_unstale":"2023-10-08T16:07:14.548048+0000","last_undegraded":"2023-10-08T16:07:14.548048+0000","last_fullsized":"2023-10-08T16:07:14.548048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:18.468848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.546573+0000","last_change":"2023-10-08T16:07:13.546283+0000","last_active":"2023-10-08T16:07:13.546573+0000","last_peered":"2023-10-08T16:07:13.546573+0000","last_clean":"2023-10-08T16:07:13.546573+0000","last_became_active":"2023-10-08T16:07:13.546056+0000","last_became_peered":"2023-10-08T16:07:13.546056+0000","last_unstale":"2023-10-08T16:07:13.546573+0000","last_undegraded":"2023-10-08T16:07:13.546573+0000","last_fullsized":"2023-10-08T16:07:13.546573+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:46.862053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545288+0000","last_change":"2023-10-08T16:07:14.544907+0000","last_active":"2023-10-08T16:07:14.545288+0000","last_peered":"2023-10-08T16:07:14.545288+0000","last_clean":"2023-10-08T16:07:14.545288+0000","last_became_active":"2023-10-08T16:07:14.544612+0000","last_became_peered":"2023-10-08T16:07:14.544612+0000","last_unstale":"2023-10-08T16:07:14.545288+0000","last_undegraded":"2023-10-08T16:07:14.545288+0000","last_fullsized":"2023-10-08T16:07:14.545288+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:18.855037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.544044+0000","last_change":"2023-10-08T16:07:13.548339+0000","last_active":"2023-10-08T16:07:14.544044+0000","last_peered":"2023-10-08T16:07:14.544044+0000","last_clean":"2023-10-08T16:07:14.544044+0000","last_became_active":"2023-10-08T16:07:13.548016+0000","last_became_peered":"2023-10-08T16:07:13.548016+0000","last_unstale":"2023-10-08T16:07:14.544044+0000","last_undegraded":"2023-10-08T16:07:14.544044+0000","last_fullsized":"2023-10-08T16:07:14.544044+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:51.593758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550514+0000","last_change":"2023-10-08T16:07:14.547235+0000","last_active":"2023-10-08T16:07:14.550514+0000","last_peered":"2023-10-08T16:07:14.550514+0000","last_clean":"2023-10-08T16:07:14.550514+0000","last_became_active":"2023-10-08T16:07:14.546985+0000","last_became_peered":"2023-10-08T16:07:14.546985+0000","last_unstale":"2023-10-08T16:07:14.550514+0000","last_undegraded":"2023-10-08T16:07:14.550514+0000","last_fullsized":"2023-10-08T16:07:14.550514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.244300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"63'2","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560907+0000","last_change":"2023-10-08T16:07:13.540263+0000","last_active":"2023-10-08T16:07:14.560907+0000","last_peered":"2023-10-08T16:07:14.560907+0000","last_clean":"2023-10-08T16:07:14.560907+0000","last_became_active":"2023-10-08T16:07:13.539966+0000","last_became_peered":"2023-10-08T16:07:13.539966+0000","last_unstale":"2023-10-08T16:07:14.560907+0000","last_undegraded":"2023-10-08T16:07:14.560907+0000","last_fullsized":"2023-10-08T16:07:14.560907+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:35.751296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550561+0000","last_change":"2023-10-08T16:07:14.550057+0000","last_active":"2023-10-08T16:07:14.550561+0000","last_peered":"2023-10-08T16:07:14.550561+0000","last_clean":"2023-10-08T16:07:14.550561+0000","last_became_active":"2023-10-08T16:07:14.545002+0000","last_became_peered":"2023-10-08T16:07:14.545002+0000","last_unstale":"2023-10-08T16:07:14.550561+0000","last_undegraded":"2023-10-08T16:07:14.550561+0000","last_fullsized":"2023-10-08T16:07:14.550561+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:28.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.542659+0000","last_change":"2023-10-08T16:07:13.545724+0000","last_active":"2023-10-08T16:07:14.542659+0000","last_peered":"2023-10-08T16:07:14.542659+0000","last_clean":"2023-10-08T16:07:14.542659+0000","last_became_active":"2023-10-08T16:07:13.545211+0000","last_became_peered":"2023-10-08T16:07:13.545211+0000","last_unstale":"2023-10-08T16:07:14.542659+0000","last_undegraded":"2023-10-08T16:07:14.542659+0000","last_fullsized":"2023-10-08T16:07:14.542659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:32.121913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549316+0000","last_change":"2023-10-08T16:07:14.549316+0000","last_active":"2023-10-08T16:07:14.549316+0000","last_peered":"2023-10-08T16:07:14.549316+0000","last_clean":"2023-10-08T16:07:14.549316+0000","last_became_active":"2023-10-08T16:07:14.549097+0000","last_became_peered":"2023-10-08T16:07:14.549097+0000","last_unstale":"2023-10-08T16:07:14.549316+0000","last_undegraded":"2023-10-08T16:07:14.549316+0000","last_fullsized":"2023-10-08T16:07:14.549316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:53.337281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.542558+0000","last_change":"2023-10-08T16:07:13.542489+0000","last_active":"2023-10-08T16:07:13.542558+0000","last_peered":"2023-10-08T16:07:13.542558+0000","last_clean":"2023-10-08T16:07:13.542558+0000","last_became_active":"2023-10-08T16:07:13.542259+0000","last_became_peered":"2023-10-08T16:07:13.542259+0000","last_unstale":"2023-10-08T16:07:13.542558+0000","last_undegraded":"2023-10-08T16:07:13.542558+0000","last_fullsized":"2023-10-08T16:07:13.542558+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:35.751296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547611+0000","last_change":"2023-10-08T16:07:14.547365+0000","last_active":"2023-10-08T16:07:14.547611+0000","last_peered":"2023-10-08T16:07:14.547611+0000","last_clean":"2023-10-08T16:07:14.547611+0000","last_became_active":"2023-10-08T16:07:14.546835+0000","last_became_peered":"2023-10-08T16:07:14.546835+0000","last_unstale":"2023-10-08T16:07:14.547611+0000","last_undegraded":"2023-10-08T16:07:14.547611+0000","last_fullsized":"2023-10-08T16:07:14.547611+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:16.139915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.541529+0000","last_change":"2023-10-08T16:07:13.543191+0000","last_active":"2023-10-08T16:07:14.541529+0000","last_peered":"2023-10-08T16:07:14.541529+0000","last_clean":"2023-10-08T16:07:14.541529+0000","last_became_active":"2023-10-08T16:07:13.542916+0000","last_became_peered":"2023-10-08T16:07:13.542916+0000","last_unstale":"2023-10-08T16:07:14.541529+0000","last_undegraded":"2023-10-08T16:07:14.541529+0000","last_fullsized":"2023-10-08T16:07:14.541529+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:47.710445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.555154+0000","last_change":"2023-10-08T16:07:14.555093+0000","last_active":"2023-10-08T16:07:14.555154+0000","last_peered":"2023-10-08T16:07:14.555154+0000","last_clean":"2023-10-08T16:07:14.555154+0000","last_became_active":"2023-10-08T16:07:14.554876+0000","last_became_peered":"2023-10-08T16:07:14.554876+0000","last_unstale":"2023-10-08T16:07:14.555154+0000","last_undegraded":"2023-10-08T16:07:14.555154+0000","last_fullsized":"2023-10-08T16:07:14.555154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:55.158280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.544749+0000","last_change":"2023-10-08T16:07:13.544620+0000","last_active":"2023-10-08T16:07:13.544749+0000","last_peered":"2023-10-08T16:07:13.544749+0000","last_clean":"2023-10-08T16:07:13.544749+0000","last_became_active":"2023-10-08T16:07:13.544376+0000","last_became_peered":"2023-10-08T16:07:13.544376+0000","last_unstale":"2023-10-08T16:07:13.544749+0000","last_undegraded":"2023-10-08T16:07:13.544749+0000","last_fullsized":"2023-10-08T16:07:13.544749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:02.627277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547086+0000","last_change":"2023-10-08T16:07:14.547086+0000","last_active":"2023-10-08T16:07:14.547086+0000","last_peered":"2023-10-08T16:07:14.547086+0000","last_clean":"2023-10-08T16:07:14.547086+0000","last_became_active":"2023-10-08T16:07:14.546648+0000","last_became_peered":"2023-10-08T16:07:14.546648+0000","last_unstale":"2023-10-08T16:07:14.547086+0000","last_undegraded":"2023-10-08T16:07:14.547086+0000","last_fullsized":"2023-10-08T16:07:14.547086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:28.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.548577+0000","last_change":"2023-10-08T16:07:13.548494+0000","last_active":"2023-10-08T16:07:13.548577+0000","last_peered":"2023-10-08T16:07:13.548577+0000","last_clean":"2023-10-08T16:07:13.548577+0000","last_became_active":"2023-10-08T16:07:13.547921+0000","last_became_peered":"2023-10-08T16:07:13.547921+0000","last_unstale":"2023-10-08T16:07:13.548577+0000","last_undegraded":"2023-10-08T16:07:13.548577+0000","last_fullsized":"2023-10-08T16:07:13.548577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:38.727137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545630+0000","last_change":"2023-10-08T16:07:14.545630+0000","last_active":"2023-10-08T16:07:14.545630+0000","last_peered":"2023-10-08T16:07:14.545630+0000","last_clean":"2023-10-08T16:07:14.545630+0000","last_became_active":"2023-10-08T16:07:14.545375+0000","last_became_peered":"2023-10-08T16:07:14.545375+0000","last_unstale":"2023-10-08T16:07:14.545630+0000","last_undegraded":"2023-10-08T16:07:14.545630+0000","last_fullsized":"2023-10-08T16:07:14.545630+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:39.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.546555+0000","last_change":"2023-10-08T16:07:13.545313+0000","last_active":"2023-10-08T16:07:13.546555+0000","last_peered":"2023-10-08T16:07:13.546555+0000","last_clean":"2023-10-08T16:07:13.546555+0000","last_became_active":"2023-10-08T16:07:13.544799+0000","last_became_peered":"2023-10-08T16:07:13.544799+0000","last_unstale":"2023-10-08T16:07:13.546555+0000","last_undegraded":"2023-10-08T16:07:13.546555+0000","last_fullsized":"2023-10-08T16:07:13.546555+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:11.523064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552084+0000","last_change":"2023-10-08T16:07:14.552041+0000","last_active":"2023-10-08T16:07:14.552084+0000","last_peered":"2023-10-08T16:07:14.552084+0000","last_clean":"2023-10-08T16:07:14.552084+0000","last_became_active":"2023-10-08T16:07:14.551416+0000","last_became_peered":"2023-10-08T16:07:14.551416+0000","last_unstale":"2023-10-08T16:07:14.552084+0000","last_undegraded":"2023-10-08T16:07:14.552084+0000","last_fullsized":"2023-10-08T16:07:14.552084+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:22.961534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550479+0000","last_change":"2023-10-08T16:07:13.545383+0000","last_active":"2023-10-08T16:07:14.550479+0000","last_peered":"2023-10-08T16:07:14.550479+0000","last_clean":"2023-10-08T16:07:14.550479+0000","last_became_active":"2023-10-08T16:07:13.545117+0000","last_became_peered":"2023-10-08T16:07:13.545117+0000","last_unstale":"2023-10-08T16:07:14.550479+0000","last_undegraded":"2023-10-08T16:07:14.550479+0000","last_fullsized":"2023-10-08T16:07:14.550479+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:29:52.742395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547782+0000","last_change":"2023-10-08T16:07:14.547720+0000","last_active":"2023-10-08T16:07:14.547782+0000","last_peered":"2023-10-08T16:07:14.547782+0000","last_clean":"2023-10-08T16:07:14.547782+0000","last_became_active":"2023-10-08T16:07:14.547514+0000","last_became_peered":"2023-10-08T16:07:14.547514+0000","last_unstale":"2023-10-08T16:07:14.547782+0000","last_undegraded":"2023-10-08T16:07:14.547782+0000","last_fullsized":"2023-10-08T16:07:14.547782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:13.636434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.545984+0000","last_change":"2023-10-08T16:07:13.545914+0000","last_active":"2023-10-08T16:07:13.545984+0000","last_peered":"2023-10-08T16:07:13.545984+0000","last_clean":"2023-10-08T16:07:13.545984+0000","last_became_active":"2023-10-08T16:07:13.545666+0000","last_became_peered":"2023-10-08T16:07:13.545666+0000","last_unstale":"2023-10-08T16:07:13.545984+0000","last_undegraded":"2023-10-08T16:07:13.545984+0000","last_fullsized":"2023-10-08T16:07:13.545984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:00.586010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.544518+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:07:13.544518+0000","last_peered":"2023-10-08T16:07:13.544518+0000","last_clean":"2023-10-08T16:07:13.544518+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:07:13.544518+0000","last_undegraded":"2023-10-08T16:07:13.544518+0000","last_fullsized":"2023-10-08T16:07:13.544518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194423,"statfs":{"total":200000000,"available":199089527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.78400000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71199999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":1.6919999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70399999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.756}]},{"osd":3,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73399999999999999,"5min":0.747,"15min":0.747},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":1.79}]},{"osd":4,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":1.8620000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.823}]},{"osd":6,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68200000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":1.252}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195000,"statfs":{"total":200000000,"available":199680055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.504}]},{"osd":1,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.443}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65200000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.497,"15min":0.49199999999999999},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.373},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679965,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.48899999999999999,"15min":0.51000000000000001},"min":{"1min":0.22900000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.57199999999999995,"5min":3.593,"15min":3.593},"last":0.316},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.25700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436}]},{"osd":3,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.28199999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.98199999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.629,"15min":0.625},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2969999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":3.532,"15min":3.532},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.341,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.095},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5429999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194415,"statfs":{"total":200000000,"available":199081309,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.22700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54000000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.48599999999999999,"15min":0.5},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56899999999999995,"5min":2.254,"15min":2.254},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46000000000000002,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.37}]},{"osd":3,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.309},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41599999999999998},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71499999999999997,"15min":0.72799999999999998},"min":{"1min":0.42799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88100000000000001,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.625},{"interface":"front","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.875,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76500000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":1.079,"15min":1.079},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":2.355,"15min":2.355},"last":0.53100000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77700000000000002,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91800000000000004,"5min":1.002,"15min":1.002},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.45000000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.26300000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42499999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.40899999999999997,"5min":0.746,"15min":0.746},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.437,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47599999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.49199999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":0.72799999999999998,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73699999999999999,"5min":0.875,"15min":0.875},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72099999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66500000000000004,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39300000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48199999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.318},{"interface":"front","average":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80700000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73799999999999999,"5min":0.873,"15min":0.873},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89000000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194998,"statfs":{"total":200000000,"available":199678519,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77600000000000002,"5min":1.141,"15min":1.141},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76700000000000002,"5min":1.149,"15min":1.149},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.60799999999999998,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.4749999999999996,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.60299999999999998,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.8730000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.3029999999999999,"5min":0.70299999999999996,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":14.6,"5min":14.6,"15min":14.6},"last":0.51900000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.61799999999999999,"15min":0.56599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":7.556,"5min":7.556,"15min":7.556},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.497,"15min":0.498},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73699999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69799999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.502},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75700000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78500000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66200000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67200000000000004}]}]}],"pool_statfs":[]}} 2023-10-08T16:07:18.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:07:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.806+0000 7f159c32b700 1 Processor -- start 2023-10-08T16:07:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.806+0000 7f159c32b700 1 -- start start 2023-10-08T16:07:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.807+0000 7f159c32b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15940b0e50 0x7f15940c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.807+0000 7f159c32b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940b1220 0x7f159406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.807+0000 7f159c32b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159415de60 con 0x7f159406dad0 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.807+0000 7f159c32b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159415e140 con 0x7f15940b0e50 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.807+0000 7f159c32b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159415e420 con 0x7f15940b1220 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15940b0e50 0x7f15940c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15940b0e50 0x7f15940c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49318/0 (socket says 172.21.15.60:49318) 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 -- 172.21.15.60:0/339329034 learned_addr learned my addr 172.21.15.60:0/339329034 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f15998c6700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940b1220 0x7f159406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 -- 172.21.15.60:0/339329034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940b1220 msgr2=0x7f159406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940b1220 0x7f159406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 -- 172.21.15.60:0/339329034 >> v1:172.21.15.144:6789/0 conn(0x7f159406dad0 legacy=0x7f15940cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 -- 172.21.15.60:0/339329034 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159415e700 con 0x7f15940b0e50 2023-10-08T16:07:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f15998c6700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940b1220 0x7f159406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f159a0c7700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f15940c9180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f158c0099e0 tx=0x7f158c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8727267c1a2c264 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f15990c5700 1 -- 172.21.15.60:0/339329034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00b820 con 0x7f15940b0e50 2023-10-08T16:07:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f15990c5700 1 -- 172.21.15.60:0/339329034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00b980 con 0x7f15940b0e50 2023-10-08T16:07:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.808+0000 7f15990c5700 1 -- 172.21.15.60:0/339329034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00bd40 con 0x7f15940b0e50 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 -- 172.21.15.60:0/339329034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 msgr2=0x7f15940c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f15940c9180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f158c0099e0 tx=0x7f158c009250 comp rx=0 tx=0).stop 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 -- 172.21.15.60:0/339329034 shutdown_connections 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f15940c9180 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 --2- 172.21.15.60:0/339329034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15940b1220 0x7f159406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 -- 172.21.15.60:0/339329034 >> 172.21.15.60:0/339329034 conn(0x7f1594069870 msgr2=0x7f1594069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 -- 172.21.15.60:0/339329034 shutdown_connections 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.809+0000 7f159c32b700 1 -- 172.21.15.60:0/339329034 wait complete. 2023-10-08T16:07:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.810+0000 7f159c32b700 1 Processor -- start 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.810+0000 7f159c32b700 1 -- start start 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159c32b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159406dad0 0x7f1594151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159c32b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f1594155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159c32b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15940b1220 0x7f15940ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159c32b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594156970 con 0x7f15940b0e50 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159c32b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594151780 con 0x7f15940b1220 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159c32b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1594155d60 con 0x7f159406dad0 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f1594155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f1594155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49326/0 (socket says 172.21.15.60:49326) 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 -- 172.21.15.60:0/2045232440 learned_addr learned my addr 172.21.15.60:0/2045232440 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159a0c7700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159406dad0 0x7f1594151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159a8c8700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15940b1220 0x7f15940ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 -- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159406dad0 msgr2=0x7f1594151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159406dad0 0x7f1594151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 -- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15940b1220 msgr2=0x7f15940ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15940b1220 0x7f15940ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 -- 172.21.15.60:0/2045232440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0094f0 con 0x7f15940b0e50 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159a0c7700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159406dad0 0x7f1594151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f159a8c8700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15940b1220 0x7f15940ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.811+0000 7f15998c6700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f1594155350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f158800d860 tx=0x7f1588008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.812+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880125f0 con 0x7f15940b0e50 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.812+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1588012750 con 0x7f15940b0e50 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.812+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1594156040 con 0x7f15940b0e50 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.812+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588012ad0 con 0x7f15940b0e50 2023-10-08T16:07:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.812+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1594156600 con 0x7f15940b0e50 2023-10-08T16:07:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.813+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1594156ae0 con 0x7f15940b0e50 2023-10-08T16:07:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.813+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1588014430 con 0x7f15940b0e50 2023-10-08T16:07:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.813+0000 7f15927fc700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.813+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1588084980 con 0x7f15940b0e50 2023-10-08T16:07:18.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.813+0000 7f159a0c7700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:18.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.814+0000 7f159a0c7700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1580066f30 0x7f15800693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f158c0099e0 tx=0x7f158c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:18.818+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1588055680 con 0x7f15940b0e50 2023-10-08T16:07:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.005+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f159404c3c0 con 0x7f1580066f30 2023-10-08T16:07:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.013+0000 7f15927fc700 1 -- 172.21.15.60:0/2045232440 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285032 (secure 0 0 0) 0x7f159404c3c0 con 0x7f1580066f30 2023-10-08T16:07:19.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1580066f30 msgr2=0x7f15800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1580066f30 0x7f15800693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f158c0099e0 tx=0x7f158c017000 comp rx=0 tx=0).stop 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 msgr2=0x7f1594155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f1594155350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f158800d860 tx=0x7f1588008040 comp rx=0 tx=0).stop 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 shutdown_connections 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f159406dad0 0x7f1594151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15940b1220 0x7f15940ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 --2- 172.21.15.60:0/2045232440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15940b0e50 0x7f1594155350 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 >> 172.21.15.60:0/2045232440 conn(0x7f1594069870 msgr2=0x7f1594157f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 shutdown_connections 2023-10-08T16:07:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.016+0000 7f159c32b700 1 -- 172.21.15.60:0/2045232440 wait complete. 2023-10-08T16:07:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:07:19.029 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-08T16:07:17.587386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558836,"statfs":{"total":1600000000,"available":1596248804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056205"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547382+0000","last_change":"2023-10-08T16:07:14.547382+0000","last_active":"2023-10-08T16:07:14.547382+0000","last_peered":"2023-10-08T16:07:14.547382+0000","last_clean":"2023-10-08T16:07:14.547382+0000","last_became_active":"2023-10-08T16:07:14.546723+0000","last_became_peered":"2023-10-08T16:07:14.546723+0000","last_unstale":"2023-10-08T16:07:14.547382+0000","last_undegraded":"2023-10-08T16:07:14.547382+0000","last_fullsized":"2023-10-08T16:07:14.547382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:57.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549841+0000","last_change":"2023-10-08T16:07:14.549549+0000","last_active":"2023-10-08T16:07:14.549841+0000","last_peered":"2023-10-08T16:07:14.549841+0000","last_clean":"2023-10-08T16:07:14.549841+0000","last_became_active":"2023-10-08T16:07:14.549175+0000","last_became_peered":"2023-10-08T16:07:14.549175+0000","last_unstale":"2023-10-08T16:07:14.549841+0000","last_undegraded":"2023-10-08T16:07:14.549841+0000","last_fullsized":"2023-10-08T16:07:14.549841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:57.583434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549874+0000","last_change":"2023-10-08T16:07:14.549874+0000","last_active":"2023-10-08T16:07:14.549874+0000","last_peered":"2023-10-08T16:07:14.549874+0000","last_clean":"2023-10-08T16:07:14.549874+0000","last_became_active":"2023-10-08T16:07:14.549367+0000","last_became_peered":"2023-10-08T16:07:14.549367+0000","last_unstale":"2023-10-08T16:07:14.549874+0000","last_undegraded":"2023-10-08T16:07:14.549874+0000","last_fullsized":"2023-10-08T16:07:14.549874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:00.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545039+0000","last_change":"2023-10-08T16:07:14.544799+0000","last_active":"2023-10-08T16:07:14.545039+0000","last_peered":"2023-10-08T16:07:14.545039+0000","last_clean":"2023-10-08T16:07:14.545039+0000","last_became_active":"2023-10-08T16:07:14.544465+0000","last_became_peered":"2023-10-08T16:07:14.544465+0000","last_unstale":"2023-10-08T16:07:14.545039+0000","last_undegraded":"2023-10-08T16:07:14.545039+0000","last_fullsized":"2023-10-08T16:07:14.545039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:29:53.746244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543246+0000","last_change":"2023-10-08T16:07:14.543246+0000","last_active":"2023-10-08T16:07:14.543246+0000","last_peered":"2023-10-08T16:07:14.543246+0000","last_clean":"2023-10-08T16:07:14.543246+0000","last_became_active":"2023-10-08T16:07:14.542974+0000","last_became_peered":"2023-10-08T16:07:14.542974+0000","last_unstale":"2023-10-08T16:07:14.543246+0000","last_undegraded":"2023-10-08T16:07:14.543246+0000","last_fullsized":"2023-10-08T16:07:14.543246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:31.257215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551198+0000","last_change":"2023-10-08T16:07:14.548759+0000","last_active":"2023-10-08T16:07:14.551198+0000","last_peered":"2023-10-08T16:07:14.551198+0000","last_clean":"2023-10-08T16:07:14.551198+0000","last_became_active":"2023-10-08T16:07:14.548497+0000","last_became_peered":"2023-10-08T16:07:14.548497+0000","last_unstale":"2023-10-08T16:07:14.551198+0000","last_undegraded":"2023-10-08T16:07:14.551198+0000","last_fullsized":"2023-10-08T16:07:14.551198+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:30:05.701056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.553185+0000","last_change":"2023-10-08T16:07:14.553185+0000","last_active":"2023-10-08T16:07:14.553185+0000","last_peered":"2023-10-08T16:07:14.553185+0000","last_clean":"2023-10-08T16:07:14.553185+0000","last_became_active":"2023-10-08T16:07:14.552879+0000","last_became_peered":"2023-10-08T16:07:14.552879+0000","last_unstale":"2023-10-08T16:07:14.553185+0000","last_undegraded":"2023-10-08T16:07:14.553185+0000","last_fullsized":"2023-10-08T16:07:14.553185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:32.009208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552442+0000","last_change":"2023-10-08T16:07:14.552365+0000","last_active":"2023-10-08T16:07:14.552442+0000","last_peered":"2023-10-08T16:07:14.552442+0000","last_clean":"2023-10-08T16:07:14.552442+0000","last_became_active":"2023-10-08T16:07:14.551907+0000","last_became_peered":"2023-10-08T16:07:14.551907+0000","last_unstale":"2023-10-08T16:07:14.552442+0000","last_undegraded":"2023-10-08T16:07:14.552442+0000","last_fullsized":"2023-10-08T16:07:14.552442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:50:28.617545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552392+0000","last_change":"2023-10-08T16:07:14.552392+0000","last_active":"2023-10-08T16:07:14.552392+0000","last_peered":"2023-10-08T16:07:14.552392+0000","last_clean":"2023-10-08T16:07:14.552392+0000","last_became_active":"2023-10-08T16:07:14.552171+0000","last_became_peered":"2023-10-08T16:07:14.552171+0000","last_unstale":"2023-10-08T16:07:14.552392+0000","last_undegraded":"2023-10-08T16:07:14.552392+0000","last_fullsized":"2023-10-08T16:07:14.552392+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:50.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547378+0000","last_change":"2023-10-08T16:07:14.547378+0000","last_active":"2023-10-08T16:07:14.547378+0000","last_peered":"2023-10-08T16:07:14.547378+0000","last_clean":"2023-10-08T16:07:14.547378+0000","last_became_active":"2023-10-08T16:07:14.547160+0000","last_became_peered":"2023-10-08T16:07:14.547160+0000","last_unstale":"2023-10-08T16:07:14.547378+0000","last_undegraded":"2023-10-08T16:07:14.547378+0000","last_fullsized":"2023-10-08T16:07:14.547378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:48.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548767+0000","last_change":"2023-10-08T16:07:14.548767+0000","last_active":"2023-10-08T16:07:14.548767+0000","last_peered":"2023-10-08T16:07:14.548767+0000","last_clean":"2023-10-08T16:07:14.548767+0000","last_became_active":"2023-10-08T16:07:14.547888+0000","last_became_peered":"2023-10-08T16:07:14.547888+0000","last_unstale":"2023-10-08T16:07:14.548767+0000","last_undegraded":"2023-10-08T16:07:14.548767+0000","last_fullsized":"2023-10-08T16:07:14.548767+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:28.760310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550579+0000","last_change":"2023-10-08T16:07:14.550196+0000","last_active":"2023-10-08T16:07:14.550579+0000","last_peered":"2023-10-08T16:07:14.550579+0000","last_clean":"2023-10-08T16:07:14.550579+0000","last_became_active":"2023-10-08T16:07:14.549850+0000","last_became_peered":"2023-10-08T16:07:14.549850+0000","last_unstale":"2023-10-08T16:07:14.550579+0000","last_undegraded":"2023-10-08T16:07:14.550579+0000","last_fullsized":"2023-10-08T16:07:14.550579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:21.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550969+0000","last_change":"2023-10-08T16:07:14.550969+0000","last_active":"2023-10-08T16:07:14.550969+0000","last_peered":"2023-10-08T16:07:14.550969+0000","last_clean":"2023-10-08T16:07:14.550969+0000","last_became_active":"2023-10-08T16:07:14.550640+0000","last_became_peered":"2023-10-08T16:07:14.550640+0000","last_unstale":"2023-10-08T16:07:14.550969+0000","last_undegraded":"2023-10-08T16:07:14.550969+0000","last_fullsized":"2023-10-08T16:07:14.550969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:53.337281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549187+0000","last_change":"2023-10-08T16:07:14.549187+0000","last_active":"2023-10-08T16:07:14.549187+0000","last_peered":"2023-10-08T16:07:14.549187+0000","last_clean":"2023-10-08T16:07:14.549187+0000","last_became_active":"2023-10-08T16:07:14.548969+0000","last_became_peered":"2023-10-08T16:07:14.548969+0000","last_unstale":"2023-10-08T16:07:14.549187+0000","last_undegraded":"2023-10-08T16:07:14.549187+0000","last_fullsized":"2023-10-08T16:07:14.549187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:22.856136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549763+0000","last_change":"2023-10-08T16:07:14.549763+0000","last_active":"2023-10-08T16:07:14.549763+0000","last_peered":"2023-10-08T16:07:14.549763+0000","last_clean":"2023-10-08T16:07:14.549763+0000","last_became_active":"2023-10-08T16:07:14.549495+0000","last_became_peered":"2023-10-08T16:07:14.549495+0000","last_unstale":"2023-10-08T16:07:14.549763+0000","last_undegraded":"2023-10-08T16:07:14.549763+0000","last_fullsized":"2023-10-08T16:07:14.549763+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.244300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546058+0000","last_change":"2023-10-08T16:07:14.545816+0000","last_active":"2023-10-08T16:07:14.546058+0000","last_peered":"2023-10-08T16:07:14.546058+0000","last_clean":"2023-10-08T16:07:14.546058+0000","last_became_active":"2023-10-08T16:07:14.545517+0000","last_became_peered":"2023-10-08T16:07:14.545517+0000","last_unstale":"2023-10-08T16:07:14.546058+0000","last_undegraded":"2023-10-08T16:07:14.546058+0000","last_fullsized":"2023-10-08T16:07:14.546058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:21.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550738+0000","last_change":"2023-10-08T16:07:14.550316+0000","last_active":"2023-10-08T16:07:14.550738+0000","last_peered":"2023-10-08T16:07:14.550738+0000","last_clean":"2023-10-08T16:07:14.550738+0000","last_became_active":"2023-10-08T16:07:14.549773+0000","last_became_peered":"2023-10-08T16:07:14.549773+0000","last_unstale":"2023-10-08T16:07:14.550738+0000","last_undegraded":"2023-10-08T16:07:14.550738+0000","last_fullsized":"2023-10-08T16:07:14.550738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:45:31.602211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549723+0000","last_change":"2023-10-08T16:07:14.549723+0000","last_active":"2023-10-08T16:07:14.549723+0000","last_peered":"2023-10-08T16:07:14.549723+0000","last_clean":"2023-10-08T16:07:14.549723+0000","last_became_active":"2023-10-08T16:07:14.549049+0000","last_became_peered":"2023-10-08T16:07:14.549049+0000","last_unstale":"2023-10-08T16:07:14.549723+0000","last_undegraded":"2023-10-08T16:07:14.549723+0000","last_fullsized":"2023-10-08T16:07:14.549723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:21.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.555620+0000","last_change":"2023-10-08T16:07:14.555620+0000","last_active":"2023-10-08T16:07:14.555620+0000","last_peered":"2023-10-08T16:07:14.555620+0000","last_clean":"2023-10-08T16:07:14.555620+0000","last_became_active":"2023-10-08T16:07:14.555393+0000","last_became_peered":"2023-10-08T16:07:14.555393+0000","last_unstale":"2023-10-08T16:07:14.555620+0000","last_undegraded":"2023-10-08T16:07:14.555620+0000","last_fullsized":"2023-10-08T16:07:14.555620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:04.377982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549390+0000","last_change":"2023-10-08T16:07:14.549320+0000","last_active":"2023-10-08T16:07:14.549390+0000","last_peered":"2023-10-08T16:07:14.549390+0000","last_clean":"2023-10-08T16:07:14.549390+0000","last_became_active":"2023-10-08T16:07:14.549084+0000","last_became_peered":"2023-10-08T16:07:14.549084+0000","last_unstale":"2023-10-08T16:07:14.549390+0000","last_undegraded":"2023-10-08T16:07:14.549390+0000","last_fullsized":"2023-10-08T16:07:14.549390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:22:18.706760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551728+0000","last_change":"2023-10-08T16:07:14.551728+0000","last_active":"2023-10-08T16:07:14.551728+0000","last_peered":"2023-10-08T16:07:14.551728+0000","last_clean":"2023-10-08T16:07:14.551728+0000","last_became_active":"2023-10-08T16:07:14.551509+0000","last_became_peered":"2023-10-08T16:07:14.551509+0000","last_unstale":"2023-10-08T16:07:14.551728+0000","last_undegraded":"2023-10-08T16:07:14.551728+0000","last_fullsized":"2023-10-08T16:07:14.551728+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:51.311824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.554022+0000","last_change":"2023-10-08T16:07:14.553960+0000","last_active":"2023-10-08T16:07:14.554022+0000","last_peered":"2023-10-08T16:07:14.554022+0000","last_clean":"2023-10-08T16:07:14.554022+0000","last_became_active":"2023-10-08T16:07:14.550100+0000","last_became_peered":"2023-10-08T16:07:14.550100+0000","last_unstale":"2023-10-08T16:07:14.554022+0000","last_undegraded":"2023-10-08T16:07:14.554022+0000","last_fullsized":"2023-10-08T16:07:14.554022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:35.606888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546112+0000","last_change":"2023-10-08T16:07:14.546112+0000","last_active":"2023-10-08T16:07:14.546112+0000","last_peered":"2023-10-08T16:07:14.546112+0000","last_clean":"2023-10-08T16:07:14.546112+0000","last_became_active":"2023-10-08T16:07:14.545852+0000","last_became_peered":"2023-10-08T16:07:14.545852+0000","last_unstale":"2023-10-08T16:07:14.546112+0000","last_undegraded":"2023-10-08T16:07:14.546112+0000","last_fullsized":"2023-10-08T16:07:14.546112+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.244300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546061+0000","last_change":"2023-10-08T16:07:14.546061+0000","last_active":"2023-10-08T16:07:14.546061+0000","last_peered":"2023-10-08T16:07:14.546061+0000","last_clean":"2023-10-08T16:07:14.546061+0000","last_became_active":"2023-10-08T16:07:14.545814+0000","last_became_peered":"2023-10-08T16:07:14.545814+0000","last_unstale":"2023-10-08T16:07:14.546061+0000","last_undegraded":"2023-10-08T16:07:14.546061+0000","last_fullsized":"2023-10-08T16:07:14.546061+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:51.561774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547466+0000","last_change":"2023-10-08T16:07:14.547466+0000","last_active":"2023-10-08T16:07:14.547466+0000","last_peered":"2023-10-08T16:07:14.547466+0000","last_clean":"2023-10-08T16:07:14.547466+0000","last_became_active":"2023-10-08T16:07:14.547214+0000","last_became_peered":"2023-10-08T16:07:14.547214+0000","last_unstale":"2023-10-08T16:07:14.547466+0000","last_undegraded":"2023-10-08T16:07:14.547466+0000","last_fullsized":"2023-10-08T16:07:14.547466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:11:21.008899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552165+0000","last_change":"2023-10-08T16:07:14.552075+0000","last_active":"2023-10-08T16:07:14.552165+0000","last_peered":"2023-10-08T16:07:14.552165+0000","last_clean":"2023-10-08T16:07:14.552165+0000","last_became_active":"2023-10-08T16:07:14.551548+0000","last_became_peered":"2023-10-08T16:07:14.551548+0000","last_unstale":"2023-10-08T16:07:14.552165+0000","last_undegraded":"2023-10-08T16:07:14.552165+0000","last_fullsized":"2023-10-08T16:07:14.552165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:20.520398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547559+0000","last_change":"2023-10-08T16:07:14.546801+0000","last_active":"2023-10-08T16:07:14.547559+0000","last_peered":"2023-10-08T16:07:14.547559+0000","last_clean":"2023-10-08T16:07:14.547559+0000","last_became_active":"2023-10-08T16:07:14.546271+0000","last_became_peered":"2023-10-08T16:07:14.546271+0000","last_unstale":"2023-10-08T16:07:14.547559+0000","last_undegraded":"2023-10-08T16:07:14.547559+0000","last_fullsized":"2023-10-08T16:07:14.547559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:51.311824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543645+0000","last_change":"2023-10-08T16:07:14.543645+0000","last_active":"2023-10-08T16:07:14.543645+0000","last_peered":"2023-10-08T16:07:14.543645+0000","last_clean":"2023-10-08T16:07:14.543645+0000","last_became_active":"2023-10-08T16:07:14.543427+0000","last_became_peered":"2023-10-08T16:07:14.543427+0000","last_unstale":"2023-10-08T16:07:14.543645+0000","last_undegraded":"2023-10-08T16:07:14.543645+0000","last_fullsized":"2023-10-08T16:07:14.543645+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:55.133957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.554738+0000","last_change":"2023-10-08T16:07:14.554677+0000","last_active":"2023-10-08T16:07:14.554738+0000","last_peered":"2023-10-08T16:07:14.554738+0000","last_clean":"2023-10-08T16:07:14.554738+0000","last_became_active":"2023-10-08T16:07:14.554468+0000","last_became_peered":"2023-10-08T16:07:14.554468+0000","last_unstale":"2023-10-08T16:07:14.554738+0000","last_undegraded":"2023-10-08T16:07:14.554738+0000","last_fullsized":"2023-10-08T16:07:14.554738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:34.904301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550215+0000","last_change":"2023-10-08T16:07:14.550215+0000","last_active":"2023-10-08T16:07:14.550215+0000","last_peered":"2023-10-08T16:07:14.550215+0000","last_clean":"2023-10-08T16:07:14.550215+0000","last_became_active":"2023-10-08T16:07:14.549594+0000","last_became_peered":"2023-10-08T16:07:14.549594+0000","last_unstale":"2023-10-08T16:07:14.550215+0000","last_undegraded":"2023-10-08T16:07:14.550215+0000","last_fullsized":"2023-10-08T16:07:14.550215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:32.544387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545265+0000","last_change":"2023-10-08T16:07:14.545265+0000","last_active":"2023-10-08T16:07:14.545265+0000","last_peered":"2023-10-08T16:07:14.545265+0000","last_clean":"2023-10-08T16:07:14.545265+0000","last_became_active":"2023-10-08T16:07:14.545035+0000","last_became_peered":"2023-10-08T16:07:14.545035+0000","last_unstale":"2023-10-08T16:07:14.545265+0000","last_undegraded":"2023-10-08T16:07:14.545265+0000","last_fullsized":"2023-10-08T16:07:14.545265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:51.833428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547577+0000","last_change":"2023-10-08T16:07:14.546938+0000","last_active":"2023-10-08T16:07:14.547577+0000","last_peered":"2023-10-08T16:07:14.547577+0000","last_clean":"2023-10-08T16:07:14.547577+0000","last_became_active":"2023-10-08T16:07:14.546575+0000","last_became_peered":"2023-10-08T16:07:14.546575+0000","last_unstale":"2023-10-08T16:07:14.547577+0000","last_undegraded":"2023-10-08T16:07:14.547577+0000","last_fullsized":"2023-10-08T16:07:14.547577+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:43.671758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547595+0000","last_change":"2023-10-08T16:07:14.547234+0000","last_active":"2023-10-08T16:07:14.547595+0000","last_peered":"2023-10-08T16:07:14.547595+0000","last_clean":"2023-10-08T16:07:14.547595+0000","last_became_active":"2023-10-08T16:07:14.546517+0000","last_became_peered":"2023-10-08T16:07:14.546517+0000","last_unstale":"2023-10-08T16:07:14.547595+0000","last_undegraded":"2023-10-08T16:07:14.547595+0000","last_fullsized":"2023-10-08T16:07:14.547595+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:27.670317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560997+0000","last_change":"2023-10-08T16:07:13.545582+0000","last_active":"2023-10-08T16:07:14.560997+0000","last_peered":"2023-10-08T16:07:14.560997+0000","last_clean":"2023-10-08T16:07:14.560997+0000","last_became_active":"2023-10-08T16:07:13.544938+0000","last_became_peered":"2023-10-08T16:07:13.544938+0000","last_unstale":"2023-10-08T16:07:14.560997+0000","last_undegraded":"2023-10-08T16:07:14.560997+0000","last_fullsized":"2023-10-08T16:07:14.560997+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:31.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547544+0000","last_change":"2023-10-08T16:07:14.547544+0000","last_active":"2023-10-08T16:07:14.547544+0000","last_peered":"2023-10-08T16:07:14.547544+0000","last_clean":"2023-10-08T16:07:14.547544+0000","last_became_active":"2023-10-08T16:07:14.545672+0000","last_became_peered":"2023-10-08T16:07:14.545672+0000","last_unstale":"2023-10-08T16:07:14.547544+0000","last_undegraded":"2023-10-08T16:07:14.547544+0000","last_fullsized":"2023-10-08T16:07:14.547544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:46.119258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560227+0000","last_change":"2023-10-08T16:07:13.549206+0000","last_active":"2023-10-08T16:07:14.560227+0000","last_peered":"2023-10-08T16:07:14.560227+0000","last_clean":"2023-10-08T16:07:14.560227+0000","last_became_active":"2023-10-08T16:07:13.547250+0000","last_became_peered":"2023-10-08T16:07:13.547250+0000","last_unstale":"2023-10-08T16:07:14.560227+0000","last_undegraded":"2023-10-08T16:07:14.560227+0000","last_fullsized":"2023-10-08T16:07:14.560227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:42.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551236+0000","last_change":"2023-10-08T16:07:14.549790+0000","last_active":"2023-10-08T16:07:14.551236+0000","last_peered":"2023-10-08T16:07:14.551236+0000","last_clean":"2023-10-08T16:07:14.551236+0000","last_became_active":"2023-10-08T16:07:14.549571+0000","last_became_peered":"2023-10-08T16:07:14.549571+0000","last_unstale":"2023-10-08T16:07:14.551236+0000","last_undegraded":"2023-10-08T16:07:14.551236+0000","last_fullsized":"2023-10-08T16:07:14.551236+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:44.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557285+0000","last_change":"2023-10-08T16:07:13.546721+0000","last_active":"2023-10-08T16:07:14.557285+0000","last_peered":"2023-10-08T16:07:14.557285+0000","last_clean":"2023-10-08T16:07:14.557285+0000","last_became_active":"2023-10-08T16:07:13.546170+0000","last_became_peered":"2023-10-08T16:07:13.546170+0000","last_unstale":"2023-10-08T16:07:14.557285+0000","last_undegraded":"2023-10-08T16:07:14.557285+0000","last_fullsized":"2023-10-08T16:07:14.557285+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:49.848072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551219+0000","last_change":"2023-10-08T16:07:14.549197+0000","last_active":"2023-10-08T16:07:14.551219+0000","last_peered":"2023-10-08T16:07:14.551219+0000","last_clean":"2023-10-08T16:07:14.551219+0000","last_became_active":"2023-10-08T16:07:14.548984+0000","last_became_peered":"2023-10-08T16:07:14.548984+0000","last_unstale":"2023-10-08T16:07:14.551219+0000","last_undegraded":"2023-10-08T16:07:14.551219+0000","last_fullsized":"2023-10-08T16:07:14.551219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:44.668779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557543+0000","last_change":"2023-10-08T16:07:13.550729+0000","last_active":"2023-10-08T16:07:14.557543+0000","last_peered":"2023-10-08T16:07:14.557543+0000","last_clean":"2023-10-08T16:07:14.557543+0000","last_became_active":"2023-10-08T16:07:13.550413+0000","last_became_peered":"2023-10-08T16:07:13.550413+0000","last_unstale":"2023-10-08T16:07:14.557543+0000","last_undegraded":"2023-10-08T16:07:14.557543+0000","last_fullsized":"2023-10-08T16:07:14.557543+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:37.830140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552382+0000","last_change":"2023-10-08T16:07:14.552227+0000","last_active":"2023-10-08T16:07:14.552382+0000","last_peered":"2023-10-08T16:07:14.552382+0000","last_clean":"2023-10-08T16:07:14.552382+0000","last_became_active":"2023-10-08T16:07:14.551662+0000","last_became_peered":"2023-10-08T16:07:14.551662+0000","last_unstale":"2023-10-08T16:07:14.552382+0000","last_undegraded":"2023-10-08T16:07:14.552382+0000","last_fullsized":"2023-10-08T16:07:14.552382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:03.176723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'1","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.542874+0000","last_change":"2023-10-08T16:07:13.548671+0000","last_active":"2023-10-08T16:07:14.542874+0000","last_peered":"2023-10-08T16:07:14.542874+0000","last_clean":"2023-10-08T16:07:14.542874+0000","last_became_active":"2023-10-08T16:07:13.548265+0000","last_became_peered":"2023-10-08T16:07:13.548265+0000","last_unstale":"2023-10-08T16:07:14.542874+0000","last_undegraded":"2023-10-08T16:07:14.542874+0000","last_fullsized":"2023-10-08T16:07:14.542874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:47.710445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549822+0000","last_change":"2023-10-08T16:07:14.549399+0000","last_active":"2023-10-08T16:07:14.549822+0000","last_peered":"2023-10-08T16:07:14.549822+0000","last_clean":"2023-10-08T16:07:14.549822+0000","last_became_active":"2023-10-08T16:07:14.548682+0000","last_became_peered":"2023-10-08T16:07:14.548682+0000","last_unstale":"2023-10-08T16:07:14.549822+0000","last_undegraded":"2023-10-08T16:07:14.549822+0000","last_fullsized":"2023-10-08T16:07:14.549822+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:37.720092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560577+0000","last_change":"2023-10-08T16:07:13.545431+0000","last_active":"2023-10-08T16:07:14.560577+0000","last_peered":"2023-10-08T16:07:14.560577+0000","last_clean":"2023-10-08T16:07:14.560577+0000","last_became_active":"2023-10-08T16:07:13.544545+0000","last_became_peered":"2023-10-08T16:07:13.544545+0000","last_unstale":"2023-10-08T16:07:14.560577+0000","last_undegraded":"2023-10-08T16:07:14.560577+0000","last_fullsized":"2023-10-08T16:07:14.560577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:15.981800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545140+0000","last_change":"2023-10-08T16:07:14.545140+0000","last_active":"2023-10-08T16:07:14.545140+0000","last_peered":"2023-10-08T16:07:14.545140+0000","last_clean":"2023-10-08T16:07:14.545140+0000","last_became_active":"2023-10-08T16:07:14.544910+0000","last_became_peered":"2023-10-08T16:07:14.544910+0000","last_unstale":"2023-10-08T16:07:14.545140+0000","last_undegraded":"2023-10-08T16:07:14.545140+0000","last_fullsized":"2023-10-08T16:07:14.545140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:43.205276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.541318+0000","last_change":"2023-10-08T16:07:13.550479+0000","last_active":"2023-10-08T16:07:14.541318+0000","last_peered":"2023-10-08T16:07:14.541318+0000","last_clean":"2023-10-08T16:07:14.541318+0000","last_became_active":"2023-10-08T16:07:13.550238+0000","last_became_peered":"2023-10-08T16:07:13.550238+0000","last_unstale":"2023-10-08T16:07:14.541318+0000","last_undegraded":"2023-10-08T16:07:14.541318+0000","last_fullsized":"2023-10-08T16:07:14.541318+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:38.727137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551258+0000","last_change":"2023-10-08T16:07:14.551198+0000","last_active":"2023-10-08T16:07:14.551258+0000","last_peered":"2023-10-08T16:07:14.551258+0000","last_clean":"2023-10-08T16:07:14.551258+0000","last_became_active":"2023-10-08T16:07:14.550950+0000","last_became_peered":"2023-10-08T16:07:14.550950+0000","last_unstale":"2023-10-08T16:07:14.551258+0000","last_undegraded":"2023-10-08T16:07:14.551258+0000","last_fullsized":"2023-10-08T16:07:14.551258+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:28.147597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.544190+0000","last_change":"2023-10-08T16:07:13.544114+0000","last_active":"2023-10-08T16:07:13.544190+0000","last_peered":"2023-10-08T16:07:13.544190+0000","last_clean":"2023-10-08T16:07:13.544190+0000","last_became_active":"2023-10-08T16:07:13.543445+0000","last_became_peered":"2023-10-08T16:07:13.543445+0000","last_unstale":"2023-10-08T16:07:13.544190+0000","last_undegraded":"2023-10-08T16:07:13.544190+0000","last_fullsized":"2023-10-08T16:07:13.544190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:51.593758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548432+0000","last_change":"2023-10-08T16:07:14.548432+0000","last_active":"2023-10-08T16:07:14.548432+0000","last_peered":"2023-10-08T16:07:14.548432+0000","last_clean":"2023-10-08T16:07:14.548432+0000","last_became_active":"2023-10-08T16:07:14.548147+0000","last_became_peered":"2023-10-08T16:07:14.548147+0000","last_unstale":"2023-10-08T16:07:14.548432+0000","last_undegraded":"2023-10-08T16:07:14.548432+0000","last_fullsized":"2023-10-08T16:07:14.548432+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:00.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.553126+0000","last_change":"2023-10-08T16:07:13.553017+0000","last_active":"2023-10-08T16:07:13.553126+0000","last_peered":"2023-10-08T16:07:13.553126+0000","last_clean":"2023-10-08T16:07:13.553126+0000","last_became_active":"2023-10-08T16:07:13.552430+0000","last_became_peered":"2023-10-08T16:07:13.552430+0000","last_unstale":"2023-10-08T16:07:13.553126+0000","last_undegraded":"2023-10-08T16:07:13.553126+0000","last_fullsized":"2023-10-08T16:07:13.553126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:50.557925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546871+0000","last_change":"2023-10-08T16:07:14.546871+0000","last_active":"2023-10-08T16:07:14.546871+0000","last_peered":"2023-10-08T16:07:14.546871+0000","last_clean":"2023-10-08T16:07:14.546871+0000","last_became_active":"2023-10-08T16:07:14.545994+0000","last_became_peered":"2023-10-08T16:07:14.545994+0000","last_unstale":"2023-10-08T16:07:14.546871+0000","last_undegraded":"2023-10-08T16:07:14.546871+0000","last_fullsized":"2023-10-08T16:07:14.546871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:16.139915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543020+0000","last_change":"2023-10-08T16:07:13.550323+0000","last_active":"2023-10-08T16:07:14.543020+0000","last_peered":"2023-10-08T16:07:14.543020+0000","last_clean":"2023-10-08T16:07:14.543020+0000","last_became_active":"2023-10-08T16:07:13.550038+0000","last_became_peered":"2023-10-08T16:07:13.550038+0000","last_unstale":"2023-10-08T16:07:14.543020+0000","last_undegraded":"2023-10-08T16:07:14.543020+0000","last_fullsized":"2023-10-08T16:07:14.543020+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:19.516549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.551218+0000","last_change":"2023-10-08T16:07:14.551218+0000","last_active":"2023-10-08T16:07:14.551218+0000","last_peered":"2023-10-08T16:07:14.551218+0000","last_clean":"2023-10-08T16:07:14.551218+0000","last_became_active":"2023-10-08T16:07:14.550972+0000","last_became_peered":"2023-10-08T16:07:14.550972+0000","last_unstale":"2023-10-08T16:07:14.551218+0000","last_undegraded":"2023-10-08T16:07:14.551218+0000","last_fullsized":"2023-10-08T16:07:14.551218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:43.205276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"63'3","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.561097+0000","last_change":"2023-10-08T16:07:13.549500+0000","last_active":"2023-10-08T16:07:14.561097+0000","last_peered":"2023-10-08T16:07:14.561097+0000","last_clean":"2023-10-08T16:07:14.561097+0000","last_became_active":"2023-10-08T16:07:13.548613+0000","last_became_peered":"2023-10-08T16:07:13.548613+0000","last_unstale":"2023-10-08T16:07:14.561097+0000","last_undegraded":"2023-10-08T16:07:14.561097+0000","last_fullsized":"2023-10-08T16:07:14.561097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:42.201427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545194+0000","last_change":"2023-10-08T16:07:14.545194+0000","last_active":"2023-10-08T16:07:14.545194+0000","last_peered":"2023-10-08T16:07:14.545194+0000","last_clean":"2023-10-08T16:07:14.545194+0000","last_became_active":"2023-10-08T16:07:14.544967+0000","last_became_peered":"2023-10-08T16:07:14.544967+0000","last_unstale":"2023-10-08T16:07:14.545194+0000","last_undegraded":"2023-10-08T16:07:14.545194+0000","last_fullsized":"2023-10-08T16:07:14.545194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:22.856136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'6","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.558831+0000","last_change":"2023-10-08T16:07:13.548839+0000","last_active":"2023-10-08T16:07:14.558831+0000","last_peered":"2023-10-08T16:07:14.558831+0000","last_clean":"2023-10-08T16:07:14.558831+0000","last_became_active":"2023-10-08T16:07:13.548197+0000","last_became_peered":"2023-10-08T16:07:13.548197+0000","last_unstale":"2023-10-08T16:07:14.558831+0000","last_undegraded":"2023-10-08T16:07:14.558831+0000","last_fullsized":"2023-10-08T16:07:14.558831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:42.201427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552548+0000","last_change":"2023-10-08T16:07:14.552376+0000","last_active":"2023-10-08T16:07:14.552548+0000","last_peered":"2023-10-08T16:07:14.552548+0000","last_clean":"2023-10-08T16:07:14.552548+0000","last_became_active":"2023-10-08T16:07:14.551855+0000","last_became_peered":"2023-10-08T16:07:14.551855+0000","last_unstale":"2023-10-08T16:07:14.552548+0000","last_undegraded":"2023-10-08T16:07:14.552548+0000","last_fullsized":"2023-10-08T16:07:14.552548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:32.544387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560494+0000","last_change":"2023-10-08T16:07:13.546950+0000","last_active":"2023-10-08T16:07:14.560494+0000","last_peered":"2023-10-08T16:07:14.560494+0000","last_clean":"2023-10-08T16:07:14.560494+0000","last_became_active":"2023-10-08T16:07:13.546723+0000","last_became_peered":"2023-10-08T16:07:13.546723+0000","last_unstale":"2023-10-08T16:07:14.560494+0000","last_undegraded":"2023-10-08T16:07:14.560494+0000","last_fullsized":"2023-10-08T16:07:14.560494+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:31.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.546427+0000","last_change":"2023-10-08T16:07:14.546427+0000","last_active":"2023-10-08T16:07:14.546427+0000","last_peered":"2023-10-08T16:07:14.546427+0000","last_clean":"2023-10-08T16:07:14.546427+0000","last_became_active":"2023-10-08T16:07:14.545799+0000","last_became_peered":"2023-10-08T16:07:14.545799+0000","last_unstale":"2023-10-08T16:07:14.546427+0000","last_undegraded":"2023-10-08T16:07:14.546427+0000","last_fullsized":"2023-10-08T16:07:14.546427+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:50.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.551683+0000","last_change":"2023-10-08T16:07:13.551620+0000","last_active":"2023-10-08T16:07:13.551683+0000","last_peered":"2023-10-08T16:07:13.551683+0000","last_clean":"2023-10-08T16:07:13.551683+0000","last_became_active":"2023-10-08T16:07:13.551406+0000","last_became_peered":"2023-10-08T16:07:13.551406+0000","last_unstale":"2023-10-08T16:07:13.551683+0000","last_undegraded":"2023-10-08T16:07:13.551683+0000","last_fullsized":"2023-10-08T16:07:13.551683+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:11.523064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548514+0000","last_change":"2023-10-08T16:07:14.548514+0000","last_active":"2023-10-08T16:07:14.548514+0000","last_peered":"2023-10-08T16:07:14.548514+0000","last_clean":"2023-10-08T16:07:14.548514+0000","last_became_active":"2023-10-08T16:07:14.548034+0000","last_became_peered":"2023-10-08T16:07:14.548034+0000","last_unstale":"2023-10-08T16:07:14.548514+0000","last_undegraded":"2023-10-08T16:07:14.548514+0000","last_fullsized":"2023-10-08T16:07:14.548514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:51.522840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.542162+0000","last_change":"2023-10-08T16:07:13.546025+0000","last_active":"2023-10-08T16:07:14.542162+0000","last_peered":"2023-10-08T16:07:14.542162+0000","last_clean":"2023-10-08T16:07:14.542162+0000","last_became_active":"2023-10-08T16:07:13.545815+0000","last_became_peered":"2023-10-08T16:07:13.545815+0000","last_unstale":"2023-10-08T16:07:14.542162+0000","last_undegraded":"2023-10-08T16:07:14.542162+0000","last_fullsized":"2023-10-08T16:07:14.542162+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:27.756461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545082+0000","last_change":"2023-10-08T16:07:14.545082+0000","last_active":"2023-10-08T16:07:14.545082+0000","last_peered":"2023-10-08T16:07:14.545082+0000","last_clean":"2023-10-08T16:07:14.545082+0000","last_became_active":"2023-10-08T16:07:14.544861+0000","last_became_peered":"2023-10-08T16:07:14.544861+0000","last_unstale":"2023-10-08T16:07:14.545082+0000","last_undegraded":"2023-10-08T16:07:14.545082+0000","last_fullsized":"2023-10-08T16:07:14.545082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:43.744487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"63'8","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.559879+0000","last_change":"2023-10-08T16:07:13.549677+0000","last_active":"2023-10-08T16:07:14.559879+0000","last_peered":"2023-10-08T16:07:14.559879+0000","last_clean":"2023-10-08T16:07:14.559879+0000","last_became_active":"2023-10-08T16:07:13.549068+0000","last_became_peered":"2023-10-08T16:07:13.549068+0000","last_unstale":"2023-10-08T16:07:14.559879+0000","last_undegraded":"2023-10-08T16:07:14.559879+0000","last_fullsized":"2023-10-08T16:07:14.559879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:52.333432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550383+0000","last_change":"2023-10-08T16:07:14.550383+0000","last_active":"2023-10-08T16:07:14.550383+0000","last_peered":"2023-10-08T16:07:14.550383+0000","last_clean":"2023-10-08T16:07:14.550383+0000","last_became_active":"2023-10-08T16:07:14.549931+0000","last_became_peered":"2023-10-08T16:07:14.549931+0000","last_unstale":"2023-10-08T16:07:14.550383+0000","last_undegraded":"2023-10-08T16:07:14.550383+0000","last_fullsized":"2023-10-08T16:07:14.550383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:46.119258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.559773+0000","last_change":"2023-10-08T16:07:13.549394+0000","last_active":"2023-10-08T16:07:14.559773+0000","last_peered":"2023-10-08T16:07:14.559773+0000","last_clean":"2023-10-08T16:07:14.559773+0000","last_became_active":"2023-10-08T16:07:13.548977+0000","last_became_peered":"2023-10-08T16:07:13.548977+0000","last_unstale":"2023-10-08T16:07:14.559773+0000","last_undegraded":"2023-10-08T16:07:14.559773+0000","last_fullsized":"2023-10-08T16:07:14.559773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:21.640650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550492+0000","last_change":"2023-10-08T16:07:14.547173+0000","last_active":"2023-10-08T16:07:14.550492+0000","last_peered":"2023-10-08T16:07:14.550492+0000","last_clean":"2023-10-08T16:07:14.550492+0000","last_became_active":"2023-10-08T16:07:14.545351+0000","last_became_peered":"2023-10-08T16:07:14.545351+0000","last_unstale":"2023-10-08T16:07:14.550492+0000","last_undegraded":"2023-10-08T16:07:14.550492+0000","last_fullsized":"2023-10-08T16:07:14.550492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:43.744487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557932+0000","last_change":"2023-10-08T16:07:13.546912+0000","last_active":"2023-10-08T16:07:14.557932+0000","last_peered":"2023-10-08T16:07:14.557932+0000","last_clean":"2023-10-08T16:07:14.557932+0000","last_became_active":"2023-10-08T16:07:13.546489+0000","last_became_peered":"2023-10-08T16:07:13.546489+0000","last_unstale":"2023-10-08T16:07:14.557932+0000","last_undegraded":"2023-10-08T16:07:14.557932+0000","last_fullsized":"2023-10-08T16:07:14.557932+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:50.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.554117+0000","last_change":"2023-10-08T16:07:14.554076+0000","last_active":"2023-10-08T16:07:14.554117+0000","last_peered":"2023-10-08T16:07:14.554117+0000","last_clean":"2023-10-08T16:07:14.554117+0000","last_became_active":"2023-10-08T16:07:14.550535+0000","last_became_peered":"2023-10-08T16:07:14.550535+0000","last_unstale":"2023-10-08T16:07:14.554117+0000","last_undegraded":"2023-10-08T16:07:14.554117+0000","last_fullsized":"2023-10-08T16:07:14.554117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:37.988708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.557994+0000","last_change":"2023-10-08T16:07:13.550606+0000","last_active":"2023-10-08T16:07:14.557994+0000","last_peered":"2023-10-08T16:07:14.557994+0000","last_clean":"2023-10-08T16:07:14.557994+0000","last_became_active":"2023-10-08T16:07:13.550105+0000","last_became_peered":"2023-10-08T16:07:13.550105+0000","last_unstale":"2023-10-08T16:07:14.557994+0000","last_undegraded":"2023-10-08T16:07:14.557994+0000","last_fullsized":"2023-10-08T16:07:14.557994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:45.115409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547003+0000","last_change":"2023-10-08T16:07:14.547003+0000","last_active":"2023-10-08T16:07:14.547003+0000","last_peered":"2023-10-08T16:07:14.547003+0000","last_clean":"2023-10-08T16:07:14.547003+0000","last_became_active":"2023-10-08T16:07:14.546347+0000","last_became_peered":"2023-10-08T16:07:14.546347+0000","last_unstale":"2023-10-08T16:07:14.547003+0000","last_undegraded":"2023-10-08T16:07:14.547003+0000","last_fullsized":"2023-10-08T16:07:14.547003+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:22.644499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.543584+0000","last_change":"2023-10-08T16:07:13.550452+0000","last_active":"2023-10-08T16:07:14.543584+0000","last_peered":"2023-10-08T16:07:14.543584+0000","last_clean":"2023-10-08T16:07:14.543584+0000","last_became_active":"2023-10-08T16:07:13.550203+0000","last_became_peered":"2023-10-08T16:07:13.550203+0000","last_unstale":"2023-10-08T16:07:14.543584+0000","last_undegraded":"2023-10-08T16:07:14.543584+0000","last_fullsized":"2023-10-08T16:07:14.543584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:45.115409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550532+0000","last_change":"2023-10-08T16:07:14.547307+0000","last_active":"2023-10-08T16:07:14.550532+0000","last_peered":"2023-10-08T16:07:14.550532+0000","last_clean":"2023-10-08T16:07:14.550532+0000","last_became_active":"2023-10-08T16:07:14.546920+0000","last_became_peered":"2023-10-08T16:07:14.546920+0000","last_unstale":"2023-10-08T16:07:14.550532+0000","last_undegraded":"2023-10-08T16:07:14.550532+0000","last_fullsized":"2023-10-08T16:07:14.550532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:22.644499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560280+0000","last_change":"2023-10-08T16:07:13.546428+0000","last_active":"2023-10-08T16:07:14.560280+0000","last_peered":"2023-10-08T16:07:14.560280+0000","last_clean":"2023-10-08T16:07:14.560280+0000","last_became_active":"2023-10-08T16:07:13.545924+0000","last_became_peered":"2023-10-08T16:07:13.545924+0000","last_unstale":"2023-10-08T16:07:14.560280+0000","last_undegraded":"2023-10-08T16:07:14.560280+0000","last_fullsized":"2023-10-08T16:07:14.560280+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:20.636508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.548048+0000","last_change":"2023-10-08T16:07:14.547889+0000","last_active":"2023-10-08T16:07:14.548048+0000","last_peered":"2023-10-08T16:07:14.548048+0000","last_clean":"2023-10-08T16:07:14.548048+0000","last_became_active":"2023-10-08T16:07:14.547529+0000","last_became_peered":"2023-10-08T16:07:14.547529+0000","last_unstale":"2023-10-08T16:07:14.548048+0000","last_undegraded":"2023-10-08T16:07:14.548048+0000","last_fullsized":"2023-10-08T16:07:14.548048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:18.468848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.546573+0000","last_change":"2023-10-08T16:07:13.546283+0000","last_active":"2023-10-08T16:07:13.546573+0000","last_peered":"2023-10-08T16:07:13.546573+0000","last_clean":"2023-10-08T16:07:13.546573+0000","last_became_active":"2023-10-08T16:07:13.546056+0000","last_became_peered":"2023-10-08T16:07:13.546056+0000","last_unstale":"2023-10-08T16:07:13.546573+0000","last_undegraded":"2023-10-08T16:07:13.546573+0000","last_fullsized":"2023-10-08T16:07:13.546573+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:46.862053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545288+0000","last_change":"2023-10-08T16:07:14.544907+0000","last_active":"2023-10-08T16:07:14.545288+0000","last_peered":"2023-10-08T16:07:14.545288+0000","last_clean":"2023-10-08T16:07:14.545288+0000","last_became_active":"2023-10-08T16:07:14.544612+0000","last_became_peered":"2023-10-08T16:07:14.544612+0000","last_unstale":"2023-10-08T16:07:14.545288+0000","last_undegraded":"2023-10-08T16:07:14.545288+0000","last_fullsized":"2023-10-08T16:07:14.545288+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:18.855037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.544044+0000","last_change":"2023-10-08T16:07:13.548339+0000","last_active":"2023-10-08T16:07:14.544044+0000","last_peered":"2023-10-08T16:07:14.544044+0000","last_clean":"2023-10-08T16:07:14.544044+0000","last_became_active":"2023-10-08T16:07:13.548016+0000","last_became_peered":"2023-10-08T16:07:13.548016+0000","last_unstale":"2023-10-08T16:07:14.544044+0000","last_undegraded":"2023-10-08T16:07:14.544044+0000","last_fullsized":"2023-10-08T16:07:14.544044+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:51.593758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550514+0000","last_change":"2023-10-08T16:07:14.547235+0000","last_active":"2023-10-08T16:07:14.550514+0000","last_peered":"2023-10-08T16:07:14.550514+0000","last_clean":"2023-10-08T16:07:14.550514+0000","last_became_active":"2023-10-08T16:07:14.546985+0000","last_became_peered":"2023-10-08T16:07:14.546985+0000","last_unstale":"2023-10-08T16:07:14.550514+0000","last_undegraded":"2023-10-08T16:07:14.550514+0000","last_fullsized":"2023-10-08T16:07:14.550514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.244300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"63'2","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.560907+0000","last_change":"2023-10-08T16:07:13.540263+0000","last_active":"2023-10-08T16:07:14.560907+0000","last_peered":"2023-10-08T16:07:14.560907+0000","last_clean":"2023-10-08T16:07:14.560907+0000","last_became_active":"2023-10-08T16:07:13.539966+0000","last_became_peered":"2023-10-08T16:07:13.539966+0000","last_unstale":"2023-10-08T16:07:14.560907+0000","last_undegraded":"2023-10-08T16:07:14.560907+0000","last_fullsized":"2023-10-08T16:07:14.560907+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:35.751296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550561+0000","last_change":"2023-10-08T16:07:14.550057+0000","last_active":"2023-10-08T16:07:14.550561+0000","last_peered":"2023-10-08T16:07:14.550561+0000","last_clean":"2023-10-08T16:07:14.550561+0000","last_became_active":"2023-10-08T16:07:14.545002+0000","last_became_peered":"2023-10-08T16:07:14.545002+0000","last_unstale":"2023-10-08T16:07:14.550561+0000","last_undegraded":"2023-10-08T16:07:14.550561+0000","last_fullsized":"2023-10-08T16:07:14.550561+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:28.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.542659+0000","last_change":"2023-10-08T16:07:13.545724+0000","last_active":"2023-10-08T16:07:14.542659+0000","last_peered":"2023-10-08T16:07:14.542659+0000","last_clean":"2023-10-08T16:07:14.542659+0000","last_became_active":"2023-10-08T16:07:13.545211+0000","last_became_peered":"2023-10-08T16:07:13.545211+0000","last_unstale":"2023-10-08T16:07:14.542659+0000","last_undegraded":"2023-10-08T16:07:14.542659+0000","last_fullsized":"2023-10-08T16:07:14.542659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:32.121913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.549316+0000","last_change":"2023-10-08T16:07:14.549316+0000","last_active":"2023-10-08T16:07:14.549316+0000","last_peered":"2023-10-08T16:07:14.549316+0000","last_clean":"2023-10-08T16:07:14.549316+0000","last_became_active":"2023-10-08T16:07:14.549097+0000","last_became_peered":"2023-10-08T16:07:14.549097+0000","last_unstale":"2023-10-08T16:07:14.549316+0000","last_undegraded":"2023-10-08T16:07:14.549316+0000","last_fullsized":"2023-10-08T16:07:14.549316+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:53.337281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.542558+0000","last_change":"2023-10-08T16:07:13.542489+0000","last_active":"2023-10-08T16:07:13.542558+0000","last_peered":"2023-10-08T16:07:13.542558+0000","last_clean":"2023-10-08T16:07:13.542558+0000","last_became_active":"2023-10-08T16:07:13.542259+0000","last_became_peered":"2023-10-08T16:07:13.542259+0000","last_unstale":"2023-10-08T16:07:13.542558+0000","last_undegraded":"2023-10-08T16:07:13.542558+0000","last_fullsized":"2023-10-08T16:07:13.542558+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:35.751296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547611+0000","last_change":"2023-10-08T16:07:14.547365+0000","last_active":"2023-10-08T16:07:14.547611+0000","last_peered":"2023-10-08T16:07:14.547611+0000","last_clean":"2023-10-08T16:07:14.547611+0000","last_became_active":"2023-10-08T16:07:14.546835+0000","last_became_peered":"2023-10-08T16:07:14.546835+0000","last_unstale":"2023-10-08T16:07:14.547611+0000","last_undegraded":"2023-10-08T16:07:14.547611+0000","last_fullsized":"2023-10-08T16:07:14.547611+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:16.139915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.541529+0000","last_change":"2023-10-08T16:07:13.543191+0000","last_active":"2023-10-08T16:07:14.541529+0000","last_peered":"2023-10-08T16:07:14.541529+0000","last_clean":"2023-10-08T16:07:14.541529+0000","last_became_active":"2023-10-08T16:07:13.542916+0000","last_became_peered":"2023-10-08T16:07:13.542916+0000","last_unstale":"2023-10-08T16:07:14.541529+0000","last_undegraded":"2023-10-08T16:07:14.541529+0000","last_fullsized":"2023-10-08T16:07:14.541529+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:47.710445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.555154+0000","last_change":"2023-10-08T16:07:14.555093+0000","last_active":"2023-10-08T16:07:14.555154+0000","last_peered":"2023-10-08T16:07:14.555154+0000","last_clean":"2023-10-08T16:07:14.555154+0000","last_became_active":"2023-10-08T16:07:14.554876+0000","last_became_peered":"2023-10-08T16:07:14.554876+0000","last_unstale":"2023-10-08T16:07:14.555154+0000","last_undegraded":"2023-10-08T16:07:14.555154+0000","last_fullsized":"2023-10-08T16:07:14.555154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:55.158280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.544749+0000","last_change":"2023-10-08T16:07:13.544620+0000","last_active":"2023-10-08T16:07:13.544749+0000","last_peered":"2023-10-08T16:07:13.544749+0000","last_clean":"2023-10-08T16:07:13.544749+0000","last_became_active":"2023-10-08T16:07:13.544376+0000","last_became_peered":"2023-10-08T16:07:13.544376+0000","last_unstale":"2023-10-08T16:07:13.544749+0000","last_undegraded":"2023-10-08T16:07:13.544749+0000","last_fullsized":"2023-10-08T16:07:13.544749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:02.627277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547086+0000","last_change":"2023-10-08T16:07:14.547086+0000","last_active":"2023-10-08T16:07:14.547086+0000","last_peered":"2023-10-08T16:07:14.547086+0000","last_clean":"2023-10-08T16:07:14.547086+0000","last_became_active":"2023-10-08T16:07:14.546648+0000","last_became_peered":"2023-10-08T16:07:14.546648+0000","last_unstale":"2023-10-08T16:07:14.547086+0000","last_undegraded":"2023-10-08T16:07:14.547086+0000","last_fullsized":"2023-10-08T16:07:14.547086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:28.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.548577+0000","last_change":"2023-10-08T16:07:13.548494+0000","last_active":"2023-10-08T16:07:13.548577+0000","last_peered":"2023-10-08T16:07:13.548577+0000","last_clean":"2023-10-08T16:07:13.548577+0000","last_became_active":"2023-10-08T16:07:13.547921+0000","last_became_peered":"2023-10-08T16:07:13.547921+0000","last_unstale":"2023-10-08T16:07:13.548577+0000","last_undegraded":"2023-10-08T16:07:13.548577+0000","last_fullsized":"2023-10-08T16:07:13.548577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:38.727137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.545630+0000","last_change":"2023-10-08T16:07:14.545630+0000","last_active":"2023-10-08T16:07:14.545630+0000","last_peered":"2023-10-08T16:07:14.545630+0000","last_clean":"2023-10-08T16:07:14.545630+0000","last_became_active":"2023-10-08T16:07:14.545375+0000","last_became_peered":"2023-10-08T16:07:14.545375+0000","last_unstale":"2023-10-08T16:07:14.545630+0000","last_undegraded":"2023-10-08T16:07:14.545630+0000","last_fullsized":"2023-10-08T16:07:14.545630+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:39.730986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.546555+0000","last_change":"2023-10-08T16:07:13.545313+0000","last_active":"2023-10-08T16:07:13.546555+0000","last_peered":"2023-10-08T16:07:13.546555+0000","last_clean":"2023-10-08T16:07:13.546555+0000","last_became_active":"2023-10-08T16:07:13.544799+0000","last_became_peered":"2023-10-08T16:07:13.544799+0000","last_unstale":"2023-10-08T16:07:13.546555+0000","last_undegraded":"2023-10-08T16:07:13.546555+0000","last_fullsized":"2023-10-08T16:07:13.546555+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:11.523064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.552084+0000","last_change":"2023-10-08T16:07:14.552041+0000","last_active":"2023-10-08T16:07:14.552084+0000","last_peered":"2023-10-08T16:07:14.552084+0000","last_clean":"2023-10-08T16:07:14.552084+0000","last_became_active":"2023-10-08T16:07:14.551416+0000","last_became_peered":"2023-10-08T16:07:14.551416+0000","last_unstale":"2023-10-08T16:07:14.552084+0000","last_undegraded":"2023-10-08T16:07:14.552084+0000","last_fullsized":"2023-10-08T16:07:14.552084+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:22.961534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.550479+0000","last_change":"2023-10-08T16:07:13.545383+0000","last_active":"2023-10-08T16:07:14.550479+0000","last_peered":"2023-10-08T16:07:14.550479+0000","last_clean":"2023-10-08T16:07:14.550479+0000","last_became_active":"2023-10-08T16:07:13.545117+0000","last_became_peered":"2023-10-08T16:07:13.545117+0000","last_unstale":"2023-10-08T16:07:14.550479+0000","last_undegraded":"2023-10-08T16:07:14.550479+0000","last_fullsized":"2023-10-08T16:07:14.550479+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:29:52.742395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T16:07:14.547782+0000","last_change":"2023-10-08T16:07:14.547720+0000","last_active":"2023-10-08T16:07:14.547782+0000","last_peered":"2023-10-08T16:07:14.547782+0000","last_clean":"2023-10-08T16:07:14.547782+0000","last_became_active":"2023-10-08T16:07:14.547514+0000","last_became_peered":"2023-10-08T16:07:14.547514+0000","last_unstale":"2023-10-08T16:07:14.547782+0000","last_undegraded":"2023-10-08T16:07:14.547782+0000","last_fullsized":"2023-10-08T16:07:14.547782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:13.531035+0000","last_clean_scrub_stamp":"2023-10-08T16:07:13.531035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:13.636434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.545984+0000","last_change":"2023-10-08T16:07:13.545914+0000","last_active":"2023-10-08T16:07:13.545984+0000","last_peered":"2023-10-08T16:07:13.545984+0000","last_clean":"2023-10-08T16:07:13.545984+0000","last_became_active":"2023-10-08T16:07:13.545666+0000","last_became_peered":"2023-10-08T16:07:13.545666+0000","last_unstale":"2023-10-08T16:07:13.545984+0000","last_undegraded":"2023-10-08T16:07:13.545984+0000","last_fullsized":"2023-10-08T16:07:13.545984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:07:12.527186+0000","last_clean_scrub_stamp":"2023-10-08T16:07:12.527186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:00.586010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T16:07:13.544518+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:07:13.544518+0000","last_peered":"2023-10-08T16:07:13.544518+0000","last_clean":"2023-10-08T16:07:13.544518+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:07:13.544518+0000","last_undegraded":"2023-10-08T16:07:13.544518+0000","last_fullsized":"2023-10-08T16:07:13.544518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194423,"statfs":{"total":200000000,"available":199089527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.78400000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71199999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":1.6919999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70399999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.756}]},{"osd":3,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73399999999999999,"5min":0.747,"15min":0.747},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":1.79}]},{"osd":4,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":1.8620000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.823}]},{"osd":6,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68200000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":1.252}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195000,"statfs":{"total":200000000,"available":199680055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.751,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.504}]},{"osd":1,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.443}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65200000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.497,"15min":0.49199999999999999},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.373},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47599999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679965,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.48899999999999999,"15min":0.51000000000000001},"min":{"1min":0.22900000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.57199999999999995,"5min":3.593,"15min":3.593},"last":0.316},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.25700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60199999999999998,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436}]},{"osd":3,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.28199999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.98199999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.629,"15min":0.625},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2969999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":3.532,"15min":3.532},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.341,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.095},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5429999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194415,"statfs":{"total":200000000,"available":199081309,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.22700000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54000000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.48599999999999999,"15min":0.5},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56899999999999995,"5min":2.254,"15min":2.254},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46000000000000002,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.37}]},{"osd":3,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24399999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.309},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41599999999999998},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71499999999999997,"15min":0.72799999999999998},"min":{"1min":0.42799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88100000000000001,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.625},{"interface":"front","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.875,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76500000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":1.079,"15min":1.079},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":2.355,"15min":2.355},"last":0.53100000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77700000000000002,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91800000000000004,"5min":1.002,"15min":1.002},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35799999999999998,"15min":0.36199999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.45000000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.26300000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42499999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.40899999999999997,"5min":0.746,"15min":0.746},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.437,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47599999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.49199999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":0.72799999999999998,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73699999999999999,"5min":0.875,"15min":0.875},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72099999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66500000000000004,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39300000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48199999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.318},{"interface":"front","average":{"1min":0.372,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80700000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73799999999999999,"5min":0.873,"15min":0.873},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89000000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Oct 8 16:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194998,"statfs":{"total":200000000,"available":199678519,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77600000000000002,"5min":1.141,"15min":1.141},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76700000000000002,"5min":1.149,"15min":1.149},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.60799999999999998,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":7.4749999999999996,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.60299999999999998,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.8730000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.3029999999999999,"5min":0.70299999999999996,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":14.6,"5min":14.6,"15min":14.6},"last":0.51900000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.61799999999999999,"15min":0.56599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":7.556,"5min":7.556,"15min":7.556},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.497,"15min":0.498},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:06:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73699999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69799999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.502},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75700000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78500000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66200000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67200000000000004}]}]}],"pool_statfs":[]}} 2023-10-08T16:07:19.035 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:07:19.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:07:19.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.194+0000 7fb55b4e9700 1 Processor -- start 2023-10-08T16:07:19.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb55b4e9700 1 -- start start 2023-10-08T16:07:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb55b4e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5540678b0 0x7fb55415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb55b4e9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5540c9390 0x7fb55415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb55b4e9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540cae70 con 0x7fb5540cbf10 2023-10-08T16:07:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb55b4e9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5540cb150 con 0x7fb5540678b0 2023-10-08T16:07:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb55b4e9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5540cb430 con 0x7fb5540c9390 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.195+0000 7fb559285700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5540678b0 0x7fb55415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb558a84700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb5540cbf10 0x7fb55415e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48208/0 (socket says 172.21.15.60:48208) 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb558a84700 1 -- 172.21.15.60:0/3197277892 learned_addr learned my addr 172.21.15.60:0/3197277892 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb559a86700 1 --2- 172.21.15.60:0/3197277892 >> v2:172.21.15.144:3300/0 conn(0x7fb5540c9390 0x7fb55415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb559285700 1 -- 172.21.15.60:0/3197277892 >> v2:172.21.15.144:3300/0 conn(0x7fb5540c9390 msgr2=0x7fb55415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb559285700 1 --2- 172.21.15.60:0/3197277892 >> v2:172.21.15.144:3300/0 conn(0x7fb5540c9390 0x7fb55415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb559285700 1 -- 172.21.15.60:0/3197277892 >> v1:172.21.15.60:6789/0 conn(0x7fb5540cbf10 legacy=0x7fb55415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb559285700 1 -- 172.21.15.60:0/3197277892 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540cb710 con 0x7fb5540678b0 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb553fff700 1 -- 172.21.15.60:0/3197277892 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237154704 0 0) 0x7fb5540cae70 con 0x7fb5540cbf10 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb559285700 1 --2- 172.21.15.60:0/3197277892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5540678b0 0x7fb55415db80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb5540c9ab0 tx=0x7fb54c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9936899733c56c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb553fff700 1 -- 172.21.15.60:0/3197277892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00b6b0 con 0x7fb5540678b0 2023-10-08T16:07:19.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb553fff700 1 -- 172.21.15.60:0/3197277892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00b810 con 0x7fb5540678b0 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.196+0000 7fb553fff700 1 -- 172.21.15.60:0/3197277892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00bbb0 con 0x7fb5540678b0 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3197277892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5540678b0 msgr2=0x7fb55415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3197277892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5540678b0 0x7fb55415db80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb5540c9ab0 tx=0x7fb54c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3197277892 shutdown_connections 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3197277892 >> v2:172.21.15.144:3300/0 conn(0x7fb5540c9390 0x7fb55415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3197277892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5540678b0 0x7fb55415db80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3197277892 >> 172.21.15.60:0/3197277892 conn(0x7fb554069870 msgr2=0x7fb554069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3197277892 shutdown_connections 2023-10-08T16:07:19.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.197+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3197277892 wait complete. 2023-10-08T16:07:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.198+0000 7fb55b4e9700 1 Processor -- start 2023-10-08T16:07:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.198+0000 7fb55b4e9700 1 -- start start 2023-10-08T16:07:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb55b4e9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5540c9390 0x7fb554167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb55b4e9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540cbf10 0x7fb55416ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb55b4e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 0x7fb554169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb55b4e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55416c580 con 0x7fb55416b3d0 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb55b4e9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55416b970 con 0x7fb5540cbf10 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb55b4e9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55416bc50 con 0x7fb5540c9390 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 0x7fb554169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 0x7fb554169a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49330/0 (socket says 172.21.15.60:49330) 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 -- 172.21.15.60:0/3574385144 learned_addr learned my addr 172.21.15.60:0/3574385144 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb558a84700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540cbf10 0x7fb55416ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559285700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5540c9390 0x7fb554167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 -- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5540c9390 msgr2=0x7fb554167e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5540c9390 0x7fb554167e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 -- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540cbf10 msgr2=0x7fb55416ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540cbf10 0x7fb55416ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 -- 172.21.15.60:0/3574385144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009420 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559285700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5540c9390 0x7fb554167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.199+0000 7fb559a86700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 0x7fb554169a50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb544007f20 tx=0x7fb544009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.200+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400ebf0 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.200+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400ed70 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.200+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55416bf30 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.200+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544014670 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.200+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb554168380 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.201+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55404c3c0 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.201+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5440149e0 con 0x7fb55416b3d0 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.201+0000 7fb5517fa700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.202+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb544084bc0 con 0x7fb55416b3d0 2023-10-08T16:07:19.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.202+0000 7fb559285700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.202+0000 7fb559285700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb55406f280 tx=0x7fb54c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.206+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb544051e30 con 0x7fb55416b3d0 2023-10-08T16:07:19.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.474+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb55416c6c0 con 0x7fb55416b3d0 2023-10-08T16:07:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.478+0000 7fb5517fa700 1 -- 172.21.15.60:0/3574385144 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb544055450 con 0x7fb55416b3d0 2023-10-08T16:07:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.480+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 msgr2=0x7fb5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.480+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb55406f280 tx=0x7fb54c017000 comp rx=0 tx=0).stop 2023-10-08T16:07:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.480+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 msgr2=0x7fb554169a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.480+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 0x7fb554169a50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb544007f20 tx=0x7fb544009860 comp rx=0 tx=0).stop 2023-10-08T16:07:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.480+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 shutdown_connections 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.480+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb540066f30 0x7fb5400693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.481+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5540c9390 0x7fb554167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.481+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb55416b3d0 0x7fb554169a50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.481+0000 7fb55b4e9700 1 --2- 172.21.15.60:0/3574385144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540cbf10 0x7fb55416ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.481+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 >> 172.21.15.60:0/3574385144 conn(0x7fb554069870 msgr2=0x7fb55406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.481+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 shutdown_connections 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.481+0000 7fb55b4e9700 1 -- 172.21.15.60:0/3574385144 wait complete. 2023-10-08T16:07:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:07:19.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.612+0000 7f62a307f700 1 Processor -- start 2023-10-08T16:07:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.612+0000 7f62a307f700 1 -- start start 2023-10-08T16:07:19.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.612+0000 7f62a307f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f629c0ade00 0x7f629c161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.612+0000 7f62a307f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0c9cb0 con 0x7f629c0c75c0 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a307f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0c90a0 con 0x7f629c0abae0 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a307f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0c9380 con 0x7f629c0ade00 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f629c0c75c0 0x7f629c0c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48210/0 (socket says 172.21.15.60:48210) 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629bfff700 1 -- 172.21.15.60:0/1779164092 learned_addr learned my addr 172.21.15.60:0/1779164092 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a161c700 1 --2- 172.21.15.60:0/1779164092 >> v2:172.21.15.60:3300/0 conn(0x7f629c0ade00 0x7f629c161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629b7fe700 1 -- 172.21.15.60:0/1779164092 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001471693 0 0) 0x7f629c0c9cb0 con 0x7f629c0c75c0 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629b7fe700 1 -- 172.21.15.60:0/1779164092 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6288003570 con 0x7f629c0c75c0 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a161c700 1 -- 172.21.15.60:0/1779164092 >> v1:172.21.15.144:6789/0 conn(0x7f629c0abae0 legacy=0x7f629c0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a161c700 1 -- 172.21.15.60:0/1779164092 >> v1:172.21.15.60:6789/0 conn(0x7f629c0c75c0 legacy=0x7f629c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a161c700 1 -- 172.21.15.60:0/1779164092 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0c9660 con 0x7f629c0ade00 2023-10-08T16:07:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f62a161c700 1 --2- 172.21.15.60:0/1779164092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0ade00 0x7f629c161b40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6294009e60 tx=0x7f6294009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e88bf60add10e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629b7fe700 1 -- 172.21.15.60:0/1779164092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400e070 con 0x7f629c0ade00 2023-10-08T16:07:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629b7fe700 1 -- 172.21.15.60:0/1779164092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400bb60 con 0x7f629c0ade00 2023-10-08T16:07:19.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.613+0000 7f629b7fe700 1 -- 172.21.15.60:0/1779164092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294012430 con 0x7f629c0ade00 2023-10-08T16:07:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 -- 172.21.15.60:0/1779164092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0ade00 msgr2=0x7f629c161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 --2- 172.21.15.60:0/1779164092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0ade00 0x7f629c161b40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6294009e60 tx=0x7f6294009780 comp rx=0 tx=0).stop 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 -- 172.21.15.60:0/1779164092 shutdown_connections 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 --2- 172.21.15.60:0/1779164092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0ade00 0x7f629c161b40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 -- 172.21.15.60:0/1779164092 >> 172.21.15.60:0/1779164092 conn(0x7f629c067660 msgr2=0x7f629c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 -- 172.21.15.60:0/1779164092 shutdown_connections 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.614+0000 7f62a307f700 1 -- 172.21.15.60:0/1779164092 wait complete. 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.615+0000 7f62a307f700 1 Processor -- start 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.615+0000 7f62a307f700 1 -- start start 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a307f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f629c0abae0 0x7f629c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a307f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f629c0ade00 0x7f629c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a307f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 0x7f629c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a307f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0cd760 con 0x7f629c0c75c0 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a307f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0c4640 con 0x7f629c0abae0 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a307f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0caa20 con 0x7f629c0ade00 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 0x7f629c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 0x7f629c159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49350/0 (socket says 172.21.15.60:49350) 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 -- 172.21.15.60:0/3665062621 learned_addr learned my addr 172.21.15.60:0/3665062621 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a0e1b700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f629c0abae0 0x7f629c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 -- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f629c0ade00 msgr2=0x7f629c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f629c0ade00 0x7f629c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 -- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f629c0abae0 msgr2=0x7f629c0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f629c0abae0 0x7f629c0ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 -- 172.21.15.60:0/3665062621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294009a20 con 0x7f629c0c75c0 2023-10-08T16:07:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a0e1b700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f629c0abae0 0x7f629c0ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:07:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.616+0000 7f62a161c700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 0x7f629c159cf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f629c06ba00 tx=0x7f6294019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.617+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294012e00 con 0x7f629c0c75c0 2023-10-08T16:07:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.617+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629401d630 con 0x7f629c0c75c0 2023-10-08T16:07:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.617+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c0c3d10 con 0x7f629c0c75c0 2023-10-08T16:07:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.617+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629401d9f0 con 0x7f629c0c75c0 2023-10-08T16:07:19.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.617+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c0c42d0 con 0x7f629c0c75c0 2023-10-08T16:07:19.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.618+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c0c47d0 con 0x7f629c0c75c0 2023-10-08T16:07:19.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.618+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6294024070 con 0x7f629c0c75c0 2023-10-08T16:07:19.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.618+0000 7f6298ff9700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f627c066f30 0x7f627c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:19.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.619+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6294086d00 con 0x7f629c0c75c0 2023-10-08T16:07:19.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.619+0000 7f62a0e1b700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f627c066f30 0x7f627c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:19.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.619+0000 7f62a0e1b700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f627c066f30 0x7f627c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f62840017a0 tx=0x7f6284009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.623+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6294053f70 con 0x7f629c0c75c0 2023-10-08T16:07:19.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.859+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f629c04c3c0 con 0x7f629c0c75c0 2023-10-08T16:07:19.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.860+0000 7f6298ff9700 1 -- 172.21.15.60:0/3665062621 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f6294057590 con 0x7f629c0c75c0 2023-10-08T16:07:19.860 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:19.861 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f627c066f30 msgr2=0x7f627c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f627c066f30 0x7f627c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f62840017a0 tx=0x7f6284009040 comp rx=0 tx=0).stop 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 msgr2=0x7f629c159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 0x7f629c159cf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f629c06ba00 tx=0x7f6294019000 comp rx=0 tx=0).stop 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 shutdown_connections 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f627c066f30 0x7f627c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629c0c75c0 0x7f629c159cf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f629c0abae0 0x7f629c0ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 --2- 172.21.15.60:0/3665062621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f629c0ade00 0x7f629c0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:19.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 >> 172.21.15.60:0/3665062621 conn(0x7f629c067660 msgr2=0x7f629c0c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:19.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 shutdown_connections 2023-10-08T16:07:19.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:19.862+0000 7f62a307f700 1 -- 172.21.15.60:0/3665062621 wait complete. 2023-10-08T16:07:19.864 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:07:20.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:07:13.938550+0000', 'modified': '2023-10-08T16:07:17.558807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5721}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5721': {'gid': 5721, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/3651333177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6835', 'nonce': 3651333177}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3651333177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:07:20.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:07:20.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:07:20.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.399+0000 7f1e5935b700 1 Processor -- start 2023-10-08T16:07:20.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 -- start start 2023-10-08T16:07:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e54159cf0 0x7f1e5415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e5415a0c0 0x7f1e540ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e540ce1a0 0x7f1e540ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e540cca20 con 0x7f1e54159cf0 2023-10-08T16:07:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5415ea40 con 0x7f1e540ce1a0 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e5935b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54067660 con 0x7f1e5415a0c0 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e52ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e54159cf0 0x7f1e5415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e52ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e54159cf0 0x7f1e5415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49366/0 (socket says 172.21.15.60:49366) 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.400+0000 7f1e52ffd700 1 -- 172.21.15.60:0/793987684 learned_addr learned my addr 172.21.15.60:0/793987684 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e537fe700 1 --2- 172.21.15.60:0/793987684 >> v2:172.21.15.144:3300/0 conn(0x7f1e540ce1a0 0x7f1e540ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e527fc700 1 --2- 172.21.15.60:0/793987684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e5415a0c0 0x7f1e540ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e52ffd700 1 -- 172.21.15.60:0/793987684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e5415a0c0 msgr2=0x7f1e540ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/793987684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e5415a0c0 0x7f1e540ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e52ffd700 1 -- 172.21.15.60:0/793987684 >> v2:172.21.15.144:3300/0 conn(0x7f1e540ce1a0 msgr2=0x7f1e540ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/793987684 >> v2:172.21.15.144:3300/0 conn(0x7f1e540ce1a0 0x7f1e540ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e52ffd700 1 -- 172.21.15.60:0/793987684 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54067f00 con 0x7f1e54159cf0 2023-10-08T16:07:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/793987684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e54159cf0 0x7f1e5415e500 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1e54071760 tx=0x7f1e4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fec26fe7239e03d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e51ffb700 1 -- 172.21.15.60:0/793987684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00e070 con 0x7f1e54159cf0 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e51ffb700 1 -- 172.21.15.60:0/793987684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00ba50 con 0x7f1e54159cf0 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.401+0000 7f1e51ffb700 1 -- 172.21.15.60:0/793987684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0092e0 con 0x7f1e54159cf0 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 -- 172.21.15.60:0/793987684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e54159cf0 msgr2=0x7f1e5415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 --2- 172.21.15.60:0/793987684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e54159cf0 0x7f1e5415e500 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1e54071760 tx=0x7f1e4c009840 comp rx=0 tx=0).stop 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 -- 172.21.15.60:0/793987684 shutdown_connections 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 --2- 172.21.15.60:0/793987684 >> v2:172.21.15.144:3300/0 conn(0x7f1e540ce1a0 0x7f1e540ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 --2- 172.21.15.60:0/793987684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e54159cf0 0x7f1e5415e500 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 --2- 172.21.15.60:0/793987684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e5415a0c0 0x7f1e540ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 -- 172.21.15.60:0/793987684 >> 172.21.15.60:0/793987684 conn(0x7f1e5406c6e0 msgr2=0x7f1e54069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 -- 172.21.15.60:0/793987684 shutdown_connections 2023-10-08T16:07:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.402+0000 7f1e5935b700 1 -- 172.21.15.60:0/793987684 wait complete. 2023-10-08T16:07:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.403+0000 7f1e5935b700 1 Processor -- start 2023-10-08T16:07:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.403+0000 7f1e5935b700 1 -- start start 2023-10-08T16:07:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 0x7f1e540b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e54159cf0 0x7f1e5414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415a0c0 0x7f1e5414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5414fc80 con 0x7f1e540ce1a0 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5414edb0 con 0x7f1e5415a0c0 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5414f070 con 0x7f1e54159cf0 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 0x7f1e540b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 0x7f1e540b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49370/0 (socket says 172.21.15.60:49370) 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 -- 172.21.15.60:0/449325993 learned_addr learned my addr 172.21.15.60:0/449325993 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e527fc700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e54159cf0 0x7f1e5414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 -- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e54159cf0 msgr2=0x7f1e5414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e54159cf0 0x7f1e5414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 -- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415a0c0 msgr2=0x7f1e5414d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415a0c0 0x7f1e5414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 -- 172.21.15.60:0/449325993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c009ae0 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 0x7f1e540b3a30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1e5406de20 tx=0x7f1e4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e4affd700 1 -- 172.21.15.60:0/449325993 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c008bb0 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e4affd700 1 -- 172.21.15.60:0/449325993 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c008d50 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5414f350 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e4affd700 1 -- 172.21.15.60:0/449325993 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c01d670 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.404+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5414f910 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.406+0000 7f1e4affd700 1 -- 172.21.15.60:0/449325993 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e4c003040 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.406+0000 7f1e4affd700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e34066f30 0x7f1e340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.407+0000 7f1e4affd700 1 -- 172.21.15.60:0/449325993 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e4c085f80 con 0x7f1e540ce1a0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.407+0000 7f1e527fc700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e34066f30 0x7f1e340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.407+0000 7f1e527fc700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e34066f30 0x7f1e340693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1e541592d0 tx=0x7f1e3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.408+0000 7f1e62653b80 1 Processor -- start 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.408+0000 7f1e62653b80 1 -- start start 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 0x55c8fd883e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd8aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e62653b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd7daa70 con 0x55c8fd883a50 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd7d8270 con 0x55c8fd8acf60 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd7d4060 con 0x55c8fd8cdd00 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 0x55c8fd883e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 0x55c8fd883e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49382/0 (socket says 172.21.15.60:49382) 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 -- 172.21.15.60:0/3007522938 learned_addr learned my addr 172.21.15.60:0/3007522938 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 -- 172.21.15.60:0/3007522938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 msgr2=0x55c8fd8aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd8aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 -- 172.21.15.60:0/3007522938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 msgr2=0x55c8fd87fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.409+0000 7f1e52ffd700 1 -- 172.21.15.60:0/3007522938 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8fd66e270 con 0x55c8fd883a50 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 0x55c8fd883e20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c01d820 tx=0x7f1e4c084400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa1ad316e5cc1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e33fff700 1 -- 172.21.15.60:0/3007522938 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00e070 con 0x55c8fd883a50 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e33fff700 1 -- 172.21.15.60:0/3007522938 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c057610 con 0x55c8fd883a50 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e33fff700 1 -- 172.21.15.60:0/3007522938 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c056eb0 con 0x55c8fd883a50 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 -- 172.21.15.60:0/3007522938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 msgr2=0x55c8fd883e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 0x55c8fd883e20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c01d820 tx=0x7f1e4c084400 comp rx=0 tx=0).stop 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 -- 172.21.15.60:0/3007522938 shutdown_connections 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd883a50 0x55c8fd883e20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 --2- 172.21.15.60:0/3007522938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd8aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.410+0000 7f1e62653b80 1 -- 172.21.15.60:0/3007522938 >> 172.21.15.60:0/3007522938 conn(0x55c8fd885370 msgr2=0x55c8fd885740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.411+0000 7f1e62653b80 1 -- 172.21.15.60:0/3007522938 shutdown_connections 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.411+0000 7f1e62653b80 1 -- 172.21.15.60:0/3007522938 wait complete. 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.411+0000 7f1e62653b80 1 -- start start 2023-10-08T16:07:20.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.411+0000 7f1e62653b80 1 Processor -- start 2023-10-08T16:07:20.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd8cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd8c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8804a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd77f890 con 0x55c8fd8acf60 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd79aea0 con 0x55c8fd8cdd00 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd656e30 con 0x55c8fd883a50 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e62653b80 10 client.0 _ll_register_callbacks cb 0x55c8fd847110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd8c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd8c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49394/0 (socket says 172.21.15.60:49394) 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 -- 172.21.15.60:0/568620166 learned_addr learned my addr 172.21.15.60:0/568620166 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e537fe700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8804a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd8cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 -- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 msgr2=0x55c8fd8cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd8cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 -- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8cdd00 msgr2=0x55c8fd8804a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8804a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.412+0000 7f1e527fc700 1 -- 172.21.15.60:0/568620166 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5414f910 con 0x55c8fd8acf60 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd8cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e527fc700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd8c79e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c006fd0 tx=0x7f1e3c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c7ec1b37a023c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e317fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e317fa700 1 -- 172.21.15.60:0/568620166 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c020440 con 0x55c8fd8acf60 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e317fa700 1 -- 172.21.15.60:0/568620166 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e3c0205a0 con 0x55c8fd8acf60 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8fd855aa0 con 0x55c8fd8acf60 2023-10-08T16:07:20.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e317fa700 1 -- 172.21.15.60:0/568620166 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e3c020970 con 0x55c8fd8acf60 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 10 client.5868 fetch_fsmap learned FSMap version 34 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55c8fd610fe0 con 0x55c8fd8acf60 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e317fa700 1 -- 172.21.15.60:0/568620166 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8fd855aa0 con 0x55c8fd8acf60 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e317fa700 1 -- 172.21.15.60:0/568620166 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e3c020ad0 con 0x55c8fd8acf60 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 10 client.5868 fetch_fsmap finished waiting for FSMap version 34 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 10 client.5868 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 20 client.5868 populate_metadata read hostname 'smithi060' 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8a8eb0 0x55c8fd8a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 4 client.5868 mds_command: new command op to 5721 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 --> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8fd776e00 con 0x55c8fd8a8eb0 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.413+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8a8eb0 0x55c8fd8a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.414+0000 7f1e317fa700 10 client.5868 ms_handle_connect on v2:172.21.15.60:6835/3651333177 2023-10-08T16:07:20.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.414+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8a8eb0 0x55c8fd8a9280 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9646e05eb54fde27 server_cookie=665075ab3f7a359f in_seq=0 out_seq=0 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.414+0000 7f1e317fa700 1 -- 172.21.15.60:0/568620166 <== mds.0 v2:172.21.15.60:6835/3651333177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c8fd776e00 con 0x55c8fd8a8eb0 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.414+0000 7f1e317fa700 10 client.5868 handle_command_reply: tid=0 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.414+0000 7f1e62653b80 1 client.5868 shutdown 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 msgr2=0x55c8fd8c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd8c79e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c006fd0 tx=0x7f1e3c016000 comp rx=0 tx=0).stop 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 shutdown_connections 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd8cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8a8eb0 0x55c8fd8a9280 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8804a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e317fa700 0 client.5868 ms_handle_reset on v2:172.21.15.60:6835/3651333177 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 --2- 172.21.15.60:0/568620166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd8c79e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 >> 172.21.15.60:0/568620166 conn(0x55c8fd885370 msgr2=0x55c8fd8c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 shutdown_connections 2023-10-08T16:07:20.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 1 -- 172.21.15.60:0/568620166 wait complete. 2023-10-08T16:07:20.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.415+0000 7f1e62653b80 20 client.5868 trim_cache size 0 max 16384 2023-10-08T16:07:20.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.432+0000 7f1e62653b80 1 Processor -- start 2023-10-08T16:07:20.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.432+0000 7f1e62653b80 1 -- start start 2023-10-08T16:07:20.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd883a50 0x55c8fd881b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd87ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd87f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e62653b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd8c3550 con 0x55c8fd8acf60 2023-10-08T16:07:20.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd8ab680 con 0x55c8fd883a50 2023-10-08T16:07:20.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd8820c0 con 0x55c8fd8cdd00 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd87ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd87ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49408/0 (socket says 172.21.15.60:49408) 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e527fc700 1 -- 172.21.15.60:0/4206913310 learned_addr learned my addr 172.21.15.60:0/4206913310 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd883a50 0x55c8fd881b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e537fe700 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd87f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 -- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 msgr2=0x55c8fd87f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd87f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 -- 172.21.15.60:0/4206913310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 msgr2=0x55c8fd87ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd87ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 -- 172.21.15.60:0/4206913310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8fd7a2780 con 0x55c8fd883a50 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.433+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd883a50 0x55c8fd881b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c003440 tx=0x7f1e4c06f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba9bb3079ddb163 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e48ff9700 1 -- 172.21.15.60:0/4206913310 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c072040 con 0x55c8fd883a50 2023-10-08T16:07:20.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e48ff9700 1 -- 172.21.15.60:0/4206913310 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0842c0 con 0x55c8fd883a50 2023-10-08T16:07:20.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e48ff9700 1 -- 172.21.15.60:0/4206913310 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c05de50 con 0x55c8fd883a50 2023-10-08T16:07:20.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 -- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd883a50 msgr2=0x55c8fd881b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd883a50 0x55c8fd881b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c003440 tx=0x7f1e4c06f040 comp rx=0 tx=0).stop 2023-10-08T16:07:20.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 -- 172.21.15.60:0/4206913310 shutdown_connections 2023-10-08T16:07:20.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd8cdd00 0x55c8fd87f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd883a50 0x55c8fd881b00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 --2- 172.21.15.60:0/4206913310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8acf60 0x55c8fd87ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 -- 172.21.15.60:0/4206913310 >> 172.21.15.60:0/4206913310 conn(0x55c8fd885370 msgr2=0x55c8fd8ac4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 -- 172.21.15.60:0/4206913310 shutdown_connections 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.434+0000 7f1e62653b80 1 -- 172.21.15.60:0/4206913310 wait complete. 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.435+0000 7f1e62653b80 1 -- start start 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.435+0000 7f1e62653b80 1 Processor -- start 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd87ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd8cee80 con 0x55c8fd8cdd00 2023-10-08T16:07:20.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd8e5150 con 0x55c8fd8acf60 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8fd8e4580 con 0x55c8fd883a50 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 10 client.0 _ll_register_callbacks cb 0x55c8fd847110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8c1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49424/0 (socket says 172.21.15.60:49424) 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 -- 172.21.15.60:0/1679993065 learned_addr learned my addr 172.21.15.60:0/1679993065 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e527fc700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd87ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 -- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 msgr2=0x55c8fd87ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd87ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 -- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 msgr2=0x55c8fd87f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 -- 172.21.15.60:0/1679993065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8fd66e270 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e537fe700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8c1c20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55c8fd881900 tx=0x7f1e44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d06275fc9ee43a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e317fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e317fa700 1 -- 172.21.15.60:0/1679993065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44015630 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e317fa700 1 -- 172.21.15.60:0/1679993065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e44015790 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.436+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8fd878b70 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e317fa700 1 -- 172.21.15.60:0/1679993065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e44015b60 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 10 client.5874 fetch_fsmap learned FSMap version 34 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55c8fd789470 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e317fa700 1 -- 172.21.15.60:0/1679993065 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8fd878b70 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e317fa700 1 -- 172.21.15.60:0/1679993065 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e4401b020 con 0x55c8fd8cdd00 2023-10-08T16:07:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 10 client.5874 fetch_fsmap finished waiting for FSMap version 34 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 10 client.5874 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 20 client.5874 populate_metadata read hostname 'smithi060' 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8c21d0 0x55c8fd8c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 4 client.5874 mds_command: new command op to 5721 tid=0[{"prefix": "status"}] 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.437+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 --> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c8fd776b20 con 0x55c8fd8c21d0 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8c21d0 0x55c8fd8c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e317fa700 10 client.5874 ms_handle_connect on v2:172.21.15.60:6835/3651333177 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e52ffd700 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8c21d0 0x55c8fd8c25a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4e3fddf54d43c61 server_cookie=4599fb836a384c81 in_seq=0 out_seq=0 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e317fa700 1 -- 172.21.15.60:0/1679993065 <== mds.0 v2:172.21.15.60:6835/3651333177 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c8fd776b20 con 0x55c8fd8c21d0 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e317fa700 10 client.5874 handle_command_reply: tid=0 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 client.5874 shutdown 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 msgr2=0x55c8fd8c1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8c1c20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55c8fd881900 tx=0x7f1e44008040 comp rx=0 tx=0).stop 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 shutdown_connections 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c8fd883a50 0x55c8fd87ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:6835/3651333177,v1:172.21.15.60:6837/3651333177] conn(0x55c8fd8c21d0 0x55c8fd8c25a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8fd8cdd00 0x55c8fd8c1c20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 --2- 172.21.15.60:0/1679993065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8fd8acf60 0x55c8fd87f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e317fa700 0 client.5874 ms_handle_reset on v2:172.21.15.60:6835/3651333177 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 >> 172.21.15.60:0/1679993065 conn(0x55c8fd885370 msgr2=0x55c8fd884500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 shutdown_connections 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 1 -- 172.21.15.60:0/1679993065 wait complete. 2023-10-08T16:07:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.438+0000 7f1e62653b80 20 client.5874 trim_cache size 0 max 16384 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 5721, 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 5.8914103559999997, 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 34, 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 64, 2023-10-08T16:07:20.446 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 64, 2023-10-08T16:07:20.447 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10.806731794999999 2023-10-08T16:07:20.447 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:07:20.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e34066f30 msgr2=0x7f1e340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e34066f30 0x7f1e340693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1e541592d0 tx=0x7f1e3c008040 comp rx=0 tx=0).stop 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 msgr2=0x7f1e540b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 0x7f1e540b3a30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1e5406de20 tx=0x7f1e4c018000 comp rx=0 tx=0).stop 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 shutdown_connections 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e34066f30 0x7f1e340693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415a0c0 0x7f1e5414d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e540ce1a0 0x7f1e540b3a30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 --2- 172.21.15.60:0/449325993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e54159cf0 0x7f1e5414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 >> 172.21.15.60:0/449325993 conn(0x7f1e5406c6e0 msgr2=0x7f1e540ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 shutdown_connections 2023-10-08T16:07:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.439+0000 7f1e5935b700 1 -- 172.21.15.60:0/449325993 wait complete. 2023-10-08T16:07:20.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:07:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.570+0000 7fc84a525700 1 Processor -- start 2023-10-08T16:07:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.570+0000 7fc84a525700 1 -- start start 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc84a525700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8440cdab0 0x7fc84415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc84a525700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc84415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc84a525700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440cb7c0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc84a525700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84415e850 con 0x7fc8440cdab0 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc84a525700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440cc360 con 0x7fc84415dda0 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc848d22700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8440cdab0 0x7fc84415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc848d22700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8440cdab0 0x7fc84415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49434/0 (socket says 172.21.15.60:49434) 2023-10-08T16:07:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc848d22700 1 -- 172.21.15.60:0/2515164002 learned_addr learned my addr 172.21.15.60:0/2515164002 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc849d24700 1 --2- 172.21.15.60:0/2515164002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc84415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.571+0000 7fc848d22700 1 -- 172.21.15.60:0/2515164002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 msgr2=0x7fc84415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc848d22700 1 --2- 172.21.15.60:0/2515164002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc84415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc848d22700 1 -- 172.21.15.60:0/2515164002 >> v1:172.21.15.144:6789/0 conn(0x7fc8440cd6e0 legacy=0x7fc8440cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc848d22700 1 -- 172.21.15.60:0/2515164002 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84415e290 con 0x7fc8440cdab0 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc848d22700 1 --2- 172.21.15.60:0/2515164002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cdab0 0x7fc84415d860 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc8340099b0 tx=0x7fc834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255ef41f645f1797 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc83bfff700 1 -- 172.21.15.60:0/2515164002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834009ea0 con 0x7fc8440cdab0 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc83bfff700 1 -- 172.21.15.60:0/2515164002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400b860 con 0x7fc8440cdab0 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc83bfff700 1 -- 172.21.15.60:0/2515164002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400bc00 con 0x7fc8440cdab0 2023-10-08T16:07:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc84a525700 1 -- 172.21.15.60:0/2515164002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cdab0 msgr2=0x7fc84415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc84a525700 1 --2- 172.21.15.60:0/2515164002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cdab0 0x7fc84415d860 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc8340099b0 tx=0x7fc834009250 comp rx=0 tx=0).stop 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc84a525700 1 -- 172.21.15.60:0/2515164002 shutdown_connections 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc84a525700 1 --2- 172.21.15.60:0/2515164002 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc84415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc84a525700 1 --2- 172.21.15.60:0/2515164002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cdab0 0x7fc84415d860 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.572+0000 7fc84a525700 1 -- 172.21.15.60:0/2515164002 >> 172.21.15.60:0/2515164002 conn(0x7fc844067660 msgr2=0x7fc844067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.573+0000 7fc84a525700 1 -- 172.21.15.60:0/2515164002 shutdown_connections 2023-10-08T16:07:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.573+0000 7fc84a525700 1 -- 172.21.15.60:0/2515164002 wait complete. 2023-10-08T16:07:20.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.574+0000 7fc84a525700 1 Processor -- start 2023-10-08T16:07:20.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.574+0000 7fc84a525700 1 -- start start 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc84a525700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 0x7fc84415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc84a525700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8440cdab0 0x7fc844159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc84a525700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc8440c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc84a525700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c8bc0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc84a525700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c8ea0 con 0x7fc8440cdab0 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc84a525700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c92f0 con 0x7fc84415dda0 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 0x7fc84415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 0x7fc84415c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49442/0 (socket says 172.21.15.60:49442) 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 -- 172.21.15.60:0/1129758269 learned_addr learned my addr 172.21.15.60:0/1129758269 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc848d22700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8440cdab0 0x7fc844159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849d24700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc8440c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 -- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 msgr2=0x7fc8440c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc8440c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 -- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8440cdab0 msgr2=0x7fc844159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8440cdab0 0x7fc844159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 -- 172.21.15.60:0/1129758269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340094f0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.575+0000 7fc849523700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 0x7fc84415c270 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c4e0 tx=0x7fc84000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.576+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840011590 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.576+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840011710 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.576+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840011ad0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.576+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440c95d0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.576+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8441597c0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.577+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc844089280 con 0x7fc8440cd6e0 2023-10-08T16:07:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.577+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc84001b3b0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.578+0000 7fc8397fa700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:20.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.578+0000 7fc848d22700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:20.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.578+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8400838f0 con 0x7fc8440cd6e0 2023-10-08T16:07:20.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.578+0000 7fc848d22700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8340099b0 tx=0x7fc834017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:20.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.582+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc840050b60 con 0x7fc8440cd6e0 2023-10-08T16:07:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.821+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc84404bb80 con 0x7fc8440cd6e0 2023-10-08T16:07:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.822+0000 7fc8397fa700 1 -- 172.21.15.60:0/1129758269 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc840017070 con 0x7fc8440cd6e0 2023-10-08T16:07:20.822 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:07:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc828066f30 msgr2=0x7fc8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8340099b0 tx=0x7fc834017000 comp rx=0 tx=0).stop 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 msgr2=0x7fc84415c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 0x7fc84415c270 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c4e0 tx=0x7fc84000c7f0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 shutdown_connections 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc84415dda0 0x7fc8440c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440cd6e0 0x7fc84415c270 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 --2- 172.21.15.60:0/1129758269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8440cdab0 0x7fc844159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 >> 172.21.15.60:0/1129758269 conn(0x7fc844067660 msgr2=0x7fc8440d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 shutdown_connections 2023-10-08T16:07:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:20.824+0000 7fc84a525700 1 -- 172.21.15.60:0/1129758269 wait complete. 2023-10-08T16:07:20.836 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:07:20.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:07:20.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:07:20.836 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:07:20.836 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:20.836 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:07:20.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:07:20.837 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:07:20.837 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:07:20.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:20.837 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:07:20.852 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:20.852 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:20.852 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:20.853 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42300sec preferred_lft 42300sec 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:07:20.854 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:20.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:20.855 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:07:20.916 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:07:20.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:20.918 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:07:20.974 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:07:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:07:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:07:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:07:20.975 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:07:20.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:20.975 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:07:20.975 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:07:20.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:07:20.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:07:20.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:07:20.976 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:07:21.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:21.077 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:07:21.091 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:07:21.091 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:07:21.092 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:07:21.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:21.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:07:21.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:21.157 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:07:21.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:21.212 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:21.267 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:07:21.267 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:07:21.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:21.349 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:21.349 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:07:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:07:21.389 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:07:21.390 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:07:21.390 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:07:21.390 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:07:21.390 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:07:21.391 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:07:21.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:21.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:07:21.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:07:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.620+0000 7f57772be700 1 Processor -- start 2023-10-08T16:07:21.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.620+0000 7f57772be700 1 -- start start 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f57772be700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5770158e50 0x7f57700cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f57772be700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577006c010 con 0x7f5770152010 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f57772be700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577006bd10 con 0x7f57701523e0 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f57772be700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577015c060 con 0x7f5770158e50 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f577505a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5770152010 0x7f577015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48214/0 (socket says 172.21.15.60:48214) 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f577505a700 1 -- 172.21.15.60:0/3606979709 learned_addr learned my addr 172.21.15.60:0/3606979709 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f577585b700 1 --2- 172.21.15.60:0/3606979709 >> v2:172.21.15.144:3300/0 conn(0x7f5770158e50 0x7f57700cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929766934 0 0) 0x7f577006c010 con 0x7f5770152010 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003570 con 0x7f5770152010 2023-10-08T16:07:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497577581 0 0) 0x7f577006bd10 con 0x7f57701523e0 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577006c010 con 0x7f57701523e0 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f577585b700 1 -- 172.21.15.60:0/3606979709 >> v1:172.21.15.144:6789/0 conn(0x7f57701523e0 legacy=0x7f577006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f577585b700 1 -- 172.21.15.60:0/3606979709 >> v1:172.21.15.60:6789/0 conn(0x7f5770152010 legacy=0x7f577015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.621+0000 7f577585b700 1 -- 172.21.15.60:0/3606979709 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577015c340 con 0x7f5770158e50 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f577585b700 1 --2- 172.21.15.60:0/3606979709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5770158e50 0x7f57700cb750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e60 tx=0x7f5768009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ed40e0c0cafad4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800e070 con 0x7f5770158e50 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576800bab0 con 0x7f5770158e50 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f5767fff700 1 -- 172.21.15.60:0/3606979709 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800be70 con 0x7f5770158e50 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 -- 172.21.15.60:0/3606979709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5770158e50 msgr2=0x7f57700cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 --2- 172.21.15.60:0/3606979709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5770158e50 0x7f57700cb750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e60 tx=0x7f5768009780 comp rx=0 tx=0).stop 2023-10-08T16:07:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 -- 172.21.15.60:0/3606979709 shutdown_connections 2023-10-08T16:07:21.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 --2- 172.21.15.60:0/3606979709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5770158e50 0x7f57700cb750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 -- 172.21.15.60:0/3606979709 >> 172.21.15.60:0/3606979709 conn(0x7f5770069870 msgr2=0x7f5770069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:21.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 -- 172.21.15.60:0/3606979709 shutdown_connections 2023-10-08T16:07:21.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.622+0000 7f57772be700 1 -- 172.21.15.60:0/3606979709 wait complete. 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.623+0000 7f57772be700 1 Processor -- start 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.623+0000 7f57772be700 1 -- start start 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.624+0000 7f57772be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5770152010 0x7f57700c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.624+0000 7f57772be700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57701523e0 0x7f577014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.624+0000 7f57772be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 0x7f57701678c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.624+0000 7f57772be700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700c7b70 con 0x7f5770158e50 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.624+0000 7f57772be700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770168380 con 0x7f57701523e0 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.624+0000 7f57772be700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5770168660 con 0x7f5770152010 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 0x7f57701678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 0x7f57701678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49456/0 (socket says 172.21.15.60:49456) 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 -- 172.21.15.60:0/2936422628 learned_addr learned my addr 172.21.15.60:0/2936422628 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f5774859700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57701523e0 0x7f577014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577505a700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5770152010 0x7f57700c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 -- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5770152010 msgr2=0x7f57700c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5770152010 0x7f57700c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 -- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57701523e0 msgr2=0x7f577014d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57701523e0 0x7f577014d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 -- 172.21.15.60:0/2936422628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768009a20 con 0x7f5770158e50 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f577585b700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 0x7f57701678c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f57700c59e0 tx=0x7f5768019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768012db0 con 0x7f5770158e50 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768026480 con 0x7f5770158e50 2023-10-08T16:07:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57700c7dc0 con 0x7f5770158e50 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768026840 con 0x7f5770158e50 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.625+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577014ddc0 con 0x7f5770158e50 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.626+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5770168820 con 0x7f5770158e50 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.627+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f576801c400 con 0x7f5770158e50 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.627+0000 7f57657fa700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5754066f30 0x7f57540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.627+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5768086410 con 0x7f5770158e50 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.627+0000 7f577505a700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5754066f30 0x7f57540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.628+0000 7f577505a700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5754066f30 0x7f57540693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f576c007fd0 tx=0x7f576c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:21.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.632+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5768053680 con 0x7f5770158e50 2023-10-08T16:07:21.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.867+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f577004c3c0 con 0x7f5770158e50 2023-10-08T16:07:21.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.867+0000 7f57657fa700 1 -- 172.21.15.60:0/2936422628 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5768056ca0 con 0x7f5770158e50 2023-10-08T16:07:21.868 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:07:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.869+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5754066f30 msgr2=0x7f57540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.869+0000 7f57772be700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5754066f30 0x7f57540693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f576c007fd0 tx=0x7f576c009040 comp rx=0 tx=0).stop 2023-10-08T16:07:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.869+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 msgr2=0x7f57701678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.869+0000 7f57772be700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 0x7f57701678c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f57700c59e0 tx=0x7f5768019000 comp rx=0 tx=0).stop 2023-10-08T16:07:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 shutdown_connections 2023-10-08T16:07:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5754066f30 0x7f57540693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5770152010 0x7f57700c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5770158e50 0x7f57701678c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 --2- 172.21.15.60:0/2936422628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57701523e0 0x7f577014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:21.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 >> 172.21.15.60:0/2936422628 conn(0x7f5770069870 msgr2=0x7f577006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:21.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 shutdown_connections 2023-10-08T16:07:21.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:21.870+0000 7f57772be700 1 -- 172.21.15.60:0/2936422628 wait complete. 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:07:21.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:21.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:21.883 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:07:21.901 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:07:21.901 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:07:21.901 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:07:21.901 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.901 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:07:21.901 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:07:21.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42301sec preferred_lft 42301sec 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:07:21.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.904 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:07:21.904 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:07:21.904 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:07:21.904 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:07:21.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:21.904 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:07:21.968 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:07:21.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:21.970 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:07:22.028 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:07:22.028 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:07:22.028 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:07:22.028 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:07:22.028 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:07:22.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:22.029 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:07:22.029 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:07:22.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:07:22.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:07:22.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:07:22.029 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:07:22.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:22.133 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:07:22.147 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:07:22.147 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:07:22.148 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:22.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:22.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:07:22.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:22.213 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:22.267 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:07:22.268 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:07:22.268 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:22.322 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:07:22.322 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:07:22.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:07:22.445 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:07:22.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:07:22.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:07:22.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:07:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.634+0000 7f2c47be4700 1 Processor -- start 2023-10-08T16:07:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.634+0000 7f2c47be4700 1 -- start start 2023-10-08T16:07:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c47be4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2c40157870 0x7f2c4015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c47be4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c4015a620 0x7f2c4015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c47be4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4015cbb0 con 0x7f2c4015d580 2023-10-08T16:07:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c47be4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4015bfa0 con 0x7f2c4015a620 2023-10-08T16:07:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c47be4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4015c280 con 0x7f2c40157870 2023-10-08T16:07:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c4517f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c4015a620 0x7f2c4015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c46181700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2c4015d580 0x7f2c40158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46932/0 (socket says 172.21.15.60:46932) 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c46181700 1 -- 172.21.15.60:0/1483198437 learned_addr learned my addr 172.21.15.60:0/1483198437 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.635+0000 7f2c45980700 1 --2- 172.21.15.60:0/1483198437 >> v2:172.21.15.144:3300/0 conn(0x7f2c40157870 0x7f2c4015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4517f700 1 -- 172.21.15.60:0/1483198437 >> v2:172.21.15.144:3300/0 conn(0x7f2c40157870 msgr2=0x7f2c4015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4517f700 1 --2- 172.21.15.60:0/1483198437 >> v2:172.21.15.144:3300/0 conn(0x7f2c40157870 0x7f2c4015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4517f700 1 -- 172.21.15.60:0/1483198437 >> v1:172.21.15.60:6789/0 conn(0x7f2c4015d580 legacy=0x7f2c40158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4517f700 1 -- 172.21.15.60:0/1483198437 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4015c560 con 0x7f2c4015a620 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4497e700 1 -- 172.21.15.60:0/1483198437 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378507280 0 0) 0x7f2c4015cbb0 con 0x7f2c4015d580 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4517f700 1 --2- 172.21.15.60:0/1483198437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c4015a620 0x7f2c4015d040 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2c40069d80 tx=0x7f2c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48403c1941537aef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4497e700 1 -- 172.21.15.60:0/1483198437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011630 con 0x7f2c4015a620 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4497e700 1 -- 172.21.15.60:0/1483198437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34011790 con 0x7f2c4015a620 2023-10-08T16:07:22.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c4497e700 1 -- 172.21.15.60:0/1483198437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011b30 con 0x7f2c4015a620 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c47be4700 1 -- 172.21.15.60:0/1483198437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c4015a620 msgr2=0x7f2c4015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.636+0000 7f2c47be4700 1 --2- 172.21.15.60:0/1483198437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c4015a620 0x7f2c4015d040 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2c40069d80 tx=0x7f2c340091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.637+0000 7f2c47be4700 1 -- 172.21.15.60:0/1483198437 shutdown_connections 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.637+0000 7f2c47be4700 1 --2- 172.21.15.60:0/1483198437 >> v2:172.21.15.144:3300/0 conn(0x7f2c40157870 0x7f2c4015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.637+0000 7f2c47be4700 1 --2- 172.21.15.60:0/1483198437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c4015a620 0x7f2c4015d040 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.637+0000 7f2c47be4700 1 -- 172.21.15.60:0/1483198437 >> 172.21.15.60:0/1483198437 conn(0x7f2c40068ce0 msgr2=0x7f2c400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.637+0000 7f2c47be4700 1 -- 172.21.15.60:0/1483198437 shutdown_connections 2023-10-08T16:07:22.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.637+0000 7f2c47be4700 1 -- 172.21.15.60:0/1483198437 wait complete. 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.638+0000 7f2c47be4700 1 Processor -- start 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.638+0000 7f2c47be4700 1 -- start start 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 0x7f2c4016e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c4015a620 0x7f2c401494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c4015d580 0x7f2c4014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400b4960 con 0x7f2c40157870 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400b54a0 con 0x7f2c4015a620 2023-10-08T16:07:22.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400b1da0 con 0x7f2c4015d580 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 0x7f2c4016e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 0x7f2c4016e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51184/0 (socket says 172.21.15.60:51184) 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 -- 172.21.15.60:0/2770426096 learned_addr learned my addr 172.21.15.60:0/2770426096 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c46181700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c4015d580 0x7f2c4014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c4517f700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c4015a620 0x7f2c401494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 -- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c4015d580 msgr2=0x7f2c4014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c4015d580 0x7f2c4014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 -- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c4015a620 msgr2=0x7f2c401494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c4015a620 0x7f2c401494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 -- 172.21.15.60:0/2770426096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c34009420 con 0x7f2c40157870 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c45980700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 0x7f2c4016e920 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000ec80 tx=0x7f2c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000c850 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000c9b0 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c400b6c10 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.639+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000cd50 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.640+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c400b4e50 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.640+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c400b5780 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.641+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c30013680 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.641+0000 7f2c3dffb700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2c2c066f60 0x7f2c2c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.641+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c30084710 con 0x7f2c40157870 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.641+0000 7f2c4517f700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2c2c066f60 0x7f2c2c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:07:22.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.642+0000 7f2c4517f700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2c2c066f60 0x7f2c2c069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2c4015aa20 tx=0x7f2c34017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:07:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.646+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c30051980 con 0x7f2c40157870 2023-10-08T16:07:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.887+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c4004c3c0 con 0x7f2c40157870 2023-10-08T16:07:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.888+0000 7f2c3dffb700 1 -- 172.21.15.60:0/2770426096 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2c30054fa0 con 0x7f2c40157870 2023-10-08T16:07:22.888 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:07:22.889 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2c2c066f60 msgr2=0x7f2c2c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2c2c066f60 0x7f2c2c069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2c4015aa20 tx=0x7f2c34017000 comp rx=0 tx=0).stop 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 msgr2=0x7f2c4016e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 0x7f2c4016e920 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000ec80 tx=0x7f2c300091a0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 shutdown_connections 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2c2c066f60 0x7f2c2c069410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c4015d580 0x7f2c4014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c40157870 0x7f2c4016e920 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 --2- 172.21.15.60:0/2770426096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c4015a620 0x7f2c401494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:07:22.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 >> 172.21.15.60:0/2770426096 conn(0x7f2c40068ce0 msgr2=0x7f2c4014c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:07:22.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 shutdown_connections 2023-10-08T16:07:22.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:07:22.890+0000 7f2c47be4700 1 -- 172.21.15.60:0/2770426096 wait complete. 2023-10-08T16:07:22.892 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:07:22.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-08T16:07:23.040 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":5721,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4829408189999995,"mdsmap_epoch":34,"osdmap_epoch":64,"osdmap_epoch_barrier":64,"uptime":13.398265014} 2023-10-08T16:07:23.040 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 5721, "mdsmap_epoch": 34, "osdmap_epoch": 64, "osdmap_epoch_barrier": 64, "rank_uptime": 8.482940819, "state": "up:active", "uptime": 13.398265014, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:07:23.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:07:23.175 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:07:23.175 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:07:23.176 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-08T16:07:23.302 INFO:teuthology.orchestra.run.smithi060.stdout:{"mon_tick_interval":"5"} 2023-10-08T16:07:23.303 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-08T16:07:23.303 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2023-10-08T16:07:23.303 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:07:23.303 DEBUG:teuthology.orchestra.run.smithi060:> import time 2023-10-08T16:07:23.303 DEBUG:teuthology.orchestra.run.smithi060:> import datetime 2023-10-08T16:07:23.303 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-10-08T16:07:23.303 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> # Write some buffered data through before going full, all should be well 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> print("writing some data through which we expect to succeed") 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> bytes = 0 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-08T16:07:23.304 DEBUG:teuthology.orchestra.run.smithi060:> # buffered IO, the error should always only appear from fsync and not 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> # from write 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> full = False 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> for n in range(0, int(531 * 0.9)): 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> print("done writing {0} bytes".format(bytes)) 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> # OK, now we should sneak in under the full condition 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> # due to the time it takes the OSDs to report to the 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> # mons, and get a successful fsync on our full-making data 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:07:23.305 DEBUG:teuthology.orchestra.run.smithi060:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> # buffered write, add more dirty data to the buffer 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> print("starting buffered write") 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> for n in range(0, int(531 * 0.2)): 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(15.0) 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> except OSError: 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> pass; 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-08T16:07:23.306 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> # Wait long enough for a background flush that should fail 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(30) 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> # ...and check that the failed background flush is reflected in fclose 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> os.close(f) 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> except OSError: 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> print("close() returned an error as expected") 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("close() failed to raise error") 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:07:23.307 DEBUG:teuthology.orchestra.run.smithi060:> # The kernel cephfs client does not raise errors on fclose 2023-10-08T16:07:23.308 DEBUG:teuthology.orchestra.run.smithi060:> os.close(f) 2023-10-08T16:07:23.308 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:07:23.308 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-08T16:07:23.308 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:07:24.710 INFO:teuthology.orchestra.run.smithi060.stdout:writing some data through which we expect to succeed 2023-10-08T16:07:24.710 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-08T16:07:24.710 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-08T16:07:24.710 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-08T16:07:24.710 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-08T16:07:24.711 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-08T16:07:24.712 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-08T16:07:24.713 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-08T16:07:24.714 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-08T16:07:24.715 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-08T16:07:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-08T16:07:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-08T16:07:24.718 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-08T16:07:24.719 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-08T16:07:24.720 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-08T16:07:24.721 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-08T16:07:24.722 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-08T16:07:24.723 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-08T16:07:24.723 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-08T16:07:24.764 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-08T16:07:24.765 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-08T16:07:24.766 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-08T16:07:24.767 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-08T16:07:24.768 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-08T16:07:24.769 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-08T16:07:24.770 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-08T16:07:24.771 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-08T16:07:24.772 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-08T16:07:24.773 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-08T16:07:24.774 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-08T16:07:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-08T16:07:24.776 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-08T16:07:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-08T16:07:24.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-08T16:07:24.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-08T16:07:24.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-08T16:07:24.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-08T16:07:24.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-08T16:07:24.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-08T16:07:24.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-08T16:07:24.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-08T16:07:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-08T16:07:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-08T16:07:24.821 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-08T16:07:24.822 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-08T16:07:24.823 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-08T16:07:24.824 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-08T16:07:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-08T16:07:24.826 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-08T16:07:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-08T16:07:24.828 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-08T16:07:24.829 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-08T16:07:24.829 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-08T16:07:26.577 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:07:26.577+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-08T16:07:32.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:32.572 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:33.306 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:07:33.305+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-08T16:08:02.651 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:02.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:32.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:32.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:40.279 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-08T16:08:40.279 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-08T16:08:40.279 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:done writing 500695040 bytes 2023-10-08T16:08:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:successfully fsync'ed prior to getting full state reported 2023-10-08T16:08:40.281 INFO:teuthology.orchestra.run.smithi060.stdout:starting buffered write 2023-10-08T16:08:40.281 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:08:40.281 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:08:40.281 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:08:40.281 INFO:teuthology.orchestra.run.smithi060.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-08T16:08:40.473 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:08:40.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:40.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:40.565 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:08:40.565 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:08:40.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:40.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:08:40.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:08:40.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:40.610 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:08:40.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:08:40.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:08:40.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:08:40.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:08:40.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:08:40.874 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:08:40.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:41.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.062+0000 7fa322186700 1 Processor -- start 2023-10-08T16:08:41.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.063+0000 7fa322186700 1 -- start start 2023-10-08T16:08:41.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.063+0000 7fa322186700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa31c157870 0x7fa31c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.063+0000 7fa322186700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c15cbb0 con 0x7fa31c157c40 2023-10-08T16:08:41.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.063+0000 7fa322186700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c15bfa0 con 0x7fa31c15a620 2023-10-08T16:08:41.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.063+0000 7fa322186700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c15c280 con 0x7fa31c157870 2023-10-08T16:08:41.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.063+0000 7fa31b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa31c157870 0x7fa31c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa31c157c40 0x7fa31c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49664/0 (socket says 172.21.15.60:49664) 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31bfff700 1 -- 172.21.15.60:0/1615320308 learned_addr learned my addr 172.21.15.60:0/1615320308 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31b7fe700 1 -- 172.21.15.60:0/1615320308 >> v1:172.21.15.144:6789/0 conn(0x7fa31c15a620 legacy=0x7fa31c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31b7fe700 1 -- 172.21.15.60:0/1615320308 >> v1:172.21.15.60:6789/0 conn(0x7fa31c157c40 legacy=0x7fa31c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31b7fe700 1 -- 172.21.15.60:0/1615320308 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c15c560 con 0x7fa31c157870 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31a7fc700 1 -- 172.21.15.60:0/1615320308 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324987587 0 0) 0x7fa31c15cbb0 con 0x7fa31c157c40 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31b7fe700 1 --2- 172.21.15.60:0/1615320308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157870 0x7fa31c15b6a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0098e0 tx=0x7fa30c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c8a2977535409d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31a7fc700 1 -- 172.21.15.60:0/1615320308 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c009e80 con 0x7fa31c157870 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31a7fc700 1 -- 172.21.15.60:0/1615320308 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00b860 con 0x7fa31c157870 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.064+0000 7fa31a7fc700 1 -- 172.21.15.60:0/1615320308 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00bbe0 con 0x7fa31c157870 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 -- 172.21.15.60:0/1615320308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157870 msgr2=0x7fa31c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 --2- 172.21.15.60:0/1615320308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157870 0x7fa31c15b6a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0098e0 tx=0x7fa30c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 -- 172.21.15.60:0/1615320308 shutdown_connections 2023-10-08T16:08:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 --2- 172.21.15.60:0/1615320308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157870 0x7fa31c15b6a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 -- 172.21.15.60:0/1615320308 >> 172.21.15.60:0/1615320308 conn(0x7fa31c068ce0 msgr2=0x7fa31c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 -- 172.21.15.60:0/1615320308 shutdown_connections 2023-10-08T16:08:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.065+0000 7fa322186700 1 -- 172.21.15.60:0/1615320308 wait complete. 2023-10-08T16:08:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.066+0000 7fa322186700 1 Processor -- start 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.066+0000 7fa322186700 1 -- start start 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa322186700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31c157870 0x7fa31c13d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa322186700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 0x7fa31c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa322186700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa31c15a620 0x7fa31c1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa322186700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1542f0 con 0x7fa31c157c40 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa322186700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1536e0 con 0x7fa31c157870 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa322186700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1539c0 con 0x7fa31c15a620 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 0x7fa31c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 0x7fa31c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37940/0 (socket says 172.21.15.60:37940) 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 -- 172.21.15.60:0/565453207 learned_addr learned my addr 172.21.15.60:0/565453207 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31b7fe700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31c157870 0x7fa31c13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31bfff700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa31c15a620 0x7fa31c1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 -- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa31c15a620 msgr2=0x7fa31c1530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa31c15a620 0x7fa31c1530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 -- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31c157870 msgr2=0x7fa31c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31c157870 0x7fa31c13d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31affd700 1 -- 172.21.15.60:0/565453207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009420 con 0x7fa31c157c40 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.067+0000 7fa31bfff700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa31c15a620 0x7fa31c1530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.068+0000 7fa31affd700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 0x7fa31c152b60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c590 tx=0x7fa310007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.068+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310011590 con 0x7fa31c157c40 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.068+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310011710 con 0x7fa31c157c40 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.068+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310011ad0 con 0x7fa31c157c40 2023-10-08T16:08:41.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.068+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c153ca0 con 0x7fa31c157c40 2023-10-08T16:08:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.068+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c151280 con 0x7fa31c157c40 2023-10-08T16:08:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.069+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c154430 con 0x7fa31c157c40 2023-10-08T16:08:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.069+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa31001a360 con 0x7fa31c157c40 2023-10-08T16:08:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.070+0000 7fa3037fe700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.070+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3100834c0 con 0x7fa31c157c40 2023-10-08T16:08:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.070+0000 7fa31b7fe700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.070+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fa30806ea50 con 0x7fa31c157c40 2023-10-08T16:08:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.070+0000 7fa31b7fe700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0093f0 tx=0x7fa30c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.074+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa31c154430 con 0x7fa31c157c40 2023-10-08T16:08:41.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.313+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa31c154430 con 0x7fa31c157c40 2023-10-08T16:08:41.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.313+0000 7fa3037fe700 1 -- 172.21.15.60:0/565453207 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fa31c154430 con 0x7fa31c157c40 2023-10-08T16:08:41.403 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:41.403 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:08:41.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa308066f30 msgr2=0x7fa3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0093f0 tx=0x7fa30c017000 comp rx=0 tx=0).stop 2023-10-08T16:08:41.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 msgr2=0x7fa31c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 0x7fa31c152b60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c590 tx=0x7fa310007f50 comp rx=0 tx=0).stop 2023-10-08T16:08:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 shutdown_connections 2023-10-08T16:08:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa31c15a620 0x7fa31c1530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31c157870 0x7fa31c13d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 --2- 172.21.15.60:0/565453207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c157c40 0x7fa31c152b60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 >> 172.21.15.60:0/565453207 conn(0x7fa31c068ce0 msgr2=0x7fa31c0d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 shutdown_connections 2023-10-08T16:08:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.315+0000 7fa322186700 1 -- 172.21.15.60:0/565453207 wait complete. 2023-10-08T16:08:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:08:41.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.578+0000 7fdada13e700 1 Processor -- start 2023-10-08T16:08:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.578+0000 7fdada13e700 1 -- start start 2023-10-08T16:08:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdada13e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad40cd6e0 0x7fdad40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdada13e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdad40cdab0 0x7fdad415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdada13e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40cb7c0 con 0x7fdad415dda0 2023-10-08T16:08:41.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdada13e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad415e850 con 0x7fdad40cdab0 2023-10-08T16:08:41.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdada13e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40cd030 con 0x7fdad40cd6e0 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdad40cdab0 0x7fdad415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdad40cdab0 0x7fdad415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37954/0 (socket says 172.21.15.60:37954) 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 -- 172.21.15.60:0/1912823187 learned_addr learned my addr 172.21.15.60:0/1912823187 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad913c700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad40cd6e0 0x7fdad40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 -- 172.21.15.60:0/1912823187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad40cd6e0 msgr2=0x7fdad40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad40cd6e0 0x7fdad40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 -- 172.21.15.60:0/1912823187 >> v1:172.21.15.144:6789/0 conn(0x7fdad415dda0 legacy=0x7fdad415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 -- 172.21.15.60:0/1912823187 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad415e290 con 0x7fdad40cdab0 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad913c700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad40cd6e0 0x7fdad40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.579+0000 7fdad893b700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cdab0 0x7fdad415d860 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdac40099b0 tx=0x7fdac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b5f3beee549f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdacbfff700 1 -- 172.21.15.60:0/1912823187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400b820 con 0x7fdad40cdab0 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdacbfff700 1 -- 172.21.15.60:0/1912823187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400b980 con 0x7fdad40cdab0 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdacbfff700 1 -- 172.21.15.60:0/1912823187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400bd20 con 0x7fdad40cdab0 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 -- 172.21.15.60:0/1912823187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cdab0 msgr2=0x7fdad415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cdab0 0x7fdad415d860 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdac40099b0 tx=0x7fdac4009250 comp rx=0 tx=0).stop 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 -- 172.21.15.60:0/1912823187 shutdown_connections 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad40cd6e0 0x7fdad40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 --2- 172.21.15.60:0/1912823187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cdab0 0x7fdad415d860 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 -- 172.21.15.60:0/1912823187 >> 172.21.15.60:0/1912823187 conn(0x7fdad4067660 msgr2=0x7fdad4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 -- 172.21.15.60:0/1912823187 shutdown_connections 2023-10-08T16:08:41.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.580+0000 7fdada13e700 1 -- 172.21.15.60:0/1912823187 wait complete. 2023-10-08T16:08:41.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.581+0000 7fdada13e700 1 Processor -- start 2023-10-08T16:08:41.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.581+0000 7fdada13e700 1 -- start start 2023-10-08T16:08:41.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdada13e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 0x7fdad40c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdada13e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdad40cdab0 0x7fdad40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdada13e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad415dda0 0x7fdad415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdada13e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad416b3b0 con 0x7fdad40cd6e0 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdada13e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad416a830 con 0x7fdad40cdab0 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdada13e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad416ab10 con 0x7fdad415dda0 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdad913c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 0x7fdad40c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdad913c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 0x7fdad40c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37968/0 (socket says 172.21.15.60:37968) 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.582+0000 7fdad913c700 1 -- 172.21.15.60:0/3301090052 learned_addr learned my addr 172.21.15.60:0/3301090052 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad993d700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad415dda0 0x7fdad415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad893b700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdad40cdab0 0x7fdad40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad913c700 1 -- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad415dda0 msgr2=0x7fdad415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad913c700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad415dda0 0x7fdad415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad913c700 1 -- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdad40cdab0 msgr2=0x7fdad40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad913c700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdad40cdab0 0x7fdad40b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad913c700 1 -- 172.21.15.60:0/3301090052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40094f0 con 0x7fdad40cd6e0 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad993d700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad415dda0 0x7fdad415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad893b700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdad40cdab0 0x7fdad40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdad913c700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 0x7fdad40c8fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdad000c850 tx=0x7fdad0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0011600 con 0x7fdad40cd6e0 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0011760 con 0x7fdad40cd6e0 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad416adf0 con 0x7fdad40cd6e0 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0011b00 con 0x7fdad40cd6e0 2023-10-08T16:08:41.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.583+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40c9520 con 0x7fdad40cd6e0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.584+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad4089280 con 0x7fdad40cd6e0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.584+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdad00073b0 con 0x7fdad40cd6e0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.585+0000 7fdac97fa700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.585+0000 7fdad893b700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.585+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdad0084530 con 0x7fdad40cd6e0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.585+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fdab806ea50 con 0x7fdad40cd6e0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.585+0000 7fdad893b700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdab8066f30 0x7fdab80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdac40099b0 tx=0x7fdac4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.589+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdad00517a0 con 0x7fdad40cd6e0 2023-10-08T16:08:41.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.852+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdad415e570 con 0x7fdad40cd6e0 2023-10-08T16:08:41.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.853+0000 7fdac97fa700 1 -- 172.21.15.60:0/3301090052 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15408 (secure 0 0 0) 0x7fdad0054dc0 con 0x7fdad40cd6e0 2023-10-08T16:08:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:41.855 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":67,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:07:28.633514+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:12.352982+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:12.910290+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdab8066f30 msgr2=0x7fdab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdab8066f30 0x7fdab80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdac40099b0 tx=0x7fdac4016000 comp rx=0 tx=0).stop 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 msgr2=0x7fdad40c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 0x7fdad40c8fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdad000c850 tx=0x7fdad0008040 comp rx=0 tx=0).stop 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 shutdown_connections 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdad415dda0 0x7fdad415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad40cd6e0 0x7fdad40c8fe0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 --2- 172.21.15.60:0/3301090052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdad40cdab0 0x7fdad40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 >> 172.21.15.60:0/3301090052 conn(0x7fdad4067660 msgr2=0x7fdad40d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 shutdown_connections 2023-10-08T16:08:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.855+0000 7fdada13e700 1 -- 172.21.15.60:0/3301090052 wait complete. 2023-10-08T16:08:41.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:07:12.352982+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:07:12.910290+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:08:41.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:08:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.989+0000 7f23835b7700 1 Processor -- start 2023-10-08T16:08:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.990+0000 7f23835b7700 1 -- start start 2023-10-08T16:08:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.990+0000 7f23835b7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f237c0697c0 0x7f237c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.990+0000 7f23835b7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f237c15a230 0x7f237c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.990+0000 7f23835b7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c15ea90 con 0x7f237c159e60 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.990+0000 7f23835b7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0d1cf0 con 0x7f237c0697c0 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.990+0000 7f23835b7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0b3100 con 0x7f237c15a230 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f237c0697c0 0x7f237c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f237c0697c0 0x7f237c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37982/0 (socket says 172.21.15.60:37982) 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 -- 172.21.15.60:0/3863103305 learned_addr learned my addr 172.21.15.60:0/3863103305 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2381b54700 1 --2- 172.21.15.60:0/3863103305 >> v2:172.21.15.144:3300/0 conn(0x7f237c15a230 0x7f237c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 -- 172.21.15.60:0/3863103305 >> v2:172.21.15.144:3300/0 conn(0x7f237c15a230 msgr2=0x7f237c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 --2- 172.21.15.60:0/3863103305 >> v2:172.21.15.144:3300/0 conn(0x7f237c15a230 0x7f237c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 -- 172.21.15.60:0/3863103305 >> v1:172.21.15.144:6789/0 conn(0x7f237c159e60 legacy=0x7f237c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 -- 172.21.15.60:0/3863103305 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0d10e0 con 0x7f237c0697c0 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f2380b52700 1 --2- 172.21.15.60:0/3863103305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c0697c0 0x7f237c15e550 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f237c0ce810 tx=0x7f2370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4389167eac4b40e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f237bfff700 1 -- 172.21.15.60:0/3863103305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370009e70 con 0x7f237c0697c0 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f237bfff700 1 -- 172.21.15.60:0/3863103305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237000b860 con 0x7f237c0697c0 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.991+0000 7f237bfff700 1 -- 172.21.15.60:0/3863103305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000bc00 con 0x7f237c0697c0 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 -- 172.21.15.60:0/3863103305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c0697c0 msgr2=0x7f237c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 --2- 172.21.15.60:0/3863103305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c0697c0 0x7f237c15e550 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f237c0ce810 tx=0x7f2370009250 comp rx=0 tx=0).stop 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 -- 172.21.15.60:0/3863103305 shutdown_connections 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 --2- 172.21.15.60:0/3863103305 >> v2:172.21.15.144:3300/0 conn(0x7f237c15a230 0x7f237c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 --2- 172.21.15.60:0/3863103305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c0697c0 0x7f237c15e550 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 -- 172.21.15.60:0/3863103305 >> 172.21.15.60:0/3863103305 conn(0x7f237c070700 msgr2=0x7f237c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 -- 172.21.15.60:0/3863103305 shutdown_connections 2023-10-08T16:08:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.992+0000 7f23835b7700 1 -- 172.21.15.60:0/3863103305 wait complete. 2023-10-08T16:08:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.993+0000 7f23835b7700 1 Processor -- start 2023-10-08T16:08:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.993+0000 7f23835b7700 1 -- start start 2023-10-08T16:08:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f23835b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f237c0697c0 0x7f237c0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f23835b7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c159e60 0x7f237c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f23835b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 0x7f237c16aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f23835b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0c5fd0 con 0x7f237c15a230 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f23835b7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0c62b0 con 0x7f237c159e60 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f23835b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c16b270 con 0x7f237c0697c0 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 0x7f237c16aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 0x7f237c16aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37990/0 (socket says 172.21.15.60:37990) 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 -- 172.21.15.60:0/242972490 learned_addr learned my addr 172.21.15.60:0/242972490 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2380b52700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c159e60 0x7f237c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381353700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f237c0697c0 0x7f237c0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 -- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f237c0697c0 msgr2=0x7f237c0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f237c0697c0 0x7f237c0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 -- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c159e60 msgr2=0x7f237c1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c159e60 0x7f237c1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 -- 172.21.15.60:0/242972490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700094f0 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381353700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f237c0697c0 0x7f237c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.994+0000 7f2381b54700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 0x7f237c16aa20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f236c009df0 tx=0x7f236c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.995+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cb50 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.995+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00f040 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.995+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c16b550 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.995+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c014480 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.995+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c158de0 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.996+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c0c6420 con 0x7f237c15a230 2023-10-08T16:08:42.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.996+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f236c014830 con 0x7f237c15a230 2023-10-08T16:08:42.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.996+0000 7f23797fa700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2368066f30 0x7f23680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.997+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f236c084da0 con 0x7f237c15a230 2023-10-08T16:08:42.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.997+0000 7f2381353700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2368066f30 0x7f23680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.997+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f236806ea50 con 0x7f237c15a230 2023-10-08T16:08:42.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:41.997+0000 7f2381353700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2368066f30 0x7f23680693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2374001820 tx=0x7f2374009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.001+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f236c052010 con 0x7f237c15a230 2023-10-08T16:08:42.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.190+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f237c04c3c0 con 0x7f237c15a230 2023-10-08T16:08:42.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.191+0000 7f23797fa700 1 -- 172.21.15.60:0/242972490 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f236c018030 con 0x7f237c15a230 2023-10-08T16:08:42.192 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:08:42.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2368066f30 msgr2=0x7f23680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2368066f30 0x7f23680693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2374001820 tx=0x7f2374009040 comp rx=0 tx=0).stop 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 msgr2=0x7f237c16aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 0x7f237c16aa20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f236c009df0 tx=0x7f236c00b040 comp rx=0 tx=0).stop 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 shutdown_connections 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2368066f30 0x7f23680693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f237c0697c0 0x7f237c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c15a230 0x7f237c16aa20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 --2- 172.21.15.60:0/242972490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c159e60 0x7f237c1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 >> 172.21.15.60:0/242972490 conn(0x7f237c070700 msgr2=0x7f237c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 shutdown_connections 2023-10-08T16:08:42.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.193+0000 7f23835b7700 1 -- 172.21.15.60:0/242972490 wait complete. 2023-10-08T16:08:42.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:08:42.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.327+0000 7fe47b451700 1 Processor -- start 2023-10-08T16:08:42.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.327+0000 7fe47b451700 1 -- start start 2023-10-08T16:08:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47b451700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4740b6580 0x7fe47406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47b451700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47406a830 0x7fe4740b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47b451700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47406ac90 con 0x7fe4740cce30 2023-10-08T16:08:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47b451700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740b4d70 con 0x7fe4740b6580 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47b451700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47415b3b0 con 0x7fe47406a830 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47a44f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe4740cce30 0x7fe47415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49672/0 (socket says 172.21.15.60:49672) 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47a44f700 1 -- 172.21.15.60:0/597664152 learned_addr learned my addr 172.21.15.60:0/597664152 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe479c4e700 1 --2- 172.21.15.60:0/597664152 >> v2:172.21.15.144:3300/0 conn(0x7fe4740b6580 0x7fe47406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47ac50700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47406a830 0x7fe4740b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47944d700 1 -- 172.21.15.60:0/597664152 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073198058 0 0) 0x7fe464001490 con 0x7fe4740cce30 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe47944d700 1 -- 172.21.15.60:0/597664152 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c003570 con 0x7fe4740cce30 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe479c4e700 1 -- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47406a830 msgr2=0x7fe4740b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe479c4e700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47406a830 0x7fe4740b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe479c4e700 1 -- 172.21.15.60:0/597664152 >> v1:172.21.15.60:6789/0 conn(0x7fe4740cce30 legacy=0x7fe47415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.328+0000 7fe479c4e700 1 -- 172.21.15.60:0/597664152 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740cd8d0 con 0x7fe4740b6580 2023-10-08T16:08:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe47ac50700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47406a830 0x7fe4740b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe479c4e700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47406a2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098e0 tx=0x7fe4680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b66a71973692f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe47944d700 1 -- 172.21.15.60:0/597664152 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011630 con 0x7fe4740b6580 2023-10-08T16:08:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe47944d700 1 -- 172.21.15.60:0/597664152 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468011790 con 0x7fe4740b6580 2023-10-08T16:08:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe47944d700 1 -- 172.21.15.60:0/597664152 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011b30 con 0x7fe4740b6580 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe47b451700 1 -- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 msgr2=0x7fe47406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.329+0000 7fe47b451700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47406a2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098e0 tx=0x7fe4680091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.330+0000 7fe47b451700 1 -- 172.21.15.60:0/597664152 shutdown_connections 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.330+0000 7fe47b451700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe47406a830 0x7fe4740b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.330+0000 7fe47b451700 1 --2- 172.21.15.60:0/597664152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47406a2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.330+0000 7fe47b451700 1 -- 172.21.15.60:0/597664152 >> 172.21.15.60:0/597664152 conn(0x7fe474068cb0 msgr2=0x7fe4740690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.330+0000 7fe47b451700 1 -- 172.21.15.60:0/597664152 shutdown_connections 2023-10-08T16:08:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.330+0000 7fe47b451700 1 -- 172.21.15.60:0/597664152 wait complete. 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.331+0000 7fe47b451700 1 Processor -- start 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.331+0000 7fe47b451700 1 -- start start 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.331+0000 7fe47b451700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 0x7fe474142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.331+0000 7fe47b451700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47b451700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4740cce30 0x7fe47415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47b451700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474155f50 con 0x7fe47406a830 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47b451700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474142c90 con 0x7fe4740b6580 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47b451700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe474155340 con 0x7fe4740cce30 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 0x7fe474142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 0x7fe474142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38006/0 (socket says 172.21.15.60:38006) 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 -- 172.21.15.60:0/3345579387 learned_addr learned my addr 172.21.15.60:0/3345579387 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe479c4e700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47ac50700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4740cce30 0x7fe47415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 -- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4740cce30 msgr2=0x7fe47415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4740cce30 0x7fe47415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 -- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 msgr2=0x7fe47415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47415e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 -- 172.21.15.60:0/3345579387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009420 con 0x7fe47406a830 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe479c4e700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47ac50700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4740cce30 0x7fe47415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47a44f700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 0x7fe474142750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe46400cc40 tx=0x7fe464001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400a9c0 con 0x7fe47406a830 2023-10-08T16:08:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46400ab40 con 0x7fe47406a830 2023-10-08T16:08:42.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640070f0 con 0x7fe47406a830 2023-10-08T16:08:42.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe468009420 con 0x7fe47406a830 2023-10-08T16:08:42.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.332+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe474155900 con 0x7fe47406a830 2023-10-08T16:08:42.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.333+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474089550 con 0x7fe47406a830 2023-10-08T16:08:42.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.334+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe464007520 con 0x7fe47406a830 2023-10-08T16:08:42.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.334+0000 7fe4727fc700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe460066f30 0x7fe4600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.334+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4640848b0 con 0x7fe47406a830 2023-10-08T16:08:42.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.334+0000 7fe479c4e700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe460066f30 0x7fe4600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.334+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fe46006ea50 con 0x7fe47406a830 2023-10-08T16:08:42.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.335+0000 7fe479c4e700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe460066f30 0x7fe4600693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe4680091e0 tx=0x7fe468017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.338+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe464051ba0 con 0x7fe47406a830 2023-10-08T16:08:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.532+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe47406ac90 con 0x7fe47406a830 2023-10-08T16:08:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.533+0000 7fe4727fc700 1 -- 172.21.15.60:0/3345579387 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe47406ac90 con 0x7fe47406a830 2023-10-08T16:08:42.534 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:08:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe460066f30 msgr2=0x7fe4600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe460066f30 0x7fe4600693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe4680091e0 tx=0x7fe468017000 comp rx=0 tx=0).stop 2023-10-08T16:08:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 msgr2=0x7fe474142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 0x7fe474142750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe46400cc40 tx=0x7fe464001a70 comp rx=0 tx=0).stop 2023-10-08T16:08:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 shutdown_connections 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe460066f30 0x7fe4600693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4740cce30 0x7fe47415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47406a830 0x7fe474142750 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 --2- 172.21.15.60:0/3345579387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4740b6580 0x7fe47415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 >> 172.21.15.60:0/3345579387 conn(0x7fe474068cb0 msgr2=0x7fe47415ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 shutdown_connections 2023-10-08T16:08:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.535+0000 7fe47b451700 1 -- 172.21.15.60:0/3345579387 wait complete. 2023-10-08T16:08:42.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:08:42.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.670+0000 7f6885544700 1 Processor -- start 2023-10-08T16:08:42.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.670+0000 7f6885544700 1 -- start start 2023-10-08T16:08:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f6885544700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f68800b4860 0x7f68800b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f6885544700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800b14f0 con 0x7f68800b4c30 2023-10-08T16:08:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f6885544700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800b17d0 con 0x7f68800b3570 2023-10-08T16:08:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f6885544700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800b1ab0 con 0x7f68800b4860 2023-10-08T16:08:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f68800b4c30 0x7f6880159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52576/0 (socket says 172.21.15.60:52576) 2023-10-08T16:08:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687e7fc700 1 -- 172.21.15.60:0/1861228318 learned_addr learned my addr 172.21.15.60:0/1861228318 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687effd700 1 --2- 172.21.15.60:0/1861228318 >> v2:172.21.15.144:3300/0 conn(0x7f68800b4860 0x7f68800b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687dffb700 1 -- 172.21.15.60:0/1861228318 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988801531 0 0) 0x7f68800b14f0 con 0x7f68800b4c30 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687dffb700 1 -- 172.21.15.60:0/1861228318 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f686c003570 con 0x7f68800b4c30 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687dffb700 1 -- 172.21.15.60:0/1861228318 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754193886 0 0) 0x7f686c003570 con 0x7f68800b4c30 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687effd700 1 -- 172.21.15.60:0/1861228318 >> v1:172.21.15.144:6789/0 conn(0x7f68800b3570 legacy=0x7f68800cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687effd700 1 -- 172.21.15.60:0/1861228318 >> v1:172.21.15.60:6789/0 conn(0x7f68800b4c30 legacy=0x7f6880159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.671+0000 7f687effd700 1 -- 172.21.15.60:0/1861228318 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800b1d90 con 0x7f68800b4860 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f687effd700 1 --2- 172.21.15.60:0/1861228318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4860 0x7f68800b6700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68700098d0 tx=0x7f6870009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860e7944283f2eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f687dffb700 1 -- 172.21.15.60:0/1861228318 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868001470 con 0x7f68800b4860 2023-10-08T16:08:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f687dffb700 1 -- 172.21.15.60:0/1861228318 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6870011420 con 0x7f68800b4860 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f687dffb700 1 -- 172.21.15.60:0/1861228318 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700117c0 con 0x7f68800b4860 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 -- 172.21.15.60:0/1861228318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4860 msgr2=0x7f68800b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 --2- 172.21.15.60:0/1861228318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4860 0x7f68800b6700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68700098d0 tx=0x7f6870009120 comp rx=0 tx=0).stop 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 -- 172.21.15.60:0/1861228318 shutdown_connections 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 --2- 172.21.15.60:0/1861228318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4860 0x7f68800b6700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 -- 172.21.15.60:0/1861228318 >> 172.21.15.60:0/1861228318 conn(0x7f688009a0f0 msgr2=0x7f6880067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 -- 172.21.15.60:0/1861228318 shutdown_connections 2023-10-08T16:08:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.672+0000 7f6885544700 1 -- 172.21.15.60:0/1861228318 wait complete. 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 Processor -- start 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 -- start start 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68800b3570 0x7f68801563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 0x7f688015ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4c30 0x7f68801604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68800ac1c0 con 0x7f68800b4860 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6880147aa0 con 0x7f68800b4c30 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f6885544700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68801568f0 con 0x7f68800b3570 2023-10-08T16:08:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f687e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 0x7f688015ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f687e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 0x7f688015ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55930/0 (socket says 172.21.15.60:55930) 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.674+0000 7f687e7fc700 1 -- 172.21.15.60:0/1817814886 learned_addr learned my addr 172.21.15.60:0/1817814886 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687effd700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68800b3570 0x7f68801563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687f7fe700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4c30 0x7f68801604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687e7fc700 1 -- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68800b3570 msgr2=0x7f68801563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687e7fc700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68800b3570 0x7f68801563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687e7fc700 1 -- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4c30 msgr2=0x7f68801604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687e7fc700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4c30 0x7f68801604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687e7fc700 1 -- 172.21.15.60:0/1817814886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700093c0 con 0x7f68800b4860 2023-10-08T16:08:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687effd700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68800b3570 0x7f68801563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f687e7fc700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 0x7f688015ff90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f686800cbc0 tx=0x7f6868001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868007360 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680074e0 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6880146e90 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868004830 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.675+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6880147450 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.676+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880147c30 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.676+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6868004be0 con 0x7f68800b4860 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.677+0000 7f6876ffd700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6860066f30 0x7f68600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.677+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6868083a00 con 0x7f68800b4860 2023-10-08T16:08:42.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.677+0000 7f687effd700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6860066f30 0x7f68600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:42.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.677+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f686006ea50 con 0x7f68800b4860 2023-10-08T16:08:42.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.677+0000 7f687effd700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6860066f30 0x7f68600693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6870009390 tx=0x7f6870016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:42.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.681+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6868018020 con 0x7f68800b4860 2023-10-08T16:08:42.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.872+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f688004c3f0 con 0x7f68800b4860 2023-10-08T16:08:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.872+0000 7f6876ffd700 1 -- 172.21.15.60:0/1817814886 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6868050bd0 con 0x7f68800b4860 2023-10-08T16:08:42.874 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:08:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6860066f30 msgr2=0x7f68600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6860066f30 0x7f68600693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6870009390 tx=0x7f6870016000 comp rx=0 tx=0).stop 2023-10-08T16:08:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 msgr2=0x7f688015ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 0x7f688015ff90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f686800cbc0 tx=0x7f6868001a30 comp rx=0 tx=0).stop 2023-10-08T16:08:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 shutdown_connections 2023-10-08T16:08:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6860066f30 0x7f68600693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68800b3570 0x7f68801563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68800b4c30 0x7f68801604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 --2- 172.21.15.60:0/1817814886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68800b4860 0x7f688015ff90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 >> 172.21.15.60:0/1817814886 conn(0x7f688009a0f0 msgr2=0x7f688006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 shutdown_connections 2023-10-08T16:08:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:42.874+0000 7f6885544700 1 -- 172.21.15.60:0/1817814886 wait complete. 2023-10-08T16:08:42.888 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 Processor -- start 2023-10-08T16:08:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 -- start start 2023-10-08T16:08:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82cc0d1c30 0x7f82cc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc0c5d80 con 0x7f82cc15a680 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc068470 con 0x7f82cc0d1c30 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.006+0000 7f82d192d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c6060 con 0x7f82cc15a2b0 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82ca7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82cc0d1c30 0x7f82cc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82cb7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f82cc15a680 0x7f82cc0c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52586/0 (socket says 172.21.15.60:52586) 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82cb7fe700 1 -- 172.21.15.60:0/2067197589 learned_addr learned my addr 172.21.15.60:0/2067197589 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82caffd700 1 --2- 172.21.15.60:0/2067197589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82ca7fc700 1 -- 172.21.15.60:0/2067197589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 msgr2=0x7f82cc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82ca7fc700 1 --2- 172.21.15.60:0/2067197589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82ca7fc700 1 -- 172.21.15.60:0/2067197589 >> v1:172.21.15.60:6789/0 conn(0x7f82cc15a680 legacy=0x7f82cc0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82ca7fc700 1 -- 172.21.15.60:0/2067197589 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0c6340 con 0x7f82cc0d1c30 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82c9ffb700 1 -- 172.21.15.60:0/2067197589 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345429424 0 0) 0x7f82cc0c5d80 con 0x7f82cc15a680 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82ca7fc700 1 --2- 172.21.15.60:0/2067197589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc0d1c30 0x7f82cc0cf710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f82b40098e0 tx=0x7f82b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8546e43bcd81a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82c9ffb700 1 -- 172.21.15.60:0/2067197589 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4009e80 con 0x7f82cc0d1c30 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82c9ffb700 1 -- 172.21.15.60:0/2067197589 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400b860 con 0x7f82cc0d1c30 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.007+0000 7f82c9ffb700 1 -- 172.21.15.60:0/2067197589 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400bbe0 con 0x7f82cc0d1c30 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 -- 172.21.15.60:0/2067197589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc0d1c30 msgr2=0x7f82cc0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 --2- 172.21.15.60:0/2067197589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc0d1c30 0x7f82cc0cf710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f82b40098e0 tx=0x7f82b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 -- 172.21.15.60:0/2067197589 shutdown_connections 2023-10-08T16:08:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 --2- 172.21.15.60:0/2067197589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 --2- 172.21.15.60:0/2067197589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc0d1c30 0x7f82cc0cf710 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 -- 172.21.15.60:0/2067197589 >> 172.21.15.60:0/2067197589 conn(0x7f82cc067e40 msgr2=0x7f82cc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 -- 172.21.15.60:0/2067197589 shutdown_connections 2023-10-08T16:08:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.008+0000 7f82d192d700 1 -- 172.21.15.60:0/2067197589 wait complete. 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.009+0000 7f82d192d700 1 Processor -- start 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.009+0000 7f82d192d700 1 -- start start 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82d192d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc0d1c30 0x7f82cc146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82d192d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82d192d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 0x7f82cc16dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82d192d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc147640 con 0x7f82cc15a680 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82d192d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc09b050 con 0x7f82cc0d1c30 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82d192d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc15b570 con 0x7f82cc15a2b0 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 0x7f82cc16dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 0x7f82cc16dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55950/0 (socket says 172.21.15.60:55950) 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 -- 172.21.15.60:0/2121506874 learned_addr learned my addr 172.21.15.60:0/2121506874 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82caffd700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc0d1c30 0x7f82cc146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82ca7fc700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 -- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 msgr2=0x7f82cc147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 -- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc0d1c30 msgr2=0x7f82cc146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc0d1c30 0x7f82cc146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 -- 172.21.15.60:0/2121506874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4009420 con 0x7f82cc15a680 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.010+0000 7f82cb7fe700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 0x7f82cc16dd00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f82c400cbf0 tx=0x7f82c40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.011+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400a910 con 0x7f82cc15a680 2023-10-08T16:08:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.011+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c400aa70 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.011+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc15b780 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.011+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400ae30 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.011+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc15c020 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.012+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc04c3c0 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.012+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c4007300 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.012+0000 7f82c2ffd700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.013+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82c4084910 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.013+0000 7f82caffd700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.013+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f82ac06ea50 con 0x7f82cc15a680 2023-10-08T16:08:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.013+0000 7f82caffd700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f82ac066f30 0x7f82ac0693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0061f0 tx=0x7f82bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.017+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82c4051b60 con 0x7f82cc15a680 2023-10-08T16:08:43.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.252+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82cc0d1860 con 0x7f82cc15a680 2023-10-08T16:08:43.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.253+0000 7f82c2ffd700 1 -- 172.21.15.60:0/2121506874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f82c4055180 con 0x7f82cc15a680 2023-10-08T16:08:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:43.255 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:08:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f82ac066f30 msgr2=0x7f82ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f82ac066f30 0x7f82ac0693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0061f0 tx=0x7f82bc008040 comp rx=0 tx=0).stop 2023-10-08T16:08:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 msgr2=0x7f82cc16dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 0x7f82cc16dd00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f82c400cbf0 tx=0x7f82c40019b0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 shutdown_connections 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc15a680 0x7f82cc16dd00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82cc0d1c30 0x7f82cc146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 --2- 172.21.15.60:0/2121506874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82cc15a2b0 0x7f82cc147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 >> 172.21.15.60:0/2121506874 conn(0x7f82cc067e40 msgr2=0x7f82cc068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:43.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 shutdown_connections 2023-10-08T16:08:43.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.255+0000 7f82d192d700 1 -- 172.21.15.60:0/2121506874 wait complete. 2023-10-08T16:08:43.258 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:08:43.268 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:43.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.386+0000 7f460aea5700 1 Processor -- start 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.386+0000 7f460aea5700 1 -- start start 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.387+0000 7f460aea5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 0x7f460415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.387+0000 7f460aea5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46040cb7c0 con 0x7f460415dda0 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.387+0000 7f460aea5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460415e290 con 0x7f46040cd6e0 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.387+0000 7f460aea5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460415e850 con 0x7f46040cdab0 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.387+0000 7f460a6a4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f460415dda0 0x7f460415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52596/0 (socket says 172.21.15.60:52596) 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.387+0000 7f460a6a4700 1 -- 172.21.15.60:0/327416873 learned_addr learned my addr 172.21.15.60:0/327416873 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776869597 0 0) 0x7f46040cb7c0 con 0x7f460415dda0 2023-10-08T16:08:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f46096a2700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 0x7f460415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ec003570 con 0x7f460415dda0 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217312525 0 0) 0x7f45ec003570 con 0x7f460415dda0 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 msgr2=0x7f460415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 0x7f460415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 >> v1:172.21.15.144:6789/0 conn(0x7f46040cd6e0 legacy=0x7f46040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460415e570 con 0x7f460415dda0 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f45fc001470 con 0x7f460415dda0 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 >> v1:172.21.15.60:6789/0 conn(0x7f460415dda0 legacy=0x7f460415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 0x7f45ec003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec004010 0x7f45ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45ec004d50 0x7f45ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460415e850 con 0x7f45ec004d50 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec00bbf0 con 0x7f45ec004010 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec00bdb0 con 0x7f46040cdab0 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f460a6a4700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45ec004d50 0x7f45ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f46096a2700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec004010 0x7f45ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f4609ea3700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 0x7f45ec003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f460a6a4700 1 -- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 msgr2=0x7f45ec003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f460a6a4700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46040cdab0 0x7f45ec003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f460a6a4700 1 -- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec004010 msgr2=0x7f45ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f460a6a4700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec004010 0x7f45ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.388+0000 7f460a6a4700 1 -- 172.21.15.60:0/327416873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec003570 con 0x7f45ec004d50 2023-10-08T16:08:43.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460a6a4700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45ec004d50 0x7f45ec0051c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00c390 tx=0x7f45fc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa678457daa91c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00cc60 con 0x7f45ec004d50 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc00cdc0 con 0x7f45ec004d50 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f4608ea1700 1 -- 172.21.15.60:0/327416873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc005b70 con 0x7f45ec004d50 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460aea5700 1 -- 172.21.15.60:0/327416873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45ec004d50 msgr2=0x7f45ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460aea5700 1 --2- 172.21.15.60:0/327416873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45ec004d50 0x7f45ec0051c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00c390 tx=0x7f45fc001e50 comp rx=0 tx=0).stop 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460a6a4700 1 -- 172.21.15.60:0/327416873 reap_dead start 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460aea5700 1 -- 172.21.15.60:0/327416873 shutdown_connections 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460aea5700 1 -- 172.21.15.60:0/327416873 >> 172.21.15.60:0/327416873 conn(0x7f4604067660 msgr2=0x7f4604067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460aea5700 1 -- 172.21.15.60:0/327416873 shutdown_connections 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.389+0000 7f460aea5700 1 -- 172.21.15.60:0/327416873 wait complete. 2023-10-08T16:08:43.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.390+0000 7f460aea5700 1 Processor -- start 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.390+0000 7f460aea5700 1 -- start start 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460aea5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45ec004d50 0x7f460414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460aea5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f460416aa70 0x7f46040b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460aea5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 0x7f46040b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460aea5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040cc360 con 0x7f46040b5fe0 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460aea5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460416e070 con 0x7f460416aa70 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460aea5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040b3e10 con 0x7f45ec004d50 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460a6a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 0x7f46040b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460a6a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 0x7f46040b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55966/0 (socket says 172.21.15.60:55966) 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f460a6a4700 1 -- 172.21.15.60:0/556632185 learned_addr learned my addr 172.21.15.60:0/556632185 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:43.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f4609ea3700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45ec004d50 0x7f460414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.391+0000 7f46096a2700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f460416aa70 0x7f46040b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460a6a4700 1 -- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45ec004d50 msgr2=0x7f460414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460a6a4700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45ec004d50 0x7f460414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460a6a4700 1 -- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f460416aa70 msgr2=0x7f46040b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460a6a4700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f460416aa70 0x7f46040b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460a6a4700 1 -- 172.21.15.60:0/556632185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040b40f0 con 0x7f46040b5fe0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f4609ea3700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45ec004d50 0x7f460414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460a6a4700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 0x7f46040b29f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f45fc011000 tx=0x7f45fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0072e0 con 0x7f46040b5fe0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc007460 con 0x7f46040b5fe0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc007820 con 0x7f46040b5fe0 2023-10-08T16:08:43.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46040b43d0 con 0x7f46040b5fe0 2023-10-08T16:08:43.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.392+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46040b3a10 con 0x7f46040b5fe0 2023-10-08T16:08:43.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.393+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46040b4870 con 0x7f46040b5fe0 2023-10-08T16:08:43.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.393+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45fc019070 con 0x7f46040b5fe0 2023-10-08T16:08:43.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.394+0000 7f4601ffb700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45f0066f30 0x7f45f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.394+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45fc085030 con 0x7f46040b5fe0 2023-10-08T16:08:43.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.394+0000 7f4609ea3700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45f0066f30 0x7f45f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.394+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f45f006ea50 con 0x7f46040b5fe0 2023-10-08T16:08:43.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.394+0000 7f4609ea3700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45f0066f30 0x7f45f00693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001750 tx=0x7f45f4001640 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.398+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45fc052350 con 0x7f46040b5fe0 2023-10-08T16:08:43.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.593+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f460416e1b0 con 0x7f46040b5fe0 2023-10-08T16:08:43.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.593+0000 7f4601ffb700 1 -- 172.21.15.60:0/556632185 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15408 (secure 0 0 0) 0x7f460416e1b0 con 0x7f46040b5fe0 2023-10-08T16:08:43.595 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:43.595 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":67,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:07:28.633514+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:12.352982+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:12.910290+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45f0066f30 msgr2=0x7f45f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45f0066f30 0x7f45f00693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001750 tx=0x7f45f4001640 comp rx=0 tx=0).stop 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 msgr2=0x7f46040b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 0x7f46040b29f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f45fc011000 tx=0x7f45fc015000 comp rx=0 tx=0).stop 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 shutdown_connections 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f45f0066f30 0x7f45f00693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45ec004d50 0x7f460414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46040b5fe0 0x7f46040b29f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 --2- 172.21.15.60:0/556632185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f460416aa70 0x7f46040b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.595+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 >> 172.21.15.60:0/556632185 conn(0x7f4604067660 msgr2=0x7f460406ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.596+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 shutdown_connections 2023-10-08T16:08:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.596+0000 7f460aea5700 1 -- 172.21.15.60:0/556632185 wait complete. 2023-10-08T16:08:43.609 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:08:43.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:43.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.726+0000 7f509f289700 1 Processor -- start 2023-10-08T16:08:43.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.727+0000 7f509f289700 1 -- start start 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.727+0000 7f509f289700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5098159e10 0x7f50980b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509f289700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509815db80 con 0x7f509815a1e0 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509f289700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509815de60 con 0x7f50980cde50 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509f289700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509815e800 con 0x7f5098159e10 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509d025700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5098159e10 0x7f50980b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509c824700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f509815a1e0 0x7f50980cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52608/0 (socket says 172.21.15.60:52608) 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509c824700 1 -- 172.21.15.60:0/281686095 learned_addr learned my addr 172.21.15.60:0/281686095 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509d025700 1 -- 172.21.15.60:0/281686095 >> v1:172.21.15.144:6789/0 conn(0x7f50980cde50 legacy=0x7f50980cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509d025700 1 -- 172.21.15.60:0/281686095 >> v1:172.21.15.60:6789/0 conn(0x7f509815a1e0 legacy=0x7f50980cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509d025700 1 -- 172.21.15.60:0/281686095 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509815e140 con 0x7f5098159e10 2023-10-08T16:08:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f5097fff700 1 -- 172.21.15.60:0/281686095 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11285376 0 0) 0x7f509815db80 con 0x7f509815a1e0 2023-10-08T16:08:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f509d025700 1 --2- 172.21.15.60:0/281686095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f50980b2d20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f50900098e0 tx=0x7f50900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152d6e635e9f2aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f5097fff700 1 -- 172.21.15.60:0/281686095 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090009e80 con 0x7f5098159e10 2023-10-08T16:08:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f5097fff700 1 -- 172.21.15.60:0/281686095 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000b860 con 0x7f5098159e10 2023-10-08T16:08:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.728+0000 7f5097fff700 1 -- 172.21.15.60:0/281686095 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000bbe0 con 0x7f5098159e10 2023-10-08T16:08:43.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 -- 172.21.15.60:0/281686095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 msgr2=0x7f50980b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 --2- 172.21.15.60:0/281686095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f50980b2d20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f50900098e0 tx=0x7f50900091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 -- 172.21.15.60:0/281686095 shutdown_connections 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 --2- 172.21.15.60:0/281686095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f50980b2d20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 -- 172.21.15.60:0/281686095 >> 172.21.15.60:0/281686095 conn(0x7f5098067660 msgr2=0x7f5098067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 -- 172.21.15.60:0/281686095 shutdown_connections 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.729+0000 7f509f289700 1 -- 172.21.15.60:0/281686095 wait complete. 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.730+0000 7f509f289700 1 Processor -- start 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.730+0000 7f509f289700 1 -- start start 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509f289700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50980cde50 0x7f509815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509f289700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f5098150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509f289700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f509815a1e0 0x7f50980c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509f289700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981512c0 con 0x7f5098159e10 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509f289700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50980c7170 con 0x7f50980cde50 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509f289700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50980c6bc0 con 0x7f509815a1e0 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f5098150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f5098150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55980/0 (socket says 172.21.15.60:55980) 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 -- 172.21.15.60:0/3800805204 learned_addr learned my addr 172.21.15.60:0/3800805204 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509d025700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50980cde50 0x7f509815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509d826700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f509815a1e0 0x7f50980c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 -- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f509815a1e0 msgr2=0x7f50980c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f509815a1e0 0x7f50980c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 -- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50980cde50 msgr2=0x7f509815d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50980cde50 0x7f509815d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509c824700 1 -- 172.21.15.60:0/3800805204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090009420 con 0x7f5098159e10 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.731+0000 7f509d025700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50980cde50 0x7f509815d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.732+0000 7f509c824700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f5098150d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c530 tx=0x7f508c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.732+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c005b30 con 0x7f5098159e10 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.732+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c005c90 con 0x7f5098159e10 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.732+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50980c6e90 con 0x7f5098159e10 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.732+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c007320 con 0x7f5098159e10 2023-10-08T16:08:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.732+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50980c80d0 con 0x7f5098159e10 2023-10-08T16:08:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.733+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509804c3c0 con 0x7f5098159e10 2023-10-08T16:08:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.733+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f508c01b3b0 con 0x7f5098159e10 2023-10-08T16:08:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.734+0000 7f50957fa700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5084066f30 0x7f50840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.734+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f508c083a40 con 0x7f5098159e10 2023-10-08T16:08:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.734+0000 7f509d025700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5084066f30 0x7f50840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.734+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f508406ea50 con 0x7f5098159e10 2023-10-08T16:08:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.734+0000 7f509d025700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5084066f30 0x7f50840693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f50900093f0 tx=0x7f5090017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.738+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f508c017020 con 0x7f5098159e10 2023-10-08T16:08:43.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.974+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f509815e420 con 0x7f5098159e10 2023-10-08T16:08:44.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.974+0000 7f50957fa700 1 -- 172.21.15.60:0/3800805204 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f508c085e60 con 0x7f5098159e10 2023-10-08T16:08:44.083 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:44.083 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:08:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5084066f30 msgr2=0x7f50840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5084066f30 0x7f50840693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f50900093f0 tx=0x7f5090017000 comp rx=0 tx=0).stop 2023-10-08T16:08:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 msgr2=0x7f5098150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f5098150d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c530 tx=0x7f508c007f90 comp rx=0 tx=0).stop 2023-10-08T16:08:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 shutdown_connections 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5084066f30 0x7f50840693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f509815a1e0 0x7f50980c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50980cde50 0x7f509815d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 --2- 172.21.15.60:0/3800805204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5098159e10 0x7f5098150d80 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 >> 172.21.15.60:0/3800805204 conn(0x7f5098067660 msgr2=0x7f509815a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 shutdown_connections 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:43.976+0000 7f509f289700 1 -- 172.21.15.60:0/3800805204 wait complete. 2023-10-08T16:08:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:08:44.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.202+0000 7fa2a5231700 1 Processor -- start 2023-10-08T16:08:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.202+0000 7fa2a5231700 1 -- start start 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa2a5231700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa2a00b0e50 0x7fa2a00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa2a5231700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa2a00b1220 0x7fa2a006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa2a5231700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a015de60 con 0x7fa2a006dad0 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa2a5231700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a015e140 con 0x7fa2a00b1220 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa2a5231700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a015e420 con 0x7fa2a00b0e50 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa29e59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa2a00b1220 0x7fa2a006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa29f59e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa2a006dad0 0x7fa2a00cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52620/0 (socket says 172.21.15.60:52620) 2023-10-08T16:08:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.203+0000 7fa29f59e700 1 -- 172.21.15.60:0/2036825778 learned_addr learned my addr 172.21.15.60:0/2036825778 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29ed9d700 1 --2- 172.21.15.60:0/2036825778 >> v2:172.21.15.144:3300/0 conn(0x7fa2a00b0e50 0x7fa2a00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29e59c700 1 -- 172.21.15.60:0/2036825778 >> v2:172.21.15.144:3300/0 conn(0x7fa2a00b0e50 msgr2=0x7fa2a00c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29e59c700 1 --2- 172.21.15.60:0/2036825778 >> v2:172.21.15.144:3300/0 conn(0x7fa2a00b0e50 0x7fa2a00c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29e59c700 1 -- 172.21.15.60:0/2036825778 >> v1:172.21.15.60:6789/0 conn(0x7fa2a006dad0 legacy=0x7fa2a00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29e59c700 1 -- 172.21.15.60:0/2036825778 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a015e700 con 0x7fa2a00b1220 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29e59c700 1 --2- 172.21.15.60:0/2036825778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a00b1220 0x7fa2a006d590 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0069840 tx=0x7fa2880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779b365b7fb04be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29dd9b700 1 -- 172.21.15.60:0/2036825778 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800b6b0 con 0x7fa2a00b1220 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29dd9b700 1 -- 172.21.15.60:0/2036825778 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800b810 con 0x7fa2a00b1220 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.204+0000 7fa29dd9b700 1 -- 172.21.15.60:0/2036825778 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800bbb0 con 0x7fa2a00b1220 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 -- 172.21.15.60:0/2036825778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a00b1220 msgr2=0x7fa2a006d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 --2- 172.21.15.60:0/2036825778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a00b1220 0x7fa2a006d590 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0069840 tx=0x7fa2880091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 -- 172.21.15.60:0/2036825778 shutdown_connections 2023-10-08T16:08:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 --2- 172.21.15.60:0/2036825778 >> v2:172.21.15.144:3300/0 conn(0x7fa2a00b0e50 0x7fa2a00c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 --2- 172.21.15.60:0/2036825778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a00b1220 0x7fa2a006d590 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 -- 172.21.15.60:0/2036825778 >> 172.21.15.60:0/2036825778 conn(0x7fa2a0069870 msgr2=0x7fa2a0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 -- 172.21.15.60:0/2036825778 shutdown_connections 2023-10-08T16:08:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.205+0000 7fa2a5231700 1 -- 172.21.15.60:0/2036825778 wait complete. 2023-10-08T16:08:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.206+0000 7fa2a5231700 1 Processor -- start 2023-10-08T16:08:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.206+0000 7fa2a5231700 1 -- start start 2023-10-08T16:08:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 0x7fa2a00c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2a00b0e50 0x7fa2a0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2a00b1220 0x7fa2a016a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a016b5d0 con 0x7fa2a006dad0 2023-10-08T16:08:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0156340 con 0x7fa2a00b0e50 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a015c2e0 con 0x7fa2a00b1220 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 0x7fa2a00c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 0x7fa2a00c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56004/0 (socket says 172.21.15.60:56004) 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 -- 172.21.15.60:0/1566865446 learned_addr learned my addr 172.21.15.60:0/1566865446 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29e59c700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2a00b0e50 0x7fa2a0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29f59e700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2a00b1220 0x7fa2a016a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 -- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2a00b1220 msgr2=0x7fa2a016a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2a00b1220 0x7fa2a016a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 -- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2a00b0e50 msgr2=0x7fa2a0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2a00b0e50 0x7fa2a0155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288009420 con 0x7fa2a006dad0 2023-10-08T16:08:44.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29e59c700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2a00b0e50 0x7fa2a0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:44.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa29ed9d700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 0x7fa2a00c5bf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa29000e190 tx=0x7fa290009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000ee30 con 0x7fa2a006dad0 2023-10-08T16:08:44.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290014420 con 0x7fa2a006dad0 2023-10-08T16:08:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900147e0 con 0x7fa2a006dad0 2023-10-08T16:08:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a015ab30 con 0x7fa2a006dad0 2023-10-08T16:08:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.207+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a015b0f0 con 0x7fa2a006dad0 2023-10-08T16:08:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.208+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a00b3e30 con 0x7fa2a006dad0 2023-10-08T16:08:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.209+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa290014bd0 con 0x7fa2a006dad0 2023-10-08T16:08:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.209+0000 7fa296ffd700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa280066f30 0x7fa2800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.209+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa290084e10 con 0x7fa2a006dad0 2023-10-08T16:08:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.209+0000 7fa29e59c700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa280066f30 0x7fa2800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.210+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fa28006ea50 con 0x7fa2a006dad0 2023-10-08T16:08:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.210+0000 7fa29e59c700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa280066f30 0x7fa2800693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00b1680 tx=0x7fa288017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.214+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa290088030 con 0x7fa2a006dad0 2023-10-08T16:08:44.401 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:08:44.400+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-08T16:08:44.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.405+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(68..68 src has 1..68) v4 ==== 304+0+0 (secure 0 0 0) 0x7fa2900563a0 con 0x7fa2a006dad0 2023-10-08T16:08:44.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.405+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7fa28006f3a0 con 0x7fa2a006dad0 2023-10-08T16:08:44.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.452+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a015c5c0 con 0x7fa2a006dad0 2023-10-08T16:08:44.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.452+0000 7fa296ffd700 1 -- 172.21.15.60:0/1566865446 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fa290009a60 con 0x7fa2a006dad0 2023-10-08T16:08:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:44.454 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:07:13.938550+0000","modified":"2023-10-08T16:07:17.558807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5721":{"gid":5721,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3651333177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3651333177},{"type":"v1","addr":"172.21.15.60:6837","nonce":3651333177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa280066f30 msgr2=0x7fa2800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa280066f30 0x7fa2800693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00b1680 tx=0x7fa288017000 comp rx=0 tx=0).stop 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 msgr2=0x7fa2a00c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 0x7fa2a00c5bf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa29000e190 tx=0x7fa290009920 comp rx=0 tx=0).stop 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 shutdown_connections 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa280066f30 0x7fa2800693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2a00b1220 0x7fa2a016a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2a006dad0 0x7fa2a00c5bf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 --2- 172.21.15.60:0/1566865446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2a00b0e50 0x7fa2a0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 >> 172.21.15.60:0/1566865446 conn(0x7fa2a0069870 msgr2=0x7fa2a0156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 shutdown_connections 2023-10-08T16:08:44.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.454+0000 7fa2a5231700 1 -- 172.21.15.60:0/1566865446 wait complete. 2023-10-08T16:08:44.457 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2023-10-08T16:08:44.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:44.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.586+0000 7fa5c9bbf700 1 Processor -- start 2023-10-08T16:08:44.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.586+0000 7fa5c9bbf700 1 -- start start 2023-10-08T16:08:44.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c9bbf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5c415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c9bbf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c4067660 con 0x7fa5c415aff0 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c9bbf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c40684c0 con 0x7fa5c415a6e0 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c9bbf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c415b460 con 0x7fa5c406f630 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa5c415aff0 0x7fa5c4070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52634/0 (socket says 172.21.15.60:52634) 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c3fff700 1 -- 172.21.15.60:0/1860184109 learned_addr learned my addr 172.21.15.60:0/1860184109 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c2ffd700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5c415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411371373 0 0) 0x7fa5c4067660 con 0x7fa5c415aff0 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ac003570 con 0x7fa5c415aff0 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896201911 0 0) 0x7fa5ac003570 con 0x7fa5c415aff0 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 msgr2=0x7fa5c415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5c415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 >> v1:172.21.15.144:6789/0 conn(0x7fa5c415a6e0 legacy=0x7fa5c4068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40678b0 con 0x7fa5c415aff0 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.587+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fa5bc0017f0 con 0x7fa5c415aff0 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 >> v1:172.21.15.60:6789/0 conn(0x7fa5c415aff0 legacy=0x7fa5c4070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ac003a90 0x7fa5ac003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c415b460 con 0x7fa5ac003a90 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac00bb10 con 0x7fa5ac004810 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac00bcd0 con 0x7fa5c406f630 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ac003a90 0x7fa5ac003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c2ffd700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c3fff700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 -- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 msgr2=0x7fa5ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 -- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac004810 msgr2=0x7fa5ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 -- 172.21.15.60:0/1860184109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac003570 con 0x7fa5ac003a90 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c2ffd700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c3fff700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c406f630 0x7fa5ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ac003a90 0x7fa5ac003e60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40019a0 tx=0x7fa5b4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7175016fab93493 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400c5d0 con 0x7fa5ac003a90 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b400c730 con 0x7fa5ac003a90 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.588+0000 7fa5c27fc700 1 -- 172.21.15.60:0/1860184109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400cad0 con 0x7fa5ac003a90 2023-10-08T16:08:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/1860184109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ac003a90 msgr2=0x7fa5ac003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/1860184109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ac003a90 0x7fa5ac003e60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40019a0 tx=0x7fa5b4007d10 comp rx=0 tx=0).stop 2023-10-08T16:08:44.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c3fff700 1 -- 172.21.15.60:0/1860184109 reap_dead start 2023-10-08T16:08:44.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/1860184109 shutdown_connections 2023-10-08T16:08:44.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/1860184109 >> 172.21.15.60:0/1860184109 conn(0x7fa5c406a250 msgr2=0x7fa5c406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/1860184109 shutdown_connections 2023-10-08T16:08:44.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.589+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/1860184109 wait complete. 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.590+0000 7fa5c9bbf700 1 Processor -- start 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.590+0000 7fa5c9bbf700 1 -- start start 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c9bbf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac003a90 0x7fa5c40ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c9bbf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c4153920 0x7fa5c4153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c9bbf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 0x7fa5c40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c9bbf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40b1040 con 0x7fa5c40aa880 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c9bbf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40afdf0 con 0x7fa5ac003a90 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c9bbf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40ae550 con 0x7fa5c4153920 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 0x7fa5c40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 0x7fa5c40aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56010/0 (socket says 172.21.15.60:56010) 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 -- 172.21.15.60:0/2577316720 learned_addr learned my addr 172.21.15.60:0/2577316720 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac003a90 0x7fa5c40ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c2ffd700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c4153920 0x7fa5c4153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 -- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c4153920 msgr2=0x7fa5c4153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c4153920 0x7fa5c4153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 -- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac003a90 msgr2=0x7fa5c40ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac003a90 0x7fa5c40ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 -- 172.21.15.60:0/2577316720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40b0a80 con 0x7fa5c40aa880 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac003a90 0x7fa5c40ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.591+0000 7fa5c3fff700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 0x7fa5c40aacf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc001460 tx=0x7fa5bc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.592+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc004e90 con 0x7fa5c40aa880 2023-10-08T16:08:44.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.592+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00b8c0 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.592+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c40b0d60 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.592+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00bc60 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.592+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c4153660 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.592+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c40ae040 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.593+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5bc0073a0 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.593+0000 7fa5ab7fe700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5b0066f30 0x7fa5b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.593+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5b0066f30 0x7fa5b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.593+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5bc0842f0 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.594+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7fa5b006ea50 con 0x7fa5c40aa880 2023-10-08T16:08:44.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.594+0000 7fa5c37fe700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5b0066f30 0x7fa5b00693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40cbfb0 tx=0x7fa5b4015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.598+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5bc04c5a0 con 0x7fa5c40aa880 2023-10-08T16:08:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.792+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5c40ae6c0 con 0x7fa5c40aa880 2023-10-08T16:08:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.793+0000 7fa5ab7fe700 1 -- 172.21.15.60:0/2577316720 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+15379 (secure 0 0 0) 0x7fa5c40ae040 con 0x7fa5c40aa880 2023-10-08T16:08:44.802 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:44.802 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:08:44.401600+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:07:12.352982+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:07:12.910290+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5b0066f30 msgr2=0x7fa5b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5b0066f30 0x7fa5b00693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40cbfb0 tx=0x7fa5b4015000 comp rx=0 tx=0).stop 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 msgr2=0x7fa5c40aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 0x7fa5c40aacf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc001460 tx=0x7fa5bc009040 comp rx=0 tx=0).stop 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 shutdown_connections 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa5b0066f30 0x7fa5b00693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5c40aa880 0x7fa5c40aacf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5ac003a90 0x7fa5c40ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 --2- 172.21.15.60:0/2577316720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5c4153920 0x7fa5c4153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 >> 172.21.15.60:0/2577316720 conn(0x7fa5c406a250 msgr2=0x7fa5c40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 shutdown_connections 2023-10-08T16:08:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.795+0000 7fa5c9bbf700 1 -- 172.21.15.60:0/2577316720 wait complete. 2023-10-08T16:08:44.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:08:44.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.927+0000 7f24bae6d700 1 Processor -- start 2023-10-08T16:08:44.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.927+0000 7f24bae6d700 1 -- start start 2023-10-08T16:08:44.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24bae6d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 0x7f24b40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24bae6d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b415db80 con 0x7f24b4159e10 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24bae6d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b415de60 con 0x7f24b40b3430 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24bae6d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b415e800 con 0x7f24b415a1e0 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b8c09700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f24b4159e10 0x7f24b40b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52650/0 (socket says 172.21.15.60:52650) 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b8c09700 1 -- 172.21.15.60:0/2025180757 learned_addr learned my addr 172.21.15.60:0/2025180757 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b3fff700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 0x7f24b40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894691320 0 0) 0x7f24b415db80 con 0x7f24b4159e10 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a0003570 con 0x7f24b4159e10 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4106368525 0 0) 0x7f24a0003570 con 0x7f24b4159e10 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 msgr2=0x7f24b40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 0x7f24b40cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 >> v1:172.21.15.144:6789/0 conn(0x7f24b40b3430 legacy=0x7f24b40cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b415e140 con 0x7f24b4159e10 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.928+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f249c001470 con 0x7f24b4159e10 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 >> v1:172.21.15.60:6789/0 conn(0x7f24b4159e10 legacy=0x7f24b40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a0003a90 0x7f24a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 0x7f24a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b415e800 con 0x7f24a0004d50 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000bb70 con 0x7f24a0003a90 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a000bd30 con 0x7f24b415a1e0 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b3fff700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 0x7f24a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b8c09700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a0003a90 0x7f24a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 -- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 msgr2=0x7f24a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b415a1e0 0x7f24a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 -- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a0003a90 msgr2=0x7f24a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24a0003a90 0x7f24a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 -- 172.21.15.60:0/2025180757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0003570 con 0x7f24a0004d50 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b940a700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f24ac001880 tx=0x7f24ac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e28c7f1963fae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac012420 con 0x7f24a0004d50 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac012580 con 0x7f24a0004d50 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.929+0000 7f24b37fe700 1 -- 172.21.15.60:0/2025180757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac012920 con 0x7f24a0004d50 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24bae6d700 1 -- 172.21.15.60:0/2025180757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a0004d50 msgr2=0x7f24a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24bae6d700 1 --2- 172.21.15.60:0/2025180757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a0004d50 0x7f24a00051c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f24ac001880 tx=0x7f24ac007d30 comp rx=0 tx=0).stop 2023-10-08T16:08:44.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24b940a700 1 -- 172.21.15.60:0/2025180757 reap_dead start 2023-10-08T16:08:44.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24bae6d700 1 -- 172.21.15.60:0/2025180757 shutdown_connections 2023-10-08T16:08:44.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24bae6d700 1 -- 172.21.15.60:0/2025180757 >> 172.21.15.60:0/2025180757 conn(0x7f24b4067660 msgr2=0x7f24b4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:44.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24bae6d700 1 -- 172.21.15.60:0/2025180757 shutdown_connections 2023-10-08T16:08:44.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.930+0000 7f24bae6d700 1 -- 172.21.15.60:0/2025180757 wait complete. 2023-10-08T16:08:44.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.931+0000 7f24bae6d700 1 Processor -- start 2023-10-08T16:08:44.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.931+0000 7f24bae6d700 1 -- start start 2023-10-08T16:08:44.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24bae6d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 0x7f24b40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24bae6d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b40c8ca0 0x7f24b416cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24bae6d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b40d11e0 0x7f24b416d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24bae6d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40c9e30 con 0x7f24b40d0e10 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24bae6d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b416d630 con 0x7f24b40d11e0 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24bae6d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40c91b0 con 0x7f24b40c8ca0 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 0x7f24b40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 0x7f24b40c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56026/0 (socket says 172.21.15.60:56026) 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 -- 172.21.15.60:0/229628361 learned_addr learned my addr 172.21.15.60:0/229628361 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b940a700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b40d11e0 0x7f24b416d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b3fff700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b40c8ca0 0x7f24b416cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 -- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b40c8ca0 msgr2=0x7f24b416cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b40c8ca0 0x7f24b416cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 -- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b40d11e0 msgr2=0x7f24b416d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:44.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b40d11e0 0x7f24b416d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40c9490 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b3fff700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b40c8ca0 0x7f24b416cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b8c09700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 0x7f24b40c8760 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f249c007390 tx=0x7f249c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.932+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c018030 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.933+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c00f660 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.933+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b40c9770 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.933+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00fa00 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.933+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b415c5a0 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.933+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b404c3c0 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.934+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f249c01b070 con 0x7f24b40d0e10 2023-10-08T16:08:44.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.934+0000 7f24b0ff9700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.934+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f249c019070 con 0x7f24b40d0e10 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.934+0000 7f24b3fff700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.935+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f249406ea50 con 0x7f24b40d0e10 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.935+0000 7f24b3fff700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2494066f30 0x7f24940693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009fd0 tx=0x7f24a400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:44.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:44.938+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f249c051570 con 0x7f24b40d0e10 2023-10-08T16:08:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.175+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f24b415e420 con 0x7f24b40d0e10 2023-10-08T16:08:45.177 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:08:45.176+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:08:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.178+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(69..69 src has 1..69) v4 ==== 366+0+0 (secure 0 0 0) 0x7f249c055230 con 0x7f24b40d0e10 2023-10-08T16:08:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.178+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f249406f3a0 con 0x7f24b40d0e10 2023-10-08T16:08:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.181+0000 7f24b0ff9700 1 -- 172.21.15.60:0/229628361 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f249c054b90 con 0x7f24b40d0e10 2023-10-08T16:08:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2494066f30 msgr2=0x7f24940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2494066f30 0x7f24940693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009fd0 tx=0x7f24a400b040 comp rx=0 tx=0).stop 2023-10-08T16:08:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 msgr2=0x7f24b40c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 0x7f24b40c8760 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f249c007390 tx=0x7f249c001e50 comp rx=0 tx=0).stop 2023-10-08T16:08:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 shutdown_connections 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b40d11e0 0x7f24b416d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24b40d0e10 0x7f24b40c8760 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 --2- 172.21.15.60:0/229628361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24b40c8ca0 0x7f24b416cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.183+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 >> 172.21.15.60:0/229628361 conn(0x7f24b4067660 msgr2=0x7f24b4159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.184+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 shutdown_connections 2023-10-08T16:08:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.184+0000 7f24bae6d700 1 -- 172.21.15.60:0/229628361 wait complete. 2023-10-08T16:08:45.186 INFO:tasks.ceph.mds.a.smithi060.stderr: -9395> 2023-10-08T16:07:16.530+0000 7fe1c75e6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:08:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:08:45.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:08:45.215 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:08:45.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.318+0000 7fda90e40700 1 Processor -- start 2023-10-08T16:08:45.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.318+0000 7fda90e40700 1 -- start start 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.318+0000 7fda90e40700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda8c0711c0 0x7fda8c06c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda90e40700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c070d30 con 0x7fda8c159c30 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda90e40700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c070700 con 0x7fda8c06c8c0 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda90e40700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c06cd40 con 0x7fda8c0711c0 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda8a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fda8c159c30 0x7fda8c06ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52658/0 (socket says 172.21.15.60:52658) 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda8a59c700 1 -- 172.21.15.60:0/2851280504 learned_addr learned my addr 172.21.15.60:0/2851280504 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda89d9b700 1 --2- 172.21.15.60:0/2851280504 >> v2:172.21.15.144:3300/0 conn(0x7fda8c0711c0 0x7fda8c06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda8959a700 1 -- 172.21.15.60:0/2851280504 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082166146 0 0) 0x7fda8c070d30 con 0x7fda8c159c30 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda8959a700 1 -- 172.21.15.60:0/2851280504 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda78003570 con 0x7fda8c159c30 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda89d9b700 1 -- 172.21.15.60:0/2851280504 >> v1:172.21.15.144:6789/0 conn(0x7fda8c06c8c0 legacy=0x7fda8c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda8959a700 1 -- 172.21.15.60:0/2851280504 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130443634 0 0) 0x7fda78003570 con 0x7fda8c159c30 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda89d9b700 1 -- 172.21.15.60:0/2851280504 >> v1:172.21.15.60:6789/0 conn(0x7fda8c159c30 legacy=0x7fda8c06ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda89d9b700 1 -- 172.21.15.60:0/2851280504 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c06f710 con 0x7fda8c0711c0 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.319+0000 7fda89d9b700 1 --2- 172.21.15.60:0/2851280504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c0711c0 0x7fda8c06c380 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda740098e0 tx=0x7fda740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f2be5e2d955fb05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda8959a700 1 -- 172.21.15.60:0/2851280504 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840017f0 con 0x7fda8c0711c0 2023-10-08T16:08:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda8959a700 1 -- 172.21.15.60:0/2851280504 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74011420 con 0x7fda8c0711c0 2023-10-08T16:08:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda8959a700 1 -- 172.21.15.60:0/2851280504 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740117c0 con 0x7fda8c0711c0 2023-10-08T16:08:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 -- 172.21.15.60:0/2851280504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c0711c0 msgr2=0x7fda8c06c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 --2- 172.21.15.60:0/2851280504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c0711c0 0x7fda8c06c380 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda740098e0 tx=0x7fda740091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 -- 172.21.15.60:0/2851280504 shutdown_connections 2023-10-08T16:08:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 --2- 172.21.15.60:0/2851280504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c0711c0 0x7fda8c06c380 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 -- 172.21.15.60:0/2851280504 >> 172.21.15.60:0/2851280504 conn(0x7fda8c0cb030 msgr2=0x7fda8c06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 -- 172.21.15.60:0/2851280504 shutdown_connections 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.320+0000 7fda90e40700 1 -- 172.21.15.60:0/2851280504 wait complete. 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.321+0000 7fda90e40700 1 Processor -- start 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.321+0000 7fda90e40700 1 -- start start 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda90e40700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c06c8c0 0x7fda8c0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda90e40700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8c0711c0 0x7fda8c0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda90e40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 0x7fda8c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda90e40700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0c5c60 con 0x7fda8c159c30 2023-10-08T16:08:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda90e40700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0c5f40 con 0x7fda8c06c8c0 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda90e40700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0c6220 con 0x7fda8c0711c0 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda8ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 0x7fda8c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda8ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 0x7fda8c1532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56056/0 (socket says 172.21.15.60:56056) 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda8ad9d700 1 -- 172.21.15.60:0/1345443089 learned_addr learned my addr 172.21.15.60:0/1345443089 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda8a59c700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c06c8c0 0x7fda8c0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.322+0000 7fda89d9b700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8c0711c0 0x7fda8c0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda8ad9d700 1 -- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8c0711c0 msgr2=0x7fda8c0c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda8ad9d700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8c0711c0 0x7fda8c0c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda8ad9d700 1 -- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c06c8c0 msgr2=0x7fda8c0afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda8ad9d700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c06c8c0 0x7fda8c0afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda8ad9d700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009420 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda8ad9d700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 0x7fda8c1532b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c600 tx=0x7fda7c007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c011590 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c011710 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c0c6500 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c011ad0 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.323+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c0c7860 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.324+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c04c3c0 con 0x7fda8c159c30 2023-10-08T16:08:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.325+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda7c01b3b0 con 0x7fda8c159c30 2023-10-08T16:08:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.325+0000 7fda827fc700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda6c066f30 0x7fda6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.325+0000 7fda8a59c700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda6c066f30 0x7fda6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.325+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fda7c0839e0 con 0x7fda8c159c30 2023-10-08T16:08:45.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.325+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fda6c06eaf0 con 0x7fda8c159c30 2023-10-08T16:08:45.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.326+0000 7fda8a59c700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda6c066f30 0x7fda6c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0b02a0 tx=0x7fda84007d20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:45.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.330+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda7c017070 con 0x7fda8c159c30 2023-10-08T16:08:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:45.568+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda8c06f9f0 con 0x7fda8c159c30 2023-10-08T16:08:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.179+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 288+0+0 (secure 0 0 0) 0x7fda7c054fc0 con 0x7fda8c159c30 2023-10-08T16:08:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.179+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fda6c06f440 con 0x7fda8c159c30 2023-10-08T16:08:46.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.185+0000 7fda827fc700 1 -- 172.21.15.60:0/1345443089 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda7c050c00 con 0x7fda8c159c30 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda6c066f30 msgr2=0x7fda6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda6c066f30 0x7fda6c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0b02a0 tx=0x7fda84007d20 comp rx=0 tx=0).stop 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 msgr2=0x7fda8c1532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 0x7fda8c1532b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c600 tx=0x7fda7c007e20 comp rx=0 tx=0).stop 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 shutdown_connections 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fda6c066f30 0x7fda6c0693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda8c159c30 0x7fda8c1532b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8c06c8c0 0x7fda8c0afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 --2- 172.21.15.60:0/1345443089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8c0711c0 0x7fda8c0c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 >> 172.21.15.60:0/1345443089 conn(0x7fda8c0cb030 msgr2=0x7fda8c068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:46.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 shutdown_connections 2023-10-08T16:08:46.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.187+0000 7fda90e40700 1 -- 172.21.15.60:0/1345443089 wait complete. 2023-10-08T16:08:46.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:08:46.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.367+0000 7f937def0700 1 Processor -- start 2023-10-08T16:08:46.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.367+0000 7f937def0700 1 -- start start 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.368+0000 7f937def0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9378159b50 0x7f9378068980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.368+0000 7f937def0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f9378070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.368+0000 7f937def0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9378067d50 con 0x7f937806f030 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.368+0000 7f937def0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937806f560 con 0x7f9378159b50 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.368+0000 7f937def0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937806f840 con 0x7f9378159f20 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f937ceee700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9378159b50 0x7f9378068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f9377fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f9378070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f937d6ef700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f937806f030 0x7f937815d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37152/0 (socket says 172.21.15.60:37152) 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f937d6ef700 1 -- 172.21.15.60:0/4031436307 learned_addr learned my addr 172.21.15.60:0/4031436307 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f9377fff700 1 -- 172.21.15.60:0/4031436307 >> v2:172.21.15.144:3300/0 conn(0x7f9378159b50 msgr2=0x7f9378068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f9377fff700 1 --2- 172.21.15.60:0/4031436307 >> v2:172.21.15.144:3300/0 conn(0x7f9378159b50 0x7f9378068980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f9377fff700 1 -- 172.21.15.60:0/4031436307 >> v1:172.21.15.144:6789/0 conn(0x7f937806f030 legacy=0x7f937815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f9377fff700 1 -- 172.21.15.60:0/4031436307 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378067700 con 0x7f9378159f20 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f93777fe700 1 -- 172.21.15.60:0/4031436307 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434054223 0 0) 0x7f9378067d50 con 0x7f937806f030 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f937ceee700 1 --2- 172.21.15.60:0/4031436307 >> v2:172.21.15.144:3300/0 conn(0x7f9378159b50 0x7f9378068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f9377fff700 1 --2- 172.21.15.60:0/4031436307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f9378070700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93680098e0 tx=0x7f93680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=949e563a7be74066 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.369+0000 7f93777fe700 1 -- 172.21.15.60:0/4031436307 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800b640 con 0x7f9378159f20 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f93777fe700 1 -- 172.21.15.60:0/4031436307 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800b7a0 con 0x7f9378159f20 2023-10-08T16:08:46.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f93777fe700 1 -- 172.21.15.60:0/4031436307 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800bb40 con 0x7f9378159f20 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 -- 172.21.15.60:0/4031436307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 msgr2=0x7f9378070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 --2- 172.21.15.60:0/4031436307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f9378070700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93680098e0 tx=0x7f93680091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 -- 172.21.15.60:0/4031436307 shutdown_connections 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 --2- 172.21.15.60:0/4031436307 >> v2:172.21.15.144:3300/0 conn(0x7f9378159b50 0x7f9378068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 --2- 172.21.15.60:0/4031436307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f9378070700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 -- 172.21.15.60:0/4031436307 >> 172.21.15.60:0/4031436307 conn(0x7f93780cd900 msgr2=0x7f93780cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 -- 172.21.15.60:0/4031436307 shutdown_connections 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.370+0000 7f937def0700 1 -- 172.21.15.60:0/4031436307 wait complete. 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.371+0000 7f937def0700 1 Processor -- start 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.371+0000 7f937def0700 1 -- start start 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937def0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 0x7f9378153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937def0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378159b50 0x7f9378145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937def0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f93780b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937def0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93781543d0 con 0x7f937806f030 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937def0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9378153a00 con 0x7f9378159b50 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937def0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9378152df0 con 0x7f9378159f20 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937ceee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 0x7f9378153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937ceee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 0x7f9378153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56068/0 (socket says 172.21.15.60:56068) 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937ceee700 1 -- 172.21.15.60:0/3419279350 learned_addr learned my addr 172.21.15.60:0/3419279350 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f937d6ef700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f93780b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.372+0000 7f9377fff700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378159b50 0x7f9378145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937ceee700 1 -- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 msgr2=0x7f93780b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937ceee700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f93780b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937ceee700 1 -- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378159b50 msgr2=0x7f9378145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937ceee700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378159b50 0x7f9378145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937ceee700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370009a20 con 0x7f937806f030 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937ceee700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 0x7f9378153e90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f937000c170 tx=0x7f937000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000ce10 con 0x7f937806f030 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937000f040 con 0x7f937806f030 2023-10-08T16:08:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9368009420 con 0x7f937806f030 2023-10-08T16:08:46.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370014690 con 0x7f937806f030 2023-10-08T16:08:46.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.373+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9378153180 con 0x7f937806f030 2023-10-08T16:08:46.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.374+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378153ce0 con 0x7f937806f030 2023-10-08T16:08:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.374+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9370014a00 con 0x7f937806f030 2023-10-08T16:08:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.375+0000 7f9374ff9700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.375+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9370085440 con 0x7f937806f030 2023-10-08T16:08:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.375+0000 7f9377fff700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.375+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f935806eaf0 con 0x7f937806f030 2023-10-08T16:08:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.375+0000 7f9377fff700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9358066f30 0x7f93580693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f93680093f0 tx=0x7f9368017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:46.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.379+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9370052660 con 0x7f937806f030 2023-10-08T16:08:46.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:46.574+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f937806d700 con 0x7f937806f030 2023-10-08T16:08:47.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.412+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 288+0+0 (secure 0 0 0) 0x7f9370056a20 con 0x7f937806f030 2023-10-08T16:08:47.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.413+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f935806cf20 con 0x7f937806f030 2023-10-08T16:08:47.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.415+0000 7f9374ff9700 1 -- 172.21.15.60:0/3419279350 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7f937806d700 con 0x7f937806f030 2023-10-08T16:08:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9358066f30 msgr2=0x7f93580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9358066f30 0x7f93580693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f93680093f0 tx=0x7f9368017000 comp rx=0 tx=0).stop 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 msgr2=0x7f9378153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 0x7f9378153e90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f937000c170 tx=0x7f937000b040 comp rx=0 tx=0).stop 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 shutdown_connections 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9378159f20 0x7f93780b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f937806f030 0x7f9378153e90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 --2- 172.21.15.60:0/3419279350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9378159b50 0x7f9378145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 >> 172.21.15.60:0/3419279350 conn(0x7f93780cd900 msgr2=0x7f93780b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 shutdown_connections 2023-10-08T16:08:47.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.423+0000 7f937def0700 1 -- 172.21.15.60:0/3419279350 wait complete. 2023-10-08T16:08:47.426 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:08:47.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:08:47.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.568+0000 7f282573b700 1 Processor -- start 2023-10-08T16:08:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.568+0000 7f282573b700 1 -- start start 2023-10-08T16:08:47.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f282573b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 0x7f28200c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f282573b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282015e940 con 0x7f28200cb740 2023-10-08T16:08:47.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f282573b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282015a250 con 0x7f282006db00 2023-10-08T16:08:47.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f282573b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282015dd30 con 0x7f28200b10a0 2023-10-08T16:08:47.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f281e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f28200cb740 0x7f282006d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52666/0 (socket says 172.21.15.60:52666) 2023-10-08T16:08:47.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f281e7fc700 1 -- 172.21.15.60:0/1675348329 learned_addr learned my addr 172.21.15.60:0/1675348329 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:47.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265749212 0 0) 0x7f282015e940 con 0x7f28200cb740 2023-10-08T16:08:47.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c003570 con 0x7f28200cb740 2023-10-08T16:08:47.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.569+0000 7f281effd700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 0x7f28200c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 696473451 0 0) 0x7f280c003570 con 0x7f28200cb740 2023-10-08T16:08:47.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 msgr2=0x7f28200c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:47.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 0x7f28200c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 >> v1:172.21.15.144:6789/0 conn(0x7f282006db00 legacy=0x7f2820067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282015e010 con 0x7f28200cb740 2023-10-08T16:08:47.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f2808001470 con 0x7f28200cb740 2023-10-08T16:08:47.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 >> v1:172.21.15.60:6789/0 conn(0x7f28200cb740 legacy=0x7f282006d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 0x7f280c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280c0040c0 0x7f280c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c004da0 0x7f280c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282015dd30 con 0x7f280c004da0 2023-10-08T16:08:47.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c00bc70 con 0x7f280c0040c0 2023-10-08T16:08:47.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c00be30 con 0x7f28200b10a0 2023-10-08T16:08:47.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c004da0 0x7f280c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281effd700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 0x7f280c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281e7fc700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280c0040c0 0x7f280c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 -- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 msgr2=0x7f280c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:47.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28200b10a0 0x7f280c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 -- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280c0040c0 msgr2=0x7f280c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:47.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280c0040c0 0x7f280c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 -- 172.21.15.60:0/1675348329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c003570 con 0x7f280c004da0 2023-10-08T16:08:47.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.570+0000 7f281f7fe700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c004da0 0x7f280c0051f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2810001f90 tx=0x7f2810001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e8442952064c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:47.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810001950 con 0x7f280c004da0 2023-10-08T16:08:47.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000c8b0 con 0x7f280c004da0 2023-10-08T16:08:47.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f281dffb700 1 -- 172.21.15.60:0/1675348329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000cc50 con 0x7f280c004da0 2023-10-08T16:08:47.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f282573b700 1 -- 172.21.15.60:0/1675348329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c004da0 msgr2=0x7f280c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f282573b700 1 --2- 172.21.15.60:0/1675348329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f280c004da0 0x7f280c0051f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2810001f90 tx=0x7f2810001640 comp rx=0 tx=0).stop 2023-10-08T16:08:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f281f7fe700 1 -- 172.21.15.60:0/1675348329 reap_dead start 2023-10-08T16:08:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f282573b700 1 -- 172.21.15.60:0/1675348329 shutdown_connections 2023-10-08T16:08:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f282573b700 1 -- 172.21.15.60:0/1675348329 >> 172.21.15.60:0/1675348329 conn(0x7f2820069870 msgr2=0x7f2820069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f282573b700 1 -- 172.21.15.60:0/1675348329 shutdown_connections 2023-10-08T16:08:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.571+0000 7f282573b700 1 -- 172.21.15.60:0/1675348329 wait complete. 2023-10-08T16:08:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.572+0000 7f282573b700 1 Processor -- start 2023-10-08T16:08:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.572+0000 7f282573b700 1 -- start start 2023-10-08T16:08:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f282573b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f282014cfe0 0x7f282014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f282573b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28200b4240 0x7f282015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f282573b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 0x7f28200ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f282573b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200ce8e0 con 0x7f28200cdf40 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f282573b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282014d8f0 con 0x7f28200b4240 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f282573b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282015ad00 con 0x7f282014cfe0 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 0x7f28200ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 0x7f28200ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56090/0 (socket says 172.21.15.60:56090) 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 -- 172.21.15.60:0/2046370306 learned_addr learned my addr 172.21.15.60:0/2046370306 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281effd700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f282014cfe0 0x7f282014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281e7fc700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28200b4240 0x7f282015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 -- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f282014cfe0 msgr2=0x7f282014d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f282014cfe0 0x7f282014d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 -- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28200b4240 msgr2=0x7f282015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28200b4240 0x7f282015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.573+0000 7f281f7fe700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282015afe0 con 0x7f28200cdf40 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f281e7fc700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28200b4240 0x7f282015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f281f7fe700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 0x7f28200ce3a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2810004000 tx=0x7f2810015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000c6d0 con 0x7f28200cdf40 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000cc30 con 0x7f28200cdf40 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282015b2c0 con 0x7f28200cdf40 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281001e630 con 0x7f28200cdf40 2023-10-08T16:08:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.574+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282015b880 con 0x7f28200cdf40 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.575+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282014fa00 con 0x7f28200cdf40 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.575+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2810019030 con 0x7f28200cdf40 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.576+0000 7f2816ffd700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2800066f30 0x7f28000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.576+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2810085ac0 con 0x7f28200cdf40 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.576+0000 7f281effd700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2800066f30 0x7f28000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.576+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f280006dcf0 con 0x7f28200cdf40 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.576+0000 7f281effd700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2800066f30 0x7f28000693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28200cec30 tx=0x7f2818008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.580+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2810017070 con 0x7f28200cdf40 2023-10-08T16:08:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:47.772+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f282004c3c0 con 0x7f28200cdf40 2023-10-08T16:08:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.416+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(72..72 src has 1..72) v4 ==== 666+0+0 (secure 0 0 0) 0x7f281001c390 con 0x7f28200cdf40 2023-10-08T16:08:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.416+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f280006ca80 con 0x7f28200cdf40 2023-10-08T16:08:48.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.423+0000 7f2816ffd700 1 -- 172.21.15.60:0/2046370306 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2810052df0 con 0x7f28200cdf40 2023-10-08T16:08:48.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.428+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2800066f30 msgr2=0x7f28000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.428+0000 7f282573b700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2800066f30 0x7f28000693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28200cec30 tx=0x7f2818008040 comp rx=0 tx=0).stop 2023-10-08T16:08:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.428+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 msgr2=0x7f28200ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.428+0000 7f282573b700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 0x7f28200ce3a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2810004000 tx=0x7f2810015000 comp rx=0 tx=0).stop 2023-10-08T16:08:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 shutdown_connections 2023-10-08T16:08:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2800066f30 0x7f28000693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f282014cfe0 0x7f282014d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28200cdf40 0x7f28200ce3a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 --2- 172.21.15.60:0/2046370306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28200b4240 0x7f282015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 >> 172.21.15.60:0/2046370306 conn(0x7f2820069870 msgr2=0x7f28200cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:48.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 shutdown_connections 2023-10-08T16:08:48.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.429+0000 7f282573b700 1 -- 172.21.15.60:0/2046370306 wait complete. 2023-10-08T16:08:48.432 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:08:48.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:08:48.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.564+0000 7fee610a6700 1 Processor -- start 2023-10-08T16:08:48.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.564+0000 7fee610a6700 1 -- start start 2023-10-08T16:08:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.565+0000 7fee610a6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 0x7fee5c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.565+0000 7fee610a6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0b0790 con 0x7fee5c159ec0 2023-10-08T16:08:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.565+0000 7fee610a6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0ce1f0 con 0x7fee5c06aae0 2023-10-08T16:08:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.565+0000 7fee610a6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c06af60 con 0x7fee5c15a290 2023-10-08T16:08:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.565+0000 7fee5ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee5c159ec0 0x7fee5c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52682/0 (socket says 172.21.15.60:52682) 2023-10-08T16:08:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.565+0000 7fee5ad9d700 1 -- 172.21.15.60:0/4190492339 learned_addr learned my addr 172.21.15.60:0/4190492339 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5a59c700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 0x7fee5c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908615082 0 0) 0x7fee5c0b0790 con 0x7fee5c159ec0 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee48003570 con 0x7fee5c159ec0 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725715234 0 0) 0x7fee48003570 con 0x7fee5c159ec0 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 msgr2=0x7fee5c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 0x7fee5c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 >> v1:172.21.15.144:6789/0 conn(0x7fee5c06aae0 legacy=0x7fee5c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0b0b20 con 0x7fee5c159ec0 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fee54001470 con 0x7fee5c159ec0 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 >> v1:172.21.15.60:6789/0 conn(0x7fee5c159ec0 legacy=0x7fee5c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee48003a90 0x7fee48003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 0x7fee480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c06af60 con 0x7fee48003a90 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800bb10 con 0x7fee48004810 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800bcd0 con 0x7fee5c15a290 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee48003a90 0x7fee48003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5a59c700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5b59e700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 0x7fee480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5ad9d700 1 -- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 msgr2=0x7fee480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee5c15a290 0x7fee480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5ad9d700 1 -- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee48004810 msgr2=0x7fee48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.566+0000 7fee5ad9d700 1 -- 172.21.15.60:0/4190492339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48003570 con 0x7fee48003a90 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee48003a90 0x7fee48003e60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c3c0 tx=0x7fee54001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b645e1ea72e243f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400cc90 con 0x7fee48003a90 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400ce10 con 0x7fee48003a90 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee59d9b700 1 -- 172.21.15.60:0/4190492339 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54005b70 con 0x7fee48003a90 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee610a6700 1 -- 172.21.15.60:0/4190492339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee48003a90 msgr2=0x7fee48003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee610a6700 1 --2- 172.21.15.60:0/4190492339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee48003a90 0x7fee48003e60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c3c0 tx=0x7fee54001e70 comp rx=0 tx=0).stop 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee5b59e700 1 -- 172.21.15.60:0/4190492339 reap_dead start 2023-10-08T16:08:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee610a6700 1 -- 172.21.15.60:0/4190492339 shutdown_connections 2023-10-08T16:08:48.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee610a6700 1 -- 172.21.15.60:0/4190492339 >> 172.21.15.60:0/4190492339 conn(0x7fee5c0d1880 msgr2=0x7fee5c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:48.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee610a6700 1 -- 172.21.15.60:0/4190492339 shutdown_connections 2023-10-08T16:08:48.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.567+0000 7fee610a6700 1 -- 172.21.15.60:0/4190492339 wait complete. 2023-10-08T16:08:48.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 Processor -- start 2023-10-08T16:08:48.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 -- start start 2023-10-08T16:08:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee48003a90 0x7fee5c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee5c15b630 0x7fee5c0b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 0x7fee5c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c157fd0 con 0x7fee5c156700 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c158270 con 0x7fee5c15b630 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee610a6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c158550 con 0x7fee48003a90 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee5b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 0x7fee5c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee5b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 0x7fee5c156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56108/0 (socket says 172.21.15.60:56108) 2023-10-08T16:08:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee5b59e700 1 -- 172.21.15.60:0/1977984537 learned_addr learned my addr 172.21.15.60:0/1977984537 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee5a59c700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee5c15b630 0x7fee5c0b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.569+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee48003a90 0x7fee5c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5b59e700 1 -- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee48003a90 msgr2=0x7fee5c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5b59e700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee48003a90 0x7fee5c157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5b59e700 1 -- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee5c15b630 msgr2=0x7fee5c0b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5b59e700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee5c15b630 0x7fee5c0b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5b59e700 1 -- 172.21.15.60:0/1977984537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c158830 con 0x7fee5c156700 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee48003a90 0x7fee5c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee5b59e700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 0x7fee5c156b80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee5c089010 tx=0x7fee4c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00c7b0 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00c930 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00ccf0 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c158b10 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.570+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c159310 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.571+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c159030 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.571+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee4c015640 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.572+0000 7fee52ffd700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee3c066f30 0x7fee3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.572+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fee4c084860 con 0x7fee5c156700 2023-10-08T16:08:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.572+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee3c066f30 0x7fee3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.572+0000 7fee5ad9d700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee3c066f30 0x7fee3c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee54001ed0 tx=0x7fee54015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.576+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee5c159030 con 0x7fee5c156700 2023-10-08T16:08:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.769+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fee5c159030 con 0x7fee5c156700 2023-10-08T16:08:48.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.772+0000 7fee52ffd700 1 -- 172.21.15.60:0/1977984537 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee5c159030 con 0x7fee5c156700 2023-10-08T16:08:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee3c066f30 msgr2=0x7fee3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee3c066f30 0x7fee3c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee54001ed0 tx=0x7fee54015000 comp rx=0 tx=0).stop 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 msgr2=0x7fee5c156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 0x7fee5c156b80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee5c089010 tx=0x7fee4c0016d0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 shutdown_connections 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee3c066f30 0x7fee3c0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee48003a90 0x7fee5c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee5c156700 0x7fee5c156b80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 --2- 172.21.15.60:0/1977984537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee5c15b630 0x7fee5c0b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 >> 172.21.15.60:0/1977984537 conn(0x7fee5c0d1880 msgr2=0x7fee5c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 shutdown_connections 2023-10-08T16:08:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.775+0000 7fee610a6700 1 -- 172.21.15.60:0/1977984537 wait complete. 2023-10-08T16:08:48.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-08T16:08:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.906+0000 7f6266a42700 1 Processor -- start 2023-10-08T16:08:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.906+0000 7f6266a42700 1 -- start start 2023-10-08T16:08:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6266a42700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f626015a2b0 0x7f62600b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6266a42700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62600cfe20 0x7f62600ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6266a42700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600c5d80 con 0x7f62600d1c30 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6266a42700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6260068470 con 0x7f62600cfe20 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6266a42700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600c6060 con 0x7f626015a2b0 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62600cfe20 0x7f62600ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62600cfe20 0x7f62600ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56124/0 (socket says 172.21.15.60:56124) 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 -- 172.21.15.60:0/853178295 learned_addr learned my addr 172.21.15.60:0/853178295 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 -- 172.21.15.60:0/853178295 >> v2:172.21.15.144:3300/0 conn(0x7f626015a2b0 msgr2=0x7f62600b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 --2- 172.21.15.60:0/853178295 >> v2:172.21.15.144:3300/0 conn(0x7f626015a2b0 0x7f62600b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 -- 172.21.15.60:0/853178295 >> v1:172.21.15.144:6789/0 conn(0x7f62600d1c30 legacy=0x7f62600cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 -- 172.21.15.60:0/853178295 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600c6340 con 0x7f62600cfe20 2023-10-08T16:08:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f6264fdf700 1 --2- 172.21.15.60:0/853178295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62600cfe20 0x7f62600ccdd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6260089220 tx=0x7f6258009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e57af63e419a227 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f625effd700 1 -- 172.21.15.60:0/853178295 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800e070 con 0x7f62600cfe20 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.907+0000 7f625effd700 1 -- 172.21.15.60:0/853178295 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800ba10 con 0x7f62600cfe20 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f625effd700 1 -- 172.21.15.60:0/853178295 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580092e0 con 0x7f62600cfe20 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 -- 172.21.15.60:0/853178295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62600cfe20 msgr2=0x7f62600ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 --2- 172.21.15.60:0/853178295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62600cfe20 0x7f62600ccdd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6260089220 tx=0x7f6258009840 comp rx=0 tx=0).stop 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 -- 172.21.15.60:0/853178295 shutdown_connections 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 --2- 172.21.15.60:0/853178295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62600cfe20 0x7f62600ccdd0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 --2- 172.21.15.60:0/853178295 >> v2:172.21.15.144:3300/0 conn(0x7f626015a2b0 0x7f62600b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 -- 172.21.15.60:0/853178295 >> 172.21.15.60:0/853178295 conn(0x7f6260067e40 msgr2=0x7f62600d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 -- 172.21.15.60:0/853178295 shutdown_connections 2023-10-08T16:08:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.908+0000 7f6266a42700 1 -- 172.21.15.60:0/853178295 wait complete. 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.909+0000 7f6266a42700 1 Processor -- start 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.909+0000 7f6266a42700 1 -- start start 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6266a42700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cfe20 0x7f62601573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6266a42700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62600d1c30 0x7f62600c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6266a42700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 0x7f626015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6266a42700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600b47e0 con 0x7f626015a2b0 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6266a42700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600b5610 con 0x7f62600cfe20 2023-10-08T16:08:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6266a42700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600b4a00 con 0x7f62600d1c30 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 0x7f626015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 0x7f626015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56138/0 (socket says 172.21.15.60:56138) 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 -- 172.21.15.60:0/2256084748 learned_addr learned my addr 172.21.15.60:0/2256084748 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 -- 172.21.15.60:0/2256084748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62600d1c30 msgr2=0x7f62600c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62600d1c30 0x7f62600c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 -- 172.21.15.60:0/2256084748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cfe20 msgr2=0x7f62601573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cfe20 0x7f62601573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.910+0000 7f6264fdf700 1 -- 172.21.15.60:0/2256084748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009ae0 con 0x7f626015a2b0 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.911+0000 7f6264fdf700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 0x7f626015a680 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6258003000 tx=0x7f6258017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.911+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258012e60 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.911+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800be80 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.911+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62600b4ce0 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.911+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625801e660 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.911+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62600b5320 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.912+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6260158000 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.912+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f625801ea50 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.913+0000 7f6247fff700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f624c066f30 0x7f624c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.913+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6258085e70 con 0x7f626015a2b0 2023-10-08T16:08:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.913+0000 7f625ffff700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f624c066f30 0x7f624c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:48.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.913+0000 7f625ffff700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f624c066f30 0x7f624c0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f62500097c0 tx=0x7f6250006d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:48.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:48.917+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62580533e0 con 0x7f626015a2b0 2023-10-08T16:08:49.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.187+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f626004c3c0 con 0x7f626015a2b0 2023-10-08T16:08:49.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.413+0000 7f6247fff700 1 -- 172.21.15.60:0/2256084748 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v202) v1 ==== 134+0+0 (secure 0 0 0) 0x7f6258056a00 con 0x7f626015a2b0 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f624c066f30 msgr2=0x7f624c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f624c066f30 0x7f624c0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f62500097c0 tx=0x7f6250006d00 comp rx=0 tx=0).stop 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 msgr2=0x7f626015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 0x7f626015a680 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6258003000 tx=0x7f6258017000 comp rx=0 tx=0).stop 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 shutdown_connections 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f624c066f30 0x7f624c0693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f626015a2b0 0x7f626015a680 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cfe20 0x7f62601573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 --2- 172.21.15.60:0/2256084748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62600d1c30 0x7f62600c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 >> 172.21.15.60:0/2256084748 conn(0x7f6260067e40 msgr2=0x7f62600cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:49.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 shutdown_connections 2023-10-08T16:08:49.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.415+0000 7f6266a42700 1 -- 172.21.15.60:0/2256084748 wait complete. 2023-10-08T16:08:49.429 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-08T16:08:49.429 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-08T16:08:49.429 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T16:08:49.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-08T16:08:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.547+0000 7fd58cdd2700 1 Processor -- start 2023-10-08T16:08:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.547+0000 7fd58cdd2700 1 -- start start 2023-10-08T16:08:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd58cdd2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd58806aa70 0x7fd5880cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd58cdd2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5880ab0e0 0x7fd5880ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd58cdd2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880c76b0 con 0x7fd58806ae40 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd58cdd2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880ccc10 con 0x7fd58806aa70 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd58cdd2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880c7900 con 0x7fd5880ab0e0 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd58806aa70 0x7fd5880cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd58806aa70 0x7fd5880cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56142/0 (socket says 172.21.15.60:56142) 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 -- 172.21.15.60:0/4030053690 learned_addr learned my addr 172.21.15.60:0/4030053690 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd587fff700 1 --2- 172.21.15.60:0/4030053690 >> v2:172.21.15.144:3300/0 conn(0x7fd5880ab0e0 0x7fd5880ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 -- 172.21.15.60:0/4030053690 >> v2:172.21.15.144:3300/0 conn(0x7fd5880ab0e0 msgr2=0x7fd5880ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 --2- 172.21.15.60:0/4030053690 >> v2:172.21.15.144:3300/0 conn(0x7fd5880ab0e0 0x7fd5880ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 -- 172.21.15.60:0/4030053690 >> v1:172.21.15.144:6789/0 conn(0x7fd58806ae40 legacy=0x7fd5880cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 -- 172.21.15.60:0/4030053690 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880c7be0 con 0x7fd58806aa70 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5877fe700 1 --2- 172.21.15.60:0/4030053690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806aa70 0x7fd5880cc630 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd58806d2e0 tx=0x7fd578009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0274dd12831c701 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.548+0000 7fd5867fc700 1 -- 172.21.15.60:0/4030053690 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800b860 con 0x7fd58806aa70 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd5867fc700 1 -- 172.21.15.60:0/4030053690 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800b9c0 con 0x7fd58806aa70 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd5867fc700 1 -- 172.21.15.60:0/4030053690 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800bd60 con 0x7fd58806aa70 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 -- 172.21.15.60:0/4030053690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806aa70 msgr2=0x7fd5880cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/4030053690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806aa70 0x7fd5880cc630 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd58806d2e0 tx=0x7fd578009250 comp rx=0 tx=0).stop 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 -- 172.21.15.60:0/4030053690 shutdown_connections 2023-10-08T16:08:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/4030053690 >> v2:172.21.15.144:3300/0 conn(0x7fd5880ab0e0 0x7fd5880ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/4030053690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806aa70 0x7fd5880cc630 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 -- 172.21.15.60:0/4030053690 >> 172.21.15.60:0/4030053690 conn(0x7fd5880cd070 msgr2=0x7fd5880cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 -- 172.21.15.60:0/4030053690 shutdown_connections 2023-10-08T16:08:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.549+0000 7fd58cdd2700 1 -- 172.21.15.60:0/4030053690 wait complete. 2023-10-08T16:08:49.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.550+0000 7fd58cdd2700 1 Processor -- start 2023-10-08T16:08:49.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.550+0000 7fd58cdd2700 1 -- start start 2023-10-08T16:08:49.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd58cdd2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58806aa70 0x7fd588153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd58cdd2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 0x7fd5880b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd58cdd2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5880ab0e0 0x7fd58815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd58cdd2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588153560 con 0x7fd58806ae40 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd58cdd2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880b0ed0 con 0x7fd5880ab0e0 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd58cdd2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880b11b0 con 0x7fd58806aa70 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd586ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 0x7fd5880b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd586ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 0x7fd5880b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56158/0 (socket says 172.21.15.60:56158) 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd586ffd700 1 -- 172.21.15.60:0/1254289397 learned_addr learned my addr 172.21.15.60:0/1254289397 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd5877fe700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58806aa70 0x7fd588153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd587fff700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5880ab0e0 0x7fd58815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd586ffd700 1 -- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58806aa70 msgr2=0x7fd588153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.551+0000 7fd586ffd700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58806aa70 0x7fd588153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd586ffd700 1 -- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5880ab0e0 msgr2=0x7fd58815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd586ffd700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5880ab0e0 0x7fd58815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd586ffd700 1 -- 172.21.15.60:0/1254289397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780094f0 con 0x7fd58806ae40 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd5877fe700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58806aa70 0x7fd588153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd586ffd700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 0x7fd5880b1f70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c590 tx=0x7fd57c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c011590 con 0x7fd58806ae40 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c0116f0 con 0x7fd58806ae40 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5880b1490 con 0x7fd58806ae40 2023-10-08T16:08:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c011ab0 con 0x7fd58806ae40 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.552+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5880b1a50 con 0x7fd58806ae40 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.553+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58806c790 con 0x7fd58806ae40 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.553+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd57c01b3b0 con 0x7fd58806ae40 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.554+0000 7fd56f7fe700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd574066f30 0x7fd5740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.554+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd57c0837e0 con 0x7fd58806ae40 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.554+0000 7fd5877fe700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd574066f30 0x7fd5740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.554+0000 7fd5877fe700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd574066f30 0x7fd5740693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd58806d2e0 tx=0x7fd578017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.558+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd57c050d50 con 0x7fd58806ae40 2023-10-08T16:08:49.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:49.832+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fd5880c7ec0 con 0x7fd58806ae40 2023-10-08T16:08:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.417+0000 7fd56f7fe700 1 -- 172.21.15.60:0/1254289397 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v203) v1 ==== 136+0+0 (secure 0 0 0) 0x7fd57c0170c0 con 0x7fd58806ae40 2023-10-08T16:08:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd574066f30 msgr2=0x7fd5740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd574066f30 0x7fd5740693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd58806d2e0 tx=0x7fd578017000 comp rx=0 tx=0).stop 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 msgr2=0x7fd5880b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 0x7fd5880b1f70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c590 tx=0x7fd57c00c950 comp rx=0 tx=0).stop 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 shutdown_connections 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd574066f30 0x7fd5740693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58806aa70 0x7fd588153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5880ab0e0 0x7fd58815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 --2- 172.21.15.60:0/1254289397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58806ae40 0x7fd5880b1f70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 >> 172.21.15.60:0/1254289397 conn(0x7fd5880cd070 msgr2=0x7fd5880aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 shutdown_connections 2023-10-08T16:08:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.419+0000 7fd58cdd2700 1 -- 172.21.15.60:0/1254289397 wait complete. 2023-10-08T16:08:50.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T16:08:50.569 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_objectstore":"memstore"} 2023-10-08T16:08:50.570 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T16:08:50.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:08:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.691+0000 7fe814d0c700 1 Processor -- start 2023-10-08T16:08:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.691+0000 7fe814d0c700 1 -- start start 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe814d0c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe81006aa00 0x7fe810164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe814d0c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8100b4d70 con 0x7fe8100b6580 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe814d0c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81015b3b0 con 0x7fe8100cce30 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe814d0c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8100cd8d0 con 0x7fe81006aa00 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe80effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe8100b6580 0x7fe81006a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52692/0 (socket says 172.21.15.60:52692) 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe80effd700 1 -- 172.21.15.60:0/58572223 learned_addr learned my addr 172.21.15.60:0/58572223 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe80ffff700 1 --2- 172.21.15.60:0/58572223 >> v2:172.21.15.144:3300/0 conn(0x7fe81006aa00 0x7fe810164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266349665 0 0) 0x7fe8100b4d70 con 0x7fe8100b6580 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.692+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f8003570 con 0x7fe8100b6580 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3149277222 0 0) 0x7fe7f8003570 con 0x7fe8100b6580 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 >> v2:172.21.15.144:3300/0 conn(0x7fe81006aa00 msgr2=0x7fe810164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 --2- 172.21.15.60:0/58572223 >> v2:172.21.15.144:3300/0 conn(0x7fe81006aa00 0x7fe810164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 >> v1:172.21.15.144:6789/0 conn(0x7fe8100cce30 legacy=0x7fe81015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100b4440 con 0x7fe8100b6580 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fe804001470 con 0x7fe8100b6580 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 >> v1:172.21.15.60:6789/0 conn(0x7fe8100b6580 legacy=0x7fe81006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe7f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7f8004810 0x7fe7f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7f80051c0 0x7fe7f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100cd8d0 con 0x7fe7f8003a60 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f800c160 con 0x7fe7f80051c0 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f800c320 con 0x7fe7f8004810 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe7f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80ffff700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7f80051c0 0x7fe7f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80effd700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7f8004810 0x7fe7f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 -- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7f8004810 msgr2=0x7fe7f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7f8004810 0x7fe7f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 -- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7f80051c0 msgr2=0x7fe7f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7f80051c0 0x7fe7f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 -- 172.21.15.60:0/58572223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8003570 con 0x7fe7f8003a60 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80ffff700 1 -- 172.21.15.60:0/58572223 reap_dead start 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80effd700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7f8004810 0x7fe7f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.693+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe7f8003e70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe8000018b0 tx=0x7fe800007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23da94ed379c5fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800012420 con 0x7fe7f8003a60 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8000125a0 con 0x7fe7f8003a60 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe80e7fc700 1 -- 172.21.15.60:0/58572223 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800012960 con 0x7fe7f8003a60 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 -- 172.21.15.60:0/58572223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 msgr2=0x7fe7f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe7f8003e70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe8000018b0 tx=0x7fe800007d30 comp rx=0 tx=0).stop 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 -- 172.21.15.60:0/58572223 shutdown_connections 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 --2- 172.21.15.60:0/58572223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe7f8003e70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 -- 172.21.15.60:0/58572223 >> 172.21.15.60:0/58572223 conn(0x7fe810068cb0 msgr2=0x7fe8100690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:50.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 -- 172.21.15.60:0/58572223 shutdown_connections 2023-10-08T16:08:50.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.694+0000 7fe814d0c700 1 -- 172.21.15.60:0/58572223 wait complete. 2023-10-08T16:08:50.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.695+0000 7fe814d0c700 1 Processor -- start 2023-10-08T16:08:50.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 -- start start 2023-10-08T16:08:50.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe8101449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe81014d6a0 0x7fe8100b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8100b1370 0x7fe81014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100b2440 con 0x7fe7f8003a60 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810144f00 con 0x7fe8100b1370 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe814d0c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100b1830 con 0x7fe81014d6a0 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe80f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe8101449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe80f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe8101449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56178/0 (socket says 172.21.15.60:56178) 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.696+0000 7fe80f7fe700 1 -- 172.21.15.60:0/1880210239 learned_addr learned my addr 172.21.15.60:0/1880210239 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80effd700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe81014d6a0 0x7fe8100b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80f7fe700 1 -- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe81014d6a0 msgr2=0x7fe8100b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe81014d6a0 0x7fe8100b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80ffff700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8100b1370 0x7fe81014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80f7fe700 1 -- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8100b1370 msgr2=0x7fe81014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8100b1370 0x7fe81014f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80f7fe700 1 -- 172.21.15.60:0/1880210239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100b1b10 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe80f7fe700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe8101449c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c3f0 tx=0x7fe800015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000c780 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000c8e0 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8100b1df0 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000cc80 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.697+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8100b28d0 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.698+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8100b2720 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.699+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe800032480 con 0x7fe7f8003a60 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.699+0000 7fe7f77fe700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe7fc066f30 0x7fe7fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.700+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe800085e50 con 0x7fe7f8003a60 2023-10-08T16:08:50.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.700+0000 7fe80effd700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe7fc066f30 0x7fe7fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.700+0000 7fe80effd700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe7fc066f30 0x7fe7fc0693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe804001200 tx=0x7fe804005e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:50.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.703+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe800053440 con 0x7fe7f8003a60 2023-10-08T16:08:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.895+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe8100b4720 con 0x7fe7f8003a60 2023-10-08T16:08:50.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.899+0000 7fe7f77fe700 1 -- 172.21.15.60:0/1880210239 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe8000170c0 con 0x7fe7f8003a60 2023-10-08T16:08:50.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe7fc066f30 msgr2=0x7fe7fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe7fc066f30 0x7fe7fc0693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe804001200 tx=0x7fe804005e00 comp rx=0 tx=0).stop 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 msgr2=0x7fe8101449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe8101449c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c3f0 tx=0x7fe800015000 comp rx=0 tx=0).stop 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 shutdown_connections 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe7fc066f30 0x7fe7fc0693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8100b1370 0x7fe81014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f8003a60 0x7fe8101449c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 --2- 172.21.15.60:0/1880210239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe81014d6a0 0x7fe8100b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 >> 172.21.15.60:0/1880210239 conn(0x7fe810068cb0 msgr2=0x7fe810150710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 shutdown_connections 2023-10-08T16:08:50.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:50.901+0000 7fe814d0c700 1 -- 172.21.15.60:0/1880210239 wait complete. 2023-10-08T16:08:50.914 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:08:50.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:50.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:08:51.002 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:08:51.002 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:08:51.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:51.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 Processor -- start 2023-10-08T16:08:51.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 -- start start 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780d1c30 0x7fa9780ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 0x7fa9780cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780c5d80 con 0x7fa97815a2b0 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa978068470 con 0x7fa97815a680 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.120+0000 7fa97ee9f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c6060 con 0x7fa9780d1c30 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa97d43c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 0x7fa9780cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa977fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780d1c30 0x7fa9780ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa97cc3b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa97815a2b0 0x7fa9780b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37208/0 (socket says 172.21.15.60:37208) 2023-10-08T16:08:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa97d43c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 0x7fa9780cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37766/0 (socket says 172.21.15.60:37766) 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa97cc3b700 1 -- 172.21.15.60:0/1752052371 learned_addr learned my addr 172.21.15.60:0/1752052371 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa977fff700 1 -- 172.21.15.60:0/1752052371 >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 msgr2=0x7fa9780cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa977fff700 1 --2- 172.21.15.60:0/1752052371 >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 0x7fa9780cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa977fff700 1 -- 172.21.15.60:0/1752052371 >> v1:172.21.15.144:6789/0 conn(0x7fa97815a2b0 legacy=0x7fa9780b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa977fff700 1 -- 172.21.15.60:0/1752052371 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780c6340 con 0x7fa9780d1c30 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa97d43c700 1 --2- 172.21.15.60:0/1752052371 >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 0x7fa9780cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.121+0000 7fa977fff700 1 --2- 172.21.15.60:0/1752052371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780d1c30 0x7fa9780ccdd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa968009e60 tx=0x7fa968009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c6c44af7e7d81d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa9777fe700 1 -- 172.21.15.60:0/1752052371 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800e070 con 0x7fa9780d1c30 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa9777fe700 1 -- 172.21.15.60:0/1752052371 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800bb60 con 0x7fa9780d1c30 2023-10-08T16:08:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa9777fe700 1 -- 172.21.15.60:0/1752052371 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968012430 con 0x7fa9780d1c30 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 -- 172.21.15.60:0/1752052371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780d1c30 msgr2=0x7fa9780ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/1752052371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780d1c30 0x7fa9780ccdd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa968009e60 tx=0x7fa968009780 comp rx=0 tx=0).stop 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 -- 172.21.15.60:0/1752052371 shutdown_connections 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/1752052371 >> v2:172.21.15.144:3300/0 conn(0x7fa97815a680 0x7fa9780cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/1752052371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780d1c30 0x7fa9780ccdd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 -- 172.21.15.60:0/1752052371 >> 172.21.15.60:0/1752052371 conn(0x7fa978067e40 msgr2=0x7fa9780d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 -- 172.21.15.60:0/1752052371 shutdown_connections 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.122+0000 7fa97ee9f700 1 -- 172.21.15.60:0/1752052371 wait complete. 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.123+0000 7fa97ee9f700 1 Processor -- start 2023-10-08T16:08:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 -- start start 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 0x7fa97814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa97815a2b0 0x7fa97815e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa97815a680 0x7fa97815e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97814b040 con 0x7fa9780d1c30 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c9580 con 0x7fa97815a2b0 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97ee9f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c8970 con 0x7fa97815a680 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97cc3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 0x7fa97814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97cc3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 0x7fa97814ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56194/0 (socket says 172.21.15.60:56194) 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.124+0000 7fa97cc3b700 1 -- 172.21.15.60:0/3519019994 learned_addr learned my addr 172.21.15.60:0/3519019994 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa977fff700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa97815a2b0 0x7fa97815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97d43c700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa97815a680 0x7fa97815e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97cc3b700 1 -- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa97815a680 msgr2=0x7fa97815e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97cc3b700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa97815a680 0x7fa97815e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97cc3b700 1 -- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa97815a2b0 msgr2=0x7fa97815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97cc3b700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa97815a2b0 0x7fa97815e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97cc3b700 1 -- 172.21.15.60:0/3519019994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009420 con 0x7fa9780d1c30 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97cc3b700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 0x7fa97814ab00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c590 tx=0x7fa960001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960005b80 con 0x7fa9780d1c30 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005ce0 con 0x7fa9780d1c30 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968009a20 con 0x7fa9780d1c30 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960004ad0 con 0x7fa9780d1c30 2023-10-08T16:08:51.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.125+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780c8f30 con 0x7fa9780d1c30 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.126+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97804c3c0 con 0x7fa9780d1c30 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.127+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9600070d0 con 0x7fa9780d1c30 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.127+0000 7fa974ff9700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa958066f30 0x7fa9580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.127+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa9600835f0 con 0x7fa9780d1c30 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.127+0000 7fa977fff700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa958066f30 0x7fa9580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.127+0000 7fa977fff700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa958066f30 0x7fa9580693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9780d2000 tx=0x7fa968019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.131+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa96004b5a0 con 0x7fa9780d1c30 2023-10-08T16:08:51.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.369+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa978064a00 con 0x7fa9780d1c30 2023-10-08T16:08:51.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.369+0000 7fa974ff9700 1 -- 172.21.15.60:0/3519019994 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fa960050b60 con 0x7fa9780d1c30 2023-10-08T16:08:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:51.371 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5111,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1729891177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1729891177},{"type":"v1","addr":"172.21.15.144:6834","nonce":1729891177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2433182580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2433182580},{"type":"v1","addr":"172.21.15.144:6835","nonce":2433182580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1327575334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1327575334},{"type":"v1","addr":"172.21.15.60:6836","nonce":1327575334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5985,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1291220898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1291220898},{"type":"v1","addr":"172.21.15.60:6837","nonce":1291220898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-10-08T16:08:51.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa958066f30 msgr2=0x7fa9580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa958066f30 0x7fa9580693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9780d2000 tx=0x7fa968019000 comp rx=0 tx=0).stop 2023-10-08T16:08:51.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 msgr2=0x7fa97814ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 0x7fa97814ab00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c590 tx=0x7fa960001070 comp rx=0 tx=0).stop 2023-10-08T16:08:51.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 shutdown_connections 2023-10-08T16:08:51.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa958066f30 0x7fa9580693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa97815a680 0x7fa97815e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9780d1c30 0x7fa97814ab00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 --2- 172.21.15.60:0/3519019994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa97815a2b0 0x7fa97815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.371+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 >> 172.21.15.60:0/3519019994 conn(0x7fa978067e40 msgr2=0x7fa978069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.372+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 shutdown_connections 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.372+0000 7fa97ee9f700 1 -- 172.21.15.60:0/3519019994 wait complete. 2023-10-08T16:08:51.374 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 36 2023-10-08T16:08:51.385 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:08:51.385 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:08:51.386 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:08:51.386 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:51.386 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:08:51.386 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:08:51.386 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:08:51.386 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:51.387 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:08:51.387 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:08:51.387 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:08:51.387 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:51.389 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:08:51.389 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:08:51.389 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:08:51.389 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:08:51.394 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:08:51.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:08:51.396 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:08:51.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:08:51.397 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:08:51.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:08:51.398 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:08:51.399 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:08:51.437 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:08:51.438 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:51.438 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:08:51.438 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:51.441 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:08:51.441 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:51.442 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:08:51.442 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:51.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:08:51.513 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:08:51.514 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:08:51.520 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:08:51.520 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:08:51.520 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-10-08T16:08:51.520+0000 7fb66ddb6700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T16:08:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.567+0000 7fd6a06e8700 1 Processor -- start 2023-10-08T16:08:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.567+0000 7fd6a06e8700 1 -- start start 2023-10-08T16:08:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.568+0000 7fd6a06e8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6980b1220 0x7fd6980c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.568+0000 7fd6a06e8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69815de60 con 0x7fd6980cb4f0 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.568+0000 7fd6a06e8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69815e140 con 0x7fd6980b0e50 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.568+0000 7fd6a06e8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69815e420 con 0x7fd6980b1220 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.568+0000 7fd69ec85700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd6980cb4f0 0x7fd6980679d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52712/0 (socket says 172.21.15.60:52712) 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.568+0000 7fd69ec85700 1 -- 172.21.15.60:0/1186971338 learned_addr learned my addr 172.21.15.60:0/1186971338 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69dc83700 1 --2- 172.21.15.60:0/1186971338 >> v2:172.21.15.144:3300/0 conn(0x7fd6980b1220 0x7fd6980c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69d482700 1 -- 172.21.15.60:0/1186971338 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051291234 0 0) 0x7fd69815de60 con 0x7fd6980cb4f0 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69d482700 1 -- 172.21.15.60:0/1186971338 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd684003570 con 0x7fd6980cb4f0 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69dc83700 1 -- 172.21.15.60:0/1186971338 >> v1:172.21.15.144:6789/0 conn(0x7fd6980b0e50 legacy=0x7fd69806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69dc83700 1 -- 172.21.15.60:0/1186971338 >> v1:172.21.15.60:6789/0 conn(0x7fd6980cb4f0 legacy=0x7fd6980679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69dc83700 1 -- 172.21.15.60:0/1186971338 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69815e700 con 0x7fd6980b1220 2023-10-08T16:08:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69dc83700 1 --2- 172.21.15.60:0/1186971338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd6980c9180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd6940098e0 tx=0x7fd6940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ab0feb2499354c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69d482700 1 -- 172.21.15.60:0/1186971338 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400b640 con 0x7fd6980b1220 2023-10-08T16:08:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69d482700 1 -- 172.21.15.60:0/1186971338 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400b7a0 con 0x7fd6980b1220 2023-10-08T16:08:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.569+0000 7fd69d482700 1 -- 172.21.15.60:0/1186971338 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400bb40 con 0x7fd6980b1220 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1186971338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 msgr2=0x7fd6980c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1186971338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd6980c9180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd6940098e0 tx=0x7fd6940091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1186971338 shutdown_connections 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1186971338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd6980c9180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1186971338 >> 172.21.15.60:0/1186971338 conn(0x7fd698069870 msgr2=0x7fd698069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1186971338 shutdown_connections 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.570+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1186971338 wait complete. 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.571+0000 7fd6a06e8700 1 Processor -- start 2023-10-08T16:08:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.571+0000 7fd6a06e8700 1 -- start start 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd6a06e8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6980b0e50 0x7fd6980b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd6a06e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd69816e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd6a06e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 0x7fd69816b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd6a06e8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69816a700 con 0x7fd6980cb4f0 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd6a06e8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69816ec30 con 0x7fd6980b1220 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd6a06e8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980b4710 con 0x7fd6980b0e50 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 0x7fd69816b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 0x7fd69816b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56224/0 (socket says 172.21.15.60:56224) 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 -- 172.21.15.60:0/1567032707 learned_addr learned my addr 172.21.15.60:0/1567032707 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69dc83700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd69816e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69e484700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6980b0e50 0x7fd6980b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 -- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6980b0e50 msgr2=0x7fd6980b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6980b0e50 0x7fd6980b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 -- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 msgr2=0x7fd69816e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd69816e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 -- 172.21.15.60:0/1567032707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694009420 con 0x7fd6980cb4f0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd69ec85700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 0x7fd69816b0f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd690001460 tx=0x7fd690001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000a870 con 0x7fd6980cb4f0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.572+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000a9d0 con 0x7fd6980cb4f0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.573+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6980b4150 con 0x7fd6980cb4f0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.573+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000ad50 con 0x7fd6980cb4f0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.573+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69816a8f0 con 0x7fd6980cb4f0 2023-10-08T16:08:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.574+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69804c3c0 con 0x7fd6980cb4f0 2023-10-08T16:08:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.574+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd690007300 con 0x7fd6980cb4f0 2023-10-08T16:08:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.574+0000 7fd68e7fc700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd67c066f30 0x7fd67c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.574+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd690084560 con 0x7fd6980cb4f0 2023-10-08T16:08:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.574+0000 7fd69e484700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd67c066f30 0x7fd67c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.575+0000 7fd69e484700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd67c066f30 0x7fd67c0693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd688003a80 tx=0x7fd688007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.579+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd690051ac0 con 0x7fd6980cb4f0 2023-10-08T16:08:51.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:51.786+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd6980b0c30 con 0x7fd6980cb4f0 2023-10-08T16:08:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.426+0000 7fd68e7fc700 1 -- 172.21.15.60:0/1567032707 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd6900550e0 con 0x7fd6980cb4f0 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd67c066f30 msgr2=0x7fd67c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd67c066f30 0x7fd67c0693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd688003a80 tx=0x7fd688007ec0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 msgr2=0x7fd69816b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 0x7fd69816b0f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd690001460 tx=0x7fd690001a40 comp rx=0 tx=0).stop 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 shutdown_connections 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd67c066f30 0x7fd67c0693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6980b0e50 0x7fd6980b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6980cb4f0 0x7fd69816b0f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 --2- 172.21.15.60:0/1567032707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6980b1220 0x7fd69816e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 >> 172.21.15.60:0/1567032707 conn(0x7fd698069870 msgr2=0x7fd698151520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 shutdown_connections 2023-10-08T16:08:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.429+0000 7fd6a06e8700 1 -- 172.21.15.60:0/1567032707 wait complete. 2023-10-08T16:08:52.432 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:08:52.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:08:52.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.566+0000 7f62d6534700 1 Processor -- start 2023-10-08T16:08:52.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.566+0000 7f62d6534700 1 -- start start 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d6534700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62d0157870 0x7f62d015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d6534700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015a620 0x7f62d015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d6534700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62d015d580 0x7f62d0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d6534700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d015cbb0 con 0x7f62d0157870 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d6534700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d015bfa0 con 0x7f62d015d580 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d6534700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d015c280 con 0x7f62d015a620 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62d0157870 0x7f62d015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62d0157870 0x7f62d015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46916/0 (socket says 172.21.15.60:46916) 2023-10-08T16:08:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 -- 172.21.15.60:0/144273707 learned_addr learned my addr 172.21.15.60:0/144273707 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d4ad1700 1 --2- 172.21.15.60:0/144273707 >> v2:172.21.15.144:3300/0 conn(0x7f62d015d580 0x7f62d0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cf7fe700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015a620 0x7f62d015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 -- 172.21.15.60:0/144273707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015a620 msgr2=0x7f62d015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015a620 0x7f62d015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 -- 172.21.15.60:0/144273707 >> v2:172.21.15.144:3300/0 conn(0x7f62d015d580 msgr2=0x7f62d0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 --2- 172.21.15.60:0/144273707 >> v2:172.21.15.144:3300/0 conn(0x7f62d015d580 0x7f62d0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 -- 172.21.15.60:0/144273707 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d015c560 con 0x7f62d0157870 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62d4ad1700 1 --2- 172.21.15.60:0/144273707 >> v2:172.21.15.144:3300/0 conn(0x7f62d015d580 0x7f62d0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cf7fe700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015a620 0x7f62d015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62cffff700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015b6a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62d00b03b0 tx=0x7f62c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef69964e3c8d0ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.567+0000 7f62ceffd700 1 -- 172.21.15.60:0/144273707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c400b860 con 0x7f62d0157870 2023-10-08T16:08:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62ceffd700 1 -- 172.21.15.60:0/144273707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c400b9c0 con 0x7f62d0157870 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62ceffd700 1 -- 172.21.15.60:0/144273707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c400bd60 con 0x7f62d0157870 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 -- 172.21.15.60:0/144273707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 msgr2=0x7f62d015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015b6a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62d00b03b0 tx=0x7f62c4009250 comp rx=0 tx=0).stop 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 -- 172.21.15.60:0/144273707 shutdown_connections 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 --2- 172.21.15.60:0/144273707 >> v2:172.21.15.144:3300/0 conn(0x7f62d015d580 0x7f62d0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015b6a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 --2- 172.21.15.60:0/144273707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015a620 0x7f62d015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 -- 172.21.15.60:0/144273707 >> 172.21.15.60:0/144273707 conn(0x7f62d0068ce0 msgr2=0x7f62d00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 -- 172.21.15.60:0/144273707 shutdown_connections 2023-10-08T16:08:52.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.568+0000 7f62d6534700 1 -- 172.21.15.60:0/144273707 wait complete. 2023-10-08T16:08:52.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.569+0000 7f62d6534700 1 Processor -- start 2023-10-08T16:08:52.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.569+0000 7f62d6534700 1 -- start start 2023-10-08T16:08:52.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62d6534700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62d6534700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62d015a620 0x7f62d016a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62d6534700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015d580 0x7f62d016aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62d6534700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00b0610 con 0x7f62d0157870 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62d6534700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00b08b0 con 0x7f62d015a620 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62d6534700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d015f1a0 con 0x7f62d015d580 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46924/0 (socket says 172.21.15.60:46924) 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62cffff700 1 -- 172.21.15.60:0/2900812702 learned_addr learned my addr 172.21.15.60:0/2900812702 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.570+0000 7f62cf7fe700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62d015a620 0x7f62d016a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62d4ad1700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015d580 0x7f62d016aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cffff700 1 -- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015d580 msgr2=0x7f62d016aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cffff700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015d580 0x7f62d016aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cffff700 1 -- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62d015a620 msgr2=0x7f62d016a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cffff700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62d015a620 0x7f62d016a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cffff700 1 -- 172.21.15.60:0/2900812702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40094f0 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cf7fe700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62d015a620 0x7f62d016a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62cffff700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015e870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f62d006b530 tx=0x7f62c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4024440 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c40245a0 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d015f480 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4024960 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.571+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d015edb0 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.572+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d004c3c0 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.572+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62c401a420 con 0x7f62d0157870 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.573+0000 7f62b7fff700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f62bc066f30 0x7f62bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.573+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f62c4086000 con 0x7f62d0157870 2023-10-08T16:08:52.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.573+0000 7f62cf7fe700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f62bc066f30 0x7f62bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.573+0000 7f62cf7fe700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f62bc066f30 0x7f62bc0693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f62d0157f20 tx=0x7f62c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:52.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.577+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62c40535c0 con 0x7f62d0157870 2023-10-08T16:08:52.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.845+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f62d015c840 con 0x7f62d0157870 2023-10-08T16:08:52.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.845+0000 7f62b7fff700 1 -- 172.21.15.60:0/2900812702 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f62c4056be0 con 0x7f62d0157870 2023-10-08T16:08:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:52.847 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:08:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:08:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.847 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:08:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:08:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:08:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:08:52.848 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:08:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:08:52.850 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.853 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:08:52.854 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:08:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:08:52.865 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f62bc066f30 msgr2=0x7f62bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f62bc066f30 0x7f62bc0693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f62d0157f20 tx=0x7f62c0008040 comp rx=0 tx=0).stop 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 msgr2=0x7f62d015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015e870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f62d006b530 tx=0x7f62c4017000 comp rx=0 tx=0).stop 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 shutdown_connections 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f62bc066f30 0x7f62bc0693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62d015d580 0x7f62d016aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62d0157870 0x7f62d015e870 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 --2- 172.21.15.60:0/2900812702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62d015a620 0x7f62d016a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 >> 172.21.15.60:0/2900812702 conn(0x7f62d0068ce0 msgr2=0x7f62d0159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 shutdown_connections 2023-10-08T16:08:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.847+0000 7f62d6534700 1 -- 172.21.15.60:0/2900812702 wait complete. 2023-10-08T16:08:52.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.989+0000 7f34fc165700 1 Processor -- start 2023-10-08T16:08:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.989+0000 7f34fc165700 1 -- start start 2023-10-08T16:08:52.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fc165700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34f4157870 0x7f34f415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fc165700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f415a620 0x7f34f415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fc165700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34f415d580 0x7f34f4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fc165700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f415cbb0 con 0x7f34f415d580 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fc165700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f415bfa0 con 0x7f34f4157870 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fc165700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f415c280 con 0x7f34f415a620 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fa702700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34f415d580 0x7f34f4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fa702700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34f415d580 0x7f34f4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46936/0 (socket says 172.21.15.60:46936) 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.990+0000 7f34fa702700 1 -- 172.21.15.60:0/2198521190 learned_addr learned my addr 172.21.15.60:0/2198521190 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f9f01700 1 --2- 172.21.15.60:0/2198521190 >> v2:172.21.15.144:3300/0 conn(0x7f34f4157870 0x7f34f415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f9700700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f415a620 0x7f34f415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34fa702700 1 -- 172.21.15.60:0/2198521190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f415a620 msgr2=0x7f34f415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34fa702700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f415a620 0x7f34f415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34fa702700 1 -- 172.21.15.60:0/2198521190 >> v2:172.21.15.144:3300/0 conn(0x7f34f4157870 msgr2=0x7f34f415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34fa702700 1 --2- 172.21.15.60:0/2198521190 >> v2:172.21.15.144:3300/0 conn(0x7f34f4157870 0x7f34f415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34fa702700 1 -- 172.21.15.60:0/2198521190 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f415c560 con 0x7f34f415d580 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f9f01700 1 --2- 172.21.15.60:0/2198521190 >> v2:172.21.15.144:3300/0 conn(0x7f34f4157870 0x7f34f415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f9700700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f415a620 0x7f34f415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34fa702700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415d580 0x7f34f4158110 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f34f4069d80 tx=0x7f34e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56fd80fede8100c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f8eff700 1 -- 172.21.15.60:0/2198521190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400e070 con 0x7f34f415d580 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f8eff700 1 -- 172.21.15.60:0/2198521190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e400ba50 con 0x7f34f415d580 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.991+0000 7f34f8eff700 1 -- 172.21.15.60:0/2198521190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40092e0 con 0x7f34f415d580 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 -- 172.21.15.60:0/2198521190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415d580 msgr2=0x7f34f4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415d580 0x7f34f4158110 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f34f4069d80 tx=0x7f34e4009840 comp rx=0 tx=0).stop 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 -- 172.21.15.60:0/2198521190 shutdown_connections 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415d580 0x7f34f4158110 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 --2- 172.21.15.60:0/2198521190 >> v2:172.21.15.144:3300/0 conn(0x7f34f4157870 0x7f34f415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 --2- 172.21.15.60:0/2198521190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f415a620 0x7f34f415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 -- 172.21.15.60:0/2198521190 >> 172.21.15.60:0/2198521190 conn(0x7f34f4068ce0 msgr2=0x7f34f40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 -- 172.21.15.60:0/2198521190 shutdown_connections 2023-10-08T16:08:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.992+0000 7f34fc165700 1 -- 172.21.15.60:0/2198521190 wait complete. 2023-10-08T16:08:52.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.993+0000 7f34fc165700 1 Processor -- start 2023-10-08T16:08:52.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.993+0000 7f34fc165700 1 -- start start 2023-10-08T16:08:52.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f4157870 0x7f34f414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 0x7f34f40b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f415d580 0x7f34f40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f416b800 con 0x7f34f415a620 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f414dee0 con 0x7f34f415d580 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f416b520 con 0x7f34f4157870 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 0x7f34f40b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 0x7f34f40b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46944/0 (socket says 172.21.15.60:46944) 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 -- 172.21.15.60:0/3840727338 learned_addr learned my addr 172.21.15.60:0/3840727338 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9f01700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f4157870 0x7f34f414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fa702700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f415d580 0x7f34f40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 -- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f4157870 msgr2=0x7f34f414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f4157870 0x7f34f414d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 -- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f415d580 msgr2=0x7f34f40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f415d580 0x7f34f40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 -- 172.21.15.60:0/3840727338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4009ae0 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f9700700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 0x7f34f40b06c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f34e8006fd0 tx=0x7f34e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8013410 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8013570 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f4157e70 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.994+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80138f0 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.995+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f4158430 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.995+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f404c3c0 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.996+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34e8013ca0 con 0x7f34f415a620 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.996+0000 7f34f1ffb700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34e0066f30 0x7f34e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.996+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f34e8083e50 con 0x7f34f415a620 2023-10-08T16:08:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.996+0000 7f34f9f01700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34e0066f30 0x7f34e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:52.997+0000 7f34f9f01700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34e0066f30 0x7f34e00693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006f00 tx=0x7f34ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.001+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34e8054ea0 con 0x7f34f415a620 2023-10-08T16:08:53.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.193+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34f415c840 con 0x7f34f415a620 2023-10-08T16:08:53.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.194+0000 7f34f1ffb700 1 -- 172.21.15.60:0/3840727338 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f34e8054a30 con 0x7f34f415a620 2023-10-08T16:08:53.195 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:53.195 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:08:52.432043+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34e0066f30 msgr2=0x7f34e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34e0066f30 0x7f34e00693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006f00 tx=0x7f34ec008040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 msgr2=0x7f34f40b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 0x7f34f40b06c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f34e8006fd0 tx=0x7f34e8008040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 shutdown_connections 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f34e0066f30 0x7f34e00693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34f4157870 0x7f34f414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34f415d580 0x7f34f40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 --2- 172.21.15.60:0/3840727338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34f415a620 0x7f34f40b06c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 >> 172.21.15.60:0/3840727338 conn(0x7f34f4068ce0 msgr2=0x7f34f40b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 shutdown_connections 2023-10-08T16:08:53.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.196+0000 7f34fc165700 1 -- 172.21.15.60:0/3840727338 wait complete. 2023-10-08T16:08:53.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:08:53.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:08:53.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.331+0000 7f0679586700 1 Processor -- start 2023-10-08T16:08:53.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.331+0000 7f0679586700 1 -- start start 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f0679586700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f067406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f0679586700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f067406aae0 0x7f06740cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f0679586700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06740b0790 con 0x7f0674159ec0 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f0679586700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067406af60 con 0x7f067406aae0 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f0679586700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06740ce1f0 con 0x7f067415a290 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f067406aae0 0x7f06740cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f067406aae0 0x7f06740cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46948/0 (socket says 172.21.15.60:46948) 2023-10-08T16:08:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 -- 172.21.15.60:0/532623051 learned_addr learned my addr 172.21.15.60:0/532623051 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06727fc700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f067406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 -- 172.21.15.60:0/532623051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 msgr2=0x7f067406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f067406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 -- 172.21.15.60:0/532623051 >> v1:172.21.15.144:6789/0 conn(0x7f0674159ec0 legacy=0x7f06740af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 -- 172.21.15.60:0/532623051 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740b0b20 con 0x7f067406aae0 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06727fc700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f067406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.332+0000 7f06737fe700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067406aae0 0x7f06740cf590 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0664009f20 tx=0x7f0664009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b218bed42a197 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0671ffb700 1 -- 172.21.15.60:0/532623051 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400e070 con 0x7f067406aae0 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0671ffb700 1 -- 172.21.15.60:0/532623051 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066400ba80 con 0x7f067406aae0 2023-10-08T16:08:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0671ffb700 1 -- 172.21.15.60:0/532623051 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640092e0 con 0x7f067406aae0 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 -- 172.21.15.60:0/532623051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067406aae0 msgr2=0x7f06740cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067406aae0 0x7f06740cf590 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0664009f20 tx=0x7f0664009840 comp rx=0 tx=0).stop 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 -- 172.21.15.60:0/532623051 shutdown_connections 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f067406aae0 0x7f06740cf590 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 --2- 172.21.15.60:0/532623051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f067406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 -- 172.21.15.60:0/532623051 >> 172.21.15.60:0/532623051 conn(0x7f06740d1880 msgr2=0x7f06740cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 -- 172.21.15.60:0/532623051 shutdown_connections 2023-10-08T16:08:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.333+0000 7f0679586700 1 -- 172.21.15.60:0/532623051 wait complete. 2023-10-08T16:08:53.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.334+0000 7f0679586700 1 Processor -- start 2023-10-08T16:08:53.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 -- start start 2023-10-08T16:08:53.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067406aae0 0x7f067415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f0674160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067415c300 con 0x7f0674159ec0 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067415bcf0 con 0x7f067406aae0 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f0679586700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067416a380 con 0x7f067415a290 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f06727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f06727fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46962/0 (socket says 172.21.15.60:46962) 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f06727fc700 1 -- 172.21.15.60:0/2655336529 learned_addr learned my addr 172.21.15.60:0/2655336529 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.335+0000 7f06737fe700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f0674160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f0672ffd700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067406aae0 0x7f067415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f06727fc700 1 -- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 msgr2=0x7f0674160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f06727fc700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f0674160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f06727fc700 1 -- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067406aae0 msgr2=0x7f067415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f06727fc700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067406aae0 0x7f067415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f06727fc700 1 -- 172.21.15.60:0/2655336529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664009ae0 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f0672ffd700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067406aae0 0x7f067415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f06727fc700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674155830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f065c00d860 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c0125f0 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c012750 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067415b730 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c012af0 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.336+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067415bf90 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.337+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067404c3c0 con 0x7f0674159ec0 2023-10-08T16:08:53.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.337+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f065c014430 con 0x7f0674159ec0 2023-10-08T16:08:53.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.338+0000 7f066affd700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0654066f30 0x7f06540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.338+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f065c084650 con 0x7f0674159ec0 2023-10-08T16:08:53.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.338+0000 7f0672ffd700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0654066f30 0x7f06540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.338+0000 7f0672ffd700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0654066f30 0x7f06540693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f066c007fd0 tx=0x7f066c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.342+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f065c051b70 con 0x7f0674159ec0 2023-10-08T16:08:53.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.539+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f067415c440 con 0x7f0674159ec0 2023-10-08T16:08:53.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.539+0000 7f066affd700 1 -- 172.21.15.60:0/2655336529 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f065c055190 con 0x7f0674159ec0 2023-10-08T16:08:53.541 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0654066f30 msgr2=0x7f06540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0654066f30 0x7f06540693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f066c007fd0 tx=0x7f066c009040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 msgr2=0x7f0674155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674155830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f065c00d860 tx=0x7f065c008040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 shutdown_connections 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0654066f30 0x7f06540693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f067415a290 0x7f0674160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067406aae0 0x7f067415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 --2- 172.21.15.60:0/2655336529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0674159ec0 0x7f0674155830 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 >> 172.21.15.60:0/2655336529 conn(0x7f06740d1880 msgr2=0x7f06740c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 shutdown_connections 2023-10-08T16:08:53.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.541+0000 7f0679586700 1 -- 172.21.15.60:0/2655336529 wait complete. 2023-10-08T16:08:53.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:08:53.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.672+0000 7fe5c63c9700 1 Processor -- start 2023-10-08T16:08:53.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.672+0000 7fe5c63c9700 1 -- start start 2023-10-08T16:08:53.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5c63c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5c00d1c30 0x7fe5c00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5c63c9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c015a680 0x7fe5c00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5c63c9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c00c5d80 con 0x7fe5c015a2b0 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5c63c9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c0068470 con 0x7fe5c00d1c30 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5c63c9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00c6060 con 0x7fe5c015a680 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5c00d1c30 0x7fe5c00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe5c015a2b0 0x7fe5c00b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50812/0 (socket says 172.21.15.60:50812) 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bffff700 1 -- 172.21.15.60:0/370696010 learned_addr learned my addr 172.21.15.60:0/370696010 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:53.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5c4966700 1 --2- 172.21.15.60:0/370696010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c015a680 0x7fe5c00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bf7fe700 1 -- 172.21.15.60:0/370696010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c015a680 msgr2=0x7fe5c00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bf7fe700 1 --2- 172.21.15.60:0/370696010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c015a680 0x7fe5c00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bf7fe700 1 -- 172.21.15.60:0/370696010 >> v1:172.21.15.60:6789/0 conn(0x7fe5c015a2b0 legacy=0x7fe5c00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5beffd700 1 -- 172.21.15.60:0/370696010 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521784066 0 0) 0x7fe5c00c5d80 con 0x7fe5c015a2b0 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bf7fe700 1 -- 172.21.15.60:0/370696010 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c00c6340 con 0x7fe5c00d1c30 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.673+0000 7fe5bf7fe700 1 --2- 172.21.15.60:0/370696010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c00d1c30 0x7fe5c00ccdd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00098e0 tx=0x7fe5b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4a91b2e21d656c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5beffd700 1 -- 172.21.15.60:0/370696010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0009e80 con 0x7fe5c00d1c30 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5beffd700 1 -- 172.21.15.60:0/370696010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000b860 con 0x7fe5c00d1c30 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5beffd700 1 -- 172.21.15.60:0/370696010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000bbe0 con 0x7fe5c00d1c30 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 -- 172.21.15.60:0/370696010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c00d1c30 msgr2=0x7fe5c00ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/370696010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c00d1c30 0x7fe5c00ccdd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00098e0 tx=0x7fe5b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 -- 172.21.15.60:0/370696010 shutdown_connections 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/370696010 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c015a680 0x7fe5c00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/370696010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c00d1c30 0x7fe5c00ccdd0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 -- 172.21.15.60:0/370696010 >> 172.21.15.60:0/370696010 conn(0x7fe5c0067e40 msgr2=0x7fe5c00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 -- 172.21.15.60:0/370696010 shutdown_connections 2023-10-08T16:08:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.674+0000 7fe5c63c9700 1 -- 172.21.15.60:0/370696010 wait complete. 2023-10-08T16:08:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.675+0000 7fe5c63c9700 1 Processor -- start 2023-10-08T16:08:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.675+0000 7fe5c63c9700 1 -- start start 2023-10-08T16:08:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c63c9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c00d1c30 0x7fe5c0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c63c9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c015a2b0 0x7fe5c015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c63c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 0x7fe5c00b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c63c9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00c94c0 con 0x7fe5c015a680 2023-10-08T16:08:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c63c9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0156100 con 0x7fe5c015a2b0 2023-10-08T16:08:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c63c9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c015ee20 con 0x7fe5c00d1c30 2023-10-08T16:08:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c4966700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 0x7fe5c00b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c4966700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 0x7fe5c00b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46982/0 (socket says 172.21.15.60:46982) 2023-10-08T16:08:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5c4966700 1 -- 172.21.15.60:0/3781299338 learned_addr learned my addr 172.21.15.60:0/3781299338 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:53.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.676+0000 7fe5bffff700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c00d1c30 0x7fe5c0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c4966700 1 -- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c00d1c30 msgr2=0x7fe5c0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5bf7fe700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c015a2b0 0x7fe5c015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c4966700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c00d1c30 0x7fe5c0155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c4966700 1 -- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c015a2b0 msgr2=0x7fe5c015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c4966700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c015a2b0 0x7fe5c015e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c4966700 1 -- 172.21.15.60:0/3781299338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009420 con 0x7fe5c015a680 2023-10-08T16:08:53.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c4966700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 0x7fe5c00b4d50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8007f50 tx=0x7fe5b8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800ecd0 con 0x7fe5c015a680 2023-10-08T16:08:53.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800ee50 con 0x7fe5c015a680 2023-10-08T16:08:53.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c015f100 con 0x7fe5c015a680 2023-10-08T16:08:53.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8014670 con 0x7fe5c015a680 2023-10-08T16:08:53.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.677+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c00c9150 con 0x7fe5c015a680 2023-10-08T16:08:53.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.678+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c00c9670 con 0x7fe5c015a680 2023-10-08T16:08:53.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.678+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5b80149e0 con 0x7fe5c015a680 2023-10-08T16:08:53.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.679+0000 7fe5b7fff700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe5a0066f60 0x7fe5a0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.679+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe5b8084850 con 0x7fe5c015a680 2023-10-08T16:08:53.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.679+0000 7fe5bffff700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe5a0066f60 0x7fe5a0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.679+0000 7fe5bffff700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe5a0066f60 0x7fe5a0069410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8001730 tx=0x7fe5a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:53.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.683+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5b8051e10 con 0x7fe5c015a680 2023-10-08T16:08:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.876+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5c004c3c0 con 0x7fe5c015a680 2023-10-08T16:08:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.876+0000 7fe5b7fff700 1 -- 172.21.15.60:0/3781299338 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe5b8055430 con 0x7fe5c015a680 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:08:53.878 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:08:53.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe5a0066f60 msgr2=0x7fe5a0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe5a0066f60 0x7fe5a0069410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8001730 tx=0x7fe5a8009040 comp rx=0 tx=0).stop 2023-10-08T16:08:53.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 msgr2=0x7fe5c00b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 0x7fe5c00b4d50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8007f50 tx=0x7fe5b8009860 comp rx=0 tx=0).stop 2023-10-08T16:08:53.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 shutdown_connections 2023-10-08T16:08:53.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe5a0066f60 0x7fe5a0069410 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5c00d1c30 0x7fe5c0155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5c015a680 0x7fe5c00b4d50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 --2- 172.21.15.60:0/3781299338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c015a2b0 0x7fe5c015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 >> 172.21.15.60:0/3781299338 conn(0x7fe5c0067e40 msgr2=0x7fe5c0158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:53.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 shutdown_connections 2023-10-08T16:08:53.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:53.878+0000 7fe5c63c9700 1 -- 172.21.15.60:0/3781299338 wait complete. 2023-10-08T16:08:53.892 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:08:53.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:08:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.014+0000 7f96e6786700 1 Processor -- start 2023-10-08T16:08:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.014+0000 7f96e6786700 1 -- start start 2023-10-08T16:08:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96e6786700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96e0157960 0x7f96e015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96e6786700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00cfda0 con 0x7f96e00cd7d0 2023-10-08T16:08:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96e6786700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00ce050 con 0x7f96e006a5c0 2023-10-08T16:08:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96e6786700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00d0940 con 0x7f96e0157960 2023-10-08T16:08:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96df7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f96e00cd7d0 0x7f96e00d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50816/0 (socket says 172.21.15.60:50816) 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96df7fe700 1 -- 172.21.15.60:0/2336490568 learned_addr learned my addr 172.21.15.60:0/2336490568 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96dffff700 1 --2- 172.21.15.60:0/2336490568 >> v2:172.21.15.144:3300/0 conn(0x7f96e0157960 0x7f96e015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304069021 0 0) 0x7f96e00cfda0 con 0x7f96e00cd7d0 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96c8003570 con 0x7f96e00cd7d0 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943120367 0 0) 0x7f96c8003570 con 0x7f96e00cd7d0 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 >> v2:172.21.15.144:3300/0 conn(0x7f96e0157960 msgr2=0x7f96e015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 --2- 172.21.15.60:0/2336490568 >> v2:172.21.15.144:3300/0 conn(0x7f96e0157960 0x7f96e015ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 >> v1:172.21.15.144:6789/0 conn(0x7f96e006a5c0 legacy=0x7f96e015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00cf4b0 con 0x7f96e00cd7d0 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f96d4001470 con 0x7f96e00cd7d0 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 >> v1:172.21.15.60:6789/0 conn(0x7f96e00cd7d0 legacy=0x7f96e00d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.015+0000 7f96deffd700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c8003a60 0x7f96c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c8004810 0x7f96c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c80051c0 0x7f96c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00d0940 con 0x7f96c8003a60 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c800c0d0 con 0x7f96c8004810 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c800c290 con 0x7f96c80051c0 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c8003a60 0x7f96c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96df7fe700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c8004810 0x7f96c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96e4d23700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c80051c0 0x7f96c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 -- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c80051c0 msgr2=0x7f96c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c80051c0 0x7f96c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 -- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c8004810 msgr2=0x7f96c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c8004810 0x7f96c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 -- 172.21.15.60:0/2336490568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8003570 con 0x7f96c8003a60 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96df7fe700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96c8004810 0x7f96c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96e4d23700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c80051c0 0x7f96c800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96e4d23700 1 -- 172.21.15.60:0/2336490568 reap_dead start 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96dffff700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c8003a60 0x7f96c8003e70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009c00 tx=0x7f96d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7c5344ba8d745a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000e710 con 0x7f96c8003a60 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000e870 con 0x7f96c8003a60 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.016+0000 7f96deffd700 1 -- 172.21.15.60:0/2336490568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000ec30 con 0x7f96c8003a60 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 -- 172.21.15.60:0/2336490568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c8003a60 msgr2=0x7f96c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c8003a60 0x7f96c8003e70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009c00 tx=0x7f96d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 -- 172.21.15.60:0/2336490568 shutdown_connections 2023-10-08T16:08:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 --2- 172.21.15.60:0/2336490568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c8003a60 0x7f96c8003e70 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 -- 172.21.15.60:0/2336490568 >> 172.21.15.60:0/2336490568 conn(0x7f96e00d18a0 msgr2=0x7f96e00b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 -- 172.21.15.60:0/2336490568 shutdown_connections 2023-10-08T16:08:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.017+0000 7f96e6786700 1 -- 172.21.15.60:0/2336490568 wait complete. 2023-10-08T16:08:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.018+0000 7f96e6786700 1 Processor -- start 2023-10-08T16:08:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.018+0000 7f96e6786700 1 -- start start 2023-10-08T16:08:54.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e6786700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c8003a60 0x7f96e016e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e6786700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 0x7f96e0171ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e6786700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e006c0e0 0x7f96e01721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e6786700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0171850 con 0x7f96e006bc70 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e6786700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e006cd50 con 0x7f96e006c0e0 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e6786700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e016e730 con 0x7f96c8003a60 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 0x7f96e0171ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 0x7f96e0171ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46994/0 (socket says 172.21.15.60:46994) 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 -- 172.21.15.60:0/2373434068 learned_addr learned my addr 172.21.15.60:0/2373434068 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e4d23700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e006c0e0 0x7f96e01721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96dffff700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c8003a60 0x7f96e016e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 -- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c8003a60 msgr2=0x7f96e016e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c8003a60 0x7f96e016e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 -- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e006c0e0 msgr2=0x7f96e01721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e006c0e0 0x7f96e01721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 -- 172.21.15.60:0/2373434068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e016ea10 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96e4d23700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e006c0e0 0x7f96e01721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96dffff700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c8003a60 0x7f96e016e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.019+0000 7f96df7fe700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 0x7f96e0171ca0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f96d400eb90 tx=0x7f96e015a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.020+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400c7e0 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.020+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d400c940 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.020+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e016ecf0 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.020+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400cce0 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.020+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e015fc90 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.021+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e004c3c0 con 0x7f96e006bc70 2023-10-08T16:08:54.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.021+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96d4013630 con 0x7f96e006bc70 2023-10-08T16:08:54.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.021+0000 7f96c7fff700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96cc066f30 0x7f96cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.022+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f96d40842f0 con 0x7f96e006bc70 2023-10-08T16:08:54.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.022+0000 7f96dffff700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96cc066f30 0x7f96cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.022+0000 7f96dffff700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96cc066f30 0x7f96cc0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f96d00091e0 tx=0x7f96d001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:54.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.026+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96d4051810 con 0x7f96e006bc70 2023-10-08T16:08:54.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.219+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f96e00cdd70 con 0x7f96e006bc70 2023-10-08T16:08:54.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.430+0000 7f96c7fff700 1 -- 172.21.15.60:0/2373434068 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7f96d4054e30 con 0x7f96e006bc70 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96cc066f30 msgr2=0x7f96cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96cc066f30 0x7f96cc0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f96d00091e0 tx=0x7f96d001a000 comp rx=0 tx=0).stop 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 msgr2=0x7f96e0171ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 0x7f96e0171ca0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f96d400eb90 tx=0x7f96e015a3e0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 shutdown_connections 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96cc066f30 0x7f96cc0693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96c8003a60 0x7f96e016e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e006c0e0 0x7f96e01721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 --2- 172.21.15.60:0/2373434068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e006bc70 0x7f96e0171ca0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.433+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 >> 172.21.15.60:0/2373434068 conn(0x7f96e00d18a0 msgr2=0x7f96e00b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:54.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.434+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 shutdown_connections 2023-10-08T16:08:54.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.434+0000 7f96e6786700 1 -- 172.21.15.60:0/2373434068 wait complete. 2023-10-08T16:08:54.436 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:08:54.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:08:54.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.571+0000 7fa3469a5700 1 Processor -- start 2023-10-08T16:08:54.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.571+0000 7fa3469a5700 1 -- start start 2023-10-08T16:08:54.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa3469a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015a190 0x7fa3400cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa3469a5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa3400cd8f0 0x7fa34006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa3469a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3400cdd60 0x7fa34006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa3469a5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400b3d40 con 0x7fa3400cdd60 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa3469a5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400b42c0 con 0x7fa3400cd8f0 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa3469a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34015a560 con 0x7fa34015a190 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa344f42700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3400cdd60 0x7fa34006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa344f42700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3400cdd60 0x7fa34006abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47010/0 (socket says 172.21.15.60:47010) 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa344f42700 1 -- 172.21.15.60:0/851893332 learned_addr learned my addr 172.21.15.60:0/851893332 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.572+0000 7fa33f7fe700 1 --2- 172.21.15.60:0/851893332 >> v2:172.21.15.144:3300/0 conn(0x7fa3400cd8f0 0x7fa34006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa33ffff700 1 --2- 172.21.15.60:0/851893332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015a190 0x7fa3400cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa344f42700 1 -- 172.21.15.60:0/851893332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015a190 msgr2=0x7fa3400cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa344f42700 1 --2- 172.21.15.60:0/851893332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015a190 0x7fa3400cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa344f42700 1 -- 172.21.15.60:0/851893332 >> v2:172.21.15.144:3300/0 conn(0x7fa3400cd8f0 msgr2=0x7fa34006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa344f42700 1 --2- 172.21.15.60:0/851893332 >> v2:172.21.15.144:3300/0 conn(0x7fa3400cd8f0 0x7fa34006a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa344f42700 1 -- 172.21.15.60:0/851893332 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400d04b0 con 0x7fa3400cdd60 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa344f42700 1 --2- 172.21.15.60:0/851893332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3400cdd60 0x7fa34006abe0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa340089d20 tx=0x7fa338009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb8a15045eb8705 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa33effd700 1 -- 172.21.15.60:0/851893332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800e070 con 0x7fa3400cdd60 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa33effd700 1 -- 172.21.15.60:0/851893332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33800b970 con 0x7fa3400cdd60 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.573+0000 7fa33effd700 1 -- 172.21.15.60:0/851893332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3380092e0 con 0x7fa3400cdd60 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 -- 172.21.15.60:0/851893332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3400cdd60 msgr2=0x7fa34006abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 --2- 172.21.15.60:0/851893332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3400cdd60 0x7fa34006abe0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa340089d20 tx=0x7fa338009840 comp rx=0 tx=0).stop 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 -- 172.21.15.60:0/851893332 shutdown_connections 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 --2- 172.21.15.60:0/851893332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3400cdd60 0x7fa34006abe0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 --2- 172.21.15.60:0/851893332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015a190 0x7fa3400cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 --2- 172.21.15.60:0/851893332 >> v2:172.21.15.144:3300/0 conn(0x7fa3400cd8f0 0x7fa34006a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 -- 172.21.15.60:0/851893332 >> 172.21.15.60:0/851893332 conn(0x7fa3400d1a50 msgr2=0x7fa340068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:54.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 -- 172.21.15.60:0/851893332 shutdown_connections 2023-10-08T16:08:54.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.574+0000 7fa3469a5700 1 -- 172.21.15.60:0/851893332 wait complete. 2023-10-08T16:08:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.575+0000 7fa3469a5700 1 Processor -- start 2023-10-08T16:08:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.575+0000 7fa3469a5700 1 -- start start 2023-10-08T16:08:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa3469a5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3400cd8f0 0x7fa34015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa3469a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 0x7fa34016d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa3469a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015cf40 0x7fa34016dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa3469a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34015e0d0 con 0x7fa34015a190 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa3469a5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34015d4c0 con 0x7fa3400cd8f0 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa3469a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34015d7a0 con 0x7fa34015cf40 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 0x7fa34016d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 0x7fa34016d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47018/0 (socket says 172.21.15.60:47018) 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 -- 172.21.15.60:0/2770257926 learned_addr learned my addr 172.21.15.60:0/2770257926 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33ffff700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3400cd8f0 0x7fa34015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa344f42700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015cf40 0x7fa34016dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 -- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015cf40 msgr2=0x7fa34016dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015cf40 0x7fa34016dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 -- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3400cd8f0 msgr2=0x7fa34015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3400cd8f0 0x7fa34015ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 -- 172.21.15.60:0/2770257926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009ae0 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa33f7fe700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 0x7fa34016d6d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa32800e930 tx=0x7fa3280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.576+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328013680 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.577+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3280137e0 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.577+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34015da80 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.577+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328013b80 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.577+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3400c5f50 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.578+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34015e240 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.578+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa32800c3e0 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.579+0000 7fa337fff700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa320066f30 0x7fa3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.579+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa3280843d0 con 0x7fa34015a190 2023-10-08T16:08:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.579+0000 7fa33ffff700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa320066f30 0x7fa3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.579+0000 7fa33ffff700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa320066f30 0x7fa3200693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa330009db0 tx=0x7fa3300091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:54.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.583+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa328051820 con 0x7fa34015a190 2023-10-08T16:08:54.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:54.777+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa34004c3c0 con 0x7fa34015a190 2023-10-08T16:08:55.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.435+0000 7fa337fff700 1 -- 172.21.15.60:0/2770257926 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa328054e40 con 0x7fa34015a190 2023-10-08T16:08:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa320066f30 msgr2=0x7fa3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa320066f30 0x7fa3200693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa330009db0 tx=0x7fa3300091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 msgr2=0x7fa34016d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 0x7fa34016d6d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa32800e930 tx=0x7fa3280091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 shutdown_connections 2023-10-08T16:08:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa320066f30 0x7fa3200693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa34015cf40 0x7fa34016dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3400cd8f0 0x7fa34015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 --2- 172.21.15.60:0/2770257926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa34015a190 0x7fa34016d6d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.440+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 >> 172.21.15.60:0/2770257926 conn(0x7fa3400d1a50 msgr2=0x7fa3400afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.441+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 shutdown_connections 2023-10-08T16:08:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.442+0000 7fa3469a5700 1 -- 172.21.15.60:0/2770257926 wait complete. 2023-10-08T16:08:55.447 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:08:55.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:08:55.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.587+0000 7f99563dd700 1 Processor -- start 2023-10-08T16:08:55.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.587+0000 7f99563dd700 1 -- start start 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f99563dd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9950152300 0x7f995015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f99563dd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995015c8d0 con 0x7f9950158df0 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f99563dd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500c9370 con 0x7f995006d370 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f99563dd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500b1400 con 0x7f9950152300 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9950152300 0x7f995015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9950158df0 0x7f99500caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50830/0 (socket says 172.21.15.60:50830) 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994f7fe700 1 -- 172.21.15.60:0/736628748 learned_addr learned my addr 172.21.15.60:0/736628748 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994effd700 1 -- 172.21.15.60:0/736628748 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273159285 0 0) 0x7f995015c8d0 con 0x7f9950158df0 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994effd700 1 -- 172.21.15.60:0/736628748 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9938003570 con 0x7f9950158df0 2023-10-08T16:08:55.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994ffff700 1 -- 172.21.15.60:0/736628748 >> v1:172.21.15.144:6789/0 conn(0x7f995006d370 legacy=0x7f995006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994ffff700 1 -- 172.21.15.60:0/736628748 >> v1:172.21.15.60:6789/0 conn(0x7f9950158df0 legacy=0x7f99500caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994ffff700 1 -- 172.21.15.60:0/736628748 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995015c030 con 0x7f9950152300 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.588+0000 7f994ffff700 1 --2- 172.21.15.60:0/736628748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f995015b9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f99400098e0 tx=0x7f99400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac13f13bf23e54a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f994effd700 1 -- 172.21.15.60:0/736628748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000b640 con 0x7f9950152300 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f994effd700 1 -- 172.21.15.60:0/736628748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000b7a0 con 0x7f9950152300 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f994effd700 1 -- 172.21.15.60:0/736628748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000bb20 con 0x7f9950152300 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 -- 172.21.15.60:0/736628748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 msgr2=0x7f995015b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 --2- 172.21.15.60:0/736628748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f995015b9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f99400098e0 tx=0x7f99400091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 -- 172.21.15.60:0/736628748 shutdown_connections 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 --2- 172.21.15.60:0/736628748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f995015b9a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 -- 172.21.15.60:0/736628748 >> 172.21.15.60:0/736628748 conn(0x7f9950069870 msgr2=0x7f9950069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:55.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 -- 172.21.15.60:0/736628748 shutdown_connections 2023-10-08T16:08:55.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.589+0000 7f99563dd700 1 -- 172.21.15.60:0/736628748 wait complete. 2023-10-08T16:08:55.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.590+0000 7f99563dd700 1 Processor -- start 2023-10-08T16:08:55.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.590+0000 7f99563dd700 1 -- start start 2023-10-08T16:08:55.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f99563dd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f995006d370 0x7f99501505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:55.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f99563dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f99500c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f99563dd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950158df0 0x7f995015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f99563dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c7630 con 0x7f9950152300 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f99563dd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500b3150 con 0x7f9950158df0 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f99563dd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9950150b00 con 0x7f995006d370 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f994f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f99500c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f994f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f99500c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47032/0 (socket says 172.21.15.60:47032) 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.591+0000 7f994f7fe700 1 -- 172.21.15.60:0/2488945142 learned_addr learned my addr 172.21.15.60:0/2488945142 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f995497a700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950158df0 0x7f995015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994f7fe700 1 -- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f995006d370 msgr2=0x7f99501505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994ffff700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f995006d370 0x7f99501505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994f7fe700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f995006d370 0x7f99501505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994f7fe700 1 -- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950158df0 msgr2=0x7f995015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994f7fe700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950158df0 0x7f995015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994f7fe700 1 -- 172.21.15.60:0/2488945142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940009420 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f995497a700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950158df0 0x7f995015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f994f7fe700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f99500c6420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f994400c5c0 tx=0x7f9944007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944005b30 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944005cb0 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500c6d90 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944007320 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.592+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500c7350 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.593+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995004c3c0 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.593+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f994401b3b0 con 0x7f9950152300 2023-10-08T16:08:55.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.594+0000 7f9937fff700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f993c066f30 0x7f993c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.594+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9944083af0 con 0x7f9950152300 2023-10-08T16:08:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.594+0000 7f994ffff700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f993c066f30 0x7f993c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.594+0000 7f994ffff700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f993c066f30 0x7f993c0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9940003080 tx=0x7f9940017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.599+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9944050dc0 con 0x7f9950152300 2023-10-08T16:08:55.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:55.837+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f995006dd90 con 0x7f9950152300 2023-10-08T16:08:56.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.444+0000 7f9937fff700 1 -- 172.21.15.60:0/2488945142 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9944017070 con 0x7f9950152300 2023-10-08T16:08:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f993c066f30 msgr2=0x7f993c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f993c066f30 0x7f993c0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9940003080 tx=0x7f9940017000 comp rx=0 tx=0).stop 2023-10-08T16:08:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 msgr2=0x7f99500c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f99500c6420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f994400c5c0 tx=0x7f9944007e00 comp rx=0 tx=0).stop 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 shutdown_connections 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f993c066f30 0x7f993c0693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f995006d370 0x7f99501505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950158df0 0x7f995015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 --2- 172.21.15.60:0/2488945142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9950152300 0x7f99500c6420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 >> 172.21.15.60:0/2488945142 conn(0x7f9950069870 msgr2=0x7f99500c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.449+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 shutdown_connections 2023-10-08T16:08:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.450+0000 7f99563dd700 1 -- 172.21.15.60:0/2488945142 wait complete. 2023-10-08T16:08:56.455 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 10 and data pool 11 2023-10-08T16:08:56.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.589+0000 7fb8f53f2700 1 Processor -- start 2023-10-08T16:08:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.589+0000 7fb8f53f2700 1 -- start start 2023-10-08T16:08:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8f53f2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8f00c9200 0x7fb8f00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8f53f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f00cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8f53f2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f00caa60 con 0x7fb8f00cc720 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8f53f2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f00cf330 con 0x7fb8f00c9200 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8f53f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00cf570 con 0x7fb8f00cba50 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8f00c9200 0x7fb8f00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8f00c9200 0x7fb8f00b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47046/0 (socket says 172.21.15.60:47046) 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 -- 172.21.15.60:0/3929939500 learned_addr learned my addr 172.21.15.60:0/3929939500 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ef7fe700 1 --2- 172.21.15.60:0/3929939500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f00cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 -- 172.21.15.60:0/3929939500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 msgr2=0x7fb8f00cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 --2- 172.21.15.60:0/3929939500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f00cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 -- 172.21.15.60:0/3929939500 >> v1:172.21.15.144:6789/0 conn(0x7fb8f00cc720 legacy=0x7fb8f00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 -- 172.21.15.60:0/3929939500 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f00cb5c0 con 0x7fb8f00c9200 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.590+0000 7fb8ee7fc700 1 --2- 172.21.15.60:0/3929939500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b18f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40099b0 tx=0x7fb8e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edad881f00d4fbe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8edffb700 1 -- 172.21.15.60:0/3929939500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4009ea0 con 0x7fb8f00c9200 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8edffb700 1 -- 172.21.15.60:0/3929939500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400b860 con 0x7fb8f00c9200 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8edffb700 1 -- 172.21.15.60:0/3929939500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400bc00 con 0x7fb8f00c9200 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 -- 172.21.15.60:0/3929939500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 msgr2=0x7fb8f00b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/3929939500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b18f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40099b0 tx=0x7fb8e4009250 comp rx=0 tx=0).stop 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 -- 172.21.15.60:0/3929939500 shutdown_connections 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/3929939500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f00cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/3929939500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b18f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 -- 172.21.15.60:0/3929939500 >> 172.21.15.60:0/3929939500 conn(0x7fb8f006c6e0 msgr2=0x7fb8f0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 -- 172.21.15.60:0/3929939500 shutdown_connections 2023-10-08T16:08:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.591+0000 7fb8f53f2700 1 -- 172.21.15.60:0/3929939500 wait complete. 2023-10-08T16:08:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.592+0000 7fb8f53f2700 1 Processor -- start 2023-10-08T16:08:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.592+0000 7fb8f53f2700 1 -- start start 2023-10-08T16:08:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8f53f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8f53f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f01492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8f53f2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f00cc720 0x7fb8f01497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8f53f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00c8ab0 con 0x7fb8f00c9200 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8f53f2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f015b9f0 con 0x7fb8f00cc720 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8f53f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f015bcd0 con 0x7fb8f00cba50 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47048/0 (socket says 172.21.15.60:47048) 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8eeffd700 1 -- 172.21.15.60:0/1032709106 learned_addr learned my addr 172.21.15.60:0/1032709106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8ef7fe700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f00cc720 0x7fb8f01497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8ee7fc700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f01492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8eeffd700 1 -- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 msgr2=0x7fb8f01492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.593+0000 7fb8eeffd700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f01492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8eeffd700 1 -- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f00cc720 msgr2=0x7fb8f01497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8eeffd700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f00cc720 0x7fb8f01497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8eeffd700 1 -- 172.21.15.60:0/1032709106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40094f0 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8ef7fe700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f00cc720 0x7fb8f01497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8eeffd700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b4160 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c4e0 tx=0x7fb8e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0011590 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e0011710 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f015bfb0 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0011ad0 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.594+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f015c7b0 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.595+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f004c3c0 con 0x7fb8f00c9200 2023-10-08T16:08:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.595+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8e001b3b0 con 0x7fb8f00c9200 2023-10-08T16:08:56.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.596+0000 7fb8d6ffd700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8dc066f30 0x7fb8dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.596+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8e0083b10 con 0x7fb8f00c9200 2023-10-08T16:08:56.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.596+0000 7fb8ee7fc700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8dc066f30 0x7fb8dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.596+0000 7fb8ee7fc700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8dc066f30 0x7fb8dc0693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40099b0 tx=0x7fb8e4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.600+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8e0050ce0 con 0x7fb8f00c9200 2023-10-08T16:08:56.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.793+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8f00cac90 con 0x7fb8f00c9200 2023-10-08T16:08:56.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.794+0000 7fb8d6ffd700 1 -- 172.21.15.60:0/1032709106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fb8e0017070 con 0x7fb8f00c9200 2023-10-08T16:08:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:56.796 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:08:55.839567+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:54.250805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:54.808564+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8dc066f30 msgr2=0x7fb8dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8dc066f30 0x7fb8dc0693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40099b0 tx=0x7fb8e4017000 comp rx=0 tx=0).stop 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 msgr2=0x7fb8f00b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b4160 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c4e0 tx=0x7fb8e000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 shutdown_connections 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8dc066f30 0x7fb8dc0693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f00cc720 0x7fb8f01497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f00c9200 0x7fb8f00b4160 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 --2- 172.21.15.60:0/1032709106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8f00cba50 0x7fb8f01492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 >> 172.21.15.60:0/1032709106 conn(0x7fb8f006c6e0 msgr2=0x7fb8f00b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:56.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 shutdown_connections 2023-10-08T16:08:56.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.796+0000 7fb8f53f2700 1 -- 172.21.15.60:0/1032709106 wait complete. 2023-10-08T16:08:56.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:56.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.928+0000 7fb13c04a700 1 Processor -- start 2023-10-08T16:08:56.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.928+0000 7fb13c04a700 1 -- start start 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13c04a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb134156570 0x7fb13406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13c04a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb13415a330 0x7fb13406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13c04a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1340c9380 0x7fb134156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13c04a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb134157c30 con 0x7fb134156570 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13c04a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1341584f0 con 0x7fb13415a330 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13c04a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb134157670 con 0x7fb1340c9380 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb134156570 0x7fb13406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb134156570 0x7fb13406d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47064/0 (socket says 172.21.15.60:47064) 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 -- 172.21.15.60:0/2443385327 learned_addr learned my addr 172.21.15.60:0/2443385327 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb1395e5700 1 --2- 172.21.15.60:0/2443385327 >> v2:172.21.15.144:3300/0 conn(0x7fb13415a330 0x7fb13406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb13a5e7700 1 --2- 172.21.15.60:0/2443385327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1340c9380 0x7fb134156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 -- 172.21.15.60:0/2443385327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1340c9380 msgr2=0x7fb134156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 --2- 172.21.15.60:0/2443385327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1340c9380 0x7fb134156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 -- 172.21.15.60:0/2443385327 >> v2:172.21.15.144:3300/0 conn(0x7fb13415a330 msgr2=0x7fb13406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 --2- 172.21.15.60:0/2443385327 >> v2:172.21.15.144:3300/0 conn(0x7fb13415a330 0x7fb13406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 -- 172.21.15.60:0/2443385327 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134157950 con 0x7fb134156570 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb139de6700 1 --2- 172.21.15.60:0/2443385327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb13406d380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb13406cd60 tx=0x7fb124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b6c7359cc7b1d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.929+0000 7fb138de4700 1 -- 172.21.15.60:0/2443385327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400b640 con 0x7fb134156570 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb138de4700 1 -- 172.21.15.60:0/2443385327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400b7a0 con 0x7fb134156570 2023-10-08T16:08:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb138de4700 1 -- 172.21.15.60:0/2443385327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400bb60 con 0x7fb134156570 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 -- 172.21.15.60:0/2443385327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 msgr2=0x7fb13406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 --2- 172.21.15.60:0/2443385327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb13406d380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb13406cd60 tx=0x7fb124009250 comp rx=0 tx=0).stop 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 -- 172.21.15.60:0/2443385327 shutdown_connections 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 --2- 172.21.15.60:0/2443385327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1340c9380 0x7fb134156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 --2- 172.21.15.60:0/2443385327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb13406d380 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 --2- 172.21.15.60:0/2443385327 >> v2:172.21.15.144:3300/0 conn(0x7fb13415a330 0x7fb13406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 -- 172.21.15.60:0/2443385327 >> 172.21.15.60:0/2443385327 conn(0x7fb134067660 msgr2=0x7fb134067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 -- 172.21.15.60:0/2443385327 shutdown_connections 2023-10-08T16:08:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.930+0000 7fb13c04a700 1 -- 172.21.15.60:0/2443385327 wait complete. 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.931+0000 7fb13c04a700 1 Processor -- start 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.931+0000 7fb13c04a700 1 -- start start 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13c04a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1340c9380 0x7fb1340c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13c04a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb134148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13c04a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb13415a330 0x7fb134149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13c04a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340c7740 con 0x7fb134156570 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13c04a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340c86d0 con 0x7fb1340c9380 2023-10-08T16:08:56.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13c04a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b2070 con 0x7fb13415a330 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb1395e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb134148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb1395e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb134148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47078/0 (socket says 172.21.15.60:47078) 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb1395e5700 1 -- 172.21.15.60:0/4220265714 learned_addr learned my addr 172.21.15.60:0/4220265714 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb139de6700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1340c9380 0x7fb1340c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.932+0000 7fb13a5e7700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb13415a330 0x7fb134149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb1395e5700 1 -- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb13415a330 msgr2=0x7fb134149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb1395e5700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb13415a330 0x7fb134149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb1395e5700 1 -- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1340c9380 msgr2=0x7fb1340c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb1395e5700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1340c9380 0x7fb1340c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb1395e5700 1 -- 172.21.15.60:0/4220265714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240094f0 con 0x7fb134156570 2023-10-08T16:08:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb1395e5700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb134148bd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb13000ec50 tx=0x7fb1300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13000c850 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13000c9b0 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1340b2350 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13000cd70 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.933+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1340c7c70 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.934+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13404c3c0 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.935+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb130013680 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.935+0000 7fb129ffb700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb118066f30 0x7fb1180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.935+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb130084ed0 con 0x7fb134156570 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.935+0000 7fb139de6700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb118066f30 0x7fb1180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.936+0000 7fb139de6700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb118066f30 0x7fb1180693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb13406cd60 tx=0x7fb124017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:56.939+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1300521c0 con 0x7fb134156570 2023-10-08T16:08:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.132+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb134158180 con 0x7fb134156570 2023-10-08T16:08:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.133+0000 7fb129ffb700 1 -- 172.21.15.60:0/4220265714 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fb1300557e0 con 0x7fb134156570 2023-10-08T16:08:57.134 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:57.134 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:08:55.839567+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:54.250805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:54.808564+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb118066f30 msgr2=0x7fb1180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb118066f30 0x7fb1180693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb13406cd60 tx=0x7fb124017000 comp rx=0 tx=0).stop 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 msgr2=0x7fb134148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb134148bd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb13000ec50 tx=0x7fb1300091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 shutdown_connections 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb118066f30 0x7fb1180693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb13415a330 0x7fb134149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1340c9380 0x7fb1340c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 --2- 172.21.15.60:0/4220265714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb134156570 0x7fb134148bd0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 >> 172.21.15.60:0/4220265714 conn(0x7fb134067660 msgr2=0x7fb13414df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 shutdown_connections 2023-10-08T16:08:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.135+0000 7fb13c04a700 1 -- 172.21.15.60:0/4220265714 wait complete. 2023-10-08T16:08:57.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:08:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.269+0000 7f7be5ce4700 1 Processor -- start 2023-10-08T16:08:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.269+0000 7f7be5ce4700 1 -- start start 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7be5ce4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7be0159e60 0x7f7be015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7be5ce4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be00697c0 0x7f7be00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7be5ce4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be015ea90 con 0x7f7be015a230 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7be5ce4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00d1cf0 con 0x7f7be0159e60 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7be5ce4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00b3100 con 0x7f7be00697c0 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7bdf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7be0159e60 0x7f7be015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7bdeffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7be015a230 0x7f7be00690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50836/0 (socket says 172.21.15.60:50836) 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.270+0000 7f7bdeffd700 1 -- 172.21.15.60:0/3212402748 learned_addr learned my addr 172.21.15.60:0/3212402748 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdffff700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be00697c0 0x7f7be00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdf7fe700 1 -- 172.21.15.60:0/3212402748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be00697c0 msgr2=0x7f7be00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdf7fe700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be00697c0 0x7f7be00af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdf7fe700 1 -- 172.21.15.60:0/3212402748 >> v1:172.21.15.60:6789/0 conn(0x7f7be015a230 legacy=0x7f7be00690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdf7fe700 1 -- 172.21.15.60:0/3212402748 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00d10e0 con 0x7f7be0159e60 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bde7fc700 1 -- 172.21.15.60:0/3212402748 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838758154 0 0) 0x7f7be015ea90 con 0x7f7be015a230 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdffff700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be00697c0 0x7f7be00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bdf7fe700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0159e60 0x7f7be015e550 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00098e0 tx=0x7f7bd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea0341d14faec91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bde7fc700 1 -- 172.21.15.60:0/3212402748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0009e80 con 0x7f7be0159e60 2023-10-08T16:08:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bde7fc700 1 -- 172.21.15.60:0/3212402748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000b860 con 0x7f7be0159e60 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7bde7fc700 1 -- 172.21.15.60:0/3212402748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000bbe0 con 0x7f7be0159e60 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3212402748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0159e60 msgr2=0x7f7be015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.271+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0159e60 0x7f7be015e550 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00098e0 tx=0x7f7bd00091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.272+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3212402748 shutdown_connections 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.272+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be00697c0 0x7f7be00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.272+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3212402748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0159e60 0x7f7be015e550 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.272+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3212402748 >> 172.21.15.60:0/3212402748 conn(0x7f7be0070700 msgr2=0x7f7be0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.272+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3212402748 shutdown_connections 2023-10-08T16:08:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.272+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3212402748 wait complete. 2023-10-08T16:08:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.273+0000 7f7be5ce4700 1 Processor -- start 2023-10-08T16:08:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.273+0000 7f7be5ce4700 1 -- start start 2023-10-08T16:08:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be00697c0 0x7f7be00c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be0159e60 0x7f7be00ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 0x7f7be00ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be016b470 con 0x7f7be015a230 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be016b190 con 0x7f7be00697c0 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00a7850 con 0x7f7be0159e60 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 0x7f7be00ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 0x7f7be00ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47098/0 (socket says 172.21.15.60:47098) 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 -- 172.21.15.60:0/3817904133 learned_addr learned my addr 172.21.15.60:0/3817904133 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdeffd700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be0159e60 0x7f7be00ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdf7fe700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be00697c0 0x7f7be00c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 -- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be0159e60 msgr2=0x7f7be00ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be0159e60 0x7f7be00ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 -- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be00697c0 msgr2=0x7f7be00c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be00697c0 0x7f7be00c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 -- 172.21.15.60:0/3817904133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0009420 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdf7fe700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be00697c0 0x7f7be00c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bdffff700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 0x7f7be00ca830 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800cf80 tx=0x7f7bd8007890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8015440 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd80155c0 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00a7b30 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8015980 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.274+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be00c79a0 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.275+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be00a76b0 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.276+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bd8003020 con 0x7f7be015a230 2023-10-08T16:08:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.276+0000 7f7bc77fe700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.276+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bd8084d50 con 0x7f7be015a230 2023-10-08T16:08:57.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.276+0000 7f7bdf7fe700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.277+0000 7f7bdf7fe700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bcc066f30 0x7f7bcc0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0003080 tx=0x7f7bd0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.281+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7be00a76b0 con 0x7f7be015a230 2023-10-08T16:08:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:57.526+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7be00a8050 con 0x7f7be015a230 2023-10-08T16:08:58.430 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-10-08T16:08:58.429+0000 7f71f174d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:08:58.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.459+0000 7f7bc77fe700 1 -- 172.21.15.60:0/3817904133 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7be00a8050 con 0x7f7be015a230 2023-10-08T16:08:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bcc066f30 msgr2=0x7f7bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bcc066f30 0x7f7bcc0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0003080 tx=0x7f7bd0017000 comp rx=0 tx=0).stop 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 msgr2=0x7f7be00ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 0x7f7be00ca830 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800cf80 tx=0x7f7bd8007890 comp rx=0 tx=0).stop 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 shutdown_connections 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be015a230 0x7f7be00ca830 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be00697c0 0x7f7be00c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 --2- 172.21.15.60:0/3817904133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7be0159e60 0x7f7be00ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 >> 172.21.15.60:0/3817904133 conn(0x7f7be0070700 msgr2=0x7f7be0070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 shutdown_connections 2023-10-08T16:08:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.462+0000 7f7be5ce4700 1 -- 172.21.15.60:0/3817904133 wait complete. 2023-10-08T16:08:58.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.605+0000 7fb9866b7700 1 Processor -- start 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 -- start start 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb9800b4860 0x7fb9800b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9800b4c30 0x7fb980159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb980159fd0 0x7fb9800cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800b14f0 con 0x7fb9800b4860 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800b17d0 con 0x7fb980159fd0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb9866b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800b1ab0 con 0x7fb9800b4c30 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb97ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb9800b4860 0x7fb9800b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb97ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb9800b4860 0x7fb9800b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47104/0 (socket says 172.21.15.60:47104) 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.606+0000 7fb97ffff700 1 -- 172.21.15.60:0/1599837918 learned_addr learned my addr 172.21.15.60:0/1599837918 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb984c54700 1 --2- 172.21.15.60:0/1599837918 >> v2:172.21.15.144:3300/0 conn(0x7fb980159fd0 0x7fb9800cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97f7fe700 1 --2- 172.21.15.60:0/1599837918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9800b4c30 0x7fb980159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97ffff700 1 -- 172.21.15.60:0/1599837918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9800b4c30 msgr2=0x7fb980159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97ffff700 1 --2- 172.21.15.60:0/1599837918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9800b4c30 0x7fb980159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97ffff700 1 -- 172.21.15.60:0/1599837918 >> v2:172.21.15.144:3300/0 conn(0x7fb980159fd0 msgr2=0x7fb9800cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97ffff700 1 --2- 172.21.15.60:0/1599837918 >> v2:172.21.15.144:3300/0 conn(0x7fb980159fd0 0x7fb9800cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97ffff700 1 -- 172.21.15.60:0/1599837918 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800b1d90 con 0x7fb9800b4860 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97ffff700 1 --2- 172.21.15.60:0/1599837918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb9800b6700 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb9800d1ed0 tx=0x7fb968009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642bb92954652fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97effd700 1 -- 172.21.15.60:0/1599837918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968005c10 con 0x7fb9800b4860 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97effd700 1 -- 172.21.15.60:0/1599837918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968005d70 con 0x7fb9800b4860 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.607+0000 7fb97effd700 1 -- 172.21.15.60:0/1599837918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968006260 con 0x7fb9800b4860 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 -- 172.21.15.60:0/1599837918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 msgr2=0x7fb9800b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 --2- 172.21.15.60:0/1599837918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb9800b6700 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb9800d1ed0 tx=0x7fb968009220 comp rx=0 tx=0).stop 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 -- 172.21.15.60:0/1599837918 shutdown_connections 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 --2- 172.21.15.60:0/1599837918 >> v2:172.21.15.144:3300/0 conn(0x7fb980159fd0 0x7fb9800cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 --2- 172.21.15.60:0/1599837918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb9800b6700 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 --2- 172.21.15.60:0/1599837918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9800b4c30 0x7fb980159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 -- 172.21.15.60:0/1599837918 >> 172.21.15.60:0/1599837918 conn(0x7fb98009a0f0 msgr2=0x7fb980067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 -- 172.21.15.60:0/1599837918 shutdown_connections 2023-10-08T16:08:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.608+0000 7fb9866b7700 1 -- 172.21.15.60:0/1599837918 wait complete. 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.609+0000 7fb9866b7700 1 Processor -- start 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.609+0000 7fb9866b7700 1 -- start start 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb9866b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb980152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb9866b7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9800b4c30 0x7fb98016a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb9866b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb980159fd0 0x7fb98016a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb9866b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb980152d70 con 0x7fb9800b4860 2023-10-08T16:08:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb9866b7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98016ae60 con 0x7fb9800b4c30 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb9866b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb980156640 con 0x7fb980159fd0 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb980152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb980152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47108/0 (socket says 172.21.15.60:47108) 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 -- 172.21.15.60:0/2054259711 learned_addr learned my addr 172.21.15.60:0/2054259711 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97f7fe700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9800b4c30 0x7fb98016a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb984c54700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb980159fd0 0x7fb98016a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 -- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb980159fd0 msgr2=0x7fb98016a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb980159fd0 0x7fb98016a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 -- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9800b4c30 msgr2=0x7fb98016a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9800b4c30 0x7fb98016a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 -- 172.21.15.60:0/2054259711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb968009480 con 0x7fb9800b4860 2023-10-08T16:08:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb984c54700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb980159fd0 0x7fb98016a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.610+0000 7fb97ffff700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb980152830 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb96800b0e0 tx=0x7fb968016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.611+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96800b860 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.611+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968020070 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.611+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96800bbf0 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.611+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98009e1f0 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.611+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98009dc30 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.612+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98004c3c0 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.612+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb968022030 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.612+0000 7fb977fff700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb960066f30 0x7fb9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.612+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb968086140 con 0x7fb9800b4860 2023-10-08T16:08:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.612+0000 7fb97f7fe700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb960066f30 0x7fb9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.613+0000 7fb97f7fe700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb960066f30 0x7fb9600693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb98006ae80 tx=0x7fb970008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.617+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9680533b0 con 0x7fb9800b4860 2023-10-08T16:08:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:58.854+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb9800b2070 con 0x7fb9800b4860 2023-10-08T16:08:59.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.460+0000 7fb977fff700 1 -- 172.21.15.60:0/2054259711 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb9680569d0 con 0x7fb9800b4860 2023-10-08T16:08:59.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb960066f30 msgr2=0x7fb9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb960066f30 0x7fb9600693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb98006ae80 tx=0x7fb970008040 comp rx=0 tx=0).stop 2023-10-08T16:08:59.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 msgr2=0x7fb980152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb980152830 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb96800b0e0 tx=0x7fb968016000 comp rx=0 tx=0).stop 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 shutdown_connections 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb960066f30 0x7fb9600693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb980159fd0 0x7fb98016a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9800b4860 0x7fb980152830 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 --2- 172.21.15.60:0/2054259711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9800b4c30 0x7fb98016a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 >> 172.21.15.60:0/2054259711 conn(0x7fb98009a0f0 msgr2=0x7fb98015b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 shutdown_connections 2023-10-08T16:08:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.463+0000 7fb9866b7700 1 -- 172.21.15.60:0/2054259711 wait complete. 2023-10-08T16:08:59.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:08:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.599+0000 7f2e61cb3700 1 Processor -- start 2023-10-08T16:08:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.600+0000 7f2e61cb3700 1 -- start start 2023-10-08T16:08:59.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.600+0000 7f2e61cb3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c1577d0 0x7f2e5c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.600+0000 7f2e61cb3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e5c06ac30 0x7f2e5c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.600+0000 7f2e61cb3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c15c360 con 0x7f2e5c157ba0 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.600+0000 7f2e61cb3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c15b790 con 0x7f2e5c06ac30 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.600+0000 7f2e61cb3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c15ba30 con 0x7f2e5c1577d0 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e5c06ac30 0x7f2e5c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e5c06ac30 0x7f2e5c15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47118/0 (socket says 172.21.15.60:47118) 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 -- 172.21.15.60:0/3511098602 learned_addr learned my addr 172.21.15.60:0/3511098602 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5b7fe700 1 --2- 172.21.15.60:0/3511098602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c1577d0 0x7f2e5c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 -- 172.21.15.60:0/3511098602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c1577d0 msgr2=0x7f2e5c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 --2- 172.21.15.60:0/3511098602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c1577d0 0x7f2e5c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 -- 172.21.15.60:0/3511098602 >> v1:172.21.15.144:6789/0 conn(0x7f2e5c157ba0 legacy=0x7f2e5c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 -- 172.21.15.60:0/3511098602 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c15bd10 con 0x7f2e5c06ac30 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5bfff700 1 --2- 172.21.15.60:0/3511098602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c06ac30 0x7f2e5c15c7f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009f20 tx=0x7f2e54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1509050db231f747 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5a7fc700 1 -- 172.21.15.60:0/3511098602 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400e070 con 0x7f2e5c06ac30 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5a7fc700 1 -- 172.21.15.60:0/3511098602 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400b9d0 con 0x7f2e5c06ac30 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.601+0000 7f2e5a7fc700 1 -- 172.21.15.60:0/3511098602 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e540092e0 con 0x7f2e5c06ac30 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 -- 172.21.15.60:0/3511098602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c06ac30 msgr2=0x7f2e5c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/3511098602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c06ac30 0x7f2e5c15c7f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009f20 tx=0x7f2e54009840 comp rx=0 tx=0).stop 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 -- 172.21.15.60:0/3511098602 shutdown_connections 2023-10-08T16:08:59.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/3511098602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c06ac30 0x7f2e5c15c7f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/3511098602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c1577d0 0x7f2e5c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 -- 172.21.15.60:0/3511098602 >> 172.21.15.60:0/3511098602 conn(0x7f2e5c068ce0 msgr2=0x7f2e5c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 -- 172.21.15.60:0/3511098602 shutdown_connections 2023-10-08T16:08:59.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.602+0000 7f2e61cb3700 1 -- 172.21.15.60:0/3511098602 wait complete. 2023-10-08T16:08:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.603+0000 7f2e61cb3700 1 Processor -- start 2023-10-08T16:08:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.603+0000 7f2e61cb3700 1 -- start start 2023-10-08T16:08:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e61cb3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c06ac30 0x7f2e5c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e61cb3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e5c1577d0 0x7f2e5c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e61cb3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 0x7f2e5c0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e61cb3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0b10f0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e61cb3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0b13d0 con 0x7f2e5c1577d0 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e61cb3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0b16b0 con 0x7f2e5c06ac30 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 0x7f2e5c0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 0x7f2e5c0b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47120/0 (socket says 172.21.15.60:47120) 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 -- 172.21.15.60:0/22608980 learned_addr learned my addr 172.21.15.60:0/22608980 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5b7fe700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c06ac30 0x7f2e5c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5affd700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e5c1577d0 0x7f2e5c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 -- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c06ac30 msgr2=0x7f2e5c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c06ac30 0x7f2e5c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 -- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e5c1577d0 msgr2=0x7f2e5c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e5c1577d0 0x7f2e5c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 -- 172.21.15.60:0/22608980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009ae0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5affd700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e5c1577d0 0x7f2e5c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.604+0000 7f2e5bfff700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 0x7f2e5c0b0b00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c06b580 tx=0x7f2e54018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.605+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54008b80 con 0x7f2e5c157ba0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.605+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e54008ce0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.605+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0b1990 con 0x7f2e5c157ba0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.605+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e540266b0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.605+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c1548a0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.606+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c04c3c0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.606+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e54003040 con 0x7f2e5c157ba0 2023-10-08T16:08:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.606+0000 7f2e437fe700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e48066f30 0x7f2e480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.606+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e54086380 con 0x7f2e5c157ba0 2023-10-08T16:08:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.607+0000 7f2e5b7fe700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e48066f30 0x7f2e480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.607+0000 7f2e5b7fe700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e48066f30 0x7f2e480693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009db0 tx=0x7f2e4c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.611+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e540535f0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.846+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e5c15bff0 con 0x7f2e5c157ba0 2023-10-08T16:08:59.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.846+0000 7f2e437fe700 1 -- 172.21.15.60:0/22608980 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2e54056c10 con 0x7f2e5c157ba0 2023-10-08T16:08:59.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:08:59.848 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:08:59.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e48066f30 msgr2=0x7f2e480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e48066f30 0x7f2e480693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009db0 tx=0x7f2e4c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 msgr2=0x7f2e5c0b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 0x7f2e5c0b0b00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c06b580 tx=0x7f2e54018000 comp rx=0 tx=0).stop 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 shutdown_connections 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2e48066f30 0x7f2e480693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e5c06ac30 0x7f2e5c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e5c157ba0 0x7f2e5c0b0b00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 --2- 172.21.15.60:0/22608980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e5c1577d0 0x7f2e5c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 >> 172.21.15.60:0/22608980 conn(0x7f2e5c068ce0 msgr2=0x7f2e5c1566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 shutdown_connections 2023-10-08T16:08:59.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.849+0000 7f2e61cb3700 1 -- 172.21.15.60:0/22608980 wait complete. 2023-10-08T16:08:59.852 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:08:59.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:08:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.980+0000 7f1360274700 1 Processor -- start 2023-10-08T16:08:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.980+0000 7f1360274700 1 -- start start 2023-10-08T16:08:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f1360274700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1358152010 0x7f135815b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f1360274700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13581523e0 0x7f135806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f1360274700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135806c010 con 0x7f1358158e50 2023-10-08T16:08:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f1360274700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135806bd10 con 0x7f1358152010 2023-10-08T16:08:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f1360274700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135815c060 con 0x7f13581523e0 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f135e010700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1358152010 0x7f135815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f135e811700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1358158e50 0x7f13580cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50850/0 (socket says 172.21.15.60:50850) 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f135e811700 1 -- 172.21.15.60:0/1986343663 learned_addr learned my addr 172.21.15.60:0/1986343663 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.981+0000 7f135d80f700 1 --2- 172.21.15.60:0/1986343663 >> v2:172.21.15.144:3300/0 conn(0x7f13581523e0 0x7f135806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135e010700 1 -- 172.21.15.60:0/1986343663 >> v2:172.21.15.144:3300/0 conn(0x7f13581523e0 msgr2=0x7f135806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135e010700 1 --2- 172.21.15.60:0/1986343663 >> v2:172.21.15.144:3300/0 conn(0x7f13581523e0 0x7f135806c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135e010700 1 -- 172.21.15.60:0/1986343663 >> v1:172.21.15.60:6789/0 conn(0x7f1358158e50 legacy=0x7f13580cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135d00e700 1 -- 172.21.15.60:0/1986343663 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473463927 0 0) 0x7f135806c010 con 0x7f1358158e50 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135e010700 1 -- 172.21.15.60:0/1986343663 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135815c340 con 0x7f1358152010 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135e010700 1 --2- 172.21.15.60:0/1986343663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1358152010 0x7f135815b810 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f13580ceae0 tx=0x7f13500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84655d1a242c373 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135d00e700 1 -- 172.21.15.60:0/1986343663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350011630 con 0x7f1358152010 2023-10-08T16:08:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135d00e700 1 -- 172.21.15.60:0/1986343663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1350011790 con 0x7f1358152010 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f135d00e700 1 -- 172.21.15.60:0/1986343663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350011b30 con 0x7f1358152010 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f1360274700 1 -- 172.21.15.60:0/1986343663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1358152010 msgr2=0x7f135815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.982+0000 7f1360274700 1 --2- 172.21.15.60:0/1986343663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1358152010 0x7f135815b810 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f13580ceae0 tx=0x7f13500091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.983+0000 7f1360274700 1 -- 172.21.15.60:0/1986343663 shutdown_connections 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.983+0000 7f1360274700 1 --2- 172.21.15.60:0/1986343663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1358152010 0x7f135815b810 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.983+0000 7f1360274700 1 --2- 172.21.15.60:0/1986343663 >> v2:172.21.15.144:3300/0 conn(0x7f13581523e0 0x7f135806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.983+0000 7f1360274700 1 -- 172.21.15.60:0/1986343663 >> 172.21.15.60:0/1986343663 conn(0x7f1358069870 msgr2=0x7f1358069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.983+0000 7f1360274700 1 -- 172.21.15.60:0/1986343663 shutdown_connections 2023-10-08T16:08:59.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.983+0000 7f1360274700 1 -- 172.21.15.60:0/1986343663 wait complete. 2023-10-08T16:08:59.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 Processor -- start 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 -- start start 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1358152010 0x7f13580c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 0x7f13580690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1358158e50 0x7f1358067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358068c60 con 0x7f13581523e0 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358069630 con 0x7f1358152010 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.984+0000 7f1360274700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1358068090 con 0x7f1358158e50 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 0x7f13580690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 0x7f13580690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47140/0 (socket says 172.21.15.60:47140) 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 -- 172.21.15.60:0/4064548723 learned_addr learned my addr 172.21.15.60:0/4064548723 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:08:59.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135e811700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1358158e50 0x7f1358067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135e010700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1358152010 0x7f13580c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 -- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1358158e50 msgr2=0x7f1358067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1358158e50 0x7f1358067780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 -- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1358152010 msgr2=0x7f13580c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1358152010 0x7f13580c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 -- 172.21.15.60:0/4064548723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350009420 con 0x7f13581523e0 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135e811700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1358158e50 0x7f1358067780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135e010700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1358152010 0x7f13580c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:08:59.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f135d80f700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 0x7f13580690f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f134c00ec80 tx=0x7f134c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00c9d0 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c00cb30 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c013470 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1358067cc0 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.985+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1358068610 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.986+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1358068dd0 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.987+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f134c013820 con 0x7f13581523e0 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.987+0000 7f13567fc700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1344066f30 0x7f13440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.987+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f134c084920 con 0x7f13581523e0 2023-10-08T16:08:59.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.987+0000 7f135e010700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1344066f30 0x7f13440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.988+0000 7f135e010700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1344066f30 0x7f13440693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13500093f0 tx=0x7f1350017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:08:59.991+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f134c051b90 con 0x7f13581523e0 2023-10-08T16:09:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.186+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f135804c3c0 con 0x7f13581523e0 2023-10-08T16:09:00.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.187+0000 7f13567fc700 1 -- 172.21.15.60:0/4064548723 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f134c0551b0 con 0x7f13581523e0 2023-10-08T16:09:00.189 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:00.189 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:08:57.436391+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:54.250805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:54.808564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1344066f30 msgr2=0x7f13440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1344066f30 0x7f13440693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13500093f0 tx=0x7f1350017000 comp rx=0 tx=0).stop 2023-10-08T16:09:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 msgr2=0x7f13580690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 0x7f13580690f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f134c00ec80 tx=0x7f134c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 shutdown_connections 2023-10-08T16:09:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1344066f30 0x7f13440693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1358158e50 0x7f1358067780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1358152010 0x7f13580c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 --2- 172.21.15.60:0/4064548723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13581523e0 0x7f13580690f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 >> 172.21.15.60:0/4064548723 conn(0x7f1358069870 msgr2=0x7f13580ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 shutdown_connections 2023-10-08T16:09:00.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.189+0000 7f1360274700 1 -- 172.21.15.60:0/4064548723 wait complete. 2023-10-08T16:09:00.203 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:09:00.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.321+0000 7fa0f71ee700 1 Processor -- start 2023-10-08T16:09:00.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f71ee700 1 -- start start 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f71ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0f015a1e0 0x7fa0f00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f71ee700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f015db80 con 0x7fa0f0159e10 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f71ee700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f015de60 con 0x7fa0f00b3430 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f71ee700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f015e800 con 0x7fa0f015a1e0 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0effff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0f015a1e0 0x7fa0f00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f4f8a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa0f0159e10 0x7fa0f00b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50862/0 (socket says 172.21.15.60:50862) 2023-10-08T16:09:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.322+0000 7fa0f4f8a700 1 -- 172.21.15.60:0/3195912810 learned_addr learned my addr 172.21.15.60:0/3195912810 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0effff700 1 -- 172.21.15.60:0/3195912810 >> v1:172.21.15.144:6789/0 conn(0x7fa0f00b3430 legacy=0x7fa0f00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0effff700 1 -- 172.21.15.60:0/3195912810 >> v1:172.21.15.60:6789/0 conn(0x7fa0f0159e10 legacy=0x7fa0f00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0effff700 1 -- 172.21.15.60:0/3195912810 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f015e140 con 0x7fa0f015a1e0 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0ef7fe700 1 -- 172.21.15.60:0/3195912810 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866930578 0 0) 0x7fa0f015db80 con 0x7fa0f0159e10 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0effff700 1 --2- 172.21.15.60:0/3195912810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f015a1e0 0x7fa0f00cd740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009e60 tx=0x7fa0e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5b3260db24e6ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0ef7fe700 1 -- 172.21.15.60:0/3195912810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000e070 con 0x7fa0f015a1e0 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0ef7fe700 1 -- 172.21.15.60:0/3195912810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000bc30 con 0x7fa0f015a1e0 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.323+0000 7fa0ef7fe700 1 -- 172.21.15.60:0/3195912810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0012430 con 0x7fa0f015a1e0 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 -- 172.21.15.60:0/3195912810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f015a1e0 msgr2=0x7fa0f00cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/3195912810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f015a1e0 0x7fa0f00cd740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009e60 tx=0x7fa0e0009780 comp rx=0 tx=0).stop 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 -- 172.21.15.60:0/3195912810 shutdown_connections 2023-10-08T16:09:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/3195912810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f015a1e0 0x7fa0f00cd740 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 -- 172.21.15.60:0/3195912810 >> 172.21.15.60:0/3195912810 conn(0x7fa0f0067660 msgr2=0x7fa0f0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 -- 172.21.15.60:0/3195912810 shutdown_connections 2023-10-08T16:09:00.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.324+0000 7fa0f71ee700 1 -- 172.21.15.60:0/3195912810 wait complete. 2023-10-08T16:09:00.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.325+0000 7fa0f71ee700 1 Processor -- start 2023-10-08T16:09:00.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.325+0000 7fa0f71ee700 1 -- start start 2023-10-08T16:09:00.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 0x7fa0f00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0159e10 0x7fa0f00cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f015a1e0 0x7fa0f00cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00c5d50 con 0x7fa0f00b3430 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00c50d0 con 0x7fa0f0159e10 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00c53b0 con 0x7fa0f015a1e0 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 0x7fa0f00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 0x7fa0f00c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47150/0 (socket says 172.21.15.60:47150) 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 -- 172.21.15.60:0/1001136456 learned_addr learned my addr 172.21.15.60:0/1001136456 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0effff700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0159e10 0x7fa0f00cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f578b700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f015a1e0 0x7fa0f00cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 -- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f015a1e0 msgr2=0x7fa0f00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f015a1e0 0x7fa0f00cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 -- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0159e10 msgr2=0x7fa0f00cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0159e10 0x7fa0f00cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 -- 172.21.15.60:0/1001136456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0009a20 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0effff700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0159e10 0x7fa0f00cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f578b700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f015a1e0 0x7fa0f00cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f4f8a700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 0x7fa0f00c4760 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c7e0 tx=0x7fa0e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8005b30 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8005c90 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8007300 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f00c5690 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.326+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f00c4ca0 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.327+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f004c3c0 con 0x7fa0f00b3430 2023-10-08T16:09:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.328+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0e801b400 con 0x7fa0f00b3430 2023-10-08T16:09:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.328+0000 7fa0ecff9700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0d0066f30 0x7fa0d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.328+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0e80840a0 con 0x7fa0f00b3430 2023-10-08T16:09:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.328+0000 7fa0effff700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0d0066f30 0x7fa0d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.329+0000 7fa0effff700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0d0066f30 0x7fa0d00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009e60 tx=0x7fa0e0019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.332+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0e8051310 con 0x7fa0f00b3430 2023-10-08T16:09:00.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.524+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0f00c5b30 con 0x7fa0d0066f30 2023-10-08T16:09:00.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.532+0000 7fa0ecff9700 1 -- 172.21.15.60:0/1001136456 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282060 (secure 0 0 0) 0x7fa0f00c5b30 con 0x7fa0d0066f30 2023-10-08T16:09:00.537 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:00.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0d0066f30 msgr2=0x7fa0d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0d0066f30 0x7fa0d00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009e60 tx=0x7fa0e0019000 comp rx=0 tx=0).stop 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 msgr2=0x7fa0f00c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 0x7fa0f00c4760 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c7e0 tx=0x7fa0e8007df0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 shutdown_connections 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa0d0066f30 0x7fa0d00693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f015a1e0 0x7fa0f00cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0f00b3430 0x7fa0f00c4760 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 --2- 172.21.15.60:0/1001136456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0159e10 0x7fa0f00cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 >> 172.21.15.60:0/1001136456 conn(0x7fa0f0067660 msgr2=0x7fa0f00cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 shutdown_connections 2023-10-08T16:09:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.535+0000 7fa0f71ee700 1 -- 172.21.15.60:0/1001136456 wait complete. 2023-10-08T16:09:00.541 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:09:00.549 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-10-08T16:08:59.611732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558194,"statfs":{"total":1600000000,"available":1595591035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.181590"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447737+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449905+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440058+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:09.261184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440973+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:33.751516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439572+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:56.610835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.450300+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445023+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.452245+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440953+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:52.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446866+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444754+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439785+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:50.657018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444154+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440499+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:10.959156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445772+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448915+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440485+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:39.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440906+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:54.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449497+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445394+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448486+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448095+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443451+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444125+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446501+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444897+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.442377+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:14.576369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449795+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439267+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:36.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446416+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444475+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448981+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447302+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451725+0000","last_change":"2023-10-08T16:08:55.451725+0000","last_active":"2023-10-08T16:08:55.451725+0000","last_peered":"2023-10-08T16:08:55.451725+0000","last_clean":"2023-10-08T16:08:55.451725+0000","last_became_active":"2023-10-08T16:08:55.451533+0000","last_became_peered":"2023-10-08T16:08:55.451533+0000","last_unstale":"2023-10-08T16:08:55.451725+0000","last_undegraded":"2023-10-08T16:08:55.451725+0000","last_fullsized":"2023-10-08T16:08:55.451725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:55.460997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439710+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:04.919950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.449671+0000","last_change":"2023-10-08T16:08:55.449671+0000","last_active":"2023-10-08T16:08:55.449671+0000","last_peered":"2023-10-08T16:08:55.449671+0000","last_clean":"2023-10-08T16:08:55.449671+0000","last_became_active":"2023-10-08T16:08:55.449136+0000","last_became_peered":"2023-10-08T16:08:55.449136+0000","last_unstale":"2023-10-08T16:08:55.449671+0000","last_undegraded":"2023-10-08T16:08:55.449671+0000","last_fullsized":"2023-10-08T16:08:55.449671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:09.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448633+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:47.343632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.454471+0000","last_change":"2023-10-08T16:08:55.454471+0000","last_active":"2023-10-08T16:08:55.454471+0000","last_peered":"2023-10-08T16:08:55.454471+0000","last_clean":"2023-10-08T16:08:55.454471+0000","last_became_active":"2023-10-08T16:08:55.454025+0000","last_became_peered":"2023-10-08T16:08:55.454025+0000","last_unstale":"2023-10-08T16:08:55.454471+0000","last_undegraded":"2023-10-08T16:08:55.454471+0000","last_fullsized":"2023-10-08T16:08:55.454471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.883624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444776+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447549+0000","last_change":"2023-10-08T16:08:55.447549+0000","last_active":"2023-10-08T16:08:55.447549+0000","last_peered":"2023-10-08T16:08:55.447549+0000","last_clean":"2023-10-08T16:08:55.447549+0000","last_became_active":"2023-10-08T16:08:55.447129+0000","last_became_peered":"2023-10-08T16:08:55.447129+0000","last_unstale":"2023-10-08T16:08:55.447549+0000","last_undegraded":"2023-10-08T16:08:55.447549+0000","last_fullsized":"2023-10-08T16:08:55.447549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:10.409532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444244+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450237+0000","last_change":"2023-10-08T16:08:55.450237+0000","last_active":"2023-10-08T16:08:55.450237+0000","last_peered":"2023-10-08T16:08:55.450237+0000","last_clean":"2023-10-08T16:08:55.450237+0000","last_became_active":"2023-10-08T16:08:55.449996+0000","last_became_peered":"2023-10-08T16:08:55.449996+0000","last_unstale":"2023-10-08T16:08:55.450237+0000","last_undegraded":"2023-10-08T16:08:55.450237+0000","last_fullsized":"2023-10-08T16:08:55.450237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:38.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447695+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446310+0000","last_change":"2023-10-08T16:08:55.446310+0000","last_active":"2023-10-08T16:08:55.446310+0000","last_peered":"2023-10-08T16:08:55.446310+0000","last_clean":"2023-10-08T16:08:55.446310+0000","last_became_active":"2023-10-08T16:08:55.446055+0000","last_became_peered":"2023-10-08T16:08:55.446055+0000","last_unstale":"2023-10-08T16:08:55.446310+0000","last_undegraded":"2023-10-08T16:08:55.446310+0000","last_fullsized":"2023-10-08T16:08:55.446310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:10.879816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439132+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:44.567117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450571+0000","last_change":"2023-10-08T16:08:55.450571+0000","last_active":"2023-10-08T16:08:55.450571+0000","last_peered":"2023-10-08T16:08:55.450571+0000","last_clean":"2023-10-08T16:08:55.450571+0000","last_became_active":"2023-10-08T16:08:55.450334+0000","last_became_peered":"2023-10-08T16:08:55.450334+0000","last_unstale":"2023-10-08T16:08:55.450571+0000","last_undegraded":"2023-10-08T16:08:55.450571+0000","last_fullsized":"2023-10-08T16:08:55.450571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:52.239027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447306+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.438753+0000","last_change":"2023-10-08T16:08:55.438753+0000","last_active":"2023-10-08T16:08:55.438753+0000","last_peered":"2023-10-08T16:08:55.438753+0000","last_clean":"2023-10-08T16:08:55.438753+0000","last_became_active":"2023-10-08T16:08:55.438500+0000","last_became_peered":"2023-10-08T16:08:55.438500+0000","last_unstale":"2023-10-08T16:08:55.438753+0000","last_undegraded":"2023-10-08T16:08:55.438753+0000","last_fullsized":"2023-10-08T16:08:55.438753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:55.385578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444422+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451505+0000","last_change":"2023-10-08T16:08:55.451505+0000","last_active":"2023-10-08T16:08:55.451505+0000","last_peered":"2023-10-08T16:08:55.451505+0000","last_clean":"2023-10-08T16:08:55.451505+0000","last_became_active":"2023-10-08T16:08:55.451279+0000","last_became_peered":"2023-10-08T16:08:55.451279+0000","last_unstale":"2023-10-08T16:08:55.451505+0000","last_undegraded":"2023-10-08T16:08:55.451505+0000","last_fullsized":"2023-10-08T16:08:55.451505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444032+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.441612+0000","last_change":"2023-10-08T16:08:55.441612+0000","last_active":"2023-10-08T16:08:55.441612+0000","last_peered":"2023-10-08T16:08:55.441612+0000","last_clean":"2023-10-08T16:08:55.441612+0000","last_became_active":"2023-10-08T16:08:55.441363+0000","last_became_peered":"2023-10-08T16:08:55.441363+0000","last_unstale":"2023-10-08T16:08:55.441612+0000","last_undegraded":"2023-10-08T16:08:55.441612+0000","last_fullsized":"2023-10-08T16:08:55.441612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:49.652172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448047+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:14.011793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.444388+0000","last_change":"2023-10-08T16:08:55.444388+0000","last_active":"2023-10-08T16:08:55.444388+0000","last_peered":"2023-10-08T16:08:55.444388+0000","last_clean":"2023-10-08T16:08:55.444388+0000","last_became_active":"2023-10-08T16:08:55.443861+0000","last_became_peered":"2023-10-08T16:08:55.443861+0000","last_unstale":"2023-10-08T16:08:55.444388+0000","last_undegraded":"2023-10-08T16:08:55.444388+0000","last_fullsized":"2023-10-08T16:08:55.444388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:39.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439294+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:18.897301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446100+0000","last_change":"2023-10-08T16:08:55.446100+0000","last_active":"2023-10-08T16:08:55.446100+0000","last_peered":"2023-10-08T16:08:55.446100+0000","last_clean":"2023-10-08T16:08:55.446100+0000","last_became_active":"2023-10-08T16:08:55.445020+0000","last_became_peered":"2023-10-08T16:08:55.445020+0000","last_unstale":"2023-10-08T16:08:55.446100+0000","last_undegraded":"2023-10-08T16:08:55.446100+0000","last_fullsized":"2023-10-08T16:08:55.446100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443631+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450684+0000","last_change":"2023-10-08T16:08:55.450684+0000","last_active":"2023-10-08T16:08:55.450684+0000","last_peered":"2023-10-08T16:08:55.450684+0000","last_clean":"2023-10-08T16:08:55.450684+0000","last_became_active":"2023-10-08T16:08:55.450407+0000","last_became_peered":"2023-10-08T16:08:55.450407+0000","last_unstale":"2023-10-08T16:08:55.450684+0000","last_undegraded":"2023-10-08T16:08:55.450684+0000","last_fullsized":"2023-10-08T16:08:55.450684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:52.823655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443451+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447354+0000","last_change":"2023-10-08T16:08:55.447354+0000","last_active":"2023-10-08T16:08:55.447354+0000","last_peered":"2023-10-08T16:08:55.447354+0000","last_clean":"2023-10-08T16:08:55.447354+0000","last_became_active":"2023-10-08T16:08:55.446789+0000","last_became_peered":"2023-10-08T16:08:55.446789+0000","last_unstale":"2023-10-08T16:08:55.447354+0000","last_undegraded":"2023-10-08T16:08:55.447354+0000","last_fullsized":"2023-10-08T16:08:55.447354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:52.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443767+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446159+0000","last_change":"2023-10-08T16:08:55.446159+0000","last_active":"2023-10-08T16:08:55.446159+0000","last_peered":"2023-10-08T16:08:55.446159+0000","last_clean":"2023-10-08T16:08:55.446159+0000","last_became_active":"2023-10-08T16:08:55.445930+0000","last_became_peered":"2023-10-08T16:08:55.445930+0000","last_unstale":"2023-10-08T16:08:55.446159+0000","last_undegraded":"2023-10-08T16:08:55.446159+0000","last_fullsized":"2023-10-08T16:08:55.446159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:15.925120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440233+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:45.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.453453+0000","last_change":"2023-10-08T16:08:55.453453+0000","last_active":"2023-10-08T16:08:55.453453+0000","last_peered":"2023-10-08T16:08:55.453453+0000","last_clean":"2023-10-08T16:08:55.453453+0000","last_became_active":"2023-10-08T16:08:55.452722+0000","last_became_peered":"2023-10-08T16:08:55.452722+0000","last_unstale":"2023-10-08T16:08:55.453453+0000","last_undegraded":"2023-10-08T16:08:55.453453+0000","last_fullsized":"2023-10-08T16:08:55.453453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:13.006947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446141+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447305+0000","last_change":"2023-10-08T16:08:55.447305+0000","last_active":"2023-10-08T16:08:55.447305+0000","last_peered":"2023-10-08T16:08:55.447305+0000","last_clean":"2023-10-08T16:08:55.447305+0000","last_became_active":"2023-10-08T16:08:55.446735+0000","last_became_peered":"2023-10-08T16:08:55.446735+0000","last_unstale":"2023-10-08T16:08:55.447305+0000","last_undegraded":"2023-10-08T16:08:55.447305+0000","last_fullsized":"2023-10-08T16:08:55.447305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:09.573102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446929+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.454617+0000","last_change":"2023-10-08T16:08:55.454617+0000","last_active":"2023-10-08T16:08:55.454617+0000","last_peered":"2023-10-08T16:08:55.454617+0000","last_clean":"2023-10-08T16:08:55.454617+0000","last_became_active":"2023-10-08T16:08:55.454282+0000","last_became_peered":"2023-10-08T16:08:55.454282+0000","last_unstale":"2023-10-08T16:08:55.454617+0000","last_undegraded":"2023-10-08T16:08:55.454617+0000","last_fullsized":"2023-10-08T16:08:55.454617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:31.993858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439396+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:53.830593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450793+0000","last_change":"2023-10-08T16:08:55.450793+0000","last_active":"2023-10-08T16:08:55.450793+0000","last_peered":"2023-10-08T16:08:55.450793+0000","last_clean":"2023-10-08T16:08:55.450793+0000","last_became_active":"2023-10-08T16:08:55.450547+0000","last_became_peered":"2023-10-08T16:08:55.450547+0000","last_unstale":"2023-10-08T16:08:55.450793+0000","last_undegraded":"2023-10-08T16:08:55.450793+0000","last_fullsized":"2023-10-08T16:08:55.450793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:19.588783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439211+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:28.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.452317+0000","last_change":"2023-10-08T16:08:55.452317+0000","last_active":"2023-10-08T16:08:55.452317+0000","last_peered":"2023-10-08T16:08:55.452317+0000","last_clean":"2023-10-08T16:08:55.452317+0000","last_became_active":"2023-10-08T16:08:55.452086+0000","last_became_peered":"2023-10-08T16:08:55.452086+0000","last_unstale":"2023-10-08T16:08:55.452317+0000","last_undegraded":"2023-10-08T16:08:55.452317+0000","last_fullsized":"2023-10-08T16:08:55.452317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:23.064317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439542+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:32.889281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450948+0000","last_change":"2023-10-08T16:08:55.450948+0000","last_active":"2023-10-08T16:08:55.450948+0000","last_peered":"2023-10-08T16:08:55.450948+0000","last_clean":"2023-10-08T16:08:55.450948+0000","last_became_active":"2023-10-08T16:08:55.450483+0000","last_became_peered":"2023-10-08T16:08:55.450483+0000","last_unstale":"2023-10-08T16:08:55.450948+0000","last_undegraded":"2023-10-08T16:08:55.450948+0000","last_fullsized":"2023-10-08T16:08:55.450948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:20.089680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.441412+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:55.331830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448307+0000","last_change":"2023-10-08T16:08:55.448307+0000","last_active":"2023-10-08T16:08:55.448307+0000","last_peered":"2023-10-08T16:08:55.448307+0000","last_clean":"2023-10-08T16:08:55.448307+0000","last_became_active":"2023-10-08T16:08:55.448064+0000","last_became_peered":"2023-10-08T16:08:55.448064+0000","last_unstale":"2023-10-08T16:08:55.448307+0000","last_undegraded":"2023-10-08T16:08:55.448307+0000","last_fullsized":"2023-10-08T16:08:55.448307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:12.916924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.438714+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:31.485982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.445304+0000","last_change":"2023-10-08T16:08:55.445304+0000","last_active":"2023-10-08T16:08:55.445304+0000","last_peered":"2023-10-08T16:08:55.445304+0000","last_clean":"2023-10-08T16:08:55.445304+0000","last_became_active":"2023-10-08T16:08:55.445049+0000","last_became_peered":"2023-10-08T16:08:55.445049+0000","last_unstale":"2023-10-08T16:08:55.445304+0000","last_undegraded":"2023-10-08T16:08:55.445304+0000","last_fullsized":"2023-10-08T16:08:55.445304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:46.859406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443361+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.444963+0000","last_change":"2023-10-08T16:08:55.444963+0000","last_active":"2023-10-08T16:08:55.444963+0000","last_peered":"2023-10-08T16:08:55.444963+0000","last_clean":"2023-10-08T16:08:55.444963+0000","last_became_active":"2023-10-08T16:08:55.444708+0000","last_became_peered":"2023-10-08T16:08:55.444708+0000","last_unstale":"2023-10-08T16:08:55.444963+0000","last_undegraded":"2023-10-08T16:08:55.444963+0000","last_fullsized":"2023-10-08T16:08:55.444963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443902+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448320+0000","last_change":"2023-10-08T16:08:55.448320+0000","last_active":"2023-10-08T16:08:55.448320+0000","last_peered":"2023-10-08T16:08:55.448320+0000","last_clean":"2023-10-08T16:08:55.448320+0000","last_became_active":"2023-10-08T16:08:55.448092+0000","last_became_peered":"2023-10-08T16:08:55.448092+0000","last_unstale":"2023-10-08T16:08:55.448320+0000","last_undegraded":"2023-10-08T16:08:55.448320+0000","last_fullsized":"2023-10-08T16:08:55.448320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:55.828614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443845+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.449538+0000","last_change":"2023-10-08T16:08:55.449538+0000","last_active":"2023-10-08T16:08:55.449538+0000","last_peered":"2023-10-08T16:08:55.449538+0000","last_clean":"2023-10-08T16:08:55.449538+0000","last_became_active":"2023-10-08T16:08:55.449266+0000","last_became_peered":"2023-10-08T16:08:55.449266+0000","last_unstale":"2023-10-08T16:08:55.449538+0000","last_undegraded":"2023-10-08T16:08:55.449538+0000","last_fullsized":"2023-10-08T16:08:55.449538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:45.246024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444529+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451262+0000","last_change":"2023-10-08T16:08:55.451262+0000","last_active":"2023-10-08T16:08:55.451262+0000","last_peered":"2023-10-08T16:08:55.451262+0000","last_clean":"2023-10-08T16:08:55.451262+0000","last_became_active":"2023-10-08T16:08:55.451044+0000","last_became_peered":"2023-10-08T16:08:55.451044+0000","last_unstale":"2023-10-08T16:08:55.451262+0000","last_undegraded":"2023-10-08T16:08:55.451262+0000","last_fullsized":"2023-10-08T16:08:55.451262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:51.332489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439947+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:15.894284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.441810+0000","last_change":"2023-10-08T16:08:55.441810+0000","last_active":"2023-10-08T16:08:55.441810+0000","last_peered":"2023-10-08T16:08:55.441810+0000","last_clean":"2023-10-08T16:08:55.441810+0000","last_became_active":"2023-10-08T16:08:55.441123+0000","last_became_peered":"2023-10-08T16:08:55.441123+0000","last_unstale":"2023-10-08T16:08:55.441810+0000","last_undegraded":"2023-10-08T16:08:55.441810+0000","last_fullsized":"2023-10-08T16:08:55.441810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:37.519813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448258+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450231+0000","last_change":"2023-10-08T16:08:55.450231+0000","last_active":"2023-10-08T16:08:55.450231+0000","last_peered":"2023-10-08T16:08:55.450231+0000","last_clean":"2023-10-08T16:08:55.450231+0000","last_became_active":"2023-10-08T16:08:55.450004+0000","last_became_peered":"2023-10-08T16:08:55.450004+0000","last_unstale":"2023-10-08T16:08:55.450231+0000","last_undegraded":"2023-10-08T16:08:55.450231+0000","last_fullsized":"2023-10-08T16:08:55.450231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440551+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:11.414378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.453605+0000","last_change":"2023-10-08T16:08:55.453605+0000","last_active":"2023-10-08T16:08:55.453605+0000","last_peered":"2023-10-08T16:08:55.453605+0000","last_clean":"2023-10-08T16:08:55.453605+0000","last_became_active":"2023-10-08T16:08:55.452990+0000","last_became_peered":"2023-10-08T16:08:55.452990+0000","last_unstale":"2023-10-08T16:08:55.453605+0000","last_undegraded":"2023-10-08T16:08:55.453605+0000","last_fullsized":"2023-10-08T16:08:55.453605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:32.746669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448085+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:32.998704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447467+0000","last_change":"2023-10-08T16:08:55.447467+0000","last_active":"2023-10-08T16:08:55.447467+0000","last_peered":"2023-10-08T16:08:55.447467+0000","last_clean":"2023-10-08T16:08:55.447467+0000","last_became_active":"2023-10-08T16:08:55.447066+0000","last_became_peered":"2023-10-08T16:08:55.447066+0000","last_unstale":"2023-10-08T16:08:55.447467+0000","last_undegraded":"2023-10-08T16:08:55.447467+0000","last_fullsized":"2023-10-08T16:08:55.447467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.438745+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:47.761359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446817+0000","last_change":"2023-10-08T16:08:55.446817+0000","last_active":"2023-10-08T16:08:55.446817+0000","last_peered":"2023-10-08T16:08:55.446817+0000","last_clean":"2023-10-08T16:08:55.446817+0000","last_became_active":"2023-10-08T16:08:55.446562+0000","last_became_peered":"2023-10-08T16:08:55.446562+0000","last_unstale":"2023-10-08T16:08:55.446817+0000","last_undegraded":"2023-10-08T16:08:55.446817+0000","last_fullsized":"2023-10-08T16:08:55.446817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T16:08:54.435264+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:08:54.435264+0000","last_peered":"2023-10-08T16:08:54.435264+0000","last_clean":"2023-10-08T16:08:54.435264+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:08:54.435264+0000","last_undegraded":"2023-10-08T16:08:54.435264+0000","last_fullsized":"2023-10-08T16:08:54.435264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.432}]},{"osd":1,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":1.756,"15min":1.756},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.625,"5min":1.79,"15min":1.79},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60199999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81100000000000005,"5min":1.823,"15min":1.823},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57299999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67400000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.745,"15min":0.745},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.495},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.437},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.439,"15min":0.434},"min":{"1min":0.316,"5min":0.249,"15min":0.249},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53200000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65200000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.755},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60499999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379}]},{"osd":7,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.621,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.45600000000000002,"15min":0.499},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":3.593,"15min":3.593},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.27600000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.45200000000000001,"15min":0.48599999999999999},"min":{"1min":0.23799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55900000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.39200000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.434,"15min":0.44700000000000001},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68300000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.26800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.46999999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94799999999999995,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.435,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.505}]},{"osd":5,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88,"5min":3.532,"15min":3.532},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.71999999999999997,"15min":0.75},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.41899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58599999999999997,"5min":2.254,"15min":2.254},"last":0.35999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61499999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.32400000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.379},"min":{"1min":0.30299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.377},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.748},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.55800000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.52000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83199999999999996,"5min":1.079,"15min":1.079},"last":0.83199999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.55100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":2.355,"15min":2.355},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.002},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.55600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.374}]},{"osd":1,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.67100000000000004,"5min":0.746,"15min":0.746},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74099999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.66400000000000003},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.55500000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.5,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.745}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.378}]},{"osd":1,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.628,"15min":0.628},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.026},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70199999999999996,"5min":1.141,"15min":1.141},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":1.149,"15min":1.149},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67300000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.70099999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":14.6,"15min":14.6},"last":0.48499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.56899999999999995},"min":{"1min":0.46400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":7.556,"15min":7.556},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.33000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.497},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.46100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.51300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.39500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73999999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.373}]},{"osd":6,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.35899999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.316},"max":{"1min":0.755,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57099999999999995}]}]}],"pool_statfs":[]}} 2023-10-08T16:09:00.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:00.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.707+0000 7f3ad8046700 1 Processor -- start 2023-10-08T16:09:00.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.708+0000 7f3ad8046700 1 -- start start 2023-10-08T16:09:00.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad8046700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 0x7f3ad0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad8046700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad015cbb0 con 0x7f3ad015a620 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad8046700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad015bfa0 con 0x7f3ad0157870 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad8046700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad015bdb0 con 0x7f3ad0157c40 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad55e1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3ad015a620 0x7f3ad015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50872/0 (socket says 172.21.15.60:50872) 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad55e1700 1 -- 172.21.15.60:0/4291933701 learned_addr learned my addr 172.21.15.60:0/4291933701 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad65e3700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 0x7f3ad0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946955123 0 0) 0x7f3ad015cbb0 con 0x7f3ad015a620 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ab8003570 con 0x7f3ad015a620 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732446675 0 0) 0x7f3ad015bfa0 con 0x7f3ad0157870 2023-10-08T16:09:00.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad015cbb0 con 0x7f3ad0157870 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812941121 0 0) 0x7f3ab8003570 con 0x7f3ad015a620 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 msgr2=0x7f3ad0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 0x7f3ad0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 >> v1:172.21.15.144:6789/0 conn(0x7f3ad0157870 legacy=0x7f3ad015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad015c280 con 0x7f3ad015a620 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f3ac4001470 con 0x7f3ad015a620 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 >> v1:172.21.15.60:6789/0 conn(0x7f3ad015a620 legacy=0x7f3ad015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ab8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 0x7f3ab8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab800bbf0 con 0x7f3ab8003c20 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab800bd30 con 0x7f3ab8004d50 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.709+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab800bea0 con 0x7f3ad0157c40 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ab8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad55e1700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 0x7f3ab8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad65e3700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 -- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 msgr2=0x7f3ab8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad0157c40 0x7f3ab8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 -- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab8004d50 msgr2=0x7f3ab80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 -- 172.21.15.60:0/4291933701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8003570 con 0x7f3ab8003c20 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad65e3700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ab8004010 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80019e0 tx=0x7f3ac8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b18c87183c59e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800c5d0 con 0x7f3ab8003c20 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac800c730 con 0x7f3ab8003c20 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.710+0000 7f3ad4de0700 1 -- 172.21.15.60:0/4291933701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800cad0 con 0x7f3ab8003c20 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad8046700 1 -- 172.21.15.60:0/4291933701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 msgr2=0x7f3ab8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad8046700 1 --2- 172.21.15.60:0/4291933701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ab8004010 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80019e0 tx=0x7f3ac8007d30 comp rx=0 tx=0).stop 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad65e3700 1 -- 172.21.15.60:0/4291933701 reap_dead start 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad8046700 1 -- 172.21.15.60:0/4291933701 shutdown_connections 2023-10-08T16:09:00.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad8046700 1 -- 172.21.15.60:0/4291933701 >> 172.21.15.60:0/4291933701 conn(0x7f3ad0068ce0 msgr2=0x7f3ad00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad8046700 1 -- 172.21.15.60:0/4291933701 shutdown_connections 2023-10-08T16:09:00.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.711+0000 7f3ad8046700 1 -- 172.21.15.60:0/4291933701 wait complete. 2023-10-08T16:09:00.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.712+0000 7f3ad8046700 1 Processor -- start 2023-10-08T16:09:00.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.712+0000 7f3ad8046700 1 -- start start 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ad01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad015f150 0x7f3ad015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ad00a8490 0x7f3ad00a8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad015ecc0 con 0x7f3ab8003c20 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0156620 con 0x7f3ad00a8490 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad015e0b0 con 0x7f3ad015f150 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ad01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ad01560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47172/0 (socket says 172.21.15.60:47172) 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 -- 172.21.15.60:0/1443469499 learned_addr learned my addr 172.21.15.60:0/1443469499 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad65e3700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ad00a8490 0x7f3ad00a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad55e1700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad015f150 0x7f3ad015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 -- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad015f150 msgr2=0x7f3ad015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad015f150 0x7f3ad015f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 -- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ad00a8490 msgr2=0x7f3ad00a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ad00a8490 0x7f3ad00a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 -- 172.21.15.60:0/1443469499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad015e390 con 0x7f3ab8003c20 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad65e3700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ad00a8490 0x7f3ad00a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad55e1700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad015f150 0x7f3ad015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad5de2700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ad01560e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800c3c0 tx=0x7f3ac8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800c5d0 con 0x7f3ab8003c20 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac8001360 con 0x7f3ab8003c20 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800ce40 con 0x7f3ab8003c20 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.713+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad015e670 con 0x7f3ab8003c20 2023-10-08T16:09:00.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.714+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad016a9a0 con 0x7f3ab8003c20 2023-10-08T16:09:00.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.714+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad015eb10 con 0x7f3ab8003c20 2023-10-08T16:09:00.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.715+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ac8019070 con 0x7f3ab8003c20 2023-10-08T16:09:00.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.715+0000 7f3acdffb700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3abc066f30 0x7f3abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.715+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ac8085030 con 0x7f3ab8003c20 2023-10-08T16:09:00.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.715+0000 7f3ad55e1700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3abc066f30 0x7f3abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.716+0000 7f3ad55e1700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3abc066f30 0x7f3abc0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4001bb0 tx=0x7f3ac4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.720+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ac80522a0 con 0x7f3ab8003c20 2023-10-08T16:09:00.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.908+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ad004c3c0 con 0x7f3abc066f30 2023-10-08T16:09:00.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.917+0000 7f3acdffb700 1 -- 172.21.15.60:0/1443469499 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282060 (secure 0 0 0) 0x7f3ad004c3c0 con 0x7f3abc066f30 2023-10-08T16:09:00.921 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3abc066f30 msgr2=0x7f3abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3abc066f30 0x7f3abc0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4001bb0 tx=0x7f3ac4009040 comp rx=0 tx=0).stop 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 msgr2=0x7f3ad01560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ad01560e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800c3c0 tx=0x7f3ac8015000 comp rx=0 tx=0).stop 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 shutdown_connections 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3abc066f30 0x7f3abc0693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ad00a8490 0x7f3ad00a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab8003c20 0x7f3ad01560e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 --2- 172.21.15.60:0/1443469499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ad015f150 0x7f3ad015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 >> 172.21.15.60:0/1443469499 conn(0x7f3ad0068ce0 msgr2=0x7f3ad00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 shutdown_connections 2023-10-08T16:09:00.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:00.920+0000 7f3ad8046700 1 -- 172.21.15.60:0/1443469499 wait complete. 2023-10-08T16:09:00.925 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:09:00.933 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-10-08T16:08:59.611732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558194,"statfs":{"total":1600000000,"available":1595591035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.181590"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447737+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449905+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440058+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:09.261184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440973+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:33.751516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439572+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:56.610835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.450300+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445023+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.452245+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440953+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:52.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446866+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444754+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439785+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:50.657018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444154+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440499+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:10.959156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445772+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448915+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440485+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:39.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440906+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:54.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449497+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445394+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448486+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448095+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443451+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444125+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446501+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444897+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.442377+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:14.576369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449795+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439267+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:36.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446416+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444475+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448981+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447302+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451725+0000","last_change":"2023-10-08T16:08:55.451725+0000","last_active":"2023-10-08T16:08:55.451725+0000","last_peered":"2023-10-08T16:08:55.451725+0000","last_clean":"2023-10-08T16:08:55.451725+0000","last_became_active":"2023-10-08T16:08:55.451533+0000","last_became_peered":"2023-10-08T16:08:55.451533+0000","last_unstale":"2023-10-08T16:08:55.451725+0000","last_undegraded":"2023-10-08T16:08:55.451725+0000","last_fullsized":"2023-10-08T16:08:55.451725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:55.460997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439710+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:04.919950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.449671+0000","last_change":"2023-10-08T16:08:55.449671+0000","last_active":"2023-10-08T16:08:55.449671+0000","last_peered":"2023-10-08T16:08:55.449671+0000","last_clean":"2023-10-08T16:08:55.449671+0000","last_became_active":"2023-10-08T16:08:55.449136+0000","last_became_peered":"2023-10-08T16:08:55.449136+0000","last_unstale":"2023-10-08T16:08:55.449671+0000","last_undegraded":"2023-10-08T16:08:55.449671+0000","last_fullsized":"2023-10-08T16:08:55.449671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:09.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448633+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:47.343632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.454471+0000","last_change":"2023-10-08T16:08:55.454471+0000","last_active":"2023-10-08T16:08:55.454471+0000","last_peered":"2023-10-08T16:08:55.454471+0000","last_clean":"2023-10-08T16:08:55.454471+0000","last_became_active":"2023-10-08T16:08:55.454025+0000","last_became_peered":"2023-10-08T16:08:55.454025+0000","last_unstale":"2023-10-08T16:08:55.454471+0000","last_undegraded":"2023-10-08T16:08:55.454471+0000","last_fullsized":"2023-10-08T16:08:55.454471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.883624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444776+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447549+0000","last_change":"2023-10-08T16:08:55.447549+0000","last_active":"2023-10-08T16:08:55.447549+0000","last_peered":"2023-10-08T16:08:55.447549+0000","last_clean":"2023-10-08T16:08:55.447549+0000","last_became_active":"2023-10-08T16:08:55.447129+0000","last_became_peered":"2023-10-08T16:08:55.447129+0000","last_unstale":"2023-10-08T16:08:55.447549+0000","last_undegraded":"2023-10-08T16:08:55.447549+0000","last_fullsized":"2023-10-08T16:08:55.447549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:10.409532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444244+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450237+0000","last_change":"2023-10-08T16:08:55.450237+0000","last_active":"2023-10-08T16:08:55.450237+0000","last_peered":"2023-10-08T16:08:55.450237+0000","last_clean":"2023-10-08T16:08:55.450237+0000","last_became_active":"2023-10-08T16:08:55.449996+0000","last_became_peered":"2023-10-08T16:08:55.449996+0000","last_unstale":"2023-10-08T16:08:55.450237+0000","last_undegraded":"2023-10-08T16:08:55.450237+0000","last_fullsized":"2023-10-08T16:08:55.450237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:38.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447695+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446310+0000","last_change":"2023-10-08T16:08:55.446310+0000","last_active":"2023-10-08T16:08:55.446310+0000","last_peered":"2023-10-08T16:08:55.446310+0000","last_clean":"2023-10-08T16:08:55.446310+0000","last_became_active":"2023-10-08T16:08:55.446055+0000","last_became_peered":"2023-10-08T16:08:55.446055+0000","last_unstale":"2023-10-08T16:08:55.446310+0000","last_undegraded":"2023-10-08T16:08:55.446310+0000","last_fullsized":"2023-10-08T16:08:55.446310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:10.879816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439132+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:44.567117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450571+0000","last_change":"2023-10-08T16:08:55.450571+0000","last_active":"2023-10-08T16:08:55.450571+0000","last_peered":"2023-10-08T16:08:55.450571+0000","last_clean":"2023-10-08T16:08:55.450571+0000","last_became_active":"2023-10-08T16:08:55.450334+0000","last_became_peered":"2023-10-08T16:08:55.450334+0000","last_unstale":"2023-10-08T16:08:55.450571+0000","last_undegraded":"2023-10-08T16:08:55.450571+0000","last_fullsized":"2023-10-08T16:08:55.450571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:52.239027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447306+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.438753+0000","last_change":"2023-10-08T16:08:55.438753+0000","last_active":"2023-10-08T16:08:55.438753+0000","last_peered":"2023-10-08T16:08:55.438753+0000","last_clean":"2023-10-08T16:08:55.438753+0000","last_became_active":"2023-10-08T16:08:55.438500+0000","last_became_peered":"2023-10-08T16:08:55.438500+0000","last_unstale":"2023-10-08T16:08:55.438753+0000","last_undegraded":"2023-10-08T16:08:55.438753+0000","last_fullsized":"2023-10-08T16:08:55.438753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:55.385578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444422+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451505+0000","last_change":"2023-10-08T16:08:55.451505+0000","last_active":"2023-10-08T16:08:55.451505+0000","last_peered":"2023-10-08T16:08:55.451505+0000","last_clean":"2023-10-08T16:08:55.451505+0000","last_became_active":"2023-10-08T16:08:55.451279+0000","last_became_peered":"2023-10-08T16:08:55.451279+0000","last_unstale":"2023-10-08T16:08:55.451505+0000","last_undegraded":"2023-10-08T16:08:55.451505+0000","last_fullsized":"2023-10-08T16:08:55.451505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444032+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.441612+0000","last_change":"2023-10-08T16:08:55.441612+0000","last_active":"2023-10-08T16:08:55.441612+0000","last_peered":"2023-10-08T16:08:55.441612+0000","last_clean":"2023-10-08T16:08:55.441612+0000","last_became_active":"2023-10-08T16:08:55.441363+0000","last_became_peered":"2023-10-08T16:08:55.441363+0000","last_unstale":"2023-10-08T16:08:55.441612+0000","last_undegraded":"2023-10-08T16:08:55.441612+0000","last_fullsized":"2023-10-08T16:08:55.441612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:49.652172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448047+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:14.011793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.444388+0000","last_change":"2023-10-08T16:08:55.444388+0000","last_active":"2023-10-08T16:08:55.444388+0000","last_peered":"2023-10-08T16:08:55.444388+0000","last_clean":"2023-10-08T16:08:55.444388+0000","last_became_active":"2023-10-08T16:08:55.443861+0000","last_became_peered":"2023-10-08T16:08:55.443861+0000","last_unstale":"2023-10-08T16:08:55.444388+0000","last_undegraded":"2023-10-08T16:08:55.444388+0000","last_fullsized":"2023-10-08T16:08:55.444388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:39.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439294+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:18.897301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446100+0000","last_change":"2023-10-08T16:08:55.446100+0000","last_active":"2023-10-08T16:08:55.446100+0000","last_peered":"2023-10-08T16:08:55.446100+0000","last_clean":"2023-10-08T16:08:55.446100+0000","last_became_active":"2023-10-08T16:08:55.445020+0000","last_became_peered":"2023-10-08T16:08:55.445020+0000","last_unstale":"2023-10-08T16:08:55.446100+0000","last_undegraded":"2023-10-08T16:08:55.446100+0000","last_fullsized":"2023-10-08T16:08:55.446100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443631+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450684+0000","last_change":"2023-10-08T16:08:55.450684+0000","last_active":"2023-10-08T16:08:55.450684+0000","last_peered":"2023-10-08T16:08:55.450684+0000","last_clean":"2023-10-08T16:08:55.450684+0000","last_became_active":"2023-10-08T16:08:55.450407+0000","last_became_peered":"2023-10-08T16:08:55.450407+0000","last_unstale":"2023-10-08T16:08:55.450684+0000","last_undegraded":"2023-10-08T16:08:55.450684+0000","last_fullsized":"2023-10-08T16:08:55.450684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:52.823655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443451+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447354+0000","last_change":"2023-10-08T16:08:55.447354+0000","last_active":"2023-10-08T16:08:55.447354+0000","last_peered":"2023-10-08T16:08:55.447354+0000","last_clean":"2023-10-08T16:08:55.447354+0000","last_became_active":"2023-10-08T16:08:55.446789+0000","last_became_peered":"2023-10-08T16:08:55.446789+0000","last_unstale":"2023-10-08T16:08:55.447354+0000","last_undegraded":"2023-10-08T16:08:55.447354+0000","last_fullsized":"2023-10-08T16:08:55.447354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:52.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443767+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446159+0000","last_change":"2023-10-08T16:08:55.446159+0000","last_active":"2023-10-08T16:08:55.446159+0000","last_peered":"2023-10-08T16:08:55.446159+0000","last_clean":"2023-10-08T16:08:55.446159+0000","last_became_active":"2023-10-08T16:08:55.445930+0000","last_became_peered":"2023-10-08T16:08:55.445930+0000","last_unstale":"2023-10-08T16:08:55.446159+0000","last_undegraded":"2023-10-08T16:08:55.446159+0000","last_fullsized":"2023-10-08T16:08:55.446159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:15.925120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440233+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:45.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.453453+0000","last_change":"2023-10-08T16:08:55.453453+0000","last_active":"2023-10-08T16:08:55.453453+0000","last_peered":"2023-10-08T16:08:55.453453+0000","last_clean":"2023-10-08T16:08:55.453453+0000","last_became_active":"2023-10-08T16:08:55.452722+0000","last_became_peered":"2023-10-08T16:08:55.452722+0000","last_unstale":"2023-10-08T16:08:55.453453+0000","last_undegraded":"2023-10-08T16:08:55.453453+0000","last_fullsized":"2023-10-08T16:08:55.453453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:13.006947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446141+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447305+0000","last_change":"2023-10-08T16:08:55.447305+0000","last_active":"2023-10-08T16:08:55.447305+0000","last_peered":"2023-10-08T16:08:55.447305+0000","last_clean":"2023-10-08T16:08:55.447305+0000","last_became_active":"2023-10-08T16:08:55.446735+0000","last_became_peered":"2023-10-08T16:08:55.446735+0000","last_unstale":"2023-10-08T16:08:55.447305+0000","last_undegraded":"2023-10-08T16:08:55.447305+0000","last_fullsized":"2023-10-08T16:08:55.447305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:09.573102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446929+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.454617+0000","last_change":"2023-10-08T16:08:55.454617+0000","last_active":"2023-10-08T16:08:55.454617+0000","last_peered":"2023-10-08T16:08:55.454617+0000","last_clean":"2023-10-08T16:08:55.454617+0000","last_became_active":"2023-10-08T16:08:55.454282+0000","last_became_peered":"2023-10-08T16:08:55.454282+0000","last_unstale":"2023-10-08T16:08:55.454617+0000","last_undegraded":"2023-10-08T16:08:55.454617+0000","last_fullsized":"2023-10-08T16:08:55.454617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:31.993858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439396+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:53.830593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450793+0000","last_change":"2023-10-08T16:08:55.450793+0000","last_active":"2023-10-08T16:08:55.450793+0000","last_peered":"2023-10-08T16:08:55.450793+0000","last_clean":"2023-10-08T16:08:55.450793+0000","last_became_active":"2023-10-08T16:08:55.450547+0000","last_became_peered":"2023-10-08T16:08:55.450547+0000","last_unstale":"2023-10-08T16:08:55.450793+0000","last_undegraded":"2023-10-08T16:08:55.450793+0000","last_fullsized":"2023-10-08T16:08:55.450793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:19.588783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439211+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:28.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.452317+0000","last_change":"2023-10-08T16:08:55.452317+0000","last_active":"2023-10-08T16:08:55.452317+0000","last_peered":"2023-10-08T16:08:55.452317+0000","last_clean":"2023-10-08T16:08:55.452317+0000","last_became_active":"2023-10-08T16:08:55.452086+0000","last_became_peered":"2023-10-08T16:08:55.452086+0000","last_unstale":"2023-10-08T16:08:55.452317+0000","last_undegraded":"2023-10-08T16:08:55.452317+0000","last_fullsized":"2023-10-08T16:08:55.452317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:23.064317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439542+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:32.889281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450948+0000","last_change":"2023-10-08T16:08:55.450948+0000","last_active":"2023-10-08T16:08:55.450948+0000","last_peered":"2023-10-08T16:08:55.450948+0000","last_clean":"2023-10-08T16:08:55.450948+0000","last_became_active":"2023-10-08T16:08:55.450483+0000","last_became_peered":"2023-10-08T16:08:55.450483+0000","last_unstale":"2023-10-08T16:08:55.450948+0000","last_undegraded":"2023-10-08T16:08:55.450948+0000","last_fullsized":"2023-10-08T16:08:55.450948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:20.089680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.441412+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:55.331830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448307+0000","last_change":"2023-10-08T16:08:55.448307+0000","last_active":"2023-10-08T16:08:55.448307+0000","last_peered":"2023-10-08T16:08:55.448307+0000","last_clean":"2023-10-08T16:08:55.448307+0000","last_became_active":"2023-10-08T16:08:55.448064+0000","last_became_peered":"2023-10-08T16:08:55.448064+0000","last_unstale":"2023-10-08T16:08:55.448307+0000","last_undegraded":"2023-10-08T16:08:55.448307+0000","last_fullsized":"2023-10-08T16:08:55.448307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:12.916924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.438714+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:31.485982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.445304+0000","last_change":"2023-10-08T16:08:55.445304+0000","last_active":"2023-10-08T16:08:55.445304+0000","last_peered":"2023-10-08T16:08:55.445304+0000","last_clean":"2023-10-08T16:08:55.445304+0000","last_became_active":"2023-10-08T16:08:55.445049+0000","last_became_peered":"2023-10-08T16:08:55.445049+0000","last_unstale":"2023-10-08T16:08:55.445304+0000","last_undegraded":"2023-10-08T16:08:55.445304+0000","last_fullsized":"2023-10-08T16:08:55.445304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:46.859406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443361+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.444963+0000","last_change":"2023-10-08T16:08:55.444963+0000","last_active":"2023-10-08T16:08:55.444963+0000","last_peered":"2023-10-08T16:08:55.444963+0000","last_clean":"2023-10-08T16:08:55.444963+0000","last_became_active":"2023-10-08T16:08:55.444708+0000","last_became_peered":"2023-10-08T16:08:55.444708+0000","last_unstale":"2023-10-08T16:08:55.444963+0000","last_undegraded":"2023-10-08T16:08:55.444963+0000","last_fullsized":"2023-10-08T16:08:55.444963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443902+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448320+0000","last_change":"2023-10-08T16:08:55.448320+0000","last_active":"2023-10-08T16:08:55.448320+0000","last_peered":"2023-10-08T16:08:55.448320+0000","last_clean":"2023-10-08T16:08:55.448320+0000","last_became_active":"2023-10-08T16:08:55.448092+0000","last_became_peered":"2023-10-08T16:08:55.448092+0000","last_unstale":"2023-10-08T16:08:55.448320+0000","last_undegraded":"2023-10-08T16:08:55.448320+0000","last_fullsized":"2023-10-08T16:08:55.448320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:55.828614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443845+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.449538+0000","last_change":"2023-10-08T16:08:55.449538+0000","last_active":"2023-10-08T16:08:55.449538+0000","last_peered":"2023-10-08T16:08:55.449538+0000","last_clean":"2023-10-08T16:08:55.449538+0000","last_became_active":"2023-10-08T16:08:55.449266+0000","last_became_peered":"2023-10-08T16:08:55.449266+0000","last_unstale":"2023-10-08T16:08:55.449538+0000","last_undegraded":"2023-10-08T16:08:55.449538+0000","last_fullsized":"2023-10-08T16:08:55.449538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:45.246024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444529+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451262+0000","last_change":"2023-10-08T16:08:55.451262+0000","last_active":"2023-10-08T16:08:55.451262+0000","last_peered":"2023-10-08T16:08:55.451262+0000","last_clean":"2023-10-08T16:08:55.451262+0000","last_became_active":"2023-10-08T16:08:55.451044+0000","last_became_peered":"2023-10-08T16:08:55.451044+0000","last_unstale":"2023-10-08T16:08:55.451262+0000","last_undegraded":"2023-10-08T16:08:55.451262+0000","last_fullsized":"2023-10-08T16:08:55.451262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:51.332489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439947+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:15.894284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.441810+0000","last_change":"2023-10-08T16:08:55.441810+0000","last_active":"2023-10-08T16:08:55.441810+0000","last_peered":"2023-10-08T16:08:55.441810+0000","last_clean":"2023-10-08T16:08:55.441810+0000","last_became_active":"2023-10-08T16:08:55.441123+0000","last_became_peered":"2023-10-08T16:08:55.441123+0000","last_unstale":"2023-10-08T16:08:55.441810+0000","last_undegraded":"2023-10-08T16:08:55.441810+0000","last_fullsized":"2023-10-08T16:08:55.441810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:37.519813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448258+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450231+0000","last_change":"2023-10-08T16:08:55.450231+0000","last_active":"2023-10-08T16:08:55.450231+0000","last_peered":"2023-10-08T16:08:55.450231+0000","last_clean":"2023-10-08T16:08:55.450231+0000","last_became_active":"2023-10-08T16:08:55.450004+0000","last_became_peered":"2023-10-08T16:08:55.450004+0000","last_unstale":"2023-10-08T16:08:55.450231+0000","last_undegraded":"2023-10-08T16:08:55.450231+0000","last_fullsized":"2023-10-08T16:08:55.450231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440551+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:11.414378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.453605+0000","last_change":"2023-10-08T16:08:55.453605+0000","last_active":"2023-10-08T16:08:55.453605+0000","last_peered":"2023-10-08T16:08:55.453605+0000","last_clean":"2023-10-08T16:08:55.453605+0000","last_became_active":"2023-10-08T16:08:55.452990+0000","last_became_peered":"2023-10-08T16:08:55.452990+0000","last_unstale":"2023-10-08T16:08:55.453605+0000","last_undegraded":"2023-10-08T16:08:55.453605+0000","last_fullsized":"2023-10-08T16:08:55.453605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:32.746669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448085+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:32.998704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447467+0000","last_change":"2023-10-08T16:08:55.447467+0000","last_active":"2023-10-08T16:08:55.447467+0000","last_peered":"2023-10-08T16:08:55.447467+0000","last_clean":"2023-10-08T16:08:55.447467+0000","last_became_active":"2023-10-08T16:08:55.447066+0000","last_became_peered":"2023-10-08T16:08:55.447066+0000","last_unstale":"2023-10-08T16:08:55.447467+0000","last_undegraded":"2023-10-08T16:08:55.447467+0000","last_fullsized":"2023-10-08T16:08:55.447467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.438745+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:47.761359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446817+0000","last_change":"2023-10-08T16:08:55.446817+0000","last_active":"2023-10-08T16:08:55.446817+0000","last_peered":"2023-10-08T16:08:55.446817+0000","last_clean":"2023-10-08T16:08:55.446817+0000","last_became_active":"2023-10-08T16:08:55.446562+0000","last_became_peered":"2023-10-08T16:08:55.446562+0000","last_unstale":"2023-10-08T16:08:55.446817+0000","last_undegraded":"2023-10-08T16:08:55.446817+0000","last_fullsized":"2023-10-08T16:08:55.446817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T16:08:54.435264+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:08:54.435264+0000","last_peered":"2023-10-08T16:08:54.435264+0000","last_clean":"2023-10-08T16:08:54.435264+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:08:54.435264+0000","last_undegraded":"2023-10-08T16:08:54.435264+0000","last_fullsized":"2023-10-08T16:08:54.435264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.432}]},{"osd":1,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":1.756,"15min":1.756},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.625,"5min":1.79,"15min":1.79},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60199999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81100000000000005,"5min":1.823,"15min":1.823},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57299999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67400000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.745,"15min":0.745},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.495},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.437},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.439,"15min":0.434},"min":{"1min":0.316,"5min":0.249,"15min":0.249},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53200000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65200000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.755},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60499999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379}]},{"osd":7,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.621,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.45600000000000002,"15min":0.499},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":3.593,"15min":3.593},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.27600000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.45200000000000001,"15min":0.48599999999999999},"min":{"1min":0.23799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55900000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.39200000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.434,"15min":0.44700000000000001},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68300000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.26800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.46999999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94799999999999995,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.435,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.505}]},{"osd":5,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88,"5min":3.532,"15min":3.532},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.71999999999999997,"15min":0.75},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.41899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58599999999999997,"5min":2.254,"15min":2.254},"last":0.35999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61499999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.32400000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.379},"min":{"1min":0.30299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.377},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.748},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.55800000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.52000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83199999999999996,"5min":1.079,"15min":1.079},"last":0.83199999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.55100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":2.355,"15min":2.355},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.002},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.55600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.374}]},{"osd":1,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.67100000000000004,"5min":0.746,"15min":0.746},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74099999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.66400000000000003},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.55500000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.5,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.745}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.378}]},{"osd":1,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.628,"15min":0.628},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.026},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70199999999999996,"5min":1.141,"15min":1.141},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":1.149,"15min":1.149},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67300000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.70099999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":14.6,"15min":14.6},"last":0.48499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.56899999999999995},"min":{"1min":0.46400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":7.556,"15min":7.556},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.33000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.497},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.46100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.51300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.39500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73999999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.373}]},{"osd":6,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.35899999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.316},"max":{"1min":0.755,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57099999999999995}]}]}],"pool_statfs":[]}} 2023-10-08T16:09:00.940 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.090+0000 7f1ff5989700 1 Processor -- start 2023-10-08T16:09:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.090+0000 7f1ff5989700 1 -- start start 2023-10-08T16:09:01.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1ff5989700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ff0157870 0x7f1ff015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1ff5989700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ff0157c40 0x7f1ff0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1ff5989700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff015cbb0 con 0x7f1ff015a620 2023-10-08T16:09:01.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1ff5989700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff015bfa0 con 0x7f1ff0157870 2023-10-08T16:09:01.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1ff5989700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff015c280 con 0x7f1ff0157c40 2023-10-08T16:09:01.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1feeffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ff0157870 0x7f1ff015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1feeffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ff0157870 0x7f1ff015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47182/0 (socket says 172.21.15.60:47182) 2023-10-08T16:09:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.091+0000 7f1feeffd700 1 -- 172.21.15.60:0/3749247570 learned_addr learned my addr 172.21.15.60:0/3749247570 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1fef7fe700 1 --2- 172.21.15.60:0/3749247570 >> v2:172.21.15.144:3300/0 conn(0x7f1ff0157c40 0x7f1ff0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1feeffd700 1 -- 172.21.15.60:0/3749247570 >> v2:172.21.15.144:3300/0 conn(0x7f1ff0157c40 msgr2=0x7f1ff0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1feeffd700 1 --2- 172.21.15.60:0/3749247570 >> v2:172.21.15.144:3300/0 conn(0x7f1ff0157c40 0x7f1ff0158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1feeffd700 1 -- 172.21.15.60:0/3749247570 >> v1:172.21.15.144:6789/0 conn(0x7f1ff015a620 legacy=0x7f1ff015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1feeffd700 1 -- 172.21.15.60:0/3749247570 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff015c560 con 0x7f1ff0157870 2023-10-08T16:09:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1feeffd700 1 --2- 172.21.15.60:0/3749247570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff015b6a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1ff006b4e0 tx=0x7f1fe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736f7987696b3652 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1fedffb700 1 -- 172.21.15.60:0/3749247570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800b820 con 0x7f1ff0157870 2023-10-08T16:09:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1fedffb700 1 -- 172.21.15.60:0/3749247570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe800b980 con 0x7f1ff0157870 2023-10-08T16:09:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1fedffb700 1 -- 172.21.15.60:0/3749247570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800bd20 con 0x7f1ff0157870 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1ff5989700 1 -- 172.21.15.60:0/3749247570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 msgr2=0x7f1ff015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3749247570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff015b6a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1ff006b4e0 tx=0x7f1fe8009250 comp rx=0 tx=0).stop 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1ff5989700 1 -- 172.21.15.60:0/3749247570 shutdown_connections 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3749247570 >> v2:172.21.15.144:3300/0 conn(0x7f1ff0157c40 0x7f1ff0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3749247570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff015b6a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.092+0000 7f1ff5989700 1 -- 172.21.15.60:0/3749247570 >> 172.21.15.60:0/3749247570 conn(0x7f1ff0068ce0 msgr2=0x7f1ff00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.093+0000 7f1ff5989700 1 -- 172.21.15.60:0/3749247570 shutdown_connections 2023-10-08T16:09:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.093+0000 7f1ff5989700 1 -- 172.21.15.60:0/3749247570 wait complete. 2023-10-08T16:09:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 Processor -- start 2023-10-08T16:09:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 -- start start 2023-10-08T16:09:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff0154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff0157c40 0x7f1ff013cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff015a620 0x7f1ff0150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff0150fb0 con 0x7f1ff0157870 2023-10-08T16:09:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff0153be0 con 0x7f1ff0157c40 2023-10-08T16:09:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.094+0000 7f1ff5989700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff014e220 con 0x7f1ff015a620 2023-10-08T16:09:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff0154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff0154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47184/0 (socket says 172.21.15.60:47184) 2023-10-08T16:09:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 -- 172.21.15.60:0/3404112624 learned_addr learned my addr 172.21.15.60:0/3404112624 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1fef7fe700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff015a620 0x7f1ff0150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1fee7fc700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff0157c40 0x7f1ff013cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 -- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff015a620 msgr2=0x7f1ff0150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff015a620 0x7f1ff0150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 -- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff0157c40 msgr2=0x7f1ff013cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff0157c40 0x7f1ff013cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 -- 172.21.15.60:0/3404112624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80094f0 con 0x7f1ff0157870 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1fef7fe700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff015a620 0x7f1ff0150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:01.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1feeffd700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff0154070 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80030c0 tx=0x7f1fe8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011e60 con 0x7f1ff0157870 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8020070 con 0x7f1ff0157870 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff014e500 con 0x7f1ff0157870 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe801b6a0 con 0x7f1ff0157870 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.095+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff0151220 con 0x7f1ff0157870 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.096+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff004c3c0 con 0x7f1ff0157870 2023-10-08T16:09:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.097+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fe8022030 con 0x7f1ff0157870 2023-10-08T16:09:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.097+0000 7f1fe6ffd700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fd0066f30 0x7f1fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.097+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fe8086410 con 0x7f1ff0157870 2023-10-08T16:09:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.097+0000 7f1fee7fc700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fd0066f30 0x7f1fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.097+0000 7f1fee7fc700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fd0066f30 0x7f1fd00693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8006fd0 tx=0x7f1fd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.101+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fe8053680 con 0x7f1ff0157870 2023-10-08T16:09:01.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.291+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ff0153d20 con 0x7f1fd0066f30 2023-10-08T16:09:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.299+0000 7f1fe6ffd700 1 -- 172.21.15.60:0/3404112624 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282060 (secure 0 0 0) 0x7f1fd8009db0 con 0x7f1fd0066f30 2023-10-08T16:09:01.303 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.302+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fd0066f30 msgr2=0x7f1fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.302+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fd0066f30 0x7f1fd00693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8006fd0 tx=0x7f1fd8008040 comp rx=0 tx=0).stop 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.302+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 msgr2=0x7f1ff0154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.302+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff0154070 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80030c0 tx=0x7f1fe8016000 comp rx=0 tx=0).stop 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 shutdown_connections 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fd0066f30 0x7f1fd00693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff015a620 0x7f1ff0150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff0157870 0x7f1ff0154070 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 --2- 172.21.15.60:0/3404112624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff0157c40 0x7f1ff013cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 >> 172.21.15.60:0/3404112624 conn(0x7f1ff0068ce0 msgr2=0x7f1ff014d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 shutdown_connections 2023-10-08T16:09:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.303+0000 7f1ff5989700 1 -- 172.21.15.60:0/3404112624 wait complete. 2023-10-08T16:09:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:09:01.316 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-10-08T16:08:59.611732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558194,"statfs":{"total":1600000000,"available":1595591035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.181590"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447737+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449905+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440058+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:09.261184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440973+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:33.751516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439572+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:56.610835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.450300+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445023+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.452245+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440953+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:52.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446866+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444754+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439785+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:50.657018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444154+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440499+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:10.959156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445772+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448915+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440485+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:39.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440906+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:54.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449497+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.445394+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448486+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448095+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443451+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444125+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446501+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444897+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.442377+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:14.576369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.449795+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439267+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:36.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446416+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444475+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448981+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447302+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451725+0000","last_change":"2023-10-08T16:08:55.451725+0000","last_active":"2023-10-08T16:08:55.451725+0000","last_peered":"2023-10-08T16:08:55.451725+0000","last_clean":"2023-10-08T16:08:55.451725+0000","last_became_active":"2023-10-08T16:08:55.451533+0000","last_became_peered":"2023-10-08T16:08:55.451533+0000","last_unstale":"2023-10-08T16:08:55.451725+0000","last_undegraded":"2023-10-08T16:08:55.451725+0000","last_fullsized":"2023-10-08T16:08:55.451725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:55.460997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439710+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:04.919950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.449671+0000","last_change":"2023-10-08T16:08:55.449671+0000","last_active":"2023-10-08T16:08:55.449671+0000","last_peered":"2023-10-08T16:08:55.449671+0000","last_clean":"2023-10-08T16:08:55.449671+0000","last_became_active":"2023-10-08T16:08:55.449136+0000","last_became_peered":"2023-10-08T16:08:55.449136+0000","last_unstale":"2023-10-08T16:08:55.449671+0000","last_undegraded":"2023-10-08T16:08:55.449671+0000","last_fullsized":"2023-10-08T16:08:55.449671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:09.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448633+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:47.343632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.454471+0000","last_change":"2023-10-08T16:08:55.454471+0000","last_active":"2023-10-08T16:08:55.454471+0000","last_peered":"2023-10-08T16:08:55.454471+0000","last_clean":"2023-10-08T16:08:55.454471+0000","last_became_active":"2023-10-08T16:08:55.454025+0000","last_became_peered":"2023-10-08T16:08:55.454025+0000","last_unstale":"2023-10-08T16:08:55.454471+0000","last_undegraded":"2023-10-08T16:08:55.454471+0000","last_fullsized":"2023-10-08T16:08:55.454471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.883624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444776+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447549+0000","last_change":"2023-10-08T16:08:55.447549+0000","last_active":"2023-10-08T16:08:55.447549+0000","last_peered":"2023-10-08T16:08:55.447549+0000","last_clean":"2023-10-08T16:08:55.447549+0000","last_became_active":"2023-10-08T16:08:55.447129+0000","last_became_peered":"2023-10-08T16:08:55.447129+0000","last_unstale":"2023-10-08T16:08:55.447549+0000","last_undegraded":"2023-10-08T16:08:55.447549+0000","last_fullsized":"2023-10-08T16:08:55.447549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:10.409532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444244+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450237+0000","last_change":"2023-10-08T16:08:55.450237+0000","last_active":"2023-10-08T16:08:55.450237+0000","last_peered":"2023-10-08T16:08:55.450237+0000","last_clean":"2023-10-08T16:08:55.450237+0000","last_became_active":"2023-10-08T16:08:55.449996+0000","last_became_peered":"2023-10-08T16:08:55.449996+0000","last_unstale":"2023-10-08T16:08:55.450237+0000","last_undegraded":"2023-10-08T16:08:55.450237+0000","last_fullsized":"2023-10-08T16:08:55.450237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:38.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447695+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446310+0000","last_change":"2023-10-08T16:08:55.446310+0000","last_active":"2023-10-08T16:08:55.446310+0000","last_peered":"2023-10-08T16:08:55.446310+0000","last_clean":"2023-10-08T16:08:55.446310+0000","last_became_active":"2023-10-08T16:08:55.446055+0000","last_became_peered":"2023-10-08T16:08:55.446055+0000","last_unstale":"2023-10-08T16:08:55.446310+0000","last_undegraded":"2023-10-08T16:08:55.446310+0000","last_fullsized":"2023-10-08T16:08:55.446310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:10.879816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439132+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:44.567117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450571+0000","last_change":"2023-10-08T16:08:55.450571+0000","last_active":"2023-10-08T16:08:55.450571+0000","last_peered":"2023-10-08T16:08:55.450571+0000","last_clean":"2023-10-08T16:08:55.450571+0000","last_became_active":"2023-10-08T16:08:55.450334+0000","last_became_peered":"2023-10-08T16:08:55.450334+0000","last_unstale":"2023-10-08T16:08:55.450571+0000","last_undegraded":"2023-10-08T16:08:55.450571+0000","last_fullsized":"2023-10-08T16:08:55.450571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:52.239027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.447306+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.438753+0000","last_change":"2023-10-08T16:08:55.438753+0000","last_active":"2023-10-08T16:08:55.438753+0000","last_peered":"2023-10-08T16:08:55.438753+0000","last_clean":"2023-10-08T16:08:55.438753+0000","last_became_active":"2023-10-08T16:08:55.438500+0000","last_became_peered":"2023-10-08T16:08:55.438500+0000","last_unstale":"2023-10-08T16:08:55.438753+0000","last_undegraded":"2023-10-08T16:08:55.438753+0000","last_fullsized":"2023-10-08T16:08:55.438753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:55.385578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444422+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451505+0000","last_change":"2023-10-08T16:08:55.451505+0000","last_active":"2023-10-08T16:08:55.451505+0000","last_peered":"2023-10-08T16:08:55.451505+0000","last_clean":"2023-10-08T16:08:55.451505+0000","last_became_active":"2023-10-08T16:08:55.451279+0000","last_became_peered":"2023-10-08T16:08:55.451279+0000","last_unstale":"2023-10-08T16:08:55.451505+0000","last_undegraded":"2023-10-08T16:08:55.451505+0000","last_fullsized":"2023-10-08T16:08:55.451505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444032+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.441612+0000","last_change":"2023-10-08T16:08:55.441612+0000","last_active":"2023-10-08T16:08:55.441612+0000","last_peered":"2023-10-08T16:08:55.441612+0000","last_clean":"2023-10-08T16:08:55.441612+0000","last_became_active":"2023-10-08T16:08:55.441363+0000","last_became_peered":"2023-10-08T16:08:55.441363+0000","last_unstale":"2023-10-08T16:08:55.441612+0000","last_undegraded":"2023-10-08T16:08:55.441612+0000","last_fullsized":"2023-10-08T16:08:55.441612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:49.652172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448047+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:14.011793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.444388+0000","last_change":"2023-10-08T16:08:55.444388+0000","last_active":"2023-10-08T16:08:55.444388+0000","last_peered":"2023-10-08T16:08:55.444388+0000","last_clean":"2023-10-08T16:08:55.444388+0000","last_became_active":"2023-10-08T16:08:55.443861+0000","last_became_peered":"2023-10-08T16:08:55.443861+0000","last_unstale":"2023-10-08T16:08:55.444388+0000","last_undegraded":"2023-10-08T16:08:55.444388+0000","last_fullsized":"2023-10-08T16:08:55.444388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:39.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439294+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:18.897301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446100+0000","last_change":"2023-10-08T16:08:55.446100+0000","last_active":"2023-10-08T16:08:55.446100+0000","last_peered":"2023-10-08T16:08:55.446100+0000","last_clean":"2023-10-08T16:08:55.446100+0000","last_became_active":"2023-10-08T16:08:55.445020+0000","last_became_peered":"2023-10-08T16:08:55.445020+0000","last_unstale":"2023-10-08T16:08:55.446100+0000","last_undegraded":"2023-10-08T16:08:55.446100+0000","last_fullsized":"2023-10-08T16:08:55.446100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443631+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450684+0000","last_change":"2023-10-08T16:08:55.450684+0000","last_active":"2023-10-08T16:08:55.450684+0000","last_peered":"2023-10-08T16:08:55.450684+0000","last_clean":"2023-10-08T16:08:55.450684+0000","last_became_active":"2023-10-08T16:08:55.450407+0000","last_became_peered":"2023-10-08T16:08:55.450407+0000","last_unstale":"2023-10-08T16:08:55.450684+0000","last_undegraded":"2023-10-08T16:08:55.450684+0000","last_fullsized":"2023-10-08T16:08:55.450684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:52.823655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443451+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447354+0000","last_change":"2023-10-08T16:08:55.447354+0000","last_active":"2023-10-08T16:08:55.447354+0000","last_peered":"2023-10-08T16:08:55.447354+0000","last_clean":"2023-10-08T16:08:55.447354+0000","last_became_active":"2023-10-08T16:08:55.446789+0000","last_became_peered":"2023-10-08T16:08:55.446789+0000","last_unstale":"2023-10-08T16:08:55.447354+0000","last_undegraded":"2023-10-08T16:08:55.447354+0000","last_fullsized":"2023-10-08T16:08:55.447354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:52.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443767+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446159+0000","last_change":"2023-10-08T16:08:55.446159+0000","last_active":"2023-10-08T16:08:55.446159+0000","last_peered":"2023-10-08T16:08:55.446159+0000","last_clean":"2023-10-08T16:08:55.446159+0000","last_became_active":"2023-10-08T16:08:55.445930+0000","last_became_peered":"2023-10-08T16:08:55.445930+0000","last_unstale":"2023-10-08T16:08:55.446159+0000","last_undegraded":"2023-10-08T16:08:55.446159+0000","last_fullsized":"2023-10-08T16:08:55.446159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:15.925120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440233+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:45.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.453453+0000","last_change":"2023-10-08T16:08:55.453453+0000","last_active":"2023-10-08T16:08:55.453453+0000","last_peered":"2023-10-08T16:08:55.453453+0000","last_clean":"2023-10-08T16:08:55.453453+0000","last_became_active":"2023-10-08T16:08:55.452722+0000","last_became_peered":"2023-10-08T16:08:55.452722+0000","last_unstale":"2023-10-08T16:08:55.453453+0000","last_undegraded":"2023-10-08T16:08:55.453453+0000","last_fullsized":"2023-10-08T16:08:55.453453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:13.006947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446141+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447305+0000","last_change":"2023-10-08T16:08:55.447305+0000","last_active":"2023-10-08T16:08:55.447305+0000","last_peered":"2023-10-08T16:08:55.447305+0000","last_clean":"2023-10-08T16:08:55.447305+0000","last_became_active":"2023-10-08T16:08:55.446735+0000","last_became_peered":"2023-10-08T16:08:55.446735+0000","last_unstale":"2023-10-08T16:08:55.447305+0000","last_undegraded":"2023-10-08T16:08:55.447305+0000","last_fullsized":"2023-10-08T16:08:55.447305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:09.573102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.446929+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.454617+0000","last_change":"2023-10-08T16:08:55.454617+0000","last_active":"2023-10-08T16:08:55.454617+0000","last_peered":"2023-10-08T16:08:55.454617+0000","last_clean":"2023-10-08T16:08:55.454617+0000","last_became_active":"2023-10-08T16:08:55.454282+0000","last_became_peered":"2023-10-08T16:08:55.454282+0000","last_unstale":"2023-10-08T16:08:55.454617+0000","last_undegraded":"2023-10-08T16:08:55.454617+0000","last_fullsized":"2023-10-08T16:08:55.454617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:31.993858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439396+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:53.830593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450793+0000","last_change":"2023-10-08T16:08:55.450793+0000","last_active":"2023-10-08T16:08:55.450793+0000","last_peered":"2023-10-08T16:08:55.450793+0000","last_clean":"2023-10-08T16:08:55.450793+0000","last_became_active":"2023-10-08T16:08:55.450547+0000","last_became_peered":"2023-10-08T16:08:55.450547+0000","last_unstale":"2023-10-08T16:08:55.450793+0000","last_undegraded":"2023-10-08T16:08:55.450793+0000","last_fullsized":"2023-10-08T16:08:55.450793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:19.588783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439211+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:28.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.452317+0000","last_change":"2023-10-08T16:08:55.452317+0000","last_active":"2023-10-08T16:08:55.452317+0000","last_peered":"2023-10-08T16:08:55.452317+0000","last_clean":"2023-10-08T16:08:55.452317+0000","last_became_active":"2023-10-08T16:08:55.452086+0000","last_became_peered":"2023-10-08T16:08:55.452086+0000","last_unstale":"2023-10-08T16:08:55.452317+0000","last_undegraded":"2023-10-08T16:08:55.452317+0000","last_fullsized":"2023-10-08T16:08:55.452317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:23.064317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439542+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:32.889281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450948+0000","last_change":"2023-10-08T16:08:55.450948+0000","last_active":"2023-10-08T16:08:55.450948+0000","last_peered":"2023-10-08T16:08:55.450948+0000","last_clean":"2023-10-08T16:08:55.450948+0000","last_became_active":"2023-10-08T16:08:55.450483+0000","last_became_peered":"2023-10-08T16:08:55.450483+0000","last_unstale":"2023-10-08T16:08:55.450948+0000","last_undegraded":"2023-10-08T16:08:55.450948+0000","last_fullsized":"2023-10-08T16:08:55.450948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:20.089680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.441412+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:55.331830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448307+0000","last_change":"2023-10-08T16:08:55.448307+0000","last_active":"2023-10-08T16:08:55.448307+0000","last_peered":"2023-10-08T16:08:55.448307+0000","last_clean":"2023-10-08T16:08:55.448307+0000","last_became_active":"2023-10-08T16:08:55.448064+0000","last_became_peered":"2023-10-08T16:08:55.448064+0000","last_unstale":"2023-10-08T16:08:55.448307+0000","last_undegraded":"2023-10-08T16:08:55.448307+0000","last_fullsized":"2023-10-08T16:08:55.448307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:12.916924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.438714+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:31.485982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.445304+0000","last_change":"2023-10-08T16:08:55.445304+0000","last_active":"2023-10-08T16:08:55.445304+0000","last_peered":"2023-10-08T16:08:55.445304+0000","last_clean":"2023-10-08T16:08:55.445304+0000","last_became_active":"2023-10-08T16:08:55.445049+0000","last_became_peered":"2023-10-08T16:08:55.445049+0000","last_unstale":"2023-10-08T16:08:55.445304+0000","last_undegraded":"2023-10-08T16:08:55.445304+0000","last_fullsized":"2023-10-08T16:08:55.445304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:46.859406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443361+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.444963+0000","last_change":"2023-10-08T16:08:55.444963+0000","last_active":"2023-10-08T16:08:55.444963+0000","last_peered":"2023-10-08T16:08:55.444963+0000","last_clean":"2023-10-08T16:08:55.444963+0000","last_became_active":"2023-10-08T16:08:55.444708+0000","last_became_peered":"2023-10-08T16:08:55.444708+0000","last_unstale":"2023-10-08T16:08:55.444963+0000","last_undegraded":"2023-10-08T16:08:55.444963+0000","last_fullsized":"2023-10-08T16:08:55.444963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443902+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448320+0000","last_change":"2023-10-08T16:08:55.448320+0000","last_active":"2023-10-08T16:08:55.448320+0000","last_peered":"2023-10-08T16:08:55.448320+0000","last_clean":"2023-10-08T16:08:55.448320+0000","last_became_active":"2023-10-08T16:08:55.448092+0000","last_became_peered":"2023-10-08T16:08:55.448092+0000","last_unstale":"2023-10-08T16:08:55.448320+0000","last_undegraded":"2023-10-08T16:08:55.448320+0000","last_fullsized":"2023-10-08T16:08:55.448320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:55.828614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.443845+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.449538+0000","last_change":"2023-10-08T16:08:55.449538+0000","last_active":"2023-10-08T16:08:55.449538+0000","last_peered":"2023-10-08T16:08:55.449538+0000","last_clean":"2023-10-08T16:08:55.449538+0000","last_became_active":"2023-10-08T16:08:55.449266+0000","last_became_peered":"2023-10-08T16:08:55.449266+0000","last_unstale":"2023-10-08T16:08:55.449538+0000","last_undegraded":"2023-10-08T16:08:55.449538+0000","last_fullsized":"2023-10-08T16:08:55.449538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:45.246024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.444529+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.451262+0000","last_change":"2023-10-08T16:08:55.451262+0000","last_active":"2023-10-08T16:08:55.451262+0000","last_peered":"2023-10-08T16:08:55.451262+0000","last_clean":"2023-10-08T16:08:55.451262+0000","last_became_active":"2023-10-08T16:08:55.451044+0000","last_became_peered":"2023-10-08T16:08:55.451044+0000","last_unstale":"2023-10-08T16:08:55.451262+0000","last_undegraded":"2023-10-08T16:08:55.451262+0000","last_fullsized":"2023-10-08T16:08:55.451262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:51.332489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.439947+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:15.894284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.441810+0000","last_change":"2023-10-08T16:08:55.441810+0000","last_active":"2023-10-08T16:08:55.441810+0000","last_peered":"2023-10-08T16:08:55.441810+0000","last_clean":"2023-10-08T16:08:55.441810+0000","last_became_active":"2023-10-08T16:08:55.441123+0000","last_became_peered":"2023-10-08T16:08:55.441123+0000","last_unstale":"2023-10-08T16:08:55.441810+0000","last_undegraded":"2023-10-08T16:08:55.441810+0000","last_fullsized":"2023-10-08T16:08:55.441810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:37.519813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448258+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.450231+0000","last_change":"2023-10-08T16:08:55.450231+0000","last_active":"2023-10-08T16:08:55.450231+0000","last_peered":"2023-10-08T16:08:55.450231+0000","last_clean":"2023-10-08T16:08:55.450231+0000","last_became_active":"2023-10-08T16:08:55.450004+0000","last_became_peered":"2023-10-08T16:08:55.450004+0000","last_unstale":"2023-10-08T16:08:55.450231+0000","last_undegraded":"2023-10-08T16:08:55.450231+0000","last_fullsized":"2023-10-08T16:08:55.450231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.440551+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:11.414378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.453605+0000","last_change":"2023-10-08T16:08:55.453605+0000","last_active":"2023-10-08T16:08:55.453605+0000","last_peered":"2023-10-08T16:08:55.453605+0000","last_clean":"2023-10-08T16:08:55.453605+0000","last_became_active":"2023-10-08T16:08:55.452990+0000","last_became_peered":"2023-10-08T16:08:55.452990+0000","last_unstale":"2023-10-08T16:08:55.453605+0000","last_undegraded":"2023-10-08T16:08:55.453605+0000","last_fullsized":"2023-10-08T16:08:55.453605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:32.746669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.448085+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:32.998704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.447467+0000","last_change":"2023-10-08T16:08:55.447467+0000","last_active":"2023-10-08T16:08:55.447467+0000","last_peered":"2023-10-08T16:08:55.447467+0000","last_clean":"2023-10-08T16:08:55.447467+0000","last_became_active":"2023-10-08T16:08:55.447066+0000","last_became_peered":"2023-10-08T16:08:55.447066+0000","last_unstale":"2023-10-08T16:08:55.447467+0000","last_undegraded":"2023-10-08T16:08:55.447467+0000","last_fullsized":"2023-10-08T16:08:55.447467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:08:55.430142+0000","last_change":"2023-10-08T16:08:55.438745+0000","last_active":"2023-10-08T16:08:55.430142+0000","last_peered":"2023-10-08T16:08:55.430142+0000","last_clean":"2023-10-08T16:08:55.430142+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:08:55.430142+0000","last_undegraded":"2023-10-08T16:08:55.430142+0000","last_fullsized":"2023-10-08T16:08:55.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:47.761359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.446817+0000","last_change":"2023-10-08T16:08:55.446817+0000","last_active":"2023-10-08T16:08:55.446817+0000","last_peered":"2023-10-08T16:08:55.446817+0000","last_clean":"2023-10-08T16:08:55.446817+0000","last_became_active":"2023-10-08T16:08:55.446562+0000","last_became_peered":"2023-10-08T16:08:55.446562+0000","last_unstale":"2023-10-08T16:08:55.446817+0000","last_undegraded":"2023-10-08T16:08:55.446817+0000","last_fullsized":"2023-10-08T16:08:55.446817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T16:08:54.435264+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:08:54.435264+0000","last_peered":"2023-10-08T16:08:54.435264+0000","last_clean":"2023-10-08T16:08:54.435264+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:08:54.435264+0000","last_undegraded":"2023-10-08T16:08:54.435264+0000","last_fullsized":"2023-10-08T16:08:54.435264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.432}]},{"osd":1,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":1.756,"15min":1.756},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.625,"5min":1.79,"15min":1.79},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60199999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81100000000000005,"5min":1.823,"15min":1.823},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57299999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.41699999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67400000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.745,"15min":0.745},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.495},"min":{"1min":0.374,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.437},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.439,"15min":0.434},"min":{"1min":0.316,"5min":0.249,"15min":0.249},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53200000000000003,"15min":0.54300000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65200000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":0.755},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60499999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379}]},{"osd":7,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.621,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.45600000000000002,"15min":0.499},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48299999999999998,"5min":3.593,"15min":3.593},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.27600000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.45200000000000001,"15min":0.48599999999999999},"min":{"1min":0.23799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55900000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.39200000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.434,"15min":0.44700000000000001},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68300000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.26800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.46999999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94799999999999995,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.435,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.505}]},{"osd":5,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80200000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88,"5min":3.532,"15min":3.532},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.71999999999999997,"15min":0.75},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91000000000000003,"5min":1.095,"15min":1.095},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66400000000000003,"15min":0.66600000000000004},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.41899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58599999999999997,"5min":2.254,"15min":2.254},"last":0.35999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61499999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.32400000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.379},"min":{"1min":0.30299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.377},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.748},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.55800000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.52000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83199999999999996,"5min":1.079,"15min":1.079},"last":0.83199999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.55100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":2.355,"15min":2.355},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.002},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.55600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.374}]},{"osd":1,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.67100000000000004,"5min":0.746,"15min":0.746},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74099999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.66400000000000003},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.55500000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.5,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.745}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.378}]},{"osd":1,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.628,"15min":0.628},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.026},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.627},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70199999999999996,"5min":1.141,"15min":1.141},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":1.149,"15min":1.149},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67300000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.70099999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":14.6,"15min":14.6},"last":0.48499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.56899999999999995},"min":{"1min":0.46400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":7.556,"15min":7.556},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.33000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194920,"statfs":{"total":200000000,"available":199598820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.497},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.46100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.51300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.39500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73999999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.373}]},{"osd":6,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.35899999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.316},"max":{"1min":0.755,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57099999999999995}]}]}],"pool_statfs":[]}} 2023-10-08T16:09:01.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-08T16:09:01.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.447737+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-08T16:09:01.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.449905+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-08T16:09:01.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440058+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:52:09.261184+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440973+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:09:33.751516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439572+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:53:56.610835+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.450300+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.445023+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.452245+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440953+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:11:52.210142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.446866+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444754+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439785+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:00:50.657018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444154+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-08T16:09:01.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440499+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:35:10.959156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.445772+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448915+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440485+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:13:39.245502+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-08T16:09:01.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440906+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:22:54.790856+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.449497+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.445394+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448486+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-08T16:09:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448095+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443451+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:02:16.929966+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444125+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.446501+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:06:56.833460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-08T16:09:01.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444897+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.442377+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:50:14.576369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.449795+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439267+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:46:36.840181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-08T16:09:01.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.446416+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444475+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448981+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:15:56.465843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.447302+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439710+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:52:04.919950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448633+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:23:47.343632+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444776+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444244+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.447695+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439132+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:05:44.567117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.447306+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444422+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444032+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448047+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:36:14.011793+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439294+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:45:18.897301+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443631+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443451+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443767+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440233+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:35:45.282768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-08T16:09:01.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.446141+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:51:24.069164+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.446929+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439396+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:48:53.830593+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439211+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:56:28.761981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-08T16:09:01.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439542+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:03:32.889281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.441412+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:55:55.331830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.438714+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:05:31.485982+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443361+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-08T16:09:01.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443902+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:21:10.701791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.443845+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.444529+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.439947+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:55:15.894284+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-08T16:09:01.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448258+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:06:22.888471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-08T16:09:01.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.440551+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:06:11.414378+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:09:01.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-08T16:09:01.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.448085+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:39:32.998704+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:09:01.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-08T16:09:01.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:08:55.430142+0000', 'last_change': '2023-10-08T16:08:55.438745+0000', 'last_active': '2023-10-08T16:08:55.430142+0000', 'last_peered': '2023-10-08T16:08:55.430142+0000', 'last_clean': '2023-10-08T16:08:55.430142+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:08:55.430142+0000', 'last_undegraded': '2023-10-08T16:08:55.430142+0000', 'last_fullsized': '2023-10-08T16:08:55.430142+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'last_clean_scrub_stamp': '2023-10-08T16:08:55.430142+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:58:47.761359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:09:01.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:09:01.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.473+0000 7f249f13e700 1 Processor -- start 2023-10-08T16:09:01.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.473+0000 7f249f13e700 1 -- start start 2023-10-08T16:09:01.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249f13e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249f13e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249815db80 con 0x7f24980cde50 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249f13e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249815de60 con 0x7f249815a1e0 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249f13e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249815e800 con 0x7f2498159e10 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249d6db700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f24980cde50 0x7f24980cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50884/0 (socket says 172.21.15.60:50884) 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249d6db700 1 -- 172.21.15.60:0/2586333980 learned_addr learned my addr 172.21.15.60:0/2586333980 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249ceda700 1 --2- 172.21.15.60:0/2586333980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f24977fe700 1 -- 172.21.15.60:0/2586333980 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749761324 0 0) 0x7f249815db80 con 0x7f24980cde50 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f24977fe700 1 -- 172.21.15.60:0/2586333980 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2488003570 con 0x7f24980cde50 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249ceda700 1 -- 172.21.15.60:0/2586333980 >> v1:172.21.15.144:6789/0 conn(0x7f249815a1e0 legacy=0x7f24980cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f24977fe700 1 -- 172.21.15.60:0/2586333980 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787958028 0 0) 0x7f249815de60 con 0x7f249815a1e0 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249ceda700 1 -- 172.21.15.60:0/2586333980 >> v1:172.21.15.60:6789/0 conn(0x7f24980cde50 legacy=0x7f24980cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249ceda700 1 -- 172.21.15.60:0/2586333980 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249815e140 con 0x7f2498159e10 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.474+0000 7f249ceda700 1 --2- 172.21.15.60:0/2586333980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980b2d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f248c009910 tx=0x7f248c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321f65c08e25a1db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f24977fe700 1 -- 172.21.15.60:0/2586333980 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00b680 con 0x7f2498159e10 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f24977fe700 1 -- 172.21.15.60:0/2586333980 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00b7e0 con 0x7f2498159e10 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f24977fe700 1 -- 172.21.15.60:0/2586333980 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00bba0 con 0x7f2498159e10 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 -- 172.21.15.60:0/2586333980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 msgr2=0x7f24980b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 --2- 172.21.15.60:0/2586333980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980b2d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f248c009910 tx=0x7f248c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 -- 172.21.15.60:0/2586333980 shutdown_connections 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 --2- 172.21.15.60:0/2586333980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980b2d20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 -- 172.21.15.60:0/2586333980 >> 172.21.15.60:0/2586333980 conn(0x7f2498067660 msgr2=0x7f2498067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 -- 172.21.15.60:0/2586333980 shutdown_connections 2023-10-08T16:09:01.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.475+0000 7f249f13e700 1 -- 172.21.15.60:0/2586333980 wait complete. 2023-10-08T16:09:01.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.476+0000 7f249f13e700 1 Processor -- start 2023-10-08T16:09:01.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.476+0000 7f249f13e700 1 -- start start 2023-10-08T16:09:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249f13e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 0x7f24980c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249f13e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249f13e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249815a1e0 0x7f249814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249f13e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c8d20 con 0x7f24980cde50 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249f13e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c92e0 con 0x7f249815a1e0 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249f13e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c5cf0 con 0x7f2498159e10 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249ceda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 0x7f24980c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249ceda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 0x7f24980c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47194/0 (socket says 172.21.15.60:47194) 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.477+0000 7f249ceda700 1 -- 172.21.15.60:0/4188031371 learned_addr learned my addr 172.21.15.60:0/4188031371 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249d6db700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249815a1e0 0x7f249814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f2497fff700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249ceda700 1 -- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 msgr2=0x7f24980c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249ceda700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249ceda700 1 -- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249815a1e0 msgr2=0x7f249814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249ceda700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249815a1e0 0x7f249814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249ceda700 1 -- 172.21.15.60:0/4188031371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c009420 con 0x7f24980cde50 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249d6db700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249815a1e0 0x7f249814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249ceda700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 0x7f24980c5610 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2498089c80 tx=0x7f248c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00bb60 con 0x7f24980cde50 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c027450 con 0x7f24980cde50 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24980c5fd0 con 0x7f24980cde50 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0277f0 con 0x7f24980cde50 2023-10-08T16:09:01.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.478+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249814d7f0 con 0x7f24980cde50 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.479+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249804c3c0 con 0x7f24980cde50 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.479+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f248c01a430 con 0x7f24980cde50 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.480+0000 7f2494ff9700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f247c066f30 0x7f247c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.480+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f248c086510 con 0x7f24980cde50 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.480+0000 7f2497fff700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f247c066f30 0x7f247c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.480+0000 7f2497fff700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f247c066f30 0x7f247c0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f249816b7c0 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.484+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f248c053830 con 0x7f24980cde50 2023-10-08T16:09:01.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.759+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f249815e420 con 0x7f24980cde50 2023-10-08T16:09:01.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.759+0000 7f2494ff9700 1 -- 172.21.15.60:0/4188031371 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1029 (secure 0 0 0) 0x7f248c056e50 con 0x7f24980cde50 2023-10-08T16:09:01.761 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:01.761 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":258,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":80,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781088,"num_in_osds":8,"osd_in_since":1696781085,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":4408965,"bytes_avail":1595591035,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":43,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6036}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-08T16:08:21.603745+0000","services":{}},"progress_events":{}} 2023-10-08T16:09:01.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f247c066f30 msgr2=0x7f247c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f247c066f30 0x7f247c0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f249816b7c0 tx=0x7f2484009040 comp rx=0 tx=0).stop 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 msgr2=0x7f24980c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 0x7f24980c5610 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2498089c80 tx=0x7f248c017000 comp rx=0 tx=0).stop 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 shutdown_connections 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f247c066f30 0x7f247c0693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249815a1e0 0x7f249814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24980cde50 0x7f24980c5610 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 --2- 172.21.15.60:0/4188031371 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2498159e10 0x7f24980c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 >> 172.21.15.60:0/4188031371 conn(0x7f2498067660 msgr2=0x7f24980b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 shutdown_connections 2023-10-08T16:09:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.761+0000 7f249f13e700 1 -- 172.21.15.60:0/4188031371 wait complete. 2023-10-08T16:09:01.774 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:09:01.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:01.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.892+0000 7f0c753fc700 1 Processor -- start 2023-10-08T16:09:01.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.892+0000 7f0c753fc700 1 -- start start 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c753fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c7006a4d0 0x7f0c700af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c753fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c700afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c753fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c701598d0 0x7f0c70159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c753fc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700d1600 con 0x7f0c701598d0 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c753fc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700cef50 con 0x7f0c7006a4d0 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c753fc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700b0900 con 0x7f0c7006a8a0 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c701598d0 0x7f0c70159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c701598d0 0x7f0c70159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47196/0 (socket says 172.21.15.60:47196) 2023-10-08T16:09:01.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 -- 172.21.15.60:0/3960396670 learned_addr learned my addr 172.21.15.60:0/3960396670 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6e7fc700 1 --2- 172.21.15.60:0/3960396670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c700afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6effd700 1 --2- 172.21.15.60:0/3960396670 >> v2:172.21.15.144:3300/0 conn(0x7f0c7006a4d0 0x7f0c700af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 -- 172.21.15.60:0/3960396670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 msgr2=0x7f0c700afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 --2- 172.21.15.60:0/3960396670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c700afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 -- 172.21.15.60:0/3960396670 >> v2:172.21.15.144:3300/0 conn(0x7f0c7006a4d0 msgr2=0x7f0c700af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 --2- 172.21.15.60:0/3960396670 >> v2:172.21.15.144:3300/0 conn(0x7f0c7006a4d0 0x7f0c700af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.893+0000 7f0c6f7fe700 1 -- 172.21.15.60:0/3960396670 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700b0310 con 0x7f0c701598d0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c6f7fe700 1 --2- 172.21.15.60:0/3960396670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c701598d0 0x7f0c70159d50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0c70070240 tx=0x7f0c68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77c0726e1868435 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c6dffb700 1 -- 172.21.15.60:0/3960396670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800e070 con 0x7f0c701598d0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c6dffb700 1 -- 172.21.15.60:0/3960396670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6800ba50 con 0x7f0c701598d0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c6dffb700 1 -- 172.21.15.60:0/3960396670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c680092e0 con 0x7f0c701598d0 2023-10-08T16:09:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 -- 172.21.15.60:0/3960396670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c701598d0 msgr2=0x7f0c70159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 --2- 172.21.15.60:0/3960396670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c701598d0 0x7f0c70159d50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0c70070240 tx=0x7f0c68009840 comp rx=0 tx=0).stop 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 -- 172.21.15.60:0/3960396670 shutdown_connections 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 --2- 172.21.15.60:0/3960396670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c701598d0 0x7f0c70159d50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 --2- 172.21.15.60:0/3960396670 >> v2:172.21.15.144:3300/0 conn(0x7f0c7006a4d0 0x7f0c700af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 --2- 172.21.15.60:0/3960396670 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c700afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 -- 172.21.15.60:0/3960396670 >> 172.21.15.60:0/3960396670 conn(0x7f0c700695e0 msgr2=0x7f0c700d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 -- 172.21.15.60:0/3960396670 shutdown_connections 2023-10-08T16:09:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.894+0000 7f0c753fc700 1 -- 172.21.15.60:0/3960396670 wait complete. 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 Processor -- start 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 -- start start 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 0x7f0c701495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c70155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c701598d0 0x7f0c70156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c97d0 con 0x7f0c7006a4d0 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c8bc0 con 0x7f0c701598d0 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c753fc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c8ea0 con 0x7f0c7006a8a0 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c6effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 0x7f0c701495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c6effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 0x7f0c701495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47198/0 (socket says 172.21.15.60:47198) 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.896+0000 7f0c6effd700 1 -- 172.21.15.60:0/717157936 learned_addr learned my addr 172.21.15.60:0/717157936 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6f7fe700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c701598d0 0x7f0c70156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6e7fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c70155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6effd700 1 -- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 msgr2=0x7f0c70155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6effd700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c70155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6effd700 1 -- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c701598d0 msgr2=0x7f0c70156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6effd700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c701598d0 0x7f0c70156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6effd700 1 -- 172.21.15.60:0/717157936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68009ae0 con 0x7f0c7006a4d0 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6f7fe700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c701598d0 0x7f0c70156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6e7fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c70155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c6effd700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 0x7f0c701495d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000d890 tx=0x7f0c60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000b600 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000b760 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c700c9180 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000bae0 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.897+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c70149b10 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.898+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c700ce900 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.898+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c6001e460 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.899+0000 7f0c66ffd700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c50066f30 0x7f0c500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.899+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c60084be0 con 0x7f0c7006a4d0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.899+0000 7f0c6e7fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c50066f30 0x7f0c500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.899+0000 7f0c6e7fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c50066f30 0x7f0c500693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c700b67a0 tx=0x7f0c58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:01.903+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c60051e50 con 0x7f0c7006a4d0 2023-10-08T16:09:02.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.092+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c700c9910 con 0x7f0c50066f30 2023-10-08T16:09:02.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.100+0000 7f0c66ffd700 1 -- 172.21.15.60:0/717157936 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285037 (secure 0 0 0) 0x7f0c580097d0 con 0x7f0c50066f30 2023-10-08T16:09:02.104 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c50066f30 msgr2=0x7f0c500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c50066f30 0x7f0c500693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c700b67a0 tx=0x7f0c58008040 comp rx=0 tx=0).stop 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 msgr2=0x7f0c701495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 0x7f0c701495d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000d890 tx=0x7f0c60008040 comp rx=0 tx=0).stop 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 shutdown_connections 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c50066f30 0x7f0c500693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c701598d0 0x7f0c70156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7006a4d0 0x7f0c701495d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 --2- 172.21.15.60:0/717157936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c7006a8a0 0x7f0c70155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 >> 172.21.15.60:0/717157936 conn(0x7f0c700695e0 msgr2=0x7f0c700cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:02.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 shutdown_connections 2023-10-08T16:09:02.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:02.103+0000 7f0c753fc700 1 -- 172.21.15.60:0/717157936 wait complete. 2023-10-08T16:09:02.108 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:09:02.117 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2023-10-08T16:09:01.612013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4442,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558057,"statfs":{"total":1600000000,"available":1595450700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.176823"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449527+0000","last_change":"2023-10-08T16:08:56.449460+0000","last_active":"2023-10-08T16:08:56.449527+0000","last_peered":"2023-10-08T16:08:56.449527+0000","last_clean":"2023-10-08T16:08:56.449527+0000","last_became_active":"2023-10-08T16:08:56.448882+0000","last_became_peered":"2023-10-08T16:08:56.448882+0000","last_unstale":"2023-10-08T16:08:56.449527+0000","last_undegraded":"2023-10-08T16:08:56.449527+0000","last_fullsized":"2023-10-08T16:08:56.449527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453335+0000","last_change":"2023-10-08T16:08:56.453286+0000","last_active":"2023-10-08T16:08:56.453335+0000","last_peered":"2023-10-08T16:08:56.453335+0000","last_clean":"2023-10-08T16:08:56.453335+0000","last_became_active":"2023-10-08T16:08:56.452940+0000","last_became_peered":"2023-10-08T16:08:56.452940+0000","last_unstale":"2023-10-08T16:08:56.453335+0000","last_undegraded":"2023-10-08T16:08:56.453335+0000","last_fullsized":"2023-10-08T16:08:56.453335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453582+0000","last_change":"2023-10-08T16:08:56.453248+0000","last_active":"2023-10-08T16:08:56.453582+0000","last_peered":"2023-10-08T16:08:56.453582+0000","last_clean":"2023-10-08T16:08:56.453582+0000","last_became_active":"2023-10-08T16:08:56.452685+0000","last_became_peered":"2023-10-08T16:08:56.452685+0000","last_unstale":"2023-10-08T16:08:56.453582+0000","last_undegraded":"2023-10-08T16:08:56.453582+0000","last_fullsized":"2023-10-08T16:08:56.453582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:05.471318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445221+0000","last_change":"2023-10-08T16:08:56.445154+0000","last_active":"2023-10-08T16:08:56.445221+0000","last_peered":"2023-10-08T16:08:56.445221+0000","last_clean":"2023-10-08T16:08:56.445221+0000","last_became_active":"2023-10-08T16:08:56.444792+0000","last_became_peered":"2023-10-08T16:08:56.444792+0000","last_unstale":"2023-10-08T16:08:56.445221+0000","last_undegraded":"2023-10-08T16:08:56.445221+0000","last_fullsized":"2023-10-08T16:08:56.445221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:47.343632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448740+0000","last_change":"2023-10-08T16:08:56.448345+0000","last_active":"2023-10-08T16:08:56.448740+0000","last_peered":"2023-10-08T16:08:56.448740+0000","last_clean":"2023-10-08T16:08:56.448740+0000","last_became_active":"2023-10-08T16:08:56.447992+0000","last_became_peered":"2023-10-08T16:08:56.447992+0000","last_unstale":"2023-10-08T16:08:56.448740+0000","last_undegraded":"2023-10-08T16:08:56.448740+0000","last_fullsized":"2023-10-08T16:08:56.448740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:55.567851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452452+0000","last_change":"2023-10-08T16:08:56.452384+0000","last_active":"2023-10-08T16:08:56.452452+0000","last_peered":"2023-10-08T16:08:56.452452+0000","last_clean":"2023-10-08T16:08:56.452452+0000","last_became_active":"2023-10-08T16:08:56.451538+0000","last_became_peered":"2023-10-08T16:08:56.451538+0000","last_unstale":"2023-10-08T16:08:56.452452+0000","last_undegraded":"2023-10-08T16:08:56.452452+0000","last_fullsized":"2023-10-08T16:08:56.452452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449132+0000","last_change":"2023-10-08T16:08:56.448903+0000","last_active":"2023-10-08T16:08:56.449132+0000","last_peered":"2023-10-08T16:08:56.449132+0000","last_clean":"2023-10-08T16:08:56.449132+0000","last_became_active":"2023-10-08T16:08:56.448355+0000","last_became_peered":"2023-10-08T16:08:56.448355+0000","last_unstale":"2023-10-08T16:08:56.449132+0000","last_undegraded":"2023-10-08T16:08:56.449132+0000","last_fullsized":"2023-10-08T16:08:56.449132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.456217+0000","last_change":"2023-10-08T16:08:56.456171+0000","last_active":"2023-10-08T16:08:56.456217+0000","last_peered":"2023-10-08T16:08:56.456217+0000","last_clean":"2023-10-08T16:08:56.456217+0000","last_became_active":"2023-10-08T16:08:56.455514+0000","last_became_peered":"2023-10-08T16:08:56.455514+0000","last_unstale":"2023-10-08T16:08:56.456217+0000","last_undegraded":"2023-10-08T16:08:56.456217+0000","last_fullsized":"2023-10-08T16:08:56.456217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454736+0000","last_change":"2023-10-08T16:08:56.454667+0000","last_active":"2023-10-08T16:08:56.454736+0000","last_peered":"2023-10-08T16:08:56.454736+0000","last_clean":"2023-10-08T16:08:56.454736+0000","last_became_active":"2023-10-08T16:08:56.454440+0000","last_became_peered":"2023-10-08T16:08:56.454440+0000","last_unstale":"2023-10-08T16:08:56.454736+0000","last_undegraded":"2023-10-08T16:08:56.454736+0000","last_fullsized":"2023-10-08T16:08:56.454736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:26.211645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446084+0000","last_change":"2023-10-08T16:08:56.445872+0000","last_active":"2023-10-08T16:08:56.446084+0000","last_peered":"2023-10-08T16:08:56.446084+0000","last_clean":"2023-10-08T16:08:56.446084+0000","last_became_active":"2023-10-08T16:08:56.445324+0000","last_became_peered":"2023-10-08T16:08:56.445324+0000","last_unstale":"2023-10-08T16:08:56.446084+0000","last_undegraded":"2023-10-08T16:08:56.446084+0000","last_fullsized":"2023-10-08T16:08:56.446084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448737+0000","last_change":"2023-10-08T16:08:56.448620+0000","last_active":"2023-10-08T16:08:56.448737+0000","last_peered":"2023-10-08T16:08:56.448737+0000","last_clean":"2023-10-08T16:08:56.448737+0000","last_became_active":"2023-10-08T16:08:56.447905+0000","last_became_peered":"2023-10-08T16:08:56.447905+0000","last_unstale":"2023-10-08T16:08:56.448737+0000","last_undegraded":"2023-10-08T16:08:56.448737+0000","last_fullsized":"2023-10-08T16:08:56.448737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:09.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446060+0000","last_change":"2023-10-08T16:08:56.446008+0000","last_active":"2023-10-08T16:08:56.446060+0000","last_peered":"2023-10-08T16:08:56.446060+0000","last_clean":"2023-10-08T16:08:56.446060+0000","last_became_active":"2023-10-08T16:08:56.445533+0000","last_became_peered":"2023-10-08T16:08:56.445533+0000","last_unstale":"2023-10-08T16:08:56.446060+0000","last_undegraded":"2023-10-08T16:08:56.446060+0000","last_fullsized":"2023-10-08T16:08:56.446060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454907+0000","last_change":"2023-10-08T16:08:56.454795+0000","last_active":"2023-10-08T16:08:56.454907+0000","last_peered":"2023-10-08T16:08:56.454907+0000","last_clean":"2023-10-08T16:08:56.454907+0000","last_became_active":"2023-10-08T16:08:56.454143+0000","last_became_peered":"2023-10-08T16:08:56.454143+0000","last_unstale":"2023-10-08T16:08:56.454907+0000","last_undegraded":"2023-10-08T16:08:56.454907+0000","last_fullsized":"2023-10-08T16:08:56.454907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:07.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445804+0000","last_change":"2023-10-08T16:08:56.445735+0000","last_active":"2023-10-08T16:08:56.445804+0000","last_peered":"2023-10-08T16:08:56.445804+0000","last_clean":"2023-10-08T16:08:56.445804+0000","last_became_active":"2023-10-08T16:08:56.445465+0000","last_became_peered":"2023-10-08T16:08:56.445465+0000","last_unstale":"2023-10-08T16:08:56.445804+0000","last_undegraded":"2023-10-08T16:08:56.445804+0000","last_fullsized":"2023-10-08T16:08:56.445804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:30.931959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449485+0000","last_change":"2023-10-08T16:08:56.449425+0000","last_active":"2023-10-08T16:08:56.449485+0000","last_peered":"2023-10-08T16:08:56.449485+0000","last_clean":"2023-10-08T16:08:56.449485+0000","last_became_active":"2023-10-08T16:08:56.449199+0000","last_became_peered":"2023-10-08T16:08:56.449199+0000","last_unstale":"2023-10-08T16:08:56.449485+0000","last_undegraded":"2023-10-08T16:08:56.449485+0000","last_fullsized":"2023-10-08T16:08:56.449485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:39.843156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455083+0000","last_change":"2023-10-08T16:08:56.455008+0000","last_active":"2023-10-08T16:08:56.455083+0000","last_peered":"2023-10-08T16:08:56.455083+0000","last_clean":"2023-10-08T16:08:56.455083+0000","last_became_active":"2023-10-08T16:08:56.454534+0000","last_became_peered":"2023-10-08T16:08:56.454534+0000","last_unstale":"2023-10-08T16:08:56.455083+0000","last_undegraded":"2023-10-08T16:08:56.455083+0000","last_fullsized":"2023-10-08T16:08:56.455083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448755+0000","last_change":"2023-10-08T16:08:56.448391+0000","last_active":"2023-10-08T16:08:56.448755+0000","last_peered":"2023-10-08T16:08:56.448755+0000","last_clean":"2023-10-08T16:08:56.448755+0000","last_became_active":"2023-10-08T16:08:56.447798+0000","last_became_peered":"2023-10-08T16:08:56.447798+0000","last_unstale":"2023-10-08T16:08:56.448755+0000","last_undegraded":"2023-10-08T16:08:56.448755+0000","last_fullsized":"2023-10-08T16:08:56.448755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:11.884663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453202+0000","last_change":"2023-10-08T16:08:56.453113+0000","last_active":"2023-10-08T16:08:56.453202+0000","last_peered":"2023-10-08T16:08:56.453202+0000","last_clean":"2023-10-08T16:08:56.453202+0000","last_became_active":"2023-10-08T16:08:56.452664+0000","last_became_peered":"2023-10-08T16:08:56.452664+0000","last_unstale":"2023-10-08T16:08:56.453202+0000","last_undegraded":"2023-10-08T16:08:56.453202+0000","last_fullsized":"2023-10-08T16:08:56.453202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:32.998704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.451960+0000","last_change":"2023-10-08T16:08:56.451682+0000","last_active":"2023-10-08T16:08:56.451960+0000","last_peered":"2023-10-08T16:08:56.451960+0000","last_clean":"2023-10-08T16:08:56.451960+0000","last_became_active":"2023-10-08T16:08:56.451327+0000","last_became_peered":"2023-10-08T16:08:56.451327+0000","last_unstale":"2023-10-08T16:08:56.451960+0000","last_undegraded":"2023-10-08T16:08:56.451960+0000","last_fullsized":"2023-10-08T16:08:56.451960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446077+0000","last_change":"2023-10-08T16:08:56.445472+0000","last_active":"2023-10-08T16:08:56.446077+0000","last_peered":"2023-10-08T16:08:56.446077+0000","last_clean":"2023-10-08T16:08:56.446077+0000","last_became_active":"2023-10-08T16:08:56.445323+0000","last_became_peered":"2023-10-08T16:08:56.445323+0000","last_unstale":"2023-10-08T16:08:56.446077+0000","last_undegraded":"2023-10-08T16:08:56.446077+0000","last_fullsized":"2023-10-08T16:08:56.446077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:26:05.006624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446711+0000","last_change":"2023-10-08T16:08:56.446647+0000","last_active":"2023-10-08T16:08:56.446711+0000","last_peered":"2023-10-08T16:08:56.446711+0000","last_clean":"2023-10-08T16:08:56.446711+0000","last_became_active":"2023-10-08T16:08:56.446419+0000","last_became_peered":"2023-10-08T16:08:56.446419+0000","last_unstale":"2023-10-08T16:08:56.446711+0000","last_undegraded":"2023-10-08T16:08:56.446711+0000","last_fullsized":"2023-10-08T16:08:56.446711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447760+0000","last_change":"2023-10-08T16:08:56.447490+0000","last_active":"2023-10-08T16:08:56.447760+0000","last_peered":"2023-10-08T16:08:56.447760+0000","last_clean":"2023-10-08T16:08:56.447760+0000","last_became_active":"2023-10-08T16:08:56.446488+0000","last_became_peered":"2023-10-08T16:08:56.446488+0000","last_unstale":"2023-10-08T16:08:56.447760+0000","last_undegraded":"2023-10-08T16:08:56.447760+0000","last_fullsized":"2023-10-08T16:08:56.447760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446308+0000","last_change":"2023-10-08T16:08:56.446204+0000","last_active":"2023-10-08T16:08:56.446308+0000","last_peered":"2023-10-08T16:08:56.446308+0000","last_clean":"2023-10-08T16:08:56.446308+0000","last_became_active":"2023-10-08T16:08:56.445973+0000","last_became_peered":"2023-10-08T16:08:56.445973+0000","last_unstale":"2023-10-08T16:08:56.446308+0000","last_undegraded":"2023-10-08T16:08:56.446308+0000","last_fullsized":"2023-10-08T16:08:56.446308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454465+0000","last_change":"2023-10-08T16:08:56.454406+0000","last_active":"2023-10-08T16:08:56.454465+0000","last_peered":"2023-10-08T16:08:56.454465+0000","last_clean":"2023-10-08T16:08:56.454465+0000","last_became_active":"2023-10-08T16:08:56.454043+0000","last_became_peered":"2023-10-08T16:08:56.454043+0000","last_unstale":"2023-10-08T16:08:56.454465+0000","last_undegraded":"2023-10-08T16:08:56.454465+0000","last_fullsized":"2023-10-08T16:08:56.454465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:06:02.421456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446098+0000","last_change":"2023-10-08T16:08:56.446003+0000","last_active":"2023-10-08T16:08:56.446098+0000","last_peered":"2023-10-08T16:08:56.446098+0000","last_clean":"2023-10-08T16:08:56.446098+0000","last_became_active":"2023-10-08T16:08:56.445623+0000","last_became_peered":"2023-10-08T16:08:56.445623+0000","last_unstale":"2023-10-08T16:08:56.446098+0000","last_undegraded":"2023-10-08T16:08:56.446098+0000","last_fullsized":"2023-10-08T16:08:56.446098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449114+0000","last_change":"2023-10-08T16:08:56.448394+0000","last_active":"2023-10-08T16:08:56.449114+0000","last_peered":"2023-10-08T16:08:56.449114+0000","last_clean":"2023-10-08T16:08:56.449114+0000","last_became_active":"2023-10-08T16:08:56.448119+0000","last_became_peered":"2023-10-08T16:08:56.448119+0000","last_unstale":"2023-10-08T16:08:56.449114+0000","last_undegraded":"2023-10-08T16:08:56.449114+0000","last_fullsized":"2023-10-08T16:08:56.449114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:07.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447186+0000","last_change":"2023-10-08T16:08:56.447048+0000","last_active":"2023-10-08T16:08:56.447186+0000","last_peered":"2023-10-08T16:08:56.447186+0000","last_clean":"2023-10-08T16:08:56.447186+0000","last_became_active":"2023-10-08T16:08:56.445497+0000","last_became_peered":"2023-10-08T16:08:56.445497+0000","last_unstale":"2023-10-08T16:08:56.447186+0000","last_undegraded":"2023-10-08T16:08:56.447186+0000","last_fullsized":"2023-10-08T16:08:56.447186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:57.360488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446067+0000","last_change":"2023-10-08T16:08:56.445390+0000","last_active":"2023-10-08T16:08:56.446067+0000","last_peered":"2023-10-08T16:08:56.446067+0000","last_clean":"2023-10-08T16:08:56.446067+0000","last_became_active":"2023-10-08T16:08:56.445142+0000","last_became_peered":"2023-10-08T16:08:56.445142+0000","last_unstale":"2023-10-08T16:08:56.446067+0000","last_undegraded":"2023-10-08T16:08:56.446067+0000","last_fullsized":"2023-10-08T16:08:56.446067+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453631+0000","last_change":"2023-10-08T16:08:56.453573+0000","last_active":"2023-10-08T16:08:56.453631+0000","last_peered":"2023-10-08T16:08:56.453631+0000","last_clean":"2023-10-08T16:08:56.453631+0000","last_became_active":"2023-10-08T16:08:56.452295+0000","last_became_peered":"2023-10-08T16:08:56.452295+0000","last_unstale":"2023-10-08T16:08:56.453631+0000","last_undegraded":"2023-10-08T16:08:56.453631+0000","last_fullsized":"2023-10-08T16:08:56.453631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:42.255724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443238+0000","last_change":"2023-10-08T16:08:56.443094+0000","last_active":"2023-10-08T16:08:56.443238+0000","last_peered":"2023-10-08T16:08:56.443238+0000","last_clean":"2023-10-08T16:08:56.443238+0000","last_became_active":"2023-10-08T16:08:56.442869+0000","last_became_peered":"2023-10-08T16:08:56.442869+0000","last_unstale":"2023-10-08T16:08:56.443238+0000","last_undegraded":"2023-10-08T16:08:56.443238+0000","last_fullsized":"2023-10-08T16:08:56.443238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:26:05.006624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445152+0000","last_change":"2023-10-08T16:08:56.445089+0000","last_active":"2023-10-08T16:08:56.445152+0000","last_peered":"2023-10-08T16:08:56.445152+0000","last_clean":"2023-10-08T16:08:56.445152+0000","last_became_active":"2023-10-08T16:08:56.444818+0000","last_became_peered":"2023-10-08T16:08:56.444818+0000","last_unstale":"2023-10-08T16:08:56.445152+0000","last_undegraded":"2023-10-08T16:08:56.445152+0000","last_fullsized":"2023-10-08T16:08:56.445152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:39.843156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453213+0000","last_change":"2023-10-08T16:08:56.453155+0000","last_active":"2023-10-08T16:08:56.453213+0000","last_peered":"2023-10-08T16:08:56.453213+0000","last_clean":"2023-10-08T16:08:56.453213+0000","last_became_active":"2023-10-08T16:08:56.452633+0000","last_became_peered":"2023-10-08T16:08:56.452633+0000","last_unstale":"2023-10-08T16:08:56.453213+0000","last_undegraded":"2023-10-08T16:08:56.453213+0000","last_fullsized":"2023-10-08T16:08:56.453213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454330+0000","last_change":"2023-10-08T16:08:56.454264+0000","last_active":"2023-10-08T16:08:56.454330+0000","last_peered":"2023-10-08T16:08:56.454330+0000","last_clean":"2023-10-08T16:08:56.454330+0000","last_became_active":"2023-10-08T16:08:56.453715+0000","last_became_peered":"2023-10-08T16:08:56.453715+0000","last_unstale":"2023-10-08T16:08:56.454330+0000","last_undegraded":"2023-10-08T16:08:56.454330+0000","last_fullsized":"2023-10-08T16:08:56.454330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:20.990840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.456498+0000","last_change":"2023-10-08T16:08:55.451725+0000","last_active":"2023-10-08T16:08:56.456498+0000","last_peered":"2023-10-08T16:08:56.456498+0000","last_clean":"2023-10-08T16:08:56.456498+0000","last_became_active":"2023-10-08T16:08:55.451533+0000","last_became_peered":"2023-10-08T16:08:55.451533+0000","last_unstale":"2023-10-08T16:08:56.456498+0000","last_undegraded":"2023-10-08T16:08:56.456498+0000","last_fullsized":"2023-10-08T16:08:56.456498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:55.460997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455330+0000","last_change":"2023-10-08T16:08:56.455145+0000","last_active":"2023-10-08T16:08:56.455330+0000","last_peered":"2023-10-08T16:08:56.455330+0000","last_clean":"2023-10-08T16:08:56.455330+0000","last_became_active":"2023-10-08T16:08:56.454917+0000","last_became_peered":"2023-10-08T16:08:56.454917+0000","last_unstale":"2023-10-08T16:08:56.455330+0000","last_undegraded":"2023-10-08T16:08:56.455330+0000","last_fullsized":"2023-10-08T16:08:56.455330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:21.094526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452735+0000","last_change":"2023-10-08T16:08:55.449671+0000","last_active":"2023-10-08T16:08:56.452735+0000","last_peered":"2023-10-08T16:08:56.452735+0000","last_clean":"2023-10-08T16:08:56.452735+0000","last_became_active":"2023-10-08T16:08:55.449136+0000","last_became_peered":"2023-10-08T16:08:55.449136+0000","last_unstale":"2023-10-08T16:08:56.452735+0000","last_undegraded":"2023-10-08T16:08:56.452735+0000","last_fullsized":"2023-10-08T16:08:56.452735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:09.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452915+0000","last_change":"2023-10-08T16:08:56.452853+0000","last_active":"2023-10-08T16:08:56.452915+0000","last_peered":"2023-10-08T16:08:56.452915+0000","last_clean":"2023-10-08T16:08:56.452915+0000","last_became_active":"2023-10-08T16:08:56.452166+0000","last_became_peered":"2023-10-08T16:08:56.452166+0000","last_unstale":"2023-10-08T16:08:56.452915+0000","last_undegraded":"2023-10-08T16:08:56.452915+0000","last_fullsized":"2023-10-08T16:08:56.452915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.462102+0000","last_change":"2023-10-08T16:08:55.454471+0000","last_active":"2023-10-08T16:08:56.462102+0000","last_peered":"2023-10-08T16:08:56.462102+0000","last_clean":"2023-10-08T16:08:56.462102+0000","last_became_active":"2023-10-08T16:08:55.454025+0000","last_became_peered":"2023-10-08T16:08:55.454025+0000","last_unstale":"2023-10-08T16:08:56.462102+0000","last_undegraded":"2023-10-08T16:08:56.462102+0000","last_fullsized":"2023-10-08T16:08:56.462102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.883624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447164+0000","last_change":"2023-10-08T16:08:56.447091+0000","last_active":"2023-10-08T16:08:56.447164+0000","last_peered":"2023-10-08T16:08:56.447164+0000","last_clean":"2023-10-08T16:08:56.447164+0000","last_became_active":"2023-10-08T16:08:56.446639+0000","last_became_peered":"2023-10-08T16:08:56.446639+0000","last_unstale":"2023-10-08T16:08:56.447164+0000","last_undegraded":"2023-10-08T16:08:56.447164+0000","last_fullsized":"2023-10-08T16:08:56.447164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.456680+0000","last_change":"2023-10-08T16:08:55.447549+0000","last_active":"2023-10-08T16:08:56.456680+0000","last_peered":"2023-10-08T16:08:56.456680+0000","last_clean":"2023-10-08T16:08:56.456680+0000","last_became_active":"2023-10-08T16:08:55.447129+0000","last_became_peered":"2023-10-08T16:08:55.447129+0000","last_unstale":"2023-10-08T16:08:56.456680+0000","last_undegraded":"2023-10-08T16:08:56.456680+0000","last_fullsized":"2023-10-08T16:08:56.456680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:10.409532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449097+0000","last_change":"2023-10-08T16:08:56.448339+0000","last_active":"2023-10-08T16:08:56.449097+0000","last_peered":"2023-10-08T16:08:56.449097+0000","last_clean":"2023-10-08T16:08:56.449097+0000","last_became_active":"2023-10-08T16:08:56.448099+0000","last_became_peered":"2023-10-08T16:08:56.448099+0000","last_unstale":"2023-10-08T16:08:56.449097+0000","last_undegraded":"2023-10-08T16:08:56.449097+0000","last_fullsized":"2023-10-08T16:08:56.449097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.458985+0000","last_change":"2023-10-08T16:08:55.450237+0000","last_active":"2023-10-08T16:08:56.458985+0000","last_peered":"2023-10-08T16:08:56.458985+0000","last_clean":"2023-10-08T16:08:56.458985+0000","last_became_active":"2023-10-08T16:08:55.449996+0000","last_became_peered":"2023-10-08T16:08:55.449996+0000","last_unstale":"2023-10-08T16:08:56.458985+0000","last_undegraded":"2023-10-08T16:08:56.458985+0000","last_fullsized":"2023-10-08T16:08:56.458985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:38.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447777+0000","last_change":"2023-10-08T16:08:56.447646+0000","last_active":"2023-10-08T16:08:56.447777+0000","last_peered":"2023-10-08T16:08:56.447777+0000","last_clean":"2023-10-08T16:08:56.447777+0000","last_became_active":"2023-10-08T16:08:56.446808+0000","last_became_peered":"2023-10-08T16:08:56.446808+0000","last_unstale":"2023-10-08T16:08:56.447777+0000","last_undegraded":"2023-10-08T16:08:56.447777+0000","last_fullsized":"2023-10-08T16:08:56.447777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.458107+0000","last_change":"2023-10-08T16:08:55.446310+0000","last_active":"2023-10-08T16:08:56.458107+0000","last_peered":"2023-10-08T16:08:56.458107+0000","last_clean":"2023-10-08T16:08:56.458107+0000","last_became_active":"2023-10-08T16:08:55.446055+0000","last_became_peered":"2023-10-08T16:08:55.446055+0000","last_unstale":"2023-10-08T16:08:56.458107+0000","last_undegraded":"2023-10-08T16:08:56.458107+0000","last_fullsized":"2023-10-08T16:08:56.458107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:10.879816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448723+0000","last_change":"2023-10-08T16:08:56.448213+0000","last_active":"2023-10-08T16:08:56.448723+0000","last_peered":"2023-10-08T16:08:56.448723+0000","last_clean":"2023-10-08T16:08:56.448723+0000","last_became_active":"2023-10-08T16:08:56.447622+0000","last_became_peered":"2023-10-08T16:08:56.447622+0000","last_unstale":"2023-10-08T16:08:56.448723+0000","last_undegraded":"2023-10-08T16:08:56.448723+0000","last_fullsized":"2023-10-08T16:08:56.448723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:47.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438199+0000","last_change":"2023-10-08T16:08:55.450571+0000","last_active":"2023-10-08T16:08:56.438199+0000","last_peered":"2023-10-08T16:08:56.438199+0000","last_clean":"2023-10-08T16:08:56.438199+0000","last_became_active":"2023-10-08T16:08:55.450334+0000","last_became_peered":"2023-10-08T16:08:55.450334+0000","last_unstale":"2023-10-08T16:08:56.438199+0000","last_undegraded":"2023-10-08T16:08:56.438199+0000","last_fullsized":"2023-10-08T16:08:56.438199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:52.239027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448298+0000","last_change":"2023-10-08T16:08:56.448233+0000","last_active":"2023-10-08T16:08:56.448298+0000","last_peered":"2023-10-08T16:08:56.448298+0000","last_clean":"2023-10-08T16:08:56.448298+0000","last_became_active":"2023-10-08T16:08:56.447993+0000","last_became_peered":"2023-10-08T16:08:56.447993+0000","last_unstale":"2023-10-08T16:08:56.448298+0000","last_undegraded":"2023-10-08T16:08:56.448298+0000","last_fullsized":"2023-10-08T16:08:56.448298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:09.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.441605+0000","last_change":"2023-10-08T16:08:55.438753+0000","last_active":"2023-10-08T16:08:56.441605+0000","last_peered":"2023-10-08T16:08:56.441605+0000","last_clean":"2023-10-08T16:08:56.441605+0000","last_became_active":"2023-10-08T16:08:55.438500+0000","last_became_peered":"2023-10-08T16:08:55.438500+0000","last_unstale":"2023-10-08T16:08:56.441605+0000","last_undegraded":"2023-10-08T16:08:56.441605+0000","last_fullsized":"2023-10-08T16:08:56.441605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:55.385578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.444726+0000","last_change":"2023-10-08T16:08:56.444659+0000","last_active":"2023-10-08T16:08:56.444726+0000","last_peered":"2023-10-08T16:08:56.444726+0000","last_clean":"2023-10-08T16:08:56.444726+0000","last_became_active":"2023-10-08T16:08:56.444413+0000","last_became_peered":"2023-10-08T16:08:56.444413+0000","last_unstale":"2023-10-08T16:08:56.444726+0000","last_undegraded":"2023-10-08T16:08:56.444726+0000","last_fullsized":"2023-10-08T16:08:56.444726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:49.697041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.439116+0000","last_change":"2023-10-08T16:08:55.451505+0000","last_active":"2023-10-08T16:08:56.439116+0000","last_peered":"2023-10-08T16:08:56.439116+0000","last_clean":"2023-10-08T16:08:56.439116+0000","last_became_active":"2023-10-08T16:08:55.451279+0000","last_became_peered":"2023-10-08T16:08:55.451279+0000","last_unstale":"2023-10-08T16:08:56.439116+0000","last_undegraded":"2023-10-08T16:08:56.439116+0000","last_fullsized":"2023-10-08T16:08:56.439116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452984+0000","last_change":"2023-10-08T16:08:56.452913+0000","last_active":"2023-10-08T16:08:56.452984+0000","last_peered":"2023-10-08T16:08:56.452984+0000","last_clean":"2023-10-08T16:08:56.452984+0000","last_became_active":"2023-10-08T16:08:56.452509+0000","last_became_peered":"2023-10-08T16:08:56.452509+0000","last_unstale":"2023-10-08T16:08:56.452984+0000","last_undegraded":"2023-10-08T16:08:56.452984+0000","last_fullsized":"2023-10-08T16:08:56.452984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:39.843156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.444470+0000","last_change":"2023-10-08T16:08:55.441612+0000","last_active":"2023-10-08T16:08:56.444470+0000","last_peered":"2023-10-08T16:08:56.444470+0000","last_clean":"2023-10-08T16:08:56.444470+0000","last_became_active":"2023-10-08T16:08:55.441363+0000","last_became_peered":"2023-10-08T16:08:55.441363+0000","last_unstale":"2023-10-08T16:08:56.444470+0000","last_undegraded":"2023-10-08T16:08:56.444470+0000","last_fullsized":"2023-10-08T16:08:56.444470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:49.652172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.451939+0000","last_change":"2023-10-08T16:08:56.451062+0000","last_active":"2023-10-08T16:08:56.451939+0000","last_peered":"2023-10-08T16:08:56.451939+0000","last_clean":"2023-10-08T16:08:56.451939+0000","last_became_active":"2023-10-08T16:08:56.446619+0000","last_became_peered":"2023-10-08T16:08:56.446619+0000","last_unstale":"2023-10-08T16:08:56.451939+0000","last_undegraded":"2023-10-08T16:08:56.451939+0000","last_fullsized":"2023-10-08T16:08:56.451939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.459179+0000","last_change":"2023-10-08T16:08:55.444388+0000","last_active":"2023-10-08T16:08:56.459179+0000","last_peered":"2023-10-08T16:08:56.459179+0000","last_clean":"2023-10-08T16:08:56.459179+0000","last_became_active":"2023-10-08T16:08:55.443861+0000","last_became_peered":"2023-10-08T16:08:55.443861+0000","last_unstale":"2023-10-08T16:08:56.459179+0000","last_undegraded":"2023-10-08T16:08:56.459179+0000","last_fullsized":"2023-10-08T16:08:56.459179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:39.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.450263+0000","last_change":"2023-10-08T16:08:56.450129+0000","last_active":"2023-10-08T16:08:56.450263+0000","last_peered":"2023-10-08T16:08:56.450263+0000","last_clean":"2023-10-08T16:08:56.450263+0000","last_became_active":"2023-10-08T16:08:56.449777+0000","last_became_peered":"2023-10-08T16:08:56.449777+0000","last_unstale":"2023-10-08T16:08:56.450263+0000","last_undegraded":"2023-10-08T16:08:56.450263+0000","last_fullsized":"2023-10-08T16:08:56.450263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:10.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.459859+0000","last_change":"2023-10-08T16:08:55.446100+0000","last_active":"2023-10-08T16:08:56.459859+0000","last_peered":"2023-10-08T16:08:56.459859+0000","last_clean":"2023-10-08T16:08:56.459859+0000","last_became_active":"2023-10-08T16:08:55.445020+0000","last_became_peered":"2023-10-08T16:08:55.445020+0000","last_unstale":"2023-10-08T16:08:56.459859+0000","last_undegraded":"2023-10-08T16:08:56.459859+0000","last_fullsized":"2023-10-08T16:08:56.459859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449712+0000","last_change":"2023-10-08T16:08:56.449655+0000","last_active":"2023-10-08T16:08:56.449712+0000","last_peered":"2023-10-08T16:08:56.449712+0000","last_clean":"2023-10-08T16:08:56.449712+0000","last_became_active":"2023-10-08T16:08:56.449191+0000","last_became_peered":"2023-10-08T16:08:56.449191+0000","last_unstale":"2023-10-08T16:08:56.449712+0000","last_undegraded":"2023-10-08T16:08:56.449712+0000","last_fullsized":"2023-10-08T16:08:56.449712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:49.697041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453595+0000","last_change":"2023-10-08T16:08:55.450684+0000","last_active":"2023-10-08T16:08:56.453595+0000","last_peered":"2023-10-08T16:08:56.453595+0000","last_clean":"2023-10-08T16:08:56.453595+0000","last_became_active":"2023-10-08T16:08:55.450407+0000","last_became_peered":"2023-10-08T16:08:55.450407+0000","last_unstale":"2023-10-08T16:08:56.453595+0000","last_undegraded":"2023-10-08T16:08:56.453595+0000","last_fullsized":"2023-10-08T16:08:56.453595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:52.823655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443071+0000","last_change":"2023-10-08T16:08:56.442550+0000","last_active":"2023-10-08T16:08:56.443071+0000","last_peered":"2023-10-08T16:08:56.443071+0000","last_clean":"2023-10-08T16:08:56.443071+0000","last_became_active":"2023-10-08T16:08:56.442391+0000","last_became_peered":"2023-10-08T16:08:56.442391+0000","last_unstale":"2023-10-08T16:08:56.443071+0000","last_undegraded":"2023-10-08T16:08:56.443071+0000","last_fullsized":"2023-10-08T16:08:56.443071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446529+0000","last_change":"2023-10-08T16:08:55.447354+0000","last_active":"2023-10-08T16:08:56.446529+0000","last_peered":"2023-10-08T16:08:56.446529+0000","last_clean":"2023-10-08T16:08:56.446529+0000","last_became_active":"2023-10-08T16:08:55.446789+0000","last_became_peered":"2023-10-08T16:08:55.446789+0000","last_unstale":"2023-10-08T16:08:56.446529+0000","last_undegraded":"2023-10-08T16:08:56.446529+0000","last_fullsized":"2023-10-08T16:08:56.446529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:52.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454892+0000","last_change":"2023-10-08T16:08:56.454653+0000","last_active":"2023-10-08T16:08:56.454892+0000","last_peered":"2023-10-08T16:08:56.454892+0000","last_clean":"2023-10-08T16:08:56.454892+0000","last_became_active":"2023-10-08T16:08:56.453845+0000","last_became_peered":"2023-10-08T16:08:56.453845+0000","last_unstale":"2023-10-08T16:08:56.454892+0000","last_undegraded":"2023-10-08T16:08:56.454892+0000","last_fullsized":"2023-10-08T16:08:56.454892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:49.697041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.439181+0000","last_change":"2023-10-08T16:08:55.446159+0000","last_active":"2023-10-08T16:08:56.439181+0000","last_peered":"2023-10-08T16:08:56.439181+0000","last_clean":"2023-10-08T16:08:56.439181+0000","last_became_active":"2023-10-08T16:08:55.445930+0000","last_became_peered":"2023-10-08T16:08:55.445930+0000","last_unstale":"2023-10-08T16:08:56.439181+0000","last_undegraded":"2023-10-08T16:08:56.439181+0000","last_fullsized":"2023-10-08T16:08:56.439181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:15.925120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454987+0000","last_change":"2023-10-08T16:08:56.454930+0000","last_active":"2023-10-08T16:08:56.454987+0000","last_peered":"2023-10-08T16:08:56.454987+0000","last_clean":"2023-10-08T16:08:56.454987+0000","last_became_active":"2023-10-08T16:08:56.454352+0000","last_became_peered":"2023-10-08T16:08:56.454352+0000","last_unstale":"2023-10-08T16:08:56.454987+0000","last_undegraded":"2023-10-08T16:08:56.454987+0000","last_fullsized":"2023-10-08T16:08:56.454987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:44.399894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.464511+0000","last_change":"2023-10-08T16:08:55.453453+0000","last_active":"2023-10-08T16:08:56.464511+0000","last_peered":"2023-10-08T16:08:56.464511+0000","last_clean":"2023-10-08T16:08:56.464511+0000","last_became_active":"2023-10-08T16:08:55.452722+0000","last_became_peered":"2023-10-08T16:08:55.452722+0000","last_unstale":"2023-10-08T16:08:56.464511+0000","last_undegraded":"2023-10-08T16:08:56.464511+0000","last_fullsized":"2023-10-08T16:08:56.464511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:13.006947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.441519+0000","last_change":"2023-10-08T16:08:56.441443+0000","last_active":"2023-10-08T16:08:56.441519+0000","last_peered":"2023-10-08T16:08:56.441519+0000","last_clean":"2023-10-08T16:08:56.441519+0000","last_became_active":"2023-10-08T16:08:56.441138+0000","last_became_peered":"2023-10-08T16:08:56.441138+0000","last_unstale":"2023-10-08T16:08:56.441519+0000","last_undegraded":"2023-10-08T16:08:56.441519+0000","last_fullsized":"2023-10-08T16:08:56.441519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455996+0000","last_change":"2023-10-08T16:08:55.447305+0000","last_active":"2023-10-08T16:08:56.455996+0000","last_peered":"2023-10-08T16:08:56.455996+0000","last_clean":"2023-10-08T16:08:56.455996+0000","last_became_active":"2023-10-08T16:08:55.446735+0000","last_became_peered":"2023-10-08T16:08:55.446735+0000","last_unstale":"2023-10-08T16:08:56.455996+0000","last_undegraded":"2023-10-08T16:08:56.455996+0000","last_fullsized":"2023-10-08T16:08:56.455996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:09.573102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448124+0000","last_change":"2023-10-08T16:08:56.448055+0000","last_active":"2023-10-08T16:08:56.448124+0000","last_peered":"2023-10-08T16:08:56.448124+0000","last_clean":"2023-10-08T16:08:56.448124+0000","last_became_active":"2023-10-08T16:08:56.447800+0000","last_became_peered":"2023-10-08T16:08:56.447800+0000","last_unstale":"2023-10-08T16:08:56.448124+0000","last_undegraded":"2023-10-08T16:08:56.448124+0000","last_fullsized":"2023-10-08T16:08:56.448124+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:07.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.464168+0000","last_change":"2023-10-08T16:08:55.454617+0000","last_active":"2023-10-08T16:08:56.464168+0000","last_peered":"2023-10-08T16:08:56.464168+0000","last_clean":"2023-10-08T16:08:56.464168+0000","last_became_active":"2023-10-08T16:08:55.454282+0000","last_became_peered":"2023-10-08T16:08:55.454282+0000","last_unstale":"2023-10-08T16:08:56.464168+0000","last_undegraded":"2023-10-08T16:08:56.464168+0000","last_fullsized":"2023-10-08T16:08:56.464168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:31.993858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445927+0000","last_change":"2023-10-08T16:08:56.445873+0000","last_active":"2023-10-08T16:08:56.445927+0000","last_peered":"2023-10-08T16:08:56.445927+0000","last_clean":"2023-10-08T16:08:56.445927+0000","last_became_active":"2023-10-08T16:08:56.445242+0000","last_became_peered":"2023-10-08T16:08:56.445242+0000","last_unstale":"2023-10-08T16:08:56.445927+0000","last_undegraded":"2023-10-08T16:08:56.445927+0000","last_fullsized":"2023-10-08T16:08:56.445927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:14.011793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455989+0000","last_change":"2023-10-08T16:08:55.450793+0000","last_active":"2023-10-08T16:08:56.455989+0000","last_peered":"2023-10-08T16:08:56.455989+0000","last_clean":"2023-10-08T16:08:56.455989+0000","last_became_active":"2023-10-08T16:08:55.450547+0000","last_became_peered":"2023-10-08T16:08:55.450547+0000","last_unstale":"2023-10-08T16:08:56.455989+0000","last_undegraded":"2023-10-08T16:08:56.455989+0000","last_fullsized":"2023-10-08T16:08:56.455989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:19.588783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447359+0000","last_change":"2023-10-08T16:08:56.447284+0000","last_active":"2023-10-08T16:08:56.447359+0000","last_peered":"2023-10-08T16:08:56.447359+0000","last_clean":"2023-10-08T16:08:56.447359+0000","last_became_active":"2023-10-08T16:08:56.447061+0000","last_became_peered":"2023-10-08T16:08:56.447061+0000","last_unstale":"2023-10-08T16:08:56.447359+0000","last_undegraded":"2023-10-08T16:08:56.447359+0000","last_fullsized":"2023-10-08T16:08:56.447359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:10.026926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442213+0000","last_change":"2023-10-08T16:08:55.452317+0000","last_active":"2023-10-08T16:08:56.442213+0000","last_peered":"2023-10-08T16:08:56.442213+0000","last_clean":"2023-10-08T16:08:56.442213+0000","last_became_active":"2023-10-08T16:08:55.452086+0000","last_became_peered":"2023-10-08T16:08:55.452086+0000","last_unstale":"2023-10-08T16:08:56.442213+0000","last_undegraded":"2023-10-08T16:08:56.442213+0000","last_fullsized":"2023-10-08T16:08:56.442213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:23.064317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453602+0000","last_change":"2023-10-08T16:08:56.453490+0000","last_active":"2023-10-08T16:08:56.453602+0000","last_peered":"2023-10-08T16:08:56.453602+0000","last_clean":"2023-10-08T16:08:56.453602+0000","last_became_active":"2023-10-08T16:08:56.453009+0000","last_became_peered":"2023-10-08T16:08:56.453009+0000","last_unstale":"2023-10-08T16:08:56.453602+0000","last_undegraded":"2023-10-08T16:08:56.453602+0000","last_fullsized":"2023-10-08T16:08:56.453602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:47.943322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442557+0000","last_change":"2023-10-08T16:08:55.450948+0000","last_active":"2023-10-08T16:08:56.442557+0000","last_peered":"2023-10-08T16:08:56.442557+0000","last_clean":"2023-10-08T16:08:56.442557+0000","last_became_active":"2023-10-08T16:08:55.450483+0000","last_became_peered":"2023-10-08T16:08:55.450483+0000","last_unstale":"2023-10-08T16:08:56.442557+0000","last_undegraded":"2023-10-08T16:08:56.442557+0000","last_fullsized":"2023-10-08T16:08:56.442557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:20.089680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453179+0000","last_change":"2023-10-08T16:08:56.452952+0000","last_active":"2023-10-08T16:08:56.453179+0000","last_peered":"2023-10-08T16:08:56.453179+0000","last_clean":"2023-10-08T16:08:56.453179+0000","last_became_active":"2023-10-08T16:08:56.452675+0000","last_became_peered":"2023-10-08T16:08:56.452675+0000","last_unstale":"2023-10-08T16:08:56.453179+0000","last_undegraded":"2023-10-08T16:08:56.453179+0000","last_fullsized":"2023-10-08T16:08:56.453179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:10.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438822+0000","last_change":"2023-10-08T16:08:55.448307+0000","last_active":"2023-10-08T16:08:56.438822+0000","last_peered":"2023-10-08T16:08:56.438822+0000","last_clean":"2023-10-08T16:08:56.438822+0000","last_became_active":"2023-10-08T16:08:55.448064+0000","last_became_peered":"2023-10-08T16:08:55.448064+0000","last_unstale":"2023-10-08T16:08:56.438822+0000","last_undegraded":"2023-10-08T16:08:56.438822+0000","last_fullsized":"2023-10-08T16:08:56.438822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:12.916924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445278+0000","last_change":"2023-10-08T16:08:56.444165+0000","last_active":"2023-10-08T16:08:56.445278+0000","last_peered":"2023-10-08T16:08:56.445278+0000","last_clean":"2023-10-08T16:08:56.445278+0000","last_became_active":"2023-10-08T16:08:56.443994+0000","last_became_peered":"2023-10-08T16:08:56.443994+0000","last_unstale":"2023-10-08T16:08:56.445278+0000","last_undegraded":"2023-10-08T16:08:56.445278+0000","last_fullsized":"2023-10-08T16:08:56.445278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:49.821594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443457+0000","last_change":"2023-10-08T16:08:55.445304+0000","last_active":"2023-10-08T16:08:56.443457+0000","last_peered":"2023-10-08T16:08:56.443457+0000","last_clean":"2023-10-08T16:08:56.443457+0000","last_became_active":"2023-10-08T16:08:55.445049+0000","last_became_peered":"2023-10-08T16:08:55.445049+0000","last_unstale":"2023-10-08T16:08:56.443457+0000","last_undegraded":"2023-10-08T16:08:56.443457+0000","last_fullsized":"2023-10-08T16:08:56.443457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:46.859406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449632+0000","last_change":"2023-10-08T16:08:56.449573+0000","last_active":"2023-10-08T16:08:56.449632+0000","last_peered":"2023-10-08T16:08:56.449632+0000","last_clean":"2023-10-08T16:08:56.449632+0000","last_became_active":"2023-10-08T16:08:56.449343+0000","last_became_peered":"2023-10-08T16:08:56.449343+0000","last_unstale":"2023-10-08T16:08:56.449632+0000","last_undegraded":"2023-10-08T16:08:56.449632+0000","last_fullsized":"2023-10-08T16:08:56.449632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.457148+0000","last_change":"2023-10-08T16:08:55.444963+0000","last_active":"2023-10-08T16:08:56.457148+0000","last_peered":"2023-10-08T16:08:56.457148+0000","last_clean":"2023-10-08T16:08:56.457148+0000","last_became_active":"2023-10-08T16:08:55.444708+0000","last_became_peered":"2023-10-08T16:08:55.444708+0000","last_unstale":"2023-10-08T16:08:56.457148+0000","last_undegraded":"2023-10-08T16:08:56.457148+0000","last_fullsized":"2023-10-08T16:08:56.457148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449147+0000","last_change":"2023-10-08T16:08:56.449041+0000","last_active":"2023-10-08T16:08:56.449147+0000","last_peered":"2023-10-08T16:08:56.449147+0000","last_clean":"2023-10-08T16:08:56.449147+0000","last_became_active":"2023-10-08T16:08:56.448667+0000","last_became_peered":"2023-10-08T16:08:56.448667+0000","last_unstale":"2023-10-08T16:08:56.449147+0000","last_undegraded":"2023-10-08T16:08:56.449147+0000","last_fullsized":"2023-10-08T16:08:56.449147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438668+0000","last_change":"2023-10-08T16:08:55.448320+0000","last_active":"2023-10-08T16:08:56.438668+0000","last_peered":"2023-10-08T16:08:56.438668+0000","last_clean":"2023-10-08T16:08:56.438668+0000","last_became_active":"2023-10-08T16:08:55.448092+0000","last_became_peered":"2023-10-08T16:08:55.448092+0000","last_unstale":"2023-10-08T16:08:56.438668+0000","last_undegraded":"2023-10-08T16:08:56.438668+0000","last_fullsized":"2023-10-08T16:08:56.438668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:55.828614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452881+0000","last_change":"2023-10-08T16:08:56.452819+0000","last_active":"2023-10-08T16:08:56.452881+0000","last_peered":"2023-10-08T16:08:56.452881+0000","last_clean":"2023-10-08T16:08:56.452881+0000","last_became_active":"2023-10-08T16:08:56.452612+0000","last_became_peered":"2023-10-08T16:08:56.452612+0000","last_unstale":"2023-10-08T16:08:56.452881+0000","last_undegraded":"2023-10-08T16:08:56.452881+0000","last_fullsized":"2023-10-08T16:08:56.452881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442085+0000","last_change":"2023-10-08T16:08:55.449538+0000","last_active":"2023-10-08T16:08:56.442085+0000","last_peered":"2023-10-08T16:08:56.442085+0000","last_clean":"2023-10-08T16:08:56.442085+0000","last_became_active":"2023-10-08T16:08:55.449266+0000","last_became_peered":"2023-10-08T16:08:55.449266+0000","last_unstale":"2023-10-08T16:08:56.442085+0000","last_undegraded":"2023-10-08T16:08:56.442085+0000","last_fullsized":"2023-10-08T16:08:56.442085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:45.246024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446291+0000","last_change":"2023-10-08T16:08:56.446062+0000","last_active":"2023-10-08T16:08:56.446291+0000","last_peered":"2023-10-08T16:08:56.446291+0000","last_clean":"2023-10-08T16:08:56.446291+0000","last_became_active":"2023-10-08T16:08:56.445821+0000","last_became_peered":"2023-10-08T16:08:56.445821+0000","last_unstale":"2023-10-08T16:08:56.446291+0000","last_undegraded":"2023-10-08T16:08:56.446291+0000","last_fullsized":"2023-10-08T16:08:56.446291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:26:05.006624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443594+0000","last_change":"2023-10-08T16:08:55.451262+0000","last_active":"2023-10-08T16:08:56.443594+0000","last_peered":"2023-10-08T16:08:56.443594+0000","last_clean":"2023-10-08T16:08:56.443594+0000","last_became_active":"2023-10-08T16:08:55.451044+0000","last_became_peered":"2023-10-08T16:08:55.451044+0000","last_unstale":"2023-10-08T16:08:56.443594+0000","last_undegraded":"2023-10-08T16:08:56.443594+0000","last_fullsized":"2023-10-08T16:08:56.443594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:51.332489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455312+0000","last_change":"2023-10-08T16:08:56.455071+0000","last_active":"2023-10-08T16:08:56.455312+0000","last_peered":"2023-10-08T16:08:56.455312+0000","last_clean":"2023-10-08T16:08:56.455312+0000","last_became_active":"2023-10-08T16:08:56.454668+0000","last_became_peered":"2023-10-08T16:08:56.454668+0000","last_unstale":"2023-10-08T16:08:56.455312+0000","last_undegraded":"2023-10-08T16:08:56.455312+0000","last_fullsized":"2023-10-08T16:08:56.455312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:17.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.440204+0000","last_change":"2023-10-08T16:08:55.441810+0000","last_active":"2023-10-08T16:08:56.440204+0000","last_peered":"2023-10-08T16:08:56.440204+0000","last_clean":"2023-10-08T16:08:56.440204+0000","last_became_active":"2023-10-08T16:08:55.441123+0000","last_became_peered":"2023-10-08T16:08:55.441123+0000","last_unstale":"2023-10-08T16:08:56.440204+0000","last_undegraded":"2023-10-08T16:08:56.440204+0000","last_fullsized":"2023-10-08T16:08:56.440204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:37.519813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452583+0000","last_change":"2023-10-08T16:08:56.452529+0000","last_active":"2023-10-08T16:08:56.452583+0000","last_peered":"2023-10-08T16:08:56.452583+0000","last_clean":"2023-10-08T16:08:56.452583+0000","last_became_active":"2023-10-08T16:08:56.451875+0000","last_became_peered":"2023-10-08T16:08:56.451875+0000","last_unstale":"2023-10-08T16:08:56.452583+0000","last_undegraded":"2023-10-08T16:08:56.452583+0000","last_fullsized":"2023-10-08T16:08:56.452583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438250+0000","last_change":"2023-10-08T16:08:55.450231+0000","last_active":"2023-10-08T16:08:56.438250+0000","last_peered":"2023-10-08T16:08:56.438250+0000","last_clean":"2023-10-08T16:08:56.438250+0000","last_became_active":"2023-10-08T16:08:55.450004+0000","last_became_peered":"2023-10-08T16:08:55.450004+0000","last_unstale":"2023-10-08T16:08:56.438250+0000","last_undegraded":"2023-10-08T16:08:56.438250+0000","last_fullsized":"2023-10-08T16:08:56.438250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.444646+0000","last_change":"2023-10-08T16:08:56.444470+0000","last_active":"2023-10-08T16:08:56.444646+0000","last_peered":"2023-10-08T16:08:56.444646+0000","last_clean":"2023-10-08T16:08:56.444646+0000","last_became_active":"2023-10-08T16:08:56.444235+0000","last_became_peered":"2023-10-08T16:08:56.444235+0000","last_unstale":"2023-10-08T16:08:56.444646+0000","last_undegraded":"2023-10-08T16:08:56.444646+0000","last_fullsized":"2023-10-08T16:08:56.444646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438611+0000","last_change":"2023-10-08T16:08:55.453605+0000","last_active":"2023-10-08T16:08:56.438611+0000","last_peered":"2023-10-08T16:08:56.438611+0000","last_clean":"2023-10-08T16:08:56.438611+0000","last_became_active":"2023-10-08T16:08:55.452990+0000","last_became_peered":"2023-10-08T16:08:55.452990+0000","last_unstale":"2023-10-08T16:08:56.438611+0000","last_undegraded":"2023-10-08T16:08:56.438611+0000","last_fullsized":"2023-10-08T16:08:56.438611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:32.746669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454933+0000","last_change":"2023-10-08T16:08:56.454868+0000","last_active":"2023-10-08T16:08:56.454933+0000","last_peered":"2023-10-08T16:08:56.454933+0000","last_clean":"2023-10-08T16:08:56.454933+0000","last_became_active":"2023-10-08T16:08:56.454624+0000","last_became_peered":"2023-10-08T16:08:56.454624+0000","last_unstale":"2023-10-08T16:08:56.454933+0000","last_undegraded":"2023-10-08T16:08:56.454933+0000","last_fullsized":"2023-10-08T16:08:56.454933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442628+0000","last_change":"2023-10-08T16:08:55.447467+0000","last_active":"2023-10-08T16:08:56.442628+0000","last_peered":"2023-10-08T16:08:56.442628+0000","last_clean":"2023-10-08T16:08:56.442628+0000","last_became_active":"2023-10-08T16:08:55.447066+0000","last_became_peered":"2023-10-08T16:08:55.447066+0000","last_unstale":"2023-10-08T16:08:56.442628+0000","last_undegraded":"2023-10-08T16:08:56.442628+0000","last_fullsized":"2023-10-08T16:08:56.442628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455407+0000","last_change":"2023-10-08T16:08:56.453961+0000","last_active":"2023-10-08T16:08:56.455407+0000","last_peered":"2023-10-08T16:08:56.455407+0000","last_clean":"2023-10-08T16:08:56.455407+0000","last_became_active":"2023-10-08T16:08:56.453337+0000","last_became_peered":"2023-10-08T16:08:56.453337+0000","last_unstale":"2023-10-08T16:08:56.455407+0000","last_undegraded":"2023-10-08T16:08:56.455407+0000","last_fullsized":"2023-10-08T16:08:56.455407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:11.483542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455975+0000","last_change":"2023-10-08T16:08:55.446817+0000","last_active":"2023-10-08T16:08:56.455975+0000","last_peered":"2023-10-08T16:08:56.455975+0000","last_clean":"2023-10-08T16:08:56.455975+0000","last_became_active":"2023-10-08T16:08:55.446562+0000","last_became_peered":"2023-10-08T16:08:55.446562+0000","last_unstale":"2023-10-08T16:08:56.455975+0000","last_undegraded":"2023-10-08T16:08:56.455975+0000","last_fullsized":"2023-10-08T16:08:56.455975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443285+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:08:56.443285+0000","last_peered":"2023-10-08T16:08:56.443285+0000","last_clean":"2023-10-08T16:08:56.443285+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:08:56.443285+0000","last_undegraded":"2023-10-08T16:08:56.443285+0000","last_fullsized":"2023-10-08T16:08:56.443285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49299999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":1.756,"15min":1.756},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.625,"5min":1.79,"15min":1.79},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60199999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81100000000000005,"5min":1.823,"15min":1.823},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579414,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.504},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.65600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.745,"15min":0.745},"last":0.68799999999999994}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.433},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.48099999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194899,"statfs":{"total":200000000,"available":199577382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.434,"15min":0.49199999999999999},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.59899999999999998,"5min":3.593,"15min":3.593},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.433,"15min":0.47899999999999998},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63700000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63500000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.61299999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64100000000000001,"15min":0.629},"min":{"1min":0.505,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90800000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.35299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83799999999999997,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":3.532,"15min":3.532},"last":0.439}]},{"osd":6,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81100000000000005,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.745},"min":{"1min":0.44800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.095,"15min":1.095},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0289999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194325,"statfs":{"total":200000000,"available":198989138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.307},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58599999999999997,"5min":2.254,"15min":2.254},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61499999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.379},"min":{"1min":0.30299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.628},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.55800000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.52000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83199999999999996,"5min":1.079,"15min":1.079},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.55100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":2.355,"15min":2.355},"last":0.58999999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.002},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199577970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.55600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.30099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.67100000000000004,"5min":0.746,"15min":0.746},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74099999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.434},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.66400000000000003},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.55500000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.5,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579394,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.372},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.628,"15min":0.628},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.43099999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.026},"last":0.52000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70199999999999996,"5min":1.141,"15min":1.141},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":1.149,"15min":1.149},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67300000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.70099999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":14.6,"15min":14.6},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.56899999999999995},"min":{"1min":0.46400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":7.556,"15min":7.556},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.41499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.501},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.58999999999999997},"min":{"1min":0.46999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.373}]},{"osd":4,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69799999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39600000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70399999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.435},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54900000000000004}]}]}],"pool_statfs":[]}} 2023-10-08T16:09:02.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:02.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:05.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:05.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.255+0000 7f4917515700 1 Processor -- start 2023-10-08T16:09:05.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.255+0000 7f4917515700 1 -- start start 2023-10-08T16:09:05.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4917515700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f49100c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4917515700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49100ae320 con 0x7f491015a2e0 2023-10-08T16:09:05.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4917515700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49100ad710 con 0x7f4910159f10 2023-10-08T16:09:05.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4917515700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491015a760 con 0x7f49100cc410 2023-10-08T16:09:05.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4916d14700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f491015a2e0 0x7f49100cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40972/0 (socket says 172.21.15.60:40972) 2023-10-08T16:09:05.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4916d14700 1 -- 172.21.15.60:0/1369874725 learned_addr learned my addr 172.21.15.60:0/1369874725 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4915d12700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f49100c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.256+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801573077 0 0) 0x7f49100ae320 con 0x7f491015a2e0 2023-10-08T16:09:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f8003570 con 0x7f491015a2e0 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431630932 0 0) 0x7f49100ad710 con 0x7f4910159f10 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49100ae320 con 0x7f4910159f10 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4016644448 0 0) 0x7f48f8003570 con 0x7f491015a2e0 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 msgr2=0x7f49100c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f49100c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 >> v1:172.21.15.144:6789/0 conn(0x7f4910159f10 legacy=0x7f49100cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100ad9f0 con 0x7f491015a2e0 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f4908001470 con 0x7f491015a2e0 2023-10-08T16:09:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 >> v1:172.21.15.60:6789/0 conn(0x7f491015a2e0 legacy=0x7f49100cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8003c20 0x7f48f8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f8004810 0x7f48f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f48f8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491015a760 con 0x7f48f8004810 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f800bb90 con 0x7f48f8003c20 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f800bd50 con 0x7f49100cc410 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915d12700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f8004810 0x7f48f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4916513700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8003c20 0x7f48f8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4916d14700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f48f8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915d12700 1 -- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 msgr2=0x7f48f8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915d12700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f48f8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915d12700 1 -- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8003c20 msgr2=0x7f48f8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915d12700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8003c20 0x7f48f8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4915d12700 1 -- 172.21.15.60:0/1369874725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8003570 con 0x7f48f8004810 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.257+0000 7f4916d14700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49100cc410 0x7f48f8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4915d12700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f8004810 0x7f48f8004c80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4904009c00 tx=0x7f49040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9810be1f0623397c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490400e710 con 0x7f48f8004810 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490400e870 con 0x7f48f8004810 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4915511700 1 -- 172.21.15.60:0/1369874725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490400ec30 con 0x7f48f8004810 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4917515700 1 -- 172.21.15.60:0/1369874725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f8004810 msgr2=0x7f48f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4917515700 1 --2- 172.21.15.60:0/1369874725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f8004810 0x7f48f8004c80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4904009c00 tx=0x7f49040091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4916d14700 1 -- 172.21.15.60:0/1369874725 reap_dead start 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4917515700 1 -- 172.21.15.60:0/1369874725 shutdown_connections 2023-10-08T16:09:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4917515700 1 -- 172.21.15.60:0/1369874725 >> 172.21.15.60:0/1369874725 conn(0x7f4910067e40 msgr2=0x7f49100d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4917515700 1 -- 172.21.15.60:0/1369874725 shutdown_connections 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.258+0000 7f4917515700 1 -- 172.21.15.60:0/1369874725 wait complete. 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.259+0000 7f4917515700 1 Processor -- start 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.259+0000 7f4917515700 1 -- start start 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4917515700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8004810 0x7f49100ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4917515700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4910150830 0x7f49100c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4917515700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 0x7f49100c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4917515700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49101584e0 con 0x7f4910150ca0 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4917515700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49100ca170 con 0x7f48f8004810 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4917515700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49100c9560 con 0x7f4910150830 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4916d14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 0x7f49100c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4916d14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 0x7f49100c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37272/0 (socket says 172.21.15.60:37272) 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4916d14700 1 -- 172.21.15.60:0/3615592746 learned_addr learned my addr 172.21.15.60:0/3615592746 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4916513700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8004810 0x7f49100ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.260+0000 7f4915d12700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4910150830 0x7f49100c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4916d14700 1 -- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4910150830 msgr2=0x7f49100c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4916d14700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4910150830 0x7f49100c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4916d14700 1 -- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8004810 msgr2=0x7f49100ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4916d14700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8004810 0x7f49100ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4916d14700 1 -- 172.21.15.60:0/3615592746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100c9840 con 0x7f4910150ca0 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4916d14700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 0x7f49100c8c40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f49100711d0 tx=0x7f49100ae290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49080114f0 con 0x7f4910150ca0 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908011670 con 0x7f4910150ca0 2023-10-08T16:09:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49100c9b20 con 0x7f4910150ca0 2023-10-08T16:09:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908011a30 con 0x7f4910150ca0 2023-10-08T16:09:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.261+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49100d0b30 con 0x7f4910150ca0 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.262+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910089300 con 0x7f4910150ca0 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.262+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49080133e0 con 0x7f4910150ca0 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.263+0000 7f490e7fc700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.263+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4908083bc0 con 0x7f4910150ca0 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.263+0000 7f4916513700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.263+0000 7f4916513700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48fc066f30 0x7f48fc0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4900011320 tx=0x7f49000017a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.268+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4908050e30 con 0x7f4910150ca0 2023-10-08T16:09:05.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.456+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49100890a0 con 0x7f48fc066f30 2023-10-08T16:09:05.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.464+0000 7f490e7fc700 1 -- 172.21.15.60:0/3615592746 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285037 (secure 0 0 0) 0x7f49100890a0 con 0x7f48fc066f30 2023-10-08T16:09:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48fc066f30 msgr2=0x7f48fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48fc066f30 0x7f48fc0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4900011320 tx=0x7f49000017a0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 msgr2=0x7f49100c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 0x7f49100c8c40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f49100711d0 tx=0x7f49100ae290 comp rx=0 tx=0).stop 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 shutdown_connections 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4910150ca0 0x7f49100c8c40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48f8004810 0x7f49100ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 --2- 172.21.15.60:0/3615592746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4910150830 0x7f49100c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 >> 172.21.15.60:0/3615592746 conn(0x7f4910067e40 msgr2=0x7f49100cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 shutdown_connections 2023-10-08T16:09:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.468+0000 7f4917515700 1 -- 172.21.15.60:0/3615592746 wait complete. 2023-10-08T16:09:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:09:05.482 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2023-10-08T16:09:03.612531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4442,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558057,"statfs":{"total":1600000000,"available":1595450700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001555"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449527+0000","last_change":"2023-10-08T16:08:56.449460+0000","last_active":"2023-10-08T16:08:56.449527+0000","last_peered":"2023-10-08T16:08:56.449527+0000","last_clean":"2023-10-08T16:08:56.449527+0000","last_became_active":"2023-10-08T16:08:56.448882+0000","last_became_peered":"2023-10-08T16:08:56.448882+0000","last_unstale":"2023-10-08T16:08:56.449527+0000","last_undegraded":"2023-10-08T16:08:56.449527+0000","last_fullsized":"2023-10-08T16:08:56.449527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453335+0000","last_change":"2023-10-08T16:08:56.453286+0000","last_active":"2023-10-08T16:08:56.453335+0000","last_peered":"2023-10-08T16:08:56.453335+0000","last_clean":"2023-10-08T16:08:56.453335+0000","last_became_active":"2023-10-08T16:08:56.452940+0000","last_became_peered":"2023-10-08T16:08:56.452940+0000","last_unstale":"2023-10-08T16:08:56.453335+0000","last_undegraded":"2023-10-08T16:08:56.453335+0000","last_fullsized":"2023-10-08T16:08:56.453335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453582+0000","last_change":"2023-10-08T16:08:56.453248+0000","last_active":"2023-10-08T16:08:56.453582+0000","last_peered":"2023-10-08T16:08:56.453582+0000","last_clean":"2023-10-08T16:08:56.453582+0000","last_became_active":"2023-10-08T16:08:56.452685+0000","last_became_peered":"2023-10-08T16:08:56.452685+0000","last_unstale":"2023-10-08T16:08:56.453582+0000","last_undegraded":"2023-10-08T16:08:56.453582+0000","last_fullsized":"2023-10-08T16:08:56.453582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:05.471318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445221+0000","last_change":"2023-10-08T16:08:56.445154+0000","last_active":"2023-10-08T16:08:56.445221+0000","last_peered":"2023-10-08T16:08:56.445221+0000","last_clean":"2023-10-08T16:08:56.445221+0000","last_became_active":"2023-10-08T16:08:56.444792+0000","last_became_peered":"2023-10-08T16:08:56.444792+0000","last_unstale":"2023-10-08T16:08:56.445221+0000","last_undegraded":"2023-10-08T16:08:56.445221+0000","last_fullsized":"2023-10-08T16:08:56.445221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:47.343632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448740+0000","last_change":"2023-10-08T16:08:56.448345+0000","last_active":"2023-10-08T16:08:56.448740+0000","last_peered":"2023-10-08T16:08:56.448740+0000","last_clean":"2023-10-08T16:08:56.448740+0000","last_became_active":"2023-10-08T16:08:56.447992+0000","last_became_peered":"2023-10-08T16:08:56.447992+0000","last_unstale":"2023-10-08T16:08:56.448740+0000","last_undegraded":"2023-10-08T16:08:56.448740+0000","last_fullsized":"2023-10-08T16:08:56.448740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:55.567851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452452+0000","last_change":"2023-10-08T16:08:56.452384+0000","last_active":"2023-10-08T16:08:56.452452+0000","last_peered":"2023-10-08T16:08:56.452452+0000","last_clean":"2023-10-08T16:08:56.452452+0000","last_became_active":"2023-10-08T16:08:56.451538+0000","last_became_peered":"2023-10-08T16:08:56.451538+0000","last_unstale":"2023-10-08T16:08:56.452452+0000","last_undegraded":"2023-10-08T16:08:56.452452+0000","last_fullsized":"2023-10-08T16:08:56.452452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449132+0000","last_change":"2023-10-08T16:08:56.448903+0000","last_active":"2023-10-08T16:08:56.449132+0000","last_peered":"2023-10-08T16:08:56.449132+0000","last_clean":"2023-10-08T16:08:56.449132+0000","last_became_active":"2023-10-08T16:08:56.448355+0000","last_became_peered":"2023-10-08T16:08:56.448355+0000","last_unstale":"2023-10-08T16:08:56.449132+0000","last_undegraded":"2023-10-08T16:08:56.449132+0000","last_fullsized":"2023-10-08T16:08:56.449132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.456217+0000","last_change":"2023-10-08T16:08:56.456171+0000","last_active":"2023-10-08T16:08:56.456217+0000","last_peered":"2023-10-08T16:08:56.456217+0000","last_clean":"2023-10-08T16:08:56.456217+0000","last_became_active":"2023-10-08T16:08:56.455514+0000","last_became_peered":"2023-10-08T16:08:56.455514+0000","last_unstale":"2023-10-08T16:08:56.456217+0000","last_undegraded":"2023-10-08T16:08:56.456217+0000","last_fullsized":"2023-10-08T16:08:56.456217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454736+0000","last_change":"2023-10-08T16:08:56.454667+0000","last_active":"2023-10-08T16:08:56.454736+0000","last_peered":"2023-10-08T16:08:56.454736+0000","last_clean":"2023-10-08T16:08:56.454736+0000","last_became_active":"2023-10-08T16:08:56.454440+0000","last_became_peered":"2023-10-08T16:08:56.454440+0000","last_unstale":"2023-10-08T16:08:56.454736+0000","last_undegraded":"2023-10-08T16:08:56.454736+0000","last_fullsized":"2023-10-08T16:08:56.454736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:26.211645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446084+0000","last_change":"2023-10-08T16:08:56.445872+0000","last_active":"2023-10-08T16:08:56.446084+0000","last_peered":"2023-10-08T16:08:56.446084+0000","last_clean":"2023-10-08T16:08:56.446084+0000","last_became_active":"2023-10-08T16:08:56.445324+0000","last_became_peered":"2023-10-08T16:08:56.445324+0000","last_unstale":"2023-10-08T16:08:56.446084+0000","last_undegraded":"2023-10-08T16:08:56.446084+0000","last_fullsized":"2023-10-08T16:08:56.446084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:32.770026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448737+0000","last_change":"2023-10-08T16:08:56.448620+0000","last_active":"2023-10-08T16:08:56.448737+0000","last_peered":"2023-10-08T16:08:56.448737+0000","last_clean":"2023-10-08T16:08:56.448737+0000","last_became_active":"2023-10-08T16:08:56.447905+0000","last_became_peered":"2023-10-08T16:08:56.447905+0000","last_unstale":"2023-10-08T16:08:56.448737+0000","last_undegraded":"2023-10-08T16:08:56.448737+0000","last_fullsized":"2023-10-08T16:08:56.448737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:09.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446060+0000","last_change":"2023-10-08T16:08:56.446008+0000","last_active":"2023-10-08T16:08:56.446060+0000","last_peered":"2023-10-08T16:08:56.446060+0000","last_clean":"2023-10-08T16:08:56.446060+0000","last_became_active":"2023-10-08T16:08:56.445533+0000","last_became_peered":"2023-10-08T16:08:56.445533+0000","last_unstale":"2023-10-08T16:08:56.446060+0000","last_undegraded":"2023-10-08T16:08:56.446060+0000","last_fullsized":"2023-10-08T16:08:56.446060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454907+0000","last_change":"2023-10-08T16:08:56.454795+0000","last_active":"2023-10-08T16:08:56.454907+0000","last_peered":"2023-10-08T16:08:56.454907+0000","last_clean":"2023-10-08T16:08:56.454907+0000","last_became_active":"2023-10-08T16:08:56.454143+0000","last_became_peered":"2023-10-08T16:08:56.454143+0000","last_unstale":"2023-10-08T16:08:56.454907+0000","last_undegraded":"2023-10-08T16:08:56.454907+0000","last_fullsized":"2023-10-08T16:08:56.454907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:07.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445804+0000","last_change":"2023-10-08T16:08:56.445735+0000","last_active":"2023-10-08T16:08:56.445804+0000","last_peered":"2023-10-08T16:08:56.445804+0000","last_clean":"2023-10-08T16:08:56.445804+0000","last_became_active":"2023-10-08T16:08:56.445465+0000","last_became_peered":"2023-10-08T16:08:56.445465+0000","last_unstale":"2023-10-08T16:08:56.445804+0000","last_undegraded":"2023-10-08T16:08:56.445804+0000","last_fullsized":"2023-10-08T16:08:56.445804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:30.931959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449485+0000","last_change":"2023-10-08T16:08:56.449425+0000","last_active":"2023-10-08T16:08:56.449485+0000","last_peered":"2023-10-08T16:08:56.449485+0000","last_clean":"2023-10-08T16:08:56.449485+0000","last_became_active":"2023-10-08T16:08:56.449199+0000","last_became_peered":"2023-10-08T16:08:56.449199+0000","last_unstale":"2023-10-08T16:08:56.449485+0000","last_undegraded":"2023-10-08T16:08:56.449485+0000","last_fullsized":"2023-10-08T16:08:56.449485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:39.843156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455083+0000","last_change":"2023-10-08T16:08:56.455008+0000","last_active":"2023-10-08T16:08:56.455083+0000","last_peered":"2023-10-08T16:08:56.455083+0000","last_clean":"2023-10-08T16:08:56.455083+0000","last_became_active":"2023-10-08T16:08:56.454534+0000","last_became_peered":"2023-10-08T16:08:56.454534+0000","last_unstale":"2023-10-08T16:08:56.455083+0000","last_undegraded":"2023-10-08T16:08:56.455083+0000","last_fullsized":"2023-10-08T16:08:56.455083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448755+0000","last_change":"2023-10-08T16:08:56.448391+0000","last_active":"2023-10-08T16:08:56.448755+0000","last_peered":"2023-10-08T16:08:56.448755+0000","last_clean":"2023-10-08T16:08:56.448755+0000","last_became_active":"2023-10-08T16:08:56.447798+0000","last_became_peered":"2023-10-08T16:08:56.447798+0000","last_unstale":"2023-10-08T16:08:56.448755+0000","last_undegraded":"2023-10-08T16:08:56.448755+0000","last_fullsized":"2023-10-08T16:08:56.448755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:11.884663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453202+0000","last_change":"2023-10-08T16:08:56.453113+0000","last_active":"2023-10-08T16:08:56.453202+0000","last_peered":"2023-10-08T16:08:56.453202+0000","last_clean":"2023-10-08T16:08:56.453202+0000","last_became_active":"2023-10-08T16:08:56.452664+0000","last_became_peered":"2023-10-08T16:08:56.452664+0000","last_unstale":"2023-10-08T16:08:56.453202+0000","last_undegraded":"2023-10-08T16:08:56.453202+0000","last_fullsized":"2023-10-08T16:08:56.453202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:32.998704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.451960+0000","last_change":"2023-10-08T16:08:56.451682+0000","last_active":"2023-10-08T16:08:56.451960+0000","last_peered":"2023-10-08T16:08:56.451960+0000","last_clean":"2023-10-08T16:08:56.451960+0000","last_became_active":"2023-10-08T16:08:56.451327+0000","last_became_peered":"2023-10-08T16:08:56.451327+0000","last_unstale":"2023-10-08T16:08:56.451960+0000","last_undegraded":"2023-10-08T16:08:56.451960+0000","last_fullsized":"2023-10-08T16:08:56.451960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:12.362455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446077+0000","last_change":"2023-10-08T16:08:56.445472+0000","last_active":"2023-10-08T16:08:56.446077+0000","last_peered":"2023-10-08T16:08:56.446077+0000","last_clean":"2023-10-08T16:08:56.446077+0000","last_became_active":"2023-10-08T16:08:56.445323+0000","last_became_peered":"2023-10-08T16:08:56.445323+0000","last_unstale":"2023-10-08T16:08:56.446077+0000","last_undegraded":"2023-10-08T16:08:56.446077+0000","last_fullsized":"2023-10-08T16:08:56.446077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:26:05.006624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446711+0000","last_change":"2023-10-08T16:08:56.446647+0000","last_active":"2023-10-08T16:08:56.446711+0000","last_peered":"2023-10-08T16:08:56.446711+0000","last_clean":"2023-10-08T16:08:56.446711+0000","last_became_active":"2023-10-08T16:08:56.446419+0000","last_became_peered":"2023-10-08T16:08:56.446419+0000","last_unstale":"2023-10-08T16:08:56.446711+0000","last_undegraded":"2023-10-08T16:08:56.446711+0000","last_fullsized":"2023-10-08T16:08:56.446711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447760+0000","last_change":"2023-10-08T16:08:56.447490+0000","last_active":"2023-10-08T16:08:56.447760+0000","last_peered":"2023-10-08T16:08:56.447760+0000","last_clean":"2023-10-08T16:08:56.447760+0000","last_became_active":"2023-10-08T16:08:56.446488+0000","last_became_peered":"2023-10-08T16:08:56.446488+0000","last_unstale":"2023-10-08T16:08:56.447760+0000","last_undegraded":"2023-10-08T16:08:56.447760+0000","last_fullsized":"2023-10-08T16:08:56.447760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:52.337335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446308+0000","last_change":"2023-10-08T16:08:56.446204+0000","last_active":"2023-10-08T16:08:56.446308+0000","last_peered":"2023-10-08T16:08:56.446308+0000","last_clean":"2023-10-08T16:08:56.446308+0000","last_became_active":"2023-10-08T16:08:56.445973+0000","last_became_peered":"2023-10-08T16:08:56.445973+0000","last_unstale":"2023-10-08T16:08:56.446308+0000","last_undegraded":"2023-10-08T16:08:56.446308+0000","last_fullsized":"2023-10-08T16:08:56.446308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454465+0000","last_change":"2023-10-08T16:08:56.454406+0000","last_active":"2023-10-08T16:08:56.454465+0000","last_peered":"2023-10-08T16:08:56.454465+0000","last_clean":"2023-10-08T16:08:56.454465+0000","last_became_active":"2023-10-08T16:08:56.454043+0000","last_became_peered":"2023-10-08T16:08:56.454043+0000","last_unstale":"2023-10-08T16:08:56.454465+0000","last_undegraded":"2023-10-08T16:08:56.454465+0000","last_fullsized":"2023-10-08T16:08:56.454465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:06:02.421456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446098+0000","last_change":"2023-10-08T16:08:56.446003+0000","last_active":"2023-10-08T16:08:56.446098+0000","last_peered":"2023-10-08T16:08:56.446098+0000","last_clean":"2023-10-08T16:08:56.446098+0000","last_became_active":"2023-10-08T16:08:56.445623+0000","last_became_peered":"2023-10-08T16:08:56.445623+0000","last_unstale":"2023-10-08T16:08:56.446098+0000","last_undegraded":"2023-10-08T16:08:56.446098+0000","last_fullsized":"2023-10-08T16:08:56.446098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449114+0000","last_change":"2023-10-08T16:08:56.448394+0000","last_active":"2023-10-08T16:08:56.449114+0000","last_peered":"2023-10-08T16:08:56.449114+0000","last_clean":"2023-10-08T16:08:56.449114+0000","last_became_active":"2023-10-08T16:08:56.448119+0000","last_became_peered":"2023-10-08T16:08:56.448119+0000","last_unstale":"2023-10-08T16:08:56.449114+0000","last_undegraded":"2023-10-08T16:08:56.449114+0000","last_fullsized":"2023-10-08T16:08:56.449114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:07.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447186+0000","last_change":"2023-10-08T16:08:56.447048+0000","last_active":"2023-10-08T16:08:56.447186+0000","last_peered":"2023-10-08T16:08:56.447186+0000","last_clean":"2023-10-08T16:08:56.447186+0000","last_became_active":"2023-10-08T16:08:56.445497+0000","last_became_peered":"2023-10-08T16:08:56.445497+0000","last_unstale":"2023-10-08T16:08:56.447186+0000","last_undegraded":"2023-10-08T16:08:56.447186+0000","last_fullsized":"2023-10-08T16:08:56.447186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:57.360488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446067+0000","last_change":"2023-10-08T16:08:56.445390+0000","last_active":"2023-10-08T16:08:56.446067+0000","last_peered":"2023-10-08T16:08:56.446067+0000","last_clean":"2023-10-08T16:08:56.446067+0000","last_became_active":"2023-10-08T16:08:56.445142+0000","last_became_peered":"2023-10-08T16:08:56.445142+0000","last_unstale":"2023-10-08T16:08:56.446067+0000","last_undegraded":"2023-10-08T16:08:56.446067+0000","last_fullsized":"2023-10-08T16:08:56.446067+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453631+0000","last_change":"2023-10-08T16:08:56.453573+0000","last_active":"2023-10-08T16:08:56.453631+0000","last_peered":"2023-10-08T16:08:56.453631+0000","last_clean":"2023-10-08T16:08:56.453631+0000","last_became_active":"2023-10-08T16:08:56.452295+0000","last_became_peered":"2023-10-08T16:08:56.452295+0000","last_unstale":"2023-10-08T16:08:56.453631+0000","last_undegraded":"2023-10-08T16:08:56.453631+0000","last_fullsized":"2023-10-08T16:08:56.453631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:42.255724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443238+0000","last_change":"2023-10-08T16:08:56.443094+0000","last_active":"2023-10-08T16:08:56.443238+0000","last_peered":"2023-10-08T16:08:56.443238+0000","last_clean":"2023-10-08T16:08:56.443238+0000","last_became_active":"2023-10-08T16:08:56.442869+0000","last_became_peered":"2023-10-08T16:08:56.442869+0000","last_unstale":"2023-10-08T16:08:56.443238+0000","last_undegraded":"2023-10-08T16:08:56.443238+0000","last_fullsized":"2023-10-08T16:08:56.443238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:26:05.006624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445152+0000","last_change":"2023-10-08T16:08:56.445089+0000","last_active":"2023-10-08T16:08:56.445152+0000","last_peered":"2023-10-08T16:08:56.445152+0000","last_clean":"2023-10-08T16:08:56.445152+0000","last_became_active":"2023-10-08T16:08:56.444818+0000","last_became_peered":"2023-10-08T16:08:56.444818+0000","last_unstale":"2023-10-08T16:08:56.445152+0000","last_undegraded":"2023-10-08T16:08:56.445152+0000","last_fullsized":"2023-10-08T16:08:56.445152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:39.843156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453213+0000","last_change":"2023-10-08T16:08:56.453155+0000","last_active":"2023-10-08T16:08:56.453213+0000","last_peered":"2023-10-08T16:08:56.453213+0000","last_clean":"2023-10-08T16:08:56.453213+0000","last_became_active":"2023-10-08T16:08:56.452633+0000","last_became_peered":"2023-10-08T16:08:56.452633+0000","last_unstale":"2023-10-08T16:08:56.453213+0000","last_undegraded":"2023-10-08T16:08:56.453213+0000","last_fullsized":"2023-10-08T16:08:56.453213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:47.864252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454330+0000","last_change":"2023-10-08T16:08:56.454264+0000","last_active":"2023-10-08T16:08:56.454330+0000","last_peered":"2023-10-08T16:08:56.454330+0000","last_clean":"2023-10-08T16:08:56.454330+0000","last_became_active":"2023-10-08T16:08:56.453715+0000","last_became_peered":"2023-10-08T16:08:56.453715+0000","last_unstale":"2023-10-08T16:08:56.454330+0000","last_undegraded":"2023-10-08T16:08:56.454330+0000","last_fullsized":"2023-10-08T16:08:56.454330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:20.990840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.456498+0000","last_change":"2023-10-08T16:08:55.451725+0000","last_active":"2023-10-08T16:08:56.456498+0000","last_peered":"2023-10-08T16:08:56.456498+0000","last_clean":"2023-10-08T16:08:56.456498+0000","last_became_active":"2023-10-08T16:08:55.451533+0000","last_became_peered":"2023-10-08T16:08:55.451533+0000","last_unstale":"2023-10-08T16:08:56.456498+0000","last_undegraded":"2023-10-08T16:08:56.456498+0000","last_fullsized":"2023-10-08T16:08:56.456498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:55.460997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455330+0000","last_change":"2023-10-08T16:08:56.455145+0000","last_active":"2023-10-08T16:08:56.455330+0000","last_peered":"2023-10-08T16:08:56.455330+0000","last_clean":"2023-10-08T16:08:56.455330+0000","last_became_active":"2023-10-08T16:08:56.454917+0000","last_became_peered":"2023-10-08T16:08:56.454917+0000","last_unstale":"2023-10-08T16:08:56.455330+0000","last_undegraded":"2023-10-08T16:08:56.455330+0000","last_fullsized":"2023-10-08T16:08:56.455330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:21.094526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452735+0000","last_change":"2023-10-08T16:08:55.449671+0000","last_active":"2023-10-08T16:08:56.452735+0000","last_peered":"2023-10-08T16:08:56.452735+0000","last_clean":"2023-10-08T16:08:56.452735+0000","last_became_active":"2023-10-08T16:08:55.449136+0000","last_became_peered":"2023-10-08T16:08:55.449136+0000","last_unstale":"2023-10-08T16:08:56.452735+0000","last_undegraded":"2023-10-08T16:08:56.452735+0000","last_fullsized":"2023-10-08T16:08:56.452735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:09.696945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452915+0000","last_change":"2023-10-08T16:08:56.452853+0000","last_active":"2023-10-08T16:08:56.452915+0000","last_peered":"2023-10-08T16:08:56.452915+0000","last_clean":"2023-10-08T16:08:56.452915+0000","last_became_active":"2023-10-08T16:08:56.452166+0000","last_became_peered":"2023-10-08T16:08:56.452166+0000","last_unstale":"2023-10-08T16:08:56.452915+0000","last_undegraded":"2023-10-08T16:08:56.452915+0000","last_fullsized":"2023-10-08T16:08:56.452915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.462102+0000","last_change":"2023-10-08T16:08:55.454471+0000","last_active":"2023-10-08T16:08:56.462102+0000","last_peered":"2023-10-08T16:08:56.462102+0000","last_clean":"2023-10-08T16:08:56.462102+0000","last_became_active":"2023-10-08T16:08:55.454025+0000","last_became_peered":"2023-10-08T16:08:55.454025+0000","last_unstale":"2023-10-08T16:08:56.462102+0000","last_undegraded":"2023-10-08T16:08:56.462102+0000","last_fullsized":"2023-10-08T16:08:56.462102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.883624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447164+0000","last_change":"2023-10-08T16:08:56.447091+0000","last_active":"2023-10-08T16:08:56.447164+0000","last_peered":"2023-10-08T16:08:56.447164+0000","last_clean":"2023-10-08T16:08:56.447164+0000","last_became_active":"2023-10-08T16:08:56.446639+0000","last_became_peered":"2023-10-08T16:08:56.446639+0000","last_unstale":"2023-10-08T16:08:56.447164+0000","last_undegraded":"2023-10-08T16:08:56.447164+0000","last_fullsized":"2023-10-08T16:08:56.447164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.456680+0000","last_change":"2023-10-08T16:08:55.447549+0000","last_active":"2023-10-08T16:08:56.456680+0000","last_peered":"2023-10-08T16:08:56.456680+0000","last_clean":"2023-10-08T16:08:56.456680+0000","last_became_active":"2023-10-08T16:08:55.447129+0000","last_became_peered":"2023-10-08T16:08:55.447129+0000","last_unstale":"2023-10-08T16:08:56.456680+0000","last_undegraded":"2023-10-08T16:08:56.456680+0000","last_fullsized":"2023-10-08T16:08:56.456680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:10.409532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449097+0000","last_change":"2023-10-08T16:08:56.448339+0000","last_active":"2023-10-08T16:08:56.449097+0000","last_peered":"2023-10-08T16:08:56.449097+0000","last_clean":"2023-10-08T16:08:56.449097+0000","last_became_active":"2023-10-08T16:08:56.448099+0000","last_became_peered":"2023-10-08T16:08:56.448099+0000","last_unstale":"2023-10-08T16:08:56.449097+0000","last_undegraded":"2023-10-08T16:08:56.449097+0000","last_fullsized":"2023-10-08T16:08:56.449097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:47.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.458985+0000","last_change":"2023-10-08T16:08:55.450237+0000","last_active":"2023-10-08T16:08:56.458985+0000","last_peered":"2023-10-08T16:08:56.458985+0000","last_clean":"2023-10-08T16:08:56.458985+0000","last_became_active":"2023-10-08T16:08:55.449996+0000","last_became_peered":"2023-10-08T16:08:55.449996+0000","last_unstale":"2023-10-08T16:08:56.458985+0000","last_undegraded":"2023-10-08T16:08:56.458985+0000","last_fullsized":"2023-10-08T16:08:56.458985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:38.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447777+0000","last_change":"2023-10-08T16:08:56.447646+0000","last_active":"2023-10-08T16:08:56.447777+0000","last_peered":"2023-10-08T16:08:56.447777+0000","last_clean":"2023-10-08T16:08:56.447777+0000","last_became_active":"2023-10-08T16:08:56.446808+0000","last_became_peered":"2023-10-08T16:08:56.446808+0000","last_unstale":"2023-10-08T16:08:56.447777+0000","last_undegraded":"2023-10-08T16:08:56.447777+0000","last_fullsized":"2023-10-08T16:08:56.447777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:41.307088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.458107+0000","last_change":"2023-10-08T16:08:55.446310+0000","last_active":"2023-10-08T16:08:56.458107+0000","last_peered":"2023-10-08T16:08:56.458107+0000","last_clean":"2023-10-08T16:08:56.458107+0000","last_became_active":"2023-10-08T16:08:55.446055+0000","last_became_peered":"2023-10-08T16:08:55.446055+0000","last_unstale":"2023-10-08T16:08:56.458107+0000","last_undegraded":"2023-10-08T16:08:56.458107+0000","last_fullsized":"2023-10-08T16:08:56.458107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:10.879816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448723+0000","last_change":"2023-10-08T16:08:56.448213+0000","last_active":"2023-10-08T16:08:56.448723+0000","last_peered":"2023-10-08T16:08:56.448723+0000","last_clean":"2023-10-08T16:08:56.448723+0000","last_became_active":"2023-10-08T16:08:56.447622+0000","last_became_peered":"2023-10-08T16:08:56.447622+0000","last_unstale":"2023-10-08T16:08:56.448723+0000","last_undegraded":"2023-10-08T16:08:56.448723+0000","last_fullsized":"2023-10-08T16:08:56.448723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:47.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438199+0000","last_change":"2023-10-08T16:08:55.450571+0000","last_active":"2023-10-08T16:08:56.438199+0000","last_peered":"2023-10-08T16:08:56.438199+0000","last_clean":"2023-10-08T16:08:56.438199+0000","last_became_active":"2023-10-08T16:08:55.450334+0000","last_became_peered":"2023-10-08T16:08:55.450334+0000","last_unstale":"2023-10-08T16:08:56.438199+0000","last_undegraded":"2023-10-08T16:08:56.438199+0000","last_fullsized":"2023-10-08T16:08:56.438199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:52.239027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448298+0000","last_change":"2023-10-08T16:08:56.448233+0000","last_active":"2023-10-08T16:08:56.448298+0000","last_peered":"2023-10-08T16:08:56.448298+0000","last_clean":"2023-10-08T16:08:56.448298+0000","last_became_active":"2023-10-08T16:08:56.447993+0000","last_became_peered":"2023-10-08T16:08:56.447993+0000","last_unstale":"2023-10-08T16:08:56.448298+0000","last_undegraded":"2023-10-08T16:08:56.448298+0000","last_fullsized":"2023-10-08T16:08:56.448298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:09.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.441605+0000","last_change":"2023-10-08T16:08:55.438753+0000","last_active":"2023-10-08T16:08:56.441605+0000","last_peered":"2023-10-08T16:08:56.441605+0000","last_clean":"2023-10-08T16:08:56.441605+0000","last_became_active":"2023-10-08T16:08:55.438500+0000","last_became_peered":"2023-10-08T16:08:55.438500+0000","last_unstale":"2023-10-08T16:08:56.441605+0000","last_undegraded":"2023-10-08T16:08:56.441605+0000","last_fullsized":"2023-10-08T16:08:56.441605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:55.385578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.444726+0000","last_change":"2023-10-08T16:08:56.444659+0000","last_active":"2023-10-08T16:08:56.444726+0000","last_peered":"2023-10-08T16:08:56.444726+0000","last_clean":"2023-10-08T16:08:56.444726+0000","last_became_active":"2023-10-08T16:08:56.444413+0000","last_became_peered":"2023-10-08T16:08:56.444413+0000","last_unstale":"2023-10-08T16:08:56.444726+0000","last_undegraded":"2023-10-08T16:08:56.444726+0000","last_fullsized":"2023-10-08T16:08:56.444726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:49.697041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.439116+0000","last_change":"2023-10-08T16:08:55.451505+0000","last_active":"2023-10-08T16:08:56.439116+0000","last_peered":"2023-10-08T16:08:56.439116+0000","last_clean":"2023-10-08T16:08:56.439116+0000","last_became_active":"2023-10-08T16:08:55.451279+0000","last_became_peered":"2023-10-08T16:08:55.451279+0000","last_unstale":"2023-10-08T16:08:56.439116+0000","last_undegraded":"2023-10-08T16:08:56.439116+0000","last_fullsized":"2023-10-08T16:08:56.439116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452984+0000","last_change":"2023-10-08T16:08:56.452913+0000","last_active":"2023-10-08T16:08:56.452984+0000","last_peered":"2023-10-08T16:08:56.452984+0000","last_clean":"2023-10-08T16:08:56.452984+0000","last_became_active":"2023-10-08T16:08:56.452509+0000","last_became_peered":"2023-10-08T16:08:56.452509+0000","last_unstale":"2023-10-08T16:08:56.452984+0000","last_undegraded":"2023-10-08T16:08:56.452984+0000","last_fullsized":"2023-10-08T16:08:56.452984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:39.843156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.444470+0000","last_change":"2023-10-08T16:08:55.441612+0000","last_active":"2023-10-08T16:08:56.444470+0000","last_peered":"2023-10-08T16:08:56.444470+0000","last_clean":"2023-10-08T16:08:56.444470+0000","last_became_active":"2023-10-08T16:08:55.441363+0000","last_became_peered":"2023-10-08T16:08:55.441363+0000","last_unstale":"2023-10-08T16:08:56.444470+0000","last_undegraded":"2023-10-08T16:08:56.444470+0000","last_fullsized":"2023-10-08T16:08:56.444470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:49.652172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.451939+0000","last_change":"2023-10-08T16:08:56.451062+0000","last_active":"2023-10-08T16:08:56.451939+0000","last_peered":"2023-10-08T16:08:56.451939+0000","last_clean":"2023-10-08T16:08:56.451939+0000","last_became_active":"2023-10-08T16:08:56.446619+0000","last_became_peered":"2023-10-08T16:08:56.446619+0000","last_unstale":"2023-10-08T16:08:56.451939+0000","last_undegraded":"2023-10-08T16:08:56.451939+0000","last_fullsized":"2023-10-08T16:08:56.451939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:13.921770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.459179+0000","last_change":"2023-10-08T16:08:55.444388+0000","last_active":"2023-10-08T16:08:56.459179+0000","last_peered":"2023-10-08T16:08:56.459179+0000","last_clean":"2023-10-08T16:08:56.459179+0000","last_became_active":"2023-10-08T16:08:55.443861+0000","last_became_peered":"2023-10-08T16:08:55.443861+0000","last_unstale":"2023-10-08T16:08:56.459179+0000","last_undegraded":"2023-10-08T16:08:56.459179+0000","last_fullsized":"2023-10-08T16:08:56.459179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:39.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.450263+0000","last_change":"2023-10-08T16:08:56.450129+0000","last_active":"2023-10-08T16:08:56.450263+0000","last_peered":"2023-10-08T16:08:56.450263+0000","last_clean":"2023-10-08T16:08:56.450263+0000","last_became_active":"2023-10-08T16:08:56.449777+0000","last_became_peered":"2023-10-08T16:08:56.449777+0000","last_unstale":"2023-10-08T16:08:56.450263+0000","last_undegraded":"2023-10-08T16:08:56.450263+0000","last_fullsized":"2023-10-08T16:08:56.450263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:10.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.459859+0000","last_change":"2023-10-08T16:08:55.446100+0000","last_active":"2023-10-08T16:08:56.459859+0000","last_peered":"2023-10-08T16:08:56.459859+0000","last_clean":"2023-10-08T16:08:56.459859+0000","last_became_active":"2023-10-08T16:08:55.445020+0000","last_became_peered":"2023-10-08T16:08:55.445020+0000","last_unstale":"2023-10-08T16:08:56.459859+0000","last_undegraded":"2023-10-08T16:08:56.459859+0000","last_fullsized":"2023-10-08T16:08:56.459859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449712+0000","last_change":"2023-10-08T16:08:56.449655+0000","last_active":"2023-10-08T16:08:56.449712+0000","last_peered":"2023-10-08T16:08:56.449712+0000","last_clean":"2023-10-08T16:08:56.449712+0000","last_became_active":"2023-10-08T16:08:56.449191+0000","last_became_peered":"2023-10-08T16:08:56.449191+0000","last_unstale":"2023-10-08T16:08:56.449712+0000","last_undegraded":"2023-10-08T16:08:56.449712+0000","last_fullsized":"2023-10-08T16:08:56.449712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:49.697041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453595+0000","last_change":"2023-10-08T16:08:55.450684+0000","last_active":"2023-10-08T16:08:56.453595+0000","last_peered":"2023-10-08T16:08:56.453595+0000","last_clean":"2023-10-08T16:08:56.453595+0000","last_became_active":"2023-10-08T16:08:55.450407+0000","last_became_peered":"2023-10-08T16:08:55.450407+0000","last_unstale":"2023-10-08T16:08:56.453595+0000","last_undegraded":"2023-10-08T16:08:56.453595+0000","last_fullsized":"2023-10-08T16:08:56.453595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:52.823655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443071+0000","last_change":"2023-10-08T16:08:56.442550+0000","last_active":"2023-10-08T16:08:56.443071+0000","last_peered":"2023-10-08T16:08:56.443071+0000","last_clean":"2023-10-08T16:08:56.443071+0000","last_became_active":"2023-10-08T16:08:56.442391+0000","last_became_peered":"2023-10-08T16:08:56.442391+0000","last_unstale":"2023-10-08T16:08:56.443071+0000","last_undegraded":"2023-10-08T16:08:56.443071+0000","last_fullsized":"2023-10-08T16:08:56.443071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:11.395929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446529+0000","last_change":"2023-10-08T16:08:55.447354+0000","last_active":"2023-10-08T16:08:56.446529+0000","last_peered":"2023-10-08T16:08:56.446529+0000","last_clean":"2023-10-08T16:08:56.446529+0000","last_became_active":"2023-10-08T16:08:55.446789+0000","last_became_peered":"2023-10-08T16:08:55.446789+0000","last_unstale":"2023-10-08T16:08:56.446529+0000","last_undegraded":"2023-10-08T16:08:56.446529+0000","last_fullsized":"2023-10-08T16:08:56.446529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:52.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454892+0000","last_change":"2023-10-08T16:08:56.454653+0000","last_active":"2023-10-08T16:08:56.454892+0000","last_peered":"2023-10-08T16:08:56.454892+0000","last_clean":"2023-10-08T16:08:56.454892+0000","last_became_active":"2023-10-08T16:08:56.453845+0000","last_became_peered":"2023-10-08T16:08:56.453845+0000","last_unstale":"2023-10-08T16:08:56.454892+0000","last_undegraded":"2023-10-08T16:08:56.454892+0000","last_fullsized":"2023-10-08T16:08:56.454892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:49.697041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.439181+0000","last_change":"2023-10-08T16:08:55.446159+0000","last_active":"2023-10-08T16:08:56.439181+0000","last_peered":"2023-10-08T16:08:56.439181+0000","last_clean":"2023-10-08T16:08:56.439181+0000","last_became_active":"2023-10-08T16:08:55.445930+0000","last_became_peered":"2023-10-08T16:08:55.445930+0000","last_unstale":"2023-10-08T16:08:56.439181+0000","last_undegraded":"2023-10-08T16:08:56.439181+0000","last_fullsized":"2023-10-08T16:08:56.439181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:15.925120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454987+0000","last_change":"2023-10-08T16:08:56.454930+0000","last_active":"2023-10-08T16:08:56.454987+0000","last_peered":"2023-10-08T16:08:56.454987+0000","last_clean":"2023-10-08T16:08:56.454987+0000","last_became_active":"2023-10-08T16:08:56.454352+0000","last_became_peered":"2023-10-08T16:08:56.454352+0000","last_unstale":"2023-10-08T16:08:56.454987+0000","last_undegraded":"2023-10-08T16:08:56.454987+0000","last_fullsized":"2023-10-08T16:08:56.454987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:44.399894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.464511+0000","last_change":"2023-10-08T16:08:55.453453+0000","last_active":"2023-10-08T16:08:56.464511+0000","last_peered":"2023-10-08T16:08:56.464511+0000","last_clean":"2023-10-08T16:08:56.464511+0000","last_became_active":"2023-10-08T16:08:55.452722+0000","last_became_peered":"2023-10-08T16:08:55.452722+0000","last_unstale":"2023-10-08T16:08:56.464511+0000","last_undegraded":"2023-10-08T16:08:56.464511+0000","last_fullsized":"2023-10-08T16:08:56.464511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:13.006947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.441519+0000","last_change":"2023-10-08T16:08:56.441443+0000","last_active":"2023-10-08T16:08:56.441519+0000","last_peered":"2023-10-08T16:08:56.441519+0000","last_clean":"2023-10-08T16:08:56.441519+0000","last_became_active":"2023-10-08T16:08:56.441138+0000","last_became_peered":"2023-10-08T16:08:56.441138+0000","last_unstale":"2023-10-08T16:08:56.441519+0000","last_undegraded":"2023-10-08T16:08:56.441519+0000","last_fullsized":"2023-10-08T16:08:56.441519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455996+0000","last_change":"2023-10-08T16:08:55.447305+0000","last_active":"2023-10-08T16:08:56.455996+0000","last_peered":"2023-10-08T16:08:56.455996+0000","last_clean":"2023-10-08T16:08:56.455996+0000","last_became_active":"2023-10-08T16:08:55.446735+0000","last_became_peered":"2023-10-08T16:08:55.446735+0000","last_unstale":"2023-10-08T16:08:56.455996+0000","last_undegraded":"2023-10-08T16:08:56.455996+0000","last_fullsized":"2023-10-08T16:08:56.455996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:09.573102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.448124+0000","last_change":"2023-10-08T16:08:56.448055+0000","last_active":"2023-10-08T16:08:56.448124+0000","last_peered":"2023-10-08T16:08:56.448124+0000","last_clean":"2023-10-08T16:08:56.448124+0000","last_became_active":"2023-10-08T16:08:56.447800+0000","last_became_peered":"2023-10-08T16:08:56.447800+0000","last_unstale":"2023-10-08T16:08:56.448124+0000","last_undegraded":"2023-10-08T16:08:56.448124+0000","last_fullsized":"2023-10-08T16:08:56.448124+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:07.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.464168+0000","last_change":"2023-10-08T16:08:55.454617+0000","last_active":"2023-10-08T16:08:56.464168+0000","last_peered":"2023-10-08T16:08:56.464168+0000","last_clean":"2023-10-08T16:08:56.464168+0000","last_became_active":"2023-10-08T16:08:55.454282+0000","last_became_peered":"2023-10-08T16:08:55.454282+0000","last_unstale":"2023-10-08T16:08:56.464168+0000","last_undegraded":"2023-10-08T16:08:56.464168+0000","last_fullsized":"2023-10-08T16:08:56.464168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:31.993858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445927+0000","last_change":"2023-10-08T16:08:56.445873+0000","last_active":"2023-10-08T16:08:56.445927+0000","last_peered":"2023-10-08T16:08:56.445927+0000","last_clean":"2023-10-08T16:08:56.445927+0000","last_became_active":"2023-10-08T16:08:56.445242+0000","last_became_peered":"2023-10-08T16:08:56.445242+0000","last_unstale":"2023-10-08T16:08:56.445927+0000","last_undegraded":"2023-10-08T16:08:56.445927+0000","last_fullsized":"2023-10-08T16:08:56.445927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:14.011793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455989+0000","last_change":"2023-10-08T16:08:55.450793+0000","last_active":"2023-10-08T16:08:56.455989+0000","last_peered":"2023-10-08T16:08:56.455989+0000","last_clean":"2023-10-08T16:08:56.455989+0000","last_became_active":"2023-10-08T16:08:55.450547+0000","last_became_peered":"2023-10-08T16:08:55.450547+0000","last_unstale":"2023-10-08T16:08:56.455989+0000","last_undegraded":"2023-10-08T16:08:56.455989+0000","last_fullsized":"2023-10-08T16:08:56.455989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:19.588783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.447359+0000","last_change":"2023-10-08T16:08:56.447284+0000","last_active":"2023-10-08T16:08:56.447359+0000","last_peered":"2023-10-08T16:08:56.447359+0000","last_clean":"2023-10-08T16:08:56.447359+0000","last_became_active":"2023-10-08T16:08:56.447061+0000","last_became_peered":"2023-10-08T16:08:56.447061+0000","last_unstale":"2023-10-08T16:08:56.447359+0000","last_undegraded":"2023-10-08T16:08:56.447359+0000","last_fullsized":"2023-10-08T16:08:56.447359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:10.026926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442213+0000","last_change":"2023-10-08T16:08:55.452317+0000","last_active":"2023-10-08T16:08:56.442213+0000","last_peered":"2023-10-08T16:08:56.442213+0000","last_clean":"2023-10-08T16:08:56.442213+0000","last_became_active":"2023-10-08T16:08:55.452086+0000","last_became_peered":"2023-10-08T16:08:55.452086+0000","last_unstale":"2023-10-08T16:08:56.442213+0000","last_undegraded":"2023-10-08T16:08:56.442213+0000","last_fullsized":"2023-10-08T16:08:56.442213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:23.064317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453602+0000","last_change":"2023-10-08T16:08:56.453490+0000","last_active":"2023-10-08T16:08:56.453602+0000","last_peered":"2023-10-08T16:08:56.453602+0000","last_clean":"2023-10-08T16:08:56.453602+0000","last_became_active":"2023-10-08T16:08:56.453009+0000","last_became_peered":"2023-10-08T16:08:56.453009+0000","last_unstale":"2023-10-08T16:08:56.453602+0000","last_undegraded":"2023-10-08T16:08:56.453602+0000","last_fullsized":"2023-10-08T16:08:56.453602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:47.943322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442557+0000","last_change":"2023-10-08T16:08:55.450948+0000","last_active":"2023-10-08T16:08:56.442557+0000","last_peered":"2023-10-08T16:08:56.442557+0000","last_clean":"2023-10-08T16:08:56.442557+0000","last_became_active":"2023-10-08T16:08:55.450483+0000","last_became_peered":"2023-10-08T16:08:55.450483+0000","last_unstale":"2023-10-08T16:08:56.442557+0000","last_undegraded":"2023-10-08T16:08:56.442557+0000","last_fullsized":"2023-10-08T16:08:56.442557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:20.089680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.453179+0000","last_change":"2023-10-08T16:08:56.452952+0000","last_active":"2023-10-08T16:08:56.453179+0000","last_peered":"2023-10-08T16:08:56.453179+0000","last_clean":"2023-10-08T16:08:56.453179+0000","last_became_active":"2023-10-08T16:08:56.452675+0000","last_became_peered":"2023-10-08T16:08:56.452675+0000","last_unstale":"2023-10-08T16:08:56.453179+0000","last_undegraded":"2023-10-08T16:08:56.453179+0000","last_fullsized":"2023-10-08T16:08:56.453179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:10.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438822+0000","last_change":"2023-10-08T16:08:55.448307+0000","last_active":"2023-10-08T16:08:56.438822+0000","last_peered":"2023-10-08T16:08:56.438822+0000","last_clean":"2023-10-08T16:08:56.438822+0000","last_became_active":"2023-10-08T16:08:55.448064+0000","last_became_peered":"2023-10-08T16:08:55.448064+0000","last_unstale":"2023-10-08T16:08:56.438822+0000","last_undegraded":"2023-10-08T16:08:56.438822+0000","last_fullsized":"2023-10-08T16:08:56.438822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:18:12.916924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.445278+0000","last_change":"2023-10-08T16:08:56.444165+0000","last_active":"2023-10-08T16:08:56.445278+0000","last_peered":"2023-10-08T16:08:56.445278+0000","last_clean":"2023-10-08T16:08:56.445278+0000","last_became_active":"2023-10-08T16:08:56.443994+0000","last_became_peered":"2023-10-08T16:08:56.443994+0000","last_unstale":"2023-10-08T16:08:56.445278+0000","last_undegraded":"2023-10-08T16:08:56.445278+0000","last_fullsized":"2023-10-08T16:08:56.445278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:49.821594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443457+0000","last_change":"2023-10-08T16:08:55.445304+0000","last_active":"2023-10-08T16:08:56.443457+0000","last_peered":"2023-10-08T16:08:56.443457+0000","last_clean":"2023-10-08T16:08:56.443457+0000","last_became_active":"2023-10-08T16:08:55.445049+0000","last_became_peered":"2023-10-08T16:08:55.445049+0000","last_unstale":"2023-10-08T16:08:56.443457+0000","last_undegraded":"2023-10-08T16:08:56.443457+0000","last_fullsized":"2023-10-08T16:08:56.443457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:46.859406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449632+0000","last_change":"2023-10-08T16:08:56.449573+0000","last_active":"2023-10-08T16:08:56.449632+0000","last_peered":"2023-10-08T16:08:56.449632+0000","last_clean":"2023-10-08T16:08:56.449632+0000","last_became_active":"2023-10-08T16:08:56.449343+0000","last_became_peered":"2023-10-08T16:08:56.449343+0000","last_unstale":"2023-10-08T16:08:56.449632+0000","last_undegraded":"2023-10-08T16:08:56.449632+0000","last_fullsized":"2023-10-08T16:08:56.449632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:13.582197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.457148+0000","last_change":"2023-10-08T16:08:55.444963+0000","last_active":"2023-10-08T16:08:56.457148+0000","last_peered":"2023-10-08T16:08:56.457148+0000","last_clean":"2023-10-08T16:08:56.457148+0000","last_became_active":"2023-10-08T16:08:55.444708+0000","last_became_peered":"2023-10-08T16:08:55.444708+0000","last_unstale":"2023-10-08T16:08:56.457148+0000","last_undegraded":"2023-10-08T16:08:56.457148+0000","last_fullsized":"2023-10-08T16:08:56.457148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.449147+0000","last_change":"2023-10-08T16:08:56.449041+0000","last_active":"2023-10-08T16:08:56.449147+0000","last_peered":"2023-10-08T16:08:56.449147+0000","last_clean":"2023-10-08T16:08:56.449147+0000","last_became_active":"2023-10-08T16:08:56.448667+0000","last_became_peered":"2023-10-08T16:08:56.448667+0000","last_unstale":"2023-10-08T16:08:56.449147+0000","last_undegraded":"2023-10-08T16:08:56.449147+0000","last_fullsized":"2023-10-08T16:08:56.449147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:35.100276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438668+0000","last_change":"2023-10-08T16:08:55.448320+0000","last_active":"2023-10-08T16:08:56.438668+0000","last_peered":"2023-10-08T16:08:56.438668+0000","last_clean":"2023-10-08T16:08:56.438668+0000","last_became_active":"2023-10-08T16:08:55.448092+0000","last_became_peered":"2023-10-08T16:08:55.448092+0000","last_unstale":"2023-10-08T16:08:56.438668+0000","last_undegraded":"2023-10-08T16:08:56.438668+0000","last_fullsized":"2023-10-08T16:08:56.438668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:55.828614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452881+0000","last_change":"2023-10-08T16:08:56.452819+0000","last_active":"2023-10-08T16:08:56.452881+0000","last_peered":"2023-10-08T16:08:56.452881+0000","last_clean":"2023-10-08T16:08:56.452881+0000","last_became_active":"2023-10-08T16:08:56.452612+0000","last_became_peered":"2023-10-08T16:08:56.452612+0000","last_unstale":"2023-10-08T16:08:56.452881+0000","last_undegraded":"2023-10-08T16:08:56.452881+0000","last_fullsized":"2023-10-08T16:08:56.452881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.444797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442085+0000","last_change":"2023-10-08T16:08:55.449538+0000","last_active":"2023-10-08T16:08:56.442085+0000","last_peered":"2023-10-08T16:08:56.442085+0000","last_clean":"2023-10-08T16:08:56.442085+0000","last_became_active":"2023-10-08T16:08:55.449266+0000","last_became_peered":"2023-10-08T16:08:55.449266+0000","last_unstale":"2023-10-08T16:08:56.442085+0000","last_undegraded":"2023-10-08T16:08:56.442085+0000","last_fullsized":"2023-10-08T16:08:56.442085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:45.246024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.446291+0000","last_change":"2023-10-08T16:08:56.446062+0000","last_active":"2023-10-08T16:08:56.446291+0000","last_peered":"2023-10-08T16:08:56.446291+0000","last_clean":"2023-10-08T16:08:56.446291+0000","last_became_active":"2023-10-08T16:08:56.445821+0000","last_became_peered":"2023-10-08T16:08:56.445821+0000","last_unstale":"2023-10-08T16:08:56.446291+0000","last_undegraded":"2023-10-08T16:08:56.446291+0000","last_fullsized":"2023-10-08T16:08:56.446291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:26:05.006624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443594+0000","last_change":"2023-10-08T16:08:55.451262+0000","last_active":"2023-10-08T16:08:56.443594+0000","last_peered":"2023-10-08T16:08:56.443594+0000","last_clean":"2023-10-08T16:08:56.443594+0000","last_became_active":"2023-10-08T16:08:55.451044+0000","last_became_peered":"2023-10-08T16:08:55.451044+0000","last_unstale":"2023-10-08T16:08:56.443594+0000","last_undegraded":"2023-10-08T16:08:56.443594+0000","last_fullsized":"2023-10-08T16:08:56.443594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:51.332489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455312+0000","last_change":"2023-10-08T16:08:56.455071+0000","last_active":"2023-10-08T16:08:56.455312+0000","last_peered":"2023-10-08T16:08:56.455312+0000","last_clean":"2023-10-08T16:08:56.455312+0000","last_became_active":"2023-10-08T16:08:56.454668+0000","last_became_peered":"2023-10-08T16:08:56.454668+0000","last_unstale":"2023-10-08T16:08:56.455312+0000","last_undegraded":"2023-10-08T16:08:56.455312+0000","last_fullsized":"2023-10-08T16:08:56.455312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:17.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.440204+0000","last_change":"2023-10-08T16:08:55.441810+0000","last_active":"2023-10-08T16:08:56.440204+0000","last_peered":"2023-10-08T16:08:56.440204+0000","last_clean":"2023-10-08T16:08:56.440204+0000","last_became_active":"2023-10-08T16:08:55.441123+0000","last_became_peered":"2023-10-08T16:08:55.441123+0000","last_unstale":"2023-10-08T16:08:56.440204+0000","last_undegraded":"2023-10-08T16:08:56.440204+0000","last_fullsized":"2023-10-08T16:08:56.440204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:37.519813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.452583+0000","last_change":"2023-10-08T16:08:56.452529+0000","last_active":"2023-10-08T16:08:56.452583+0000","last_peered":"2023-10-08T16:08:56.452583+0000","last_clean":"2023-10-08T16:08:56.452583+0000","last_became_active":"2023-10-08T16:08:56.451875+0000","last_became_peered":"2023-10-08T16:08:56.451875+0000","last_unstale":"2023-10-08T16:08:56.452583+0000","last_undegraded":"2023-10-08T16:08:56.452583+0000","last_fullsized":"2023-10-08T16:08:56.452583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:18.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438250+0000","last_change":"2023-10-08T16:08:55.450231+0000","last_active":"2023-10-08T16:08:56.438250+0000","last_peered":"2023-10-08T16:08:56.438250+0000","last_clean":"2023-10-08T16:08:56.438250+0000","last_became_active":"2023-10-08T16:08:55.450004+0000","last_became_peered":"2023-10-08T16:08:55.450004+0000","last_unstale":"2023-10-08T16:08:56.438250+0000","last_undegraded":"2023-10-08T16:08:56.438250+0000","last_fullsized":"2023-10-08T16:08:56.438250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:11.922814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.444646+0000","last_change":"2023-10-08T16:08:56.444470+0000","last_active":"2023-10-08T16:08:56.444646+0000","last_peered":"2023-10-08T16:08:56.444646+0000","last_clean":"2023-10-08T16:08:56.444646+0000","last_became_active":"2023-10-08T16:08:56.444235+0000","last_became_peered":"2023-10-08T16:08:56.444235+0000","last_unstale":"2023-10-08T16:08:56.444646+0000","last_undegraded":"2023-10-08T16:08:56.444646+0000","last_fullsized":"2023-10-08T16:08:56.444646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.465843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.438611+0000","last_change":"2023-10-08T16:08:55.453605+0000","last_active":"2023-10-08T16:08:56.438611+0000","last_peered":"2023-10-08T16:08:56.438611+0000","last_clean":"2023-10-08T16:08:56.438611+0000","last_became_active":"2023-10-08T16:08:55.452990+0000","last_became_peered":"2023-10-08T16:08:55.452990+0000","last_unstale":"2023-10-08T16:08:56.438611+0000","last_undegraded":"2023-10-08T16:08:56.438611+0000","last_fullsized":"2023-10-08T16:08:56.438611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:32.746669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.454933+0000","last_change":"2023-10-08T16:08:56.454868+0000","last_active":"2023-10-08T16:08:56.454933+0000","last_peered":"2023-10-08T16:08:56.454933+0000","last_clean":"2023-10-08T16:08:56.454933+0000","last_became_active":"2023-10-08T16:08:56.454624+0000","last_became_peered":"2023-10-08T16:08:56.454624+0000","last_unstale":"2023-10-08T16:08:56.454933+0000","last_undegraded":"2023-10-08T16:08:56.454933+0000","last_fullsized":"2023-10-08T16:08:56.454933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.442628+0000","last_change":"2023-10-08T16:08:55.447467+0000","last_active":"2023-10-08T16:08:56.442628+0000","last_peered":"2023-10-08T16:08:56.442628+0000","last_clean":"2023-10-08T16:08:56.442628+0000","last_became_active":"2023-10-08T16:08:55.447066+0000","last_became_peered":"2023-10-08T16:08:55.447066+0000","last_unstale":"2023-10-08T16:08:56.442628+0000","last_undegraded":"2023-10-08T16:08:56.442628+0000","last_fullsized":"2023-10-08T16:08:56.442628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:53.786010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455407+0000","last_change":"2023-10-08T16:08:56.453961+0000","last_active":"2023-10-08T16:08:56.455407+0000","last_peered":"2023-10-08T16:08:56.455407+0000","last_clean":"2023-10-08T16:08:56.455407+0000","last_became_active":"2023-10-08T16:08:56.453337+0000","last_became_peered":"2023-10-08T16:08:56.453337+0000","last_unstale":"2023-10-08T16:08:56.455407+0000","last_undegraded":"2023-10-08T16:08:56.455407+0000","last_fullsized":"2023-10-08T16:08:56.455407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:55.430142+0000","last_clean_scrub_stamp":"2023-10-08T16:08:55.430142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:11.483542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.455975+0000","last_change":"2023-10-08T16:08:55.446817+0000","last_active":"2023-10-08T16:08:56.455975+0000","last_peered":"2023-10-08T16:08:56.455975+0000","last_clean":"2023-10-08T16:08:56.455975+0000","last_became_active":"2023-10-08T16:08:55.446562+0000","last_became_peered":"2023-10-08T16:08:55.446562+0000","last_unstale":"2023-10-08T16:08:56.455975+0000","last_undegraded":"2023-10-08T16:08:56.455975+0000","last_fullsized":"2023-10-08T16:08:56.455975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:08:54.425295+0000","last_clean_scrub_stamp":"2023-10-08T16:08:54.425295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:09.022080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-08T16:08:56.443285+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:08:56.443285+0000","last_peered":"2023-10-08T16:08:56.443285+0000","last_clean":"2023-10-08T16:08:56.443285+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:08:56.443285+0000","last_undegraded":"2023-10-08T16:08:56.443285+0000","last_fullsized":"2023-10-08T16:08:56.443285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.70699999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49299999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":1.756,"15min":1.756},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.625,"5min":1.79,"15min":1.79},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60199999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81100000000000005,"5min":1.823,"15min":1.823},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Oct 8 16:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579414,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.504},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.65600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.745,"15min":0.745},"last":0.68799999999999994}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.433},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.48099999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194899,"statfs":{"total":200000000,"available":199577382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.434,"15min":0.49199999999999999},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.59899999999999998,"5min":3.593,"15min":3.593},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.433,"15min":0.47899999999999998},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63700000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63500000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.61299999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64100000000000001,"15min":0.629},"min":{"1min":0.505,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90800000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.35299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83799999999999997,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":3.532,"15min":3.532},"last":0.439}]},{"osd":6,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81100000000000005,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.745},"min":{"1min":0.44800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.095,"15min":1.095},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0289999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194325,"statfs":{"total":200000000,"available":198989138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.307},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.48599999999999999},"min":{"1min":0.35399999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58599999999999997,"5min":2.254,"15min":2.254},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61499999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.379},"min":{"1min":0.30299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.628},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.55800000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.52000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83199999999999996,"5min":1.079,"15min":1.079},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.55100000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":2.355,"15min":2.355},"last":0.58999999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:08:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.002},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199577970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.55600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.30099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.67100000000000004,"5min":0.746,"15min":0.746},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.74099999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.434},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74299999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.66400000000000003},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.99299999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.55500000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92400000000000004,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.5,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579394,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.372},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.628,"15min":0.628},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.43099999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.628},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.026},"last":0.52000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70199999999999996,"5min":1.141,"15min":1.141},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":1.149,"15min":1.149},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78200000000000003,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67300000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.70099999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":14.6,"15min":14.6},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.56899999999999995},"min":{"1min":0.46400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":7.556,"15min":7.556},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194901,"statfs":{"total":200000000,"available":199579416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.41499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.501},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.58999999999999997},"min":{"1min":0.46999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.315,"15min":0.315},"max":{"1min":0.76000000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.373}]},{"osd":4,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69799999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39600000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.32500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.74399999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:08:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70399999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.435},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54900000000000004}]}]}],"pool_statfs":[]}} 2023-10-08T16:09:05.488 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:09:05.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:09:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.648+0000 7fd52646a700 1 Processor -- start 2023-10-08T16:09:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.648+0000 7fd52646a700 1 -- start start 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd52646a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5200ccd10 0x7fd52006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd52646a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200c2420 con 0x7fd52006fb00 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd52646a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200c2fc0 con 0x7fd5200cc940 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd52646a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200c93c0 con 0x7fd5200ccd10 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd51f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5200ccd10 0x7fd52006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd524a07700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd52006fb00 0x7fd5200cae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40988/0 (socket says 172.21.15.60:40988) 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd524a07700 1 -- 172.21.15.60:0/382352180 learned_addr learned my addr 172.21.15.60:0/382352180 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd51f7fe700 1 -- 172.21.15.60:0/382352180 >> v1:172.21.15.144:6789/0 conn(0x7fd5200cc940 legacy=0x7fd5200c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd51f7fe700 1 -- 172.21.15.60:0/382352180 >> v1:172.21.15.60:6789/0 conn(0x7fd52006fb00 legacy=0x7fd5200cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd51f7fe700 1 -- 172.21.15.60:0/382352180 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200c96a0 con 0x7fd5200ccd10 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd51effd700 1 -- 172.21.15.60:0/382352180 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658203888 0 0) 0x7fd5200c2420 con 0x7fd52006fb00 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.649+0000 7fd51f7fe700 1 --2- 172.21.15.60:0/382352180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200ccd10 0x7fd52006f5c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd5100098e0 tx=0x7fd5100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553becae4d70d26 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd51effd700 1 -- 172.21.15.60:0/382352180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510009e80 con 0x7fd5200ccd10 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd51effd700 1 -- 172.21.15.60:0/382352180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000b860 con 0x7fd5200ccd10 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd51effd700 1 -- 172.21.15.60:0/382352180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000bbe0 con 0x7fd5200ccd10 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 -- 172.21.15.60:0/382352180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200ccd10 msgr2=0x7fd52006f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 --2- 172.21.15.60:0/382352180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200ccd10 0x7fd52006f5c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd5100098e0 tx=0x7fd5100091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 -- 172.21.15.60:0/382352180 shutdown_connections 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 --2- 172.21.15.60:0/382352180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200ccd10 0x7fd52006f5c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 -- 172.21.15.60:0/382352180 >> 172.21.15.60:0/382352180 conn(0x7fd520067660 msgr2=0x7fd520067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 -- 172.21.15.60:0/382352180 shutdown_connections 2023-10-08T16:09:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.650+0000 7fd52646a700 1 -- 172.21.15.60:0/382352180 wait complete. 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.651+0000 7fd52646a700 1 Processor -- start 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 -- start start 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd52006fb00 0x7fd520154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 0x7fd520099f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5200ccd10 0x7fd52009a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52016b610 con 0x7fd5200cc940 2023-10-08T16:09:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520097e10 con 0x7fd5200ccd10 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd52646a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200c65a0 con 0x7fd52006fb00 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 0x7fd520099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 0x7fd520099f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37294/0 (socket says 172.21.15.60:37294) 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd51f7fe700 1 -- 172.21.15.60:0/1116321072 learned_addr learned my addr 172.21.15.60:0/1116321072 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd524a07700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5200ccd10 0x7fd52009a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.652+0000 7fd51ffff700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd52006fb00 0x7fd520154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd51f7fe700 1 -- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd52006fb00 msgr2=0x7fd520154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd51f7fe700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd52006fb00 0x7fd520154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd51f7fe700 1 -- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5200ccd10 msgr2=0x7fd52009a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd51f7fe700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5200ccd10 0x7fd52009a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd51f7fe700 1 -- 172.21.15.60:0/1116321072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009420 con 0x7fd5200cc940 2023-10-08T16:09:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd51f7fe700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 0x7fd520099f40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd5200ca960 tx=0x7fd510017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011420 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510011580 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011920 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5200c6880 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.653+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520097aa0 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.654+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52004c3c0 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.654+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd510011c90 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.655+0000 7fd517fff700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd500066f30 0x7fd5000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.655+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd510085fe0 con 0x7fd5200cc940 2023-10-08T16:09:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.655+0000 7fd51ffff700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd500066f30 0x7fd5000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.655+0000 7fd51ffff700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd500066f30 0x7fd5000693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd5200af1a0 tx=0x7fd508009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.660+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5100532d0 con 0x7fd5200cc940 2023-10-08T16:09:05.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.934+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd5200c9980 con 0x7fd5200cc940 2023-10-08T16:09:05.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.937+0000 7fd517fff700 1 -- 172.21.15.60:0/1116321072 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd5100568f0 con 0x7fd5200cc940 2023-10-08T16:09:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd500066f30 msgr2=0x7fd5000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd500066f30 0x7fd5000693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd5200af1a0 tx=0x7fd508009040 comp rx=0 tx=0).stop 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 msgr2=0x7fd520099f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 0x7fd520099f40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd5200ca960 tx=0x7fd510017000 comp rx=0 tx=0).stop 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 shutdown_connections 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd500066f30 0x7fd5000693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd52006fb00 0x7fd520154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5200ccd10 0x7fd52009a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 --2- 172.21.15.60:0/1116321072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5200cc940 0x7fd520099f40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 >> 172.21.15.60:0/1116321072 conn(0x7fd520067660 msgr2=0x7fd52006a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 shutdown_connections 2023-10-08T16:09:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:05.940+0000 7fd52646a700 1 -- 172.21.15.60:0/1116321072 wait complete. 2023-10-08T16:09:05.943 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:09:05.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.070+0000 7fef8ba33700 1 Processor -- start 2023-10-08T16:09:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.071+0000 7fef8ba33700 1 -- start start 2023-10-08T16:09:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.071+0000 7fef8ba33700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef8415a620 0x7fef8415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.071+0000 7fef8ba33700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef8415d580 0x7fef84158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.071+0000 7fef8ba33700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8415cbb0 con 0x7fef84157870 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.071+0000 7fef8ba33700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8415bdb0 con 0x7fef8415d580 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.071+0000 7fef8ba33700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8415bfa0 con 0x7fef8415a620 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef89fd0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef8415d580 0x7fef84158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef897cf700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fef84157870 0x7fef8415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40990/0 (socket says 172.21.15.60:40990) 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef897cf700 1 -- 172.21.15.60:0/3250166395 learned_addr learned my addr 172.21.15.60:0/3250166395 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef88fce700 1 --2- 172.21.15.60:0/3250166395 >> v2:172.21.15.144:3300/0 conn(0x7fef8415a620 0x7fef8415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef89fd0700 1 -- 172.21.15.60:0/3250166395 >> v2:172.21.15.144:3300/0 conn(0x7fef8415a620 msgr2=0x7fef8415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef89fd0700 1 --2- 172.21.15.60:0/3250166395 >> v2:172.21.15.144:3300/0 conn(0x7fef8415a620 0x7fef8415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef89fd0700 1 -- 172.21.15.60:0/3250166395 >> v1:172.21.15.60:6789/0 conn(0x7fef84157870 legacy=0x7fef8415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef89fd0700 1 -- 172.21.15.60:0/3250166395 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8415c280 con 0x7fef8415d580 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef83fff700 1 -- 172.21.15.60:0/3250166395 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676504844 0 0) 0x7fef8415cbb0 con 0x7fef84157870 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef89fd0700 1 --2- 172.21.15.60:0/3250166395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef8415d580 0x7fef84158110 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fef8415cb20 tx=0x7fef7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef1c390c8f66e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef83fff700 1 -- 172.21.15.60:0/3250166395 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00e070 con 0x7fef8415d580 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef83fff700 1 -- 172.21.15.60:0/3250166395 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00bc30 con 0x7fef8415d580 2023-10-08T16:09:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.072+0000 7fef83fff700 1 -- 172.21.15.60:0/3250166395 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c012430 con 0x7fef8415d580 2023-10-08T16:09:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 -- 172.21.15.60:0/3250166395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef8415d580 msgr2=0x7fef84158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3250166395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef8415d580 0x7fef84158110 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fef8415cb20 tx=0x7fef7c009780 comp rx=0 tx=0).stop 2023-10-08T16:09:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 -- 172.21.15.60:0/3250166395 shutdown_connections 2023-10-08T16:09:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3250166395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef8415d580 0x7fef84158110 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3250166395 >> v2:172.21.15.144:3300/0 conn(0x7fef8415a620 0x7fef8415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 -- 172.21.15.60:0/3250166395 >> 172.21.15.60:0/3250166395 conn(0x7fef84068ce0 msgr2=0x7fef840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 -- 172.21.15.60:0/3250166395 shutdown_connections 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 -- 172.21.15.60:0/3250166395 wait complete. 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 Processor -- start 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.074+0000 7fef8ba33700 1 -- start start 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 0x7fef840b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef8415a620 0x7fef840d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef8415d580 0x7fef8414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840cfdf0 con 0x7fef84157870 2023-10-08T16:09:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840b35f0 con 0x7fef8415d580 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef841565b0 con 0x7fef8415a620 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 0x7fef840b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 0x7fef840b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37312/0 (socket says 172.21.15.60:37312) 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 -- 172.21.15.60:0/3275753117 learned_addr learned my addr 172.21.15.60:0/3275753117 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef89fd0700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef8415d580 0x7fef8414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef88fce700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef8415a620 0x7fef840d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 -- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef8415a620 msgr2=0x7fef840d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef8415a620 0x7fef840d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 -- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef8415d580 msgr2=0x7fef8414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef8415d580 0x7fef8414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 -- 172.21.15.60:0/3275753117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c009a20 con 0x7fef84157870 2023-10-08T16:09:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef897cf700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 0x7fef840b06c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c7e0 tx=0x7fef74007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74005b30 con 0x7fef84157870 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74005c90 con 0x7fef84157870 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef84156890 con 0x7fef84157870 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74007300 con 0x7fef84157870 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.076+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef84156b70 con 0x7fef84157870 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.077+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8404c3c0 con 0x7fef84157870 2023-10-08T16:09:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.077+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef7401b400 con 0x7fef84157870 2023-10-08T16:09:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.077+0000 7fef817fa700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef70066f30 0x7fef700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.078+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef74084040 con 0x7fef84157870 2023-10-08T16:09:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.078+0000 7fef88fce700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef70066f30 0x7fef700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.078+0000 7fef88fce700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef70066f30 0x7fef700693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef8414cd50 tx=0x7fef78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.082+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef74051330 con 0x7fef84157870 2023-10-08T16:09:06.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.320+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef840d0090 con 0x7fef84157870 2023-10-08T16:09:06.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.321+0000 7fef817fa700 1 -- 172.21.15.60:0/3275753117 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fef74054950 con 0x7fef84157870 2023-10-08T16:09:06.321 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:06.321 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:09:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef70066f30 msgr2=0x7fef700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef70066f30 0x7fef700693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef8414cd50 tx=0x7fef78008040 comp rx=0 tx=0).stop 2023-10-08T16:09:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 msgr2=0x7fef840b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 0x7fef840b06c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c7e0 tx=0x7fef74007df0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 shutdown_connections 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fef70066f30 0x7fef700693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef8415d580 0x7fef8414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef84157870 0x7fef840b06c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 --2- 172.21.15.60:0/3275753117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef8415a620 0x7fef840d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 >> 172.21.15.60:0/3275753117 conn(0x7fef84068ce0 msgr2=0x7fef8414c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 shutdown_connections 2023-10-08T16:09:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.323+0000 7fef8ba33700 1 -- 172.21.15.60:0/3275753117 wait complete. 2023-10-08T16:09:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:09:06.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:08:55.839890+0000', 'modified': '2023-10-08T16:08:59.459648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6036}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6036': {'gid': 6036, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6836/3557387212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 3557387212}, {'type': 'v1', 'addr': '172.21.15.60:6836', 'nonce': 3557387212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:09:06.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:09:06.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:09:06.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.865+0000 7efd29566700 1 Processor -- start 2023-10-08T16:09:06.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.865+0000 7efd29566700 1 -- start start 2023-10-08T16:09:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd29566700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd240b0e50 0x7efd240c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd29566700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd240cb4f0 0x7efd240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd29566700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2415de60 con 0x7efd240b1220 2023-10-08T16:09:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd29566700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd240cbeb0 con 0x7efd240cb4f0 2023-10-08T16:09:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd29566700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2415e140 con 0x7efd240b0e50 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd237fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd240cb4f0 0x7efd240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd227fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efd240b1220 0x7efd2406d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41000/0 (socket says 172.21.15.60:41000) 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd227fc700 1 -- 172.21.15.60:0/768932881 learned_addr learned my addr 172.21.15.60:0/768932881 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.866+0000 7efd22ffd700 1 --2- 172.21.15.60:0/768932881 >> v2:172.21.15.144:3300/0 conn(0x7efd240b0e50 0x7efd240c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd237fe700 1 -- 172.21.15.60:0/768932881 >> v2:172.21.15.144:3300/0 conn(0x7efd240b0e50 msgr2=0x7efd240c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd237fe700 1 --2- 172.21.15.60:0/768932881 >> v2:172.21.15.144:3300/0 conn(0x7efd240b0e50 0x7efd240c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd237fe700 1 -- 172.21.15.60:0/768932881 >> v1:172.21.15.60:6789/0 conn(0x7efd240b1220 legacy=0x7efd2406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd237fe700 1 -- 172.21.15.60:0/768932881 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2415e420 con 0x7efd240cb4f0 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd21ffb700 1 -- 172.21.15.60:0/768932881 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306862591 0 0) 0x7efd2415de60 con 0x7efd240b1220 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd237fe700 1 --2- 172.21.15.60:0/768932881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240cb4f0 0x7efd240cb970 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efd24069840 tx=0x7efd1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a392ae2cd789d356 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd21ffb700 1 -- 172.21.15.60:0/768932881 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00e070 con 0x7efd240cb4f0 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd21ffb700 1 -- 172.21.15.60:0/768932881 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c00bc30 con 0x7efd240cb4f0 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd21ffb700 1 -- 172.21.15.60:0/768932881 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c012430 con 0x7efd240cb4f0 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd29566700 1 -- 172.21.15.60:0/768932881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240cb4f0 msgr2=0x7efd240cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd29566700 1 --2- 172.21.15.60:0/768932881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240cb4f0 0x7efd240cb970 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efd24069840 tx=0x7efd1c009780 comp rx=0 tx=0).stop 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd29566700 1 -- 172.21.15.60:0/768932881 shutdown_connections 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd29566700 1 --2- 172.21.15.60:0/768932881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240cb4f0 0x7efd240cb970 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd29566700 1 --2- 172.21.15.60:0/768932881 >> v2:172.21.15.144:3300/0 conn(0x7efd240b0e50 0x7efd240c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.867+0000 7efd29566700 1 -- 172.21.15.60:0/768932881 >> 172.21.15.60:0/768932881 conn(0x7efd24069870 msgr2=0x7efd24069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.868+0000 7efd29566700 1 -- 172.21.15.60:0/768932881 shutdown_connections 2023-10-08T16:09:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.868+0000 7efd29566700 1 -- 172.21.15.60:0/768932881 wait complete. 2023-10-08T16:09:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.869+0000 7efd29566700 1 Processor -- start 2023-10-08T16:09:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.869+0000 7efd29566700 1 -- start start 2023-10-08T16:09:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 0x7efd240b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd240b1220 0x7efd240c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240cb4f0 0x7efd240c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24156f40 con 0x7efd240b0e50 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24156330 con 0x7efd240cb4f0 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd24156610 con 0x7efd240b1220 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 0x7efd240b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 0x7efd240b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37318/0 (socket says 172.21.15.60:37318) 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 -- 172.21.15.60:0/1156967173 learned_addr learned my addr 172.21.15.60:0/1156967173 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd237fe700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240cb4f0 0x7efd240c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd227fc700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd240b1220 0x7efd240c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 -- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd240b1220 msgr2=0x7efd240c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd240b1220 0x7efd240c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 -- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240cb4f0 msgr2=0x7efd240c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240cb4f0 0x7efd240c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 -- 172.21.15.60:0/1156967173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009a20 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 0x7efd240b41b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efd1400d890 tx=0x7efd14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd1affd700 1 -- 172.21.15.60:0/1156967173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400b600 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd1affd700 1 -- 172.21.15.60:0/1156967173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1400b760 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd241568f0 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.870+0000 7efd1affd700 1 -- 172.21.15.60:0/1156967173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400bae0 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.871+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd240b46f0 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.872+0000 7efd1affd700 1 -- 172.21.15.60:0/1156967173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd1401e460 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.872+0000 7efd1affd700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.872+0000 7efd1affd700 1 -- 172.21.15.60:0/1156967173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd14084be0 con 0x7efd240b0e50 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.872+0000 7efd227fc700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.873+0000 7efd227fc700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efd2416d890 tx=0x7efd0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.874+0000 7efd3285eb80 1 Processor -- start 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.874+0000 7efd3285eb80 1 -- start start 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3617e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 0x55b0e3640a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3640f60 0x55b0e3613cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd3285eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e356ea70 con 0x55b0e3661d00 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e356c270 con 0x55b0e3640f60 2023-10-08T16:09:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e3568060 con 0x55b0e3617a50 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd227fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 0x55b0e3640a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd227fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 0x55b0e3640a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37322/0 (socket says 172.21.15.60:37322) 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd227fc700 1 -- 172.21.15.60:0/82344161 learned_addr learned my addr 172.21.15.60:0/82344161 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd237fe700 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3640f60 0x55b0e3613cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.875+0000 7efd22ffd700 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3617e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd227fc700 1 -- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 msgr2=0x55b0e3617e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd227fc700 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3617e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd227fc700 1 -- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3640f60 msgr2=0x55b0e3613cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd227fc700 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3640f60 0x55b0e3613cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd227fc700 1 -- 172.21.15.60:0/82344161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0e3402270 con 0x55b0e3661d00 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd227fc700 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 0x55b0e3640a20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005b30 tx=0x7efd0c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da28671a3c73cd6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd03fff700 1 -- 172.21.15.60:0/82344161 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c005e40 con 0x55b0e3661d00 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd03fff700 1 -- 172.21.15.60:0/82344161 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c0076f0 con 0x55b0e3661d00 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.876+0000 7efd03fff700 1 -- 172.21.15.60:0/82344161 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00e880 con 0x55b0e3661d00 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 -- 172.21.15.60:0/82344161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 msgr2=0x55b0e3640a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 0x55b0e3640a20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005b30 tx=0x7efd0c013000 comp rx=0 tx=0).stop 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 -- 172.21.15.60:0/82344161 shutdown_connections 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3617e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3640f60 0x55b0e3613cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 --2- 172.21.15.60:0/82344161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3661d00 0x55b0e3640a20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 -- 172.21.15.60:0/82344161 >> 172.21.15.60:0/82344161 conn(0x55b0e3619370 msgr2=0x55b0e3619740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 -- 172.21.15.60:0/82344161 shutdown_connections 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 -- 172.21.15.60:0/82344161 wait complete. 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 -- start start 2023-10-08T16:09:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.877+0000 7efd3285eb80 1 Processor -- start 2023-10-08T16:09:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e363bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e365a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e363f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e3513890 con 0x55b0e3640f60 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e352eea0 con 0x55b0e3661d00 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e33eae30 con 0x55b0e3617a50 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd3285eb80 10 client.0 _ll_register_callbacks cb 0x55b0e35db110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd227fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e365a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.878+0000 7efd227fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e365a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37326/0 (socket says 172.21.15.60:37326) 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 -- 172.21.15.60:0/1700966065 learned_addr learned my addr 172.21.15.60:0/1700966065 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e363bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd237fe700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e363f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 -- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 msgr2=0x55b0e363bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e363bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 -- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 msgr2=0x55b0e363f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e363f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 -- 172.21.15.60:0/1700966065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c00f040 con 0x55b0e3640f60 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd237fe700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e363f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e363bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd227fc700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e365a830 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005ad0 tx=0x7efd0c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd6f5aff3e0b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd017fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd017fa700 1 -- 172.21.15.60:0/1700966065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00ec30 con 0x55b0e3640f60 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0e360cb70 con 0x55b0e3640f60 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd017fa700 1 -- 172.21.15.60:0/1700966065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd0c00ed90 con 0x55b0e3640f60 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd017fa700 1 -- 172.21.15.60:0/1700966065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd0c02b640 con 0x55b0e3640f60 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd3285eb80 10 client.6222 fetch_fsmap learned FSMap version 43 2023-10-08T16:09:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55b0e33a4fe0 con 0x55b0e3640f60 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.879+0000 7efd017fa700 1 -- 172.21.15.60:0/1700966065 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0e360cb70 con 0x55b0e3640f60 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd017fa700 1 -- 172.21.15.60:0/1700966065 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efd0c02b7a0 con 0x55b0e3640f60 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd3285eb80 10 client.6222 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd3285eb80 10 client.6222 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd3285eb80 20 client.6222 populate_metadata read hostname 'smithi060' 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd3285eb80 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e36595d0 0x55b0e36599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd3285eb80 4 client.6222 mds_command: new command op to 6036 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 --> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0e35e9aa0 con 0x55b0e36595d0 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e36595d0 0x55b0e36599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd017fa700 10 client.6222 ms_handle_connect on v2:172.21.15.60:6834/3557387212 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.880+0000 7efd22ffd700 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e36595d0 0x55b0e36599a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c190026aa4e08952 server_cookie=78d2867227a938c7 in_seq=0 out_seq=0 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd017fa700 1 -- 172.21.15.60:0/1700966065 <== mds.0 v2:172.21.15.60:6834/3557387212 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b0e35e9aa0 con 0x55b0e36595d0 2023-10-08T16:09:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd017fa700 10 client.6222 handle_command_reply: tid=0 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 client.6222 shutdown 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 msgr2=0x55b0e365a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e365a830 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005ad0 tx=0x7efd0c014000 comp rx=0 tx=0).stop 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 shutdown_connections 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e36595d0 0x55b0e36599a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e363bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e363f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 --2- 172.21.15.60:0/1700966065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e365a830 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd017fa700 0 client.6222 ms_handle_reset on v2:172.21.15.60:6834/3557387212 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 >> 172.21.15.60:0/1700966065 conn(0x55b0e3619370 msgr2=0x55b0e36149f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 shutdown_connections 2023-10-08T16:09:06.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 1 -- 172.21.15.60:0/1700966065 wait complete. 2023-10-08T16:09:06.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.881+0000 7efd3285eb80 20 client.6222 trim_cache size 0 max 16384 2023-10-08T16:09:06.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 Processor -- start 2023-10-08T16:09:06.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 -- start start 2023-10-08T16:09:06.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3613cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e3647990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e36131f0 con 0x55b0e3640f60 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e363bad0 con 0x55b0e3661d00 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.898+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e35f0410 con 0x55b0e3617a50 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e3647990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e3647990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37328/0 (socket says 172.21.15.60:37328) 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 -- 172.21.15.60:0/2262397427 learned_addr learned my addr 172.21.15.60:0/2262397427 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd22ffd700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3613cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd237fe700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 -- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 msgr2=0x55b0e3613cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3613cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 -- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 msgr2=0x55b0e36148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 -- 172.21.15.60:0/2262397427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0e3536780 con 0x55b0e3640f60 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd22ffd700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3613cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd237fe700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd227fc700 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e3647990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efd0c001760 tx=0x7efd0c029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb7c85c0ca9bf00 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd18ff9700 1 -- 172.21.15.60:0/2262397427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c007b20 con 0x55b0e3640f60 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd18ff9700 1 -- 172.21.15.60:0/2262397427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c019040 con 0x55b0e3640f60 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.899+0000 7efd18ff9700 1 -- 172.21.15.60:0/2262397427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c02bc60 con 0x55b0e3640f60 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 -- 172.21.15.60:0/2262397427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 msgr2=0x55b0e3647990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e3647990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efd0c001760 tx=0x7efd0c029000 comp rx=0 tx=0).stop 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 -- 172.21.15.60:0/2262397427 shutdown_connections 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3617a50 0x55b0e3613cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 --2- 172.21.15.60:0/2262397427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3640f60 0x55b0e3647990 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 -- 172.21.15.60:0/2262397427 >> 172.21.15.60:0/2262397427 conn(0x55b0e3619370 msgr2=0x55b0e36104b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 -- 172.21.15.60:0/2262397427 shutdown_connections 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 -- 172.21.15.60:0/2262397427 wait complete. 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 -- start start 2023-10-08T16:09:06.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.900+0000 7efd3285eb80 1 Processor -- start 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 0x55b0e36145f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3640f60 0x55b0e3614b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e363e6a0 con 0x55b0e3617a50 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e363e500 con 0x55b0e3661d00 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e36c4910 con 0x55b0e3640f60 2023-10-08T16:09:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd3285eb80 10 client.0 _ll_register_callbacks cb 0x55b0e35db110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd22ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 0x55b0e36145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd22ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 0x55b0e36145f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37342/0 (socket says 172.21.15.60:37342) 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd22ffd700 1 -- 172.21.15.60:0/537597882 learned_addr learned my addr 172.21.15.60:0/537597882 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd227fc700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3640f60 0x55b0e3614b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.901+0000 7efd237fe700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd22ffd700 1 -- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3640f60 msgr2=0x55b0e3614b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd22ffd700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3640f60 0x55b0e3614b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd22ffd700 1 -- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 msgr2=0x55b0e36775b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd22ffd700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36775b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd22ffd700 1 -- 172.21.15.60:0/537597882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0e33a4fe0 con 0x55b0e3617a50 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd227fc700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3640f60 0x55b0e3614b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd237fe700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36775b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd22ffd700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 0x55b0e36145f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efd140563c0 tx=0x7efd14020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831cf28136786e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd017fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd017fa700 1 -- 172.21.15.60:0/537597882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1406d040 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd017fa700 1 -- 172.21.15.60:0/537597882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd14053eb0 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd0c0076f0 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd017fa700 1 -- 172.21.15.60:0/537597882 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd14071250 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 10 client.6228 fetch_fsmap learned FSMap version 43 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55b0e351d470 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd017fa700 1 -- 172.21.15.60:0/537597882 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c0076f0 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd017fa700 1 -- 172.21.15.60:0/537597882 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efd14070070 con 0x55b0e3617a50 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 10 client.6228 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T16:09:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 10 client.6228 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 20 client.6228 populate_metadata read hostname 'smithi060' 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e3677af0 0x55b0e3677ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 4 client.6228 mds_command: new command op to 6036 tid=0[{"prefix": "status"}] 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 --> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b0e350ae00 con 0x55b0e3677af0 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.902+0000 7efd227fc700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e3677af0 0x55b0e3677ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd227fc700 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e3677af0 0x55b0e3677ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1105e009ed583401 server_cookie=c6eaaa3794f2f712 in_seq=0 out_seq=0 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd017fa700 10 client.6228 ms_handle_connect on v2:172.21.15.60:6834/3557387212 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd017fa700 1 -- 172.21.15.60:0/537597882 <== mds.0 v2:172.21.15.60:6834/3557387212 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b0e350ae00 con 0x55b0e3677af0 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd017fa700 10 client.6228 handle_command_reply: tid=0 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 client.6228 shutdown 2023-10-08T16:09:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 msgr2=0x55b0e36145f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 0x55b0e36145f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efd140563c0 tx=0x7efd14020040 comp rx=0 tx=0).stop 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 shutdown_connections 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0e3661d00 0x55b0e36775b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0e3617a50 0x55b0e36145f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.60:6834/3557387212,v1:172.21.15.60:6836/3557387212] conn(0x55b0e3677af0 0x55b0e3677ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 --2- 172.21.15.60:0/537597882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b0e3640f60 0x55b0e3614b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd017fa700 0 client.6228 ms_handle_reset on v2:172.21.15.60:6834/3557387212 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 >> 172.21.15.60:0/537597882 conn(0x55b0e3619370 msgr2=0x55b0e3618240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 shutdown_connections 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 1 -- 172.21.15.60:0/537597882 wait complete. 2023-10-08T16:09:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.903+0000 7efd3285eb80 20 client.6228 trim_cache size 0 max 16384 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 6036, 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 10.467094213999999, 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 43, 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 80, 2023-10-08T16:09:06.912 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 80, 2023-10-08T16:09:06.913 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15.388362366999999 2023-10-08T16:09:06.913 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:09:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 msgr2=0x7efd040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efd2416d890 tx=0x7efd0c009040 comp rx=0 tx=0).stop 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 msgr2=0x7efd240b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 0x7efd240b41b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efd1400d890 tx=0x7efd14008040 comp rx=0 tx=0).stop 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 shutdown_connections 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efd04066f30 0x7efd040693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240cb4f0 0x7efd240c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd240b0e50 0x7efd240b41b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 --2- 172.21.15.60:0/1156967173 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd240b1220 0x7efd240c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 >> 172.21.15.60:0/1156967173 conn(0x7efd24069870 msgr2=0x7efd240ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 shutdown_connections 2023-10-08T16:09:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:06.904+0000 7efd29566700 1 -- 172.21.15.60:0/1156967173 wait complete. 2023-10-08T16:09:06.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:09:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.035+0000 7f0a2f1bc700 1 Processor -- start 2023-10-08T16:09:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.035+0000 7f0a2f1bc700 1 -- start start 2023-10-08T16:09:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.035+0000 7f0a2f1bc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 0x7f0a2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.035+0000 7f0a2f1bc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a2815d580 0x7f0a28158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a2f1bc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2815cbb0 con 0x7f0a28157870 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a2f1bc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2815bdb0 con 0x7f0a2815d580 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a2f1bc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815bfa0 con 0x7f0a2815a620 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 0x7f0a2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a2d759700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a2815d580 0x7f0a28158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 0x7f0a2815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:33054/0 (socket says 172.21.15.60:33054) 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 -- 172.21.15.60:0/1290773432 learned_addr learned my addr 172.21.15.60:0/1290773432 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a2cf58700 1 --1- 172.21.15.60:0/1290773432 >> v1:172.21.15.144:6789/0 conn(0x7f0a28157870 0x7f0a2815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:46136/0 (socket says 172.21.15.60:46136) 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 -- 172.21.15.60:0/1290773432 >> v2:172.21.15.144:3300/0 conn(0x7f0a2815d580 msgr2=0x7f0a28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 --2- 172.21.15.60:0/1290773432 >> v2:172.21.15.144:3300/0 conn(0x7f0a2815d580 0x7f0a28158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 -- 172.21.15.60:0/1290773432 >> v1:172.21.15.144:6789/0 conn(0x7f0a28157870 legacy=0x7f0a2815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 -- 172.21.15.60:0/1290773432 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2815c280 con 0x7f0a2815a620 2023-10-08T16:09:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a2d759700 1 --2- 172.21.15.60:0/1290773432 >> v2:172.21.15.144:3300/0 conn(0x7f0a2815d580 0x7f0a28158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.036+0000 7f0a27fff700 1 --2- 172.21.15.60:0/1290773432 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 0x7f0a2815d040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a180099b0 tx=0x7f0a18009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a682260ebb1efc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a277fe700 1 -- 172.21.15.60:0/1290773432 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18009ea0 con 0x7f0a2815a620 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a277fe700 1 -- 172.21.15.60:0/1290773432 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1800b860 con 0x7f0a2815a620 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a277fe700 1 -- 172.21.15.60:0/1290773432 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1800bc00 con 0x7f0a2815a620 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/1290773432 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 msgr2=0x7f0a2815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/1290773432 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 0x7f0a2815d040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a180099b0 tx=0x7f0a18009250 comp rx=0 tx=0).stop 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/1290773432 shutdown_connections 2023-10-08T16:09:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/1290773432 >> v2:172.21.15.144:3300/0 conn(0x7f0a2815d580 0x7f0a28158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/1290773432 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a620 0x7f0a2815d040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/1290773432 >> 172.21.15.60:0/1290773432 conn(0x7f0a28068ce0 msgr2=0x7f0a280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/1290773432 shutdown_connections 2023-10-08T16:09:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.037+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/1290773432 wait complete. 2023-10-08T16:09:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.038+0000 7f0a2f1bc700 1 Processor -- start 2023-10-08T16:09:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 -- start start 2023-10-08T16:09:07.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a28157870 0x7f0a280b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 0x7f0a280cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815d580 0x7f0a280cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280c77c0 con 0x7f0a2815a620 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2816eda0 con 0x7f0a28157870 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a2f1bc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280c81c0 con 0x7f0a2815d580 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 0x7f0a280cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 0x7f0a280cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37350/0 (socket says 172.21.15.60:37350) 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.039+0000 7f0a27fff700 1 -- 172.21.15.60:0/3078454071 learned_addr learned my addr 172.21.15.60:0/3078454071 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a2cf58700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a28157870 0x7f0a280b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a2d759700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815d580 0x7f0a280cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a27fff700 1 -- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815d580 msgr2=0x7f0a280cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a27fff700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815d580 0x7f0a280cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a27fff700 1 -- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a28157870 msgr2=0x7f0a280b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a27fff700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a28157870 0x7f0a280b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a27fff700 1 -- 172.21.15.60:0/3078454071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009a20 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a27fff700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 0x7f0a280cbd90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0a2815c0e0 tx=0x7f0a18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18000d10 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a180094f0 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280c7b70 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1800bbe0 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.040+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18011630 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.041+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c0052b0 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.041+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a18011a60 con 0x7f0a2815a620 2023-10-08T16:09:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.042+0000 7f0a24ff9700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0a08066f30 0x7f0a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.042+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a18085d20 con 0x7f0a2815a620 2023-10-08T16:09:07.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.042+0000 7f0a2cf58700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0a08066f30 0x7f0a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.042+0000 7f0a2cf58700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0a08066f30 0x7f0a080693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0a10004fd0 tx=0x7f0a10007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.046+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a18052f90 con 0x7f0a2815a620 2023-10-08T16:09:07.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.285+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a0c005830 con 0x7f0a2815a620 2023-10-08T16:09:07.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.285+0000 7f0a24ff9700 1 -- 172.21.15.60:0/3078454071 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0a180565b0 con 0x7f0a2815a620 2023-10-08T16:09:07.286 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:09:07.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0a08066f30 msgr2=0x7f0a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0a08066f30 0x7f0a080693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0a10004fd0 tx=0x7f0a10007eb0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 msgr2=0x7f0a280cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 0x7f0a280cbd90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0a2815c0e0 tx=0x7f0a18017000 comp rx=0 tx=0).stop 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 shutdown_connections 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0a08066f30 0x7f0a080693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815d580 0x7f0a280cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a28157870 0x7f0a280b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 --2- 172.21.15.60:0/3078454071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a2815a620 0x7f0a280cbd90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 >> 172.21.15.60:0/3078454071 conn(0x7f0a28068ce0 msgr2=0x7f0a280b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 shutdown_connections 2023-10-08T16:09:07.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:07.288+0000 7f0a2f1bc700 1 -- 172.21.15.60:0/3078454071 wait complete. 2023-10-08T16:09:07.300 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:09:07.300 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:09:07.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:09:07.300 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:09:07.301 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:07.301 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:09:07.301 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:09:07.301 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:09:07.301 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:09:07.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.301 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:09:07.316 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:07.317 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42194sec preferred_lft 42194sec 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:07.318 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:09:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:07.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.320 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:09:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:09:07.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.382 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:09:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:09:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:09:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:09:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:09:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:09:07.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.439 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:09:07.439 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:09:07.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:09:07.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:09:07.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:09:07.440 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:09:07.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.542 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:09:07.557 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:09:07.557 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:09:07.557 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:09:07.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:09:07.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:07.623 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:07.678 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:09:07.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:07.679 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:07.733 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:09:07.734 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:09:07.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:07.815 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:07.815 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:07.834 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:07.834 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:07.834 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:09:07.834 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:09:07.834 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:09:07.835 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:09:07.835 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:09:07.835 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:09:07.856 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:09:07.857 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:09:07.857 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:09:07.857 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:09:07.857 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:09:07.858 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:09:07.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:07.858 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:07.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:09:08.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.083+0000 7f2d2b59e700 1 Processor -- start 2023-10-08T16:09:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.083+0000 7f2d2b59e700 1 -- start start 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2b59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d2c159f10 0x7f2d2c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d2c0cc240 0x7f2d2c0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c15a730 con 0x7f2d2c0cc240 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2b59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c0ae320 con 0x7f2d2c159f10 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0ad710 con 0x7f2d2c15a2e0 2023-10-08T16:09:08.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d2c0cc240 0x7f2d2c0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d2c0cc240 0x7f2d2c0ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37362/0 (socket says 172.21.15.60:37362) 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.084+0000 7f2d2ad9d700 1 -- 172.21.15.60:0/76290953 learned_addr learned my addr 172.21.15.60:0/76290953 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d29d9b700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2a59c700 1 --2- 172.21.15.60:0/76290953 >> v2:172.21.15.144:3300/0 conn(0x7f2d2c159f10 0x7f2d2c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2ad9d700 1 -- 172.21.15.60:0/76290953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 msgr2=0x7f2d2c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2ad9d700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2ad9d700 1 -- 172.21.15.60:0/76290953 >> v2:172.21.15.144:3300/0 conn(0x7f2d2c159f10 msgr2=0x7f2d2c0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2ad9d700 1 --2- 172.21.15.60:0/76290953 >> v2:172.21.15.144:3300/0 conn(0x7f2d2c159f10 0x7f2d2c0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2ad9d700 1 -- 172.21.15.60:0/76290953 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c0ad9f0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d29d9b700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2a59c700 1 --2- 172.21.15.60:0/76290953 >> v2:172.21.15.144:3300/0 conn(0x7f2d2c159f10 0x7f2d2c0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2ad9d700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c0ae7b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c08b3c0 tx=0x7f2d24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15b14babff326c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2959a700 1 -- 172.21.15.60:0/76290953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400b860 con 0x7f2d2c0cc240 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2959a700 1 -- 172.21.15.60:0/76290953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400b9c0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.085+0000 7f2d2959a700 1 -- 172.21.15.60:0/76290953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400bd60 con 0x7f2d2c0cc240 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 -- 172.21.15.60:0/76290953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 msgr2=0x7f2d2c0ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c0ae7b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c08b3c0 tx=0x7f2d24009250 comp rx=0 tx=0).stop 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 -- 172.21.15.60:0/76290953 shutdown_connections 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c0ae7b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/76290953 >> v2:172.21.15.144:3300/0 conn(0x7f2d2c159f10 0x7f2d2c0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/76290953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 -- 172.21.15.60:0/76290953 >> 172.21.15.60:0/76290953 conn(0x7f2d2c067e40 msgr2=0x7f2d2c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 -- 172.21.15.60:0/76290953 shutdown_connections 2023-10-08T16:09:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.086+0000 7f2d2b59e700 1 -- 172.21.15.60:0/76290953 wait complete. 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.087+0000 7f2d2b59e700 1 Processor -- start 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.087+0000 7f2d2b59e700 1 -- start start 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.087+0000 7f2d2b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c16d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.087+0000 7f2d2b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d2c159f10 0x7f2d2c1695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.087+0000 7f2d2b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b39e0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2b59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b3cc0 con 0x7f2d2c159f10 2023-10-08T16:09:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c16d910 con 0x7f2d2c15a2e0 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c16d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c16d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37378/0 (socket says 172.21.15.60:37378) 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 -- 172.21.15.60:0/690809497 learned_addr learned my addr 172.21.15.60:0/690809497 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2ad9d700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d29d9b700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d2c159f10 0x7f2d2c1695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 -- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 msgr2=0x7f2d2c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 -- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d2c159f10 msgr2=0x7f2d2c1695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d2c159f10 0x7f2d2c1695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 -- 172.21.15.60:0/690809497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240094f0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2a59c700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c16d3d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00a400 tx=0x7f2d1c007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c015440 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0155a0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c16dbb0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c015940 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.088+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c16e170 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.089+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c089300 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.090+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d1c015cf0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.090+0000 7f2d227fc700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.090+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d1c084be0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.090+0000 7f2d29d9b700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.091+0000 7f2d29d9b700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2d0c066f30 0x7f2d0c0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0b2cc0 tx=0x7f2d14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.094+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d1c04e5a0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.335+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d2c0b3fa0 con 0x7f2d2c0cc240 2023-10-08T16:09:08.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.335+0000 7f2d227fc700 1 -- 172.21.15.60:0/690809497 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d1c01a070 con 0x7f2d2c0cc240 2023-10-08T16:09:08.336 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:09:08.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2d0c066f30 msgr2=0x7f2d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2d0c066f30 0x7f2d0c0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0b2cc0 tx=0x7f2d14008040 comp rx=0 tx=0).stop 2023-10-08T16:09:08.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 msgr2=0x7f2d2c16d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c16d3d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00a400 tx=0x7f2d1c007880 comp rx=0 tx=0).stop 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 shutdown_connections 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d2c15a2e0 0x7f2d2c0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d2c0cc240 0x7f2d2c16d3d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 --2- 172.21.15.60:0/690809497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d2c159f10 0x7f2d2c1695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 >> 172.21.15.60:0/690809497 conn(0x7f2d2c067e40 msgr2=0x7f2d2c1558f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 shutdown_connections 2023-10-08T16:09:08.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:08.338+0000 7f2d2b59e700 1 -- 172.21.15.60:0/690809497 wait complete. 2023-10-08T16:09:08.350 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:09:08.351 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:09:08.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.352 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:09:08.369 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42195sec preferred_lft 42195sec 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:09:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:08.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.373 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:09:08.437 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:09:08.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.439 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:09:08.497 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:09:08.497 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:09:08.497 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:09:08.497 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:09:08.497 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:09:08.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.498 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:09:08.498 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:09:08.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:09:08.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:09:08.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:09:08.498 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:09:08.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.603 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:09:08.618 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:09:08.618 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:09:08.618 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:09:08.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:09:08.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:08.683 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:08.739 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:09:08.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:08.739 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:08.794 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:09:08.794 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:09:08.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:09:08.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:08.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:08.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.110+0000 7ff52e27e700 1 Processor -- start 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.110+0000 7ff52e27e700 1 -- start start 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff52e27e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5280d1c30 0x7ff5280ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff52e27e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff52815a680 0x7ff5280cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff52e27e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5280c5d80 con 0x7ff52815a2b0 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff52e27e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff528068470 con 0x7ff5280d1c30 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff52e27e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5280c6060 con 0x7ff52815a680 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff5277fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5280d1c30 0x7ff5280ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff527fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff52815a2b0 0x7ff5280b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41010/0 (socket says 172.21.15.60:41010) 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff5277fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5280d1c30 0x7ff5280ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37384/0 (socket says 172.21.15.60:37384) 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff527fff700 1 -- 172.21.15.60:0/3405047582 learned_addr learned my addr 172.21.15.60:0/3405047582 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff52c81b700 1 --2- 172.21.15.60:0/3405047582 >> v2:172.21.15.144:3300/0 conn(0x7ff52815a680 0x7ff5280cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff5277fe700 1 -- 172.21.15.60:0/3405047582 >> v2:172.21.15.144:3300/0 conn(0x7ff52815a680 msgr2=0x7ff5280cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff5277fe700 1 --2- 172.21.15.60:0/3405047582 >> v2:172.21.15.144:3300/0 conn(0x7ff52815a680 0x7ff5280cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff5277fe700 1 -- 172.21.15.60:0/3405047582 >> v1:172.21.15.60:6789/0 conn(0x7ff52815a2b0 legacy=0x7ff5280b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff5277fe700 1 -- 172.21.15.60:0/3405047582 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280c6340 con 0x7ff5280d1c30 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.111+0000 7ff526ffd700 1 -- 172.21.15.60:0/3405047582 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038253997 0 0) 0x7ff5280c5d80 con 0x7ff52815a2b0 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff5277fe700 1 --2- 172.21.15.60:0/3405047582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d1c30 0x7ff5280ccdd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff528064970 tx=0x7ff5180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dad8ae24255bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff526ffd700 1 -- 172.21.15.60:0/3405047582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011630 con 0x7ff5280d1c30 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff526ffd700 1 -- 172.21.15.60:0/3405047582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518011790 con 0x7ff5280d1c30 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff526ffd700 1 -- 172.21.15.60:0/3405047582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518011b30 con 0x7ff5280d1c30 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 -- 172.21.15.60:0/3405047582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d1c30 msgr2=0x7ff5280ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 --2- 172.21.15.60:0/3405047582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d1c30 0x7ff5280ccdd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff528064970 tx=0x7ff5180091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 -- 172.21.15.60:0/3405047582 shutdown_connections 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 --2- 172.21.15.60:0/3405047582 >> v2:172.21.15.144:3300/0 conn(0x7ff52815a680 0x7ff5280cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 --2- 172.21.15.60:0/3405047582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d1c30 0x7ff5280ccdd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 -- 172.21.15.60:0/3405047582 >> 172.21.15.60:0/3405047582 conn(0x7ff528067e40 msgr2=0x7ff5280d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 -- 172.21.15.60:0/3405047582 shutdown_connections 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.112+0000 7ff52e27e700 1 -- 172.21.15.60:0/3405047582 wait complete. 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.113+0000 7ff52e27e700 1 Processor -- start 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 -- start start 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5280d1c30 0x7ff52816b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 0x7ff52816a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff52815a680 0x7ff528158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280ca370 con 0x7ff52815a2b0 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52816ba20 con 0x7ff52815a680 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff52e27e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52816abd0 con 0x7ff5280d1c30 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff5277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 0x7ff52816a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff5277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 0x7ff52816a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37394/0 (socket says 172.21.15.60:37394) 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.114+0000 7ff5277fe700 1 -- 172.21.15.60:0/2093517991 learned_addr learned my addr 172.21.15.60:0/2093517991 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff52c81b700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff52815a680 0x7ff528158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff527fff700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5280d1c30 0x7ff52816b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff5277fe700 1 -- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5280d1c30 msgr2=0x7ff52816b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff5277fe700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5280d1c30 0x7ff52816b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff5277fe700 1 -- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff52815a680 msgr2=0x7ff528158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff5277fe700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff52815a680 0x7ff528158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff5277fe700 1 -- 172.21.15.60:0/2093517991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518009420 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff5277fe700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 0x7ff52816a310 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff528089120 tx=0x7ff518017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518000d10 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518011b10 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518025640 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52816aeb0 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.115+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52816a850 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.116+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52804c3c0 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.117+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff518025a30 con 0x7ff52815a2b0 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.117+0000 7ff51ffff700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff508066f30 0x7ff5080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.117+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff518085bb0 con 0x7ff52815a2b0 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.117+0000 7ff527fff700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff508066f30 0x7ff5080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.118+0000 7ff527fff700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff508066f30 0x7ff5080693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff52815afb0 tx=0x7ff510009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.121+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff518052e20 con 0x7ff52815a2b0 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.360+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff528159b30 con 0x7ff52815a2b0 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.361+0000 7ff51ffff700 1 -- 172.21.15.60:0/2093517991 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff518015020 con 0x7ff52815a2b0 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff508066f30 msgr2=0x7ff5080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff508066f30 0x7ff5080693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff52815afb0 tx=0x7ff510009040 comp rx=0 tx=0).stop 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 msgr2=0x7ff52816a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 0x7ff52816a310 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff528089120 tx=0x7ff518017000 comp rx=0 tx=0).stop 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 shutdown_connections 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff508066f30 0x7ff5080693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5280d1c30 0x7ff52816b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff52815a680 0x7ff528158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 --2- 172.21.15.60:0/2093517991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815a2b0 0x7ff52816a310 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 >> 172.21.15.60:0/2093517991 conn(0x7ff528067e40 msgr2=0x7ff5280b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 shutdown_connections 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:09.363+0000 7ff52e27e700 1 -- 172.21.15.60:0/2093517991 wait complete. 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:09:09.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":6036,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.066921482,"mdsmap_epoch":43,"osdmap_epoch":80,"osdmap_epoch_barrier":80,"uptime":17.988191233999999} 2023-10-08T16:09:09.514 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 6036, "mdsmap_epoch": 43, "osdmap_epoch": 80, "osdmap_epoch_barrier": 80, "rank_uptime": 13.066921482, "state": "up:active", "uptime": 17.988191234, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:09:09.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:09:09.650 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:09:09.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi060.stdout:{"mon_tick_interval":"5"} 2023-10-08T16:09:09.778 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-08T16:09:09.779 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2023-10-08T16:09:09.779 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:09:09.779 DEBUG:teuthology.orchestra.run.smithi060:> import time 2023-10-08T16:09:09.779 DEBUG:teuthology.orchestra.run.smithi060:> import datetime 2023-10-08T16:09:09.779 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-10-08T16:09:09.780 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:09:09.780 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.780 DEBUG:teuthology.orchestra.run.smithi060:> # Write some buffered data through before going full, all should be well 2023-10-08T16:09:09.780 DEBUG:teuthology.orchestra.run.smithi060:> print("writing some data through which we expect to succeed") 2023-10-08T16:09:09.780 DEBUG:teuthology.orchestra.run.smithi060:> bytes = 0 2023-10-08T16:09:09.780 DEBUG:teuthology.orchestra.run.smithi060:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-08T16:09:09.781 DEBUG:teuthology.orchestra.run.smithi060:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> # buffered IO, the error should always only appear from fsync and not 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> # from write 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> full = False 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> for n in range(0, int(531 * 1.1)): 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:09:09.782 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> except OSError as e: 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> raise 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> full = True 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> break 2023-10-08T16:09:09.783 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> print("fsync'"'"'ed successfully") 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> except OSError as e: 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> full = True 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> break 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> if n > 531 * 0.9: 2023-10-08T16:09:09.784 DEBUG:teuthology.orchestra.run.smithi060:> # Be cautious in the last region where we expect to hit 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(15.0) 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> if not full: 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> # close() should not raise an error because we already caught it in 2023-10-08T16:09:09.785 DEBUG:teuthology.orchestra.run.smithi060:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> # since then because all IOs got cancelled on the full flag. 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> print("calling close") 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> os.close(f) 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> print("close() did not raise error") 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-08T16:09:09.786 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:09:11.747 INFO:teuthology.orchestra.run.smithi060.stdout:writing some data through which we expect to succeed 2023-10-08T16:09:13.244 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 1.00 MB 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 2.00 MB 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 3.00 MB 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.245 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 4.00 MB 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 5.00 MB 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 6.00 MB 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 7.00 MB 2023-10-08T16:09:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 8.00 MB 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 9.00 MB 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 10.00 MB 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.247 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.248 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 11.00 MB 2023-10-08T16:09:13.248 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 12.00 MB 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 13.00 MB 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 14.00 MB 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 15.00 MB 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 16.00 MB 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 17.00 MB 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.250 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 18.00 MB 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 19.00 MB 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.251 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 20.00 MB 2023-10-08T16:09:13.402 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 21.00 MB 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 22.00 MB 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 23.00 MB 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 24.00 MB 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 25.00 MB 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 26.00 MB 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 27.00 MB 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 28.00 MB 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 29.00 MB 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 30.00 MB 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 31.00 MB 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 32.00 MB 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 33.00 MB 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 34.00 MB 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 35.00 MB 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 36.00 MB 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 37.00 MB 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 38.00 MB 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 39.00 MB 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 40.00 MB 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 41.00 MB 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 42.00 MB 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 43.00 MB 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 44.00 MB 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 45.00 MB 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 46.00 MB 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 47.00 MB 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 48.00 MB 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 49.00 MB 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 50.00 MB 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 51.00 MB 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 52.00 MB 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 53.00 MB 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 54.00 MB 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 55.00 MB 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 56.00 MB 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 57.00 MB 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 58.00 MB 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 59.00 MB 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 60.00 MB 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 61.00 MB 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 62.00 MB 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 63.00 MB 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 64.00 MB 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 65.00 MB 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 66.00 MB 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 67.00 MB 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 68.00 MB 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 69.00 MB 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 70.00 MB 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 71.00 MB 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 72.00 MB 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 73.00 MB 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 74.00 MB 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 75.00 MB 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 76.00 MB 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 77.00 MB 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 78.00 MB 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 79.00 MB 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 80.00 MB 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 81.00 MB 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 82.00 MB 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 83.00 MB 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 84.00 MB 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 85.00 MB 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 86.00 MB 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 87.00 MB 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 88.00 MB 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 89.00 MB 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 90.00 MB 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 91.00 MB 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 92.00 MB 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 93.00 MB 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 94.00 MB 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 95.00 MB 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 96.00 MB 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 97.00 MB 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 98.00 MB 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 99.00 MB 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 100.00 MB 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 101.00 MB 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 102.00 MB 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 103.00 MB 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 104.00 MB 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 105.00 MB 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 106.00 MB 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 107.00 MB 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 108.00 MB 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 109.00 MB 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 110.00 MB 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 111.00 MB 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 112.00 MB 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 113.00 MB 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 114.00 MB 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 115.00 MB 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 116.00 MB 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 117.00 MB 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 118.00 MB 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 119.00 MB 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 120.00 MB 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 121.00 MB 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 122.00 MB 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 123.00 MB 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 124.00 MB 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 125.00 MB 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 126.00 MB 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 127.00 MB 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 128.00 MB 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 129.00 MB 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 130.00 MB 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 131.00 MB 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 132.00 MB 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 133.00 MB 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 134.00 MB 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 135.00 MB 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 136.00 MB 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 137.00 MB 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 138.00 MB 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 139.00 MB 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 140.00 MB 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 141.00 MB 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 142.00 MB 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 143.00 MB 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 144.00 MB 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 145.00 MB 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 146.00 MB 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 147.00 MB 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 148.00 MB 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 149.00 MB 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 150.00 MB 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 151.00 MB 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 152.00 MB 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 153.00 MB 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 154.00 MB 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 155.00 MB 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 156.00 MB 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 157.00 MB 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 158.00 MB 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 159.00 MB 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 160.00 MB 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 161.00 MB 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 162.00 MB 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 163.00 MB 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 164.00 MB 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 165.00 MB 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 166.00 MB 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 167.00 MB 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 168.00 MB 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 169.00 MB 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 170.00 MB 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 171.00 MB 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 172.00 MB 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 173.00 MB 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 174.00 MB 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 175.00 MB 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 176.00 MB 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 177.00 MB 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 178.00 MB 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 179.00 MB 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 180.00 MB 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 181.00 MB 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 182.00 MB 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 183.00 MB 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 184.00 MB 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 185.00 MB 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 186.00 MB 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 187.00 MB 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 188.00 MB 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 189.00 MB 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 190.00 MB 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 191.00 MB 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 192.00 MB 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 193.00 MB 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 194.00 MB 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 195.00 MB 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 196.00 MB 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 197.00 MB 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 198.00 MB 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 199.00 MB 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 200.00 MB 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 201.00 MB 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 202.00 MB 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 203.00 MB 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 204.00 MB 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 205.00 MB 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 206.00 MB 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 207.00 MB 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 208.00 MB 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 209.00 MB 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 210.00 MB 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 211.00 MB 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 212.00 MB 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 213.00 MB 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 214.00 MB 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 215.00 MB 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 216.00 MB 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 217.00 MB 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 218.00 MB 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 219.00 MB 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 220.00 MB 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 221.00 MB 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 222.00 MB 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 223.00 MB 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 224.00 MB 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 225.00 MB 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 226.00 MB 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 227.00 MB 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 228.00 MB 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 229.00 MB 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 230.00 MB 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 231.00 MB 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 232.00 MB 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 233.00 MB 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 234.00 MB 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 235.00 MB 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 236.00 MB 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 237.00 MB 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 238.00 MB 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 239.00 MB 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 240.00 MB 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 241.00 MB 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 242.00 MB 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 243.00 MB 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 244.00 MB 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 245.00 MB 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 246.00 MB 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 247.00 MB 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 248.00 MB 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 249.00 MB 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 250.00 MB 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 251.00 MB 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 252.00 MB 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 253.00 MB 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 254.00 MB 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 255.00 MB 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 256.00 MB 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 257.00 MB 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 258.00 MB 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 259.00 MB 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 260.00 MB 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 261.00 MB 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 262.00 MB 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 263.00 MB 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 264.00 MB 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 265.00 MB 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 266.00 MB 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 267.00 MB 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 268.00 MB 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 269.00 MB 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 270.00 MB 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 271.00 MB 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 272.00 MB 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 273.00 MB 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 274.00 MB 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 275.00 MB 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 276.00 MB 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 277.00 MB 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 278.00 MB 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 279.00 MB 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 280.00 MB 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 281.00 MB 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 282.00 MB 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 283.00 MB 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 284.00 MB 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 285.00 MB 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 286.00 MB 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 287.00 MB 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 288.00 MB 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 289.00 MB 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 290.00 MB 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 291.00 MB 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 292.00 MB 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 293.00 MB 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 294.00 MB 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 295.00 MB 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 296.00 MB 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 297.00 MB 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 298.00 MB 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 299.00 MB 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 300.00 MB 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 301.00 MB 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 302.00 MB 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 303.00 MB 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 304.00 MB 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 305.00 MB 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 306.00 MB 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 307.00 MB 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 308.00 MB 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 309.00 MB 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 310.00 MB 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 311.00 MB 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 312.00 MB 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 313.00 MB 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 314.00 MB 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 315.00 MB 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 316.00 MB 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 317.00 MB 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 318.00 MB 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 319.00 MB 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 320.00 MB 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 321.00 MB 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 322.00 MB 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 323.00 MB 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 324.00 MB 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 325.00 MB 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 326.00 MB 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 327.00 MB 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 328.00 MB 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 329.00 MB 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 330.00 MB 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 331.00 MB 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 332.00 MB 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 333.00 MB 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 334.00 MB 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 335.00 MB 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 336.00 MB 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 337.00 MB 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 338.00 MB 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 339.00 MB 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 340.00 MB 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 341.00 MB 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 342.00 MB 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 343.00 MB 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 344.00 MB 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 345.00 MB 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 346.00 MB 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 347.00 MB 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 348.00 MB 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 349.00 MB 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 350.00 MB 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 351.00 MB 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 352.00 MB 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 353.00 MB 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 354.00 MB 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 355.00 MB 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 356.00 MB 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 357.00 MB 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 358.00 MB 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 359.00 MB 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 360.00 MB 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 361.00 MB 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 362.00 MB 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.486 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 363.00 MB 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 364.00 MB 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 365.00 MB 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 366.00 MB 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.487 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 367.00 MB 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 368.00 MB 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 369.00 MB 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 370.00 MB 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 371.00 MB 2023-10-08T16:09:13.488 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 372.00 MB 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 373.00 MB 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 374.00 MB 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 375.00 MB 2023-10-08T16:09:13.489 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 376.00 MB 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 377.00 MB 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 378.00 MB 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 379.00 MB 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.490 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 380.00 MB 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 381.00 MB 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 382.00 MB 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 383.00 MB 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.491 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 384.00 MB 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 385.00 MB 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 386.00 MB 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 387.00 MB 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 388.00 MB 2023-10-08T16:09:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 389.00 MB 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 390.00 MB 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 391.00 MB 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 392.00 MB 2023-10-08T16:09:13.493 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 393.00 MB 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 394.00 MB 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 395.00 MB 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 396.00 MB 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.494 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 397.00 MB 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 398.00 MB 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 399.00 MB 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 400.00 MB 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 401.00 MB 2023-10-08T16:09:13.496 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:13.496 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:13.496 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 402.00 MB 2023-10-08T16:09:15.335 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:09:15.335+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-08T16:09:23.326 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:09:23.326+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-08T16:09:32.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:32.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 403.00 MB 2023-10-08T16:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 404.00 MB 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 405.00 MB 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 406.00 MB 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 407.00 MB 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 408.00 MB 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 409.00 MB 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 410.00 MB 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 411.00 MB 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 412.00 MB 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 413.00 MB 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 414.00 MB 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 415.00 MB 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 416.00 MB 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 417.00 MB 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 418.00 MB 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 419.00 MB 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 420.00 MB 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 421.00 MB 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 422.00 MB 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 423.00 MB 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 424.00 MB 2023-10-08T16:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 425.00 MB 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 426.00 MB 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 427.00 MB 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 428.00 MB 2023-10-08T16:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 429.00 MB 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 430.00 MB 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 431.00 MB 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 432.00 MB 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 433.00 MB 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 434.00 MB 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 435.00 MB 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 436.00 MB 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 437.00 MB 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 438.00 MB 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 439.00 MB 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 440.00 MB 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 441.00 MB 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 442.00 MB 2023-10-08T16:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 443.00 MB 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 444.00 MB 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 445.00 MB 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 446.00 MB 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 447.00 MB 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 448.00 MB 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 449.00 MB 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 450.00 MB 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 451.00 MB 2023-10-08T16:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 452.00 MB 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 453.00 MB 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 454.00 MB 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 455.00 MB 2023-10-08T16:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 456.00 MB 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 457.00 MB 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 458.00 MB 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 459.00 MB 2023-10-08T16:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 460.00 MB 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 461.00 MB 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 462.00 MB 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 463.00 MB 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 464.00 MB 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 465.00 MB 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 466.00 MB 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 467.00 MB 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 468.00 MB 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 469.00 MB 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 470.00 MB 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 471.00 MB 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 472.00 MB 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 473.00 MB 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 474.00 MB 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 475.00 MB 2023-10-08T16:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 476.00 MB 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 477.00 MB 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 478.00 MB 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 479.00 MB 2023-10-08T16:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 480.00 MB 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:Reached fullness after 480.00 MB 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:calling close 2023-10-08T16:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout:close() did not raise error 2023-10-08T16:09:42.889 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:09:42.890 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:09:42.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:09:42.976 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:09:42.976 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:09:42.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:09:42.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:43.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:09:43.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.020 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:09:43.077 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:09:43.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:09:43.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:43.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:09:43.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.120 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:09:43.176 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:43.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.303+0000 7f261c703700 1 Processor -- start 2023-10-08T16:09:43.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.303+0000 7f261c703700 1 -- start start 2023-10-08T16:09:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261c703700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f261415a2b0 0x7f26140b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261c703700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26140d1c30 0x7f26140cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261c703700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f261415a680 0x7f26140cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261c703700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2614068470 con 0x7f261415a2b0 2023-10-08T16:09:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261c703700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140c5d80 con 0x7f261415a680 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261c703700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c6060 con 0x7f26140d1c30 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261a49f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f261415a2b0 0x7f26140b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261a49f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f261415a2b0 0x7f26140b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35464/0 (socket says 172.21.15.60:35464) 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.304+0000 7f261a49f700 1 -- 172.21.15.60:0/178322117 learned_addr learned my addr 172.21.15.60:0/178322117 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261aca0700 1 --2- 172.21.15.60:0/178322117 >> v2:172.21.15.144:3300/0 conn(0x7f261415a680 0x7f26140cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f2619c9e700 1 --2- 172.21.15.60:0/178322117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26140d1c30 0x7f26140cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261a49f700 1 -- 172.21.15.60:0/178322117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26140d1c30 msgr2=0x7f26140cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261a49f700 1 --2- 172.21.15.60:0/178322117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26140d1c30 0x7f26140cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261a49f700 1 -- 172.21.15.60:0/178322117 >> v2:172.21.15.144:3300/0 conn(0x7f261415a680 msgr2=0x7f26140cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261a49f700 1 --2- 172.21.15.60:0/178322117 >> v2:172.21.15.144:3300/0 conn(0x7f261415a680 0x7f26140cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261a49f700 1 -- 172.21.15.60:0/178322117 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140c6340 con 0x7f261415a2b0 2023-10-08T16:09:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261aca0700 1 --2- 172.21.15.60:0/178322117 >> v2:172.21.15.144:3300/0 conn(0x7f261415a680 0x7f26140cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261a49f700 1 --2- 172.21.15.60:0/178322117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f261415a2b0 0x7f26140b3da0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f261408a810 tx=0x7f2604009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f022fa7f504f6fd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261949d700 1 -- 172.21.15.60:0/178322117 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604005c10 con 0x7f261415a2b0 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261949d700 1 -- 172.21.15.60:0/178322117 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604005d70 con 0x7f261415a2b0 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261949d700 1 -- 172.21.15.60:0/178322117 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400b880 con 0x7f261415a2b0 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261c703700 1 -- 172.21.15.60:0/178322117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f261415a2b0 msgr2=0x7f26140b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.305+0000 7f261c703700 1 --2- 172.21.15.60:0/178322117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f261415a2b0 0x7f26140b3da0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f261408a810 tx=0x7f2604009220 comp rx=0 tx=0).stop 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 -- 172.21.15.60:0/178322117 shutdown_connections 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 --2- 172.21.15.60:0/178322117 >> v2:172.21.15.144:3300/0 conn(0x7f261415a680 0x7f26140cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 --2- 172.21.15.60:0/178322117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f261415a2b0 0x7f26140b3da0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 --2- 172.21.15.60:0/178322117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26140d1c30 0x7f26140cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 -- 172.21.15.60:0/178322117 >> 172.21.15.60:0/178322117 conn(0x7f2614067e40 msgr2=0x7f26140d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 -- 172.21.15.60:0/178322117 shutdown_connections 2023-10-08T16:09:43.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.306+0000 7f261c703700 1 -- 172.21.15.60:0/178322117 wait complete. 2023-10-08T16:09:43.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.307+0000 7f261c703700 1 Processor -- start 2023-10-08T16:09:43.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.307+0000 7f261c703700 1 -- start start 2023-10-08T16:09:43.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.307+0000 7f261c703700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 0x7f261415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261c703700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f261415a2b0 0x7f261414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261c703700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261415a680 0x7f261415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261c703700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261414b040 con 0x7f26140d1c30 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261c703700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415aff0 con 0x7f261415a680 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261c703700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c8500 con 0x7f261415a2b0 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 0x7f261415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 0x7f261415d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35474/0 (socket says 172.21.15.60:35474) 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 -- 172.21.15.60:0/2385451435 learned_addr learned my addr 172.21.15.60:0/2385451435 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f2619c9e700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f261415a2b0 0x7f261414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261aca0700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261415a680 0x7f261415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 -- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f261415a2b0 msgr2=0x7f261414ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f261415a2b0 0x7f261414ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 -- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261415a680 msgr2=0x7f261415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261415a680 0x7f261415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 -- 172.21.15.60:0/2385451435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009480 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261a49f700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 0x7f261415d7a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2604009fd0 tx=0x7f2604016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604011740 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604020070 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604011ad0 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.308+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26140caf00 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.309+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26141582b0 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.309+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261404c3c0 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.310+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2604022030 con 0x7f26140d1c30 2023-10-08T16:09:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.310+0000 7f26127fc700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2600066f30 0x7f26000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.310+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2604085fd0 con 0x7f26140d1c30 2023-10-08T16:09:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.310+0000 7f2619c9e700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2600066f30 0x7f26000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.310+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f260006ea50 con 0x7f26140d1c30 2023-10-08T16:09:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.311+0000 7f2619c9e700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2600066f30 0x7f26000693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f26140b65a0 tx=0x7f2608008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.315+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2604053240 con 0x7f26140d1c30 2023-10-08T16:09:43.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.614+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2614064a00 con 0x7f26140d1c30 2023-10-08T16:09:43.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.615+0000 7f26127fc700 1 -- 172.21.15.60:0/2385451435 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f260401a390 con 0x7f26140d1c30 2023-10-08T16:09:43.615 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:43.616 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:09:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2600066f30 msgr2=0x7f26000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2600066f30 0x7f26000693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f26140b65a0 tx=0x7f2608008040 comp rx=0 tx=0).stop 2023-10-08T16:09:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 msgr2=0x7f261415d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 0x7f261415d7a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2604009fd0 tx=0x7f2604016000 comp rx=0 tx=0).stop 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 shutdown_connections 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2600066f30 0x7f26000693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261415a680 0x7f261415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26140d1c30 0x7f261415d7a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 --2- 172.21.15.60:0/2385451435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f261415a2b0 0x7f261414ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 >> 172.21.15.60:0/2385451435 conn(0x7f2614067e40 msgr2=0x7f2614068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 shutdown_connections 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.617+0000 7f261c703700 1 -- 172.21.15.60:0/2385451435 wait complete. 2023-10-08T16:09:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:09:43.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:43.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.749+0000 7f20efafb700 1 Processor -- start 2023-10-08T16:09:43.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20efafb700 1 -- start start 2023-10-08T16:09:43.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20efafb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20e80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20efafb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e815db80 con 0x7f20e80cde50 2023-10-08T16:09:43.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20efafb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e815de60 con 0x7f20e815a1e0 2023-10-08T16:09:43.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20efafb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e815e800 con 0x7f20e8159e10 2023-10-08T16:09:43.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20ee098700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20e80cde50 0x7f20e80cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54984/0 (socket says 172.21.15.60:54984) 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.750+0000 7f20ee098700 1 -- 172.21.15.60:0/2254739617 learned_addr learned my addr 172.21.15.60:0/2254739617 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ed897700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20e80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149978747 0 0) 0x7f20e815db80 con 0x7f20e80cde50 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d0003570 con 0x7f20e80cde50 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754118528 0 0) 0x7f20d0003570 con 0x7f20e80cde50 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 msgr2=0x7f20e80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20e80b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 >> v1:172.21.15.144:6789/0 conn(0x7f20e815a1e0 legacy=0x7f20e80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e815e140 con 0x7f20e80cde50 2023-10-08T16:09:43.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f20e0001490 con 0x7f20e80cde50 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 >> v1:172.21.15.60:6789/0 conn(0x7f20e80cde50 legacy=0x7f20e80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20d0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d0004010 0x7f20d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e815e800 con 0x7f20d0004d50 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d000bbf0 con 0x7f20d0004010 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d000bdb0 con 0x7f20e8159e10 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ee098700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ed897700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20d0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ed096700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d0004010 0x7f20d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ee098700 1 -- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 msgr2=0x7f20d0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.751+0000 7f20ee098700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20d0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ee098700 1 -- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d0004010 msgr2=0x7f20d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ee098700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d0004010 0x7f20d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ee098700 1 -- 172.21.15.60:0/2254739617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0003570 con 0x7f20d0004d50 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ed897700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e8159e10 0x7f20d0003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ee098700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20d00051c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f20e80ce250 tx=0x7f20e0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d676655c97f304 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000cc00 con 0x7f20d0004d50 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000cd80 con 0x7f20d0004d50 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ec895700 1 -- 172.21.15.60:0/2254739617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004b40 con 0x7f20d0004d50 2023-10-08T16:09:43.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20efafb700 1 -- 172.21.15.60:0/2254739617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 msgr2=0x7f20d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20efafb700 1 --2- 172.21.15.60:0/2254739617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20d00051c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f20e80ce250 tx=0x7f20e0001e70 comp rx=0 tx=0).stop 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20ee098700 1 -- 172.21.15.60:0/2254739617 reap_dead start 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20efafb700 1 -- 172.21.15.60:0/2254739617 shutdown_connections 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20efafb700 1 -- 172.21.15.60:0/2254739617 >> 172.21.15.60:0/2254739617 conn(0x7f20e8067660 msgr2=0x7f20e8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20efafb700 1 -- 172.21.15.60:0/2254739617 shutdown_connections 2023-10-08T16:09:43.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.752+0000 7f20efafb700 1 -- 172.21.15.60:0/2254739617 wait complete. 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 Processor -- start 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 -- start start 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20e815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20e80c7120 0x7f20e815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e815c580 0x7f20e8157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c4760 con 0x7f20d0004d50 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c7590 con 0x7f20e80c7120 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20efafb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e815ac60 con 0x7f20e815c580 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20ed897700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20e815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20ed897700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20e815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35496/0 (socket says 172.21.15.60:35496) 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20ed897700 1 -- 172.21.15.60:0/505858858 learned_addr learned my addr 172.21.15.60:0/505858858 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20ed096700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20e80c7120 0x7f20e815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.754+0000 7f20ee098700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e815c580 0x7f20e8157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20ed897700 1 -- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e815c580 msgr2=0x7f20e8157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20ed897700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e815c580 0x7f20e8157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20ed897700 1 -- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20e80c7120 msgr2=0x7f20e815c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20ed897700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20e80c7120 0x7f20e815c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20ed897700 1 -- 172.21.15.60:0/505858858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e815af40 con 0x7f20d0004d50 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20ed897700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20e815a5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f20d800f560 tx=0x7f20d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800e040 con 0x7f20d0004d50 2023-10-08T16:09:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d800f040 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e815b220 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8015680 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.755+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e81583a0 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.756+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e80c4a00 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.757+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20d8003020 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.757+0000 7f20e5ffb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20d4066f30 0x7f20d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.757+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20d8084f20 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.757+0000 7f20ed096700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20d4066f30 0x7f20d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.757+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f20d406ea50 con 0x7f20d0004d50 2023-10-08T16:09:43.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.758+0000 7f20ed096700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20d4066f30 0x7f20d40693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20dc007e40 tx=0x7f20dc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.761+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20d8052190 con 0x7f20d0004d50 2023-10-08T16:09:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.956+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20e804c3c0 con 0x7f20d0004d50 2023-10-08T16:09:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.956+0000 7f20e5ffb700 1 -- 172.21.15.60:0/505858858 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+15396 (secure 0 0 0) 0x7f20d8056e60 con 0x7f20d0004d50 2023-10-08T16:09:43.957 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:43.957 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":83,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:18.346488+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:54.250805+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:54.808564+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20d4066f30 msgr2=0x7f20d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20d4066f30 0x7f20d40693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20dc007e40 tx=0x7f20dc007d30 comp rx=0 tx=0).stop 2023-10-08T16:09:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 msgr2=0x7f20e815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20e815a5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f20d800f560 tx=0x7f20d800b040 comp rx=0 tx=0).stop 2023-10-08T16:09:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 shutdown_connections 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20d4066f30 0x7f20d40693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20e815c580 0x7f20e8157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0004d50 0x7f20e815a5d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 --2- 172.21.15.60:0/505858858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20e80c7120 0x7f20e815c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.958+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 >> 172.21.15.60:0/505858858 conn(0x7f20e8067660 msgr2=0x7f20e8159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.959+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 shutdown_connections 2023-10-08T16:09:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:43.959+0000 7f20efafb700 1 -- 172.21.15.60:0/505858858 wait complete. 2023-10-08T16:09:43.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:08:54.250805+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:08:54.808564+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:43.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:44.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.093+0000 7f16eefab700 1 Processor -- start 2023-10-08T16:09:44.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.093+0000 7f16eefab700 1 -- start start 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16eefab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e80affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16eefab700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f16e8068670 0x7f16e8068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16eefab700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e815a270 con 0x7f16e815d8b0 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16eefab700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80b0500 con 0x7f16e8068670 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16eefab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8069030 con 0x7f16e8154270 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16ed7a8700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f16e815d8b0 0x7f16e80aae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54994/0 (socket says 172.21.15.60:54994) 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16ed7a8700 1 -- 172.21.15.60:0/3572269479 learned_addr learned my addr 172.21.15.60:0/3572269479 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16ee7aa700 1 --2- 172.21.15.60:0/3572269479 >> v2:172.21.15.144:3300/0 conn(0x7f16e8068670 0x7f16e8068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16edfa9700 1 --2- 172.21.15.60:0/3572269479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e80affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16ecfa7700 1 -- 172.21.15.60:0/3572269479 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230288388 0 0) 0x7f16e815a270 con 0x7f16e815d8b0 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.094+0000 7f16ecfa7700 1 -- 172.21.15.60:0/3572269479 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d0003570 con 0x7f16e815d8b0 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16edfa9700 1 -- 172.21.15.60:0/3572269479 >> v2:172.21.15.144:3300/0 conn(0x7f16e8068670 msgr2=0x7f16e8068af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16edfa9700 1 --2- 172.21.15.60:0/3572269479 >> v2:172.21.15.144:3300/0 conn(0x7f16e8068670 0x7f16e8068af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16edfa9700 1 -- 172.21.15.60:0/3572269479 >> v1:172.21.15.60:6789/0 conn(0x7f16e815d8b0 legacy=0x7f16e80aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16ecfa7700 1 -- 172.21.15.60:0/3572269479 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1590981730 0 0) 0x7f16d0003570 con 0x7f16e815d8b0 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16edfa9700 1 -- 172.21.15.60:0/3572269479 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80ad5b0 con 0x7f16e8154270 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16edfa9700 1 --2- 172.21.15.60:0/3572269479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e80affc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098e0 tx=0x7f16e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee18156225eb1ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16ecfa7700 1 -- 172.21.15.60:0/3572269479 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc001470 con 0x7f16e8154270 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16ecfa7700 1 -- 172.21.15.60:0/3572269479 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0011420 con 0x7f16e8154270 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16ecfa7700 1 -- 172.21.15.60:0/3572269479 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00117a0 con 0x7f16e8154270 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16eefab700 1 -- 172.21.15.60:0/3572269479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 msgr2=0x7f16e80affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16eefab700 1 --2- 172.21.15.60:0/3572269479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e80affc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098e0 tx=0x7f16e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16eefab700 1 -- 172.21.15.60:0/3572269479 shutdown_connections 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16eefab700 1 --2- 172.21.15.60:0/3572269479 >> v2:172.21.15.144:3300/0 conn(0x7f16e8068670 0x7f16e8068af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16eefab700 1 --2- 172.21.15.60:0/3572269479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e80affc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.095+0000 7f16eefab700 1 -- 172.21.15.60:0/3572269479 >> 172.21.15.60:0/3572269479 conn(0x7f16e806a070 msgr2=0x7f16e806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.096+0000 7f16eefab700 1 -- 172.21.15.60:0/3572269479 shutdown_connections 2023-10-08T16:09:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.096+0000 7f16eefab700 1 -- 172.21.15.60:0/3572269479 wait complete. 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 Processor -- start 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 -- start start 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 0x7f16e813ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e8158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e815d8b0 0x7f16e80ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8157030 con 0x7f16e8068670 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8156420 con 0x7f16e815d8b0 2023-10-08T16:09:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.097+0000 7f16eefab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8156700 con 0x7f16e8154270 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 0x7f16e813ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 0x7f16e813ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35510/0 (socket says 172.21.15.60:35510) 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 -- 172.21.15.60:0/624846192 learned_addr learned my addr 172.21.15.60:0/624846192 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16ed7a8700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e8158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16ee7aa700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e815d8b0 0x7f16e80ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 -- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 msgr2=0x7f16e8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e8158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 -- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e815d8b0 msgr2=0x7f16e80ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e815d8b0 0x7f16e80ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 -- 172.21.15.60:0/624846192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009420 con 0x7f16e8068670 2023-10-08T16:09:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16edfa9700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 0x7f16e813ef10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f16e8071770 tx=0x7f16e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e001caf0 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e001cc50 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e81569e0 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.098+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e001a450 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.099+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e8158dc0 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.099+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e806d130 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.100+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16e001a800 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.100+0000 7f16e5ffb700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f16d4066f30 0x7f16d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.100+0000 7f16ed7a8700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f16d4066f30 0x7f16d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.100+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16e0085f50 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.101+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f16d406ea50 con 0x7f16e8068670 2023-10-08T16:09:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.101+0000 7f16ed7a8700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f16d4066f30 0x7f16d40693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f16e8157c60 tx=0x7f16dc001580 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.105+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16e00531c0 con 0x7f16e8068670 2023-10-08T16:09:44.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.294+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16e80b37d0 con 0x7f16e8068670 2023-10-08T16:09:44.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.294+0000 7f16e5ffb700 1 -- 172.21.15.60:0/624846192 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16e0029070 con 0x7f16e8068670 2023-10-08T16:09:44.297 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:09:44.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f16d4066f30 msgr2=0x7f16d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f16d4066f30 0x7f16d40693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f16e8157c60 tx=0x7f16dc001580 comp rx=0 tx=0).stop 2023-10-08T16:09:44.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 msgr2=0x7f16e813ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 0x7f16e813ef10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f16e8071770 tx=0x7f16e0016000 comp rx=0 tx=0).stop 2023-10-08T16:09:44.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 shutdown_connections 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f16d4066f30 0x7f16d40693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e815d8b0 0x7f16e80ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16e8068670 0x7f16e813ef10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 --2- 172.21.15.60:0/624846192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e8154270 0x7f16e8158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 >> 172.21.15.60:0/624846192 conn(0x7f16e806a070 msgr2=0x7f16e8070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 shutdown_connections 2023-10-08T16:09:44.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.297+0000 7f16eefab700 1 -- 172.21.15.60:0/624846192 wait complete. 2023-10-08T16:09:44.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:09:44.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.431+0000 7f0f253ed700 1 Processor -- start 2023-10-08T16:09:44.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.431+0000 7f0f253ed700 1 -- start start 2023-10-08T16:09:44.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f253ed700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f200cce30 0x7f0f2015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f253ed700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f200b6580 0x7f0f2006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f253ed700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2006ac90 con 0x7f0f2006a830 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f253ed700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200b4d70 con 0x7f0f200cce30 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f253ed700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200cd8d0 con 0x7f0f200b6580 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f200cce30 0x7f0f2015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f24bec700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0f2006a830 0x7f0f2015d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55002/0 (socket says 172.21.15.60:55002) 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f24bec700 1 -- 172.21.15.60:0/640862068 learned_addr learned my addr 172.21.15.60:0/640862068 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1f7fe700 1 --2- 172.21.15.60:0/640862068 >> v2:172.21.15.144:3300/0 conn(0x7f0f200b6580 0x7f0f2006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1ffff700 1 -- 172.21.15.60:0/640862068 >> v2:172.21.15.144:3300/0 conn(0x7f0f200b6580 msgr2=0x7f0f2006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:44.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1ffff700 1 --2- 172.21.15.60:0/640862068 >> v2:172.21.15.144:3300/0 conn(0x7f0f200b6580 0x7f0f2006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1ffff700 1 -- 172.21.15.60:0/640862068 >> v1:172.21.15.60:6789/0 conn(0x7f0f2006a830 legacy=0x7f0f2015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1ffff700 1 -- 172.21.15.60:0/640862068 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200b4440 con 0x7f0f200cce30 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.432+0000 7f0f1effd700 1 -- 172.21.15.60:0/640862068 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105423647 0 0) 0x7f0f18001490 con 0x7f0f2006a830 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f1ffff700 1 --2- 172.21.15.60:0/640862068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200cce30 0x7f0f2015aca0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0f20089bc0 tx=0x7f0f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3812d659da9ab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f1effd700 1 -- 172.21.15.60:0/640862068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08011630 con 0x7f0f200cce30 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f1effd700 1 -- 172.21.15.60:0/640862068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08011790 con 0x7f0f200cce30 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f1effd700 1 -- 172.21.15.60:0/640862068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08011b30 con 0x7f0f200cce30 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 -- 172.21.15.60:0/640862068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200cce30 msgr2=0x7f0f2015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 --2- 172.21.15.60:0/640862068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200cce30 0x7f0f2015aca0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0f20089bc0 tx=0x7f0f080091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 -- 172.21.15.60:0/640862068 shutdown_connections 2023-10-08T16:09:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 --2- 172.21.15.60:0/640862068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200cce30 0x7f0f2015aca0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 --2- 172.21.15.60:0/640862068 >> v2:172.21.15.144:3300/0 conn(0x7f0f200b6580 0x7f0f2006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 -- 172.21.15.60:0/640862068 >> 172.21.15.60:0/640862068 conn(0x7f0f20068cb0 msgr2=0x7f0f200690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 -- 172.21.15.60:0/640862068 shutdown_connections 2023-10-08T16:09:44.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.433+0000 7f0f253ed700 1 -- 172.21.15.60:0/640862068 wait complete. 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 Processor -- start 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 -- start start 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2006a830 0x7f0f2014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 0x7f0f20157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f200cce30 0x7f0f20153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20155860 con 0x7f0f200b6580 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f201501e0 con 0x7f0f2006a830 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.435+0000 7f0f253ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20154c50 con 0x7f0f200cce30 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 0x7f0f20157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 0x7f0f20157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35516/0 (socket says 172.21.15.60:35516) 2023-10-08T16:09:44.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 -- 172.21.15.60:0/3855250230 learned_addr learned my addr 172.21.15.60:0/3855250230 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1ffff700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2006a830 0x7f0f2014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f24bec700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f200cce30 0x7f0f20153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 -- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f200cce30 msgr2=0x7f0f20153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f200cce30 0x7f0f20153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 -- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2006a830 msgr2=0x7f0f2014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2006a830 0x7f0f2014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 -- 172.21.15.60:0/3855250230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08009420 con 0x7f0f200b6580 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f1f7fe700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 0x7f0f20157270 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000ecb0 tx=0x7f0f100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000c9d0 con 0x7f0f200b6580 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000cb30 con 0x7f0f200b6580 2023-10-08T16:09:44.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000ced0 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f20154f30 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.436+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f201554f0 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.437+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f20155a30 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.438+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f10013680 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.438+0000 7f0f17fff700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0f00066f60 0x7f0f00069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.438+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f100848f0 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.438+0000 7f0f1ffff700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0f00066f60 0x7f0f00069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.438+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f0f0006ea80 con 0x7f0f200b6580 2023-10-08T16:09:44.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.439+0000 7f0f1ffff700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0f00066f60 0x7f0f00069410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0f080093f0 tx=0x7f0f08017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.442+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f10017060 con 0x7f0f200b6580 2023-10-08T16:09:44.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.637+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f200b4720 con 0x7f0f200b6580 2023-10-08T16:09:44.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.637+0000 7f0f17fff700 1 -- 172.21.15.60:0/3855250230 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f20155a30 con 0x7f0f200b6580 2023-10-08T16:09:44.638 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:09:44.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0f00066f60 msgr2=0x7f0f00069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0f00066f60 0x7f0f00069410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0f080093f0 tx=0x7f0f08017000 comp rx=0 tx=0).stop 2023-10-08T16:09:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 msgr2=0x7f0f20157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 0x7f0f20157270 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000ecb0 tx=0x7f0f100091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 shutdown_connections 2023-10-08T16:09:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0f00066f60 0x7f0f00069410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f200cce30 0x7f0f20153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2006a830 0x7f0f2014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 --2- 172.21.15.60:0/3855250230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f200b6580 0x7f0f20157270 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 >> 172.21.15.60:0/3855250230 conn(0x7f0f20068cb0 msgr2=0x7f0f200cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 shutdown_connections 2023-10-08T16:09:44.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.639+0000 7f0f253ed700 1 -- 172.21.15.60:0/3855250230 wait complete. 2023-10-08T16:09:44.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:09:44.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.773+0000 7fb56971f700 1 Processor -- start 2023-10-08T16:09:44.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.773+0000 7fb56971f700 1 -- start start 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb56971f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5640cce30 0x7fb56415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb56971f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb56406aa00 0x7fb5640b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb56971f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640b4d70 con 0x7fb5640b6580 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb56971f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640cd8d0 con 0x7fb56406aa00 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb56971f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b4440 con 0x7fb5640cce30 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb5637fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb5640b6580 0x7fb56406a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55012/0 (socket says 172.21.15.60:55012) 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb5637fe700 1 -- 172.21.15.60:0/2100353138 learned_addr learned my addr 172.21.15.60:0/2100353138 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb563fff700 1 --2- 172.21.15.60:0/2100353138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5640cce30 0x7fb56415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb568f1e700 1 --2- 172.21.15.60:0/2100353138 >> v2:172.21.15.144:3300/0 conn(0x7fb56406aa00 0x7fb5640b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb562ffd700 1 -- 172.21.15.60:0/2100353138 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783504758 0 0) 0x7fb5640b4d70 con 0x7fb5640b6580 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.774+0000 7fb562ffd700 1 -- 172.21.15.60:0/2100353138 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb550003570 con 0x7fb5640b6580 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb563fff700 1 -- 172.21.15.60:0/2100353138 >> v2:172.21.15.144:3300/0 conn(0x7fb56406aa00 msgr2=0x7fb5640b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb563fff700 1 --2- 172.21.15.60:0/2100353138 >> v2:172.21.15.144:3300/0 conn(0x7fb56406aa00 0x7fb5640b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb563fff700 1 -- 172.21.15.60:0/2100353138 >> v1:172.21.15.60:6789/0 conn(0x7fb5640b6580 legacy=0x7fb56406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb563fff700 1 -- 172.21.15.60:0/2100353138 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640b4720 con 0x7fb5640cce30 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb568f1e700 1 --2- 172.21.15.60:0/2100353138 >> v2:172.21.15.144:3300/0 conn(0x7fb56406aa00 0x7fb5640b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb563fff700 1 --2- 172.21.15.60:0/2100353138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5640cce30 0x7fb56415aca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5540098e0 tx=0x7fb5540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e47e65f2bacedd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb562ffd700 1 -- 172.21.15.60:0/2100353138 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011630 con 0x7fb5640cce30 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb562ffd700 1 -- 172.21.15.60:0/2100353138 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554011790 con 0x7fb5640cce30 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb562ffd700 1 -- 172.21.15.60:0/2100353138 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011b30 con 0x7fb5640cce30 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 -- 172.21.15.60:0/2100353138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5640cce30 msgr2=0x7fb56415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 --2- 172.21.15.60:0/2100353138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5640cce30 0x7fb56415aca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5540098e0 tx=0x7fb5540091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 -- 172.21.15.60:0/2100353138 shutdown_connections 2023-10-08T16:09:44.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 --2- 172.21.15.60:0/2100353138 >> v2:172.21.15.144:3300/0 conn(0x7fb56406aa00 0x7fb5640b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 --2- 172.21.15.60:0/2100353138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5640cce30 0x7fb56415aca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 -- 172.21.15.60:0/2100353138 >> 172.21.15.60:0/2100353138 conn(0x7fb564068cb0 msgr2=0x7fb5640690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.775+0000 7fb56971f700 1 -- 172.21.15.60:0/2100353138 shutdown_connections 2023-10-08T16:09:44.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.776+0000 7fb56971f700 1 -- 172.21.15.60:0/2100353138 wait complete. 2023-10-08T16:09:44.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 Processor -- start 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 -- start start 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb56406aa00 0x7fb56414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 0x7fb5641512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5640cce30 0x7fb564155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564152a30 con 0x7fb5640b6580 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564151d60 con 0x7fb5640cce30 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.777+0000 7fb56971f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb564152040 con 0x7fb56406aa00 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 0x7fb5641512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 0x7fb5641512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35530/0 (socket says 172.21.15.60:35530) 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 -- 172.21.15.60:0/633557327 learned_addr learned my addr 172.21.15.60:0/633557327 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb563fff700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb56406aa00 0x7fb56414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb568f1e700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5640cce30 0x7fb564155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 -- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb56406aa00 msgr2=0x7fb56414e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb56406aa00 0x7fb56414e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 -- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5640cce30 msgr2=0x7fb564155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5640cce30 0x7fb564155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 -- 172.21.15.60:0/633557327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009a20 con 0x7fb5640b6580 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb5637fe700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 0x7fb5641512e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00c7c0 tx=0x7fb54c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c005c00 con 0x7fb5640b6580 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c005d60 con 0x7fb5640b6580 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb554009420 con 0x7fb5640b6580 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007320 con 0x7fb5640b6580 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.778+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb564152600 con 0x7fb5640b6580 2023-10-08T16:09:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.779+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb564152850 con 0x7fb5640b6580 2023-10-08T16:09:44.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.780+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb54c007690 con 0x7fb5640b6580 2023-10-08T16:09:44.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.780+0000 7fb55bfff700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb544066f30 0x7fb5440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:44.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.780+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb54c083fd0 con 0x7fb5640b6580 2023-10-08T16:09:44.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.780+0000 7fb563fff700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb544066f30 0x7fb5440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:44.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.780+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7fb54406ea50 con 0x7fb5640b6580 2023-10-08T16:09:44.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.780+0000 7fb563fff700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb544066f30 0x7fb5440693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5540091e0 tx=0x7fb554017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:44.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.784+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb54c0512c0 con 0x7fb5640b6580 2023-10-08T16:09:44.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.974+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb56404bb80 con 0x7fb5640b6580 2023-10-08T16:09:44.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.974+0000 7fb55bfff700 1 -- 172.21.15.60:0/633557327 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb54c0548e0 con 0x7fb5640b6580 2023-10-08T16:09:44.974 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:09:44.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb544066f30 msgr2=0x7fb5440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb544066f30 0x7fb5440693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5540091e0 tx=0x7fb554017000 comp rx=0 tx=0).stop 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 msgr2=0x7fb5641512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 0x7fb5641512e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00c7c0 tx=0x7fb54c007dd0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 shutdown_connections 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb544066f30 0x7fb5440693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb56406aa00 0x7fb56414e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5640cce30 0x7fb564155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 --2- 172.21.15.60:0/633557327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5640b6580 0x7fb5641512e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 >> 172.21.15.60:0/633557327 conn(0x7fb564068cb0 msgr2=0x7fb56414f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 shutdown_connections 2023-10-08T16:09:44.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:44.976+0000 7fb56971f700 1 -- 172.21.15.60:0/633557327 wait complete. 2023-10-08T16:09:44.989 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:45.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.107+0000 7fd810417700 1 Processor -- start 2023-10-08T16:09:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.107+0000 7fd810417700 1 -- start start 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd810417700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd810417700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8080b3430 0x7fd8080cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd810417700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80815db80 con 0x7fd808159e10 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd810417700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80815e800 con 0x7fd8080b3430 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd810417700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80815de60 con 0x7fd80815a1e0 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd80e1b3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd808159e10 0x7fd8080b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55016/0 (socket says 172.21.15.60:55016) 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd80e1b3700 1 -- 172.21.15.60:0/1270130313 learned_addr learned my addr 172.21.15.60:0/1270130313 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:45.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd80d9b2700 1 --2- 172.21.15.60:0/1270130313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd80e9b4700 1 --2- 172.21.15.60:0/1270130313 >> v2:172.21.15.144:3300/0 conn(0x7fd8080b3430 0x7fd8080cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.108+0000 7fd80d1b1700 1 -- 172.21.15.60:0/1270130313 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190948501 0 0) 0x7fd80815db80 con 0x7fd808159e10 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d1b1700 1 -- 172.21.15.60:0/1270130313 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f0003570 con 0x7fd808159e10 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1270130313 >> v2:172.21.15.144:3300/0 conn(0x7fd8080b3430 msgr2=0x7fd8080cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d9b2700 1 --2- 172.21.15.60:0/1270130313 >> v2:172.21.15.144:3300/0 conn(0x7fd8080b3430 0x7fd8080cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1270130313 >> v1:172.21.15.60:6789/0 conn(0x7fd808159e10 legacy=0x7fd8080b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1270130313 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80815e140 con 0x7fd80815a1e0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d9b2700 1 --2- 172.21.15.60:0/1270130313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080cd740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0098e0 tx=0x7fd7fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389274b3cc0e955c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d1b1700 1 -- 172.21.15.60:0/1270130313 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011630 con 0x7fd80815a1e0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d1b1700 1 -- 172.21.15.60:0/1270130313 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc011790 con 0x7fd80815a1e0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.109+0000 7fd80d1b1700 1 -- 172.21.15.60:0/1270130313 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011b30 con 0x7fd80815a1e0 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 -- 172.21.15.60:0/1270130313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 msgr2=0x7fd8080cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 --2- 172.21.15.60:0/1270130313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080cd740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0098e0 tx=0x7fd7fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 -- 172.21.15.60:0/1270130313 shutdown_connections 2023-10-08T16:09:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 --2- 172.21.15.60:0/1270130313 >> v2:172.21.15.144:3300/0 conn(0x7fd8080b3430 0x7fd8080cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 --2- 172.21.15.60:0/1270130313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080cd740 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 -- 172.21.15.60:0/1270130313 >> 172.21.15.60:0/1270130313 conn(0x7fd808067660 msgr2=0x7fd808067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 -- 172.21.15.60:0/1270130313 shutdown_connections 2023-10-08T16:09:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.110+0000 7fd810417700 1 -- 172.21.15.60:0/1270130313 wait complete. 2023-10-08T16:09:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.111+0000 7fd810417700 1 Processor -- start 2023-10-08T16:09:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.111+0000 7fd810417700 1 -- start start 2023-10-08T16:09:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.111+0000 7fd810417700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8080b3430 0x7fd8080c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.111+0000 7fd810417700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 0x7fd8080c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd810417700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd810417700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080c5950 con 0x7fd808159e10 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd810417700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080c6320 con 0x7fd8080b3430 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd810417700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080c4d40 con 0x7fd80815a1e0 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 0x7fd8080c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 0x7fd8080c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35538/0 (socket says 172.21.15.60:35538) 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1874394083 learned_addr learned my addr 172.21.15.60:0/1874394083 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80e1b3700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8080b3430 0x7fd8080c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80e9b4700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 msgr2=0x7fd8080c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8080b3430 msgr2=0x7fd8080c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8080b3430 0x7fd8080c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 -- 172.21.15.60:0/1874394083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009420 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd80d9b2700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 0x7fd8080c5de0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009ed0 tx=0x7fd7fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011900 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc011a60 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080c5020 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.112+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc023620 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.113+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8080c55e0 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.113+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8080c5b00 con 0x7fd808159e10 2023-10-08T16:09:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.114+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7fc02c3b0 con 0x7fd808159e10 2023-10-08T16:09:45.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.114+0000 7fd8067fc700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7f4066f30 0x7fd7f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.114+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7fc085940 con 0x7fd808159e10 2023-10-08T16:09:45.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.114+0000 7fd80e1b3700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7f4066f30 0x7fd7f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.115+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7fd7f406ea50 con 0x7fd808159e10 2023-10-08T16:09:45.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.115+0000 7fd80e1b3700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7f4066f30 0x7fd7f40693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd800005c50 tx=0x7fd800009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.119+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8080c5b00 con 0x7fd808159e10 2023-10-08T16:09:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.357+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8080c5b00 con 0x7fd808159e10 2023-10-08T16:09:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.357+0000 7fd8067fc700 1 -- 172.21.15.60:0/1874394083 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd8080c5b00 con 0x7fd808159e10 2023-10-08T16:09:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:45.358 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:09:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.359+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7f4066f30 msgr2=0x7fd7f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.359+0000 7fd810417700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7f4066f30 0x7fd7f40693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd800005c50 tx=0x7fd800009040 comp rx=0 tx=0).stop 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.359+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 msgr2=0x7fd8080c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.359+0000 7fd810417700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 0x7fd8080c5de0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009ed0 tx=0x7fd7fc017000 comp rx=0 tx=0).stop 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 shutdown_connections 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd7f4066f30 0x7fd7f40693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd80815a1e0 0x7fd8080c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8080b3430 0x7fd8080c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 --2- 172.21.15.60:0/1874394083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808159e10 0x7fd8080c5de0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 >> 172.21.15.60:0/1874394083 conn(0x7fd808067660 msgr2=0x7fd808159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 shutdown_connections 2023-10-08T16:09:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.360+0000 7fd810417700 1 -- 172.21.15.60:0/1874394083 wait complete. 2023-10-08T16:09:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:09:45.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:45.385 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:09:45.385+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-08T16:09:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.495+0000 7fbd2f119700 1 Processor -- start 2023-10-08T16:09:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.495+0000 7fbd2f119700 1 -- start start 2023-10-08T16:09:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd2f119700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd281523e0 0x7fbd2806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd2f119700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28158e50 0x7fbd280cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd2f119700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2806c010 con 0x7fbd28152010 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd2f119700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2806bd10 con 0x7fbd281523e0 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd2f119700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2815c060 con 0x7fbd28158e50 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd27fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd281523e0 0x7fbd2806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd27fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd281523e0 0x7fbd2806c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35544/0 (socket says 172.21.15.60:35544) 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.496+0000 7fbd27fff700 1 -- 172.21.15.60:0/1841828673 learned_addr learned my addr 172.21.15.60:0/1841828673 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd2d6b6700 1 --2- 172.21.15.60:0/1841828673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28158e50 0x7fbd280cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd27fff700 1 -- 172.21.15.60:0/1841828673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28158e50 msgr2=0x7fbd280cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd27fff700 1 --2- 172.21.15.60:0/1841828673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28158e50 0x7fbd280cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd27fff700 1 -- 172.21.15.60:0/1841828673 >> v1:172.21.15.144:6789/0 conn(0x7fbd28152010 legacy=0x7fbd2815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd27fff700 1 -- 172.21.15.60:0/1841828673 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2815c340 con 0x7fbd281523e0 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd27fff700 1 --2- 172.21.15.60:0/1841828673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd281523e0 0x7fbd2806c4a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009f20 tx=0x7fbd18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807e7c215e1713e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd277fe700 1 -- 172.21.15.60:0/1841828673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800e070 con 0x7fbd281523e0 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd277fe700 1 -- 172.21.15.60:0/1841828673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800ba40 con 0x7fbd281523e0 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.497+0000 7fbd277fe700 1 -- 172.21.15.60:0/1841828673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180092e0 con 0x7fbd281523e0 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 -- 172.21.15.60:0/1841828673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd281523e0 msgr2=0x7fbd2806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 --2- 172.21.15.60:0/1841828673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd281523e0 0x7fbd2806c4a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009f20 tx=0x7fbd18009840 comp rx=0 tx=0).stop 2023-10-08T16:09:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 -- 172.21.15.60:0/1841828673 shutdown_connections 2023-10-08T16:09:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 --2- 172.21.15.60:0/1841828673 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28158e50 0x7fbd280cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 --2- 172.21.15.60:0/1841828673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd281523e0 0x7fbd2806c4a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 -- 172.21.15.60:0/1841828673 >> 172.21.15.60:0/1841828673 conn(0x7fbd28069870 msgr2=0x7fbd28069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 -- 172.21.15.60:0/1841828673 shutdown_connections 2023-10-08T16:09:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.498+0000 7fbd2f119700 1 -- 172.21.15.60:0/1841828673 wait complete. 2023-10-08T16:09:45.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.499+0000 7fbd2f119700 1 Processor -- start 2023-10-08T16:09:45.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.499+0000 7fbd2f119700 1 -- start start 2023-10-08T16:09:45.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2f119700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28152010 0x7fbd28149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2f119700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd281523e0 0x7fbd28152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2f119700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 0x7fbd28152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2f119700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2814d760 con 0x7fbd28158e50 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2f119700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280b18e0 con 0x7fbd281523e0 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2f119700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2814da00 con 0x7fbd28152010 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 0x7fbd28152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2ceb5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28152010 0x7fbd28149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 0x7fbd28152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35548/0 (socket says 172.21.15.60:35548) 2023-10-08T16:09:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 -- 172.21.15.60:0/765757372 learned_addr learned my addr 172.21.15.60:0/765757372 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd27fff700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd281523e0 0x7fbd28152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 -- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28152010 msgr2=0x7fbd28149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28152010 0x7fbd28149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 -- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd281523e0 msgr2=0x7fbd28152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd281523e0 0x7fbd28152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 -- 172.21.15.60:0/765757372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009ae0 con 0x7fbd28158e50 2023-10-08T16:09:45.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2ceb5700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28152010 0x7fbd28149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:45.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd2d6b6700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 0x7fbd28152d40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000d860 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.500+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100125f0 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.501+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10012790 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.501+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10012b50 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.501+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2814dce0 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.501+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2814e2a0 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.501+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2814e490 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.502+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd10013480 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.502+0000 7fbd24ff9700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd08066f30 0x7fbd080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.502+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd100847c0 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.502+0000 7fbd2ceb5700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd08066f30 0x7fbd080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.503+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=85}) v3 -- 0x7fbd0806ea50 con 0x7fbd28158e50 2023-10-08T16:09:45.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.503+0000 7fbd2ceb5700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd08066f30 0x7fbd080693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd20002e00 tx=0x7fbd20007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.507+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd10051a30 con 0x7fbd28158e50 2023-10-08T16:09:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.700+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd2804c3c0 con 0x7fbd28158e50 2023-10-08T16:09:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.701+0000 7fbd24ff9700 1 -- 172.21.15.60:0/765757372 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15389 (secure 0 0 0) 0x7fbd10055050 con 0x7fbd28158e50 2023-10-08T16:09:45.701 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:45.702 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":84,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:45.386326+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:54.250805+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:54.808564+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd08066f30 msgr2=0x7fbd080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd08066f30 0x7fbd080693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd20002e00 tx=0x7fbd20007ea0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 msgr2=0x7fbd28152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 0x7fbd28152d40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000d860 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 shutdown_connections 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd08066f30 0x7fbd080693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd28152010 0x7fbd28149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd28158e50 0x7fbd28152d40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 --2- 172.21.15.60:0/765757372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd281523e0 0x7fbd28152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 >> 172.21.15.60:0/765757372 conn(0x7fbd28069870 msgr2=0x7fbd28157300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 shutdown_connections 2023-10-08T16:09:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.703+0000 7fbd2f119700 1 -- 172.21.15.60:0/765757372 wait complete. 2023-10-08T16:09:45.716 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:09:45.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.875+0000 7f39cd960700 1 Processor -- start 2023-10-08T16:09:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.875+0000 7f39cd960700 1 -- start start 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39cd960700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39c8159850 0x7f39c8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39cd960700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c80cbaa0 con 0x7f39c8069220 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39cd960700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c80cbd80 con 0x7f39c80b2be0 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39cd960700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c80cc060 con 0x7f39c8159850 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39c6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39c8159850 0x7f39c8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39c77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f39c8069220 0x7f39c80ccb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55028/0 (socket says 172.21.15.60:55028) 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39c77fe700 1 -- 172.21.15.60:0/1303313409 learned_addr learned my addr 172.21.15.60:0/1303313409 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.876+0000 7f39c6ffd700 1 -- 172.21.15.60:0/1303313409 >> v1:172.21.15.144:6789/0 conn(0x7f39c80b2be0 legacy=0x7f39c8068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c6ffd700 1 -- 172.21.15.60:0/1303313409 >> v1:172.21.15.60:6789/0 conn(0x7f39c8069220 legacy=0x7f39c80ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c6ffd700 1 -- 172.21.15.60:0/1303313409 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c80cc340 con 0x7f39c8159850 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c5ffb700 1 -- 172.21.15.60:0/1303313409 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819894976 0 0) 0x7f39c80cbaa0 con 0x7f39c8069220 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c6ffd700 1 --2- 172.21.15.60:0/1303313409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c8159850 0x7f39c8159c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009e60 tx=0x7f39c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f5fc074115ceac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c5ffb700 1 -- 172.21.15.60:0/1303313409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000e070 con 0x7f39c8159850 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c5ffb700 1 -- 172.21.15.60:0/1303313409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000bbf0 con 0x7f39c8159850 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39c5ffb700 1 -- 172.21.15.60:0/1303313409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0012430 con 0x7f39c8159850 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 -- 172.21.15.60:0/1303313409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c8159850 msgr2=0x7f39c8159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 --2- 172.21.15.60:0/1303313409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c8159850 0x7f39c8159c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009e60 tx=0x7f39c0009780 comp rx=0 tx=0).stop 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 -- 172.21.15.60:0/1303313409 shutdown_connections 2023-10-08T16:09:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 --2- 172.21.15.60:0/1303313409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c8159850 0x7f39c8159c20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 -- 172.21.15.60:0/1303313409 >> 172.21.15.60:0/1303313409 conn(0x7f39c8067660 msgr2=0x7f39c8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 -- 172.21.15.60:0/1303313409 shutdown_connections 2023-10-08T16:09:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.877+0000 7f39cd960700 1 -- 172.21.15.60:0/1303313409 wait complete. 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 Processor -- start 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 -- start start 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39c8069220 0x7f39c8155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 0x7f39c80b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39c8159850 0x7f39c80c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c816ade0 con 0x7f39c80b2be0 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c816a1d0 con 0x7f39c8159850 2023-10-08T16:09:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39cd960700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c816a4b0 con 0x7f39c8069220 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.879+0000 7f39c67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 0x7f39c80b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 0x7f39c80b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35560/0 (socket says 172.21.15.60:35560) 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 -- 172.21.15.60:0/1230393889 learned_addr learned my addr 172.21.15.60:0/1230393889 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c6ffd700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39c8069220 0x7f39c8155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c77fe700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39c8159850 0x7f39c80c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 -- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39c8069220 msgr2=0x7f39c8155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39c8069220 0x7f39c8155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 -- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39c8159850 msgr2=0x7f39c80c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39c8159850 0x7f39c80c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 -- 172.21.15.60:0/1230393889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0009a20 con 0x7f39c80b2be0 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c6ffd700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39c8069220 0x7f39c8155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c77fe700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39c8159850 0x7f39c80c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39c67fc700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 0x7f39c80b0e90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c5d0 tx=0x7f39b0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0011590 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0011710 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c816a790 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0011ad0 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.880+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c81566e0 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.881+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c816af90 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.882+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39b001c460 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.882+0000 7f39beffd700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39a8066f30 0x7f39a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.882+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39b0084330 con 0x7f39c80b2be0 2023-10-08T16:09:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.882+0000 7f39c6ffd700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39a8066f30 0x7f39a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.882+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=85}) v3 -- 0x7f39a806ea50 con 0x7f39c80b2be0 2023-10-08T16:09:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.883+0000 7f39c6ffd700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39a8066f30 0x7f39a80693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f39c00099f0 tx=0x7f39c0018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:45.886+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39c816af90 con 0x7f39c80b2be0 2023-10-08T16:09:46.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.124+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39c816af20 con 0x7f39c80b2be0 2023-10-08T16:09:46.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.125+0000 7f39beffd700 1 -- 172.21.15.60:0/1230393889 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f39b00515a0 con 0x7f39c80b2be0 2023-10-08T16:09:46.125 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:46.125 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:09:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39a8066f30 msgr2=0x7f39a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39a8066f30 0x7f39a80693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f39c00099f0 tx=0x7f39c0018000 comp rx=0 tx=0).stop 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 msgr2=0x7f39c80b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 0x7f39c80b0e90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c5d0 tx=0x7f39b0007f60 comp rx=0 tx=0).stop 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 shutdown_connections 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39a8066f30 0x7f39a80693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39c8069220 0x7f39c8155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39c8159850 0x7f39c80c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 --2- 172.21.15.60:0/1230393889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39c80b2be0 0x7f39c80b0e90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 >> 172.21.15.60:0/1230393889 conn(0x7f39c8067660 msgr2=0x7f39c8156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 shutdown_connections 2023-10-08T16:09:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.127+0000 7f39cd960700 1 -- 172.21.15.60:0/1230393889 wait complete. 2023-10-08T16:09:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:09:46.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:46.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.258+0000 7f131876f700 1 Processor -- start 2023-10-08T16:09:46.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.258+0000 7f131876f700 1 -- start start 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.259+0000 7f131876f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13100b0e50 0x7f13100c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.259+0000 7f131876f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13100b1220 0x7f131006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.259+0000 7f131876f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f131006dad0 0x7f13100cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.259+0000 7f131876f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131015de60 con 0x7f13100b1220 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.259+0000 7f131876f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131015e140 con 0x7f13100b0e50 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.259+0000 7f131876f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131015e420 con 0x7f131006dad0 2023-10-08T16:09:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13100b1220 0x7f131006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13100b1220 0x7f131006d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35574/0 (socket says 172.21.15.60:35574) 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 -- 172.21.15.60:0/975482707 learned_addr learned my addr 172.21.15.60:0/975482707 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1316d0c700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f131006dad0 0x7f13100cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f131650b700 1 --2- 172.21.15.60:0/975482707 >> v2:172.21.15.144:3300/0 conn(0x7f13100b0e50 0x7f13100c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 -- 172.21.15.60:0/975482707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f131006dad0 msgr2=0x7f13100cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f131006dad0 0x7f13100cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 -- 172.21.15.60:0/975482707 >> v2:172.21.15.144:3300/0 conn(0x7f13100b0e50 msgr2=0x7f13100c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 --2- 172.21.15.60:0/975482707 >> v2:172.21.15.144:3300/0 conn(0x7f13100b0e50 0x7f13100c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 -- 172.21.15.60:0/975482707 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131015e700 con 0x7f13100b1220 2023-10-08T16:09:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f131650b700 1 --2- 172.21.15.60:0/975482707 >> v2:172.21.15.144:3300/0 conn(0x7f13100b0e50 0x7f13100c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1316d0c700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f131006dad0 0x7f13100cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315d0a700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b1220 0x7f131006d590 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1310069840 tx=0x7f1304009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ed94c271cee0bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315509700 1 -- 172.21.15.60:0/975482707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400b860 con 0x7f13100b1220 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315509700 1 -- 172.21.15.60:0/975482707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400b9c0 con 0x7f13100b1220 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.260+0000 7f1315509700 1 -- 172.21.15.60:0/975482707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400bd80 con 0x7f13100b1220 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 -- 172.21.15.60:0/975482707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b1220 msgr2=0x7f131006d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b1220 0x7f131006d590 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1310069840 tx=0x7f1304009250 comp rx=0 tx=0).stop 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 -- 172.21.15.60:0/975482707 shutdown_connections 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f131006dad0 0x7f13100cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 --2- 172.21.15.60:0/975482707 >> v2:172.21.15.144:3300/0 conn(0x7f13100b0e50 0x7f13100c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 --2- 172.21.15.60:0/975482707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b1220 0x7f131006d590 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 -- 172.21.15.60:0/975482707 >> 172.21.15.60:0/975482707 conn(0x7f1310069870 msgr2=0x7f1310069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 -- 172.21.15.60:0/975482707 shutdown_connections 2023-10-08T16:09:46.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.261+0000 7f131876f700 1 -- 172.21.15.60:0/975482707 wait complete. 2023-10-08T16:09:46.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.262+0000 7f131876f700 1 Processor -- start 2023-10-08T16:09:46.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.262+0000 7f131876f700 1 -- start start 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131876f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131006dad0 0x7f13100b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131876f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 0x7f13100ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131876f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13100b1220 0x7f13100ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131876f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310155d90 con 0x7f13100b0e50 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131876f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100caeb0 con 0x7f131006dad0 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131876f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13100cb190 con 0x7f13100b1220 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 0x7f13100ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 0x7f13100ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35586/0 (socket says 172.21.15.60:35586) 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 -- 172.21.15.60:0/1255818939 learned_addr learned my addr 172.21.15.60:0/1255818939 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131650b700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131006dad0 0x7f13100b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1316d0c700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13100b1220 0x7f13100ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 -- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13100b1220 msgr2=0x7f13100ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13100b1220 0x7f13100ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 -- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131006dad0 msgr2=0x7f13100b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131006dad0 0x7f13100b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040094f0 con 0x7f13100b0e50 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f131650b700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131006dad0 0x7f13100b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f1315d0a700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 0x7f13100ca310 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1304006fd0 tx=0x7f1304017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.263+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304020070 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.264+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304006a90 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.264+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131015af60 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.264+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130401a670 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.264+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131015b520 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.264+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131015b710 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.265+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f130401aa20 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.265+0000 7f130e7fc700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.265+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1304085710 con 0x7f13100b0e50 2023-10-08T16:09:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.265+0000 7f131650b700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.266+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=85}) v3 -- 0x7f12fc06ea50 con 0x7f13100b0e50 2023-10-08T16:09:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.266+0000 7f131650b700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12fc066f30 0x7f12fc0693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1308008b20 tx=0x7f1308008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.270+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1304052a00 con 0x7f13100b0e50 2023-10-08T16:09:46.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.394+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(85..85 src has 1..85) v4 ==== 296+0+0 (secure 0 0 0) 0x7f1304056dc0 con 0x7f13100b0e50 2023-10-08T16:09:46.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.394+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f12fc06f390 con 0x7f13100b0e50 2023-10-08T16:09:46.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.510+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f131004c3c0 con 0x7f13100b0e50 2023-10-08T16:09:46.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.510+0000 7f130e7fc700 1 -- 172.21.15.60:0/1255818939 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f1304015070 con 0x7f13100b0e50 2023-10-08T16:09:46.511 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:46.511 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:08:55.839890+0000","modified":"2023-10-08T16:08:59.459648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/3557387212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3557387212},{"type":"v1","addr":"172.21.15.60:6836","nonce":3557387212}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:09:46.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12fc066f30 msgr2=0x7f12fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12fc066f30 0x7f12fc0693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1308008b20 tx=0x7f1308008040 comp rx=0 tx=0).stop 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 msgr2=0x7f13100ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 0x7f13100ca310 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1304006fd0 tx=0x7f1304017000 comp rx=0 tx=0).stop 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 shutdown_connections 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13100b1220 0x7f13100ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131006dad0 0x7f13100b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 --2- 172.21.15.60:0/1255818939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13100b0e50 0x7f13100ca310 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 >> 172.21.15.60:0/1255818939 conn(0x7f1310069870 msgr2=0x7f1310069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 shutdown_connections 2023-10-08T16:09:46.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.513+0000 7f131876f700 1 -- 172.21.15.60:0/1255818939 wait complete. 2023-10-08T16:09:46.515 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 43 2023-10-08T16:09:46.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 Processor -- start 2023-10-08T16:09:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 -- start start 2023-10-08T16:09:46.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96e40cf1c0 0x7f96e415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e415a0c0 0x7f96e4068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e40cca20 con 0x7f96e4159cf0 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e415ea40 con 0x7f96e40cf1c0 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.644+0000 7f96e9fef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4067660 con 0x7f96e415a0c0 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f96e4159cf0 0x7f96e40ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55030/0 (socket says 172.21.15.60:55030) 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e37fe700 1 -- 172.21.15.60:0/4018426481 learned_addr learned my addr 172.21.15.60:0/4018426481 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:46.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e2ffd700 1 --2- 172.21.15.60:0/4018426481 >> v2:172.21.15.144:3300/0 conn(0x7f96e40cf1c0 0x7f96e415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e3fff700 1 --2- 172.21.15.60:0/4018426481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e415a0c0 0x7f96e4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e27fc700 1 -- 172.21.15.60:0/4018426481 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693719647 0 0) 0x7f96e40cca20 con 0x7f96e4159cf0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e27fc700 1 -- 172.21.15.60:0/4018426481 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96cc003570 con 0x7f96e4159cf0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e3fff700 1 -- 172.21.15.60:0/4018426481 >> v2:172.21.15.144:3300/0 conn(0x7f96e40cf1c0 msgr2=0x7f96e415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e3fff700 1 --2- 172.21.15.60:0/4018426481 >> v2:172.21.15.144:3300/0 conn(0x7f96e40cf1c0 0x7f96e415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e27fc700 1 -- 172.21.15.60:0/4018426481 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876086726 0 0) 0x7f96cc003570 con 0x7f96e4159cf0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e3fff700 1 -- 172.21.15.60:0/4018426481 >> v1:172.21.15.60:6789/0 conn(0x7f96e4159cf0 legacy=0x7f96e40ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e3fff700 1 -- 172.21.15.60:0/4018426481 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4067f00 con 0x7f96e415a0c0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.645+0000 7f96e3fff700 1 --2- 172.21.15.60:0/4018426481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e415a0c0 0x7f96e4068390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009e60 tx=0x7f96dc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b15b6fb30eb5db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e27fc700 1 -- 172.21.15.60:0/4018426481 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc00e070 con 0x7f96e415a0c0 2023-10-08T16:09:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e27fc700 1 -- 172.21.15.60:0/4018426481 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc00b7a0 con 0x7f96e415a0c0 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e27fc700 1 -- 172.21.15.60:0/4018426481 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4001470 con 0x7f96e415a0c0 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 -- 172.21.15.60:0/4018426481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e415a0c0 msgr2=0x7f96e4068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 --2- 172.21.15.60:0/4018426481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e415a0c0 0x7f96e4068390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009e60 tx=0x7f96dc009780 comp rx=0 tx=0).stop 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 -- 172.21.15.60:0/4018426481 shutdown_connections 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 --2- 172.21.15.60:0/4018426481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e415a0c0 0x7f96e4068390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 --2- 172.21.15.60:0/4018426481 >> v2:172.21.15.144:3300/0 conn(0x7f96e40cf1c0 0x7f96e415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 -- 172.21.15.60:0/4018426481 >> 172.21.15.60:0/4018426481 conn(0x7f96e406c6e0 msgr2=0x7f96e4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 -- 172.21.15.60:0/4018426481 shutdown_connections 2023-10-08T16:09:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.646+0000 7f96e9fef700 1 -- 172.21.15.60:0/4018426481 wait complete. 2023-10-08T16:09:46.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.647+0000 7f96e9fef700 1 Processor -- start 2023-10-08T16:09:46.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.647+0000 7f96e9fef700 1 -- start start 2023-10-08T16:09:46.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e9fef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e40cf1c0 0x7f96e40ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e9fef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e4159cf0 0x7f96e40b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e9fef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 0x7f96e4155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e9fef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e415b470 con 0x7f96e415a0c0 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e9fef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40af790 con 0x7f96e40cf1c0 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e9fef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40aec10 con 0x7f96e4159cf0 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 0x7f96e4155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 0x7f96e4155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35602/0 (socket says 172.21.15.60:35602) 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e3fff700 1 -- 172.21.15.60:0/3920864269 learned_addr learned my addr 172.21.15.60:0/3920864269 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e2ffd700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e4159cf0 0x7f96e40b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e3fff700 1 -- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e4159cf0 msgr2=0x7f96e40b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e37fe700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e40cf1c0 0x7f96e40ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e3fff700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e4159cf0 0x7f96e40b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.648+0000 7f96e3fff700 1 -- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e40cf1c0 msgr2=0x7f96e40ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96e3fff700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e40cf1c0 0x7f96e40ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96e3fff700 1 -- 172.21.15.60:0/3920864269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009a20 con 0x7f96e415a0c0 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96e3fff700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 0x7f96e4155670 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00b610 tx=0x7f96dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc012d50 con 0x7f96e415a0c0 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc01e430 con 0x7f96e415a0c0 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e40aeef0 con 0x7f96e415a0c0 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc01e7f0 con 0x7f96e415a0c0 2023-10-08T16:09:46.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.649+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e40af4b0 con 0x7f96e415a0c0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.650+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e404c3c0 con 0x7f96e415a0c0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.650+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96dc01ebe0 con 0x7f96e415a0c0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.651+0000 7f96cb7fe700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96d0066f30 0x7f96d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.651+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96dc086710 con 0x7f96e415a0c0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.651+0000 7f96e37fe700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96d0066f30 0x7f96d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.651+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f96d006ea50 con 0x7f96e415a0c0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.651+0000 7f96e37fe700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96d0066f30 0x7f96d00693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96d40011e0 tx=0x7f96d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.655+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96dc053980 con 0x7f96e415a0c0 2023-10-08T16:09:46.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.846+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e40ce730 con 0x7f96e415a0c0 2023-10-08T16:09:46.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.847+0000 7f96cb7fe700 1 -- 172.21.15.60:0/3920864269 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+15375 (secure 0 0 0) 0x7f96dc056fa0 con 0x7f96e415a0c0 2023-10-08T16:09:46.847 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:46.848 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:46.390820+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:08:54.250805+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:08:54.808564+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:46.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96d0066f30 msgr2=0x7f96d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96d0066f30 0x7f96d00693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96d40011e0 tx=0x7f96d4009040 comp rx=0 tx=0).stop 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 msgr2=0x7f96e4155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 0x7f96e4155670 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00b610 tx=0x7f96dc018000 comp rx=0 tx=0).stop 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 shutdown_connections 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f96d0066f30 0x7f96d00693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e415a0c0 0x7f96e4155670 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e40cf1c0 0x7f96e40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 --2- 172.21.15.60:0/3920864269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f96e4159cf0 0x7f96e40b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 >> 172.21.15.60:0/3920864269 conn(0x7f96e406c6e0 msgr2=0x7f96e4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 shutdown_connections 2023-10-08T16:09:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.849+0000 7f96e9fef700 1 -- 172.21.15.60:0/3920864269 wait complete. 2023-10-08T16:09:46.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:09:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.981+0000 7f841b231700 1 Processor -- start 2023-10-08T16:09:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.981+0000 7f841b231700 1 -- start start 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f841b231700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8414159e60 0x7f84140b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f841b231700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f841406adb0 0x7f8414163c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f841b231700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84140b3d40 con 0x7f84140cffa0 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f841b231700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8414069d70 con 0x7f841406adb0 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f841b231700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84140b4300 con 0x7f8414159e60 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f8413fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f84140cffa0 0x7f841406a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55042/0 (socket says 172.21.15.60:55042) 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f8413fff700 1 -- 172.21.15.60:0/2869323192 learned_addr learned my addr 172.21.15.60:0/2869323192 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f84197ce700 1 --2- 172.21.15.60:0/2869323192 >> v2:172.21.15.144:3300/0 conn(0x7f841406adb0 0x7f8414163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.982+0000 7f8418fcd700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8414159e60 0x7f84140b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84137fe700 1 -- 172.21.15.60:0/2869323192 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087938273 0 0) 0x7f84140b3d40 con 0x7f84140cffa0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84137fe700 1 -- 172.21.15.60:0/2869323192 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8400003570 con 0x7f84140cffa0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84197ce700 1 -- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8414159e60 msgr2=0x7f84140b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84197ce700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8414159e60 0x7f84140b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84197ce700 1 -- 172.21.15.60:0/2869323192 >> v1:172.21.15.60:6789/0 conn(0x7f84140cffa0 legacy=0x7f841406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84197ce700 1 -- 172.21.15.60:0/2869323192 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140d0480 con 0x7f841406adb0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f8418fcd700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8414159e60 0x7f84140b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84197ce700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f841406adb0 0x7f8414163c90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0098e0 tx=0x7f83fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec937777d8ce255 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84137fe700 1 -- 172.21.15.60:0/2869323192 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc011630 con 0x7f841406adb0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84137fe700 1 -- 172.21.15.60:0/2869323192 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc011790 con 0x7f841406adb0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.983+0000 7f84137fe700 1 -- 172.21.15.60:0/2869323192 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc011b30 con 0x7f841406adb0 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 -- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f841406adb0 msgr2=0x7f8414163c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f841406adb0 0x7f8414163c90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0098e0 tx=0x7f83fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 -- 172.21.15.60:0/2869323192 shutdown_connections 2023-10-08T16:09:46.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f841406adb0 0x7f8414163c90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 --2- 172.21.15.60:0/2869323192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8414159e60 0x7f84140b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 -- 172.21.15.60:0/2869323192 >> 172.21.15.60:0/2869323192 conn(0x7f84140d1a50 msgr2=0x7f8414068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 -- 172.21.15.60:0/2869323192 shutdown_connections 2023-10-08T16:09:46.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.984+0000 7f841b231700 1 -- 172.21.15.60:0/2869323192 wait complete. 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.985+0000 7f841b231700 1 Processor -- start 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.985+0000 7f841b231700 1 -- start start 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f841b231700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 0x7f8414152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f841b231700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84140cffa0 0x7f841415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f841b231700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8414159e60 0x7f841415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f841b231700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841415dfe0 con 0x7f841406adb0 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f841b231700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841415d3d0 con 0x7f8414159e60 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f841b231700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841415d6b0 con 0x7f84140cffa0 2023-10-08T16:09:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 0x7f8414152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 0x7f8414152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35608/0 (socket says 172.21.15.60:35608) 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 -- 172.21.15.60:0/1944712499 learned_addr learned my addr 172.21.15.60:0/1944712499 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8413fff700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84140cffa0 0x7f841415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f84197ce700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8414159e60 0x7f841415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 -- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84140cffa0 msgr2=0x7f841415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84140cffa0 0x7f841415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 -- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8414159e60 msgr2=0x7f841415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8414159e60 0x7f841415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c009420 con 0x7f841406adb0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8418fcd700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 0x7f8414152c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ec80 tx=0x7f840c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.986+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c00c9d0 con 0x7f841406adb0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.987+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c00cb30 con 0x7f841406adb0 2023-10-08T16:09:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.987+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc009420 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.987+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c00ceb0 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.987+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841415dc70 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.988+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841404c3c0 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.988+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f840c013680 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.988+0000 7f8410ff9700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83f4066f60 0x7f83f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.988+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f840c084950 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.989+0000 7f8413fff700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83f4066f60 0x7f83f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.989+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f83f406ea80 con 0x7f841406adb0 2023-10-08T16:09:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.989+0000 7f8413fff700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83f4066f60 0x7f83f4069410 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f84140b00d0 tx=0x7f8404009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:46.993+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f840c017060 con 0x7f841406adb0 2023-10-08T16:09:47.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.232+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f84140d0760 con 0x7f841406adb0 2023-10-08T16:09:47.232 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:09:47.232+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.234+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(86..86 src has 1..86) v4 ==== 1546+0+0 (secure 0 0 0) 0x7f840c055f80 con 0x7f841406adb0 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.234+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f83f406fcd0 con 0x7f841406adb0 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.237+0000 7f8410ff9700 1 -- 172.21.15.60:0/1944712499 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f840c021020 con 0x7f841406adb0 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83f4066f60 msgr2=0x7f83f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83f4066f60 0x7f83f4069410 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f84140b00d0 tx=0x7f8404009040 comp rx=0 tx=0).stop 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 msgr2=0x7f8414152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 0x7f8414152c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ec80 tx=0x7f840c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 shutdown_connections 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83f4066f60 0x7f83f4069410 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8414159e60 0x7f841415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841406adb0 0x7f8414152c60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 --2- 172.21.15.60:0/1944712499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84140cffa0 0x7f841415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 >> 172.21.15.60:0/1944712499 conn(0x7f84140d1a50 msgr2=0x7f8414156320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 shutdown_connections 2023-10-08T16:09:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.240+0000 7f841b231700 1 -- 172.21.15.60:0/1944712499 wait complete. 2023-10-08T16:09:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:09:47.253 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:09:47.272 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:09:47.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 Processor -- start 2023-10-08T16:09:47.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 -- start start 2023-10-08T16:09:47.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa44159e60 0x7faa4415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:47.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa4415a230 0x7faa440690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4415ea90 con 0x7faa440695f0 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa440d1cf0 con 0x7faa44159e60 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.375+0000 7faa49295700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa44069a70 con 0x7faa4415a230 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa42ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa44159e60 0x7faa4415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa437fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faa440695f0 0x7faa440af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55054/0 (socket says 172.21.15.60:55054) 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa437fe700 1 -- 172.21.15.60:0/417080501 learned_addr learned my addr 172.21.15.60:0/417080501 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa427fc700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa4415a230 0x7faa440690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa42ffd700 1 -- 172.21.15.60:0/417080501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa4415a230 msgr2=0x7faa440690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa42ffd700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa4415a230 0x7faa440690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa42ffd700 1 -- 172.21.15.60:0/417080501 >> v1:172.21.15.60:6789/0 conn(0x7faa440695f0 legacy=0x7faa440af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa41ffb700 1 -- 172.21.15.60:0/417080501 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223700344 0 0) 0x7faa4415ea90 con 0x7faa440695f0 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa42ffd700 1 -- 172.21.15.60:0/417080501 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440b3100 con 0x7faa44159e60 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa427fc700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa4415a230 0x7faa440690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa42ffd700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa44159e60 0x7faa4415e550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa340098e0 tx=0x7faa340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514c93a52fb176af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa41ffb700 1 -- 172.21.15.60:0/417080501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34009e80 con 0x7faa44159e60 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa41ffb700 1 -- 172.21.15.60:0/417080501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400b860 con 0x7faa44159e60 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.376+0000 7faa41ffb700 1 -- 172.21.15.60:0/417080501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400bbe0 con 0x7faa44159e60 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 -- 172.21.15.60:0/417080501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa44159e60 msgr2=0x7faa4415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa44159e60 0x7faa4415e550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa340098e0 tx=0x7faa340091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 -- 172.21.15.60:0/417080501 shutdown_connections 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa44159e60 0x7faa4415e550 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 --2- 172.21.15.60:0/417080501 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa4415a230 0x7faa440690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 -- 172.21.15.60:0/417080501 >> 172.21.15.60:0/417080501 conn(0x7faa44070700 msgr2=0x7faa44070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 -- 172.21.15.60:0/417080501 shutdown_connections 2023-10-08T16:09:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.377+0000 7faa49295700 1 -- 172.21.15.60:0/417080501 wait complete. 2023-10-08T16:09:47.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.378+0000 7faa49295700 1 Processor -- start 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.378+0000 7faa49295700 1 -- start start 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa49295700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 0x7faa4415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa49295700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa44159e60 0x7faa4415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa49295700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa4415a230 0x7faa4415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa49295700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4416a4f0 con 0x7faa440695f0 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa49295700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4415e3d0 con 0x7faa4415a230 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa49295700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4415e6b0 con 0x7faa44159e60 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 0x7faa4415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 0x7faa4415dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35638/0 (socket says 172.21.15.60:35638) 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 -- 172.21.15.60:0/3925944222 learned_addr learned my addr 172.21.15.60:0/3925944222 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:47.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa427fc700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa44159e60 0x7faa4415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 -- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa44159e60 msgr2=0x7faa4415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa437fe700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa4415a230 0x7faa4415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa44159e60 0x7faa4415a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 -- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa4415a230 msgr2=0x7faa4415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa4415a230 0x7faa4415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 -- 172.21.15.60:0/3925944222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34009420 con 0x7faa440695f0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.379+0000 7faa42ffd700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 0x7faa4415dba0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faa44069e20 tx=0x7faa34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.380+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34011420 con 0x7faa440695f0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.380+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa340115a0 con 0x7faa440695f0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.380+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4415e990 con 0x7faa440695f0 2023-10-08T16:09:47.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.380+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34011960 con 0x7faa440695f0 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.380+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4415ef50 con 0x7faa440695f0 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.381+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4415f170 con 0x7faa440695f0 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.381+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa340253f0 con 0x7faa440695f0 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.382+0000 7faa3affd700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faa24066f30 0x7faa240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.382+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5791+0+0 (secure 0 0 0) 0x7faa340861c0 con 0x7faa440695f0 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.382+0000 7faa427fc700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faa24066f30 0x7faa240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:47.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.382+0000 7faa427fc700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faa24066f30 0x7faa240693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faa4415f800 tx=0x7faa2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:47.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.386+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa34053340 con 0x7faa440695f0 2023-10-08T16:09:47.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:47.628+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faa4404c3c0 con 0x7faa440695f0 2023-10-08T16:09:48.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.237+0000 7faa3affd700 1 -- 172.21.15.60:0/3925944222 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7faa34056960 con 0x7faa440695f0 2023-10-08T16:09:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faa24066f30 msgr2=0x7faa240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faa24066f30 0x7faa240693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faa4415f800 tx=0x7faa2c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 msgr2=0x7faa4415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 0x7faa4415dba0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faa44069e20 tx=0x7faa34017000 comp rx=0 tx=0).stop 2023-10-08T16:09:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 shutdown_connections 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faa24066f30 0x7faa240693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa4415a230 0x7faa4415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa440695f0 0x7faa4415dba0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 --2- 172.21.15.60:0/3925944222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa44159e60 0x7faa4415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 >> 172.21.15.60:0/3925944222 conn(0x7faa44070700 msgr2=0x7faa44070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 shutdown_connections 2023-10-08T16:09:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.240+0000 7faa49295700 1 -- 172.21.15.60:0/3925944222 wait complete. 2023-10-08T16:09:48.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:09:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.430+0000 7fe1b3360700 1 Processor -- start 2023-10-08T16:09:48.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.430+0000 7fe1b3360700 1 -- start start 2023-10-08T16:09:48.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b3360700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1ac0b10a0 0x7fe1ac0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b3360700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac0cb740 0x7fe1ac0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b3360700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1ac06d3f0 0x7fe1ac06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b3360700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac06dd90 con 0x7fe1ac06d3f0 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b3360700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac15e940 con 0x7fe1ac0b10a0 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b3360700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac15a250 con 0x7fe1ac0cb740 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1ac06d3f0 0x7fe1ac06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1ac06d3f0 0x7fe1ac06d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35644/0 (socket says 172.21.15.60:35644) 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1586260693 learned_addr learned my addr 172.21.15.60:0/1586260693 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:48.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b10fc700 1 --2- 172.21.15.60:0/1586260693 >> v2:172.21.15.144:3300/0 conn(0x7fe1ac0b10a0 0x7fe1ac0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b08fb700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac0cb740 0x7fe1ac0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1586260693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac0cb740 msgr2=0x7fe1ac0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac0cb740 0x7fe1ac0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1586260693 >> v2:172.21.15.144:3300/0 conn(0x7fe1ac0b10a0 msgr2=0x7fe1ac0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 --2- 172.21.15.60:0/1586260693 >> v2:172.21.15.144:3300/0 conn(0x7fe1ac0b10a0 0x7fe1ac0c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1586260693 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac15dd30 con 0x7fe1ac06d3f0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.431+0000 7fe1b08fb700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac0cb740 0x7fe1ac0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b18fd700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac06d3f0 0x7fe1ac06d850 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac06f090 tx=0x7fe1a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9286730327ba29b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1a3fff700 1 -- 172.21.15.60:0/1586260693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400e070 con 0x7fe1ac06d3f0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1a3fff700 1 -- 172.21.15.60:0/1586260693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400ba50 con 0x7fe1ac06d3f0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1a3fff700 1 -- 172.21.15.60:0/1586260693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40092e0 con 0x7fe1ac06d3f0 2023-10-08T16:09:48.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 -- 172.21.15.60:0/1586260693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac06d3f0 msgr2=0x7fe1ac06d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac06d3f0 0x7fe1ac06d850 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac06f090 tx=0x7fe1a4009840 comp rx=0 tx=0).stop 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 -- 172.21.15.60:0/1586260693 shutdown_connections 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac06d3f0 0x7fe1ac06d850 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1586260693 >> v2:172.21.15.144:3300/0 conn(0x7fe1ac0b10a0 0x7fe1ac0c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1586260693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac0cb740 0x7fe1ac0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 -- 172.21.15.60:0/1586260693 >> 172.21.15.60:0/1586260693 conn(0x7fe1ac069870 msgr2=0x7fe1ac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 -- 172.21.15.60:0/1586260693 shutdown_connections 2023-10-08T16:09:48.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.432+0000 7fe1b3360700 1 -- 172.21.15.60:0/1586260693 wait complete. 2023-10-08T16:09:48.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.433+0000 7fe1b3360700 1 Processor -- start 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.433+0000 7fe1b3360700 1 -- start start 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b3360700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac06d3f0 0x7fe1ac0c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b3360700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1ac0b10a0 0x7fe1ac158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b3360700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 0x7fe1ac15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b3360700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c7750 con 0x7fe1ac0cb740 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b3360700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac15b8b0 con 0x7fe1ac0b10a0 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b3360700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b3350 con 0x7fe1ac06d3f0 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b18fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 0x7fe1ac15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b18fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 0x7fe1ac15ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35650/0 (socket says 172.21.15.60:35650) 2023-10-08T16:09:48.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.434+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1091718516 learned_addr learned my addr 172.21.15.60:0/1091718516 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b10fc700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac06d3f0 0x7fe1ac0c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b08fb700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1ac0b10a0 0x7fe1ac158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac06d3f0 msgr2=0x7fe1ac0c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b18fd700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac06d3f0 0x7fe1ac0c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1ac0b10a0 msgr2=0x7fe1ac158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b18fd700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1ac0b10a0 0x7fe1ac158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b18fd700 1 -- 172.21.15.60:0/1091718516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009ae0 con 0x7fe1ac0cb740 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b10fc700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac06d3f0 0x7fe1ac0c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b18fd700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 0x7fe1ac15ae60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009fd0 tx=0x7fe1a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40094e0 con 0x7fe1ac0cb740 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a40032f0 con 0x7fe1ac0cb740 2023-10-08T16:09:48.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac0b2a20 con 0x7fe1ac0cb740 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4025690 con 0x7fe1ac0cb740 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.435+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac0b2fe0 con 0x7fe1ac0cb740 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.436+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac04c3c0 con 0x7fe1ac0cb740 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.437+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1a4003040 con 0x7fe1ac0cb740 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.437+0000 7fe1a17fa700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.437+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe1a4086280 con 0x7fe1ac0cb740 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.437+0000 7fe1b10fc700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.437+0000 7fe1b10fc700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe19c006fd0 tx=0x7fe19c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:48.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.442+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1a40534a0 con 0x7fe1ac0cb740 2023-10-08T16:09:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:48.635+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe1ac068b10 con 0x7fe1ac0cb740 2023-10-08T16:09:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.404+0000 7fe1a17fa700 1 -- 172.21.15.60:0/1091718516 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe1a4009940 con 0x7fe1ac0cb740 2023-10-08T16:09:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe190066f30 msgr2=0x7fe1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe19c006fd0 tx=0x7fe19c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 msgr2=0x7fe1ac15ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 0x7fe1ac15ae60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009fd0 tx=0x7fe1a4018000 comp rx=0 tx=0).stop 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 shutdown_connections 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1ac06d3f0 0x7fe1ac0c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac0cb740 0x7fe1ac15ae60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 --2- 172.21.15.60:0/1091718516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1ac0b10a0 0x7fe1ac158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.410+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 >> 172.21.15.60:0/1091718516 conn(0x7fe1ac069870 msgr2=0x7fe1ac158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.411+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 shutdown_connections 2023-10-08T16:09:49.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.411+0000 7fe1b3360700 1 -- 172.21.15.60:0/1091718516 wait complete. 2023-10-08T16:09:49.413 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:09:49.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:09:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.550+0000 7f92d2ca9700 1 Processor -- start 2023-10-08T16:09:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.550+0000 7f92d2ca9700 1 -- start start 2023-10-08T16:09:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d2ca9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92cc157960 0x7f92cc15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d2ca9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92cc06a5c0 0x7f92cc06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d2ca9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc06af60 con 0x7f92cc0cd7d0 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d2ca9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0d0940 con 0x7f92cc157960 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d2ca9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0cfda0 con 0x7f92cc06a5c0 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92cc157960 0x7f92cc15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92cc157960 0x7f92cc15ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35656/0 (socket says 172.21.15.60:35656) 2023-10-08T16:09:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 -- 172.21.15.60:0/1174335925 learned_addr learned my addr 172.21.15.60:0/1174335925 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d1246700 1 --2- 172.21.15.60:0/1174335925 >> v2:172.21.15.144:3300/0 conn(0x7f92cc06a5c0 0x7f92cc06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 -- 172.21.15.60:0/1174335925 >> v2:172.21.15.144:3300/0 conn(0x7f92cc06a5c0 msgr2=0x7f92cc06aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 --2- 172.21.15.60:0/1174335925 >> v2:172.21.15.144:3300/0 conn(0x7f92cc06a5c0 0x7f92cc06aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 -- 172.21.15.60:0/1174335925 >> v1:172.21.15.144:6789/0 conn(0x7f92cc0cd7d0 legacy=0x7f92cc0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 -- 172.21.15.60:0/1174335925 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc0ce050 con 0x7f92cc157960 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92d0a45700 1 --2- 172.21.15.60:0/1174335925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc157960 0x7f92cc15ae30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0cf2a0 tx=0x7f92bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc7bd1c9d849aa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.551+0000 7f92cb7fe700 1 -- 172.21.15.60:0/1174335925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00e070 con 0x7f92cc157960 2023-10-08T16:09:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92cb7fe700 1 -- 172.21.15.60:0/1174335925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00ba20 con 0x7f92cc157960 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92cb7fe700 1 -- 172.21.15.60:0/1174335925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0092e0 con 0x7f92cc157960 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 -- 172.21.15.60:0/1174335925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc157960 msgr2=0x7f92cc15ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/1174335925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc157960 0x7f92cc15ae30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0cf2a0 tx=0x7f92bc009840 comp rx=0 tx=0).stop 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 -- 172.21.15.60:0/1174335925 shutdown_connections 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/1174335925 >> v2:172.21.15.144:3300/0 conn(0x7f92cc06a5c0 0x7f92cc06aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/1174335925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc157960 0x7f92cc15ae30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 -- 172.21.15.60:0/1174335925 >> 172.21.15.60:0/1174335925 conn(0x7f92cc0d18a0 msgr2=0x7f92cc0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 -- 172.21.15.60:0/1174335925 shutdown_connections 2023-10-08T16:09:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.552+0000 7f92d2ca9700 1 -- 172.21.15.60:0/1174335925 wait complete. 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.553+0000 7f92d2ca9700 1 Processor -- start 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 -- start start 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 0x7f92cc155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92cc0cd7d0 0x7f92cc0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92cc157960 0x7f92cc156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c6870 con 0x7f92cc06a5c0 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc155a50 con 0x7f92cc157960 2023-10-08T16:09:49.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d2ca9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c5ca0 con 0x7f92cc0cd7d0 2023-10-08T16:09:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d0a45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 0x7f92cc155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d0a45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 0x7f92cc155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35660/0 (socket says 172.21.15.60:35660) 2023-10-08T16:09:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d0a45700 1 -- 172.21.15.60:0/2998644949 learned_addr learned my addr 172.21.15.60:0/2998644949 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92d1246700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92cc157960 0x7f92cc156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.554+0000 7f92cbfff700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92cc0cd7d0 0x7f92cc0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d0a45700 1 -- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92cc0cd7d0 msgr2=0x7f92cc0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d0a45700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92cc0cd7d0 0x7f92cc0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d0a45700 1 -- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92cc157960 msgr2=0x7f92cc156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d0a45700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92cc157960 0x7f92cc156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d0a45700 1 -- 172.21.15.60:0/2998644949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009ae0 con 0x7f92cc06a5c0 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92cbfff700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92cc0cd7d0 0x7f92cc0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d0a45700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 0x7f92cc155510 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f92cc06b4d0 tx=0x7f92bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0088b0 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc008a10 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc0c5f40 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc008dd0 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.555+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc0c6500 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.556+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc04c3c0 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.556+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92bc003040 con 0x7f92cc06a5c0 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.557+0000 7f92c8ff9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f92ac066f30 0x7f92ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.557+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f92bc085d90 con 0x7f92cc06a5c0 2023-10-08T16:09:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.557+0000 7f92cbfff700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f92ac066f30 0x7f92ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.557+0000 7f92cbfff700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f92ac066f30 0x7f92ac0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92b4007fd0 tx=0x7f92b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.561+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92bc053160 con 0x7f92cc06a5c0 2023-10-08T16:09:49.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:49.758+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f92cc0c6b50 con 0x7f92cc06a5c0 2023-10-08T16:09:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.421+0000 7f92c8ff9700 1 -- 172.21.15.60:0/2998644949 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f92bc008f30 con 0x7f92cc06a5c0 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f92ac066f30 msgr2=0x7f92ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f92ac066f30 0x7f92ac0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92b4007fd0 tx=0x7f92b4009040 comp rx=0 tx=0).stop 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 msgr2=0x7f92cc155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 0x7f92cc155510 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f92cc06b4d0 tx=0x7f92bc018000 comp rx=0 tx=0).stop 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 shutdown_connections 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f92ac066f30 0x7f92ac0693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92cc157960 0x7f92cc156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92cc06a5c0 0x7f92cc155510 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 --2- 172.21.15.60:0/2998644949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92cc0cd7d0 0x7f92cc0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 >> 172.21.15.60:0/2998644949 conn(0x7f92cc0d18a0 msgr2=0x7f92cc0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.424+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 shutdown_connections 2023-10-08T16:09:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.425+0000 7f92d2ca9700 1 -- 172.21.15.60:0/2998644949 wait complete. 2023-10-08T16:09:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:09:50.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:09:50.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.564+0000 7f301759e700 1 Processor -- start 2023-10-08T16:09:50.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.564+0000 7f301759e700 1 -- start start 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f301806e460 0x7f3018156d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30180ac420 0x7f301806aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f301806b000 0x7f30180ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301806b460 con 0x7f301806b000 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301806a1b0 con 0x7f30180ac420 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30181572d0 con 0x7f301806e460 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f3016d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f301806b000 0x7f30180ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f3016d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f301806b000 0x7f30180ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35676/0 (socket says 172.21.15.60:35676) 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f3016d9d700 1 -- 172.21.15.60:0/4009993034 learned_addr learned my addr 172.21.15.60:0/4009993034 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f3015d9b700 1 --2- 172.21.15.60:0/4009993034 >> v2:172.21.15.144:3300/0 conn(0x7f30180ac420 0x7f301806aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.566+0000 7f301659c700 1 --2- 172.21.15.60:0/4009993034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f301806e460 0x7f3018156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f3016d9d700 1 -- 172.21.15.60:0/4009993034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f301806e460 msgr2=0x7f3018156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f3016d9d700 1 --2- 172.21.15.60:0/4009993034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f301806e460 0x7f3018156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f3016d9d700 1 -- 172.21.15.60:0/4009993034 >> v2:172.21.15.144:3300/0 conn(0x7f30180ac420 msgr2=0x7f301806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f3016d9d700 1 --2- 172.21.15.60:0/4009993034 >> v2:172.21.15.144:3300/0 conn(0x7f30180ac420 0x7f301806aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f3016d9d700 1 -- 172.21.15.60:0/4009993034 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180695a0 con 0x7f301806b000 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f3016d9d700 1 --2- 172.21.15.60:0/4009993034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806b000 0x7f30180ae1c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f30180713f0 tx=0x7f3008009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1290265322c2a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f301559a700 1 -- 172.21.15.60:0/4009993034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30080092e0 con 0x7f301806b000 2023-10-08T16:09:50.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f301559a700 1 -- 172.21.15.60:0/4009993034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3008009440 con 0x7f301806b000 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.567+0000 7f301559a700 1 -- 172.21.15.60:0/4009993034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30080077b0 con 0x7f301806b000 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 -- 172.21.15.60:0/4009993034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806b000 msgr2=0x7f30180ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 --2- 172.21.15.60:0/4009993034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806b000 0x7f30180ae1c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f30180713f0 tx=0x7f3008009b70 comp rx=0 tx=0).stop 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 -- 172.21.15.60:0/4009993034 shutdown_connections 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 --2- 172.21.15.60:0/4009993034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806b000 0x7f30180ae1c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 --2- 172.21.15.60:0/4009993034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f301806e460 0x7f3018156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 --2- 172.21.15.60:0/4009993034 >> v2:172.21.15.144:3300/0 conn(0x7f30180ac420 0x7f301806aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 -- 172.21.15.60:0/4009993034 >> 172.21.15.60:0/4009993034 conn(0x7f30180cc810 msgr2=0x7f30180ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 -- 172.21.15.60:0/4009993034 shutdown_connections 2023-10-08T16:09:50.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.568+0000 7f301759e700 1 -- 172.21.15.60:0/4009993034 wait complete. 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 Processor -- start 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 -- start start 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f301806b000 0x7f301815f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 0x7f3018166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30180ac420 0x7f30180b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30180b07f0 con 0x7f301806e460 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018166760 con 0x7f301806b000 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.570+0000 7f301759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30180b11c0 con 0x7f30180ac420 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 0x7f3018166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 0x7f3018166220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35686/0 (socket says 172.21.15.60:35686) 2023-10-08T16:09:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 -- 172.21.15.60:0/1945154509 learned_addr learned my addr 172.21.15.60:0/1945154509 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3016d9d700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30180ac420 0x7f30180b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f301659c700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f301806b000 0x7f301815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 -- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30180ac420 msgr2=0x7f30180b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30180ac420 0x7f30180b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 -- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f301806b000 msgr2=0x7f301815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f301806b000 0x7f301815f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 -- 172.21.15.60:0/1945154509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008009e10 con 0x7f301806e460 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f3015d9b700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 0x7f3018166220 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3010008ee0 tx=0x7f301000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301000eca0 con 0x7f301806e460 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301000ee00 con 0x7f301806e460 2023-10-08T16:09:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30180b1c90 con 0x7f301806e460 2023-10-08T16:09:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010011670 con 0x7f301806e460 2023-10-08T16:09:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.571+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30180afec0 con 0x7f301806e460 2023-10-08T16:09:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.572+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30180b0960 con 0x7f301806e460 2023-10-08T16:09:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.573+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3010011a20 con 0x7f301806e460 2023-10-08T16:09:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.573+0000 7f30067fc700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ff8066f30 0x7f2ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.573+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3010084b00 con 0x7f301806e460 2023-10-08T16:09:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.573+0000 7f301659c700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ff8066f30 0x7f2ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.574+0000 7f301659c700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ff8066f30 0x7f2ff80693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f30180ac200 tx=0x7f300c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:50.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.578+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3010052070 con 0x7f301806e460 2023-10-08T16:09:50.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.769+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3018069880 con 0x7f301806e460 2023-10-08T16:09:50.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.773+0000 7f30067fc700 1 -- 172.21.15.60:0/1945154509 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3010055690 con 0x7f301806e460 2023-10-08T16:09:50.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ff8066f30 msgr2=0x7f2ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ff8066f30 0x7f2ff80693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f30180ac200 tx=0x7f300c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 msgr2=0x7f3018166220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 0x7f3018166220 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3010008ee0 tx=0x7f301000c040 comp rx=0 tx=0).stop 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 shutdown_connections 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2ff8066f30 0x7f2ff80693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30180ac420 0x7f30180b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f301806b000 0x7f301815f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 --2- 172.21.15.60:0/1945154509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f301806e460 0x7f3018166220 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 >> 172.21.15.60:0/1945154509 conn(0x7f30180cc810 msgr2=0x7f30180ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 shutdown_connections 2023-10-08T16:09:50.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.775+0000 7f301759e700 1 -- 172.21.15.60:0/1945154509 wait complete. 2023-10-08T16:09:50.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-08T16:09:50.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.907+0000 7ff72144d700 1 Processor -- start 2023-10-08T16:09:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.907+0000 7ff72144d700 1 -- start start 2023-10-08T16:09:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff72144d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff71c0cbc00 0x7ff71c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff72144d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c15de60 con 0x7ff71c0b1220 2023-10-08T16:09:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff72144d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c15e140 con 0x7ff71c0b0e50 2023-10-08T16:09:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff72144d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c15e420 con 0x7ff71c0cbc00 2023-10-08T16:09:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff71a7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff71c0b1220 0x7ff71c0cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55056/0 (socket says 172.21.15.60:55056) 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff71a7fc700 1 -- 172.21.15.60:0/3146249401 learned_addr learned my addr 172.21.15.60:0/3146249401 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff71b7fe700 1 --2- 172.21.15.60:0/3146249401 >> v2:172.21.15.144:3300/0 conn(0x7ff71c0cbc00 0x7ff71c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285065410 0 0) 0x7ff71c15de60 con 0x7ff71c0b1220 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff708003570 con 0x7ff71c0b1220 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559217110 0 0) 0x7ff71c15e140 con 0x7ff71c0b0e50 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff71c15de60 con 0x7ff71c0b0e50 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3812885831 0 0) 0x7ff708003570 con 0x7ff71c0b1220 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff71b7fe700 1 -- 172.21.15.60:0/3146249401 >> v1:172.21.15.144:6789/0 conn(0x7ff71c0b0e50 legacy=0x7ff71c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff71b7fe700 1 -- 172.21.15.60:0/3146249401 >> v1:172.21.15.60:6789/0 conn(0x7ff71c0b1220 legacy=0x7ff71c0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.908+0000 7ff71b7fe700 1 -- 172.21.15.60:0/3146249401 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c15e700 con 0x7ff71c0cbc00 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff71b7fe700 1 --2- 172.21.15.60:0/3146249401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0cbc00 0x7ff71c0c9180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7140098e0 tx=0x7ff7140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c98c8156a8d005bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704001470 con 0x7ff71c0cbc00 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714011420 con 0x7ff71c0cbc00 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff719ffb700 1 -- 172.21.15.60:0/3146249401 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7140117a0 con 0x7ff71c0cbc00 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 -- 172.21.15.60:0/3146249401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0cbc00 msgr2=0x7ff71c0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 --2- 172.21.15.60:0/3146249401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0cbc00 0x7ff71c0c9180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7140098e0 tx=0x7ff7140091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 -- 172.21.15.60:0/3146249401 shutdown_connections 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 --2- 172.21.15.60:0/3146249401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0cbc00 0x7ff71c0c9180 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 -- 172.21.15.60:0/3146249401 >> 172.21.15.60:0/3146249401 conn(0x7ff71c069870 msgr2=0x7ff71c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 -- 172.21.15.60:0/3146249401 shutdown_connections 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.909+0000 7ff72144d700 1 -- 172.21.15.60:0/3146249401 wait complete. 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 Processor -- start 2023-10-08T16:09:51.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 -- start start 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 0x7ff71c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0b1220 0x7ff71c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff71c0cbc00 0x7ff71c0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c15db30 con 0x7ff71c0b0e50 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0b3520 con 0x7ff71c0b1220 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.911+0000 7ff72144d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c154c70 con 0x7ff71c0cbc00 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 0x7ff71c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 0x7ff71c15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35688/0 (socket says 172.21.15.60:35688) 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 -- 172.21.15.60:0/1798140999 learned_addr learned my addr 172.21.15.60:0/1798140999 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71a7fc700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0b1220 0x7ff71c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71b7fe700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff71c0cbc00 0x7ff71c0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 -- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff71c0cbc00 msgr2=0x7ff71c0c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff71c0cbc00 0x7ff71c0c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 -- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0b1220 msgr2=0x7ff71c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0b1220 0x7ff71c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 -- 172.21.15.60:0/1798140999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff714009420 con 0x7ff71c0b0e50 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff71affd700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 0x7ff71c15a4e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00cb10 tx=0x7ff70c002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00ce20 con 0x7ff71c0b0e50 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00a7e0 con 0x7ff71c0b0e50 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0b2910 con 0x7ff71c0b0e50 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00ab80 con 0x7ff71c0b0e50 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.912+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c0b2ed0 con 0x7ff71c0b0e50 2023-10-08T16:09:51.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.913+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c04c3c0 con 0x7ff71c0b0e50 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.914+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff70c012420 con 0x7ff71c0b0e50 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.914+0000 7ff712ffd700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff6fc066f30 0x7ff6fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.914+0000 7ff71a7fc700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff6fc066f30 0x7ff6fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.914+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff70c0844c0 con 0x7ff71c0b0e50 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.915+0000 7ff71a7fc700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff6fc066f30 0x7ff6fc0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0b0ce0 tx=0x7ff704000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:50.918+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff70c051a30 con 0x7ff71c0b0e50 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.192+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7ff71c068b60 con 0x7ff71c0b0e50 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.422+0000 7ff712ffd700 1 -- 172.21.15.60:0/1798140999 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v247) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff70c055050 con 0x7ff71c0b0e50 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff6fc066f30 msgr2=0x7ff6fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff6fc066f30 0x7ff6fc0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0b0ce0 tx=0x7ff704000bc0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 msgr2=0x7ff71c15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 0x7ff71c15a4e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00cb10 tx=0x7ff70c002820 comp rx=0 tx=0).stop 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 shutdown_connections 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff6fc066f30 0x7ff6fc0693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff71c0cbc00 0x7ff71c0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71c0b0e50 0x7ff71c15a4e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 --2- 172.21.15.60:0/1798140999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff71c0b1220 0x7ff71c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.424+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 >> 172.21.15.60:0/1798140999 conn(0x7ff71c069870 msgr2=0x7ff71c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.425+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 shutdown_connections 2023-10-08T16:09:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.425+0000 7ff72144d700 1 -- 172.21.15.60:0/1798140999 wait complete. 2023-10-08T16:09:51.578 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-08T16:09:51.579 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T16:09:51.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-08T16:09:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.700+0000 7f4d32fdb700 1 Processor -- start 2023-10-08T16:09:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.700+0000 7f4d32fdb700 1 -- start start 2023-10-08T16:09:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d32fdb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 0x7f4d2c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d32fdb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d2c15a620 0x7f4d2c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d32fdb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c15cbb0 con 0x7f4d2c15d580 2023-10-08T16:09:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d32fdb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c15bfa0 con 0x7f4d2c15a620 2023-10-08T16:09:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d32fdb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15c280 con 0x7f4d2c157870 2023-10-08T16:09:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d30d77700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 0x7f4d2c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d2c15a620 0x7f4d2c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d2c15a620 0x7f4d2c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:43848/0 (socket says 172.21.15.60:43848) 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d31578700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4d2c15d580 0x7f4d2c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:45290/0 (socket says 172.21.15.60:45290) 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d30d77700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 0x7f4d2c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:48238/0 (socket says 172.21.15.60:48238) 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 -- 172.21.15.60:0/1134851908 learned_addr learned my addr 172.21.15.60:0/1134851908 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 -- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 msgr2=0x7f4d2c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 --2- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 0x7f4d2c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 -- 172.21.15.60:0/1134851908 >> v1:172.21.15.144:6789/0 conn(0x7f4d2c15d580 legacy=0x7f4d2c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d2bfff700 1 -- 172.21.15.60:0/1134851908 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c15c560 con 0x7f4d2c15a620 2023-10-08T16:09:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.701+0000 7f4d30d77700 1 --2- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 0x7f4d2c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:51.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d2bfff700 1 --2- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c15a620 0x7f4d2c15d040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0099b0 tx=0x7f4d1c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2abea40be90e3e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:51.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d2b7fe700 1 -- 172.21.15.60:0/1134851908 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c009ea0 con 0x7f4d2c15a620 2023-10-08T16:09:51.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d2b7fe700 1 -- 172.21.15.60:0/1134851908 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00b860 con 0x7f4d2c15a620 2023-10-08T16:09:51.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d2b7fe700 1 -- 172.21.15.60:0/1134851908 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00bc00 con 0x7f4d2c15a620 2023-10-08T16:09:51.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 -- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c15a620 msgr2=0x7f4d2c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c15a620 0x7f4d2c15d040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0099b0 tx=0x7f4d1c009250 comp rx=0 tx=0).stop 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 -- 172.21.15.60:0/1134851908 shutdown_connections 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c157870 0x7f4d2c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/1134851908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c15a620 0x7f4d2c15d040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 -- 172.21.15.60:0/1134851908 >> 172.21.15.60:0/1134851908 conn(0x7f4d2c068ce0 msgr2=0x7f4d2c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 -- 172.21.15.60:0/1134851908 shutdown_connections 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.702+0000 7f4d32fdb700 1 -- 172.21.15.60:0/1134851908 wait complete. 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.704+0000 7f4d32fdb700 1 Processor -- start 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.704+0000 7f4d32fdb700 1 -- start start 2023-10-08T16:09:51.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.704+0000 7f4d32fdb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c157870 0x7f4d2c0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.704+0000 7f4d32fdb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c15a620 0x7f4d2c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.704+0000 7f4d32fdb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 0x7f4d2c16e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.704+0000 7f4d32fdb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0ca190 con 0x7f4d2c15d580 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d32fdb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c16acb0 con 0x7f4d2c157870 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d32fdb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c16af90 con 0x7f4d2c15a620 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 0x7f4d2c16e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 0x7f4d2c16e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35698/0 (socket says 172.21.15.60:35698) 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 -- 172.21.15.60:0/3790564228 learned_addr learned my addr 172.21.15.60:0/3790564228 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d30d77700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c157870 0x7f4d2c0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d2bfff700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c15a620 0x7f4d2c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 -- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c15a620 msgr2=0x7f4d2c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c15a620 0x7f4d2c0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 -- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c157870 msgr2=0x7f4d2c0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c157870 0x7f4d2c0b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 -- 172.21.15.60:0/3790564228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14009420 con 0x7f4d2c15d580 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d31578700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 0x7f4d2c16e1e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400cc70 tx=0x7f4d24001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24005df0 con 0x7f4d2c15d580 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400a640 con 0x7f4d2c15d580 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0094f0 con 0x7f4d2c15d580 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400aa00 con 0x7f4d2c15d580 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.705+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c16b550 con 0x7f4d2c15d580 2023-10-08T16:09:51.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.706+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c04c3c0 con 0x7f4d2c15d580 2023-10-08T16:09:51.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.707+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d240070f0 con 0x7f4d2c15d580 2023-10-08T16:09:51.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.707+0000 7f4d28ff9700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d0c066f30 0x7f4d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:51.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.707+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4d240840b0 con 0x7f4d2c15d580 2023-10-08T16:09:51.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.707+0000 7f4d30d77700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d0c066f30 0x7f4d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:51.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.708+0000 7f4d30d77700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d0c066f30 0x7f4d0c0693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009f40 tx=0x7f4d140091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:51.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.712+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d24051750 con 0x7f4d2c15d580 2023-10-08T16:09:51.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:51.987+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f4d2c15c840 con 0x7f4d2c15d580 2023-10-08T16:09:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.425+0000 7f4d28ff9700 1 -- 172.21.15.60:0/3790564228 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v248) v1 ==== 140+0+0 (secure 0 0 0) 0x7f4d24054d70 con 0x7f4d2c15d580 2023-10-08T16:09:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d0c066f30 msgr2=0x7f4d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d0c066f30 0x7f4d0c0693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009f40 tx=0x7f4d140091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 msgr2=0x7f4d2c16e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 0x7f4d2c16e1e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400cc70 tx=0x7f4d24001a40 comp rx=0 tx=0).stop 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 shutdown_connections 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4d0c066f30 0x7f4d0c0693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d2c15d580 0x7f4d2c16e1e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d2c157870 0x7f4d2c0b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 --2- 172.21.15.60:0/3790564228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d2c15a620 0x7f4d2c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 >> 172.21.15.60:0/3790564228 conn(0x7f4d2c068ce0 msgr2=0x7f4d2c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 shutdown_connections 2023-10-08T16:09:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.428+0000 7f4d32fdb700 1 -- 172.21.15.60:0/3790564228 wait complete. 2023-10-08T16:09:52.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T16:09:52.638 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_objectstore":"memstore"} 2023-10-08T16:09:52.645 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T16:09:52.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:09:52.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.768+0000 7f5315c2b700 1 Processor -- start 2023-10-08T16:09:52.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.768+0000 7f5315c2b700 1 -- start start 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f5315c2b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53100678b0 0x7f531015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f5315c2b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53100cae70 con 0x7f53100c9390 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f5315c2b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53100cb150 con 0x7f53100cbf10 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f5315c2b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53100cb430 con 0x7f53100678b0 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f53100c9390 0x7f531015a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34438/0 (socket says 172.21.15.60:34438) 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530ffff700 1 -- 172.21.15.60:0/3500377664 learned_addr learned my addr 172.21.15.60:0/3500377664 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530f7fe700 1 --2- 172.21.15.60:0/3500377664 >> v2:172.21.15.144:3300/0 conn(0x7f53100678b0 0x7f531015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:52.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375871100 0 0) 0x7f53100cae70 con 0x7f53100c9390 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc003570 con 0x7f53100c9390 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406685946 0 0) 0x7f53100cb150 con 0x7f53100cbf10 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53100cae70 con 0x7f53100cbf10 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842571711 0 0) 0x7f52fc003570 con 0x7f53100c9390 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530f7fe700 1 -- 172.21.15.60:0/3500377664 >> v1:172.21.15.144:6789/0 conn(0x7f53100cbf10 legacy=0x7f531015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530f7fe700 1 -- 172.21.15.60:0/3500377664 >> v1:172.21.15.60:6789/0 conn(0x7f53100c9390 legacy=0x7f531015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.769+0000 7f530f7fe700 1 -- 172.21.15.60:0/3500377664 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100cb710 con 0x7f53100678b0 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f530f7fe700 1 --2- 172.21.15.60:0/3500377664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100678b0 0x7f531015db80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5300009e60 tx=0x7f5300009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c43f0a957ca6e981 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:52.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000e070 con 0x7f53100678b0 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000b7a0 con 0x7f53100678b0 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f530e7fc700 1 -- 172.21.15.60:0/3500377664 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308001470 con 0x7f53100678b0 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 -- 172.21.15.60:0/3500377664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100678b0 msgr2=0x7f531015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 --2- 172.21.15.60:0/3500377664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100678b0 0x7f531015db80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5300009e60 tx=0x7f5300009780 comp rx=0 tx=0).stop 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 -- 172.21.15.60:0/3500377664 shutdown_connections 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 --2- 172.21.15.60:0/3500377664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100678b0 0x7f531015db80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 -- 172.21.15.60:0/3500377664 >> 172.21.15.60:0/3500377664 conn(0x7f5310069870 msgr2=0x7f5310069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 -- 172.21.15.60:0/3500377664 shutdown_connections 2023-10-08T16:09:52.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.770+0000 7f5315c2b700 1 -- 172.21.15.60:0/3500377664 wait complete. 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 Processor -- start 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 -- start start 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53100678b0 0x7f5310150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100c9390 0x7f53100b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 0x7f53100ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531016ab50 con 0x7f53100cbf10 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5310169f60 con 0x7f53100c9390 2023-10-08T16:09:52.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f5315c2b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531016a220 con 0x7f53100678b0 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f530ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 0x7f53100ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.772+0000 7f530ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 0x7f53100ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39336/0 (socket says 172.21.15.60:39336) 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 -- 172.21.15.60:0/642869035 learned_addr learned my addr 172.21.15.60:0/642869035 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530f7fe700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53100678b0 0x7f5310150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530effd700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100c9390 0x7f53100b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 -- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53100678b0 msgr2=0x7f5310150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53100678b0 0x7f5310150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 -- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100c9390 msgr2=0x7f53100b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100c9390 0x7f53100b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 -- 172.21.15.60:0/642869035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300009a20 con 0x7f53100cbf10 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f530ffff700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 0x7f53100ce540 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f530800cb70 tx=0x7f5308001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:52.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308007150 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080072d0 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531016a500 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308007690 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.773+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5310150da0 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.774+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531016ad00 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.775+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5308004a40 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.775+0000 7f53077fe700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f0066f30 0x7f52f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.775+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5308083900 con 0x7f53100cbf10 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.776+0000 7f530f7fe700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f0066f30 0x7f52f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:52.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.776+0000 7f530f7fe700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f0066f30 0x7f52f00693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f53000099f0 tx=0x7f5300017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:52.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.779+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53080548e0 con 0x7f53100cbf10 2023-10-08T16:09:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.973+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f531004c3c0 con 0x7f53100cbf10 2023-10-08T16:09:52.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.977+0000 7f53077fe700 1 -- 172.21.15.60:0/642869035 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5308018020 con 0x7f53100cbf10 2023-10-08T16:09:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f0066f30 msgr2=0x7f52f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f0066f30 0x7f52f00693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f53000099f0 tx=0x7f5300017000 comp rx=0 tx=0).stop 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 msgr2=0x7f53100ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 0x7f53100ce540 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f530800cb70 tx=0x7f5308001ad0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 shutdown_connections 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f52f0066f30 0x7f52f00693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53100678b0 0x7f5310150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100cbf10 0x7f53100ce540 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 --2- 172.21.15.60:0/642869035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53100c9390 0x7f53100b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 >> 172.21.15.60:0/642869035 conn(0x7f5310069870 msgr2=0x7f53100b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 shutdown_connections 2023-10-08T16:09:52.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:52.979+0000 7f5315c2b700 1 -- 172.21.15.60:0/642869035 wait complete. 2023-10-08T16:09:52.992 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:09:52.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:09:53.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:09:53.075 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:09:53.114 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:09:53.114 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.232+0000 7f70e8ad9700 1 Processor -- start 2023-10-08T16:09:53.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.232+0000 7f70e8ad9700 1 -- start start 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e8ad9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70e41523e0 0x7f70e406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e8ad9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 0x7f70e40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e8ad9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e406c010 con 0x7f70e4152010 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e8ad9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e406bd10 con 0x7f70e41523e0 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e8ad9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415c060 con 0x7f70e4158e50 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e259c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f70e4152010 0x7f70e415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34452/0 (socket says 172.21.15.60:34452) 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.233+0000 7f70e259c700 1 -- 172.21.15.60:0/2714398341 learned_addr learned my addr 172.21.15.60:0/2714398341 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:53.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/2714398341 >> v2:172.21.15.144:3300/0 conn(0x7f70e41523e0 0x7f70e406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e2d9d700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 0x7f70e40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226351444 0 0) 0x7f70e406c010 con 0x7f70e4152010 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d0003570 con 0x7f70e4152010 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 126367835 0 0) 0x7f70d0003570 con 0x7f70e4152010 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 msgr2=0x7f70e40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 0x7f70e40cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 >> v2:172.21.15.144:3300/0 conn(0x7f70e41523e0 msgr2=0x7f70e406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 --2- 172.21.15.60:0/2714398341 >> v2:172.21.15.144:3300/0 conn(0x7f70e41523e0 0x7f70e406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e415c340 con 0x7f70e4152010 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f70dc001470 con 0x7f70e4152010 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 >> v1:172.21.15.60:6789/0 conn(0x7f70e4152010 legacy=0x7f70e415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 0x7f70d0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70d0004d50 0x7f70d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e406bd10 con 0x7f70d0003fe0 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415c060 con 0x7f70d0004d50 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d000ba90 con 0x7f70e4158e50 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e2d9d700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70d0004d50 0x7f70d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e259c700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 0x7f70d0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 -- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 msgr2=0x7f70d0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e4158e50 0x7f70d0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 -- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70d0004d50 msgr2=0x7f70d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:53.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70d0004d50 0x7f70d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.234+0000 7f70e1d9b700 1 -- 172.21.15.60:0/2714398341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0003570 con 0x7f70d0003fe0 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70d0004810 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009c00 tx=0x7f70cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc18408e083956f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00e6b0 con 0x7f70d0003fe0 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00e810 con 0x7f70d0003fe0 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e159a700 1 -- 172.21.15.60:0/2714398341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00ebd0 con 0x7f70d0003fe0 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e8ad9700 1 -- 172.21.15.60:0/2714398341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 msgr2=0x7f70d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/2714398341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70d0004810 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009c00 tx=0x7f70cc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e2d9d700 1 -- 172.21.15.60:0/2714398341 reap_dead start 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e8ad9700 1 -- 172.21.15.60:0/2714398341 shutdown_connections 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e8ad9700 1 -- 172.21.15.60:0/2714398341 >> 172.21.15.60:0/2714398341 conn(0x7f70e4069870 msgr2=0x7f70e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e8ad9700 1 -- 172.21.15.60:0/2714398341 shutdown_connections 2023-10-08T16:09:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.235+0000 7f70e8ad9700 1 -- 172.21.15.60:0/2714398341 wait complete. 2023-10-08T16:09:53.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 Processor -- start 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 -- start start 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70e414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e40b3fd0 0x7f70e40b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e40c68a0 0x7f70e40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c7240 con 0x7f70d0003fe0 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415e760 con 0x7f70e40b3fd0 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e8ad9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415db50 con 0x7f70e40c68a0 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.237+0000 7f70e259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70e414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70e414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39366/0 (socket says 172.21.15.60:39366) 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 -- 172.21.15.60:0/92498335 learned_addr learned my addr 172.21.15.60:0/92498335 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:53.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e2d9d700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e40c68a0 0x7f70e40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e40b3fd0 0x7f70e40b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 -- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e40c68a0 msgr2=0x7f70e40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e40c68a0 0x7f70e40c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 -- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e40b3fd0 msgr2=0x7f70e40b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e40b3fd0 0x7f70e40b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 -- 172.21.15.60:0/92498335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e415de30 con 0x7f70d0003fe0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e40b3fd0 0x7f70e40b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e259c700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70e414dfe0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000fd0 tx=0x7f70e406bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc018030 con 0x7f70d0003fe0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00f8d0 con 0x7f70d0003fe0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e415e110 con 0x7f70d0003fe0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00fc70 con 0x7f70d0003fe0 2023-10-08T16:09:53.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.238+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e414e520 con 0x7f70d0003fe0 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.239+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e415e5b0 con 0x7f70d0003fe0 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.239+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70dc01b070 con 0x7f70d0003fe0 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.240+0000 7f70da7fc700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f70c4066f30 0x7f70c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.240+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f70dc019070 con 0x7f70d0003fe0 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.240+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f70c4066f30 0x7f70c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.240+0000 7f70e1d9b700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f70c4066f30 0x7f70c40693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f70cc006ed0 tx=0x7f70cc01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.244+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70dc051890 con 0x7f70d0003fe0 2023-10-08T16:09:53.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.480+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70e404c3c0 con 0x7f70d0003fe0 2023-10-08T16:09:53.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.481+0000 7f70da7fc700 1 -- 172.21.15.60:0/92498335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f70dc054eb0 con 0x7f70d0003fe0 2023-10-08T16:09:53.481 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:53.482 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2588476367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2588476367},{"type":"v1","addr":"172.21.15.60:6837","nonce":2588476367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1812488234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1812488234},{"type":"v1","addr":"172.21.15.144:6834","nonce":1812488234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1393062296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1393062296},{"type":"v1","addr":"172.21.15.144:6835","nonce":1393062296}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6324,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1453000191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1453000191},{"type":"v1","addr":"172.21.15.60:6836","nonce":1453000191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[]} 2023-10-08T16:09:53.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f70c4066f30 msgr2=0x7f70c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f70c4066f30 0x7f70c40693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f70cc006ed0 tx=0x7f70cc01a000 comp rx=0 tx=0).stop 2023-10-08T16:09:53.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 msgr2=0x7f70e414dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70e414dfe0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000fd0 tx=0x7f70e406bf80 comp rx=0 tx=0).stop 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 shutdown_connections 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f70c4066f30 0x7f70c40693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70e40c68a0 0x7f70e40c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70d0003fe0 0x7f70e414dfe0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 --2- 172.21.15.60:0/92498335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e40b3fd0 0x7f70e40b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 >> 172.21.15.60:0/92498335 conn(0x7f70e4069870 msgr2=0x7f70e4150600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 shutdown_connections 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.483+0000 7f70e8ad9700 1 -- 172.21.15.60:0/92498335 wait complete. 2023-10-08T16:09:53.484 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 45 2023-10-08T16:09:53.495 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:09:53.496 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:09:53.496 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:09:53.496 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:09:53.496 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:09:53.496 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:09:53.496 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:09:53.497 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:09:53.497 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:09:53.497 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:09:53.497 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:09:53.497 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:09:53.497 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:09:53.497 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:09:53.498 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:09:53.498 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:09:53.505 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:09:53.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:09:53.505 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:09:53.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:09:53.508 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:09:53.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:09:53.509 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:09:53.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:09:53.547 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:09:53.547 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:53.548 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:09:53.548 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:53.550 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:09:53.550 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:53.551 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:09:53.551 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:53.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:09:53.623 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:09:53.624 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:09:53.629 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:09:53.629 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:09:53.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.676+0000 7f59cd029700 1 Processor -- start 2023-10-08T16:09:53.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.676+0000 7f59cd029700 1 -- start start 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59cd029700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 0x7f59c8063d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59cd029700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59c80af650 0x7f59c80b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59cd029700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80b2150 con 0x7f59c80af280 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59cd029700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c815a2c0 con 0x7f59c80af650 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59cd029700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b1540 con 0x7f59c806aa20 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 0x7f59c8063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59cc828700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59c80af650 0x7f59c80b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 0x7f59c8063d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:34574/0 (socket says 172.21.15.60:34574) 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c77fe700 1 -- 172.21.15.60:0/3991274714 learned_addr learned my addr 172.21.15.60:0/3991274714 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c7fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f59c80af280 0x7f59c806a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:48108/0 (socket says 172.21.15.60:48108) 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c77fe700 1 -- 172.21.15.60:0/3991274714 >> v2:172.21.15.144:3300/0 conn(0x7f59c80af650 msgr2=0x7f59c80b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c77fe700 1 --2- 172.21.15.60:0/3991274714 >> v2:172.21.15.144:3300/0 conn(0x7f59c80af650 0x7f59c80b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.677+0000 7f59c77fe700 1 -- 172.21.15.60:0/3991274714 >> v1:172.21.15.144:6789/0 conn(0x7f59c80af280 legacy=0x7f59c806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59c77fe700 1 -- 172.21.15.60:0/3991274714 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80b1820 con 0x7f59c806aa20 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59c6ffd700 1 -- 172.21.15.60:0/3991274714 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134007895 0 0) 0x7f59c80b2150 con 0x7f59c80af280 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cc828700 1 --2- 172.21.15.60:0/3991274714 >> v2:172.21.15.144:3300/0 conn(0x7f59c80af650 0x7f59c80b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59c77fe700 1 --2- 172.21.15.60:0/3991274714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 0x7f59c8063d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59b80099b0 tx=0x7f59b8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f8d979a1384515e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59c6ffd700 1 -- 172.21.15.60:0/3991274714 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8009ea0 con 0x7f59c806aa20 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59c6ffd700 1 -- 172.21.15.60:0/3991274714 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800b860 con 0x7f59c806aa20 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59c6ffd700 1 -- 172.21.15.60:0/3991274714 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800bc00 con 0x7f59c806aa20 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 -- 172.21.15.60:0/3991274714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 msgr2=0x7f59c8063d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 --2- 172.21.15.60:0/3991274714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 0x7f59c8063d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59b80099b0 tx=0x7f59b8009250 comp rx=0 tx=0).stop 2023-10-08T16:09:53.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 -- 172.21.15.60:0/3991274714 shutdown_connections 2023-10-08T16:09:53.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 --2- 172.21.15.60:0/3991274714 >> v2:172.21.15.144:3300/0 conn(0x7f59c80af650 0x7f59c80b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 --2- 172.21.15.60:0/3991274714 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c806aa20 0x7f59c8063d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 -- 172.21.15.60:0/3991274714 >> 172.21.15.60:0/3991274714 conn(0x7f59c80cd010 msgr2=0x7f59c80cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:53.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.678+0000 7f59cd029700 1 -- 172.21.15.60:0/3991274714 shutdown_connections 2023-10-08T16:09:53.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.679+0000 7f59cd029700 1 -- 172.21.15.60:0/3991274714 wait complete. 2023-10-08T16:09:53.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.680+0000 7f59cd029700 1 Processor -- start 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.680+0000 7f59cd029700 1 -- start start 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.680+0000 7f59cd029700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59c806aa20 0x7f59c816cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.680+0000 7f59cd029700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 0x7f59c815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.680+0000 7f59cd029700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c80af650 0x7f59c80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cd029700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815ca30 con 0x7f59c806aa20 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cd029700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815be20 con 0x7f59c80af280 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cd029700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815c100 con 0x7f59c80af650 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59c77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 0x7f59c815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c80af650 0x7f59c80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59c77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 0x7f59c815b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:48130/0 (socket says 172.21.15.60:48130) 2023-10-08T16:09:53.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59c77fe700 1 -- 172.21.15.60:0/299181506 learned_addr learned my addr 172.21.15.60:0/299181506 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59c7fff700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59c806aa20 0x7f59c816cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 -- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 msgr2=0x7f59c815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 0x7f59c815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 -- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59c806aa20 msgr2=0x7f59c816cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59c806aa20 0x7f59c816cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 -- 172.21.15.60:0/299181506 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c0009a20 con 0x7f59c80af650 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59c77fe700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 0x7f59c815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59c7fff700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59c806aa20 0x7f59c816cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59cc828700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c80af650 0x7f59c80c49a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e70 tx=0x7f59c000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.681+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000cb50 con 0x7f59c80af650 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.682+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000f040 con 0x7f59c80af650 2023-10-08T16:09:53.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.682+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0014480 con 0x7f59c80af650 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.682+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80094f0 con 0x7f59c80af650 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.682+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c815c6c0 con 0x7f59c80af650 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.682+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c815cba0 con 0x7f59c80af650 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.683+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59c0003020 con 0x7f59c80af650 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.683+0000 7f59affff700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59b4066f30 0x7f59b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.683+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59c0084a70 con 0x7f59c80af650 2023-10-08T16:09:53.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.683+0000 7f59c7fff700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59b4066f30 0x7f59b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.684+0000 7f59c7fff700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59b4066f30 0x7f59b40693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f59c80cc8e0 tx=0x7f59bc007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.688+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59c0051fe0 con 0x7f59c80af650 2023-10-08T16:09:53.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:53.895+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f59c80ad820 con 0x7f59c80af650 2023-10-08T16:09:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.446+0000 7f59affff700 1 -- 172.21.15.60:0/299181506 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f59c0055600 con 0x7f59c80af650 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59b4066f30 msgr2=0x7f59b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59b4066f30 0x7f59b40693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f59c80cc8e0 tx=0x7f59bc007cb0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c80af650 msgr2=0x7f59c80c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c80af650 0x7f59c80c49a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e70 tx=0x7f59c000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 shutdown_connections 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f59b4066f30 0x7f59b40693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59c80af650 0x7f59c80c49a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59c806aa20 0x7f59c816cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 --2- 172.21.15.60:0/299181506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59c80af280 0x7f59c815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 >> 172.21.15.60:0/299181506 conn(0x7f59c80cd010 msgr2=0x7f59c8159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 shutdown_connections 2023-10-08T16:09:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.448+0000 7f59cd029700 1 -- 172.21.15.60:0/299181506 wait complete. 2023-10-08T16:09:54.450 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:09:54.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:09:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.582+0000 7f95436cd700 1 Processor -- start 2023-10-08T16:09:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.582+0000 7f95436cd700 1 -- start start 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f95436cd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f953c0b0890 0x7f953c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f95436cd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c0cb370 con 0x7f953c0cbd40 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f95436cd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c0b0c60 con 0x7f953c067d70 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f95436cd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953c06a1e0 con 0x7f953c0b0890 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f9540c68700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f953c0cbd40 0x7f953c067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34474/0 (socket says 172.21.15.60:34474) 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f9540c68700 1 -- 172.21.15.60:0/3583899844 learned_addr learned my addr 172.21.15.60:0/3583899844 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f9541469700 1 --2- 172.21.15.60:0/3583899844 >> v2:172.21.15.144:3300/0 conn(0x7f953c0b0890 0x7f953c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058984014 0 0) 0x7f953c0cb370 con 0x7f953c0cbd40 2023-10-08T16:09:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9524003570 con 0x7f953c0cbd40 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203025181 0 0) 0x7f953c0b0c60 con 0x7f953c067d70 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f953c0cb370 con 0x7f953c067d70 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630399654 0 0) 0x7f9524003570 con 0x7f953c0cbd40 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f9541469700 1 -- 172.21.15.60:0/3583899844 >> v1:172.21.15.144:6789/0 conn(0x7f953c067d70 legacy=0x7f953c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f9541469700 1 -- 172.21.15.60:0/3583899844 >> v1:172.21.15.60:6789/0 conn(0x7f953c0cbd40 legacy=0x7f953c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.583+0000 7f9541469700 1 -- 172.21.15.60:0/3583899844 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c06cb80 con 0x7f953c0b0890 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f9541469700 1 --2- 172.21.15.60:0/3583899844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c0cb800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95340098e0 tx=0x7f95340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6bafb7260bbc3c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530001470 con 0x7f953c0b0890 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534011420 con 0x7f953c0b0890 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f953bfff700 1 -- 172.21.15.60:0/3583899844 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95340117c0 con 0x7f953c0b0890 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 -- 172.21.15.60:0/3583899844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 msgr2=0x7f953c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 --2- 172.21.15.60:0/3583899844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c0cb800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95340098e0 tx=0x7f95340091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 -- 172.21.15.60:0/3583899844 shutdown_connections 2023-10-08T16:09:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 --2- 172.21.15.60:0/3583899844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c0cb800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 -- 172.21.15.60:0/3583899844 >> 172.21.15.60:0/3583899844 conn(0x7f953c06fe50 msgr2=0x7f953c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 -- 172.21.15.60:0/3583899844 shutdown_connections 2023-10-08T16:09:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.584+0000 7f95436cd700 1 -- 172.21.15.60:0/3583899844 wait complete. 2023-10-08T16:09:54.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.585+0000 7f95436cd700 1 Processor -- start 2023-10-08T16:09:54.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 -- start start 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 0x7f953c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f953c0cbd40 0x7f953c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c15ab10 con 0x7f953c067d70 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0b3590 con 0x7f953c0b0890 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f95436cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0c6970 con 0x7f953c0cbd40 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.586+0000 7f9541469700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 0x7f953c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 0x7f953c0af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39404/0 (socket says 172.21.15.60:39404) 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 -- 172.21.15.60:0/2272629710 learned_addr learned my addr 172.21.15.60:0/2272629710 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541c6a700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f953c0cbd40 0x7f953c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9540c68700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 -- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f953c0cbd40 msgr2=0x7f953c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f953c0cbd40 0x7f953c0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 -- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 msgr2=0x7f953c15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c15a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 -- 172.21.15.60:0/2272629710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9534009420 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f9541469700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 0x7f953c0af4a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f953c06ab60 tx=0x7f9534016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953401cb30 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953401cc90 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c0b37c0 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953401a6a0 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.587+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c0b3d80 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.588+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c04c3c0 con 0x7f953c067d70 2023-10-08T16:09:54.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.589+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f953401aa10 con 0x7f953c067d70 2023-10-08T16:09:54.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.589+0000 7f95397fa700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9528066f30 0x7f95280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:54.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.589+0000 7f9540c68700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9528066f30 0x7f95280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:54.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.589+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9534085870 con 0x7f953c067d70 2023-10-08T16:09:54.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.590+0000 7f9540c68700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9528066f30 0x7f95280693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f953c0cded0 tx=0x7f9530000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:54.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.594+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9534052d90 con 0x7f953c067d70 2023-10-08T16:09:54.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.866+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f953c06cdc0 con 0x7f953c067d70 2023-10-08T16:09:54.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.867+0000 7f95397fa700 1 -- 172.21.15.60:0/2272629710 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f95340563b0 con 0x7f953c067d70 2023-10-08T16:09:54.867 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:09:54.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:09:54.871 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:09:54.876 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:09:54.879 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:09:54.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:09:54.882 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:09:54.883 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9528066f30 msgr2=0x7f95280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9528066f30 0x7f95280693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f953c0cded0 tx=0x7f9530000bc0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 msgr2=0x7f953c0af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 0x7f953c0af4a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f953c06ab60 tx=0x7f9534016000 comp rx=0 tx=0).stop 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 shutdown_connections 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9528066f30 0x7f95280693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f953c0cbd40 0x7f953c0b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c067d70 0x7f953c0af4a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 --2- 172.21.15.60:0/2272629710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953c0b0890 0x7f953c15a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 >> 172.21.15.60:0/2272629710 conn(0x7f953c06fe50 msgr2=0x7f953c0cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 shutdown_connections 2023-10-08T16:09:54.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:54.869+0000 7f95436cd700 1 -- 172.21.15.60:0/2272629710 wait complete. 2023-10-08T16:09:54.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.004+0000 7f5e087bb700 1 Processor -- start 2023-10-08T16:09:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.004+0000 7f5e087bb700 1 -- start start 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e087bb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e00157870 0x7f5e0015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e087bb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e00157c40 0x7f5e00158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e087bb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0015cbb0 con 0x7f5e0015a620 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e087bb700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0015bfa0 con 0x7f5e00157870 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e087bb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0015c280 con 0x7f5e00157c40 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e06557700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e00157870 0x7f5e0015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e06557700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e00157870 0x7f5e0015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39408/0 (socket says 172.21.15.60:39408) 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.005+0000 7f5e06557700 1 -- 172.21.15.60:0/626111587 learned_addr learned my addr 172.21.15.60:0/626111587 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06d58700 1 --2- 172.21.15.60:0/626111587 >> v2:172.21.15.144:3300/0 conn(0x7f5e00157c40 0x7f5e00158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06557700 1 -- 172.21.15.60:0/626111587 >> v2:172.21.15.144:3300/0 conn(0x7f5e00157c40 msgr2=0x7f5e00158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06557700 1 --2- 172.21.15.60:0/626111587 >> v2:172.21.15.144:3300/0 conn(0x7f5e00157c40 0x7f5e00158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06557700 1 -- 172.21.15.60:0/626111587 >> v1:172.21.15.144:6789/0 conn(0x7f5e0015a620 legacy=0x7f5e0015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06557700 1 -- 172.21.15.60:0/626111587 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0015c560 con 0x7f5e00157870 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06d58700 1 --2- 172.21.15.60:0/626111587 >> v2:172.21.15.144:3300/0 conn(0x7f5e00157c40 0x7f5e00158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e06557700 1 --2- 172.21.15.60:0/626111587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0015b6a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5e0006b4e0 tx=0x7f5df8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b108283c58fa392 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e05555700 1 -- 172.21.15.60:0/626111587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800e070 con 0x7f5e00157870 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e05555700 1 -- 172.21.15.60:0/626111587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df800ba10 con 0x7f5e00157870 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e05555700 1 -- 172.21.15.60:0/626111587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80092e0 con 0x7f5e00157870 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e087bb700 1 -- 172.21.15.60:0/626111587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 msgr2=0x7f5e0015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.006+0000 7f5e087bb700 1 --2- 172.21.15.60:0/626111587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0015b6a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5e0006b4e0 tx=0x7f5df8009840 comp rx=0 tx=0).stop 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.007+0000 7f5e087bb700 1 -- 172.21.15.60:0/626111587 shutdown_connections 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.007+0000 7f5e087bb700 1 --2- 172.21.15.60:0/626111587 >> v2:172.21.15.144:3300/0 conn(0x7f5e00157c40 0x7f5e00158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.007+0000 7f5e087bb700 1 --2- 172.21.15.60:0/626111587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0015b6a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.007+0000 7f5e087bb700 1 -- 172.21.15.60:0/626111587 >> 172.21.15.60:0/626111587 conn(0x7f5e00068ce0 msgr2=0x7f5e000690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.007+0000 7f5e087bb700 1 -- 172.21.15.60:0/626111587 shutdown_connections 2023-10-08T16:09:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.007+0000 7f5e087bb700 1 -- 172.21.15.60:0/626111587 wait complete. 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 Processor -- start 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 -- start start 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e00157c40 0x7f5e00151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0015a620 0x7f5e001536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001550c0 con 0x7f5e00157870 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00155ec0 con 0x7f5e00157c40 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.008+0000 7f5e087bb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001552b0 con 0x7f5e0015a620 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0014d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39418/0 (socket says 172.21.15.60:39418) 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 -- 172.21.15.60:0/340081122 learned_addr learned my addr 172.21.15.60:0/340081122 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e05d56700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e00157c40 0x7f5e00151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06d58700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0015a620 0x7f5e001536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 -- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0015a620 msgr2=0x7f5e001536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0015a620 0x7f5e001536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 -- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e00157c40 msgr2=0x7f5e00151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e00157c40 0x7f5e00151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 -- 172.21.15.60:0/340081122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df8009ae0 con 0x7f5e00157870 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e06557700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0014d5a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009fd0 tx=0x7f5df8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80094e0 con 0x7f5e00157870 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df80128d0 con 0x7f5e00157870 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e00155590 con 0x7f5e00157870 2023-10-08T16:09:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8012cb0 con 0x7f5e00157870 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.009+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e00155b50 con 0x7f5e00157870 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.010+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0004c3c0 con 0x7f5e00157870 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.011+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5df801d630 con 0x7f5e00157870 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.011+0000 7f5dfe7fc700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5dec066f30 0x7f5dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.011+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5df80857c0 con 0x7f5e00157870 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.011+0000 7f5e05d56700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5dec066f30 0x7f5dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.011+0000 7f5e05d56700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5dec066f30 0x7f5dec0693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e00153400 tx=0x7f5df4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.015+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5df8052d80 con 0x7f5e00157870 2023-10-08T16:09:55.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.209+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e0015c840 con 0x7f5e00157870 2023-10-08T16:09:55.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.210+0000 7f5dfe7fc700 1 -- 172.21.15.60:0/340081122 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f5df80563a0 con 0x7f5e00157870 2023-10-08T16:09:55.210 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:55.210 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:54.450960+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5dec066f30 msgr2=0x7f5dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5dec066f30 0x7f5dec0693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e00153400 tx=0x7f5df4009060 comp rx=0 tx=0).stop 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 msgr2=0x7f5e0014d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0014d5a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009fd0 tx=0x7f5df8017000 comp rx=0 tx=0).stop 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 shutdown_connections 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5dec066f30 0x7f5dec0693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0015a620 0x7f5e001536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e00157870 0x7f5e0014d5a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 --2- 172.21.15.60:0/340081122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e00157c40 0x7f5e00151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 >> 172.21.15.60:0/340081122 conn(0x7f5e00068ce0 msgr2=0x7f5e000690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 shutdown_connections 2023-10-08T16:09:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.212+0000 7f5e087bb700 1 -- 172.21.15.60:0/340081122 wait complete. 2023-10-08T16:09:55.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:09:55.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:55.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.346+0000 7f3b73fca700 1 Processor -- start 2023-10-08T16:09:55.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.347+0000 7f3b73fca700 1 -- start start 2023-10-08T16:09:55.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.347+0000 7f3b73fca700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b6c0b4860 0x7f3b6c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.347+0000 7f3b73fca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b6c0b3570 0x7f3b6c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.347+0000 7f3b73fca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c0b14f0 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.347+0000 7f3b73fca700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c0b17d0 con 0x7f3b6c0b3570 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.347+0000 7f3b73fca700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c0b1ab0 con 0x7f3b6c0b4860 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b6c0b3570 0x7f3b6c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b6c0b3570 0x7f3b6c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39428/0 (socket says 172.21.15.60:39428) 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 -- 172.21.15.60:0/2291285282 learned_addr learned my addr 172.21.15.60:0/2291285282 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b71d66700 1 --2- 172.21.15.60:0/2291285282 >> v2:172.21.15.144:3300/0 conn(0x7f3b6c0b4860 0x7f3b6c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 -- 172.21.15.60:0/2291285282 >> v2:172.21.15.144:3300/0 conn(0x7f3b6c0b4860 msgr2=0x7f3b6c0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 --2- 172.21.15.60:0/2291285282 >> v2:172.21.15.144:3300/0 conn(0x7f3b6c0b4860 0x7f3b6c0b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 -- 172.21.15.60:0/2291285282 >> v1:172.21.15.144:6789/0 conn(0x7f3b6c0b4c30 legacy=0x7f3b6c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 -- 172.21.15.60:0/2291285282 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0b1d90 con 0x7f3b6c0b3570 2023-10-08T16:09:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b72567700 1 --2- 172.21.15.60:0/2291285282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b3570 0x7f3b6c15a1a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0d1e70 tx=0x7f3b5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb13b8ea8b57368d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b70d64700 1 -- 172.21.15.60:0/2291285282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00e070 con 0x7f3b6c0b3570 2023-10-08T16:09:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b70d64700 1 -- 172.21.15.60:0/2291285282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c00bab0 con 0x7f3b6c0b3570 2023-10-08T16:09:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.348+0000 7f3b70d64700 1 -- 172.21.15.60:0/2291285282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0092e0 con 0x7f3b6c0b3570 2023-10-08T16:09:55.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 -- 172.21.15.60:0/2291285282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b3570 msgr2=0x7f3b6c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 --2- 172.21.15.60:0/2291285282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b3570 0x7f3b6c15a1a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0d1e70 tx=0x7f3b5c009840 comp rx=0 tx=0).stop 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 -- 172.21.15.60:0/2291285282 shutdown_connections 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 --2- 172.21.15.60:0/2291285282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b3570 0x7f3b6c15a1a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 --2- 172.21.15.60:0/2291285282 >> v2:172.21.15.144:3300/0 conn(0x7f3b6c0b4860 0x7f3b6c0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 -- 172.21.15.60:0/2291285282 >> 172.21.15.60:0/2291285282 conn(0x7f3b6c09a0f0 msgr2=0x7f3b6c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 -- 172.21.15.60:0/2291285282 shutdown_connections 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.349+0000 7f3b73fca700 1 -- 172.21.15.60:0/2291285282 wait complete. 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.350+0000 7f3b73fca700 1 Processor -- start 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.350+0000 7f3b73fca700 1 -- start start 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b73fca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b6c0b3570 0x7f3b6c15ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b73fca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b6c0b4860 0x7f3b6c15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b73fca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 0x7f3b6c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b73fca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c09bc50 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b73fca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c09bf30 con 0x7f3b6c0b4860 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b73fca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c09c210 con 0x7f3b6c0b3570 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 0x7f3b6c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 0x7f3b6c15f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39430/0 (socket says 172.21.15.60:39430) 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 -- 172.21.15.60:0/885338231 learned_addr learned my addr 172.21.15.60:0/885338231 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b71565700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b6c0b4860 0x7f3b6c15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b71d66700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b6c0b3570 0x7f3b6c15ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 -- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b6c0b3570 msgr2=0x7f3b6c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b6c0b3570 0x7f3b6c15ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 -- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b6c0b4860 msgr2=0x7f3b6c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b6c0b4860 0x7f3b6c15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 -- 172.21.15.60:0/885338231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c009ae0 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.351+0000 7f3b72567700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 0x7f3b6c15f7e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c068cd0 tx=0x7f3b5c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.352+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0032f0 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.352+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c008e40 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.352+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c09c4f0 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.352+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0266b0 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.352+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c09b790 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.353+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c09ca10 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.353+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b5c003040 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.353+0000 7f3b69ffb700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b58066f30 0x7f3b580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.354+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3b5c085c20 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.354+0000 7f3b71d66700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b58066f30 0x7f3b580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.354+0000 7f3b71d66700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b58066f30 0x7f3b580693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009390 tx=0x7f3b64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.358+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b6c09ca10 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.553+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b6c09ca10 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.553+0000 7f3b69ffb700 1 -- 172.21.15.60:0/885338231 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b6c09ca10 con 0x7f3b6c0b4c30 2023-10-08T16:09:55.554 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b58066f30 msgr2=0x7f3b580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b58066f30 0x7f3b580693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009390 tx=0x7f3b64008040 comp rx=0 tx=0).stop 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 msgr2=0x7f3b6c15f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 0x7f3b6c15f7e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c068cd0 tx=0x7f3b5c018000 comp rx=0 tx=0).stop 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 shutdown_connections 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b58066f30 0x7f3b580693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b6c0b3570 0x7f3b6c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b6c0b4c30 0x7f3b6c15f7e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 --2- 172.21.15.60:0/885338231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b6c0b4860 0x7f3b6c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.555+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 >> 172.21.15.60:0/885338231 conn(0x7f3b6c09a0f0 msgr2=0x7f3b6c06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.556+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 shutdown_connections 2023-10-08T16:09:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.556+0000 7f3b73fca700 1 -- 172.21.15.60:0/885338231 wait complete. 2023-10-08T16:09:55.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:09:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.687+0000 7fdd0a849700 1 Processor -- start 2023-10-08T16:09:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.687+0000 7fdd0a849700 1 -- start start 2023-10-08T16:09:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.687+0000 7fdd0a849700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a2b0 0x7fdd040b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.687+0000 7fdd0a849700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd040d1c30 0x7fdd040cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.687+0000 7fdd0a849700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd0415a680 0x7fdd040cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd0a849700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd04068470 con 0x7fdd0415a680 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd0a849700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd040c5d80 con 0x7fdd040d1c30 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd0a849700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040c6060 con 0x7fdd0415a2b0 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd0415a680 0x7fdd040cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd0415a680 0x7fdd040cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39438/0 (socket says 172.21.15.60:39438) 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 -- 172.21.15.60:0/3082908723 learned_addr learned my addr 172.21.15.60:0/3082908723 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd037fe700 1 --2- 172.21.15.60:0/3082908723 >> v2:172.21.15.144:3300/0 conn(0x7fdd040d1c30 0x7fdd040cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd03fff700 1 --2- 172.21.15.60:0/3082908723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a2b0 0x7fdd040b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 -- 172.21.15.60:0/3082908723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a2b0 msgr2=0x7fdd040b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 --2- 172.21.15.60:0/3082908723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a2b0 0x7fdd040b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 -- 172.21.15.60:0/3082908723 >> v2:172.21.15.144:3300/0 conn(0x7fdd040d1c30 msgr2=0x7fdd040cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 --2- 172.21.15.60:0/3082908723 >> v2:172.21.15.144:3300/0 conn(0x7fdd040d1c30 0x7fdd040cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 -- 172.21.15.60:0/3082908723 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040c6340 con 0x7fdd0415a680 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd037fe700 1 --2- 172.21.15.60:0/3082908723 >> v2:172.21.15.144:3300/0 conn(0x7fdd040d1c30 0x7fdd040cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd08de6700 1 --2- 172.21.15.60:0/3082908723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd0415a680 0x7fdd040cfc50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdd04089050 tx=0x7fdcfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f880fae355aec14d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd02ffd700 1 -- 172.21.15.60:0/3082908723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00e070 con 0x7fdd0415a680 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd02ffd700 1 -- 172.21.15.60:0/3082908723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00ba50 con 0x7fdd0415a680 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.688+0000 7fdd02ffd700 1 -- 172.21.15.60:0/3082908723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0092e0 con 0x7fdd0415a680 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 -- 172.21.15.60:0/3082908723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd0415a680 msgr2=0x7fdd040cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3082908723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd0415a680 0x7fdd040cfc50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdd04089050 tx=0x7fdcfc009840 comp rx=0 tx=0).stop 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 -- 172.21.15.60:0/3082908723 shutdown_connections 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3082908723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd0415a680 0x7fdd040cfc50 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3082908723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a2b0 0x7fdd040b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3082908723 >> v2:172.21.15.144:3300/0 conn(0x7fdd040d1c30 0x7fdd040cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 -- 172.21.15.60:0/3082908723 >> 172.21.15.60:0/3082908723 conn(0x7fdd04067e40 msgr2=0x7fdd040d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 -- 172.21.15.60:0/3082908723 shutdown_connections 2023-10-08T16:09:55.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.689+0000 7fdd0a849700 1 -- 172.21.15.60:0/3082908723 wait complete. 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.690+0000 7fdd0a849700 1 Processor -- start 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.690+0000 7fdd0a849700 1 -- start start 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd0a849700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 0x7fdd0415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd0a849700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd0415a2b0 0x7fdd0415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd0a849700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a680 0x7fdd0415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd0a849700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04160290 con 0x7fdd040d1c30 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd0a849700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0415f680 con 0x7fdd0415a2b0 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd0a849700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0415f960 con 0x7fdd0415a680 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 0x7fdd0415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 0x7fdd0415eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39442/0 (socket says 172.21.15.60:39442) 2023-10-08T16:09:55.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 -- 172.21.15.60:0/3593765517 learned_addr learned my addr 172.21.15.60:0/3593765517 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd037fe700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd0415a2b0 0x7fdd0415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd08de6700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a680 0x7fdd0415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 -- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a680 msgr2=0x7fdd0415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a680 0x7fdd0415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 -- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd0415a2b0 msgr2=0x7fdd0415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd0415a2b0 0x7fdd0415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd03fff700 1 -- 172.21.15.60:0/3593765517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009ae0 con 0x7fdd040d1c30 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.691+0000 7fdd08de6700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a680 0x7fdd0415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:55.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.692+0000 7fdd03fff700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 0x7fdd0415eff0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c880 tx=0x7fdcf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.692+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011600 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.692+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf4011780 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.692+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0415fc40 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.692+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011b40 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.692+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04157e90 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.693+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0404c3c0 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.693+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcf4018360 con 0x7fdd040d1c30 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.694+0000 7fdcebfff700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdcf0066f30 0x7fdcf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.694+0000 7fdd037fe700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdcf0066f30 0x7fdcf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.694+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdcf4083f00 con 0x7fdd040d1c30 2023-10-08T16:09:55.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.694+0000 7fdd037fe700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdcf0066f30 0x7fdcf00693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdd040d0a60 tx=0x7fdcf8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.698+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcf4054f50 con 0x7fdd040d1c30 2023-10-08T16:09:55.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.892+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd040b6da0 con 0x7fdd040d1c30 2023-10-08T16:09:55.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.892+0000 7fdcebfff700 1 -- 172.21.15.60:0/3593765517 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdcf4015090 con 0x7fdd040d1c30 2023-10-08T16:09:55.893 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:55.893 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:09:55.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdcf0066f30 msgr2=0x7fdcf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdcf0066f30 0x7fdcf00693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdd040d0a60 tx=0x7fdcf8008040 comp rx=0 tx=0).stop 2023-10-08T16:09:55.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 msgr2=0x7fdd0415eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 0x7fdd0415eff0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c880 tx=0x7fdcf4008040 comp rx=0 tx=0).stop 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 shutdown_connections 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdcf0066f30 0x7fdcf00693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd0415a680 0x7fdd0415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd040d1c30 0x7fdd0415eff0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 --2- 172.21.15.60:0/3593765517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd0415a2b0 0x7fdd0415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 >> 172.21.15.60:0/3593765517 conn(0x7fdd04067e40 msgr2=0x7fdd040c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 shutdown_connections 2023-10-08T16:09:55.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:55.894+0000 7fdd0a849700 1 -- 172.21.15.60:0/3593765517 wait complete. 2023-10-08T16:09:55.933 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:09:55.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:09:56.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 Processor -- start 2023-10-08T16:09:56.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 -- start start 2023-10-08T16:09:56.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1380c91c0 0x7ff13806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff13806d930 0x7ff138067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13806dd90 con 0x7ff1380b10a0 2023-10-08T16:09:56.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1380c9660 con 0x7ff1380c91c0 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.057+0000 7ff13eade700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13815e940 con 0x7ff13806d930 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff13c87a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff1380b10a0 0x7ff1380cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34482/0 (socket says 172.21.15.60:34482) 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff13c87a700 1 -- 172.21.15.60:0/1554123434 learned_addr learned my addr 172.21.15.60:0/1554123434 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff137fff700 1 --2- 172.21.15.60:0/1554123434 >> v2:172.21.15.144:3300/0 conn(0x7ff1380c91c0 0x7ff13806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff13d07b700 1 --2- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff13806d930 0x7ff138067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff1377fe700 1 -- 172.21.15.60:0/1554123434 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929697352 0 0) 0x7ff130001110 con 0x7ff1380b10a0 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff1377fe700 1 -- 172.21.15.60:0/1554123434 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff124003570 con 0x7ff1380b10a0 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff137fff700 1 -- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff13806d930 msgr2=0x7ff138067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff137fff700 1 --2- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff13806d930 0x7ff138067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff137fff700 1 -- 172.21.15.60:0/1554123434 >> v1:172.21.15.60:6789/0 conn(0x7ff1380b10a0 legacy=0x7ff1380cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff1377fe700 1 -- 172.21.15.60:0/1554123434 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630864938 0 0) 0x7ff124003570 con 0x7ff1380b10a0 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff137fff700 1 -- 172.21.15.60:0/1554123434 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13815a250 con 0x7ff1380c91c0 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff137fff700 1 --2- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380c91c0 0x7ff13806d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff128009e60 tx=0x7ff128009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba5a1e2bfb95939 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.058+0000 7ff1377fe700 1 -- 172.21.15.60:0/1554123434 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12800e070 con 0x7ff1380c91c0 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff1377fe700 1 -- 172.21.15.60:0/1554123434 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800b7a0 con 0x7ff1380c91c0 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff1377fe700 1 -- 172.21.15.60:0/1554123434 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130001600 con 0x7ff1380c91c0 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 -- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380c91c0 msgr2=0x7ff13806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 --2- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380c91c0 0x7ff13806d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff128009e60 tx=0x7ff128009780 comp rx=0 tx=0).stop 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 -- 172.21.15.60:0/1554123434 shutdown_connections 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 --2- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff13806d930 0x7ff138067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 --2- 172.21.15.60:0/1554123434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380c91c0 0x7ff13806d3f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 -- 172.21.15.60:0/1554123434 >> 172.21.15.60:0/1554123434 conn(0x7ff138069870 msgr2=0x7ff138069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 -- 172.21.15.60:0/1554123434 shutdown_connections 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.059+0000 7ff13eade700 1 -- 172.21.15.60:0/1554123434 wait complete. 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.060+0000 7ff13eade700 1 Processor -- start 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.060+0000 7ff13eade700 1 -- start start 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13eade700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 0x7ff13815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13eade700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380b10a0 0x7ff13815a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13eade700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1380c91c0 0x7ff1380c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13eade700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13816b260 con 0x7ff13806d930 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13eade700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13816a650 con 0x7ff1380b10a0 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13eade700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13816a930 con 0x7ff1380c91c0 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13c87a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 0x7ff13815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13c87a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 0x7ff13815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39454/0 (socket says 172.21.15.60:39454) 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13c87a700 1 -- 172.21.15.60:0/3745945127 learned_addr learned my addr 172.21.15.60:0/3745945127 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff137fff700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380b10a0 0x7ff13815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.061+0000 7ff13d07b700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1380c91c0 0x7ff1380c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13c87a700 1 -- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1380c91c0 msgr2=0x7ff1380c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13c87a700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1380c91c0 0x7ff1380c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13c87a700 1 -- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380b10a0 msgr2=0x7ff13815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13c87a700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380b10a0 0x7ff13815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13c87a700 1 -- 172.21.15.60:0/3745945127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009a20 con 0x7ff13806d930 2023-10-08T16:09:56.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff137fff700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380b10a0 0x7ff13815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:56.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13c87a700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 0x7ff13815d030 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff13000cb90 tx=0x7ff130001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130007e90 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130007360 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130004830 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13816ac10 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.062+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1380c8c00 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.063+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13816b0b0 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.063+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff130004c20 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.064+0000 7ff134ff9700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff118066f30 0x7ff1180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.064+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff130083a40 con 0x7ff13806d930 2023-10-08T16:09:56.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.064+0000 7ff137fff700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff118066f30 0x7ff1180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.064+0000 7ff137fff700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff118066f30 0x7ff1180693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff13815d570 tx=0x7ff128018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.068+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff130050fe0 con 0x7ff13806d930 2023-10-08T16:09:56.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.261+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff13806dd90 con 0x7ff13806d930 2023-10-08T16:09:56.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.444+0000 7ff134ff9700 1 -- 172.21.15.60:0/3745945127 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff13806dd90 con 0x7ff13806d930 2023-10-08T16:09:56.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff118066f30 msgr2=0x7ff1180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff118066f30 0x7ff1180693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff13815d570 tx=0x7ff128018000 comp rx=0 tx=0).stop 2023-10-08T16:09:56.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 msgr2=0x7ff13815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 0x7ff13815d030 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff13000cb90 tx=0x7ff130001450 comp rx=0 tx=0).stop 2023-10-08T16:09:56.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 shutdown_connections 2023-10-08T16:09:56.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff118066f30 0x7ff1180693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1380c91c0 0x7ff1380c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff13806d930 0x7ff13815d030 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 --2- 172.21.15.60:0/3745945127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1380b10a0 0x7ff13815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.447+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 >> 172.21.15.60:0/3745945127 conn(0x7ff138069870 msgr2=0x7ff138157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.448+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 shutdown_connections 2023-10-08T16:09:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.448+0000 7ff13eade700 1 -- 172.21.15.60:0/3745945127 wait complete. 2023-10-08T16:09:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:09:56.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:09:56.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.587+0000 7f20d73cf700 1 Processor -- start 2023-10-08T16:09:56.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.587+0000 7f20d73cf700 1 -- start start 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d73cf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20d00af220 0x7f20d00cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d73cf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d00add80 con 0x7f20d0159d30 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d73cf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d00cfed0 con 0x7f20d00cdaa0 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d73cf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00adbf0 con 0x7f20d00af220 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d63cd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20d0159d30 0x7f20d00cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34496/0 (socket says 172.21.15.60:34496) 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d63cd700 1 -- 172.21.15.60:0/1486858075 learned_addr learned my addr 172.21.15.60:0/1486858075 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:56.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d6bce700 1 --2- 172.21.15.60:0/1486858075 >> v2:172.21.15.144:3300/0 conn(0x7f20d00af220 0x7f20d00cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629251198 0 0) 0x7f20d00add80 con 0x7f20d0159d30 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.588+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b8003570 con 0x7f20d0159d30 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753304896 0 0) 0x7f20d00cfed0 con 0x7f20d00cdaa0 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d00add80 con 0x7f20d00cdaa0 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718106166 0 0) 0x7f20b8003570 con 0x7f20d0159d30 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d6bce700 1 -- 172.21.15.60:0/1486858075 >> v1:172.21.15.144:6789/0 conn(0x7f20d00cdaa0 legacy=0x7f20d00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d6bce700 1 -- 172.21.15.60:0/1486858075 >> v1:172.21.15.60:6789/0 conn(0x7f20d0159d30 legacy=0x7f20d00cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d6bce700 1 -- 172.21.15.60:0/1486858075 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00d01b0 con 0x7f20d00af220 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d6bce700 1 --2- 172.21.15.60:0/1486858075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d00cf860 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009e60 tx=0x7f20c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29618a78e011b39 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c000e070 con 0x7f20d00af220 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c000b7a0 con 0x7f20d00af220 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d53cb700 1 -- 172.21.15.60:0/1486858075 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80015f0 con 0x7f20d00af220 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d73cf700 1 -- 172.21.15.60:0/1486858075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 msgr2=0x7f20d00cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.589+0000 7f20d73cf700 1 --2- 172.21.15.60:0/1486858075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d00cf860 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009e60 tx=0x7f20c0009780 comp rx=0 tx=0).stop 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.590+0000 7f20d73cf700 1 -- 172.21.15.60:0/1486858075 shutdown_connections 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.590+0000 7f20d73cf700 1 --2- 172.21.15.60:0/1486858075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d00cf860 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.590+0000 7f20d73cf700 1 -- 172.21.15.60:0/1486858075 >> 172.21.15.60:0/1486858075 conn(0x7f20d0099f50 msgr2=0x7f20d0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.590+0000 7f20d73cf700 1 -- 172.21.15.60:0/1486858075 shutdown_connections 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.590+0000 7f20d73cf700 1 -- 172.21.15.60:0/1486858075 wait complete. 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 Processor -- start 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 -- start start 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d016b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20d00cdaa0 0x7f20d0159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 0x7f20d016a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00b03e0 con 0x7f20d0159d30 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d016b700 con 0x7f20d00af220 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d73cf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00b05f0 con 0x7f20d00cdaa0 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.591+0000 7f20d6bce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 0x7f20d016a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 0x7f20d016a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39462/0 (socket says 172.21.15.60:39462) 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 -- 172.21.15.60:0/2807730152 learned_addr learned my addr 172.21.15.60:0/2807730152 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d63cd700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d016b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d5bcc700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20d00cdaa0 0x7f20d0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 -- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20d00cdaa0 msgr2=0x7f20d0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20d00cdaa0 0x7f20d0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 -- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 msgr2=0x7f20d016b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d016b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 -- 172.21.15.60:0/2807730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0009a20 con 0x7f20d0159d30 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d63cd700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d016b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d5bcc700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20d00cdaa0 0x7f20d0159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d6bce700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 0x7f20d016a7c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f20d00643c0 tx=0x7f20c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0012da0 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c001e450 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c001e7f0 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d00b08d0 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.592+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d00b0e90 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.593+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d006ada0 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.594+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20c001eb60 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.594+0000 7f20ce7fc700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.594+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f20c00866d0 con 0x7f20d0159d30 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.594+0000 7f20d63cd700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.595+0000 7f20d63cd700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f20c8001720 tx=0x7f20c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.599+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20c0053a80 con 0x7f20d0159d30 2023-10-08T16:09:56.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:56.793+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f20d00d0490 con 0x7f20d0159d30 2023-10-08T16:09:57.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.450+0000 7f20ce7fc700 1 -- 172.21.15.60:0/2807730152 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f20c00570a0 con 0x7f20d0159d30 2023-10-08T16:09:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.454+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 msgr2=0x7f20bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.454+0000 7f20d73cf700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f20c8001720 tx=0x7f20c8009040 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.454+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 msgr2=0x7f20d016a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.454+0000 7f20d73cf700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 0x7f20d016a7c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f20d00643c0 tx=0x7f20c0017000 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.457+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 shutdown_connections 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.457+0000 7f20d73cf700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.457+0000 7f20d73cf700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d0159d30 0x7f20d016a7c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.457+0000 7f20d73cf700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20d00af220 0x7f20d016b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.457+0000 7f20d73cf700 1 --2- 172.21.15.60:0/2807730152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20d00cdaa0 0x7f20d0159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.457+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 >> 172.21.15.60:0/2807730152 conn(0x7f20d0099f50 msgr2=0x7f20d00d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.459+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 shutdown_connections 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.459+0000 7f20d73cf700 1 -- 172.21.15.60:0/2807730152 wait complete. 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:09:57.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:09:57.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.598+0000 7fa564905700 1 Processor -- start 2023-10-08T16:09:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.598+0000 7fa564905700 1 -- start start 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.599+0000 7fa564905700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa56015afb0 0x7fa5600d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.599+0000 7fa564905700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5600d12a0 0x7fa5600cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.599+0000 7fa564905700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5601513f0 con 0x7fa5600cd300 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.599+0000 7fa564905700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56015e7a0 con 0x7fa56015afb0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.599+0000 7fa564905700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56015b430 con 0x7fa5600d12a0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa56015afb0 0x7fa5600d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa5600cd300 0x7fa5600b6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34512/0 (socket says 172.21.15.60:34512) 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55e59c700 1 -- 172.21.15.60:0/170224119 learned_addr learned my addr 172.21.15.60:0/170224119 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55ed9d700 1 --2- 172.21.15.60:0/170224119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5600d12a0 0x7fa5600cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55dd9b700 1 -- 172.21.15.60:0/170224119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5600d12a0 msgr2=0x7fa5600cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55dd9b700 1 --2- 172.21.15.60:0/170224119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5600d12a0 0x7fa5600cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55dd9b700 1 -- 172.21.15.60:0/170224119 >> v1:172.21.15.60:6789/0 conn(0x7fa5600cd300 legacy=0x7fa5600b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55dd9b700 1 -- 172.21.15.60:0/170224119 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600d1700 con 0x7fa56015afb0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55d59a700 1 -- 172.21.15.60:0/170224119 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235896345 0 0) 0x7fa5601513f0 con 0x7fa5600cd300 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55dd9b700 1 --2- 172.21.15.60:0/170224119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa56015afb0 0x7fa5600d0d60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa5540098e0 tx=0x7fa5540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636b2664119ff321 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55d59a700 1 -- 172.21.15.60:0/170224119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400b640 con 0x7fa56015afb0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55d59a700 1 -- 172.21.15.60:0/170224119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400b7a0 con 0x7fa56015afb0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.600+0000 7fa55d59a700 1 -- 172.21.15.60:0/170224119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400bb40 con 0x7fa56015afb0 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 -- 172.21.15.60:0/170224119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa56015afb0 msgr2=0x7fa5600d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 --2- 172.21.15.60:0/170224119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa56015afb0 0x7fa5600d0d60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa5540098e0 tx=0x7fa5540091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 -- 172.21.15.60:0/170224119 shutdown_connections 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 --2- 172.21.15.60:0/170224119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5600d12a0 0x7fa5600cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 --2- 172.21.15.60:0/170224119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa56015afb0 0x7fa5600d0d60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 -- 172.21.15.60:0/170224119 >> 172.21.15.60:0/170224119 conn(0x7fa560068d90 msgr2=0x7fa560069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 -- 172.21.15.60:0/170224119 shutdown_connections 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.601+0000 7fa564905700 1 -- 172.21.15.60:0/170224119 wait complete. 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.602+0000 7fa564905700 1 Processor -- start 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.602+0000 7fa564905700 1 -- start start 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa564905700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5600cd300 0x7fa5601541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa564905700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 0x7fa560142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa564905700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa56015afb0 0x7fa5601429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa564905700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601548c0 con 0x7fa5600d12a0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa564905700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56015c2d0 con 0x7fa5600cd300 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa564905700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56015c5b0 con 0x7fa56015afb0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 0x7fa560142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 0x7fa560142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39484/0 (socket says 172.21.15.60:39484) 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 -- 172.21.15.60:0/4033742778 learned_addr learned my addr 172.21.15.60:0/4033742778 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55e59c700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5600cd300 0x7fa5601541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55ed9d700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa56015afb0 0x7fa5601429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 -- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa56015afb0 msgr2=0x7fa5601429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa56015afb0 0x7fa5601429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 -- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5600cd300 msgr2=0x7fa5601541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5600cd300 0x7fa5601541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 -- 172.21.15.60:0/4033742778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554009420 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.603+0000 7fa55dd9b700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 0x7fa560142490 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa5600af920 tx=0x7fa554017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.604+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400b910 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.604+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400ba70 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.604+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56015c890 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.604+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554011670 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.604+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56015d090 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.605+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56015cdb0 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.605+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa554011aa0 con 0x7fa5600d12a0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.605+0000 7fa54e7fc700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa540066f30 0x7fa5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.606+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fa554085cd0 con 0x7fa5600d12a0 2023-10-08T16:09:57.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.606+0000 7fa55e59c700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa540066f30 0x7fa5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.606+0000 7fa55e59c700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa540066f30 0x7fa5400693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa550007160 tx=0x7fa550007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.610+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa56015cdb0 con 0x7fa5600d12a0 2023-10-08T16:09:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:57.848+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa5600d1700 con 0x7fa5600d12a0 2023-10-08T16:09:58.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.451+0000 7fa54e7fc700 1 -- 172.21.15.60:0/4033742778 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa5600d1700 con 0x7fa5600d12a0 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa540066f30 msgr2=0x7fa5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa540066f30 0x7fa5400693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa550007160 tx=0x7fa550007f50 comp rx=0 tx=0).stop 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 msgr2=0x7fa560142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 0x7fa560142490 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa5600af920 tx=0x7fa554017000 comp rx=0 tx=0).stop 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 shutdown_connections 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa540066f30 0x7fa5400693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa56015afb0 0x7fa5601429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5600cd300 0x7fa5601541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.457+0000 7fa564905700 1 --2- 172.21.15.60:0/4033742778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5600d12a0 0x7fa560142490 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.458+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 >> 172.21.15.60:0/4033742778 conn(0x7fa560068d90 msgr2=0x7fa5600b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.458+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 shutdown_connections 2023-10-08T16:09:58.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.458+0000 7fa564905700 1 -- 172.21.15.60:0/4033742778 wait complete. 2023-10-08T16:09:58.460 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 12 and data pool 13 2023-10-08T16:09:58.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.596+0000 7fe92d894700 1 Processor -- start 2023-10-08T16:09:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.596+0000 7fe92d894700 1 -- start start 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe92d894700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9280a7df0 0x7fe9280b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe92d894700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280ae760 con 0x7fe9281572a0 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe92d894700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280aea40 con 0x7fe9280a7a20 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe92d894700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280aed20 con 0x7fe9280a7df0 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe9267fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9280a7df0 0x7fe9280b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe9277fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9281572a0 0x7fe9281576b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34528/0 (socket says 172.21.15.60:34528) 2023-10-08T16:09:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.597+0000 7fe9277fe700 1 -- 172.21.15.60:0/114057584 learned_addr learned my addr 172.21.15.60:0/114057584 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe9267fc700 1 -- 172.21.15.60:0/114057584 >> v1:172.21.15.144:6789/0 conn(0x7fe9280a7a20 legacy=0x7fe9280af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe9267fc700 1 -- 172.21.15.60:0/114057584 >> v1:172.21.15.60:6789/0 conn(0x7fe9281572a0 legacy=0x7fe9281576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe925ffb700 1 -- 172.21.15.60:0/114057584 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128525822 0 0) 0x7fe9280ae760 con 0x7fe9281572a0 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe9267fc700 1 -- 172.21.15.60:0/114057584 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280af000 con 0x7fe9280a7df0 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe9267fc700 1 --2- 172.21.15.60:0/114057584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9280a7df0 0x7fe9280b29c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098e0 tx=0x7fe9100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda448a062a9ef9c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe925ffb700 1 -- 172.21.15.60:0/114057584 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910009e80 con 0x7fe9280a7df0 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe925ffb700 1 -- 172.21.15.60:0/114057584 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91000b8b0 con 0x7fe9280a7df0 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe925ffb700 1 -- 172.21.15.60:0/114057584 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000bc30 con 0x7fe9280a7df0 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe92d894700 1 -- 172.21.15.60:0/114057584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9280a7df0 msgr2=0x7fe9280b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe92d894700 1 --2- 172.21.15.60:0/114057584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9280a7df0 0x7fe9280b29c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098e0 tx=0x7fe9100091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe92d894700 1 -- 172.21.15.60:0/114057584 shutdown_connections 2023-10-08T16:09:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe92d894700 1 --2- 172.21.15.60:0/114057584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9280a7df0 0x7fe9280b29c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.598+0000 7fe92d894700 1 -- 172.21.15.60:0/114057584 >> 172.21.15.60:0/114057584 conn(0x7fe9280cd1e0 msgr2=0x7fe9280cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.599+0000 7fe92d894700 1 -- 172.21.15.60:0/114057584 shutdown_connections 2023-10-08T16:09:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.599+0000 7fe92d894700 1 -- 172.21.15.60:0/114057584 wait complete. 2023-10-08T16:09:58.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.600+0000 7fe92d894700 1 Processor -- start 2023-10-08T16:09:58.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.600+0000 7fe92d894700 1 -- start start 2023-10-08T16:09:58.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.600+0000 7fe92d894700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9280a7a20 0x7fe92814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.600+0000 7fe92d894700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9280a7df0 0x7fe92806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe92d894700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 0x7fe92806f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe92d894700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe928169200 con 0x7fe9281572a0 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe92d894700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92809a2d0 con 0x7fe9280a7df0 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe92d894700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe928169450 con 0x7fe9280a7a20 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 0x7fe92806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 0x7fe92806f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39488/0 (socket says 172.21.15.60:39488) 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 -- 172.21.15.60:0/2312074163 learned_addr learned my addr 172.21.15.60:0/2312074163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe926ffd700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9280a7a20 0x7fe92814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9267fc700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9280a7df0 0x7fe92806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 -- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9280a7a20 msgr2=0x7fe92814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9280a7a20 0x7fe92814dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 -- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9280a7df0 msgr2=0x7fe92806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9280a7df0 0x7fe92806eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 -- 172.21.15.60:0/2312074163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009420 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe9277fe700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 0x7fe92806f400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe91800cbf0 tx=0x7fe9180019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800a9c0 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91800ab20 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180070f0 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe928169730 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.601+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92814e100 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.602+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92804c3c0 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.603+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe918007520 con 0x7fe9281572a0 2023-10-08T16:09:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.603+0000 7fe91effd700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.603+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe918084910 con 0x7fe9281572a0 2023-10-08T16:09:58.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.603+0000 7fe926ffd700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.604+0000 7fe926ffd700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9280adbb0 tx=0x7fe920009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.607+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe918051c00 con 0x7fe9281572a0 2023-10-08T16:09:58.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.803+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9280ac530 con 0x7fe9281572a0 2023-10-08T16:09:58.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.804+0000 7fe91effd700 1 -- 172.21.15.60:0/2312074163 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fe918055220 con 0x7fe9281572a0 2023-10-08T16:09:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:58.805 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":95,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:57.849994+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:56.291292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:56.823764+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:58.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.806+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 msgr2=0x7fe9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.806+0000 7fe92d894700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9280adbb0 tx=0x7fe920009040 comp rx=0 tx=0).stop 2023-10-08T16:09:58.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.806+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 msgr2=0x7fe92806f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.806+0000 7fe92d894700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 0x7fe92806f400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe91800cbf0 tx=0x7fe9180019b0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 shutdown_connections 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9280a7a20 0x7fe92814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9281572a0 0x7fe92806f400 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 --2- 172.21.15.60:0/2312074163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9280a7df0 0x7fe92806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 >> 172.21.15.60:0/2312074163 conn(0x7fe9280cd1e0 msgr2=0x7fe928156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 shutdown_connections 2023-10-08T16:09:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.807+0000 7fe92d894700 1 -- 172.21.15.60:0/2312074163 wait complete. 2023-10-08T16:09:58.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:58.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.938+0000 7f0e581c9700 1 Processor -- start 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.938+0000 7f0e581c9700 1 -- start start 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e581c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e500b1220 0x7f0e500c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e581c9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500cb4f0 0x7f0e500cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e581c9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5015de60 con 0x7f0e500b0e50 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e581c9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e500cbed0 con 0x7f0e500b1220 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e581c9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5015e140 con 0x7f0e500cb4f0 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e55764700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e500b1220 0x7f0e500c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e55764700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e500b1220 0x7f0e500c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39492/0 (socket says 172.21.15.60:39492) 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.939+0000 7f0e55764700 1 -- 172.21.15.60:0/3556900271 learned_addr learned my addr 172.21.15.60:0/3556900271 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e56766700 1 --2- 172.21.15.60:0/3556900271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500cb4f0 0x7f0e500cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e55764700 1 -- 172.21.15.60:0/3556900271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500cb4f0 msgr2=0x7f0e500cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e55764700 1 --2- 172.21.15.60:0/3556900271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500cb4f0 0x7f0e500cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e55764700 1 -- 172.21.15.60:0/3556900271 >> v1:172.21.15.144:6789/0 conn(0x7f0e500b0e50 legacy=0x7f0e5006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e55764700 1 -- 172.21.15.60:0/3556900271 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5015e420 con 0x7f0e500b1220 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e55764700 1 --2- 172.21.15.60:0/3556900271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500b1220 0x7f0e500c9180 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0e440099b0 tx=0x7f0e44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4844a04d01df0dfc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e54f63700 1 -- 172.21.15.60:0/3556900271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44009ea0 con 0x7f0e500b1220 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e54f63700 1 -- 172.21.15.60:0/3556900271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400b860 con 0x7f0e500b1220 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.940+0000 7f0e54f63700 1 -- 172.21.15.60:0/3556900271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400bc20 con 0x7f0e500b1220 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 -- 172.21.15.60:0/3556900271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500b1220 msgr2=0x7f0e500c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 --2- 172.21.15.60:0/3556900271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500b1220 0x7f0e500c9180 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0e440099b0 tx=0x7f0e44009250 comp rx=0 tx=0).stop 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 -- 172.21.15.60:0/3556900271 shutdown_connections 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 --2- 172.21.15.60:0/3556900271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500cb4f0 0x7f0e500cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 --2- 172.21.15.60:0/3556900271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500b1220 0x7f0e500c9180 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 -- 172.21.15.60:0/3556900271 >> 172.21.15.60:0/3556900271 conn(0x7f0e50069870 msgr2=0x7f0e50069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 -- 172.21.15.60:0/3556900271 shutdown_connections 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.941+0000 7f0e581c9700 1 -- 172.21.15.60:0/3556900271 wait complete. 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.942+0000 7f0e581c9700 1 Processor -- start 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.942+0000 7f0e581c9700 1 -- start start 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e500b0e50 0x7f0e500b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500b1220 0x7f0e500b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 0x7f0e50151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5015c1e0 con 0x7f0e500cb4f0 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e501526e0 con 0x7f0e500b0e50 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50151bd0 con 0x7f0e500b1220 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 0x7f0e50151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 0x7f0e50151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39508/0 (socket says 172.21.15.60:39508) 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 -- 172.21.15.60:0/1612597157 learned_addr learned my addr 172.21.15.60:0/1612597157 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e55764700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500b1220 0x7f0e500b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e55f65700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e500b0e50 0x7f0e500b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 -- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500b1220 msgr2=0x7f0e500b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500b1220 0x7f0e500b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 -- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e500b0e50 msgr2=0x7f0e500b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e500b0e50 0x7f0e500b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 -- 172.21.15.60:0/1612597157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440094f0 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e56766700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 0x7f0e50151690 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009ec0 tx=0x7f0e4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000cb70 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000f040 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50152960 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.943+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40014480 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.944+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e500b3250 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.945+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5004c3c0 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.945+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e40014830 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.945+0000 7f0e4dffb700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e3c066f30 0x7f0e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.945+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e40084dd0 con 0x7f0e500cb4f0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.946+0000 7f0e55f65700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e3c066f30 0x7f0e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.946+0000 7f0e55f65700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e3c066f30 0x7f0e3c0693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e480039e0 tx=0x7f0e48007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:58.950+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e40052040 con 0x7f0e500cb4f0 2023-10-08T16:09:59.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.142+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e50068ba0 con 0x7f0e500cb4f0 2023-10-08T16:09:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.143+0000 7f0e4dffb700 1 -- 172.21.15.60:0/1612597157 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f0e40055660 con 0x7f0e500cb4f0 2023-10-08T16:09:59.143 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:09:59.143 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":95,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:57.849994+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:56.291292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:56.823764+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e3c066f30 msgr2=0x7f0e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e3c066f30 0x7f0e3c0693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e480039e0 tx=0x7f0e48007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 msgr2=0x7f0e50151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 0x7f0e50151690 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009ec0 tx=0x7f0e4000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 shutdown_connections 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e3c066f30 0x7f0e3c0693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e500cb4f0 0x7f0e50151690 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e500b0e50 0x7f0e500b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 --2- 172.21.15.60:0/1612597157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e500b1220 0x7f0e500b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 >> 172.21.15.60:0/1612597157 conn(0x7f0e50069870 msgr2=0x7f0e50158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 shutdown_connections 2023-10-08T16:09:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.145+0000 7f0e581c9700 1 -- 172.21.15.60:0/1612597157 wait complete. 2023-10-08T16:09:59.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:09:59.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.280+0000 7f734592a700 1 Processor -- start 2023-10-08T16:09:59.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.280+0000 7f734592a700 1 -- start start 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f734592a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 0x7f73400b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f734592a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400b14f0 con 0x7f73400b3570 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f734592a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400b17d0 con 0x7f73400b4c30 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f734592a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400b1ab0 con 0x7f73400b4860 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f73400b3570 0x7f73400cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34538/0 (socket says 172.21.15.60:34538) 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733f7fe700 1 -- 172.21.15.60:0/213430310 learned_addr learned my addr 172.21.15.60:0/213430310 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733effd700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 0x7f73400b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176964575 0 0) 0x7f73400b14f0 con 0x7f73400b3570 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f732c003570 con 0x7f73400b3570 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057265853 0 0) 0x7f73400b17d0 con 0x7f73400b4c30 2023-10-08T16:09:59.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73400b14f0 con 0x7f73400b4c30 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106662370 0 0) 0x7f732c003570 con 0x7f73400b3570 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 msgr2=0x7f73400b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 0x7f73400b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 >> v1:172.21.15.144:6789/0 conn(0x7f73400b4c30 legacy=0x7f7340159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400b1d90 con 0x7f73400b3570 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f7330001470 con 0x7f73400b3570 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.281+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 >> v1:172.21.15.60:6789/0 conn(0x7f73400b3570 legacy=0x7f73400cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f732c003c20 0x7f732c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 0x7f732c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c004d50 0x7f732c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400b1ab0 con 0x7f732c004d50 2023-10-08T16:09:59.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c00bbf0 con 0x7f732c003c20 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c00bd60 con 0x7f73400b4860 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c004d50 0x7f732c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733effd700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f732c003c20 0x7f732c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733e7fc700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 0x7f732c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 -- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 msgr2=0x7f732c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73400b4860 0x7f732c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 -- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f732c003c20 msgr2=0x7f732c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f732c003c20 0x7f732c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 -- 172.21.15.60:0/213430310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c003570 con 0x7f732c004d50 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733f7fe700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c004d50 0x7f732c0051c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f734008b610 tx=0x7f7330001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b8cc428ff36354 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000cae0 con 0x7f732c004d50 2023-10-08T16:09:59.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733000cc40 con 0x7f732c004d50 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.282+0000 7f733dffb700 1 -- 172.21.15.60:0/213430310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330005920 con 0x7f732c004d50 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f734592a700 1 -- 172.21.15.60:0/213430310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c004d50 msgr2=0x7f732c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f734592a700 1 --2- 172.21.15.60:0/213430310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c004d50 0x7f732c0051c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f734008b610 tx=0x7f7330001d40 comp rx=0 tx=0).stop 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f733f7fe700 1 -- 172.21.15.60:0/213430310 reap_dead start 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f734592a700 1 -- 172.21.15.60:0/213430310 shutdown_connections 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f734592a700 1 -- 172.21.15.60:0/213430310 >> 172.21.15.60:0/213430310 conn(0x7f734009a0f0 msgr2=0x7f7340067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f734592a700 1 -- 172.21.15.60:0/213430310 shutdown_connections 2023-10-08T16:09:59.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.283+0000 7f734592a700 1 -- 172.21.15.60:0/213430310 wait complete. 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.284+0000 7f734592a700 1 Processor -- start 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.284+0000 7f734592a700 1 -- start start 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f734592a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734014b3b0 0x7f734015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f734592a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 0x7f734015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f734592a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734015d210 0x7f734015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f734592a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734015dbc0 con 0x7f734015a970 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f734592a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734015c040 con 0x7f734015d210 2023-10-08T16:09:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f734592a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734015ca10 con 0x7f734014b3b0 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 0x7f734015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 0x7f734015ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39518/0 (socket says 172.21.15.60:39518) 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 -- 172.21.15.60:0/3479146623 learned_addr learned my addr 172.21.15.60:0/3479146623 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733effd700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734014b3b0 0x7f734015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733f7fe700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734015d210 0x7f734015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 -- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734014b3b0 msgr2=0x7f734015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734014b3b0 0x7f734015c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 -- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734015d210 msgr2=0x7f734015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734015d210 0x7f734015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733e7fc700 1 -- 172.21.15.60:0/3479146623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734015b430 con 0x7f734015a970 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733effd700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734014b3b0 0x7f734015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:59.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.285+0000 7f733f7fe700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734015d210 0x7f734015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.286+0000 7f733e7fc700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 0x7f734015ade0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7328002b80 tx=0x7f7328007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.286+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800f9a0 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.286+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800fb00 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.286+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734015b710 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.286+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800fec0 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.286+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734015bcd0 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.287+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734015c1f0 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.287+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73280133f0 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.287+0000 7f7336ffd700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7320066f30 0x7f73200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.288+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7328084730 con 0x7f734015a970 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.288+0000 7f733effd700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7320066f30 0x7f73200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.288+0000 7f733effd700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7320066f30 0x7f73200693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f73380094d0 tx=0x7f733800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.292+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f734015c1f0 con 0x7f734015a970 2023-10-08T16:09:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:09:59.533+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f734015c1b0 con 0x7f734015a970 2023-10-08T16:10:00.443 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-10-08T16:10:00.443+0000 7fb120efd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:10:00.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.468+0000 7f7336ffd700 1 -- 172.21.15.60:0/3479146623 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7f73280519a0 con 0x7f734015a970 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7320066f30 msgr2=0x7f73200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7320066f30 0x7f73200693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f73380094d0 tx=0x7f733800b040 comp rx=0 tx=0).stop 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 msgr2=0x7f734015ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 0x7f734015ade0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7328002b80 tx=0x7f7328007d30 comp rx=0 tx=0).stop 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 shutdown_connections 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7320066f30 0x7f73200693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734014b3b0 0x7f734015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734015d210 0x7f734015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 --2- 172.21.15.60:0/3479146623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734015a970 0x7f734015ade0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 >> 172.21.15.60:0/3479146623 conn(0x7f734009a0f0 msgr2=0x7f7340068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.470+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 shutdown_connections 2023-10-08T16:10:00.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.471+0000 7f734592a700 1 -- 172.21.15.60:0/3479146623 wait complete. 2023-10-08T16:10:00.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:10:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.617+0000 7fe17a662700 1 Processor -- start 2023-10-08T16:10:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.618+0000 7fe17a662700 1 -- start start 2023-10-08T16:10:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.618+0000 7fe17a662700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe174155450 0x7fe1740c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.618+0000 7fe17a662700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1741588d0 0x7fe1741592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.618+0000 7fe17a662700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174158440 con 0x7fe174155820 2023-10-08T16:10:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.618+0000 7fe17a662700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1741580f0 con 0x7fe174155450 2023-10-08T16:10:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.618+0000 7fe17a662700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17415bed0 con 0x7fe1741588d0 2023-10-08T16:10:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe174155450 0x7fe1740c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe174155450 0x7fe1740c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39534/0 (socket says 172.21.15.60:39534) 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 -- 172.21.15.60:0/1097044194 learned_addr learned my addr 172.21.15.60:0/1097044194 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe178e5f700 1 --1- 172.21.15.60:0/1097044194 >> v1:172.21.15.60:6789/0 conn(0x7fe174155820 0x7fe17415b6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34542/0 (socket says 172.21.15.60:34542) 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179e61700 1 --2- 172.21.15.60:0/1097044194 >> v2:172.21.15.144:3300/0 conn(0x7fe1741588d0 0x7fe1741592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 -- 172.21.15.60:0/1097044194 >> v2:172.21.15.144:3300/0 conn(0x7fe1741588d0 msgr2=0x7fe1741592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 --2- 172.21.15.60:0/1097044194 >> v2:172.21.15.144:3300/0 conn(0x7fe1741588d0 0x7fe1741592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 -- 172.21.15.60:0/1097044194 >> v1:172.21.15.60:6789/0 conn(0x7fe174155820 legacy=0x7fe17415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 -- 172.21.15.60:0/1097044194 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17415c1b0 con 0x7fe174155450 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe173fff700 1 -- 172.21.15.60:0/1097044194 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938066170 0 0) 0x7fe174158440 con 0x7fe174155820 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe179660700 1 --2- 172.21.15.60:0/1097044194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe174155450 0x7fe1740c97d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe1741583b0 tx=0x7fe16c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d14331cfe0065ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe173fff700 1 -- 172.21.15.60:0/1097044194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00e070 con 0x7fe174155450 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe173fff700 1 -- 172.21.15.60:0/1097044194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c00bad0 con 0x7fe174155450 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.619+0000 7fe173fff700 1 -- 172.21.15.60:0/1097044194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0092e0 con 0x7fe174155450 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 -- 172.21.15.60:0/1097044194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe174155450 msgr2=0x7fe1740c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 --2- 172.21.15.60:0/1097044194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe174155450 0x7fe1740c97d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe1741583b0 tx=0x7fe16c009840 comp rx=0 tx=0).stop 2023-10-08T16:10:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 -- 172.21.15.60:0/1097044194 shutdown_connections 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 --2- 172.21.15.60:0/1097044194 >> v2:172.21.15.144:3300/0 conn(0x7fe1741588d0 0x7fe1741592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 --2- 172.21.15.60:0/1097044194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe174155450 0x7fe1740c97d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 -- 172.21.15.60:0/1097044194 >> 172.21.15.60:0/1097044194 conn(0x7fe174067660 msgr2=0x7fe174067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 -- 172.21.15.60:0/1097044194 shutdown_connections 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.620+0000 7fe17a662700 1 -- 172.21.15.60:0/1097044194 wait complete. 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.621+0000 7fe17a662700 1 Processor -- start 2023-10-08T16:10:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.621+0000 7fe17a662700 1 -- start start 2023-10-08T16:10:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe17a662700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe174155450 0x7fe1741512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe17a662700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe174155820 0x7fe1740cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe17a662700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 0x7fe1740cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe17a662700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740acfe0 con 0x7fe1741588d0 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe17a662700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17416bb40 con 0x7fe174155820 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe17a662700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17416c6c0 con 0x7fe174155450 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 0x7fe1740cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 0x7fe1740cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39540/0 (socket says 172.21.15.60:39540) 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 -- 172.21.15.60:0/2439388104 learned_addr learned my addr 172.21.15.60:0/2439388104 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe178e5f700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe174155820 0x7fe1740cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179660700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe174155450 0x7fe1741512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 -- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe174155450 msgr2=0x7fe1741512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe174155450 0x7fe1741512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 -- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe174155820 msgr2=0x7fe1740cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe174155820 0x7fe1740cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 -- 172.21.15.60:0/2439388104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009ae0 con 0x7fe1741588d0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.622+0000 7fe179e61700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 0x7fe1740cb240 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe16400d8c0 tx=0x7fe164008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.623+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640125f0 con 0x7fe1741588d0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.623+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164012770 con 0x7fe1741588d0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.623+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164012b30 con 0x7fe1741588d0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.623+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17416bd90 con 0x7fe1741588d0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.623+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17416c350 con 0x7fe1741588d0 2023-10-08T16:10:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.624+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17406c890 con 0x7fe1741588d0 2023-10-08T16:10:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.624+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe16401e460 con 0x7fe1741588d0 2023-10-08T16:10:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.625+0000 7fe1717fa700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe160066f30 0x7fe1600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.625+0000 7fe179660700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe160066f30 0x7fe1600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.625+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe164084a40 con 0x7fe1741588d0 2023-10-08T16:10:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.625+0000 7fe179660700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe160066f30 0x7fe1600693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009fd0 tx=0x7fe16c018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.629+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe164086e60 con 0x7fe1741588d0 2023-10-08T16:10:00.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:00.866+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe17415c490 con 0x7fe1741588d0 2023-10-08T16:10:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.468+0000 7fe1717fa700 1 -- 172.21.15.60:0/2439388104 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe164055740 con 0x7fe1741588d0 2023-10-08T16:10:01.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe160066f30 msgr2=0x7fe1600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe160066f30 0x7fe1600693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009fd0 tx=0x7fe16c018000 comp rx=0 tx=0).stop 2023-10-08T16:10:01.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 msgr2=0x7fe1740cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 0x7fe1740cb240 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe16400d8c0 tx=0x7fe164008040 comp rx=0 tx=0).stop 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 shutdown_connections 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe160066f30 0x7fe1600693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe174155450 0x7fe1741512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1741588d0 0x7fe1740cb240 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 --2- 172.21.15.60:0/2439388104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe174155820 0x7fe1740cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 >> 172.21.15.60:0/2439388104 conn(0x7fe174067660 msgr2=0x7fe1741520b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 shutdown_connections 2023-10-08T16:10:01.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.471+0000 7fe17a662700 1 -- 172.21.15.60:0/2439388104 wait complete. 2023-10-08T16:10:01.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:01.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.606+0000 7fbc2cabc700 1 Processor -- start 2023-10-08T16:10:01.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.606+0000 7fbc2cabc700 1 -- start start 2023-10-08T16:10:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.607+0000 7fbc2cabc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc280cffa0 0x7fbc2806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.607+0000 7fbc2cabc700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc280b3d40 con 0x7fbc2815a230 2023-10-08T16:10:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc2cabc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc280b4300 con 0x7fbc28159e60 2023-10-08T16:10:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc2cabc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc28069d70 con 0x7fbc280cffa0 2023-10-08T16:10:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc25d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc280cffa0 0x7fbc2806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc26d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbc2815a230 0x7fbc28163c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34554/0 (socket says 172.21.15.60:34554) 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc25d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc280cffa0 0x7fbc2806a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39544/0 (socket says 172.21.15.60:39544) 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc26d9d700 1 -- 172.21.15.60:0/2634747843 learned_addr learned my addr 172.21.15.60:0/2634747843 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc25d9b700 1 -- 172.21.15.60:0/2634747843 >> v1:172.21.15.144:6789/0 conn(0x7fbc28159e60 legacy=0x7fbc280b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc25d9b700 1 -- 172.21.15.60:0/2634747843 >> v1:172.21.15.60:6789/0 conn(0x7fbc2815a230 legacy=0x7fbc28163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc25d9b700 1 -- 172.21.15.60:0/2634747843 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280d0480 con 0x7fbc280cffa0 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc2559a700 1 -- 172.21.15.60:0/2634747843 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675721855 0 0) 0x7fbc280b3d40 con 0x7fbc2815a230 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc25d9b700 1 --2- 172.21.15.60:0/2634747843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc280cffa0 0x7fbc2806a6a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbc180098e0 tx=0x7fbc180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b81885b3c5b7b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc2559a700 1 -- 172.21.15.60:0/2634747843 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18009e80 con 0x7fbc280cffa0 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc2559a700 1 -- 172.21.15.60:0/2634747843 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1800b820 con 0x7fbc280cffa0 2023-10-08T16:10:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.608+0000 7fbc2559a700 1 -- 172.21.15.60:0/2634747843 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800bba0 con 0x7fbc280cffa0 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 -- 172.21.15.60:0/2634747843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc280cffa0 msgr2=0x7fbc2806a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/2634747843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc280cffa0 0x7fbc2806a6a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbc180098e0 tx=0x7fbc180091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 -- 172.21.15.60:0/2634747843 shutdown_connections 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/2634747843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc280cffa0 0x7fbc2806a6a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 -- 172.21.15.60:0/2634747843 >> 172.21.15.60:0/2634747843 conn(0x7fbc280d1a50 msgr2=0x7fbc28068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 -- 172.21.15.60:0/2634747843 shutdown_connections 2023-10-08T16:10:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.609+0000 7fbc2cabc700 1 -- 172.21.15.60:0/2634747843 wait complete. 2023-10-08T16:10:01.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.610+0000 7fbc2cabc700 1 Processor -- start 2023-10-08T16:10:01.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.610+0000 7fbc2cabc700 1 -- start start 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc280cffa0 0x7fbc28154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc28159e60 0x7fbc2816af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 0x7fbc2815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28155090 con 0x7fbc2815a230 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280cc210 con 0x7fbc28159e60 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280c61b0 con 0x7fbc280cffa0 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 0x7fbc2815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 0x7fbc2815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39546/0 (socket says 172.21.15.60:39546) 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 -- 172.21.15.60:0/3700111469 learned_addr learned my addr 172.21.15.60:0/3700111469 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc25d9b700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc28159e60 0x7fbc2816af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2659c700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc280cffa0 0x7fbc28154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 -- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc280cffa0 msgr2=0x7fbc28154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc280cffa0 0x7fbc28154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 -- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc28159e60 msgr2=0x7fbc2816af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc28159e60 0x7fbc2816af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 -- 172.21.15.60:0/3700111469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18009420 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc26d9d700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 0x7fbc2815c740 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000cc10 tx=0x7fbc20001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000a930 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000aab0 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc280c6490 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.611+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000ae70 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.612+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc280c6a50 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.612+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2804c3c0 con 0x7fbc2815a230 2023-10-08T16:10:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.613+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc20007300 con 0x7fbc2815a230 2023-10-08T16:10:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.613+0000 7fbc167fc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc08066f30 0x7fbc080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.613+0000 7fbc2659c700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc08066f30 0x7fbc080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.613+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc20084940 con 0x7fbc2815a230 2023-10-08T16:10:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.614+0000 7fbc2659c700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc08066f30 0x7fbc080693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0027e0 tx=0x7fbc1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.617+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc20051ba0 con 0x7fbc2815a230 2023-10-08T16:10:01.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.854+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc280d0760 con 0x7fbc2815a230 2023-10-08T16:10:01.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.854+0000 7fbc167fc700 1 -- 172.21.15.60:0/3700111469 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbc200551c0 con 0x7fbc2815a230 2023-10-08T16:10:01.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:01.855 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc08066f30 msgr2=0x7fbc080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc08066f30 0x7fbc080693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0027e0 tx=0x7fbc1c009040 comp rx=0 tx=0).stop 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 msgr2=0x7fbc2815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 0x7fbc2815c740 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000cc10 tx=0x7fbc20001970 comp rx=0 tx=0).stop 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 shutdown_connections 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc08066f30 0x7fbc080693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc280cffa0 0x7fbc28154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2815a230 0x7fbc2815c740 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 --2- 172.21.15.60:0/3700111469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc28159e60 0x7fbc2816af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 >> 172.21.15.60:0/3700111469 conn(0x7fbc280d1a50 msgr2=0x7fbc28159180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 shutdown_connections 2023-10-08T16:10:01.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.856+0000 7fbc2cabc700 1 -- 172.21.15.60:0/3700111469 wait complete. 2023-10-08T16:10:01.858 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:01.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:01.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.987+0000 7fdb2edf2700 1 Processor -- start 2023-10-08T16:10:01.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.987+0000 7fdb2edf2700 1 -- start start 2023-10-08T16:10:01.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2edf2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb2815a2b0 0x7fdb280b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2edf2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb280ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2edf2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280c5d80 con 0x7fdb280d1c30 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2edf2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb28068470 con 0x7fdb2815a2b0 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2edf2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280c6060 con 0x7fdb280cfe20 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2cb8e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb2815a2b0 0x7fdb280b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb27fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdb280d1c30 0x7fdb280cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:48178/0 (socket says 172.21.15.60:48178) 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2d38f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb280ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2cb8e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb2815a2b0 0x7fdb280b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:48302/0 (socket says 172.21.15.60:48302) 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb27fff700 1 -- 172.21.15.60:0/474797925 learned_addr learned my addr 172.21.15.60:0/474797925 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2cb8e700 1 -- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 msgr2=0x7fdb280ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2cb8e700 1 --2- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb280ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2cb8e700 1 -- 172.21.15.60:0/474797925 >> v1:172.21.15.144:6789/0 conn(0x7fdb280d1c30 legacy=0x7fdb280cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2cb8e700 1 -- 172.21.15.60:0/474797925 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280c6340 con 0x7fdb2815a2b0 2023-10-08T16:10:01.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.988+0000 7fdb2d38f700 1 --2- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:01.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2cb8e700 1 --2- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb2815a2b0 0x7fdb280b3da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009eb0 tx=0x7fdb20009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5918d938785815d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb277fe700 1 -- 172.21.15.60:0/474797925 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000e070 con 0x7fdb2815a2b0 2023-10-08T16:10:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb277fe700 1 -- 172.21.15.60:0/474797925 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2000bc30 con 0x7fdb2815a2b0 2023-10-08T16:10:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb277fe700 1 -- 172.21.15.60:0/474797925 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20012430 con 0x7fdb2815a2b0 2023-10-08T16:10:01.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 -- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb2815a2b0 msgr2=0x7fdb280b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb2815a2b0 0x7fdb280b3da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009eb0 tx=0x7fdb20009780 comp rx=0 tx=0).stop 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 -- 172.21.15.60:0/474797925 shutdown_connections 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/474797925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb2815a2b0 0x7fdb280b3da0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 -- 172.21.15.60:0/474797925 >> 172.21.15.60:0/474797925 conn(0x7fdb28067e40 msgr2=0x7fdb280d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 -- 172.21.15.60:0/474797925 shutdown_connections 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.989+0000 7fdb2edf2700 1 -- 172.21.15.60:0/474797925 wait complete. 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.991+0000 7fdb2edf2700 1 Processor -- start 2023-10-08T16:10:01.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.991+0000 7fdb2edf2700 1 -- start start 2023-10-08T16:10:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.991+0000 7fdb2edf2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb2815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.991+0000 7fdb2edf2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb280d1c30 0x7fdb2815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.991+0000 7fdb2edf2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 0x7fdb2815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2edf2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2815d070 con 0x7fdb2815a2b0 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2edf2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28159ce0 con 0x7fdb280d1c30 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2edf2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2815bfd0 con 0x7fdb280cfe20 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 0x7fdb2815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 0x7fdb2815b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39556/0 (socket says 172.21.15.60:39556) 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 -- 172.21.15.60:0/1113864796 learned_addr learned my addr 172.21.15.60:0/1113864796 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2cb8e700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb2815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb27fff700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb280d1c30 0x7fdb2815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 -- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 msgr2=0x7fdb2815a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb2815a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 -- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb280d1c30 msgr2=0x7fdb2815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb280d1c30 0x7fdb2815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 -- 172.21.15.60:0/1113864796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18009420 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2d38f700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 0x7fdb2815b100 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800ea50 tx=0x7fdb180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800c640 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1800c7c0 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb20009a20 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800cb80 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.992+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2815c590 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.993+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2804c3c0 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.994+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb18013470 con 0x7fdb2815a2b0 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.994+0000 7fdb24ff9700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdb14066f30 0x7fdb140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.994+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb18084450 con 0x7fdb2815a2b0 2023-10-08T16:10:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.994+0000 7fdb2cb8e700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdb14066f30 0x7fdb140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.995+0000 7fdb2cb8e700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdb14066f30 0x7fdb140693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009eb0 tx=0x7fdb20019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:01.998+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb180516c0 con 0x7fdb2815a2b0 2023-10-08T16:10:02.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.190+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb28064a00 con 0x7fdb2815a2b0 2023-10-08T16:10:02.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.191+0000 7fdb24ff9700 1 -- 172.21.15.60:0/1113864796 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+15353 (secure 0 0 0) 0x7fdb18054ce0 con 0x7fdb2815a2b0 2023-10-08T16:10:02.191 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:02.191 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":96,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:09:59.335115+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:56.291292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:56.823764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:02.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdb14066f30 msgr2=0x7fdb140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdb14066f30 0x7fdb140693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009eb0 tx=0x7fdb20019000 comp rx=0 tx=0).stop 2023-10-08T16:10:02.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 msgr2=0x7fdb2815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 0x7fdb2815b100 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800ea50 tx=0x7fdb180091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 shutdown_connections 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdb14066f30 0x7fdb140693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb280cfe20 0x7fdb2815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb2815a2b0 0x7fdb2815b100 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 --2- 172.21.15.60:0/1113864796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb280d1c30 0x7fdb2815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 >> 172.21.15.60:0/1113864796 conn(0x7fdb28067e40 msgr2=0x7fdb280b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 shutdown_connections 2023-10-08T16:10:02.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.193+0000 7fdb2edf2700 1 -- 172.21.15.60:0/1113864796 wait complete. 2023-10-08T16:10:02.205 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:10:02.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:02.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.324+0000 7fe6e647b700 1 Processor -- start 2023-10-08T16:10:02.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.324+0000 7fe6e647b700 1 -- start start 2023-10-08T16:10:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6e647b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6e015a2b0 0x7fe6e00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6e647b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe6e00d1c30 0x7fe6e00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6e647b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e00c5d80 con 0x7fe6e015a680 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6e647b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e0068470 con 0x7fe6e015a2b0 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6e647b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e00c6060 con 0x7fe6e00d1c30 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6e015a2b0 0x7fe6e00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6e015a2b0 0x7fe6e00b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39570/0 (socket says 172.21.15.60:39570) 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 -- 172.21.15.60:0/3864685994 learned_addr learned my addr 172.21.15.60:0/3864685994 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6df7fe700 1 --2- 172.21.15.60:0/3864685994 >> v2:172.21.15.144:3300/0 conn(0x7fe6e00d1c30 0x7fe6e00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 -- 172.21.15.60:0/3864685994 >> v2:172.21.15.144:3300/0 conn(0x7fe6e00d1c30 msgr2=0x7fe6e00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 --2- 172.21.15.60:0/3864685994 >> v2:172.21.15.144:3300/0 conn(0x7fe6e00d1c30 0x7fe6e00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 -- 172.21.15.60:0/3864685994 >> v1:172.21.15.144:6789/0 conn(0x7fe6e015a680 legacy=0x7fe6e00c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 -- 172.21.15.60:0/3864685994 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00c6340 con 0x7fe6e015a2b0 2023-10-08T16:10:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6dffff700 1 --2- 172.21.15.60:0/3864685994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e015a2b0 0x7fe6e00b3da0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0089190 tx=0x7fe6c8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356c187841c5766e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.325+0000 7fe6deffd700 1 -- 172.21.15.60:0/3864685994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8005c10 con 0x7fe6e015a2b0 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6deffd700 1 -- 172.21.15.60:0/3864685994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8005d70 con 0x7fe6e015a2b0 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6deffd700 1 -- 172.21.15.60:0/3864685994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800b880 con 0x7fe6e015a2b0 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 -- 172.21.15.60:0/3864685994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e015a2b0 msgr2=0x7fe6e00b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3864685994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e015a2b0 0x7fe6e00b3da0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0089190 tx=0x7fe6c8009220 comp rx=0 tx=0).stop 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 -- 172.21.15.60:0/3864685994 shutdown_connections 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3864685994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e015a2b0 0x7fe6e00b3da0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3864685994 >> v2:172.21.15.144:3300/0 conn(0x7fe6e00d1c30 0x7fe6e00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 -- 172.21.15.60:0/3864685994 >> 172.21.15.60:0/3864685994 conn(0x7fe6e0067e40 msgr2=0x7fe6e00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 -- 172.21.15.60:0/3864685994 shutdown_connections 2023-10-08T16:10:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.326+0000 7fe6e647b700 1 -- 172.21.15.60:0/3864685994 wait complete. 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.327+0000 7fe6e647b700 1 Processor -- start 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.327+0000 7fe6e647b700 1 -- start start 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e647b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 0x7fe6e015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e647b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6e015a2b0 0x7fe6e0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e647b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6e015a680 0x7fe6e015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e647b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e016e9a0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e647b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b5720 con 0x7fe6e015a2b0 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e647b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b4df0 con 0x7fe6e015a680 2023-10-08T16:10:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 0x7fe6e015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 0x7fe6e015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39584/0 (socket says 172.21.15.60:39584) 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 -- 172.21.15.60:0/3509331183 learned_addr learned my addr 172.21.15.60:0/3509331183 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6df7fe700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6e015a2b0 0x7fe6e0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6e4a18700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6e015a680 0x7fe6e015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 -- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6e015a680 msgr2=0x7fe6e015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6e015a680 0x7fe6e015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 -- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6e015a2b0 msgr2=0x7fe6e0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6e015a2b0 0x7fe6e0154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6dffff700 1 -- 172.21.15.60:0/3509331183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8009480 con 0x7fe6e00d1c30 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.328+0000 7fe6df7fe700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6e015a2b0 0x7fe6e0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.329+0000 7fe6dffff700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 0x7fe6e015ba60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0089120 tx=0x7fe6c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.329+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80118e0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.329+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8020070 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.329+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e00b50d0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.329+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8011cb0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.329+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e015bfa0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.330+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e004c3c0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.330+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6c8022030 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.330+0000 7fe6d7fff700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe6c0066f30 0x7fe6c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.331+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6c8086130 con 0x7fe6e00d1c30 2023-10-08T16:10:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.331+0000 7fe6df7fe700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe6c0066f30 0x7fe6c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.331+0000 7fe6df7fe700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe6c0066f30 0x7fe6c00693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00b6910 tx=0x7fe6d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.335+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6c80533a0 con 0x7fe6e00d1c30 2023-10-08T16:10:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.525+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6e0064a00 con 0x7fe6c0066f30 2023-10-08T16:10:02.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.534+0000 7fe6d7fff700 1 -- 172.21.15.60:0/3509331183 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284838 (secure 0 0 0) 0x7fe6e0064a00 con 0x7fe6c0066f30 2023-10-08T16:10:02.537 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.537+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe6c0066f30 msgr2=0x7fe6c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.537+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe6c0066f30 0x7fe6c00693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00b6910 tx=0x7fe6d0008040 comp rx=0 tx=0).stop 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.537+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 msgr2=0x7fe6e015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.537+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 0x7fe6e015ba60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0089120 tx=0x7fe6c8016000 comp rx=0 tx=0).stop 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 shutdown_connections 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe6c0066f30 0x7fe6c00693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6e015a680 0x7fe6e015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6e00d1c30 0x7fe6e015ba60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 --2- 172.21.15.60:0/3509331183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6e015a2b0 0x7fe6e0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 >> 172.21.15.60:0/3509331183 conn(0x7fe6e0067e40 msgr2=0x7fe6e0158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 shutdown_connections 2023-10-08T16:10:02.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.538+0000 7fe6e647b700 1 -- 172.21.15.60:0/3509331183 wait complete. 2023-10-08T16:10:02.541 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:10:02.550 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-08T16:10:01.625504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557315,"statfs":{"total":1600000000,"available":1594691012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.182465"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350048+0000","last_change":"2023-10-08T16:09:58.346721+0000","last_active":"2023-10-08T16:09:58.350048+0000","last_peered":"2023-10-08T16:09:58.350048+0000","last_clean":"2023-10-08T16:09:58.350048+0000","last_became_active":"2023-10-08T16:09:58.345933+0000","last_became_peered":"2023-10-08T16:09:58.345933+0000","last_unstale":"2023-10-08T16:09:58.350048+0000","last_undegraded":"2023-10-08T16:09:58.350048+0000","last_fullsized":"2023-10-08T16:09:58.350048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:56.176466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.351741+0000","last_change":"2023-10-08T16:09:58.351668+0000","last_active":"2023-10-08T16:09:58.351741+0000","last_peered":"2023-10-08T16:09:58.351741+0000","last_clean":"2023-10-08T16:09:58.351741+0000","last_became_active":"2023-10-08T16:09:58.351396+0000","last_became_peered":"2023-10-08T16:09:58.351396+0000","last_unstale":"2023-10-08T16:09:58.351741+0000","last_undegraded":"2023-10-08T16:09:58.351741+0000","last_fullsized":"2023-10-08T16:09:58.351741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:54.727900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353586+0000","last_change":"2023-10-08T16:09:58.353506+0000","last_active":"2023-10-08T16:09:58.353586+0000","last_peered":"2023-10-08T16:09:58.353586+0000","last_clean":"2023-10-08T16:09:58.353586+0000","last_became_active":"2023-10-08T16:09:58.353218+0000","last_became_peered":"2023-10-08T16:09:58.353218+0000","last_unstale":"2023-10-08T16:09:58.353586+0000","last_undegraded":"2023-10-08T16:09:58.353586+0000","last_fullsized":"2023-10-08T16:09:58.353586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:42.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345687+0000","last_change":"2023-10-08T16:09:58.345611+0000","last_active":"2023-10-08T16:09:58.345687+0000","last_peered":"2023-10-08T16:09:58.345687+0000","last_clean":"2023-10-08T16:09:58.345687+0000","last_became_active":"2023-10-08T16:09:58.345344+0000","last_became_peered":"2023-10-08T16:09:58.345344+0000","last_unstale":"2023-10-08T16:09:58.345687+0000","last_undegraded":"2023-10-08T16:09:58.345687+0000","last_fullsized":"2023-10-08T16:09:58.345687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:53.735392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347587+0000","last_change":"2023-10-08T16:09:58.347485+0000","last_active":"2023-10-08T16:09:58.347587+0000","last_peered":"2023-10-08T16:09:58.347587+0000","last_clean":"2023-10-08T16:09:58.347587+0000","last_became_active":"2023-10-08T16:09:58.347199+0000","last_became_peered":"2023-10-08T16:09:58.347199+0000","last_unstale":"2023-10-08T16:09:58.347587+0000","last_undegraded":"2023-10-08T16:09:58.347587+0000","last_fullsized":"2023-10-08T16:09:58.347587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:03.047812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344144+0000","last_change":"2023-10-08T16:09:58.343834+0000","last_active":"2023-10-08T16:09:58.344144+0000","last_peered":"2023-10-08T16:09:58.344144+0000","last_clean":"2023-10-08T16:09:58.344144+0000","last_became_active":"2023-10-08T16:09:58.343229+0000","last_became_peered":"2023-10-08T16:09:58.343229+0000","last_unstale":"2023-10-08T16:09:58.344144+0000","last_undegraded":"2023-10-08T16:09:58.344144+0000","last_fullsized":"2023-10-08T16:09:58.344144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:10.611815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.342191+0000","last_change":"2023-10-08T16:09:58.342113+0000","last_active":"2023-10-08T16:09:58.342191+0000","last_peered":"2023-10-08T16:09:58.342191+0000","last_clean":"2023-10-08T16:09:58.342191+0000","last_became_active":"2023-10-08T16:09:58.341830+0000","last_became_peered":"2023-10-08T16:09:58.341830+0000","last_unstale":"2023-10-08T16:09:58.342191+0000","last_undegraded":"2023-10-08T16:09:58.342191+0000","last_fullsized":"2023-10-08T16:09:58.342191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:35.412761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344110+0000","last_change":"2023-10-08T16:09:58.343626+0000","last_active":"2023-10-08T16:09:58.344110+0000","last_peered":"2023-10-08T16:09:58.344110+0000","last_clean":"2023-10-08T16:09:58.344110+0000","last_became_active":"2023-10-08T16:09:58.343365+0000","last_became_peered":"2023-10-08T16:09:58.343365+0000","last_unstale":"2023-10-08T16:09:58.344110+0000","last_undegraded":"2023-10-08T16:09:58.344110+0000","last_fullsized":"2023-10-08T16:09:58.344110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.339407+0000","last_change":"2023-10-08T16:09:58.339248+0000","last_active":"2023-10-08T16:09:58.339407+0000","last_peered":"2023-10-08T16:09:58.339407+0000","last_clean":"2023-10-08T16:09:58.339407+0000","last_became_active":"2023-10-08T16:09:58.339015+0000","last_became_peered":"2023-10-08T16:09:58.339015+0000","last_unstale":"2023-10-08T16:09:58.339407+0000","last_undegraded":"2023-10-08T16:09:58.339407+0000","last_fullsized":"2023-10-08T16:09:58.339407+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:03.047812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348994+0000","last_change":"2023-10-08T16:09:58.345241+0000","last_active":"2023-10-08T16:09:58.348994+0000","last_peered":"2023-10-08T16:09:58.348994+0000","last_clean":"2023-10-08T16:09:58.348994+0000","last_became_active":"2023-10-08T16:09:58.345002+0000","last_became_peered":"2023-10-08T16:09:58.345002+0000","last_unstale":"2023-10-08T16:09:58.348994+0000","last_undegraded":"2023-10-08T16:09:58.348994+0000","last_fullsized":"2023-10-08T16:09:58.348994+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:48.014327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344667+0000","last_change":"2023-10-08T16:09:58.344551+0000","last_active":"2023-10-08T16:09:58.344667+0000","last_peered":"2023-10-08T16:09:58.344667+0000","last_clean":"2023-10-08T16:09:58.344667+0000","last_became_active":"2023-10-08T16:09:58.344222+0000","last_became_peered":"2023-10-08T16:09:58.344222+0000","last_unstale":"2023-10-08T16:09:58.344667+0000","last_undegraded":"2023-10-08T16:09:58.344667+0000","last_fullsized":"2023-10-08T16:09:58.344667+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:35.782924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348956+0000","last_change":"2023-10-08T16:09:58.345151+0000","last_active":"2023-10-08T16:09:58.348956+0000","last_peered":"2023-10-08T16:09:58.348956+0000","last_clean":"2023-10-08T16:09:58.348956+0000","last_became_active":"2023-10-08T16:09:58.344920+0000","last_became_peered":"2023-10-08T16:09:58.344920+0000","last_unstale":"2023-10-08T16:09:58.348956+0000","last_undegraded":"2023-10-08T16:09:58.348956+0000","last_fullsized":"2023-10-08T16:09:58.348956+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346068+0000","last_change":"2023-10-08T16:09:58.345880+0000","last_active":"2023-10-08T16:09:58.346068+0000","last_peered":"2023-10-08T16:09:58.346068+0000","last_clean":"2023-10-08T16:09:58.346068+0000","last_became_active":"2023-10-08T16:09:58.345634+0000","last_became_peered":"2023-10-08T16:09:58.345634+0000","last_unstale":"2023-10-08T16:09:58.346068+0000","last_undegraded":"2023-10-08T16:09:58.346068+0000","last_fullsized":"2023-10-08T16:09:58.346068+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:10.611815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344868+0000","last_change":"2023-10-08T16:09:58.344356+0000","last_active":"2023-10-08T16:09:58.344868+0000","last_peered":"2023-10-08T16:09:58.344868+0000","last_clean":"2023-10-08T16:09:58.344868+0000","last_became_active":"2023-10-08T16:09:58.343825+0000","last_became_peered":"2023-10-08T16:09:58.343825+0000","last_unstale":"2023-10-08T16:09:58.344868+0000","last_undegraded":"2023-10-08T16:09:58.344868+0000","last_fullsized":"2023-10-08T16:09:58.344868+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:20.612861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347437+0000","last_change":"2023-10-08T16:09:58.347231+0000","last_active":"2023-10-08T16:09:58.347437+0000","last_peered":"2023-10-08T16:09:58.347437+0000","last_clean":"2023-10-08T16:09:58.347437+0000","last_became_active":"2023-10-08T16:09:58.346796+0000","last_became_peered":"2023-10-08T16:09:58.346796+0000","last_unstale":"2023-10-08T16:09:58.347437+0000","last_undegraded":"2023-10-08T16:09:58.347437+0000","last_fullsized":"2023-10-08T16:09:58.347437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:47.751365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.352085+0000","last_change":"2023-10-08T16:09:58.351820+0000","last_active":"2023-10-08T16:09:58.352085+0000","last_peered":"2023-10-08T16:09:58.352085+0000","last_clean":"2023-10-08T16:09:58.352085+0000","last_became_active":"2023-10-08T16:09:58.351487+0000","last_became_peered":"2023-10-08T16:09:58.351487+0000","last_unstale":"2023-10-08T16:09:58.352085+0000","last_undegraded":"2023-10-08T16:09:58.352085+0000","last_fullsized":"2023-10-08T16:09:58.352085+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:42.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350821+0000","last_change":"2023-10-08T16:09:58.350659+0000","last_active":"2023-10-08T16:09:58.350821+0000","last_peered":"2023-10-08T16:09:58.350821+0000","last_clean":"2023-10-08T16:09:58.350821+0000","last_became_active":"2023-10-08T16:09:58.350253+0000","last_became_peered":"2023-10-08T16:09:58.350253+0000","last_unstale":"2023-10-08T16:09:58.350821+0000","last_undegraded":"2023-10-08T16:09:58.350821+0000","last_fullsized":"2023-10-08T16:09:58.350821+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:47.751365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349580+0000","last_change":"2023-10-08T16:09:58.349516+0000","last_active":"2023-10-08T16:09:58.349580+0000","last_peered":"2023-10-08T16:09:58.349580+0000","last_clean":"2023-10-08T16:09:58.349580+0000","last_became_active":"2023-10-08T16:09:58.349251+0000","last_became_peered":"2023-10-08T16:09:58.349251+0000","last_unstale":"2023-10-08T16:09:58.349580+0000","last_undegraded":"2023-10-08T16:09:58.349580+0000","last_fullsized":"2023-10-08T16:09:58.349580+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:26.019957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349812+0000","last_change":"2023-10-08T16:09:58.349745+0000","last_active":"2023-10-08T16:09:58.349812+0000","last_peered":"2023-10-08T16:09:58.349812+0000","last_clean":"2023-10-08T16:09:58.349812+0000","last_became_active":"2023-10-08T16:09:58.349508+0000","last_became_peered":"2023-10-08T16:09:58.349508+0000","last_unstale":"2023-10-08T16:09:58.349812+0000","last_undegraded":"2023-10-08T16:09:58.349812+0000","last_fullsized":"2023-10-08T16:09:58.349812+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:48.014327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340522+0000","last_change":"2023-10-08T16:09:58.339884+0000","last_active":"2023-10-08T16:09:58.340522+0000","last_peered":"2023-10-08T16:09:58.340522+0000","last_clean":"2023-10-08T16:09:58.340522+0000","last_became_active":"2023-10-08T16:09:58.339630+0000","last_became_peered":"2023-10-08T16:09:58.339630+0000","last_unstale":"2023-10-08T16:09:58.340522+0000","last_undegraded":"2023-10-08T16:09:58.340522+0000","last_fullsized":"2023-10-08T16:09:58.340522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:25:15.228071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340560+0000","last_change":"2023-10-08T16:09:58.340461+0000","last_active":"2023-10-08T16:09:58.340560+0000","last_peered":"2023-10-08T16:09:58.340560+0000","last_clean":"2023-10-08T16:09:58.340560+0000","last_became_active":"2023-10-08T16:09:58.340114+0000","last_became_peered":"2023-10-08T16:09:58.340114+0000","last_unstale":"2023-10-08T16:09:58.340560+0000","last_undegraded":"2023-10-08T16:09:58.340560+0000","last_fullsized":"2023-10-08T16:09:58.340560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:28.016286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350672+0000","last_change":"2023-10-08T16:09:58.350582+0000","last_active":"2023-10-08T16:09:58.350672+0000","last_peered":"2023-10-08T16:09:58.350672+0000","last_clean":"2023-10-08T16:09:58.350672+0000","last_became_active":"2023-10-08T16:09:58.350362+0000","last_became_peered":"2023-10-08T16:09:58.350362+0000","last_unstale":"2023-10-08T16:09:58.350672+0000","last_undegraded":"2023-10-08T16:09:58.350672+0000","last_fullsized":"2023-10-08T16:09:58.350672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:32.928386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.352874+0000","last_change":"2023-10-08T16:09:58.352799+0000","last_active":"2023-10-08T16:09:58.352874+0000","last_peered":"2023-10-08T16:09:58.352874+0000","last_clean":"2023-10-08T16:09:58.352874+0000","last_became_active":"2023-10-08T16:09:58.351583+0000","last_became_peered":"2023-10-08T16:09:58.351583+0000","last_unstale":"2023-10-08T16:09:58.352874+0000","last_undegraded":"2023-10-08T16:09:58.352874+0000","last_fullsized":"2023-10-08T16:09:58.352874+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:05.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340545+0000","last_change":"2023-10-08T16:09:58.340410+0000","last_active":"2023-10-08T16:09:58.340545+0000","last_peered":"2023-10-08T16:09:58.340545+0000","last_clean":"2023-10-08T16:09:58.340545+0000","last_became_active":"2023-10-08T16:09:58.340174+0000","last_became_peered":"2023-10-08T16:09:58.340174+0000","last_unstale":"2023-10-08T16:09:58.340545+0000","last_undegraded":"2023-10-08T16:09:58.340545+0000","last_fullsized":"2023-10-08T16:09:58.340545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:28.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348323+0000","last_change":"2023-10-08T16:09:58.348199+0000","last_active":"2023-10-08T16:09:58.348323+0000","last_peered":"2023-10-08T16:09:58.348323+0000","last_clean":"2023-10-08T16:09:58.348323+0000","last_became_active":"2023-10-08T16:09:58.347857+0000","last_became_peered":"2023-10-08T16:09:58.347857+0000","last_unstale":"2023-10-08T16:09:58.348323+0000","last_undegraded":"2023-10-08T16:09:58.348323+0000","last_fullsized":"2023-10-08T16:09:58.348323+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:01.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349281+0000","last_change":"2023-10-08T16:09:58.349170+0000","last_active":"2023-10-08T16:09:58.349281+0000","last_peered":"2023-10-08T16:09:58.349281+0000","last_clean":"2023-10-08T16:09:58.349281+0000","last_became_active":"2023-10-08T16:09:58.347590+0000","last_became_peered":"2023-10-08T16:09:58.347590+0000","last_unstale":"2023-10-08T16:09:58.349281+0000","last_undegraded":"2023-10-08T16:09:58.349281+0000","last_fullsized":"2023-10-08T16:09:58.349281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:56.176466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349196+0000","last_change":"2023-10-08T16:09:58.349077+0000","last_active":"2023-10-08T16:09:58.349196+0000","last_peered":"2023-10-08T16:09:58.349196+0000","last_clean":"2023-10-08T16:09:58.349196+0000","last_became_active":"2023-10-08T16:09:58.348859+0000","last_became_peered":"2023-10-08T16:09:58.348859+0000","last_unstale":"2023-10-08T16:09:58.349196+0000","last_undegraded":"2023-10-08T16:09:58.349196+0000","last_fullsized":"2023-10-08T16:09:58.349196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:59.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353636+0000","last_change":"2023-10-08T16:09:58.353324+0000","last_active":"2023-10-08T16:09:58.353636+0000","last_peered":"2023-10-08T16:09:58.353636+0000","last_clean":"2023-10-08T16:09:58.353636+0000","last_became_active":"2023-10-08T16:09:58.352610+0000","last_became_peered":"2023-10-08T16:09:58.352610+0000","last_unstale":"2023-10-08T16:09:58.353636+0000","last_undegraded":"2023-10-08T16:09:58.353636+0000","last_fullsized":"2023-10-08T16:09:58.353636+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:59.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345666+0000","last_change":"2023-10-08T16:09:58.345354+0000","last_active":"2023-10-08T16:09:58.345666+0000","last_peered":"2023-10-08T16:09:58.345666+0000","last_clean":"2023-10-08T16:09:58.345666+0000","last_became_active":"2023-10-08T16:09:58.344962+0000","last_became_peered":"2023-10-08T16:09:58.344962+0000","last_unstale":"2023-10-08T16:09:58.345666+0000","last_undegraded":"2023-10-08T16:09:58.345666+0000","last_fullsized":"2023-10-08T16:09:58.345666+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:52.005067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344633+0000","last_change":"2023-10-08T16:09:58.344138+0000","last_active":"2023-10-08T16:09:58.344633+0000","last_peered":"2023-10-08T16:09:58.344633+0000","last_clean":"2023-10-08T16:09:58.344633+0000","last_became_active":"2023-10-08T16:09:58.343540+0000","last_became_peered":"2023-10-08T16:09:58.343540+0000","last_unstale":"2023-10-08T16:09:58.344633+0000","last_undegraded":"2023-10-08T16:09:58.344633+0000","last_fullsized":"2023-10-08T16:09:58.344633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:21.904890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349179+0000","last_change":"2023-10-08T16:09:58.348964+0000","last_active":"2023-10-08T16:09:58.349179+0000","last_peered":"2023-10-08T16:09:58.349179+0000","last_clean":"2023-10-08T16:09:58.349179+0000","last_became_active":"2023-10-08T16:09:58.348411+0000","last_became_peered":"2023-10-08T16:09:58.348411+0000","last_unstale":"2023-10-08T16:09:58.349179+0000","last_undegraded":"2023-10-08T16:09:58.349179+0000","last_fullsized":"2023-10-08T16:09:58.349179+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350097+0000","last_change":"2023-10-08T16:09:58.348499+0000","last_active":"2023-10-08T16:09:58.350097+0000","last_peered":"2023-10-08T16:09:58.350097+0000","last_clean":"2023-10-08T16:09:58.350097+0000","last_became_active":"2023-10-08T16:09:58.348240+0000","last_became_peered":"2023-10-08T16:09:58.348240+0000","last_unstale":"2023-10-08T16:09:58.350097+0000","last_undegraded":"2023-10-08T16:09:58.350097+0000","last_fullsized":"2023-10-08T16:09:58.350097+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:01.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.352067+0000","last_change":"2023-10-08T16:09:58.351826+0000","last_active":"2023-10-08T16:09:58.352067+0000","last_peered":"2023-10-08T16:09:58.352067+0000","last_clean":"2023-10-08T16:09:58.352067+0000","last_became_active":"2023-10-08T16:09:58.351431+0000","last_became_peered":"2023-10-08T16:09:58.351431+0000","last_unstale":"2023-10-08T16:09:58.352067+0000","last_undegraded":"2023-10-08T16:09:58.352067+0000","last_fullsized":"2023-10-08T16:09:58.352067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:52.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459882+0000","last_change":"2023-10-08T16:09:57.459598+0000","last_active":"2023-10-08T16:09:58.459882+0000","last_peered":"2023-10-08T16:09:58.459882+0000","last_clean":"2023-10-08T16:09:58.459882+0000","last_became_active":"2023-10-08T16:09:57.459175+0000","last_became_peered":"2023-10-08T16:09:57.459175+0000","last_unstale":"2023-10-08T16:09:58.459882+0000","last_undegraded":"2023-10-08T16:09:58.459882+0000","last_fullsized":"2023-10-08T16:09:58.459882+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:00.171570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353603+0000","last_change":"2023-10-08T16:09:58.352959+0000","last_active":"2023-10-08T16:09:58.353603+0000","last_peered":"2023-10-08T16:09:58.353603+0000","last_clean":"2023-10-08T16:09:58.353603+0000","last_became_active":"2023-10-08T16:09:58.351897+0000","last_became_peered":"2023-10-08T16:09:58.351897+0000","last_unstale":"2023-10-08T16:09:58.353603+0000","last_undegraded":"2023-10-08T16:09:58.353603+0000","last_fullsized":"2023-10-08T16:09:58.353603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459469+0000","last_change":"2023-10-08T16:09:57.460859+0000","last_active":"2023-10-08T16:09:58.459469+0000","last_peered":"2023-10-08T16:09:58.459469+0000","last_clean":"2023-10-08T16:09:58.459469+0000","last_became_active":"2023-10-08T16:09:57.460440+0000","last_became_peered":"2023-10-08T16:09:57.460440+0000","last_unstale":"2023-10-08T16:09:58.459469+0000","last_undegraded":"2023-10-08T16:09:58.459469+0000","last_fullsized":"2023-10-08T16:09:58.459469+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:25.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350075+0000","last_change":"2023-10-08T16:09:58.346865+0000","last_active":"2023-10-08T16:09:58.350075+0000","last_peered":"2023-10-08T16:09:58.350075+0000","last_clean":"2023-10-08T16:09:58.350075+0000","last_became_active":"2023-10-08T16:09:58.346476+0000","last_became_peered":"2023-10-08T16:09:58.346476+0000","last_unstale":"2023-10-08T16:09:58.350075+0000","last_undegraded":"2023-10-08T16:09:58.350075+0000","last_fullsized":"2023-10-08T16:09:58.350075+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:47.751365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459223+0000","last_change":"2023-10-08T16:09:57.459989+0000","last_active":"2023-10-08T16:09:58.459223+0000","last_peered":"2023-10-08T16:09:58.459223+0000","last_clean":"2023-10-08T16:09:58.459223+0000","last_became_active":"2023-10-08T16:09:57.459261+0000","last_became_peered":"2023-10-08T16:09:57.459261+0000","last_unstale":"2023-10-08T16:09:58.459223+0000","last_undegraded":"2023-10-08T16:09:58.459223+0000","last_fullsized":"2023-10-08T16:09:58.459223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:35.229222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350523+0000","last_change":"2023-10-08T16:09:58.350122+0000","last_active":"2023-10-08T16:09:58.350523+0000","last_peered":"2023-10-08T16:09:58.350523+0000","last_clean":"2023-10-08T16:09:58.350523+0000","last_became_active":"2023-10-08T16:09:58.349351+0000","last_became_peered":"2023-10-08T16:09:58.349351+0000","last_unstale":"2023-10-08T16:09:58.350523+0000","last_undegraded":"2023-10-08T16:09:58.350523+0000","last_fullsized":"2023-10-08T16:09:58.350523+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:03.047812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.460445+0000","last_change":"2023-10-08T16:09:57.458291+0000","last_active":"2023-10-08T16:09:58.460445+0000","last_peered":"2023-10-08T16:09:58.460445+0000","last_clean":"2023-10-08T16:09:58.460445+0000","last_became_active":"2023-10-08T16:09:57.458047+0000","last_became_peered":"2023-10-08T16:09:57.458047+0000","last_unstale":"2023-10-08T16:09:58.460445+0000","last_undegraded":"2023-10-08T16:09:58.460445+0000","last_fullsized":"2023-10-08T16:09:58.460445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:45.570376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345636+0000","last_change":"2023-10-08T16:09:58.344798+0000","last_active":"2023-10-08T16:09:58.345636+0000","last_peered":"2023-10-08T16:09:58.345636+0000","last_clean":"2023-10-08T16:09:58.345636+0000","last_became_active":"2023-10-08T16:09:58.344238+0000","last_became_peered":"2023-10-08T16:09:58.344238+0000","last_unstale":"2023-10-08T16:09:58.345636+0000","last_undegraded":"2023-10-08T16:09:58.345636+0000","last_fullsized":"2023-10-08T16:09:58.345636+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:39.145570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457454+0000","last_change":"2023-10-08T16:09:57.461077+0000","last_active":"2023-10-08T16:09:58.457454+0000","last_peered":"2023-10-08T16:09:58.457454+0000","last_clean":"2023-10-08T16:09:58.457454+0000","last_became_active":"2023-10-08T16:09:57.460092+0000","last_became_peered":"2023-10-08T16:09:57.460092+0000","last_unstale":"2023-10-08T16:09:58.457454+0000","last_undegraded":"2023-10-08T16:09:58.457454+0000","last_fullsized":"2023-10-08T16:09:58.457454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:00.171570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350802+0000","last_change":"2023-10-08T16:09:58.350507+0000","last_active":"2023-10-08T16:09:58.350802+0000","last_peered":"2023-10-08T16:09:58.350802+0000","last_clean":"2023-10-08T16:09:58.350802+0000","last_became_active":"2023-10-08T16:09:58.349944+0000","last_became_peered":"2023-10-08T16:09:58.349944+0000","last_unstale":"2023-10-08T16:09:58.350802+0000","last_undegraded":"2023-10-08T16:09:58.350802+0000","last_fullsized":"2023-10-08T16:09:58.350802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:01.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457558+0000","last_change":"2023-10-08T16:09:57.461980+0000","last_active":"2023-10-08T16:09:58.457558+0000","last_peered":"2023-10-08T16:09:58.457558+0000","last_clean":"2023-10-08T16:09:58.457558+0000","last_became_active":"2023-10-08T16:09:57.461730+0000","last_became_peered":"2023-10-08T16:09:57.461730+0000","last_unstale":"2023-10-08T16:09:58.457558+0000","last_undegraded":"2023-10-08T16:09:58.457558+0000","last_fullsized":"2023-10-08T16:09:58.457558+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:31.923896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350543+0000","last_change":"2023-10-08T16:09:58.350262+0000","last_active":"2023-10-08T16:09:58.350543+0000","last_peered":"2023-10-08T16:09:58.350543+0000","last_clean":"2023-10-08T16:09:58.350543+0000","last_became_active":"2023-10-08T16:09:58.349634+0000","last_became_peered":"2023-10-08T16:09:58.349634+0000","last_unstale":"2023-10-08T16:09:58.350543+0000","last_undegraded":"2023-10-08T16:09:58.350543+0000","last_fullsized":"2023-10-08T16:09:58.350543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.337368+0000","last_change":"2023-10-08T16:09:57.458331+0000","last_active":"2023-10-08T16:09:58.337368+0000","last_peered":"2023-10-08T16:09:58.337368+0000","last_clean":"2023-10-08T16:09:58.337368+0000","last_became_active":"2023-10-08T16:09:57.458048+0000","last_became_peered":"2023-10-08T16:09:57.458048+0000","last_unstale":"2023-10-08T16:09:58.337368+0000","last_undegraded":"2023-10-08T16:09:58.337368+0000","last_fullsized":"2023-10-08T16:09:58.337368+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:09.607325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.342409+0000","last_change":"2023-10-08T16:09:58.342335+0000","last_active":"2023-10-08T16:09:58.342409+0000","last_peered":"2023-10-08T16:09:58.342409+0000","last_clean":"2023-10-08T16:09:58.342409+0000","last_became_active":"2023-10-08T16:09:58.342105+0000","last_became_peered":"2023-10-08T16:09:58.342105+0000","last_unstale":"2023-10-08T16:09:58.342409+0000","last_undegraded":"2023-10-08T16:09:58.342409+0000","last_fullsized":"2023-10-08T16:09:58.342409+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:19:15.430515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340866+0000","last_change":"2023-10-08T16:09:57.455637+0000","last_active":"2023-10-08T16:09:58.340866+0000","last_peered":"2023-10-08T16:09:58.340866+0000","last_clean":"2023-10-08T16:09:58.340866+0000","last_became_active":"2023-10-08T16:09:57.455413+0000","last_became_peered":"2023-10-08T16:09:57.455413+0000","last_unstale":"2023-10-08T16:09:58.340866+0000","last_undegraded":"2023-10-08T16:09:58.340866+0000","last_fullsized":"2023-10-08T16:09:58.340866+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:27.970845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346003+0000","last_change":"2023-10-08T16:09:58.345939+0000","last_active":"2023-10-08T16:09:58.346003+0000","last_peered":"2023-10-08T16:09:58.346003+0000","last_clean":"2023-10-08T16:09:58.346003+0000","last_became_active":"2023-10-08T16:09:58.345703+0000","last_became_peered":"2023-10-08T16:09:58.345703+0000","last_unstale":"2023-10-08T16:09:58.346003+0000","last_undegraded":"2023-10-08T16:09:58.346003+0000","last_fullsized":"2023-10-08T16:09:58.346003+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:41.055382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340582+0000","last_change":"2023-10-08T16:09:57.457203+0000","last_active":"2023-10-08T16:09:58.340582+0000","last_peered":"2023-10-08T16:09:58.340582+0000","last_clean":"2023-10-08T16:09:58.340582+0000","last_became_active":"2023-10-08T16:09:57.456761+0000","last_became_peered":"2023-10-08T16:09:57.456761+0000","last_unstale":"2023-10-08T16:09:58.340582+0000","last_undegraded":"2023-10-08T16:09:58.340582+0000","last_fullsized":"2023-10-08T16:09:58.340582+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:55:35.539175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344531+0000","last_change":"2023-10-08T16:09:58.344021+0000","last_active":"2023-10-08T16:09:58.344531+0000","last_peered":"2023-10-08T16:09:58.344531+0000","last_clean":"2023-10-08T16:09:58.344531+0000","last_became_active":"2023-10-08T16:09:58.343554+0000","last_became_peered":"2023-10-08T16:09:58.343554+0000","last_unstale":"2023-10-08T16:09:58.344531+0000","last_undegraded":"2023-10-08T16:09:58.344531+0000","last_fullsized":"2023-10-08T16:09:58.344531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:17.847851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340300+0000","last_change":"2023-10-08T16:09:57.462116+0000","last_active":"2023-10-08T16:09:58.340300+0000","last_peered":"2023-10-08T16:09:58.340300+0000","last_clean":"2023-10-08T16:09:58.340300+0000","last_became_active":"2023-10-08T16:09:57.461904+0000","last_became_peered":"2023-10-08T16:09:57.461904+0000","last_unstale":"2023-10-08T16:09:58.340300+0000","last_undegraded":"2023-10-08T16:09:58.340300+0000","last_fullsized":"2023-10-08T16:09:58.340300+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:38.367737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348296+0000","last_change":"2023-10-08T16:09:58.347836+0000","last_active":"2023-10-08T16:09:58.348296+0000","last_peered":"2023-10-08T16:09:58.348296+0000","last_clean":"2023-10-08T16:09:58.348296+0000","last_became_active":"2023-10-08T16:09:58.345878+0000","last_became_peered":"2023-10-08T16:09:58.345878+0000","last_unstale":"2023-10-08T16:09:58.348296+0000","last_undegraded":"2023-10-08T16:09:58.348296+0000","last_fullsized":"2023-10-08T16:09:58.348296+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459804+0000","last_change":"2023-10-08T16:09:57.461409+0000","last_active":"2023-10-08T16:09:58.459804+0000","last_peered":"2023-10-08T16:09:58.459804+0000","last_clean":"2023-10-08T16:09:58.459804+0000","last_became_active":"2023-10-08T16:09:57.461168+0000","last_became_peered":"2023-10-08T16:09:57.461168+0000","last_unstale":"2023-10-08T16:09:58.459804+0000","last_undegraded":"2023-10-08T16:09:58.459804+0000","last_fullsized":"2023-10-08T16:09:58.459804+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:34.778433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349566+0000","last_change":"2023-10-08T16:09:58.349285+0000","last_active":"2023-10-08T16:09:58.349566+0000","last_peered":"2023-10-08T16:09:58.349566+0000","last_clean":"2023-10-08T16:09:58.349566+0000","last_became_active":"2023-10-08T16:09:58.346749+0000","last_became_peered":"2023-10-08T16:09:58.346749+0000","last_unstale":"2023-10-08T16:09:58.349566+0000","last_undegraded":"2023-10-08T16:09:58.349566+0000","last_fullsized":"2023-10-08T16:09:58.349566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.462095+0000","last_change":"2023-10-08T16:09:57.456879+0000","last_active":"2023-10-08T16:09:58.462095+0000","last_peered":"2023-10-08T16:09:58.462095+0000","last_clean":"2023-10-08T16:09:58.462095+0000","last_became_active":"2023-10-08T16:09:57.456670+0000","last_became_peered":"2023-10-08T16:09:57.456670+0000","last_unstale":"2023-10-08T16:09:58.462095+0000","last_undegraded":"2023-10-08T16:09:58.462095+0000","last_fullsized":"2023-10-08T16:09:58.462095+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:25.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345596+0000","last_change":"2023-10-08T16:09:58.345497+0000","last_active":"2023-10-08T16:09:58.345596+0000","last_peered":"2023-10-08T16:09:58.345596+0000","last_clean":"2023-10-08T16:09:58.345596+0000","last_became_active":"2023-10-08T16:09:58.345133+0000","last_became_peered":"2023-10-08T16:09:58.345133+0000","last_unstale":"2023-10-08T16:09:58.345596+0000","last_undegraded":"2023-10-08T16:09:58.345596+0000","last_fullsized":"2023-10-08T16:09:58.345596+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:56.176466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.458624+0000","last_change":"2023-10-08T16:09:57.457354+0000","last_active":"2023-10-08T16:09:58.458624+0000","last_peered":"2023-10-08T16:09:58.458624+0000","last_clean":"2023-10-08T16:09:58.458624+0000","last_became_active":"2023-10-08T16:09:57.457081+0000","last_became_peered":"2023-10-08T16:09:57.457081+0000","last_unstale":"2023-10-08T16:09:58.458624+0000","last_undegraded":"2023-10-08T16:09:58.458624+0000","last_fullsized":"2023-10-08T16:09:58.458624+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:09:13.062036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350560+0000","last_change":"2023-10-08T16:09:58.350400+0000","last_active":"2023-10-08T16:09:58.350560+0000","last_peered":"2023-10-08T16:09:58.350560+0000","last_clean":"2023-10-08T16:09:58.350560+0000","last_became_active":"2023-10-08T16:09:58.349899+0000","last_became_peered":"2023-10-08T16:09:58.349899+0000","last_unstale":"2023-10-08T16:09:58.350560+0000","last_undegraded":"2023-10-08T16:09:58.350560+0000","last_fullsized":"2023-10-08T16:09:58.350560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:05.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.341344+0000","last_change":"2023-10-08T16:09:57.463181+0000","last_active":"2023-10-08T16:09:58.341344+0000","last_peered":"2023-10-08T16:09:58.341344+0000","last_clean":"2023-10-08T16:09:58.341344+0000","last_became_active":"2023-10-08T16:09:57.462953+0000","last_became_peered":"2023-10-08T16:09:57.462953+0000","last_unstale":"2023-10-08T16:09:58.341344+0000","last_undegraded":"2023-10-08T16:09:58.341344+0000","last_fullsized":"2023-10-08T16:09:58.341344+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:55.171975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344651+0000","last_change":"2023-10-08T16:09:58.344463+0000","last_active":"2023-10-08T16:09:58.344651+0000","last_peered":"2023-10-08T16:09:58.344651+0000","last_clean":"2023-10-08T16:09:58.344651+0000","last_became_active":"2023-10-08T16:09:58.343909+0000","last_became_peered":"2023-10-08T16:09:58.343909+0000","last_unstale":"2023-10-08T16:09:58.344651+0000","last_undegraded":"2023-10-08T16:09:58.344651+0000","last_fullsized":"2023-10-08T16:09:58.344651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:04.472396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.338330+0000","last_change":"2023-10-08T16:09:57.460566+0000","last_active":"2023-10-08T16:09:58.338330+0000","last_peered":"2023-10-08T16:09:58.338330+0000","last_clean":"2023-10-08T16:09:58.338330+0000","last_became_active":"2023-10-08T16:09:57.460341+0000","last_became_peered":"2023-10-08T16:09:57.460341+0000","last_unstale":"2023-10-08T16:09:58.338330+0000","last_undegraded":"2023-10-08T16:09:58.338330+0000","last_fullsized":"2023-10-08T16:09:58.338330+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:31.923896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347693+0000","last_change":"2023-10-08T16:09:58.347388+0000","last_active":"2023-10-08T16:09:58.347693+0000","last_peered":"2023-10-08T16:09:58.347693+0000","last_clean":"2023-10-08T16:09:58.347693+0000","last_became_active":"2023-10-08T16:09:58.347169+0000","last_became_peered":"2023-10-08T16:09:58.347169+0000","last_unstale":"2023-10-08T16:09:58.347693+0000","last_undegraded":"2023-10-08T16:09:58.347693+0000","last_fullsized":"2023-10-08T16:09:58.347693+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:26.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.460259+0000","last_change":"2023-10-08T16:09:57.461215+0000","last_active":"2023-10-08T16:09:58.460259+0000","last_peered":"2023-10-08T16:09:58.460259+0000","last_clean":"2023-10-08T16:09:58.460259+0000","last_became_active":"2023-10-08T16:09:57.461003+0000","last_became_peered":"2023-10-08T16:09:57.461003+0000","last_unstale":"2023-10-08T16:09:58.460259+0000","last_undegraded":"2023-10-08T16:09:58.460259+0000","last_fullsized":"2023-10-08T16:09:58.460259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:00.171570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348702+0000","last_change":"2023-10-08T16:09:58.348534+0000","last_active":"2023-10-08T16:09:58.348702+0000","last_peered":"2023-10-08T16:09:58.348702+0000","last_clean":"2023-10-08T16:09:58.348702+0000","last_became_active":"2023-10-08T16:09:58.348334+0000","last_became_peered":"2023-10-08T16:09:58.348334+0000","last_unstale":"2023-10-08T16:09:58.348702+0000","last_undegraded":"2023-10-08T16:09:58.348702+0000","last_fullsized":"2023-10-08T16:09:58.348702+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.456637+0000","last_change":"2023-10-08T16:09:57.457685+0000","last_active":"2023-10-08T16:09:58.456637+0000","last_peered":"2023-10-08T16:09:58.456637+0000","last_clean":"2023-10-08T16:09:58.456637+0000","last_became_active":"2023-10-08T16:09:57.457449+0000","last_became_peered":"2023-10-08T16:09:57.457449+0000","last_unstale":"2023-10-08T16:09:58.456637+0000","last_undegraded":"2023-10-08T16:09:58.456637+0000","last_fullsized":"2023-10-08T16:09:58.456637+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.054728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350141+0000","last_change":"2023-10-08T16:09:58.349809+0000","last_active":"2023-10-08T16:09:58.350141+0000","last_peered":"2023-10-08T16:09:58.350141+0000","last_clean":"2023-10-08T16:09:58.350141+0000","last_became_active":"2023-10-08T16:09:58.345474+0000","last_became_peered":"2023-10-08T16:09:58.345474+0000","last_unstale":"2023-10-08T16:09:58.350141+0000","last_undegraded":"2023-10-08T16:09:58.350141+0000","last_fullsized":"2023-10-08T16:09:58.350141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.460643+0000","last_change":"2023-10-08T16:09:57.459837+0000","last_active":"2023-10-08T16:09:58.460643+0000","last_peered":"2023-10-08T16:09:58.460643+0000","last_clean":"2023-10-08T16:09:58.460643+0000","last_became_active":"2023-10-08T16:09:57.458869+0000","last_became_peered":"2023-10-08T16:09:57.458869+0000","last_unstale":"2023-10-08T16:09:58.460643+0000","last_undegraded":"2023-10-08T16:09:58.460643+0000","last_fullsized":"2023-10-08T16:09:58.460643+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:16.843360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349212+0000","last_change":"2023-10-08T16:09:58.349116+0000","last_active":"2023-10-08T16:09:58.349212+0000","last_peered":"2023-10-08T16:09:58.349212+0000","last_clean":"2023-10-08T16:09:58.349212+0000","last_became_active":"2023-10-08T16:09:58.348712+0000","last_became_peered":"2023-10-08T16:09:58.348712+0000","last_unstale":"2023-10-08T16:09:58.349212+0000","last_undegraded":"2023-10-08T16:09:58.349212+0000","last_fullsized":"2023-10-08T16:09:58.349212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.338262+0000","last_change":"2023-10-08T16:09:57.457918+0000","last_active":"2023-10-08T16:09:58.338262+0000","last_peered":"2023-10-08T16:09:58.338262+0000","last_clean":"2023-10-08T16:09:58.338262+0000","last_became_active":"2023-10-08T16:09:57.457680+0000","last_became_peered":"2023-10-08T16:09:57.457680+0000","last_unstale":"2023-10-08T16:09:58.338262+0000","last_undegraded":"2023-10-08T16:09:58.338262+0000","last_fullsized":"2023-10-08T16:09:58.338262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:38.141079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344881+0000","last_change":"2023-10-08T16:09:58.344492+0000","last_active":"2023-10-08T16:09:58.344881+0000","last_peered":"2023-10-08T16:09:58.344881+0000","last_clean":"2023-10-08T16:09:58.344881+0000","last_became_active":"2023-10-08T16:09:58.344139+0000","last_became_peered":"2023-10-08T16:09:58.344139+0000","last_unstale":"2023-10-08T16:09:58.344881+0000","last_undegraded":"2023-10-08T16:09:58.344881+0000","last_fullsized":"2023-10-08T16:09:58.344881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:09:14.066527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457959+0000","last_change":"2023-10-08T16:09:57.461182+0000","last_active":"2023-10-08T16:09:58.457959+0000","last_peered":"2023-10-08T16:09:58.457959+0000","last_clean":"2023-10-08T16:09:58.457959+0000","last_became_active":"2023-10-08T16:09:57.460675+0000","last_became_peered":"2023-10-08T16:09:57.460675+0000","last_unstale":"2023-10-08T16:09:58.457959+0000","last_undegraded":"2023-10-08T16:09:58.457959+0000","last_fullsized":"2023-10-08T16:09:58.457959+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:19.484204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345192+0000","last_change":"2023-10-08T16:09:58.345048+0000","last_active":"2023-10-08T16:09:58.345192+0000","last_peered":"2023-10-08T16:09:58.345192+0000","last_clean":"2023-10-08T16:09:58.345192+0000","last_became_active":"2023-10-08T16:09:58.344213+0000","last_became_peered":"2023-10-08T16:09:58.344213+0000","last_unstale":"2023-10-08T16:09:58.345192+0000","last_undegraded":"2023-10-08T16:09:58.345192+0000","last_fullsized":"2023-10-08T16:09:58.345192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.337466+0000","last_change":"2023-10-08T16:09:57.457882+0000","last_active":"2023-10-08T16:09:58.337466+0000","last_peered":"2023-10-08T16:09:58.337466+0000","last_clean":"2023-10-08T16:09:58.337466+0000","last_became_active":"2023-10-08T16:09:57.457652+0000","last_became_peered":"2023-10-08T16:09:57.457652+0000","last_unstale":"2023-10-08T16:09:58.337466+0000","last_undegraded":"2023-10-08T16:09:58.337466+0000","last_fullsized":"2023-10-08T16:09:58.337466+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:16.307948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.343214+0000","last_change":"2023-10-08T16:09:58.342966+0000","last_active":"2023-10-08T16:09:58.343214+0000","last_peered":"2023-10-08T16:09:58.343214+0000","last_clean":"2023-10-08T16:09:58.343214+0000","last_became_active":"2023-10-08T16:09:58.342723+0000","last_became_peered":"2023-10-08T16:09:58.342723+0000","last_unstale":"2023-10-08T16:09:58.343214+0000","last_undegraded":"2023-10-08T16:09:58.343214+0000","last_fullsized":"2023-10-08T16:09:58.343214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:21.480180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.336755+0000","last_change":"2023-10-08T16:09:57.460189+0000","last_active":"2023-10-08T16:09:58.336755+0000","last_peered":"2023-10-08T16:09:58.336755+0000","last_clean":"2023-10-08T16:09:58.336755+0000","last_became_active":"2023-10-08T16:09:57.459783+0000","last_became_peered":"2023-10-08T16:09:57.459783+0000","last_unstale":"2023-10-08T16:09:58.336755+0000","last_undegraded":"2023-10-08T16:09:58.336755+0000","last_fullsized":"2023-10-08T16:09:58.336755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:42.808280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.339389+0000","last_change":"2023-10-08T16:09:58.339168+0000","last_active":"2023-10-08T16:09:58.339389+0000","last_peered":"2023-10-08T16:09:58.339389+0000","last_clean":"2023-10-08T16:09:58.339389+0000","last_became_active":"2023-10-08T16:09:58.338968+0000","last_became_peered":"2023-10-08T16:09:58.338968+0000","last_unstale":"2023-10-08T16:09:58.339389+0000","last_undegraded":"2023-10-08T16:09:58.339389+0000","last_fullsized":"2023-10-08T16:09:58.339389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:06.806747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.341448+0000","last_change":"2023-10-08T16:09:57.458110+0000","last_active":"2023-10-08T16:09:58.341448+0000","last_peered":"2023-10-08T16:09:58.341448+0000","last_clean":"2023-10-08T16:09:58.341448+0000","last_became_active":"2023-10-08T16:09:57.457891+0000","last_became_peered":"2023-10-08T16:09:57.457891+0000","last_unstale":"2023-10-08T16:09:58.341448+0000","last_undegraded":"2023-10-08T16:09:58.341448+0000","last_fullsized":"2023-10-08T16:09:58.341448+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:19.879197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349582+0000","last_change":"2023-10-08T16:09:58.349434+0000","last_active":"2023-10-08T16:09:58.349582+0000","last_peered":"2023-10-08T16:09:58.349582+0000","last_clean":"2023-10-08T16:09:58.349582+0000","last_became_active":"2023-10-08T16:09:58.347059+0000","last_became_peered":"2023-10-08T16:09:58.347059+0000","last_unstale":"2023-10-08T16:09:58.349582+0000","last_undegraded":"2023-10-08T16:09:58.349582+0000","last_fullsized":"2023-10-08T16:09:58.349582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459706+0000","last_change":"2023-10-08T16:09:57.462624+0000","last_active":"2023-10-08T16:09:58.459706+0000","last_peered":"2023-10-08T16:09:58.459706+0000","last_clean":"2023-10-08T16:09:58.459706+0000","last_became_active":"2023-10-08T16:09:57.462158+0000","last_became_peered":"2023-10-08T16:09:57.462158+0000","last_unstale":"2023-10-08T16:09:58.459706+0000","last_undegraded":"2023-10-08T16:09:58.459706+0000","last_fullsized":"2023-10-08T16:09:58.459706+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:19.608371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.351021+0000","last_change":"2023-10-08T16:09:58.350952+0000","last_active":"2023-10-08T16:09:58.351021+0000","last_peered":"2023-10-08T16:09:58.351021+0000","last_clean":"2023-10-08T16:09:58.351021+0000","last_became_active":"2023-10-08T16:09:58.350688+0000","last_became_peered":"2023-10-08T16:09:58.350688+0000","last_unstale":"2023-10-08T16:09:58.351021+0000","last_undegraded":"2023-10-08T16:09:58.351021+0000","last_fullsized":"2023-10-08T16:09:58.351021+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.341953+0000","last_change":"2023-10-08T16:09:57.458382+0000","last_active":"2023-10-08T16:09:58.341953+0000","last_peered":"2023-10-08T16:09:58.341953+0000","last_clean":"2023-10-08T16:09:58.341953+0000","last_became_active":"2023-10-08T16:09:57.458202+0000","last_became_peered":"2023-10-08T16:09:57.458202+0000","last_unstale":"2023-10-08T16:09:58.341953+0000","last_undegraded":"2023-10-08T16:09:58.341953+0000","last_fullsized":"2023-10-08T16:09:58.341953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:25:14.223580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350113+0000","last_change":"2023-10-08T16:09:58.348807+0000","last_active":"2023-10-08T16:09:58.350113+0000","last_peered":"2023-10-08T16:09:58.350113+0000","last_clean":"2023-10-08T16:09:58.350113+0000","last_became_active":"2023-10-08T16:09:58.348566+0000","last_became_peered":"2023-10-08T16:09:58.348566+0000","last_unstale":"2023-10-08T16:09:58.350113+0000","last_undegraded":"2023-10-08T16:09:58.350113+0000","last_fullsized":"2023-10-08T16:09:58.350113+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:20.157184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340557+0000","last_change":"2023-10-08T16:09:57.459795+0000","last_active":"2023-10-08T16:09:58.340557+0000","last_peered":"2023-10-08T16:09:58.340557+0000","last_clean":"2023-10-08T16:09:58.340557+0000","last_became_active":"2023-10-08T16:09:57.459542+0000","last_became_peered":"2023-10-08T16:09:57.459542+0000","last_unstale":"2023-10-08T16:09:58.340557+0000","last_undegraded":"2023-10-08T16:09:58.340557+0000","last_fullsized":"2023-10-08T16:09:58.340557+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:53.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.351738+0000","last_change":"2023-10-08T16:09:58.351641+0000","last_active":"2023-10-08T16:09:58.351738+0000","last_peered":"2023-10-08T16:09:58.351738+0000","last_clean":"2023-10-08T16:09:58.351738+0000","last_became_active":"2023-10-08T16:09:58.351021+0000","last_became_peered":"2023-10-08T16:09:58.351021+0000","last_unstale":"2023-10-08T16:09:58.351738+0000","last_undegraded":"2023-10-08T16:09:58.351738+0000","last_fullsized":"2023-10-08T16:09:58.351738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:05.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.342117+0000","last_change":"2023-10-08T16:09:57.457330+0000","last_active":"2023-10-08T16:09:58.342117+0000","last_peered":"2023-10-08T16:09:58.342117+0000","last_clean":"2023-10-08T16:09:58.342117+0000","last_became_active":"2023-10-08T16:09:57.456790+0000","last_became_peered":"2023-10-08T16:09:57.456790+0000","last_unstale":"2023-10-08T16:09:58.342117+0000","last_undegraded":"2023-10-08T16:09:58.342117+0000","last_fullsized":"2023-10-08T16:09:58.342117+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:31.923896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344510+0000","last_change":"2023-10-08T16:09:58.343910+0000","last_active":"2023-10-08T16:09:58.344510+0000","last_peered":"2023-10-08T16:09:58.344510+0000","last_clean":"2023-10-08T16:09:58.344510+0000","last_became_active":"2023-10-08T16:09:58.343174+0000","last_became_peered":"2023-10-08T16:09:58.343174+0000","last_unstale":"2023-10-08T16:09:58.344510+0000","last_undegraded":"2023-10-08T16:09:58.344510+0000","last_fullsized":"2023-10-08T16:09:58.344510+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:42.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.337831+0000","last_change":"2023-10-08T16:09:57.461686+0000","last_active":"2023-10-08T16:09:58.337831+0000","last_peered":"2023-10-08T16:09:58.337831+0000","last_clean":"2023-10-08T16:09:58.337831+0000","last_became_active":"2023-10-08T16:09:57.461453+0000","last_became_peered":"2023-10-08T16:09:57.461453+0000","last_unstale":"2023-10-08T16:09:58.337831+0000","last_undegraded":"2023-10-08T16:09:58.337831+0000","last_fullsized":"2023-10-08T16:09:58.337831+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:51.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345577+0000","last_change":"2023-10-08T16:09:58.345354+0000","last_active":"2023-10-08T16:09:58.345577+0000","last_peered":"2023-10-08T16:09:58.345577+0000","last_clean":"2023-10-08T16:09:58.345577+0000","last_became_active":"2023-10-08T16:09:58.344821+0000","last_became_peered":"2023-10-08T16:09:58.344821+0000","last_unstale":"2023-10-08T16:09:58.345577+0000","last_undegraded":"2023-10-08T16:09:58.345577+0000","last_fullsized":"2023-10-08T16:09:58.345577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347710+0000","last_change":"2023-10-08T16:09:57.461524+0000","last_active":"2023-10-08T16:09:58.347710+0000","last_peered":"2023-10-08T16:09:58.347710+0000","last_clean":"2023-10-08T16:09:58.347710+0000","last_became_active":"2023-10-08T16:09:57.460632+0000","last_became_peered":"2023-10-08T16:09:57.460632+0000","last_unstale":"2023-10-08T16:09:58.347710+0000","last_undegraded":"2023-10-08T16:09:58.347710+0000","last_fullsized":"2023-10-08T16:09:58.347710+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:34.778433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345695+0000","last_change":"2023-10-08T16:09:58.345557+0000","last_active":"2023-10-08T16:09:58.345695+0000","last_peered":"2023-10-08T16:09:58.345695+0000","last_clean":"2023-10-08T16:09:58.345695+0000","last_became_active":"2023-10-08T16:09:58.345322+0000","last_became_peered":"2023-10-08T16:09:58.345322+0000","last_unstale":"2023-10-08T16:09:58.345695+0000","last_undegraded":"2023-10-08T16:09:58.345695+0000","last_fullsized":"2023-10-08T16:09:58.345695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346358+0000","last_change":"2023-10-08T16:09:57.455674+0000","last_active":"2023-10-08T16:09:58.346358+0000","last_peered":"2023-10-08T16:09:58.346358+0000","last_clean":"2023-10-08T16:09:58.346358+0000","last_became_active":"2023-10-08T16:09:57.455389+0000","last_became_peered":"2023-10-08T16:09:57.455389+0000","last_unstale":"2023-10-08T16:09:58.346358+0000","last_undegraded":"2023-10-08T16:09:58.346358+0000","last_fullsized":"2023-10-08T16:09:58.346358+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:25.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353621+0000","last_change":"2023-10-08T16:09:58.353140+0000","last_active":"2023-10-08T16:09:58.353621+0000","last_peered":"2023-10-08T16:09:58.353621+0000","last_clean":"2023-10-08T16:09:58.353621+0000","last_became_active":"2023-10-08T16:09:58.352218+0000","last_became_peered":"2023-10-08T16:09:58.352218+0000","last_unstale":"2023-10-08T16:09:58.353621+0000","last_undegraded":"2023-10-08T16:09:58.353621+0000","last_fullsized":"2023-10-08T16:09:58.353621+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:52.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.343447+0000","last_change":"2023-10-08T16:09:57.460683+0000","last_active":"2023-10-08T16:09:58.343447+0000","last_peered":"2023-10-08T16:09:58.343447+0000","last_clean":"2023-10-08T16:09:58.343447+0000","last_became_active":"2023-10-08T16:09:57.459926+0000","last_became_peered":"2023-10-08T16:09:57.459926+0000","last_unstale":"2023-10-08T16:09:58.343447+0000","last_undegraded":"2023-10-08T16:09:58.343447+0000","last_fullsized":"2023-10-08T16:09:58.343447+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:53.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346363+0000","last_change":"2023-10-08T16:09:58.346286+0000","last_active":"2023-10-08T16:09:58.346363+0000","last_peered":"2023-10-08T16:09:58.346363+0000","last_clean":"2023-10-08T16:09:58.346363+0000","last_became_active":"2023-10-08T16:09:58.346046+0000","last_became_peered":"2023-10-08T16:09:58.346046+0000","last_unstale":"2023-10-08T16:09:58.346363+0000","last_undegraded":"2023-10-08T16:09:58.346363+0000","last_fullsized":"2023-10-08T16:09:58.346363+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:39.372228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457675+0000","last_change":"2023-10-08T16:09:57.463602+0000","last_active":"2023-10-08T16:09:58.457675+0000","last_peered":"2023-10-08T16:09:58.457675+0000","last_clean":"2023-10-08T16:09:58.457675+0000","last_became_active":"2023-10-08T16:09:57.463472+0000","last_became_peered":"2023-10-08T16:09:57.463472+0000","last_unstale":"2023-10-08T16:09:58.457675+0000","last_undegraded":"2023-10-08T16:09:58.457675+0000","last_fullsized":"2023-10-08T16:09:58.457675+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:34.778433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340095+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:09:58.340095+0000","last_peered":"2023-10-08T16:09:58.340095+0000","last_clean":"2023-10-08T16:09:58.340095+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:09:58.340095+0000","last_undegraded":"2023-10-08T16:09:58.340095+0000","last_fullsized":"2023-10-08T16:09:58.340095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198894107,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.438}]},{"osd":1,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73399999999999999,"5min":1.756,"15min":1.756},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72499999999999998,"5min":1.79,"15min":1.79},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":1.823,"15min":1.823},"last":0.56599999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.44400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":1.252,"15min":1.252},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.504},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.745,"15min":0.745},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.433},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.43099999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199484351,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.434,"15min":0.49199999999999999},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.59899999999999998,"5min":3.593,"15min":3.593},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.37}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.433,"15min":0.47899999999999998},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63700000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63500000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.61299999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.28999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64100000000000001,"15min":0.629},"min":{"1min":0.505,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90800000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54900000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.35299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83799999999999997,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":3.532,"15min":3.532},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81100000000000005,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.745},"min":{"1min":0.44800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.095,"15min":1.095},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0289999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.53800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198894143,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48899999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.66600000000000004,"5min":2.254,"15min":2.254},"last":0.30399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.379},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58199999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72999999999999998,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.373}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.378},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83399999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91500000000000004,"5min":1.079,"15min":1.079},"last":0.54900000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.875,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93799999999999994,"5min":2.355,"15min":2.355},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64200000000000002,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98199999999999998,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":1.002,"15min":1.002},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483991,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.246,"5min":0.185,"15min":0.185},"max":{"1min":0.52900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.374},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40799999999999997,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56499999999999995,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.746,"15min":0.746},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61699999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.44},"min":{"1min":0.32000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.44500000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.018,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.67000000000000004},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.046,"5min":1.091,"15min":1.091},"last":0.441},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.499,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199483009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34000000000000002,"15min":0.313},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44900000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.45000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.56299999999999994,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.46800000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41399999999999998,"15min":0.39400000000000002},"min":{"1min":0.28999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.754,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69599999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.621,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.498}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78000000000000003,"5min":0.999,"15min":0.999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76800000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194809,"statfs":{"total":200000000,"available":199484545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73299999999999998,"5min":1.141,"15min":1.141},"last":0.503},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76300000000000001,"5min":1.149,"15min":1.149},"last":0.76900000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67900000000000005,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.753,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.627},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.69599999999999995,"15min":0.59999999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75800000000000001,"5min":14.6,"15min":14.6},"last":0.73399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.629,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74199999999999999,"5min":7.556,"15min":7.556},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69299999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.78700000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60299999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63100000000000001,"5min":0.754,"15min":0.754},"last":0.435}]},{"osd":6,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.61199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.61699999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199482987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51000000000000001,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57799999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.622},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71499999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61799999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59799999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58499999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60899999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:10:02.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:02.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.709+0000 7f94d532a700 1 Processor -- start 2023-10-08T16:10:02.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.709+0000 7f94d532a700 1 -- start start 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94d532a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f94d006ac30 0x7f94d0164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94d532a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d015c360 con 0x7f94d01577d0 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94d532a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d015b790 con 0x7f94d0157ba0 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94d532a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d015d800 con 0x7f94d006ac30 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94cf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f94d006ac30 0x7f94d0164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94ceffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f94d01577d0 0x7f94d00cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58056/0 (socket says 172.21.15.60:58056) 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.710+0000 7f94ceffd700 1 -- 172.21.15.60:0/1666178682 learned_addr learned my addr 172.21.15.60:0/1666178682 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cf7fe700 1 -- 172.21.15.60:0/1666178682 >> v1:172.21.15.144:6789/0 conn(0x7f94d0157ba0 legacy=0x7f94d006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cf7fe700 1 -- 172.21.15.60:0/1666178682 >> v1:172.21.15.60:6789/0 conn(0x7f94d01577d0 legacy=0x7f94d00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cf7fe700 1 -- 172.21.15.60:0/1666178682 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d015ba30 con 0x7f94d006ac30 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cdffb700 1 -- 172.21.15.60:0/1666178682 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354373636 0 0) 0x7f94d015c360 con 0x7f94d01577d0 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cf7fe700 1 --2- 172.21.15.60:0/1666178682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d006ac30 0x7f94d0164e30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009e60 tx=0x7f94c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb9fb399952c2e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cdffb700 1 -- 172.21.15.60:0/1666178682 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000e070 con 0x7f94d006ac30 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cdffb700 1 -- 172.21.15.60:0/1666178682 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000bbf0 con 0x7f94d006ac30 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94cdffb700 1 -- 172.21.15.60:0/1666178682 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0012430 con 0x7f94d006ac30 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 -- 172.21.15.60:0/1666178682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d006ac30 msgr2=0x7f94d0164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 --2- 172.21.15.60:0/1666178682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d006ac30 0x7f94d0164e30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009e60 tx=0x7f94c0009780 comp rx=0 tx=0).stop 2023-10-08T16:10:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 -- 172.21.15.60:0/1666178682 shutdown_connections 2023-10-08T16:10:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 --2- 172.21.15.60:0/1666178682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d006ac30 0x7f94d0164e30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 -- 172.21.15.60:0/1666178682 >> 172.21.15.60:0/1666178682 conn(0x7f94d0068ce0 msgr2=0x7f94d00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 -- 172.21.15.60:0/1666178682 shutdown_connections 2023-10-08T16:10:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.711+0000 7f94d532a700 1 -- 172.21.15.60:0/1666178682 wait complete. 2023-10-08T16:10:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 Processor -- start 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 -- start start 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94d006ac30 0x7f94d016b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 0x7f94d014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94d0157ba0 0x7f94d01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d014dec0 con 0x7f94d01577d0 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01597e0 con 0x7f94d0157ba0 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94d532a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01586f0 con 0x7f94d006ac30 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94ce7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 0x7f94d014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94ce7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 0x7f94d014d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48092/0 (socket says 172.21.15.60:48092) 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.713+0000 7f94ce7fc700 1 -- 172.21.15.60:0/1101714908 learned_addr learned my addr 172.21.15.60:0/1101714908 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ceffd700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94d006ac30 0x7f94d016b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94cf7fe700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94d0157ba0 0x7f94d01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ce7fc700 1 -- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94d006ac30 msgr2=0x7f94d016b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ce7fc700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94d006ac30 0x7f94d016b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ce7fc700 1 -- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94d0157ba0 msgr2=0x7f94d01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ce7fc700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94d0157ba0 0x7f94d01581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ce7fc700 1 -- 172.21.15.60:0/1101714908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c0009a20 con 0x7f94d01577d0 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94cf7fe700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94d0157ba0 0x7f94d01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94ce7fc700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 0x7f94d014d980 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f94b800b5e0 tx=0x7f94b8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800f510 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b800f670 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800fa30 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d0158990 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.714+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d0158f50 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.715+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d01595b0 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.716+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94b801a400 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.716+0000 7f94c6ffd700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f94b0066f30 0x7f94b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.716+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94b8084020 con 0x7f94d01577d0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.716+0000 7f94ceffd700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f94b0066f30 0x7f94b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.717+0000 7f94ceffd700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f94b0066f30 0x7f94b00693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f94c80011e0 tx=0x7f94c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.720+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94d01595b0 con 0x7f94d01577d0 2023-10-08T16:10:02.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.908+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94d01595b0 con 0x7f94b0066f30 2023-10-08T16:10:02.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.917+0000 7f94c6ffd700 1 -- 172.21.15.60:0/1101714908 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284838 (secure 0 0 0) 0x7f94d01595b0 con 0x7f94b0066f30 2023-10-08T16:10:02.920 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:02.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f94b0066f30 msgr2=0x7f94b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f94b0066f30 0x7f94b00693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f94c80011e0 tx=0x7f94c8009040 comp rx=0 tx=0).stop 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 msgr2=0x7f94d014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 0x7f94d014d980 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f94b800b5e0 tx=0x7f94b8009120 comp rx=0 tx=0).stop 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 shutdown_connections 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f94b0066f30 0x7f94b00693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94d006ac30 0x7f94d016b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94d0157ba0 0x7f94d01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 --2- 172.21.15.60:0/1101714908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d01577d0 0x7f94d014d980 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 >> 172.21.15.60:0/1101714908 conn(0x7f94d0068ce0 msgr2=0x7f94d006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 shutdown_connections 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:02.920+0000 7f94d532a700 1 -- 172.21.15.60:0/1101714908 wait complete. 2023-10-08T16:10:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:10:02.933 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-08T16:10:01.625504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557315,"statfs":{"total":1600000000,"available":1594691012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.182465"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350048+0000","last_change":"2023-10-08T16:09:58.346721+0000","last_active":"2023-10-08T16:09:58.350048+0000","last_peered":"2023-10-08T16:09:58.350048+0000","last_clean":"2023-10-08T16:09:58.350048+0000","last_became_active":"2023-10-08T16:09:58.345933+0000","last_became_peered":"2023-10-08T16:09:58.345933+0000","last_unstale":"2023-10-08T16:09:58.350048+0000","last_undegraded":"2023-10-08T16:09:58.350048+0000","last_fullsized":"2023-10-08T16:09:58.350048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:56.176466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.351741+0000","last_change":"2023-10-08T16:09:58.351668+0000","last_active":"2023-10-08T16:09:58.351741+0000","last_peered":"2023-10-08T16:09:58.351741+0000","last_clean":"2023-10-08T16:09:58.351741+0000","last_became_active":"2023-10-08T16:09:58.351396+0000","last_became_peered":"2023-10-08T16:09:58.351396+0000","last_unstale":"2023-10-08T16:09:58.351741+0000","last_undegraded":"2023-10-08T16:09:58.351741+0000","last_fullsized":"2023-10-08T16:09:58.351741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:54.727900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353586+0000","last_change":"2023-10-08T16:09:58.353506+0000","last_active":"2023-10-08T16:09:58.353586+0000","last_peered":"2023-10-08T16:09:58.353586+0000","last_clean":"2023-10-08T16:09:58.353586+0000","last_became_active":"2023-10-08T16:09:58.353218+0000","last_became_peered":"2023-10-08T16:09:58.353218+0000","last_unstale":"2023-10-08T16:09:58.353586+0000","last_undegraded":"2023-10-08T16:09:58.353586+0000","last_fullsized":"2023-10-08T16:09:58.353586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:42.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345687+0000","last_change":"2023-10-08T16:09:58.345611+0000","last_active":"2023-10-08T16:09:58.345687+0000","last_peered":"2023-10-08T16:09:58.345687+0000","last_clean":"2023-10-08T16:09:58.345687+0000","last_became_active":"2023-10-08T16:09:58.345344+0000","last_became_peered":"2023-10-08T16:09:58.345344+0000","last_unstale":"2023-10-08T16:09:58.345687+0000","last_undegraded":"2023-10-08T16:09:58.345687+0000","last_fullsized":"2023-10-08T16:09:58.345687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:53.735392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347587+0000","last_change":"2023-10-08T16:09:58.347485+0000","last_active":"2023-10-08T16:09:58.347587+0000","last_peered":"2023-10-08T16:09:58.347587+0000","last_clean":"2023-10-08T16:09:58.347587+0000","last_became_active":"2023-10-08T16:09:58.347199+0000","last_became_peered":"2023-10-08T16:09:58.347199+0000","last_unstale":"2023-10-08T16:09:58.347587+0000","last_undegraded":"2023-10-08T16:09:58.347587+0000","last_fullsized":"2023-10-08T16:09:58.347587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:03.047812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344144+0000","last_change":"2023-10-08T16:09:58.343834+0000","last_active":"2023-10-08T16:09:58.344144+0000","last_peered":"2023-10-08T16:09:58.344144+0000","last_clean":"2023-10-08T16:09:58.344144+0000","last_became_active":"2023-10-08T16:09:58.343229+0000","last_became_peered":"2023-10-08T16:09:58.343229+0000","last_unstale":"2023-10-08T16:09:58.344144+0000","last_undegraded":"2023-10-08T16:09:58.344144+0000","last_fullsized":"2023-10-08T16:09:58.344144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:10.611815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.342191+0000","last_change":"2023-10-08T16:09:58.342113+0000","last_active":"2023-10-08T16:09:58.342191+0000","last_peered":"2023-10-08T16:09:58.342191+0000","last_clean":"2023-10-08T16:09:58.342191+0000","last_became_active":"2023-10-08T16:09:58.341830+0000","last_became_peered":"2023-10-08T16:09:58.341830+0000","last_unstale":"2023-10-08T16:09:58.342191+0000","last_undegraded":"2023-10-08T16:09:58.342191+0000","last_fullsized":"2023-10-08T16:09:58.342191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:35.412761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344110+0000","last_change":"2023-10-08T16:09:58.343626+0000","last_active":"2023-10-08T16:09:58.344110+0000","last_peered":"2023-10-08T16:09:58.344110+0000","last_clean":"2023-10-08T16:09:58.344110+0000","last_became_active":"2023-10-08T16:09:58.343365+0000","last_became_peered":"2023-10-08T16:09:58.343365+0000","last_unstale":"2023-10-08T16:09:58.344110+0000","last_undegraded":"2023-10-08T16:09:58.344110+0000","last_fullsized":"2023-10-08T16:09:58.344110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.339407+0000","last_change":"2023-10-08T16:09:58.339248+0000","last_active":"2023-10-08T16:09:58.339407+0000","last_peered":"2023-10-08T16:09:58.339407+0000","last_clean":"2023-10-08T16:09:58.339407+0000","last_became_active":"2023-10-08T16:09:58.339015+0000","last_became_peered":"2023-10-08T16:09:58.339015+0000","last_unstale":"2023-10-08T16:09:58.339407+0000","last_undegraded":"2023-10-08T16:09:58.339407+0000","last_fullsized":"2023-10-08T16:09:58.339407+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:03.047812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348994+0000","last_change":"2023-10-08T16:09:58.345241+0000","last_active":"2023-10-08T16:09:58.348994+0000","last_peered":"2023-10-08T16:09:58.348994+0000","last_clean":"2023-10-08T16:09:58.348994+0000","last_became_active":"2023-10-08T16:09:58.345002+0000","last_became_peered":"2023-10-08T16:09:58.345002+0000","last_unstale":"2023-10-08T16:09:58.348994+0000","last_undegraded":"2023-10-08T16:09:58.348994+0000","last_fullsized":"2023-10-08T16:09:58.348994+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:48.014327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344667+0000","last_change":"2023-10-08T16:09:58.344551+0000","last_active":"2023-10-08T16:09:58.344667+0000","last_peered":"2023-10-08T16:09:58.344667+0000","last_clean":"2023-10-08T16:09:58.344667+0000","last_became_active":"2023-10-08T16:09:58.344222+0000","last_became_peered":"2023-10-08T16:09:58.344222+0000","last_unstale":"2023-10-08T16:09:58.344667+0000","last_undegraded":"2023-10-08T16:09:58.344667+0000","last_fullsized":"2023-10-08T16:09:58.344667+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:35.782924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348956+0000","last_change":"2023-10-08T16:09:58.345151+0000","last_active":"2023-10-08T16:09:58.348956+0000","last_peered":"2023-10-08T16:09:58.348956+0000","last_clean":"2023-10-08T16:09:58.348956+0000","last_became_active":"2023-10-08T16:09:58.344920+0000","last_became_peered":"2023-10-08T16:09:58.344920+0000","last_unstale":"2023-10-08T16:09:58.348956+0000","last_undegraded":"2023-10-08T16:09:58.348956+0000","last_fullsized":"2023-10-08T16:09:58.348956+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346068+0000","last_change":"2023-10-08T16:09:58.345880+0000","last_active":"2023-10-08T16:09:58.346068+0000","last_peered":"2023-10-08T16:09:58.346068+0000","last_clean":"2023-10-08T16:09:58.346068+0000","last_became_active":"2023-10-08T16:09:58.345634+0000","last_became_peered":"2023-10-08T16:09:58.345634+0000","last_unstale":"2023-10-08T16:09:58.346068+0000","last_undegraded":"2023-10-08T16:09:58.346068+0000","last_fullsized":"2023-10-08T16:09:58.346068+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:10.611815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344868+0000","last_change":"2023-10-08T16:09:58.344356+0000","last_active":"2023-10-08T16:09:58.344868+0000","last_peered":"2023-10-08T16:09:58.344868+0000","last_clean":"2023-10-08T16:09:58.344868+0000","last_became_active":"2023-10-08T16:09:58.343825+0000","last_became_peered":"2023-10-08T16:09:58.343825+0000","last_unstale":"2023-10-08T16:09:58.344868+0000","last_undegraded":"2023-10-08T16:09:58.344868+0000","last_fullsized":"2023-10-08T16:09:58.344868+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:20.612861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347437+0000","last_change":"2023-10-08T16:09:58.347231+0000","last_active":"2023-10-08T16:09:58.347437+0000","last_peered":"2023-10-08T16:09:58.347437+0000","last_clean":"2023-10-08T16:09:58.347437+0000","last_became_active":"2023-10-08T16:09:58.346796+0000","last_became_peered":"2023-10-08T16:09:58.346796+0000","last_unstale":"2023-10-08T16:09:58.347437+0000","last_undegraded":"2023-10-08T16:09:58.347437+0000","last_fullsized":"2023-10-08T16:09:58.347437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:47.751365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.352085+0000","last_change":"2023-10-08T16:09:58.351820+0000","last_active":"2023-10-08T16:09:58.352085+0000","last_peered":"2023-10-08T16:09:58.352085+0000","last_clean":"2023-10-08T16:09:58.352085+0000","last_became_active":"2023-10-08T16:09:58.351487+0000","last_became_peered":"2023-10-08T16:09:58.351487+0000","last_unstale":"2023-10-08T16:09:58.352085+0000","last_undegraded":"2023-10-08T16:09:58.352085+0000","last_fullsized":"2023-10-08T16:09:58.352085+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:42.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350821+0000","last_change":"2023-10-08T16:09:58.350659+0000","last_active":"2023-10-08T16:09:58.350821+0000","last_peered":"2023-10-08T16:09:58.350821+0000","last_clean":"2023-10-08T16:09:58.350821+0000","last_became_active":"2023-10-08T16:09:58.350253+0000","last_became_peered":"2023-10-08T16:09:58.350253+0000","last_unstale":"2023-10-08T16:09:58.350821+0000","last_undegraded":"2023-10-08T16:09:58.350821+0000","last_fullsized":"2023-10-08T16:09:58.350821+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:47.751365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349580+0000","last_change":"2023-10-08T16:09:58.349516+0000","last_active":"2023-10-08T16:09:58.349580+0000","last_peered":"2023-10-08T16:09:58.349580+0000","last_clean":"2023-10-08T16:09:58.349580+0000","last_became_active":"2023-10-08T16:09:58.349251+0000","last_became_peered":"2023-10-08T16:09:58.349251+0000","last_unstale":"2023-10-08T16:09:58.349580+0000","last_undegraded":"2023-10-08T16:09:58.349580+0000","last_fullsized":"2023-10-08T16:09:58.349580+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:26.019957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349812+0000","last_change":"2023-10-08T16:09:58.349745+0000","last_active":"2023-10-08T16:09:58.349812+0000","last_peered":"2023-10-08T16:09:58.349812+0000","last_clean":"2023-10-08T16:09:58.349812+0000","last_became_active":"2023-10-08T16:09:58.349508+0000","last_became_peered":"2023-10-08T16:09:58.349508+0000","last_unstale":"2023-10-08T16:09:58.349812+0000","last_undegraded":"2023-10-08T16:09:58.349812+0000","last_fullsized":"2023-10-08T16:09:58.349812+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:48.014327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340522+0000","last_change":"2023-10-08T16:09:58.339884+0000","last_active":"2023-10-08T16:09:58.340522+0000","last_peered":"2023-10-08T16:09:58.340522+0000","last_clean":"2023-10-08T16:09:58.340522+0000","last_became_active":"2023-10-08T16:09:58.339630+0000","last_became_peered":"2023-10-08T16:09:58.339630+0000","last_unstale":"2023-10-08T16:09:58.340522+0000","last_undegraded":"2023-10-08T16:09:58.340522+0000","last_fullsized":"2023-10-08T16:09:58.340522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:25:15.228071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340560+0000","last_change":"2023-10-08T16:09:58.340461+0000","last_active":"2023-10-08T16:09:58.340560+0000","last_peered":"2023-10-08T16:09:58.340560+0000","last_clean":"2023-10-08T16:09:58.340560+0000","last_became_active":"2023-10-08T16:09:58.340114+0000","last_became_peered":"2023-10-08T16:09:58.340114+0000","last_unstale":"2023-10-08T16:09:58.340560+0000","last_undegraded":"2023-10-08T16:09:58.340560+0000","last_fullsized":"2023-10-08T16:09:58.340560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:28.016286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350672+0000","last_change":"2023-10-08T16:09:58.350582+0000","last_active":"2023-10-08T16:09:58.350672+0000","last_peered":"2023-10-08T16:09:58.350672+0000","last_clean":"2023-10-08T16:09:58.350672+0000","last_became_active":"2023-10-08T16:09:58.350362+0000","last_became_peered":"2023-10-08T16:09:58.350362+0000","last_unstale":"2023-10-08T16:09:58.350672+0000","last_undegraded":"2023-10-08T16:09:58.350672+0000","last_fullsized":"2023-10-08T16:09:58.350672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:32.928386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.352874+0000","last_change":"2023-10-08T16:09:58.352799+0000","last_active":"2023-10-08T16:09:58.352874+0000","last_peered":"2023-10-08T16:09:58.352874+0000","last_clean":"2023-10-08T16:09:58.352874+0000","last_became_active":"2023-10-08T16:09:58.351583+0000","last_became_peered":"2023-10-08T16:09:58.351583+0000","last_unstale":"2023-10-08T16:09:58.352874+0000","last_undegraded":"2023-10-08T16:09:58.352874+0000","last_fullsized":"2023-10-08T16:09:58.352874+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:05.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340545+0000","last_change":"2023-10-08T16:09:58.340410+0000","last_active":"2023-10-08T16:09:58.340545+0000","last_peered":"2023-10-08T16:09:58.340545+0000","last_clean":"2023-10-08T16:09:58.340545+0000","last_became_active":"2023-10-08T16:09:58.340174+0000","last_became_peered":"2023-10-08T16:09:58.340174+0000","last_unstale":"2023-10-08T16:09:58.340545+0000","last_undegraded":"2023-10-08T16:09:58.340545+0000","last_fullsized":"2023-10-08T16:09:58.340545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:28.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348323+0000","last_change":"2023-10-08T16:09:58.348199+0000","last_active":"2023-10-08T16:09:58.348323+0000","last_peered":"2023-10-08T16:09:58.348323+0000","last_clean":"2023-10-08T16:09:58.348323+0000","last_became_active":"2023-10-08T16:09:58.347857+0000","last_became_peered":"2023-10-08T16:09:58.347857+0000","last_unstale":"2023-10-08T16:09:58.348323+0000","last_undegraded":"2023-10-08T16:09:58.348323+0000","last_fullsized":"2023-10-08T16:09:58.348323+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:01.176060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349281+0000","last_change":"2023-10-08T16:09:58.349170+0000","last_active":"2023-10-08T16:09:58.349281+0000","last_peered":"2023-10-08T16:09:58.349281+0000","last_clean":"2023-10-08T16:09:58.349281+0000","last_became_active":"2023-10-08T16:09:58.347590+0000","last_became_peered":"2023-10-08T16:09:58.347590+0000","last_unstale":"2023-10-08T16:09:58.349281+0000","last_undegraded":"2023-10-08T16:09:58.349281+0000","last_fullsized":"2023-10-08T16:09:58.349281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:56.176466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349196+0000","last_change":"2023-10-08T16:09:58.349077+0000","last_active":"2023-10-08T16:09:58.349196+0000","last_peered":"2023-10-08T16:09:58.349196+0000","last_clean":"2023-10-08T16:09:58.349196+0000","last_became_active":"2023-10-08T16:09:58.348859+0000","last_became_peered":"2023-10-08T16:09:58.348859+0000","last_unstale":"2023-10-08T16:09:58.349196+0000","last_undegraded":"2023-10-08T16:09:58.349196+0000","last_fullsized":"2023-10-08T16:09:58.349196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:59.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353636+0000","last_change":"2023-10-08T16:09:58.353324+0000","last_active":"2023-10-08T16:09:58.353636+0000","last_peered":"2023-10-08T16:09:58.353636+0000","last_clean":"2023-10-08T16:09:58.353636+0000","last_became_active":"2023-10-08T16:09:58.352610+0000","last_became_peered":"2023-10-08T16:09:58.352610+0000","last_unstale":"2023-10-08T16:09:58.353636+0000","last_undegraded":"2023-10-08T16:09:58.353636+0000","last_fullsized":"2023-10-08T16:09:58.353636+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:59.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345666+0000","last_change":"2023-10-08T16:09:58.345354+0000","last_active":"2023-10-08T16:09:58.345666+0000","last_peered":"2023-10-08T16:09:58.345666+0000","last_clean":"2023-10-08T16:09:58.345666+0000","last_became_active":"2023-10-08T16:09:58.344962+0000","last_became_peered":"2023-10-08T16:09:58.344962+0000","last_unstale":"2023-10-08T16:09:58.345666+0000","last_undegraded":"2023-10-08T16:09:58.345666+0000","last_fullsized":"2023-10-08T16:09:58.345666+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:52.005067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344633+0000","last_change":"2023-10-08T16:09:58.344138+0000","last_active":"2023-10-08T16:09:58.344633+0000","last_peered":"2023-10-08T16:09:58.344633+0000","last_clean":"2023-10-08T16:09:58.344633+0000","last_became_active":"2023-10-08T16:09:58.343540+0000","last_became_peered":"2023-10-08T16:09:58.343540+0000","last_unstale":"2023-10-08T16:09:58.344633+0000","last_undegraded":"2023-10-08T16:09:58.344633+0000","last_fullsized":"2023-10-08T16:09:58.344633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:21.904890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349179+0000","last_change":"2023-10-08T16:09:58.348964+0000","last_active":"2023-10-08T16:09:58.349179+0000","last_peered":"2023-10-08T16:09:58.349179+0000","last_clean":"2023-10-08T16:09:58.349179+0000","last_became_active":"2023-10-08T16:09:58.348411+0000","last_became_peered":"2023-10-08T16:09:58.348411+0000","last_unstale":"2023-10-08T16:09:58.349179+0000","last_undegraded":"2023-10-08T16:09:58.349179+0000","last_fullsized":"2023-10-08T16:09:58.349179+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350097+0000","last_change":"2023-10-08T16:09:58.348499+0000","last_active":"2023-10-08T16:09:58.350097+0000","last_peered":"2023-10-08T16:09:58.350097+0000","last_clean":"2023-10-08T16:09:58.350097+0000","last_became_active":"2023-10-08T16:09:58.348240+0000","last_became_peered":"2023-10-08T16:09:58.348240+0000","last_unstale":"2023-10-08T16:09:58.350097+0000","last_undegraded":"2023-10-08T16:09:58.350097+0000","last_fullsized":"2023-10-08T16:09:58.350097+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:01.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.352067+0000","last_change":"2023-10-08T16:09:58.351826+0000","last_active":"2023-10-08T16:09:58.352067+0000","last_peered":"2023-10-08T16:09:58.352067+0000","last_clean":"2023-10-08T16:09:58.352067+0000","last_became_active":"2023-10-08T16:09:58.351431+0000","last_became_peered":"2023-10-08T16:09:58.351431+0000","last_unstale":"2023-10-08T16:09:58.352067+0000","last_undegraded":"2023-10-08T16:09:58.352067+0000","last_fullsized":"2023-10-08T16:09:58.352067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:52.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459882+0000","last_change":"2023-10-08T16:09:57.459598+0000","last_active":"2023-10-08T16:09:58.459882+0000","last_peered":"2023-10-08T16:09:58.459882+0000","last_clean":"2023-10-08T16:09:58.459882+0000","last_became_active":"2023-10-08T16:09:57.459175+0000","last_became_peered":"2023-10-08T16:09:57.459175+0000","last_unstale":"2023-10-08T16:09:58.459882+0000","last_undegraded":"2023-10-08T16:09:58.459882+0000","last_fullsized":"2023-10-08T16:09:58.459882+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:00.171570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353603+0000","last_change":"2023-10-08T16:09:58.352959+0000","last_active":"2023-10-08T16:09:58.353603+0000","last_peered":"2023-10-08T16:09:58.353603+0000","last_clean":"2023-10-08T16:09:58.353603+0000","last_became_active":"2023-10-08T16:09:58.351897+0000","last_became_peered":"2023-10-08T16:09:58.351897+0000","last_unstale":"2023-10-08T16:09:58.353603+0000","last_undegraded":"2023-10-08T16:09:58.353603+0000","last_fullsized":"2023-10-08T16:09:58.353603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459469+0000","last_change":"2023-10-08T16:09:57.460859+0000","last_active":"2023-10-08T16:09:58.459469+0000","last_peered":"2023-10-08T16:09:58.459469+0000","last_clean":"2023-10-08T16:09:58.459469+0000","last_became_active":"2023-10-08T16:09:57.460440+0000","last_became_peered":"2023-10-08T16:09:57.460440+0000","last_unstale":"2023-10-08T16:09:58.459469+0000","last_undegraded":"2023-10-08T16:09:58.459469+0000","last_fullsized":"2023-10-08T16:09:58.459469+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:25.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350075+0000","last_change":"2023-10-08T16:09:58.346865+0000","last_active":"2023-10-08T16:09:58.350075+0000","last_peered":"2023-10-08T16:09:58.350075+0000","last_clean":"2023-10-08T16:09:58.350075+0000","last_became_active":"2023-10-08T16:09:58.346476+0000","last_became_peered":"2023-10-08T16:09:58.346476+0000","last_unstale":"2023-10-08T16:09:58.350075+0000","last_undegraded":"2023-10-08T16:09:58.350075+0000","last_fullsized":"2023-10-08T16:09:58.350075+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:47.751365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459223+0000","last_change":"2023-10-08T16:09:57.459989+0000","last_active":"2023-10-08T16:09:58.459223+0000","last_peered":"2023-10-08T16:09:58.459223+0000","last_clean":"2023-10-08T16:09:58.459223+0000","last_became_active":"2023-10-08T16:09:57.459261+0000","last_became_peered":"2023-10-08T16:09:57.459261+0000","last_unstale":"2023-10-08T16:09:58.459223+0000","last_undegraded":"2023-10-08T16:09:58.459223+0000","last_fullsized":"2023-10-08T16:09:58.459223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:35.229222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350523+0000","last_change":"2023-10-08T16:09:58.350122+0000","last_active":"2023-10-08T16:09:58.350523+0000","last_peered":"2023-10-08T16:09:58.350523+0000","last_clean":"2023-10-08T16:09:58.350523+0000","last_became_active":"2023-10-08T16:09:58.349351+0000","last_became_peered":"2023-10-08T16:09:58.349351+0000","last_unstale":"2023-10-08T16:09:58.350523+0000","last_undegraded":"2023-10-08T16:09:58.350523+0000","last_fullsized":"2023-10-08T16:09:58.350523+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:03.047812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.460445+0000","last_change":"2023-10-08T16:09:57.458291+0000","last_active":"2023-10-08T16:09:58.460445+0000","last_peered":"2023-10-08T16:09:58.460445+0000","last_clean":"2023-10-08T16:09:58.460445+0000","last_became_active":"2023-10-08T16:09:57.458047+0000","last_became_peered":"2023-10-08T16:09:57.458047+0000","last_unstale":"2023-10-08T16:09:58.460445+0000","last_undegraded":"2023-10-08T16:09:58.460445+0000","last_fullsized":"2023-10-08T16:09:58.460445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:45.570376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345636+0000","last_change":"2023-10-08T16:09:58.344798+0000","last_active":"2023-10-08T16:09:58.345636+0000","last_peered":"2023-10-08T16:09:58.345636+0000","last_clean":"2023-10-08T16:09:58.345636+0000","last_became_active":"2023-10-08T16:09:58.344238+0000","last_became_peered":"2023-10-08T16:09:58.344238+0000","last_unstale":"2023-10-08T16:09:58.345636+0000","last_undegraded":"2023-10-08T16:09:58.345636+0000","last_fullsized":"2023-10-08T16:09:58.345636+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:39.145570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457454+0000","last_change":"2023-10-08T16:09:57.461077+0000","last_active":"2023-10-08T16:09:58.457454+0000","last_peered":"2023-10-08T16:09:58.457454+0000","last_clean":"2023-10-08T16:09:58.457454+0000","last_became_active":"2023-10-08T16:09:57.460092+0000","last_became_peered":"2023-10-08T16:09:57.460092+0000","last_unstale":"2023-10-08T16:09:58.457454+0000","last_undegraded":"2023-10-08T16:09:58.457454+0000","last_fullsized":"2023-10-08T16:09:58.457454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:00.171570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350802+0000","last_change":"2023-10-08T16:09:58.350507+0000","last_active":"2023-10-08T16:09:58.350802+0000","last_peered":"2023-10-08T16:09:58.350802+0000","last_clean":"2023-10-08T16:09:58.350802+0000","last_became_active":"2023-10-08T16:09:58.349944+0000","last_became_peered":"2023-10-08T16:09:58.349944+0000","last_unstale":"2023-10-08T16:09:58.350802+0000","last_undegraded":"2023-10-08T16:09:58.350802+0000","last_fullsized":"2023-10-08T16:09:58.350802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:01.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457558+0000","last_change":"2023-10-08T16:09:57.461980+0000","last_active":"2023-10-08T16:09:58.457558+0000","last_peered":"2023-10-08T16:09:58.457558+0000","last_clean":"2023-10-08T16:09:58.457558+0000","last_became_active":"2023-10-08T16:09:57.461730+0000","last_became_peered":"2023-10-08T16:09:57.461730+0000","last_unstale":"2023-10-08T16:09:58.457558+0000","last_undegraded":"2023-10-08T16:09:58.457558+0000","last_fullsized":"2023-10-08T16:09:58.457558+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:31.923896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350543+0000","last_change":"2023-10-08T16:09:58.350262+0000","last_active":"2023-10-08T16:09:58.350543+0000","last_peered":"2023-10-08T16:09:58.350543+0000","last_clean":"2023-10-08T16:09:58.350543+0000","last_became_active":"2023-10-08T16:09:58.349634+0000","last_became_peered":"2023-10-08T16:09:58.349634+0000","last_unstale":"2023-10-08T16:09:58.350543+0000","last_undegraded":"2023-10-08T16:09:58.350543+0000","last_fullsized":"2023-10-08T16:09:58.350543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.337368+0000","last_change":"2023-10-08T16:09:57.458331+0000","last_active":"2023-10-08T16:09:58.337368+0000","last_peered":"2023-10-08T16:09:58.337368+0000","last_clean":"2023-10-08T16:09:58.337368+0000","last_became_active":"2023-10-08T16:09:57.458048+0000","last_became_peered":"2023-10-08T16:09:57.458048+0000","last_unstale":"2023-10-08T16:09:58.337368+0000","last_undegraded":"2023-10-08T16:09:58.337368+0000","last_fullsized":"2023-10-08T16:09:58.337368+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:09.607325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.342409+0000","last_change":"2023-10-08T16:09:58.342335+0000","last_active":"2023-10-08T16:09:58.342409+0000","last_peered":"2023-10-08T16:09:58.342409+0000","last_clean":"2023-10-08T16:09:58.342409+0000","last_became_active":"2023-10-08T16:09:58.342105+0000","last_became_peered":"2023-10-08T16:09:58.342105+0000","last_unstale":"2023-10-08T16:09:58.342409+0000","last_undegraded":"2023-10-08T16:09:58.342409+0000","last_fullsized":"2023-10-08T16:09:58.342409+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:19:15.430515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340866+0000","last_change":"2023-10-08T16:09:57.455637+0000","last_active":"2023-10-08T16:09:58.340866+0000","last_peered":"2023-10-08T16:09:58.340866+0000","last_clean":"2023-10-08T16:09:58.340866+0000","last_became_active":"2023-10-08T16:09:57.455413+0000","last_became_peered":"2023-10-08T16:09:57.455413+0000","last_unstale":"2023-10-08T16:09:58.340866+0000","last_undegraded":"2023-10-08T16:09:58.340866+0000","last_fullsized":"2023-10-08T16:09:58.340866+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:27.970845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346003+0000","last_change":"2023-10-08T16:09:58.345939+0000","last_active":"2023-10-08T16:09:58.346003+0000","last_peered":"2023-10-08T16:09:58.346003+0000","last_clean":"2023-10-08T16:09:58.346003+0000","last_became_active":"2023-10-08T16:09:58.345703+0000","last_became_peered":"2023-10-08T16:09:58.345703+0000","last_unstale":"2023-10-08T16:09:58.346003+0000","last_undegraded":"2023-10-08T16:09:58.346003+0000","last_fullsized":"2023-10-08T16:09:58.346003+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:41.055382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340582+0000","last_change":"2023-10-08T16:09:57.457203+0000","last_active":"2023-10-08T16:09:58.340582+0000","last_peered":"2023-10-08T16:09:58.340582+0000","last_clean":"2023-10-08T16:09:58.340582+0000","last_became_active":"2023-10-08T16:09:57.456761+0000","last_became_peered":"2023-10-08T16:09:57.456761+0000","last_unstale":"2023-10-08T16:09:58.340582+0000","last_undegraded":"2023-10-08T16:09:58.340582+0000","last_fullsized":"2023-10-08T16:09:58.340582+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:55:35.539175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344531+0000","last_change":"2023-10-08T16:09:58.344021+0000","last_active":"2023-10-08T16:09:58.344531+0000","last_peered":"2023-10-08T16:09:58.344531+0000","last_clean":"2023-10-08T16:09:58.344531+0000","last_became_active":"2023-10-08T16:09:58.343554+0000","last_became_peered":"2023-10-08T16:09:58.343554+0000","last_unstale":"2023-10-08T16:09:58.344531+0000","last_undegraded":"2023-10-08T16:09:58.344531+0000","last_fullsized":"2023-10-08T16:09:58.344531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:17.847851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340300+0000","last_change":"2023-10-08T16:09:57.462116+0000","last_active":"2023-10-08T16:09:58.340300+0000","last_peered":"2023-10-08T16:09:58.340300+0000","last_clean":"2023-10-08T16:09:58.340300+0000","last_became_active":"2023-10-08T16:09:57.461904+0000","last_became_peered":"2023-10-08T16:09:57.461904+0000","last_unstale":"2023-10-08T16:09:58.340300+0000","last_undegraded":"2023-10-08T16:09:58.340300+0000","last_fullsized":"2023-10-08T16:09:58.340300+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:38.367737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348296+0000","last_change":"2023-10-08T16:09:58.347836+0000","last_active":"2023-10-08T16:09:58.348296+0000","last_peered":"2023-10-08T16:09:58.348296+0000","last_clean":"2023-10-08T16:09:58.348296+0000","last_became_active":"2023-10-08T16:09:58.345878+0000","last_became_peered":"2023-10-08T16:09:58.345878+0000","last_unstale":"2023-10-08T16:09:58.348296+0000","last_undegraded":"2023-10-08T16:09:58.348296+0000","last_fullsized":"2023-10-08T16:09:58.348296+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459804+0000","last_change":"2023-10-08T16:09:57.461409+0000","last_active":"2023-10-08T16:09:58.459804+0000","last_peered":"2023-10-08T16:09:58.459804+0000","last_clean":"2023-10-08T16:09:58.459804+0000","last_became_active":"2023-10-08T16:09:57.461168+0000","last_became_peered":"2023-10-08T16:09:57.461168+0000","last_unstale":"2023-10-08T16:09:58.459804+0000","last_undegraded":"2023-10-08T16:09:58.459804+0000","last_fullsized":"2023-10-08T16:09:58.459804+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:34.778433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349566+0000","last_change":"2023-10-08T16:09:58.349285+0000","last_active":"2023-10-08T16:09:58.349566+0000","last_peered":"2023-10-08T16:09:58.349566+0000","last_clean":"2023-10-08T16:09:58.349566+0000","last_became_active":"2023-10-08T16:09:58.346749+0000","last_became_peered":"2023-10-08T16:09:58.346749+0000","last_unstale":"2023-10-08T16:09:58.349566+0000","last_undegraded":"2023-10-08T16:09:58.349566+0000","last_fullsized":"2023-10-08T16:09:58.349566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.462095+0000","last_change":"2023-10-08T16:09:57.456879+0000","last_active":"2023-10-08T16:09:58.462095+0000","last_peered":"2023-10-08T16:09:58.462095+0000","last_clean":"2023-10-08T16:09:58.462095+0000","last_became_active":"2023-10-08T16:09:57.456670+0000","last_became_peered":"2023-10-08T16:09:57.456670+0000","last_unstale":"2023-10-08T16:09:58.462095+0000","last_undegraded":"2023-10-08T16:09:58.462095+0000","last_fullsized":"2023-10-08T16:09:58.462095+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:25.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345596+0000","last_change":"2023-10-08T16:09:58.345497+0000","last_active":"2023-10-08T16:09:58.345596+0000","last_peered":"2023-10-08T16:09:58.345596+0000","last_clean":"2023-10-08T16:09:58.345596+0000","last_became_active":"2023-10-08T16:09:58.345133+0000","last_became_peered":"2023-10-08T16:09:58.345133+0000","last_unstale":"2023-10-08T16:09:58.345596+0000","last_undegraded":"2023-10-08T16:09:58.345596+0000","last_fullsized":"2023-10-08T16:09:58.345596+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:56.176466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.458624+0000","last_change":"2023-10-08T16:09:57.457354+0000","last_active":"2023-10-08T16:09:58.458624+0000","last_peered":"2023-10-08T16:09:58.458624+0000","last_clean":"2023-10-08T16:09:58.458624+0000","last_became_active":"2023-10-08T16:09:57.457081+0000","last_became_peered":"2023-10-08T16:09:57.457081+0000","last_unstale":"2023-10-08T16:09:58.458624+0000","last_undegraded":"2023-10-08T16:09:58.458624+0000","last_fullsized":"2023-10-08T16:09:58.458624+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:09:13.062036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350560+0000","last_change":"2023-10-08T16:09:58.350400+0000","last_active":"2023-10-08T16:09:58.350560+0000","last_peered":"2023-10-08T16:09:58.350560+0000","last_clean":"2023-10-08T16:09:58.350560+0000","last_became_active":"2023-10-08T16:09:58.349899+0000","last_became_peered":"2023-10-08T16:09:58.349899+0000","last_unstale":"2023-10-08T16:09:58.350560+0000","last_undegraded":"2023-10-08T16:09:58.350560+0000","last_fullsized":"2023-10-08T16:09:58.350560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:05.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.341344+0000","last_change":"2023-10-08T16:09:57.463181+0000","last_active":"2023-10-08T16:09:58.341344+0000","last_peered":"2023-10-08T16:09:58.341344+0000","last_clean":"2023-10-08T16:09:58.341344+0000","last_became_active":"2023-10-08T16:09:57.462953+0000","last_became_peered":"2023-10-08T16:09:57.462953+0000","last_unstale":"2023-10-08T16:09:58.341344+0000","last_undegraded":"2023-10-08T16:09:58.341344+0000","last_fullsized":"2023-10-08T16:09:58.341344+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:55.171975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344651+0000","last_change":"2023-10-08T16:09:58.344463+0000","last_active":"2023-10-08T16:09:58.344651+0000","last_peered":"2023-10-08T16:09:58.344651+0000","last_clean":"2023-10-08T16:09:58.344651+0000","last_became_active":"2023-10-08T16:09:58.343909+0000","last_became_peered":"2023-10-08T16:09:58.343909+0000","last_unstale":"2023-10-08T16:09:58.344651+0000","last_undegraded":"2023-10-08T16:09:58.344651+0000","last_fullsized":"2023-10-08T16:09:58.344651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:04.472396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.338330+0000","last_change":"2023-10-08T16:09:57.460566+0000","last_active":"2023-10-08T16:09:58.338330+0000","last_peered":"2023-10-08T16:09:58.338330+0000","last_clean":"2023-10-08T16:09:58.338330+0000","last_became_active":"2023-10-08T16:09:57.460341+0000","last_became_peered":"2023-10-08T16:09:57.460341+0000","last_unstale":"2023-10-08T16:09:58.338330+0000","last_undegraded":"2023-10-08T16:09:58.338330+0000","last_fullsized":"2023-10-08T16:09:58.338330+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:31.923896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347693+0000","last_change":"2023-10-08T16:09:58.347388+0000","last_active":"2023-10-08T16:09:58.347693+0000","last_peered":"2023-10-08T16:09:58.347693+0000","last_clean":"2023-10-08T16:09:58.347693+0000","last_became_active":"2023-10-08T16:09:58.347169+0000","last_became_peered":"2023-10-08T16:09:58.347169+0000","last_unstale":"2023-10-08T16:09:58.347693+0000","last_undegraded":"2023-10-08T16:09:58.347693+0000","last_fullsized":"2023-10-08T16:09:58.347693+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:26.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.460259+0000","last_change":"2023-10-08T16:09:57.461215+0000","last_active":"2023-10-08T16:09:58.460259+0000","last_peered":"2023-10-08T16:09:58.460259+0000","last_clean":"2023-10-08T16:09:58.460259+0000","last_became_active":"2023-10-08T16:09:57.461003+0000","last_became_peered":"2023-10-08T16:09:57.461003+0000","last_unstale":"2023-10-08T16:09:58.460259+0000","last_undegraded":"2023-10-08T16:09:58.460259+0000","last_fullsized":"2023-10-08T16:09:58.460259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:00.171570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.348702+0000","last_change":"2023-10-08T16:09:58.348534+0000","last_active":"2023-10-08T16:09:58.348702+0000","last_peered":"2023-10-08T16:09:58.348702+0000","last_clean":"2023-10-08T16:09:58.348702+0000","last_became_active":"2023-10-08T16:09:58.348334+0000","last_became_peered":"2023-10-08T16:09:58.348334+0000","last_unstale":"2023-10-08T16:09:58.348702+0000","last_undegraded":"2023-10-08T16:09:58.348702+0000","last_fullsized":"2023-10-08T16:09:58.348702+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.424537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.456637+0000","last_change":"2023-10-08T16:09:57.457685+0000","last_active":"2023-10-08T16:09:58.456637+0000","last_peered":"2023-10-08T16:09:58.456637+0000","last_clean":"2023-10-08T16:09:58.456637+0000","last_became_active":"2023-10-08T16:09:57.457449+0000","last_became_peered":"2023-10-08T16:09:57.457449+0000","last_unstale":"2023-10-08T16:09:58.456637+0000","last_undegraded":"2023-10-08T16:09:58.456637+0000","last_fullsized":"2023-10-08T16:09:58.456637+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.054728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350141+0000","last_change":"2023-10-08T16:09:58.349809+0000","last_active":"2023-10-08T16:09:58.350141+0000","last_peered":"2023-10-08T16:09:58.350141+0000","last_clean":"2023-10-08T16:09:58.350141+0000","last_became_active":"2023-10-08T16:09:58.345474+0000","last_became_peered":"2023-10-08T16:09:58.345474+0000","last_unstale":"2023-10-08T16:09:58.350141+0000","last_undegraded":"2023-10-08T16:09:58.350141+0000","last_fullsized":"2023-10-08T16:09:58.350141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.460643+0000","last_change":"2023-10-08T16:09:57.459837+0000","last_active":"2023-10-08T16:09:58.460643+0000","last_peered":"2023-10-08T16:09:58.460643+0000","last_clean":"2023-10-08T16:09:58.460643+0000","last_became_active":"2023-10-08T16:09:57.458869+0000","last_became_peered":"2023-10-08T16:09:57.458869+0000","last_unstale":"2023-10-08T16:09:58.460643+0000","last_undegraded":"2023-10-08T16:09:58.460643+0000","last_fullsized":"2023-10-08T16:09:58.460643+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:16.843360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349212+0000","last_change":"2023-10-08T16:09:58.349116+0000","last_active":"2023-10-08T16:09:58.349212+0000","last_peered":"2023-10-08T16:09:58.349212+0000","last_clean":"2023-10-08T16:09:58.349212+0000","last_became_active":"2023-10-08T16:09:58.348712+0000","last_became_peered":"2023-10-08T16:09:58.348712+0000","last_unstale":"2023-10-08T16:09:58.349212+0000","last_undegraded":"2023-10-08T16:09:58.349212+0000","last_fullsized":"2023-10-08T16:09:58.349212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.338262+0000","last_change":"2023-10-08T16:09:57.457918+0000","last_active":"2023-10-08T16:09:58.338262+0000","last_peered":"2023-10-08T16:09:58.338262+0000","last_clean":"2023-10-08T16:09:58.338262+0000","last_became_active":"2023-10-08T16:09:57.457680+0000","last_became_peered":"2023-10-08T16:09:57.457680+0000","last_unstale":"2023-10-08T16:09:58.338262+0000","last_undegraded":"2023-10-08T16:09:58.338262+0000","last_fullsized":"2023-10-08T16:09:58.338262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:38.141079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344881+0000","last_change":"2023-10-08T16:09:58.344492+0000","last_active":"2023-10-08T16:09:58.344881+0000","last_peered":"2023-10-08T16:09:58.344881+0000","last_clean":"2023-10-08T16:09:58.344881+0000","last_became_active":"2023-10-08T16:09:58.344139+0000","last_became_peered":"2023-10-08T16:09:58.344139+0000","last_unstale":"2023-10-08T16:09:58.344881+0000","last_undegraded":"2023-10-08T16:09:58.344881+0000","last_fullsized":"2023-10-08T16:09:58.344881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:09:14.066527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457959+0000","last_change":"2023-10-08T16:09:57.461182+0000","last_active":"2023-10-08T16:09:58.457959+0000","last_peered":"2023-10-08T16:09:58.457959+0000","last_clean":"2023-10-08T16:09:58.457959+0000","last_became_active":"2023-10-08T16:09:57.460675+0000","last_became_peered":"2023-10-08T16:09:57.460675+0000","last_unstale":"2023-10-08T16:09:58.457959+0000","last_undegraded":"2023-10-08T16:09:58.457959+0000","last_fullsized":"2023-10-08T16:09:58.457959+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:19.484204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345192+0000","last_change":"2023-10-08T16:09:58.345048+0000","last_active":"2023-10-08T16:09:58.345192+0000","last_peered":"2023-10-08T16:09:58.345192+0000","last_clean":"2023-10-08T16:09:58.345192+0000","last_became_active":"2023-10-08T16:09:58.344213+0000","last_became_peered":"2023-10-08T16:09:58.344213+0000","last_unstale":"2023-10-08T16:09:58.345192+0000","last_undegraded":"2023-10-08T16:09:58.345192+0000","last_fullsized":"2023-10-08T16:09:58.345192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.337466+0000","last_change":"2023-10-08T16:09:57.457882+0000","last_active":"2023-10-08T16:09:58.337466+0000","last_peered":"2023-10-08T16:09:58.337466+0000","last_clean":"2023-10-08T16:09:58.337466+0000","last_became_active":"2023-10-08T16:09:57.457652+0000","last_became_peered":"2023-10-08T16:09:57.457652+0000","last_unstale":"2023-10-08T16:09:58.337466+0000","last_undegraded":"2023-10-08T16:09:58.337466+0000","last_fullsized":"2023-10-08T16:09:58.337466+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:16.307948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.343214+0000","last_change":"2023-10-08T16:09:58.342966+0000","last_active":"2023-10-08T16:09:58.343214+0000","last_peered":"2023-10-08T16:09:58.343214+0000","last_clean":"2023-10-08T16:09:58.343214+0000","last_became_active":"2023-10-08T16:09:58.342723+0000","last_became_peered":"2023-10-08T16:09:58.342723+0000","last_unstale":"2023-10-08T16:09:58.343214+0000","last_undegraded":"2023-10-08T16:09:58.343214+0000","last_fullsized":"2023-10-08T16:09:58.343214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:21.480180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.336755+0000","last_change":"2023-10-08T16:09:57.460189+0000","last_active":"2023-10-08T16:09:58.336755+0000","last_peered":"2023-10-08T16:09:58.336755+0000","last_clean":"2023-10-08T16:09:58.336755+0000","last_became_active":"2023-10-08T16:09:57.459783+0000","last_became_peered":"2023-10-08T16:09:57.459783+0000","last_unstale":"2023-10-08T16:09:58.336755+0000","last_undegraded":"2023-10-08T16:09:58.336755+0000","last_fullsized":"2023-10-08T16:09:58.336755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:42.808280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.339389+0000","last_change":"2023-10-08T16:09:58.339168+0000","last_active":"2023-10-08T16:09:58.339389+0000","last_peered":"2023-10-08T16:09:58.339389+0000","last_clean":"2023-10-08T16:09:58.339389+0000","last_became_active":"2023-10-08T16:09:58.338968+0000","last_became_peered":"2023-10-08T16:09:58.338968+0000","last_unstale":"2023-10-08T16:09:58.339389+0000","last_undegraded":"2023-10-08T16:09:58.339389+0000","last_fullsized":"2023-10-08T16:09:58.339389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:06.806747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.341448+0000","last_change":"2023-10-08T16:09:57.458110+0000","last_active":"2023-10-08T16:09:58.341448+0000","last_peered":"2023-10-08T16:09:58.341448+0000","last_clean":"2023-10-08T16:09:58.341448+0000","last_became_active":"2023-10-08T16:09:57.457891+0000","last_became_peered":"2023-10-08T16:09:57.457891+0000","last_unstale":"2023-10-08T16:09:58.341448+0000","last_undegraded":"2023-10-08T16:09:58.341448+0000","last_fullsized":"2023-10-08T16:09:58.341448+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:19.879197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.349582+0000","last_change":"2023-10-08T16:09:58.349434+0000","last_active":"2023-10-08T16:09:58.349582+0000","last_peered":"2023-10-08T16:09:58.349582+0000","last_clean":"2023-10-08T16:09:58.349582+0000","last_became_active":"2023-10-08T16:09:58.347059+0000","last_became_peered":"2023-10-08T16:09:58.347059+0000","last_unstale":"2023-10-08T16:09:58.349582+0000","last_undegraded":"2023-10-08T16:09:58.349582+0000","last_fullsized":"2023-10-08T16:09:58.349582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:20.883688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.459706+0000","last_change":"2023-10-08T16:09:57.462624+0000","last_active":"2023-10-08T16:09:58.459706+0000","last_peered":"2023-10-08T16:09:58.459706+0000","last_clean":"2023-10-08T16:09:58.459706+0000","last_became_active":"2023-10-08T16:09:57.462158+0000","last_became_peered":"2023-10-08T16:09:57.462158+0000","last_unstale":"2023-10-08T16:09:58.459706+0000","last_undegraded":"2023-10-08T16:09:58.459706+0000","last_fullsized":"2023-10-08T16:09:58.459706+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:19.608371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.351021+0000","last_change":"2023-10-08T16:09:58.350952+0000","last_active":"2023-10-08T16:09:58.351021+0000","last_peered":"2023-10-08T16:09:58.351021+0000","last_clean":"2023-10-08T16:09:58.351021+0000","last_became_active":"2023-10-08T16:09:58.350688+0000","last_became_peered":"2023-10-08T16:09:58.350688+0000","last_unstale":"2023-10-08T16:09:58.351021+0000","last_undegraded":"2023-10-08T16:09:58.351021+0000","last_fullsized":"2023-10-08T16:09:58.351021+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:24.591567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.341953+0000","last_change":"2023-10-08T16:09:57.458382+0000","last_active":"2023-10-08T16:09:58.341953+0000","last_peered":"2023-10-08T16:09:58.341953+0000","last_clean":"2023-10-08T16:09:58.341953+0000","last_became_active":"2023-10-08T16:09:57.458202+0000","last_became_peered":"2023-10-08T16:09:57.458202+0000","last_unstale":"2023-10-08T16:09:58.341953+0000","last_undegraded":"2023-10-08T16:09:58.341953+0000","last_fullsized":"2023-10-08T16:09:58.341953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:25:14.223580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.350113+0000","last_change":"2023-10-08T16:09:58.348807+0000","last_active":"2023-10-08T16:09:58.350113+0000","last_peered":"2023-10-08T16:09:58.350113+0000","last_clean":"2023-10-08T16:09:58.350113+0000","last_became_active":"2023-10-08T16:09:58.348566+0000","last_became_peered":"2023-10-08T16:09:58.348566+0000","last_unstale":"2023-10-08T16:09:58.350113+0000","last_undegraded":"2023-10-08T16:09:58.350113+0000","last_fullsized":"2023-10-08T16:09:58.350113+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:20.157184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340557+0000","last_change":"2023-10-08T16:09:57.459795+0000","last_active":"2023-10-08T16:09:58.340557+0000","last_peered":"2023-10-08T16:09:58.340557+0000","last_clean":"2023-10-08T16:09:58.340557+0000","last_became_active":"2023-10-08T16:09:57.459542+0000","last_became_peered":"2023-10-08T16:09:57.459542+0000","last_unstale":"2023-10-08T16:09:58.340557+0000","last_undegraded":"2023-10-08T16:09:58.340557+0000","last_fullsized":"2023-10-08T16:09:58.340557+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:53.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.351738+0000","last_change":"2023-10-08T16:09:58.351641+0000","last_active":"2023-10-08T16:09:58.351738+0000","last_peered":"2023-10-08T16:09:58.351738+0000","last_clean":"2023-10-08T16:09:58.351738+0000","last_became_active":"2023-10-08T16:09:58.351021+0000","last_became_peered":"2023-10-08T16:09:58.351021+0000","last_unstale":"2023-10-08T16:09:58.351738+0000","last_undegraded":"2023-10-08T16:09:58.351738+0000","last_fullsized":"2023-10-08T16:09:58.351738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:05.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.342117+0000","last_change":"2023-10-08T16:09:57.457330+0000","last_active":"2023-10-08T16:09:58.342117+0000","last_peered":"2023-10-08T16:09:58.342117+0000","last_clean":"2023-10-08T16:09:58.342117+0000","last_became_active":"2023-10-08T16:09:57.456790+0000","last_became_peered":"2023-10-08T16:09:57.456790+0000","last_unstale":"2023-10-08T16:09:58.342117+0000","last_undegraded":"2023-10-08T16:09:58.342117+0000","last_fullsized":"2023-10-08T16:09:58.342117+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:31.923896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.344510+0000","last_change":"2023-10-08T16:09:58.343910+0000","last_active":"2023-10-08T16:09:58.344510+0000","last_peered":"2023-10-08T16:09:58.344510+0000","last_clean":"2023-10-08T16:09:58.344510+0000","last_became_active":"2023-10-08T16:09:58.343174+0000","last_became_peered":"2023-10-08T16:09:58.343174+0000","last_unstale":"2023-10-08T16:09:58.344510+0000","last_undegraded":"2023-10-08T16:09:58.344510+0000","last_fullsized":"2023-10-08T16:09:58.344510+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:42.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.337831+0000","last_change":"2023-10-08T16:09:57.461686+0000","last_active":"2023-10-08T16:09:58.337831+0000","last_peered":"2023-10-08T16:09:58.337831+0000","last_clean":"2023-10-08T16:09:58.337831+0000","last_became_active":"2023-10-08T16:09:57.461453+0000","last_became_peered":"2023-10-08T16:09:57.461453+0000","last_unstale":"2023-10-08T16:09:58.337831+0000","last_undegraded":"2023-10-08T16:09:58.337831+0000","last_fullsized":"2023-10-08T16:09:58.337831+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:51.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345577+0000","last_change":"2023-10-08T16:09:58.345354+0000","last_active":"2023-10-08T16:09:58.345577+0000","last_peered":"2023-10-08T16:09:58.345577+0000","last_clean":"2023-10-08T16:09:58.345577+0000","last_became_active":"2023-10-08T16:09:58.344821+0000","last_became_peered":"2023-10-08T16:09:58.344821+0000","last_unstale":"2023-10-08T16:09:58.345577+0000","last_undegraded":"2023-10-08T16:09:58.345577+0000","last_fullsized":"2023-10-08T16:09:58.345577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.347710+0000","last_change":"2023-10-08T16:09:57.461524+0000","last_active":"2023-10-08T16:09:58.347710+0000","last_peered":"2023-10-08T16:09:58.347710+0000","last_clean":"2023-10-08T16:09:58.347710+0000","last_became_active":"2023-10-08T16:09:57.460632+0000","last_became_peered":"2023-10-08T16:09:57.460632+0000","last_unstale":"2023-10-08T16:09:58.347710+0000","last_undegraded":"2023-10-08T16:09:58.347710+0000","last_fullsized":"2023-10-08T16:09:58.347710+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:34.778433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.345695+0000","last_change":"2023-10-08T16:09:58.345557+0000","last_active":"2023-10-08T16:09:58.345695+0000","last_peered":"2023-10-08T16:09:58.345695+0000","last_clean":"2023-10-08T16:09:58.345695+0000","last_became_active":"2023-10-08T16:09:58.345322+0000","last_became_peered":"2023-10-08T16:09:58.345322+0000","last_unstale":"2023-10-08T16:09:58.345695+0000","last_undegraded":"2023-10-08T16:09:58.345695+0000","last_fullsized":"2023-10-08T16:09:58.345695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:20.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346358+0000","last_change":"2023-10-08T16:09:57.455674+0000","last_active":"2023-10-08T16:09:58.346358+0000","last_peered":"2023-10-08T16:09:58.346358+0000","last_clean":"2023-10-08T16:09:58.346358+0000","last_became_active":"2023-10-08T16:09:57.455389+0000","last_became_peered":"2023-10-08T16:09:57.455389+0000","last_unstale":"2023-10-08T16:09:58.346358+0000","last_undegraded":"2023-10-08T16:09:58.346358+0000","last_fullsized":"2023-10-08T16:09:58.346358+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:25.354947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.353621+0000","last_change":"2023-10-08T16:09:58.353140+0000","last_active":"2023-10-08T16:09:58.353621+0000","last_peered":"2023-10-08T16:09:58.353621+0000","last_clean":"2023-10-08T16:09:58.353621+0000","last_became_active":"2023-10-08T16:09:58.352218+0000","last_became_peered":"2023-10-08T16:09:58.352218+0000","last_unstale":"2023-10-08T16:09:58.353621+0000","last_undegraded":"2023-10-08T16:09:58.353621+0000","last_fullsized":"2023-10-08T16:09:58.353621+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:52.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.343447+0000","last_change":"2023-10-08T16:09:57.460683+0000","last_active":"2023-10-08T16:09:58.343447+0000","last_peered":"2023-10-08T16:09:58.343447+0000","last_clean":"2023-10-08T16:09:58.343447+0000","last_became_active":"2023-10-08T16:09:57.459926+0000","last_became_peered":"2023-10-08T16:09:57.459926+0000","last_unstale":"2023-10-08T16:09:58.343447+0000","last_undegraded":"2023-10-08T16:09:58.343447+0000","last_fullsized":"2023-10-08T16:09:58.343447+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:53.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.346363+0000","last_change":"2023-10-08T16:09:58.346286+0000","last_active":"2023-10-08T16:09:58.346363+0000","last_peered":"2023-10-08T16:09:58.346363+0000","last_clean":"2023-10-08T16:09:58.346363+0000","last_became_active":"2023-10-08T16:09:58.346046+0000","last_became_peered":"2023-10-08T16:09:58.346046+0000","last_unstale":"2023-10-08T16:09:58.346363+0000","last_undegraded":"2023-10-08T16:09:58.346363+0000","last_fullsized":"2023-10-08T16:09:58.346363+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:57.443251+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.443251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:39.372228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.457675+0000","last_change":"2023-10-08T16:09:57.463602+0000","last_active":"2023-10-08T16:09:58.457675+0000","last_peered":"2023-10-08T16:09:58.457675+0000","last_clean":"2023-10-08T16:09:58.457675+0000","last_became_active":"2023-10-08T16:09:57.463472+0000","last_became_peered":"2023-10-08T16:09:57.463472+0000","last_unstale":"2023-10-08T16:09:58.457675+0000","last_undegraded":"2023-10-08T16:09:58.457675+0000","last_fullsized":"2023-10-08T16:09:58.457675+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:56.438760+0000","last_clean_scrub_stamp":"2023-10-08T16:09:56.438760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:34.778433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-08T16:09:58.340095+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:09:58.340095+0000","last_peered":"2023-10-08T16:09:58.340095+0000","last_clean":"2023-10-08T16:09:58.340095+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:09:58.340095+0000","last_undegraded":"2023-10-08T16:09:58.340095+0000","last_fullsized":"2023-10-08T16:09:58.340095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198894107,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.438}]},{"osd":1,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73399999999999999,"5min":1.756,"15min":1.756},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72499999999999998,"5min":1.79,"15min":1.79},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":1.823,"15min":1.823},"last":0.56599999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.44400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":1.252,"15min":1.252},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.504},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.745,"15min":0.745},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.433},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.43099999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199484351,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.434,"15min":0.49199999999999999},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.59899999999999998,"5min":3.593,"15min":3.593},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68100000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.37}]},{"osd":2,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.433,"15min":0.47899999999999998},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63700000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.43099999999999999,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63500000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.61299999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.28999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64100000000000001,"15min":0.629},"min":{"1min":0.505,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90800000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54900000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.35299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83799999999999997,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":3.532,"15min":3.532},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81100000000000005,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.745},"min":{"1min":0.44800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.095,"15min":1.095},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0289999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.53800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1079,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198894143,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48899999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.66600000000000004,"5min":2.254,"15min":2.254},"last":0.30399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.379},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58199999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72999999999999998,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.373}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.378},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83399999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91500000000000004,"5min":1.079,"15min":1.079},"last":0.54900000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.875,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93799999999999994,"5min":2.355,"15min":2.355},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64200000000000002,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98199999999999998,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":1.002,"15min":1.002},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483991,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.246,"5min":0.185,"15min":0.185},"max":{"1min":0.52900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.374},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40799999999999997,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56499999999999995,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.746,"15min":0.746},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61699999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.44},"min":{"1min":0.32000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.44500000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.018,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.67000000000000004},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.046,"5min":1.091,"15min":1.091},"last":0.441},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.499,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199483009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34000000000000002,"15min":0.313},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44900000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.45000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.56299999999999994,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.35799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.46800000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41399999999999998,"15min":0.39400000000000002},"min":{"1min":0.28999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.754,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69599999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.621,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.498}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78000000000000003,"5min":0.999,"15min":0.999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76800000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194809,"statfs":{"total":200000000,"available":199484545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73299999999999998,"5min":1.141,"15min":1.141},"last":0.503},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76300000000000001,"5min":1.149,"15min":1.149},"last":0.76900000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67900000000000005,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.753,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.627},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.69599999999999995,"15min":0.59999999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75800000000000001,"5min":14.6,"15min":14.6},"last":0.73399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.629,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74199999999999999,"5min":7.556,"15min":7.556},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69299999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.78700000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60299999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63100000000000001,"5min":0.754,"15min":0.754},"last":0.435}]},{"osd":6,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.61199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.61699999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199482987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51000000000000001,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57799999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.622},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71499999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61799999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59799999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58499999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60899999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:10:02.939 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:10:02.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:10:02.989 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:03.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:03.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.100+0000 7f53e3fff700 1 Processor -- start 2023-10-08T16:10:03.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.100+0000 7f53e3fff700 1 -- start start 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53e40682e0 0x7f53e406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e406f550 con 0x7f53e4159b60 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e3fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e4067e50 con 0x7f53e4159f30 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e3fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40cb810 con 0x7f53e40682e0 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f53e4159b60 0x7f53e4070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58060/0 (socket says 172.21.15.60:58060) 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e2ffd700 1 -- 172.21.15.60:0/307051255 learned_addr learned my addr 172.21.15.60:0/307051255 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.101+0000 7f53e37fe700 1 --2- 172.21.15.60:0/307051255 >> v2:172.21.15.144:3300/0 conn(0x7f53e40682e0 0x7f53e406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e1ffb700 1 -- 172.21.15.60:0/307051255 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115214211 0 0) 0x7f53e406f550 con 0x7f53e4159b60 2023-10-08T16:10:03.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e1ffb700 1 -- 172.21.15.60:0/307051255 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d0003570 con 0x7f53e4159b60 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e37fe700 1 -- 172.21.15.60:0/307051255 >> v1:172.21.15.144:6789/0 conn(0x7f53e4159f30 legacy=0x7f53e415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e37fe700 1 -- 172.21.15.60:0/307051255 >> v1:172.21.15.60:6789/0 conn(0x7f53e4159b60 legacy=0x7f53e4070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e37fe700 1 -- 172.21.15.60:0/307051255 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e406f780 con 0x7f53e40682e0 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e37fe700 1 --2- 172.21.15.60:0/307051255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e40682e0 0x7f53e406f010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53d40098e0 tx=0x7f53d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e98ede221efb5d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e1ffb700 1 -- 172.21.15.60:0/307051255 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400b640 con 0x7f53e40682e0 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e1ffb700 1 -- 172.21.15.60:0/307051255 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400b7a0 con 0x7f53e40682e0 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.102+0000 7f53e1ffb700 1 -- 172.21.15.60:0/307051255 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400bb20 con 0x7f53e40682e0 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 -- 172.21.15.60:0/307051255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e40682e0 msgr2=0x7f53e406f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 --2- 172.21.15.60:0/307051255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e40682e0 0x7f53e406f010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53d40098e0 tx=0x7f53d40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 -- 172.21.15.60:0/307051255 shutdown_connections 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 --2- 172.21.15.60:0/307051255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e40682e0 0x7f53e406f010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 -- 172.21.15.60:0/307051255 >> 172.21.15.60:0/307051255 conn(0x7f53e40cd900 msgr2=0x7f53e40cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 -- 172.21.15.60:0/307051255 shutdown_connections 2023-10-08T16:10:03.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.103+0000 7f53e3fff700 1 -- 172.21.15.60:0/307051255 wait complete. 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.104+0000 7f53e3fff700 1 Processor -- start 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.104+0000 7f53e3fff700 1 -- start start 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 0x7f53e40b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53e4159b60 0x7f53e416dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e4159f30 0x7f53e414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40b3550 con 0x7f53e40682e0 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e3fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e416e500 con 0x7f53e4159f30 2023-10-08T16:10:03.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e3fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40ad730 con 0x7f53e4159b60 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 0x7f53e40b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 0x7f53e40b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48108/0 (socket says 172.21.15.60:48108) 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 -- 172.21.15.60:0/1999376805 learned_addr learned my addr 172.21.15.60:0/1999376805 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e27fc700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53e4159b60 0x7f53e416dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e37fe700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e4159f30 0x7f53e414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 -- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53e4159b60 msgr2=0x7f53e416dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53e4159b60 0x7f53e416dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 -- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e4159f30 msgr2=0x7f53e414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e4159f30 0x7f53e414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 -- 172.21.15.60:0/1999376805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009420 con 0x7f53e40682e0 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53e2ffd700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 0x7f53e40b1e40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00cd60 tx=0x7f53dc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00aa80 con 0x7f53e40682e0 2023-10-08T16:10:03.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.105+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00ac00 con 0x7f53e40682e0 2023-10-08T16:10:03.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.106+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0070f0 con 0x7f53e40682e0 2023-10-08T16:10:03.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.106+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40b30c0 con 0x7f53e40682e0 2023-10-08T16:10:03.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.106+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e40b2790 con 0x7f53e40682e0 2023-10-08T16:10:03.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.106+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e40b33a0 con 0x7f53e40682e0 2023-10-08T16:10:03.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.107+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53dc0074a0 con 0x7f53e40682e0 2023-10-08T16:10:03.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.107+0000 7f53daffd700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f53c4066f30 0x7f53c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.107+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53dc084910 con 0x7f53e40682e0 2023-10-08T16:10:03.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.107+0000 7f53e27fc700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f53c4066f30 0x7f53c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.108+0000 7f53e27fc700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f53c4066f30 0x7f53c40693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f53e40b04e0 tx=0x7f53cc007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:03.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.111+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53dc051b60 con 0x7f53e40682e0 2023-10-08T16:10:03.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.386+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f53e406d690 con 0x7f53e40682e0 2023-10-08T16:10:03.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.389+0000 7f53daffd700 1 -- 172.21.15.60:0/1999376805 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f53dc055180 con 0x7f53e40682e0 2023-10-08T16:10:03.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f53c4066f30 msgr2=0x7f53c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f53c4066f30 0x7f53c40693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f53e40b04e0 tx=0x7f53cc007ea0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 msgr2=0x7f53e40b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 0x7f53e40b1e40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00cd60 tx=0x7f53dc001b10 comp rx=0 tx=0).stop 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 shutdown_connections 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f53c4066f30 0x7f53c40693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53e4159f30 0x7f53e414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e40682e0 0x7f53e40b1e40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 --2- 172.21.15.60:0/1999376805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53e4159b60 0x7f53e416dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 >> 172.21.15.60:0/1999376805 conn(0x7f53e40cd900 msgr2=0x7f53e4070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 shutdown_connections 2023-10-08T16:10:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.391+0000 7f53e3fff700 1 -- 172.21.15.60:0/1999376805 wait complete. 2023-10-08T16:10:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:10:03.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:03.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.562+0000 7fe8a9023700 1 Processor -- start 2023-10-08T16:10:03.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.562+0000 7fe8a9023700 1 -- start start 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a9023700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8a41523e0 0x7fe8a406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a9023700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8a4158e50 0x7fe8a40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a9023700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a406c010 con 0x7fe8a4152010 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a9023700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a406bd10 con 0x7fe8a4158e50 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a9023700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a415c060 con 0x7fe8a41523e0 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8a4158e50 0x7fe8a40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a2d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe8a4152010 0x7fe8a415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58076/0 (socket says 172.21.15.60:58076) 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a2d9d700 1 -- 172.21.15.60:0/2626962738 learned_addr learned my addr 172.21.15.60:0/2626962738 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.563+0000 7fe8a259c700 1 --2- 172.21.15.60:0/2626962738 >> v2:172.21.15.144:3300/0 conn(0x7fe8a41523e0 0x7fe8a406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a359e700 1 -- 172.21.15.60:0/2626962738 >> v2:172.21.15.144:3300/0 conn(0x7fe8a41523e0 msgr2=0x7fe8a406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a359e700 1 --2- 172.21.15.60:0/2626962738 >> v2:172.21.15.144:3300/0 conn(0x7fe8a41523e0 0x7fe8a406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a359e700 1 -- 172.21.15.60:0/2626962738 >> v1:172.21.15.60:6789/0 conn(0x7fe8a4152010 legacy=0x7fe8a415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a1d9b700 1 -- 172.21.15.60:0/2626962738 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304036955 0 0) 0x7fe8a406c010 con 0x7fe8a4152010 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a359e700 1 -- 172.21.15.60:0/2626962738 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a415c340 con 0x7fe8a4158e50 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a359e700 1 --2- 172.21.15.60:0/2626962738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a40cdf30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40ceae0 tx=0x7fe894009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f996f95a67fefa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a1d9b700 1 -- 172.21.15.60:0/2626962738 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400e070 con 0x7fe8a4158e50 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a1d9b700 1 -- 172.21.15.60:0/2626962738 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400bb60 con 0x7fe8a4158e50 2023-10-08T16:10:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a1d9b700 1 -- 172.21.15.60:0/2626962738 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894012430 con 0x7fe8a4158e50 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 -- 172.21.15.60:0/2626962738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 msgr2=0x7fe8a40cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 --2- 172.21.15.60:0/2626962738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a40cdf30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40ceae0 tx=0x7fe894009780 comp rx=0 tx=0).stop 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 -- 172.21.15.60:0/2626962738 shutdown_connections 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 --2- 172.21.15.60:0/2626962738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a40cdf30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 --2- 172.21.15.60:0/2626962738 >> v2:172.21.15.144:3300/0 conn(0x7fe8a41523e0 0x7fe8a406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 -- 172.21.15.60:0/2626962738 >> 172.21.15.60:0/2626962738 conn(0x7fe8a4069870 msgr2=0x7fe8a4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.564+0000 7fe8a9023700 1 -- 172.21.15.60:0/2626962738 shutdown_connections 2023-10-08T16:10:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.565+0000 7fe8a9023700 1 -- 172.21.15.60:0/2626962738 wait complete. 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 Processor -- start 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 -- start start 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8a4152010 0x7fe8a4142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8a41523e0 0x7fe8a414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a4068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4142b70 con 0x7fe8a4158e50 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a414ea80 con 0x7fe8a4152010 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.566+0000 7fe8a9023700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a414d540 con 0x7fe8a41523e0 2023-10-08T16:10:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a4068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a4068070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48116/0 (socket says 172.21.15.60:48116) 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 -- 172.21.15.60:0/3140398805 learned_addr learned my addr 172.21.15.60:0/3140398805 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a2d9d700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8a4152010 0x7fe8a4142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a259c700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8a41523e0 0x7fe8a414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 -- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8a41523e0 msgr2=0x7fe8a414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8a41523e0 0x7fe8a414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 -- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8a4152010 msgr2=0x7fe8a4142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8a4152010 0x7fe8a4142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 -- 172.21.15.60:0/3140398805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894009a20 con 0x7fe8a4158e50 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a359e700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a4068070 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe89400b6c0 tx=0x7fe894019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894027470 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8940275d0 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894027990 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a414f270 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.567+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a414ecb0 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.568+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a404c3c0 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.569+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe894024070 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.569+0000 7fe89affd700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe884066f30 0x7fe8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.569+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe894086de0 con 0x7fe8a4158e50 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.569+0000 7fe8a2d9d700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe884066f30 0x7fe8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:03.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.570+0000 7fe8a2d9d700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe884066f30 0x7fe8840693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe89c007160 tx=0x7fe89c007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:03.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.574+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe894054100 con 0x7fe8a4158e50 2023-10-08T16:10:03.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.812+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8a4151ba0 con 0x7fe8a4158e50 2023-10-08T16:10:03.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.813+0000 7fe89affd700 1 -- 172.21.15.60:0/3140398805 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fe89402c090 con 0x7fe8a4158e50 2023-10-08T16:10:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:03.813 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe884066f30 msgr2=0x7fe8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe884066f30 0x7fe8840693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe89c007160 tx=0x7fe89c007f50 comp rx=0 tx=0).stop 2023-10-08T16:10:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 msgr2=0x7fe8a4068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a4068070 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe89400b6c0 tx=0x7fe894019000 comp rx=0 tx=0).stop 2023-10-08T16:10:03.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 shutdown_connections 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe884066f30 0x7fe8840693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8a4158e50 0x7fe8a4068070 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8a4152010 0x7fe8a4142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 --2- 172.21.15.60:0/3140398805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8a41523e0 0x7fe8a414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 >> 172.21.15.60:0/3140398805 conn(0x7fe8a4069870 msgr2=0x7fe8a414c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 shutdown_connections 2023-10-08T16:10:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:03.815+0000 7fe8a9023700 1 -- 172.21.15.60:0/3140398805 wait complete. 2023-10-08T16:10:03.818 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:04.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:09:57.850301+0000', 'modified': '2023-10-08T16:10:01.467107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6381': {'gid': 6381, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6836/2808352006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 2808352006}, {'type': 'v1', 'addr': '172.21.15.60:6836', 'nonce': 2808352006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:10:04.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:10:04.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:10:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.354+0000 7fadd5a87700 1 Processor -- start 2023-10-08T16:10:04.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.354+0000 7fadd5a87700 1 -- start start 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadd5a87700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fadd0159c10 0x7fadd00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadd5a87700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fadd00cde30 0x7fadd0067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadd5a87700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd00cc350 con 0x7fadd00cbbe0 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadd5a87700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00b0870 con 0x7fadd00cde30 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadd5a87700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00cee50 con 0x7fadd0159c10 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadcffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fadd00cde30 0x7fadd0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadcffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fadd00cde30 0x7fadd0067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48128/0 (socket says 172.21.15.60:48128) 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadcffff700 1 -- 172.21.15.60:0/741079929 learned_addr learned my addr 172.21.15.60:0/741079929 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadd4a85700 1 --2- 172.21.15.60:0/741079929 >> v2:172.21.15.144:3300/0 conn(0x7fadd0159c10 0x7fadd00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadcffff700 1 -- 172.21.15.60:0/741079929 >> v2:172.21.15.144:3300/0 conn(0x7fadd0159c10 msgr2=0x7fadd00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadcffff700 1 --2- 172.21.15.60:0/741079929 >> v2:172.21.15.144:3300/0 conn(0x7fadd0159c10 0x7fadd00b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.355+0000 7fadcffff700 1 -- 172.21.15.60:0/741079929 >> v1:172.21.15.144:6789/0 conn(0x7fadd00cbbe0 legacy=0x7fadd015d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadcffff700 1 -- 172.21.15.60:0/741079929 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00cc070 con 0x7fadd00cde30 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadcffff700 1 --2- 172.21.15.60:0/741079929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd0067660 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fadd006b890 tx=0x7fadc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132332d18b2e3a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadcf7fe700 1 -- 172.21.15.60:0/741079929 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0009e70 con 0x7fadd00cde30 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadcf7fe700 1 -- 172.21.15.60:0/741079929 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000b860 con 0x7fadd00cde30 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadcf7fe700 1 -- 172.21.15.60:0/741079929 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000bc00 con 0x7fadd00cde30 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadd5a87700 1 -- 172.21.15.60:0/741079929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 msgr2=0x7fadd0067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadd5a87700 1 --2- 172.21.15.60:0/741079929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd0067660 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fadd006b890 tx=0x7fadc0009250 comp rx=0 tx=0).stop 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadd5a87700 1 -- 172.21.15.60:0/741079929 shutdown_connections 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadd5a87700 1 --2- 172.21.15.60:0/741079929 >> v2:172.21.15.144:3300/0 conn(0x7fadd0159c10 0x7fadd00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadd5a87700 1 --2- 172.21.15.60:0/741079929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd0067660 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.356+0000 7fadd5a87700 1 -- 172.21.15.60:0/741079929 >> 172.21.15.60:0/741079929 conn(0x7fadd00d1660 msgr2=0x7fadd00cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.357+0000 7fadd5a87700 1 -- 172.21.15.60:0/741079929 shutdown_connections 2023-10-08T16:10:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.357+0000 7fadd5a87700 1 -- 172.21.15.60:0/741079929 wait complete. 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.358+0000 7fadd5a87700 1 Processor -- start 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.358+0000 7fadd5a87700 1 -- start start 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadd00cbbe0 0x7fadd00b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadd0159c10 0x7fadd016a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00b6840 con 0x7fadd00cde30 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00b3d30 con 0x7fadd0159c10 2023-10-08T16:10:04.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00b4010 con 0x7fadd00cbbe0 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd015b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48140/0 (socket says 172.21.15.60:48140) 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 -- 172.21.15.60:0/408531968 learned_addr learned my addr 172.21.15.60:0/408531968 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd4a85700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadd00cbbe0 0x7fadd00b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5286700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadd0159c10 0x7fadd016a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 -- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadd00cbbe0 msgr2=0x7fadd00b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadd00cbbe0 0x7fadd00b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 -- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadd0159c10 msgr2=0x7fadd016a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadd0159c10 0x7fadd016a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 -- 172.21.15.60:0/408531968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00094f0 con 0x7fadd00cde30 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadcffff700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd015b6b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fadd0089560 tx=0x7fadc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadccff9700 1 -- 172.21.15.60:0/408531968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000bbe0 con 0x7fadd00cde30 2023-10-08T16:10:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadccff9700 1 -- 172.21.15.60:0/408531968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0011420 con 0x7fadd00cde30 2023-10-08T16:10:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd00b42f0 con 0x7fadd00cde30 2023-10-08T16:10:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadccff9700 1 -- 172.21.15.60:0/408531968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00117c0 con 0x7fadd00cde30 2023-10-08T16:10:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.359+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd00b48b0 con 0x7fadd00cde30 2023-10-08T16:10:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.361+0000 7fadccff9700 1 -- 172.21.15.60:0/408531968 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadc0011bf0 con 0x7fadd00cde30 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.361+0000 7fadccff9700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fadb0066f30 0x7fadb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.361+0000 7fadccff9700 1 -- 172.21.15.60:0/408531968 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadc0085a00 con 0x7fadd00cde30 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.361+0000 7fadd4a85700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fadb0066f30 0x7fadb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.362+0000 7fadd4a85700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fadb0066f30 0x7fadb00693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009fd0 tx=0x7fadc800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.363+0000 7faddffe1b80 1 Processor -- start 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.363+0000 7faddffe1b80 1 -- start start 2023-10-08T16:10:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e66b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e68c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e641ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7faddffe1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e598a70 con 0x56258e68c480 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e596270 con 0x56258e63f5f0 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56258e592060 con 0x56258e641b80 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e66b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e66b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48146/0 (socket says 172.21.15.60:48146) 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 -- 172.21.15.60:0/4046116218 learned_addr learned my addr 172.21.15.60:0/4046116218 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd5286700 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e641ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadcffff700 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e68c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 -- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 msgr2=0x56258e641ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e641ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 -- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 msgr2=0x56258e68c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e68c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 -- 172.21.15.60:0/4046116218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56258e42c270 con 0x56258e68c480 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadcffff700 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e68c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.364+0000 7fadd4a85700 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e66b7d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fadc8017790 tx=0x7fadc8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c5c7094205ca91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7fadc5ffb700 1 -- 172.21.15.60:0/4046116218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc801c040 con 0x56258e68c480 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7fadc5ffb700 1 -- 172.21.15.60:0/4046116218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800f040 con 0x56258e68c480 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7fadc5ffb700 1 -- 172.21.15.60:0/4046116218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800e040 con 0x56258e68c480 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 -- 172.21.15.60:0/4046116218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 msgr2=0x56258e66b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e66b7d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fadc8017790 tx=0x7fadc8019000 comp rx=0 tx=0).stop 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 -- 172.21.15.60:0/4046116218 shutdown_connections 2023-10-08T16:10:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e641ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e66b7d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 --2- 172.21.15.60:0/4046116218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e68c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 -- 172.21.15.60:0/4046116218 >> 172.21.15.60:0/4046116218 conn(0x56258e6430c0 msgr2=0x56258e6438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 -- 172.21.15.60:0/4046116218 shutdown_connections 2023-10-08T16:10:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.365+0000 7faddffe1b80 1 -- 172.21.15.60:0/4046116218 wait complete. 2023-10-08T16:10:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.366+0000 7faddffe1b80 1 -- start start 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.366+0000 7faddffe1b80 1 Processor -- start 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e69c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e69b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e68c480 0x56258e665420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e53d890 con 0x56258e641b80 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e558ea0 con 0x56258e63f5f0 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56258e414e30 con 0x56258e68c480 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7faddffe1b80 10 client.0 _ll_register_callbacks cb 0x56258e6052c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e69b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e69b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48154/0 (socket says 172.21.15.60:48154) 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 -- 172.21.15.60:0/1016136514 learned_addr learned my addr 172.21.15.60:0/1016136514 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadd4a85700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e69c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadd5286700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e68c480 0x56258e665420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 -- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e68c480 msgr2=0x56258e665420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e68c480 0x56258e665420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 -- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 msgr2=0x56258e69c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e69c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 -- 172.21.15.60:0/1016136514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc8017440 con 0x56258e641b80 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadcffff700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e69b930 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fadc0052e30 tx=0x7fadc0083e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0dcfdde162c56 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.367+0000 7fadaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:10:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadaeffd700 1 -- 172.21.15.60:0/1016136514 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011ea0 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56258e636cd0 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadaeffd700 1 -- 172.21.15.60:0/1016136514 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadc0006c70 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadaeffd700 1 -- 172.21.15.60:0/1016136514 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc0056930 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 10 client.6534 fetch_fsmap learned FSMap version 52 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x56258e3cefe0 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadaeffd700 1 -- 172.21.15.60:0/1016136514 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0082020 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadaeffd700 1 -- 172.21.15.60:0/1016136514 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fadc005d440 con 0x56258e641b80 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 10 client.6534 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 10 client.6534 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 20 client.6534 populate_metadata read hostname 'smithi060' 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e6692b0 0x56258e669680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 4 client.6534 mds_command: new command op to 6381 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 --> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56258e613aa0 con 0x56258e6692b0 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadd4a85700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e6692b0 0x56258e669680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadaeffd700 10 client.6534 ms_handle_connect on v2:172.21.15.60:6834/2808352006 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.368+0000 7fadd4a85700 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e6692b0 0x56258e669680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fdb2409d8cbf868 server_cookie=aed6fc328d357ea1 in_seq=0 out_seq=0 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7fadaeffd700 1 -- 172.21.15.60:0/1016136514 <== mds.0 v2:172.21.15.60:6834/2808352006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56258e613aa0 con 0x56258e6692b0 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7fadaeffd700 10 client.6534 handle_command_reply: tid=0 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 client.6534 shutdown 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 msgr2=0x56258e69b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e69b930 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fadc0052e30 tx=0x7fadc0083e80 comp rx=0 tx=0).stop 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 shutdown_connections 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e6692b0 0x56258e669680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e68c480 0x56258e665420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e69c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 --2- 172.21.15.60:0/1016136514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e69b930 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 >> 172.21.15.60:0/1016136514 conn(0x56258e6430c0 msgr2=0x56258e641ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7fadaeffd700 0 client.6534 ms_handle_reset on v2:172.21.15.60:6834/2808352006 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 shutdown_connections 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.369+0000 7faddffe1b80 1 -- 172.21.15.60:0/1016136514 wait complete. 2023-10-08T16:10:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.370+0000 7faddffe1b80 20 client.6534 trim_cache size 0 max 16384 2023-10-08T16:10:04.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.386+0000 7faddffe1b80 1 Processor -- start 2023-10-08T16:10:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 -- start start 2023-10-08T16:10:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e63f5f0 0x56258e642260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e63ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e68c480 0x56258e63efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e6420f0 con 0x56258e641b80 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e642a10 con 0x56258e68c480 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56258e66b650 con 0x56258e63f5f0 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e63ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e63ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48164/0 (socket says 172.21.15.60:48164) 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 -- 172.21.15.60:0/546878175 learned_addr learned my addr 172.21.15.60:0/546878175 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadd4a85700 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e63f5f0 0x56258e642260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadd5286700 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e68c480 0x56258e63efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 -- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e63f5f0 msgr2=0x56258e642260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e63f5f0 0x56258e642260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 -- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e68c480 msgr2=0x56258e63efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.387+0000 7fadcffff700 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e68c480 0x56258e63efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7fadcffff700 1 -- 172.21.15.60:0/546878175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56258e560780 con 0x56258e641b80 2023-10-08T16:10:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7fadcffff700 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e63ea70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fadc0085ce0 tx=0x7fadc006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a26aefe9ad262c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7fadc67fc700 1 -- 172.21.15.60:0/546878175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011ea0 con 0x56258e641b80 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7fadc67fc700 1 -- 172.21.15.60:0/546878175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0082070 con 0x56258e641b80 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7fadc67fc700 1 -- 172.21.15.60:0/546878175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0059bd0 con 0x56258e641b80 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 -- 172.21.15.60:0/546878175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 msgr2=0x56258e63ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e63ea70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fadc0085ce0 tx=0x7fadc006c000 comp rx=0 tx=0).stop 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 -- 172.21.15.60:0/546878175 shutdown_connections 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e63f5f0 0x56258e642260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e68c480 0x56258e63efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 --2- 172.21.15.60:0/546878175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e641b80 0x56258e63ea70 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 -- 172.21.15.60:0/546878175 >> 172.21.15.60:0/546878175 conn(0x56258e6430c0 msgr2=0x56258e644e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 -- 172.21.15.60:0/546878175 shutdown_connections 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.388+0000 7faddffe1b80 1 -- 172.21.15.60:0/546878175 wait complete. 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.389+0000 7faddffe1b80 1 -- start start 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.389+0000 7faddffe1b80 1 Processor -- start 2023-10-08T16:10:04.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e6eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e637f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e699580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e66ed20 con 0x56258e68c480 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258e6ee5c0 con 0x56258e63f5f0 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56258e6413a0 con 0x56258e641b80 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7faddffe1b80 10 client.0 _ll_register_callbacks cb 0x56258e6052c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e699580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd4a85700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e6eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e699580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48168/0 (socket says 172.21.15.60:48168) 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 -- 172.21.15.60:0/2862744984 learned_addr learned my addr 172.21.15.60:0/2862744984 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadcffff700 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e637f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 -- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 msgr2=0x56258e637f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e637f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 -- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 msgr2=0x56258e6eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e6eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 -- 172.21.15.60:0/2862744984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56258e3cefe0 con 0x56258e68c480 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadd5286700 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e699580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fadb8017a40 tx=0x7fadb8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bf87cdaddf3509 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.390+0000 7fadaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadaeffd700 1 -- 172.21.15.60:0/2862744984 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80159d0 con 0x56258e68c480 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadaeffd700 1 -- 172.21.15.60:0/2862744984 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadb8015b30 con 0x56258e68c480 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadc800f040 con 0x56258e68c480 2023-10-08T16:10:04.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadaeffd700 1 -- 172.21.15.60:0/2862744984 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadb8020440 con 0x56258e68c480 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 10 client.6540 fetch_fsmap learned FSMap version 52 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x56258e547470 con 0x56258e68c480 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadaeffd700 1 -- 172.21.15.60:0/2862744984 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800f040 con 0x56258e68c480 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadaeffd700 1 -- 172.21.15.60:0/2862744984 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fadb8012070 con 0x56258e68c480 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 10 client.6540 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 10 client.6540 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 20 client.6540 populate_metadata read hostname 'smithi060' 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e66df60 0x56258e66e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 4 client.6540 mds_command: new command op to 6381 tid=0[{"prefix": "status"}] 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 --> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56258e534e00 con 0x56258e66df60 2023-10-08T16:10:04.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadd4a85700 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e66df60 0x56258e66e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadd4a85700 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e66df60 0x56258e66e330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360a9fb90ece9135 server_cookie=a4c208cd6a9a2872 in_seq=0 out_seq=0 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.391+0000 7fadaeffd700 10 client.6540 ms_handle_connect on v2:172.21.15.60:6834/2808352006 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadaeffd700 1 -- 172.21.15.60:0/2862744984 <== mds.0 v2:172.21.15.60:6834/2808352006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56258e534e00 con 0x56258e66df60 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadaeffd700 10 client.6540 handle_command_reply: tid=0 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 client.6540 shutdown 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 msgr2=0x56258e699580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e699580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fadb8017a40 tx=0x7fadb8009040 comp rx=0 tx=0).stop 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 shutdown_connections 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56258e68c480 0x56258e699580 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56258e63f5f0 0x56258e6eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.60:6834/2808352006,v1:172.21.15.60:6836/2808352006] conn(0x56258e66df60 0x56258e66e330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 --2- 172.21.15.60:0/2862744984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56258e641b80 0x56258e637f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 >> 172.21.15.60:0/2862744984 conn(0x56258e6430c0 msgr2=0x56258e63ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadaeffd700 0 client.6540 ms_handle_reset on v2:172.21.15.60:6834/2808352006 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 shutdown_connections 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 1 -- 172.21.15.60:0/2862744984 wait complete. 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7faddffe1b80 20 client.6540 trim_cache size 0 max 16384 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 6381, 2023-10-08T16:10:04.404 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 5.9423173580000004, 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 52, 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 96, 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 96, 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10.767064086 2023-10-08T16:10:04.405 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fadb0066f30 msgr2=0x7fadb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fadb0066f30 0x7fadb00693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009fd0 tx=0x7fadc800b040 comp rx=0 tx=0).stop 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 msgr2=0x7fadd015b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd015b6b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fadd0089560 tx=0x7fadc0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 shutdown_connections 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fadb0066f30 0x7fadb00693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadd00cbbe0 0x7fadd00b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadd0159c10 0x7fadd016a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 --2- 172.21.15.60:0/408531968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadd00cde30 0x7fadd015b6b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.392+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 >> 172.21.15.60:0/408531968 conn(0x7fadd00d1660 msgr2=0x7fadd00c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.393+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 shutdown_connections 2023-10-08T16:10:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.393+0000 7fadd5a87700 1 -- 172.21.15.60:0/408531968 wait complete. 2023-10-08T16:10:04.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:10:04.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.526+0000 7f1f6a743700 1 Processor -- start 2023-10-08T16:10:04.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.526+0000 7f1f6a743700 1 -- start start 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f6a743700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f64152010 0x7f1f6415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f6a743700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f641523e0 0x7f1f6406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f6a743700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406c010 con 0x7f1f64158e50 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f6a743700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6406bd10 con 0x7f1f641523e0 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f6a743700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6415c060 con 0x7f1f64152010 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f637fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f641523e0 0x7f1f6406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.527+0000 7f1f637fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f641523e0 0x7f1f6406c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48174/0 (socket says 172.21.15.60:48174) 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f637fe700 1 -- 172.21.15.60:0/1017574306 learned_addr learned my addr 172.21.15.60:0/1017574306 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f63fff700 1 --2- 172.21.15.60:0/1017574306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f64152010 0x7f1f6415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f637fe700 1 -- 172.21.15.60:0/1017574306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f64152010 msgr2=0x7f1f6415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f637fe700 1 --2- 172.21.15.60:0/1017574306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f64152010 0x7f1f6415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f637fe700 1 -- 172.21.15.60:0/1017574306 >> v1:172.21.15.144:6789/0 conn(0x7f1f64158e50 legacy=0x7f1f640cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f637fe700 1 -- 172.21.15.60:0/1017574306 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6415c340 con 0x7f1f641523e0 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f637fe700 1 --2- 172.21.15.60:0/1017574306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f641523e0 0x7f1f6406c4a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1f580099b0 tx=0x7f1f58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd518917f2d59ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f62ffd700 1 -- 172.21.15.60:0/1017574306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58009ea0 con 0x7f1f641523e0 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f62ffd700 1 -- 172.21.15.60:0/1017574306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5800b860 con 0x7f1f641523e0 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.528+0000 7f1f62ffd700 1 -- 172.21.15.60:0/1017574306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800bc00 con 0x7f1f641523e0 2023-10-08T16:10:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 -- 172.21.15.60:0/1017574306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f641523e0 msgr2=0x7f1f6406c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1017574306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f641523e0 0x7f1f6406c4a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1f580099b0 tx=0x7f1f58009250 comp rx=0 tx=0).stop 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 -- 172.21.15.60:0/1017574306 shutdown_connections 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1017574306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f64152010 0x7f1f6415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1017574306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f641523e0 0x7f1f6406c4a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 -- 172.21.15.60:0/1017574306 >> 172.21.15.60:0/1017574306 conn(0x7f1f64069870 msgr2=0x7f1f64069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 -- 172.21.15.60:0/1017574306 shutdown_connections 2023-10-08T16:10:04.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.529+0000 7f1f6a743700 1 -- 172.21.15.60:0/1017574306 wait complete. 2023-10-08T16:10:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.530+0000 7f1f6a743700 1 Processor -- start 2023-10-08T16:10:04.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.530+0000 7f1f6a743700 1 -- start start 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f6a743700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 0x7f1f64067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f6a743700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f641523e0 0x7f1f64169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f6a743700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f64158e50 0x7f1f640c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f6a743700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64155550 con 0x7f1f64152010 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f6a743700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6416a2e0 con 0x7f1f64158e50 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f6a743700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64154940 con 0x7f1f641523e0 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 0x7f1f64067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 0x7f1f64067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48188/0 (socket says 172.21.15.60:48188) 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 -- 172.21.15.60:0/1785217529 learned_addr learned my addr 172.21.15.60:0/1785217529 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f637fe700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f641523e0 0x7f1f64169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f68ce0700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f64158e50 0x7f1f640c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 -- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f641523e0 msgr2=0x7f1f64169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f641523e0 0x7f1f64169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 -- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f64158e50 msgr2=0x7f1f640c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f64158e50 0x7f1f640c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 -- 172.21.15.60:0/1785217529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580094f0 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f63fff700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 0x7f1f64067660 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e930 tx=0x7f1f540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54013680 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f540137e0 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.531+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54013b80 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.532+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64154c20 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.532+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f641551e0 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.532+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6404c3c0 con 0x7f1f64152010 2023-10-08T16:10:04.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.533+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f5400c3e0 con 0x7f1f64152010 2023-10-08T16:10:04.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.533+0000 7f1f4bfff700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f50066f30 0x7f1f500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.533+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f54084620 con 0x7f1f64152010 2023-10-08T16:10:04.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.533+0000 7f1f637fe700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f50066f30 0x7f1f500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.534+0000 7f1f637fe700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f50066f30 0x7f1f500693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f580099b0 tx=0x7f1f58017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.538+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f54051890 con 0x7f1f64152010 2023-10-08T16:10:04.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.775+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f640cf8f0 con 0x7f1f64152010 2023-10-08T16:10:04.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.775+0000 7f1f4bfff700 1 -- 172.21.15.60:0/1785217529 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f54054eb0 con 0x7f1f64152010 2023-10-08T16:10:04.775 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:10:04.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f50066f30 msgr2=0x7f1f500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f50066f30 0x7f1f500693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f580099b0 tx=0x7f1f58017000 comp rx=0 tx=0).stop 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 msgr2=0x7f1f64067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 0x7f1f64067660 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e930 tx=0x7f1f540091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 shutdown_connections 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f50066f30 0x7f1f500693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f64158e50 0x7f1f640c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f64152010 0x7f1f64067660 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 --2- 172.21.15.60:0/1785217529 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f641523e0 0x7f1f64169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 >> 172.21.15.60:0/1785217529 conn(0x7f1f64069870 msgr2=0x7f1f64069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 shutdown_connections 2023-10-08T16:10:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:04.777+0000 7f1f6a743700 1 -- 172.21.15.60:0/1785217529 wait complete. 2023-10-08T16:10:04.789 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:10:04.789 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:10:04.789 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:10:04.789 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:10:04.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:04.790 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:10:04.790 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:10:04.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:10:04.790 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:04.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:04.790 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:10:04.805 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:10:04.805 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:10:04.805 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:10:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42136sec preferred_lft 42136sec 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:10:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:04.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:04.809 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:10:04.869 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:10:04.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:04.871 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:10:04.927 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:10:04.928 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:10:04.928 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:10:04.928 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:10:04.928 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:10:04.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:04.928 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:10:04.928 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:10:04.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:10:04.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:10:04.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:10:04.929 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:10:05.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.030 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:10:05.045 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:10:05.045 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:10:05.045 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:05.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:10:05.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:05.111 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:05.166 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:05.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:05.167 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:05.222 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:10:05.222 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:10:05.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:05.303 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:05.303 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:05.322 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:05.322 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:05.322 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:05.322 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:05.322 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:05.323 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:05.323 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:05.323 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:05.344 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:05.344 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:05.344 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:05.344 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:05.344 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:05.344 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:05.345 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:05.345 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:05.345 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:10:05.345 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:10:05.345 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:10:05.346 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:10:05.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:05.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:10:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.572+0000 7fb342595700 1 Processor -- start 2023-10-08T16:10:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.572+0000 7fb342595700 1 -- start start 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb342595700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb33c0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb342595700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0cb0b0 con 0x7fb33c157a90 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb342595700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0b0830 con 0x7fb33c06fef0 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb342595700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0b0ad0 con 0x7fb33c157e60 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb341593700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb33c157a90 0x7fb33c0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58086/0 (socket says 172.21.15.60:58086) 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb341593700 1 -- 172.21.15.60:0/3408947275 learned_addr learned my addr 172.21.15.60:0/3408947275 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb340d92700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb33c0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004400840 0 0) 0x7fb33c0cb0b0 con 0x7fb33c157a90 2023-10-08T16:10:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.573+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb324003570 con 0x7fb33c157a90 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351571372 0 0) 0x7fb33c0b0830 con 0x7fb33c06fef0 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c0cb0b0 con 0x7fb33c06fef0 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3691523681 0 0) 0x7fb324003570 con 0x7fb33c157a90 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 msgr2=0x7fb33c0b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb33c0b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 >> v1:172.21.15.144:6789/0 conn(0x7fb33c06fef0 legacy=0x7fb33c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c0ca780 con 0x7fb33c157a90 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fb334001470 con 0x7fb33c157a90 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 >> v1:172.21.15.60:6789/0 conn(0x7fb33c157a90 legacy=0x7fb33c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb324003c20 0x7fb324004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb324004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb324004d50 0x7fb3240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0b0ad0 con 0x7fb324004d50 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32400bb40 con 0x7fb324003c20 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32400bd00 con 0x7fb33c157e60 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb324004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb341593700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb324003c20 0x7fb324004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb341d94700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb324004d50 0x7fb3240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 -- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb324003c20 msgr2=0x7fb324004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb324003c20 0x7fb324004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 -- 172.21.15.60:0/3408947275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb324004d50 msgr2=0x7fb3240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb324004d50 0x7fb3240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 -- 172.21.15.60:0/3408947275 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324003570 con 0x7fb33c157e60 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb340d92700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb324004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb330009c00 tx=0x7fb3300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c1a2764c1befac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.574+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33000e710 con 0x7fb33c157e60 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33000e870 con 0x7fb33c157e60 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb33bfff700 1 -- 172.21.15.60:0/3408947275 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33000ec30 con 0x7fb33c157e60 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb342595700 1 -- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 msgr2=0x7fb324004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb342595700 1 --2- 172.21.15.60:0/3408947275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c157e60 0x7fb324004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb330009c00 tx=0x7fb3300091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb341d94700 1 -- 172.21.15.60:0/3408947275 reap_dead start 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb342595700 1 -- 172.21.15.60:0/3408947275 shutdown_connections 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb342595700 1 -- 172.21.15.60:0/3408947275 >> 172.21.15.60:0/3408947275 conn(0x7fb33c06bc70 msgr2=0x7fb33c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb342595700 1 -- 172.21.15.60:0/3408947275 shutdown_connections 2023-10-08T16:10:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.575+0000 7fb342595700 1 -- 172.21.15.60:0/3408947275 wait complete. 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.576+0000 7fb342595700 1 Processor -- start 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.576+0000 7fb342595700 1 -- start start 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb342595700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33c157e60 0x7fb33c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb342595700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c14ef80 0x7fb33c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb342595700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 0x7fb33c154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb342595700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0c7310 con 0x7fb33c14f3f0 2023-10-08T16:10:05.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb342595700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c15b3e0 con 0x7fb33c157e60 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb342595700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0c6cc0 con 0x7fb33c14ef80 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.577+0000 7fb341d94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 0x7fb33c154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 0x7fb33c154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48200/0 (socket says 172.21.15.60:48200) 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 -- 172.21.15.60:0/2254501890 learned_addr learned my addr 172.21.15.60:0/2254501890 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb340d92700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c14ef80 0x7fb33c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341593700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33c157e60 0x7fb33c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 -- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c14ef80 msgr2=0x7fb33c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c14ef80 0x7fb33c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 -- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33c157e60 msgr2=0x7fb33c150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33c157e60 0x7fb33c150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 -- 172.21.15.60:0/2254501890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c0c6fa0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb341d94700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 0x7fb33c154cc0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0b0c10 tx=0x7fb32c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c006db0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c00c8f0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00ccb0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c150ca0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.578+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c0c89d0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.579+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c0c74c0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.580+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb32c01a3e0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.580+0000 7fb3397fa700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb328066f30 0x7fb3280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.580+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb32c087a20 con 0x7fb33c14f3f0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.580+0000 7fb341593700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb328066f30 0x7fb3280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.581+0000 7fb341593700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb328066f30 0x7fb3280693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb334000c00 tx=0x7fb33c0cb020 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.585+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb33c0c74c0 con 0x7fb33c14f3f0 2023-10-08T16:10:05.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.824+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb33c0c7450 con 0x7fb33c14f3f0 2023-10-08T16:10:05.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.825+0000 7fb3397fa700 1 -- 172.21.15.60:0/2254501890 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb32c021070 con 0x7fb33c14f3f0 2023-10-08T16:10:05.825 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:10:05.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb328066f30 msgr2=0x7fb3280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb328066f30 0x7fb3280693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb334000c00 tx=0x7fb33c0cb020 comp rx=0 tx=0).stop 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 msgr2=0x7fb33c154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 0x7fb33c154cc0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0b0c10 tx=0x7fb32c0017a0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 shutdown_connections 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb328066f30 0x7fb3280693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb33c14f3f0 0x7fb33c154cc0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33c157e60 0x7fb33c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 --2- 172.21.15.60:0/2254501890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb33c14ef80 0x7fb33c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 >> 172.21.15.60:0/2254501890 conn(0x7fb33c06bc70 msgr2=0x7fb33c14fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 shutdown_connections 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:05.827+0000 7fb342595700 1 -- 172.21.15.60:0/2254501890 wait complete. 2023-10-08T16:10:05.839 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:10:05.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:10:05.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:10:05.840 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:10:05.840 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:05.840 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:10:05.840 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:10:05.840 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:10:05.840 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:10:05.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.840 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.858 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:10:05.859 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42137sec preferred_lft 42137sec 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.860 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:10:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:05.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.862 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:10:05.922 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:10:05.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.924 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:10:05.981 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:10:05.981 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:10:05.981 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:10:05.981 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:10:05.981 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:10:05.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.982 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:10:05.982 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:10:05.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:10:05.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:10:05.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:10:05.982 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:10:06.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:06.081 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:10:06.095 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:10:06.095 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:10:06.096 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:10:06.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:06.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:10:06.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:06.160 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:06.215 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:10:06.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:06.215 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:06.269 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:10:06.270 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:10:06.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:06.351 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:06.352 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:06.393 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:06.393 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:06.393 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:06.393 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:06.393 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:06.394 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:06.394 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:06.394 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:06.394 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:10:06.394 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:10:06.394 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:10:06.396 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:10:06.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:06.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:06.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.593+0000 7f1630e6c700 1 Processor -- start 2023-10-08T16:10:06.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.594+0000 7f1630e6c700 1 -- start start 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.594+0000 7f1630e6c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f162c0d1c30 0x7f162c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.594+0000 7f1630e6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a680 0x7f162c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f1630e6c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0c5d80 con 0x7f162c15a2b0 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f1630e6c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c068470 con 0x7f162c0d1c30 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f1630e6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0c6060 con 0x7f162c15a680 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f162c15a2b0 0x7f162c0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58096/0 (socket says 172.21.15.60:58096) 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162a59c700 1 -- 172.21.15.60:0/3033914197 learned_addr learned my addr 172.21.15.60:0/3033914197 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162ad9d700 1 --2- 172.21.15.60:0/3033914197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a680 0x7f162c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f1629d9b700 1 --2- 172.21.15.60:0/3033914197 >> v2:172.21.15.144:3300/0 conn(0x7f162c0d1c30 0x7f162c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162959a700 1 -- 172.21.15.60:0/3033914197 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087991671 0 0) 0x7f162c0c5d80 con 0x7f162c15a2b0 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162959a700 1 -- 172.21.15.60:0/3033914197 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1618003570 con 0x7f162c15a2b0 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162ad9d700 1 -- 172.21.15.60:0/3033914197 >> v2:172.21.15.144:3300/0 conn(0x7f162c0d1c30 msgr2=0x7f162c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162ad9d700 1 --2- 172.21.15.60:0/3033914197 >> v2:172.21.15.144:3300/0 conn(0x7f162c0d1c30 0x7f162c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162ad9d700 1 -- 172.21.15.60:0/3033914197 >> v1:172.21.15.60:6789/0 conn(0x7f162c15a2b0 legacy=0x7f162c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162ad9d700 1 -- 172.21.15.60:0/3033914197 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0c6340 con 0x7f162c15a680 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f1629d9b700 1 --2- 172.21.15.60:0/3033914197 >> v2:172.21.15.144:3300/0 conn(0x7f162c0d1c30 0x7f162c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.595+0000 7f162ad9d700 1 --2- 172.21.15.60:0/3033914197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a680 0x7f162c0cf710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f161c009e60 tx=0x7f161c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c12e6b8b9876cf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f162959a700 1 -- 172.21.15.60:0/3033914197 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00e070 con 0x7f162c15a680 2023-10-08T16:10:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f162959a700 1 -- 172.21.15.60:0/3033914197 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00bab0 con 0x7f162c15a680 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f162959a700 1 -- 172.21.15.60:0/3033914197 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00be70 con 0x7f162c15a680 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 -- 172.21.15.60:0/3033914197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a680 msgr2=0x7f162c0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 --2- 172.21.15.60:0/3033914197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a680 0x7f162c0cf710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f161c009e60 tx=0x7f161c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 -- 172.21.15.60:0/3033914197 shutdown_connections 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 --2- 172.21.15.60:0/3033914197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a680 0x7f162c0cf710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 --2- 172.21.15.60:0/3033914197 >> v2:172.21.15.144:3300/0 conn(0x7f162c0d1c30 0x7f162c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 -- 172.21.15.60:0/3033914197 >> 172.21.15.60:0/3033914197 conn(0x7f162c067e40 msgr2=0x7f162c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 -- 172.21.15.60:0/3033914197 shutdown_connections 2023-10-08T16:10:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.596+0000 7f1630e6c700 1 -- 172.21.15.60:0/3033914197 wait complete. 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.597+0000 7f1630e6c700 1 Processor -- start 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.597+0000 7f1630e6c700 1 -- start start 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1630e6c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f162c0d1c30 0x7f162c09e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1630e6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a2b0 0x7f162c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1630e6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 0x7f162c0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1630e6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c16ad60 con 0x7f162c15a680 2023-10-08T16:10:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1630e6c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0c9810 con 0x7f162c0d1c30 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1630e6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c16a050 con 0x7f162c15a2b0 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f162ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 0x7f162c0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f162ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 0x7f162c0c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48212/0 (socket says 172.21.15.60:48212) 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f162ad9d700 1 -- 172.21.15.60:0/2152188106 learned_addr learned my addr 172.21.15.60:0/2152188106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f162a59c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f162c0d1c30 0x7f162c09e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.598+0000 7f1629d9b700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a2b0 0x7f162c0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f162ad9d700 1 -- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a2b0 msgr2=0x7f162c0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f162ad9d700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a2b0 0x7f162c0c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f162ad9d700 1 -- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f162c0d1c30 msgr2=0x7f162c09e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f162ad9d700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f162c0d1c30 0x7f162c09e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f162ad9d700 1 -- 172.21.15.60:0/2152188106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009420 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f162ad9d700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 0x7f162c0c85d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f161c00b610 tx=0x7f161c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012dd0 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c027470 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c009a20 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c027830 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.599+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c0c8ee0 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.600+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c04c3c0 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.600+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f161c024070 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.601+0000 7f16227fc700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.601+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f161c086f10 con 0x7f162c15a680 2023-10-08T16:10:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.601+0000 7f162a59c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.601+0000 7f162a59c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1624001360 tx=0x7f1624009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.605+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f161c054230 con 0x7f162c15a680 2023-10-08T16:10:06.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.844+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f162c064a00 con 0x7f162c15a680 2023-10-08T16:10:06.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.844+0000 7f16227fc700 1 -- 172.21.15.60:0/2152188106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f161c057850 con 0x7f162c15a680 2023-10-08T16:10:06.844 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:06.845 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f160c066f30 msgr2=0x7f160c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1624001360 tx=0x7f1624009040 comp rx=0 tx=0).stop 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 msgr2=0x7f162c0c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 0x7f162c0c85d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f161c00b610 tx=0x7f161c019000 comp rx=0 tx=0).stop 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 shutdown_connections 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f162c15a680 0x7f162c0c85d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f162c0d1c30 0x7f162c09e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 --2- 172.21.15.60:0/2152188106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f162c15a2b0 0x7f162c0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 >> 172.21.15.60:0/2152188106 conn(0x7f162c067e40 msgr2=0x7f162c0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 shutdown_connections 2023-10-08T16:10:06.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:06.846+0000 7f1630e6c700 1 -- 172.21.15.60:0/2152188106 wait complete. 2023-10-08T16:10:06.848 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:06.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-08T16:10:06.998 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":6381,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5373996959999996,"mdsmap_epoch":52,"osdmap_epoch":96,"osdmap_epoch_barrier":96,"uptime":13.362148615000001} 2023-10-08T16:10:06.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 6381, "mdsmap_epoch": 52, "osdmap_epoch": 96, "osdmap_epoch_barrier": 96, "rank_uptime": 8.537399696, "state": "up:active", "uptime": 13.362148615, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:10:06.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:10:07.132 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:10:07.132 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:10:07.132 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-08T16:10:07.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:07.133 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-08T16:10:08.517 INFO:teuthology.orchestra.run.smithi060.stderr:265+0 records in 2023-10-08T16:10:08.517 INFO:teuthology.orchestra.run.smithi060.stderr:265+0 records out 2023-10-08T16:10:08.517 INFO:teuthology.orchestra.run.smithi060.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.3661 s, 203 MB/s 2023-10-08T16:10:08.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:08.518 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-08T16:10:10.061 INFO:teuthology.orchestra.run.smithi060.stderr:292+0 records in 2023-10-08T16:10:10.061 INFO:teuthology.orchestra.run.smithi060.stderr:292+0 records out 2023-10-08T16:10:10.061 INFO:teuthology.orchestra.run.smithi060.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.52652 s, 201 MB/s 2023-10-08T16:10:10.061 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-08T16:10:10.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:10.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.179+0000 7fb06759e700 1 Processor -- start 2023-10-08T16:10:10.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.180+0000 7fb06759e700 1 -- start start 2023-10-08T16:10:10.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.180+0000 7fb06759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0680cc630 0x7fb0680cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.180+0000 7fb06759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb0680ab0e0 0x7fb0680ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.180+0000 7fb06759e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680c76b0 con 0x7fb06806aa70 2023-10-08T16:10:10.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.180+0000 7fb06759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680ccc10 con 0x7fb0680cc630 2023-10-08T16:10:10.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.180+0000 7fb06759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680c7900 con 0x7fb0680ab0e0 2023-10-08T16:10:10.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0680cc630 0x7fb0680cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0680cc630 0x7fb0680cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48218/0 (socket says 172.21.15.60:48218) 2023-10-08T16:10:10.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 -- 172.21.15.60:0/1277651691 learned_addr learned my addr 172.21.15.60:0/1277651691 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:10.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb066d9d700 1 --2- 172.21.15.60:0/1277651691 >> v2:172.21.15.144:3300/0 conn(0x7fb0680ab0e0 0x7fb0680ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 -- 172.21.15.60:0/1277651691 >> v2:172.21.15.144:3300/0 conn(0x7fb0680ab0e0 msgr2=0x7fb0680ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:10.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 --2- 172.21.15.60:0/1277651691 >> v2:172.21.15.144:3300/0 conn(0x7fb0680ab0e0 0x7fb0680ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 -- 172.21.15.60:0/1277651691 >> v1:172.21.15.144:6789/0 conn(0x7fb06806aa70 legacy=0x7fb06806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 -- 172.21.15.60:0/1277651691 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680c7be0 con 0x7fb0680cc630 2023-10-08T16:10:10.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb066d9d700 1 --2- 172.21.15.60:0/1277651691 >> v2:172.21.15.144:3300/0 conn(0x7fb0680ab0e0 0x7fb0680ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:10.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb065d9b700 1 --2- 172.21.15.60:0/1277651691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb0680cb670 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb06806d2e0 tx=0x7fb050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6ced6f1effd24a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:10.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb06559a700 1 -- 172.21.15.60:0/1277651691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000b860 con 0x7fb0680cc630 2023-10-08T16:10:10.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb06559a700 1 -- 172.21.15.60:0/1277651691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05000b9c0 con 0x7fb0680cc630 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.181+0000 7fb06559a700 1 -- 172.21.15.60:0/1277651691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000bd60 con 0x7fb0680cc630 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 -- 172.21.15.60:0/1277651691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 msgr2=0x7fb0680cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 --2- 172.21.15.60:0/1277651691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb0680cb670 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb06806d2e0 tx=0x7fb050009250 comp rx=0 tx=0).stop 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 -- 172.21.15.60:0/1277651691 shutdown_connections 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 --2- 172.21.15.60:0/1277651691 >> v2:172.21.15.144:3300/0 conn(0x7fb0680ab0e0 0x7fb0680ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 --2- 172.21.15.60:0/1277651691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb0680cb670 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 -- 172.21.15.60:0/1277651691 >> 172.21.15.60:0/1277651691 conn(0x7fb0680cd070 msgr2=0x7fb0680cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:10.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 -- 172.21.15.60:0/1277651691 shutdown_connections 2023-10-08T16:10:10.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.182+0000 7fb06759e700 1 -- 172.21.15.60:0/1277651691 wait complete. 2023-10-08T16:10:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.183+0000 7fb06759e700 1 Processor -- start 2023-10-08T16:10:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.183+0000 7fb06759e700 1 -- start start 2023-10-08T16:10:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb06806aa70 0x7fb068151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0680ab0e0 0x7fb0680986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb06806e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c7320 con 0x7fb0680cc630 2023-10-08T16:10:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c6710 con 0x7fb06806aa70 2023-10-08T16:10:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c69f0 con 0x7fb0680ab0e0 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb06806e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb06806e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48220/0 (socket says 172.21.15.60:48220) 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 -- 172.21.15.60:0/2404909807 learned_addr learned my addr 172.21.15.60:0/2404909807 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb065d9b700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0680ab0e0 0x7fb0680986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb06659c700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb06806aa70 0x7fb068151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 -- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0680ab0e0 msgr2=0x7fb0680986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0680ab0e0 0x7fb0680986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 -- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb06806aa70 msgr2=0x7fb068151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb06806aa70 0x7fb068151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.184+0000 7fb066d9d700 1 -- 172.21.15.60:0/2404909807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500094f0 con 0x7fb0680cc630 2023-10-08T16:10:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.185+0000 7fb066d9d700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb06806e570 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb05800d180 tx=0x7fb058009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.185+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800dcc0 con 0x7fb0680cc630 2023-10-08T16:10:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.185+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800f040 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.185+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0680c6cd0 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.185+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058015690 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.185+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680c6420 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.186+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0680c7490 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.186+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb05801e3b0 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.187+0000 7fb05e7fc700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.187+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0580849d0 con 0x7fb0680cc630 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.187+0000 7fb06659c700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.187+0000 7fb06659c700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb048066f30 0x7fb0480693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb0680985d0 tx=0x7fb060009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.191+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb058051c40 con 0x7fb0680cc630 2023-10-08T16:10:10.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.389+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb0680c7ec0 con 0x7fb0680cc630 2023-10-08T16:10:10.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.390+0000 7fb05e7fc700 1 -- 172.21.15.60:0/2404909807 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v96) v1 ==== 81+0+32263 (secure 0 0 0) 0x7fb05801a090 con 0x7fb0680cc630 2023-10-08T16:10:10.390 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 96, 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:09:59.335115+0000", 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:10.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:10.392 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:10.393 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:10.393 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:10.393 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:10.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.393 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:10.393 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:10.394 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:10.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:10:10.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:10:10.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:10.394 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:10.394 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:10.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:10.396 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "86", 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:10.398 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:10.399 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:10.400 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:10.401 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:10.402 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:10.403 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:10.404 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "95", 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:10.405 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:10.406 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:10.407 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:10.408 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:10.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:10.411 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:10.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:10.412 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:10.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "96", 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:10.414 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:10.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:10.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:10.417 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:10.417 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:10.417 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:10.417 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:10.417 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:10.418 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:10.418 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:10.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.418 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:10.418 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.419 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.421 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.422 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:10.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.453 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:10.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.457 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:10.458 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.459 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:10.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.462 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:10.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:10.466 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:10.467 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:10.471 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.472 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.473 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.476 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.477 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:10.478 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:10.481 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:10.481 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:10.481 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:10.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:10.482 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:10.483 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:10.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:10.484 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:10.484 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:10.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:10.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:10.484 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb048066f30 msgr2=0x7fb0480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb048066f30 0x7fb0480693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb0680985d0 tx=0x7fb060009040 comp rx=0 tx=0).stop 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 msgr2=0x7fb06806e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb06806e570 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb05800d180 tx=0x7fb058009a50 comp rx=0 tx=0).stop 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 shutdown_connections 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680cc630 0x7fb06806e570 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb06806aa70 0x7fb068151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 --2- 172.21.15.60:0/2404909807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0680ab0e0 0x7fb0680986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 >> 172.21.15.60:0/2404909807 conn(0x7fb0680cd070 msgr2=0x7fb0680cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 shutdown_connections 2023-10-08T16:10:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:10.392+0000 7fb06759e700 1 -- 172.21.15.60:0/2404909807 wait complete. 2023-10-08T16:10:10.487 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:10:13.502 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:10:13.501+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-08T16:10:15.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:15.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.623+0000 7f834492b700 1 Processor -- start 2023-10-08T16:10:15.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.623+0000 7f834492b700 1 -- start start 2023-10-08T16:10:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.624+0000 7f834492b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 0x7f8340164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.624+0000 7f834492b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834015c360 con 0x7f8340157ba0 2023-10-08T16:10:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.624+0000 7f834492b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834015b790 con 0x7f83401577d0 2023-10-08T16:10:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.624+0000 7f834492b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834015d800 con 0x7f834006ac30 2023-10-08T16:10:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.624+0000 7f833dd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8340157ba0 0x7f834006a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59872/0 (socket says 172.21.15.60:59872) 2023-10-08T16:10:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.624+0000 7f833dd9b700 1 -- 172.21.15.60:0/3163876526 learned_addr learned my addr 172.21.15.60:0/3163876526 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833ed9d700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 0x7f8340164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615685041 0 0) 0x7f834015c360 con 0x7f8340157ba0 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f832c003570 con 0x7f8340157ba0 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1520254710 0 0) 0x7f832c003570 con 0x7f8340157ba0 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 msgr2=0x7f8340164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 0x7f8340164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 >> v1:172.21.15.144:6789/0 conn(0x7f83401577d0 legacy=0x7f83400cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834015ba30 con 0x7f8340157ba0 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f8328001470 con 0x7f8340157ba0 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 >> v1:172.21.15.60:6789/0 conn(0x7f8340157ba0 legacy=0x7f834006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f832c003a90 0x7f832c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f832c004810 0x7f832c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 0x7f832c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834015d800 con 0x7f832c003a90 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c00bb10 con 0x7f832c004810 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c00bcd0 con 0x7f834006ac30 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833e59c700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f832c003a90 0x7f832c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833dd9b700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f832c004810 0x7f832c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.625+0000 7f833ed9d700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 0x7f832c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833e59c700 1 -- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 msgr2=0x7f832c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833e59c700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f834006ac30 0x7f832c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833e59c700 1 -- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f832c004810 msgr2=0x7f832c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833e59c700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f832c004810 0x7f832c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833e59c700 1 -- 172.21.15.60:0/3163876526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c003570 con 0x7f832c003a90 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833e59c700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f832c003a90 0x7f832c003e60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f83300019a0 tx=0x7f8330007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c9af60190fe43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833000c5d0 con 0x7f832c003a90 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833000c730 con 0x7f832c003a90 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833d59a700 1 -- 172.21.15.60:0/3163876526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833000cad0 con 0x7f832c003a90 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f834492b700 1 -- 172.21.15.60:0/3163876526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f832c003a90 msgr2=0x7f832c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f834492b700 1 --2- 172.21.15.60:0/3163876526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f832c003a90 0x7f832c003e60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f83300019a0 tx=0x7f8330007d10 comp rx=0 tx=0).stop 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f833ed9d700 1 -- 172.21.15.60:0/3163876526 reap_dead start 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f834492b700 1 -- 172.21.15.60:0/3163876526 shutdown_connections 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.626+0000 7f834492b700 1 -- 172.21.15.60:0/3163876526 >> 172.21.15.60:0/3163876526 conn(0x7f8340068ce0 msgr2=0x7f83400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.627+0000 7f834492b700 1 -- 172.21.15.60:0/3163876526 shutdown_connections 2023-10-08T16:10:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.627+0000 7f834492b700 1 -- 172.21.15.60:0/3163876526 wait complete. 2023-10-08T16:10:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 Processor -- start 2023-10-08T16:10:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 -- start start 2023-10-08T16:10:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f832c003a90 0x7f8340159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83400b06a0 0x7f834016acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 0x7f83400b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400cfe20 con 0x7f83400d1130 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400d0ca0 con 0x7f83400b06a0 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.628+0000 7f834492b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834016b230 con 0x7f832c003a90 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 0x7f83400b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 0x7f83400b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44034/0 (socket says 172.21.15.60:44034) 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833dd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83400b06a0 0x7f834016acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f832c003a90 0x7f8340159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 -- 172.21.15.60:0/855129835 learned_addr learned my addr 172.21.15.60:0/855129835 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 -- 172.21.15.60:0/855129835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f832c003a90 msgr2=0x7f8340159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f832c003a90 0x7f8340159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 -- 172.21.15.60:0/855129835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83400b06a0 msgr2=0x7f834016acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83400b06a0 0x7f834016acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 -- 172.21.15.60:0/855129835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400d0070 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f833ed9d700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 0x7f83400b1330 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f83380094d0 tx=0x7f833800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800e040 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800f040 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400d0350 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800fd70 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.629+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83400d15b0 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.630+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83400d0540 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.631+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8338015640 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.631+0000 7f83367fc700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.631+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8338084c80 con 0x7f83400d1130 2023-10-08T16:10:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.631+0000 7f833e59c700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:15.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.631+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7f832006ea50 con 0x7f83400d1130 2023-10-08T16:10:15.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.632+0000 7f833e59c700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8320066f30 0x7f83200693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8330000fd0 tx=0x7f8330015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:15.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.636+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8338051ef0 con 0x7f83400d1130 2023-10-08T16:10:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.830+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f834004c3c0 con 0x7f83400d1130 2023-10-08T16:10:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.831+0000 7f83367fc700 1 -- 172.21.15.60:0/855129835 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) v1 ==== 81+0+32406 (secure 0 0 0) 0x7f8338055510 con 0x7f83400d1130 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 99, 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:10:14.512622+0000", 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:10:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:15.918 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8320066f30 msgr2=0x7f83200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8320066f30 0x7f83200693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8330000fd0 tx=0x7f8330015000 comp rx=0 tx=0).stop 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 msgr2=0x7f83400b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 0x7f83400b1330 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f83380094d0 tx=0x7f833800b040 comp rx=0 tx=0).stop 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 shutdown_connections 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f832c003a90 0x7f8340159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83400d1130 0x7f83400b1330 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 --2- 172.21.15.60:0/855129835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83400b06a0 0x7f834016acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 >> 172.21.15.60:0/855129835 conn(0x7f8340068ce0 msgr2=0x7f83400b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 shutdown_connections 2023-10-08T16:10:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:15.833+0000 7f834492b700 1 -- 172.21.15.60:0/855129835 wait complete. 2023-10-08T16:10:15.920 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-08T16:10:15.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:15.921 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-08T16:10:16.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:10:16.171 INFO:teuthology.orchestra.run.smithi060.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-08T16:10:16.171 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:10:16.172 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:10:16.172 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.228892 s, 229 MB/s 2023-10-08T16:10:16.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:16.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.291+0000 7f03609b7700 1 Processor -- start 2023-10-08T16:10:16.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.291+0000 7f03609b7700 1 -- start start 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f03609b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f03609b7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c15db80 con 0x7f035c159e10 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f03609b7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c15de60 con 0x7f035c0b3430 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f03609b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c15e800 con 0x7f035c15a1e0 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f035a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f035c159e10 0x7f035c0b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59882/0 (socket says 172.21.15.60:59882) 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f035a59c700 1 -- 172.21.15.60:0/1125728783 learned_addr learned my addr 172.21.15.60:0/1125728783 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0351d9b700 1 --2- 172.21.15.60:0/1125728783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690407860 0 0) 0x7f035c15db80 con 0x7f035c159e10 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0348003570 con 0x7f035c159e10 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234503280 0 0) 0x7f035c15de60 con 0x7f035c0b3430 2023-10-08T16:10:16.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c15db80 con 0x7f035c0b3430 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0351d9b700 1 -- 172.21.15.60:0/1125728783 >> v1:172.21.15.144:6789/0 conn(0x7f035c0b3430 legacy=0x7f035c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0351d9b700 1 -- 172.21.15.60:0/1125728783 >> v1:172.21.15.60:6789/0 conn(0x7f035c159e10 legacy=0x7f035c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0351d9b700 1 -- 172.21.15.60:0/1125728783 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c15e140 con 0x7f035c15a1e0 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.292+0000 7f0351d9b700 1 --2- 172.21.15.60:0/1125728783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0344009910 tx=0x7f03440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bbdf44138e67d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344011630 con 0x7f035c15a1e0 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0344011790 con 0x7f035c15a1e0 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f0359d9b700 1 -- 172.21.15.60:0/1125728783 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344011b30 con 0x7f035c15a1e0 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 -- 172.21.15.60:0/1125728783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 msgr2=0x7f035c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 --2- 172.21.15.60:0/1125728783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0344009910 tx=0x7f03440091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 -- 172.21.15.60:0/1125728783 shutdown_connections 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 --2- 172.21.15.60:0/1125728783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 -- 172.21.15.60:0/1125728783 >> 172.21.15.60:0/1125728783 conn(0x7f035c067660 msgr2=0x7f035c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:16.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 -- 172.21.15.60:0/1125728783 shutdown_connections 2023-10-08T16:10:16.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.293+0000 7f03609b7700 1 -- 172.21.15.60:0/1125728783 wait complete. 2023-10-08T16:10:16.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.294+0000 7f03609b7700 1 Processor -- start 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.294+0000 7f03609b7700 1 -- start start 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f03609b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 0x7f035c16acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f03609b7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c159e10 0x7f035c16b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f03609b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f03609b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0c6f20 con 0x7f035c0b3430 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f03609b7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0d05f0 con 0x7f035c159e10 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f03609b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c16b1f0 con 0x7f035c15a1e0 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f035a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 0x7f035c16acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f035a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 0x7f035c16acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44044/0 (socket says 172.21.15.60:44044) 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f035a59c700 1 -- 172.21.15.60:0/2682863598 learned_addr learned my addr 172.21.15.60:0/2682863598 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.295+0000 7f035ad9d700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f0351d9b700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c159e10 0x7f035c16b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035a59c700 1 -- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 msgr2=0x7f035c0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035a59c700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035a59c700 1 -- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c159e10 msgr2=0x7f035c16b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035a59c700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c159e10 0x7f035c16b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035a59c700 1 -- 172.21.15.60:0/2682863598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009420 con 0x7f035c0b3430 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035ad9d700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f0351d9b700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c159e10 0x7f035c16b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f035a59c700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 0x7f035c16acb0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f034c00c790 tx=0x7f034c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:16.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c005b30 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c005c90 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c007300 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c0c7170 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.296+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c0d0280 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.297+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c04c3c0 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.297+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f034c01b400 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.298+0000 7f0352ffd700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f033c066f30 0x7f033c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.298+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f034c084100 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.298+0000 7f0351d9b700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f033c066f30 0x7f033c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.298+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7f033c06ea50 con 0x7f035c0b3430 2023-10-08T16:10:16.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.298+0000 7f0351d9b700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f033c066f30 0x7f033c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0344009860 tx=0x7f0344017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:16.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.302+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f034c051420 con 0x7f035c0b3430 2023-10-08T16:10:16.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.495+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f035c15e420 con 0x7f035c0b3430 2023-10-08T16:10:16.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.496+0000 7f0352ffd700 1 -- 172.21.15.60:0/2682863598 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) v1 ==== 81+0+32406 (secure 0 0 0) 0x7f034c0076f0 con 0x7f035c0b3430 2023-10-08T16:10:16.497 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:16.497 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:16.497 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 99, 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:10:14.512622+0000", 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:16.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:16.499 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:16.500 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:16.502 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:16.503 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.504 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:16.505 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:16.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:16.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:16.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:16.510 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:16.511 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:16.512 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:16.513 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:16.514 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:16.515 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:16.516 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:16.518 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:16.519 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:16.520 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:16.521 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:16.522 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.523 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.524 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.526 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:16.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:16.528 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.531 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.533 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:16.536 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.539 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:16.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:16.545 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:16.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:16.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.549 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.550 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.551 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:16.552 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.553 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.557 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.558 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.560 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.561 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:16.569 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.571 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:16.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:16.586 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:16.587 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:16.603 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f033c066f30 msgr2=0x7f033c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f033c066f30 0x7f033c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0344009860 tx=0x7f0344017000 comp rx=0 tx=0).stop 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 msgr2=0x7f035c16acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 0x7f035c16acb0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f034c00c790 tx=0x7f034c007ea0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 shutdown_connections 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f033c066f30 0x7f033c0693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f035c15a1e0 0x7f035c0cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035c0b3430 0x7f035c16acb0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 --2- 172.21.15.60:0/2682863598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f035c159e10 0x7f035c16b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 >> 172.21.15.60:0/2682863598 conn(0x7f035c067660 msgr2=0x7f035c156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 shutdown_connections 2023-10-08T16:10:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.499+0000 7f03609b7700 1 -- 172.21.15.60:0/2682863598 wait complete. 2023-10-08T16:10:16.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.725+0000 7fbf008a4700 1 Processor -- start 2023-10-08T16:10:16.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.725+0000 7fbf008a4700 1 -- start start 2023-10-08T16:10:16.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbf008a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc0c87a0 0x7fbefc161a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbf008a4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc067ba0 con 0x7fbefc1568d0 2023-10-08T16:10:16.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbf008a4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc067870 con 0x7fbefc06a530 2023-10-08T16:10:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbf008a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc15aa90 con 0x7fbefc0c87a0 2023-10-08T16:10:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbefa59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbefc1568d0 0x7fbefc069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59896/0 (socket says 172.21.15.60:59896) 2023-10-08T16:10:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbefa59c700 1 -- 172.21.15.60:0/1421615972 learned_addr learned my addr 172.21.15.60:0/1421615972 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.726+0000 7fbefad9d700 1 --2- 172.21.15.60:0/1421615972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc0c87a0 0x7fbefc161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731284084 0 0) 0x7fbefc067ba0 con 0x7fbefc1568d0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee8003570 con 0x7fbefc1568d0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373183407 0 0) 0x7fbefc067870 con 0x7fbefc06a530 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc067ba0 con 0x7fbefc06a530 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbefad9d700 1 -- 172.21.15.60:0/1421615972 >> v1:172.21.15.144:6789/0 conn(0x7fbefc06a530 legacy=0x7fbefc0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbefad9d700 1 -- 172.21.15.60:0/1421615972 >> v1:172.21.15.60:6789/0 conn(0x7fbefc1568d0 legacy=0x7fbefc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbefad9d700 1 -- 172.21.15.60:0/1421615972 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0c8ca0 con 0x7fbefc0c87a0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbefad9d700 1 --2- 172.21.15.60:0/1421615972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc0c87a0 0x7fbefc161a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009910 tx=0x7fbeec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27f739780fdfb0fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec011630 con 0x7fbefc0c87a0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec011790 con 0x7fbefc0c87a0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.727+0000 7fbef959a700 1 -- 172.21.15.60:0/1421615972 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec011b30 con 0x7fbefc0c87a0 2023-10-08T16:10:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 -- 172.21.15.60:0/1421615972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc0c87a0 msgr2=0x7fbefc161a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 --2- 172.21.15.60:0/1421615972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc0c87a0 0x7fbefc161a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009910 tx=0x7fbeec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 -- 172.21.15.60:0/1421615972 shutdown_connections 2023-10-08T16:10:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 --2- 172.21.15.60:0/1421615972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc0c87a0 0x7fbefc161a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 -- 172.21.15.60:0/1421615972 >> 172.21.15.60:0/1421615972 conn(0x7fbefc0cda50 msgr2=0x7fbefc0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 -- 172.21.15.60:0/1421615972 shutdown_connections 2023-10-08T16:10:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.728+0000 7fbf008a4700 1 -- 172.21.15.60:0/1421615972 wait complete. 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.729+0000 7fbf008a4700 1 Processor -- start 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.729+0000 7fbf008a4700 1 -- start start 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc06a530 0x7fbefc155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 0x7fbefc0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbefc1568d0 0x7fbefc0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0c5050 con 0x7fbefc0c87a0 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0c1930 con 0x7fbefc1568d0 2023-10-08T16:10:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0c1c10 con 0x7fbefc06a530 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 0x7fbefc0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 0x7fbefc0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44056/0 (socket says 172.21.15.60:44056) 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 -- 172.21.15.60:0/2442723191 learned_addr learned my addr 172.21.15.60:0/2442723191 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbefa59c700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc06a530 0x7fbefc155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbefad9d700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbefc1568d0 0x7fbefc0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 -- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc06a530 msgr2=0x7fbefc155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc06a530 0x7fbefc155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 -- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbefc1568d0 msgr2=0x7fbefc0aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbefc1568d0 0x7fbefc0aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 -- 172.21.15.60:0/2442723191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec009420 con 0x7fbefc0c87a0 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef9d9b700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 0x7fbefc0b2d80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbee400c580 tx=0x7fbee4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4010510 con 0x7fbefc0c87a0 2023-10-08T16:10:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4010670 con 0x7fbefc0c87a0 2023-10-08T16:10:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc0c1ef0 con 0x7fbefc0c87a0 2023-10-08T16:10:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.730+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4010a30 con 0x7fbefc0c87a0 2023-10-08T16:10:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.731+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc0c1550 con 0x7fbefc0c87a0 2023-10-08T16:10:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.732+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc0c5250 con 0x7fbefc0c87a0 2023-10-08T16:10:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.732+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbee401b400 con 0x7fbefc0c87a0 2023-10-08T16:10:16.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.732+0000 7fbef27fc700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbedc066f30 0x7fbedc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:16.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.732+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbee4084060 con 0x7fbefc0c87a0 2023-10-08T16:10:16.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.732+0000 7fbefa59c700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbedc066f30 0x7fbedc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:16.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.733+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7fbedc06ea50 con 0x7fbefc0c87a0 2023-10-08T16:10:16.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.733+0000 7fbefa59c700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbedc066f30 0x7fbedc0693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbef4005c50 tx=0x7fbef4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.737+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbefc0c5250 con 0x7fbefc0c87a0 2023-10-08T16:10:16.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.972+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbefc0c5250 con 0x7fbefc0c87a0 2023-10-08T16:10:16.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.973+0000 7fbef27fc700 1 -- 172.21.15.60:0/2442723191 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbefc0c5250 con 0x7fbefc0c87a0 2023-10-08T16:10:16.973 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:16.973 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbedc066f30 msgr2=0x7fbedc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbedc066f30 0x7fbedc0693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbef4005c50 tx=0x7fbef4009040 comp rx=0 tx=0).stop 2023-10-08T16:10:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 msgr2=0x7fbefc0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 0x7fbefc0b2d80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbee400c580 tx=0x7fbee4007e10 comp rx=0 tx=0).stop 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 shutdown_connections 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbedc066f30 0x7fbedc0693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbefc06a530 0x7fbefc155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbefc1568d0 0x7fbefc0aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 --2- 172.21.15.60:0/2442723191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc0c87a0 0x7fbefc0b2d80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 >> 172.21.15.60:0/2442723191 conn(0x7fbefc0cda50 msgr2=0x7fbefc0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 shutdown_connections 2023-10-08T16:10:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:16.975+0000 7fbf008a4700 1 -- 172.21.15.60:0/2442723191 wait complete. 2023-10-08T16:10:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:16.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-08T16:10:17.124 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":6381,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.664719488999999,"mdsmap_epoch":52,"osdmap_epoch":100,"osdmap_epoch_barrier":99,"uptime":23.489469375999999} 2023-10-08T16:10:17.124 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 6381, "mdsmap_epoch": 52, "osdmap_epoch": 100, "osdmap_epoch_barrier": 99, "rank_uptime": 18.664719489, "state": "up:active", "uptime": 23.489469376, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:10:17.125 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:10:17.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:17.125 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T16:10:17.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:10:17.141 INFO:teuthology.orchestra.run.smithi060.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-08T16:10:17.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:17.141 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-08T16:10:17.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:17.199 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-08T16:10:17.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:17.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.436+0000 7f56b4752700 1 Processor -- start 2023-10-08T16:10:17.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.436+0000 7f56b4752700 1 -- start start 2023-10-08T16:10:17.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b4752700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56ac157870 0x7f56ac15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:17.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b4752700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac15cbb0 con 0x7f56ac15a620 2023-10-08T16:10:17.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b4752700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac15bfa0 con 0x7f56ac157c40 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b4752700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac15c280 con 0x7f56ac157870 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b24ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56ac157870 0x7f56ac15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b1ced700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f56ac15a620 0x7f56ac15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59906/0 (socket says 172.21.15.60:59906) 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.437+0000 7f56b1ced700 1 -- 172.21.15.60:0/1659405056 learned_addr learned my addr 172.21.15.60:0/1659405056 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b24ee700 1 -- 172.21.15.60:0/1659405056 >> v1:172.21.15.144:6789/0 conn(0x7f56ac157c40 legacy=0x7f56ac158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b24ee700 1 -- 172.21.15.60:0/1659405056 >> v1:172.21.15.60:6789/0 conn(0x7f56ac15a620 legacy=0x7f56ac15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b14ec700 1 -- 172.21.15.60:0/1659405056 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251802652 0 0) 0x7f56ac15cbb0 con 0x7f56ac15a620 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b24ee700 1 -- 172.21.15.60:0/1659405056 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac15c560 con 0x7f56ac157870 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b24ee700 1 --2- 172.21.15.60:0/1659405056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac157870 0x7f56ac15b6a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f56a40098e0 tx=0x7f56a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221f7899f7d050d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:17.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b14ec700 1 -- 172.21.15.60:0/1659405056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4009e80 con 0x7f56ac157870 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b14ec700 1 -- 172.21.15.60:0/1659405056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a400b820 con 0x7f56ac157870 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b14ec700 1 -- 172.21.15.60:0/1659405056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400bba0 con 0x7f56ac157870 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b4752700 1 -- 172.21.15.60:0/1659405056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac157870 msgr2=0x7f56ac15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b4752700 1 --2- 172.21.15.60:0/1659405056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac157870 0x7f56ac15b6a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f56a40098e0 tx=0x7f56a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b4752700 1 -- 172.21.15.60:0/1659405056 shutdown_connections 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.438+0000 7f56b4752700 1 --2- 172.21.15.60:0/1659405056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac157870 0x7f56ac15b6a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.439+0000 7f56b4752700 1 -- 172.21.15.60:0/1659405056 >> 172.21.15.60:0/1659405056 conn(0x7f56ac068ce0 msgr2=0x7f56ac0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.439+0000 7f56b4752700 1 -- 172.21.15.60:0/1659405056 shutdown_connections 2023-10-08T16:10:17.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.439+0000 7f56b4752700 1 -- 172.21.15.60:0/1659405056 wait complete. 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 Processor -- start 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 -- start start 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac157870 0x7f56ac150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ac157c40 0x7f56ac1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 0x7f56ac152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac14da40 con 0x7f56ac15a620 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac14e2e0 con 0x7f56ac157870 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.440+0000 7f56b4752700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac153b10 con 0x7f56ac157c40 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 0x7f56ac152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:17.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 0x7f56ac152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44072/0 (socket says 172.21.15.60:44072) 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 -- 172.21.15.60:0/982076974 learned_addr learned my addr 172.21.15.60:0/982076974 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b1ced700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ac157c40 0x7f56ac1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b24ee700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac157870 0x7f56ac150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 -- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ac157c40 msgr2=0x7f56ac1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ac157c40 0x7f56ac1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 -- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac157870 msgr2=0x7f56ac150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac157870 0x7f56ac150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 -- 172.21.15.60:0/982076974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4009420 con 0x7f56ac15a620 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b24ee700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac157870 0x7f56ac150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b2cef700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 0x7f56ac152de0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c890 tx=0x7f569c0026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c012630 con 0x7f56ac15a620 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac14dc90 con 0x7f56ac15a620 2023-10-08T16:10:17.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c012790 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c012b50 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.441+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac153320 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.442+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac14e490 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.443+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f569c01b400 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.443+0000 7f56aa7fc700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5698066f30 0x7f56980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.443+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f569c0848b0 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.443+0000 7f56b24ee700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5698066f30 0x7f56980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.443+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7f569806ea50 con 0x7f56ac15a620 2023-10-08T16:10:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.443+0000 7f56b24ee700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5698066f30 0x7f56980693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f56a40030c0 tx=0x7f56a4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:17.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.447+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f569c016020 con 0x7f56ac15a620 2023-10-08T16:10:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.643+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f56ac04c3c0 con 0x7f56ac15a620 2023-10-08T16:10:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.644+0000 7f56aa7fc700 1 -- 172.21.15.60:0/982076974 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v100) v1 ==== 81+0+32431 (secure 0 0 0) 0x7f56ac14e490 con 0x7f56ac15a620 2023-10-08T16:10:17.644 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:17.644 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 100, 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:10:16.518660+0000", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:17.645 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:17.646 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:17.647 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:17.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:17.649 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:17.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:17.652 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:17.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:17.654 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:17.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:17.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:17.657 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:17.658 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:17.659 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:17.659 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:17.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:17.659 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:17.659 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:17.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:17.660 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:17.660 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:17.660 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:17.660 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:17.661 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:17.661 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:17.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:17.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.661 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:17.662 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:17.663 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:17.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.664 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:17.664 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:17.664 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:17.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.665 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:17.665 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:17.665 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:17.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:17.667 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:17.668 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:17.669 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:17.670 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:17.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.672 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.674 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:17.678 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.679 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.681 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:17.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.685 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.686 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:17.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.692 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:17.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:17.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.704 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.707 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.708 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:17.715 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.716 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:17.717 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:17.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.722 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:17.723 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:17.725 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:17.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:17.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:17.729 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:17.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.732 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.733 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.735 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.736 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:17.737 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:17.738 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:17.739 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:17.740 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5698066f30 msgr2=0x7f56980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5698066f30 0x7f56980693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f56a40030c0 tx=0x7f56a4016000 comp rx=0 tx=0).stop 2023-10-08T16:10:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 msgr2=0x7f56ac152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:17.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 0x7f56ac152de0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c890 tx=0x7f569c0026a0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 shutdown_connections 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5698066f30 0x7f56980693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56ac15a620 0x7f56ac152de0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ac157870 0x7f56ac150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 --2- 172.21.15.60:0/982076974 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ac157c40 0x7f56ac1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 >> 172.21.15.60:0/982076974 conn(0x7f56ac068ce0 msgr2=0x7f56ac0d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 shutdown_connections 2023-10-08T16:10:17.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:17.646+0000 7f56b4752700 1 -- 172.21.15.60:0/982076974 wait complete. 2023-10-08T16:10:17.744 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:10:18.526 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:10:18.525+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-08T16:10:22.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.878+0000 7fa008a60700 1 Processor -- start 2023-10-08T16:10:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.878+0000 7fa008a60700 1 -- start start 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa008a60700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa00406f660 0x7fa00406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa008a60700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00406a050 con 0x7fa004068ae0 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa008a60700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040acdc0 con 0x7fa004068710 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa008a60700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040c9c20 con 0x7fa00406f660 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa002ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa00406f660 0x7fa00406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa003fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa004068ae0 0x7fa004070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39936/0 (socket says 172.21.15.60:39936) 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa003fff700 1 -- 172.21.15.60:0/644818546 learned_addr learned my addr 172.21.15.60:0/644818546 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.879+0000 7fa002ffd700 1 -- 172.21.15.60:0/644818546 >> v1:172.21.15.144:6789/0 conn(0x7fa004068710 legacy=0x7fa0040c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa002ffd700 1 -- 172.21.15.60:0/644818546 >> v1:172.21.15.60:6789/0 conn(0x7fa004068ae0 legacy=0x7fa004070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa002ffd700 1 -- 172.21.15.60:0/644818546 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040c9e00 con 0x7fa00406f660 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa0027fc700 1 -- 172.21.15.60:0/644818546 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781426058 0 0) 0x7fa00406a050 con 0x7fa004068ae0 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa002ffd700 1 --2- 172.21.15.60:0/644818546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00406f660 0x7fa00406aaf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80098e0 tx=0x7f9ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a63bec3eb7adac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa0027fc700 1 -- 172.21.15.60:0/644818546 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8009e80 con 0x7fa00406f660 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa0027fc700 1 -- 172.21.15.60:0/644818546 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800b820 con 0x7fa00406f660 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa0027fc700 1 -- 172.21.15.60:0/644818546 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800bba0 con 0x7fa00406f660 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa008a60700 1 -- 172.21.15.60:0/644818546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00406f660 msgr2=0x7fa00406aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa008a60700 1 --2- 172.21.15.60:0/644818546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00406f660 0x7fa00406aaf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80098e0 tx=0x7f9ff80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa008a60700 1 -- 172.21.15.60:0/644818546 shutdown_connections 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa008a60700 1 --2- 172.21.15.60:0/644818546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00406f660 0x7fa00406aaf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa008a60700 1 -- 172.21.15.60:0/644818546 >> 172.21.15.60:0/644818546 conn(0x7fa0040cd8f0 msgr2=0x7fa0040cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.880+0000 7fa008a60700 1 -- 172.21.15.60:0/644818546 shutdown_connections 2023-10-08T16:10:22.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.881+0000 7fa008a60700 1 -- 172.21.15.60:0/644818546 wait complete. 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.882+0000 7fa008a60700 1 Processor -- start 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.882+0000 7fa008a60700 1 -- start start 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.882+0000 7fa008a60700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa004068710 0x7fa0040b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.882+0000 7fa008a60700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 0x7fa0040b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.882+0000 7fa008a60700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406f660 0x7fa0040c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa008a60700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b3090 con 0x7fa004068ae0 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa008a60700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b2540 con 0x7fa004068710 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa008a60700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b27f0 con 0x7fa00406f660 2023-10-08T16:10:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 0x7fa0040b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 0x7fa0040b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54368/0 (socket says 172.21.15.60:54368) 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 -- 172.21.15.60:0/1447470382 learned_addr learned my addr 172.21.15.60:0/1447470382 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa0037fe700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa004068710 0x7fa0040b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa003fff700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406f660 0x7fa0040c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 -- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406f660 msgr2=0x7fa0040c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406f660 0x7fa0040c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 -- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa004068710 msgr2=0x7fa0040b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa004068710 0x7fa0040b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 -- 172.21.15.60:0/1447470382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009420 con 0x7fa004068ae0 2023-10-08T16:10:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa0037fe700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa004068710 0x7fa0040b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa002ffd700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 0x7fa0040b2000 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80030c0 tx=0x7f9ff8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800bae0 con 0x7fa004068ae0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8020070 con 0x7fa004068ae0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff801b6a0 con 0x7fa004068ae0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040b2ad0 con 0x7fa004068ae0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.883+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0040c4ea0 con 0x7fa004068ae0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.884+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00406d640 con 0x7fa004068ae0 2023-10-08T16:10:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.885+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ff8022030 con 0x7fa004068ae0 2023-10-08T16:10:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.885+0000 7f9feb7fe700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.885+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ff8086460 con 0x7fa004068ae0 2023-10-08T16:10:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.885+0000 7fa0037fe700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.885+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=102}) v3 -- 0x7f9ff006ea50 con 0x7fa004068ae0 2023-10-08T16:10:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.886+0000 7fa0037fe700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4007fd0 tx=0x7f9ff4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:22.890+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ff80536d0 con 0x7fa004068ae0 2023-10-08T16:10:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.082+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa00406d640 con 0x7fa004068ae0 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.083+0000 7f9feb7fe700 1 -- 172.21.15.60:0/1447470382 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+32439 (secure 0 0 0) 0x7f9ff8056cf0 con 0x7fa004068ae0 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 101, 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:10:18.526299+0000", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:23.097 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:23.098 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 3, 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full", 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:23.099 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:23.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:23.102 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:23.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:23.104 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:23.105 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.106 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.111 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.112 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.116 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.118 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.119 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.120 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.125 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.129 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.130 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.131 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.137 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.138 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.143 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.144 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.146 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.147 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.149 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.150 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "full", 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:23.152 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:23.155 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:23.156 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:23.157 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.158 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.160 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:23.162 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:23.165 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 msgr2=0x7f9ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4007fd0 tx=0x7f9ff4009040 comp rx=0 tx=0).stop 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 msgr2=0x7fa0040b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 0x7fa0040b2000 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80030c0 tx=0x7f9ff8016000 comp rx=0 tx=0).stop 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 shutdown_connections 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406f660 0x7fa0040c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa004068710 0x7fa0040b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 --2- 172.21.15.60:0/1447470382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004068ae0 0x7fa0040b2000 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.085+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 >> 172.21.15.60:0/1447470382 conn(0x7fa0040cd8f0 msgr2=0x7fa0040af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.086+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 shutdown_connections 2023-10-08T16:10:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:23.086+0000 7fa008a60700 1 -- 172.21.15.60:0/1447470382 wait complete. 2023-10-08T16:10:23.170 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:10:25.538 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:10:25.538+0000 7f919316d700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-08T16:10:28.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:28.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.303+0000 7f628b498700 1 Processor -- start 2023-10-08T16:10:28.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.303+0000 7f628b498700 1 -- start start 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628b498700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62840cd420 0x7f62840cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628b498700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6284156d50 0x7f62840cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628b498700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840ad5c0 con 0x7f6284156980 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628b498700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840ac9b0 con 0x7f6284156d50 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628b498700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840acc90 con 0x7f62840cd420 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628ac97700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6284156d50 0x7f62840cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628ac97700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6284156d50 0x7f62840cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54370/0 (socket says 172.21.15.60:54370) 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628ac97700 1 -- 172.21.15.60:0/4183082748 learned_addr learned my addr 172.21.15.60:0/4183082748 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f6289c95700 1 --2- 172.21.15.60:0/4183082748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62840cd420 0x7f62840cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628ac97700 1 -- 172.21.15.60:0/4183082748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62840cd420 msgr2=0x7f62840cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628ac97700 1 --2- 172.21.15.60:0/4183082748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62840cd420 0x7f62840cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.304+0000 7f628ac97700 1 -- 172.21.15.60:0/4183082748 >> v1:172.21.15.144:6789/0 conn(0x7f6284156980 legacy=0x7f62840ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628ac97700 1 -- 172.21.15.60:0/4183082748 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840acf70 con 0x7f6284156d50 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628ac97700 1 --2- 172.21.15.60:0/4183082748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840cbd40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f62740099b0 tx=0x7f6274009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e02b66c703507a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f6289494700 1 -- 172.21.15.60:0/4183082748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400b860 con 0x7f6284156d50 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f6289494700 1 -- 172.21.15.60:0/4183082748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627400b9c0 con 0x7f6284156d50 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f6289494700 1 -- 172.21.15.60:0/4183082748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400bd60 con 0x7f6284156d50 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628b498700 1 -- 172.21.15.60:0/4183082748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 msgr2=0x7f62840cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628b498700 1 --2- 172.21.15.60:0/4183082748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840cbd40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f62740099b0 tx=0x7f6274009250 comp rx=0 tx=0).stop 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628b498700 1 -- 172.21.15.60:0/4183082748 shutdown_connections 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628b498700 1 --2- 172.21.15.60:0/4183082748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840cbd40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628b498700 1 --2- 172.21.15.60:0/4183082748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62840cd420 0x7f62840cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.305+0000 7f628b498700 1 -- 172.21.15.60:0/4183082748 >> 172.21.15.60:0/4183082748 conn(0x7f62840680e0 msgr2=0x7f62840cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:28.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.306+0000 7f628b498700 1 -- 172.21.15.60:0/4183082748 shutdown_connections 2023-10-08T16:10:28.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.306+0000 7f628b498700 1 -- 172.21.15.60:0/4183082748 wait complete. 2023-10-08T16:10:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 Processor -- start 2023-10-08T16:10:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 -- start start 2023-10-08T16:10:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62840cd420 0x7f628414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6284156980 0x7f62840b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b0020 con 0x7f6284156d50 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b0e20 con 0x7f62840cd420 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.307+0000 7f628b498700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b0210 con 0x7f6284156980 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54378/0 (socket says 172.21.15.60:54378) 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 -- 172.21.15.60:0/2704468841 learned_addr learned my addr 172.21.15.60:0/2704468841 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f6289c95700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6284156980 0x7f62840b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628a496700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62840cd420 0x7f628414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 -- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6284156980 msgr2=0x7f62840b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6284156980 0x7f62840b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 -- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62840cd420 msgr2=0x7f628414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62840cd420 0x7f628414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 -- 172.21.15.60:0/2704468841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740094f0 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628ac97700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840b17f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f628406c560 tx=0x7f6274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274011e30 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627401a630 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840b04f0 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627401a9f0 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.308+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62840b0ab0 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.309+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62840b0f90 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.310+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62740253f0 con 0x7f6284156d50 2023-10-08T16:10:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.310+0000 7f62827fc700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.310+0000 7f628a496700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.310+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6274085fb0 con 0x7f6284156d50 2023-10-08T16:10:28.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.311+0000 7f628a496700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6270066f30 0x7f62700693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f627c007fd0 tx=0x7f627c0016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.315+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62740b75a0 con 0x7f6284156d50 2023-10-08T16:10:28.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.508+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f628404bb80 con 0x7f6284156d50 2023-10-08T16:10:28.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.509+0000 7f62827fc700 1 -- 172.21.15.60:0/2704468841 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+32347 (secure 0 0 0) 0x7f6274053220 con 0x7f6284156d50 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 104, 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:10:27.546502+0000", 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:28.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:28.512 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:28.513 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 4097, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,backfillfull", 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:28.514 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:28.515 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "104", 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:28.516 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:28.517 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:28.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:28.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 4097, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,backfillfull", 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:28.520 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:28.521 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "104", 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:28.522 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:28.523 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:28.524 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:28.525 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.526 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:28.527 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 4097, 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,backfillfull", 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:28.528 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:28.529 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:28.530 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "104", 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:28.531 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:28.533 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:28.534 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:28.534 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:28.534 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:28.534 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:28.534 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:28.534 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:28.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:28.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.535 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:28.535 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:28.537 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:28.537 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:28.537 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:28.537 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:28.537 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:28.537 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.539 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:28.542 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:28.544 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.545 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:28.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.551 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.552 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:28.553 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:28.556 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:28.557 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.558 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:28.563 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:28.569 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.570 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.576 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.577 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.579 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.581 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.583 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:28.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.588 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:28.591 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.592 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:28.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.594 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:28.595 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.596 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.597 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:28.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6270066f30 msgr2=0x7f62700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6270066f30 0x7f62700693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f627c007fd0 tx=0x7f627c0016f0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 msgr2=0x7f62840b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840b17f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f628406c560 tx=0x7f6274017000 comp rx=0 tx=0).stop 2023-10-08T16:10:28.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 shutdown_connections 2023-10-08T16:10:28.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6284156d50 0x7f62840b17f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.511+0000 7f628b498700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62840cd420 0x7f628414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.512+0000 7f628b498700 1 --2- 172.21.15.60:0/2704468841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6284156980 0x7f62840b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.512+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 >> 172.21.15.60:0/2704468841 conn(0x7f62840680e0 msgr2=0x7f62841533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:28.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.512+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 shutdown_connections 2023-10-08T16:10:28.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.512+0000 7f628b498700 1 -- 172.21.15.60:0/2704468841 wait complete. 2023-10-08T16:10:28.600 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T16:10:28.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:10:28.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.718+0000 7fae2476b700 1 Processor -- start 2023-10-08T16:10:28.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.718+0000 7fae2476b700 1 -- start start 2023-10-08T16:10:28.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.719+0000 7fae2476b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 0x7fae1c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.719+0000 7fae2476b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 0x7fae1c0a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.719+0000 7fae2476b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0ccac0 con 0x7fae1c0affa0 2023-10-08T16:10:28.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.719+0000 7fae2476b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0a8050 con 0x7fae1c0af000 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.719+0000 7fae2476b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0b1930 con 0x7fae1c0af3d0 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 0x7fae1c0a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22507700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 0x7fae1c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 0x7fae1c0a7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:48686/0 (socket says 172.21.15.60:48686) 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22507700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 0x7fae1c0b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:38652/0 (socket says 172.21.15.60:38652) 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae21d06700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fae1c0affa0 0x7fae1c0a7400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:49758/0 (socket says 172.21.15.60:49758) 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 -- 172.21.15.60:0/2143274656 learned_addr learned my addr 172.21.15.60:0/2143274656 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae21505700 1 -- 172.21.15.60:0/2143274656 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718312500 0 0) 0x7fae1c0ccac0 con 0x7fae1c0affa0 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae21505700 1 -- 172.21.15.60:0/2143274656 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae04003570 con 0x7fae1c0affa0 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 -- 172.21.15.60:0/2143274656 >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 msgr2=0x7fae1c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 --2- 172.21.15.60:0/2143274656 >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 0x7fae1c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 -- 172.21.15.60:0/2143274656 >> v1:172.21.15.144:6789/0 conn(0x7fae1c0affa0 legacy=0x7fae1c0a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 -- 172.21.15.60:0/2143274656 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0b1bd0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22507700 1 --2- 172.21.15.60:0/2143274656 >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 0x7fae1c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.720+0000 7fae22d08700 1 --2- 172.21.15.60:0/2143274656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 0x7fae1c0a7b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009f20 tx=0x7fae0c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40c087853d33445 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae21505700 1 -- 172.21.15.60:0/2143274656 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00e070 con 0x7fae1c0af3d0 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae21505700 1 -- 172.21.15.60:0/2143274656 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00ba00 con 0x7fae1c0af3d0 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae21505700 1 -- 172.21.15.60:0/2143274656 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0092e0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 -- 172.21.15.60:0/2143274656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 msgr2=0x7fae1c0a7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 --2- 172.21.15.60:0/2143274656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 0x7fae1c0a7b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009f20 tx=0x7fae0c009840 comp rx=0 tx=0).stop 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 -- 172.21.15.60:0/2143274656 shutdown_connections 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 --2- 172.21.15.60:0/2143274656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af3d0 0x7fae1c0a7b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 --2- 172.21.15.60:0/2143274656 >> v2:172.21.15.144:3300/0 conn(0x7fae1c0af000 0x7fae1c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 -- 172.21.15.60:0/2143274656 >> 172.21.15.60:0/2143274656 conn(0x7fae1c0cd1e0 msgr2=0x7fae1c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 -- 172.21.15.60:0/2143274656 shutdown_connections 2023-10-08T16:10:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.721+0000 7fae2476b700 1 -- 172.21.15.60:0/2143274656 wait complete. 2023-10-08T16:10:28.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.722+0000 7fae2476b700 1 Processor -- start 2023-10-08T16:10:28.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.722+0000 7fae2476b700 1 -- start start 2023-10-08T16:10:28.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae2476b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af000 0x7fae1c143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae2476b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 0x7fae1c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae2476b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c0affa0 0x7fae1c159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae2476b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c143f10 con 0x7fae1c0af3d0 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae2476b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0aaa00 con 0x7fae1c0affa0 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae2476b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0a9df0 con 0x7fae1c0af000 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 0x7fae1c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 0x7fae1c1439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54388/0 (socket says 172.21.15.60:54388) 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 -- 172.21.15.60:0/917196382 learned_addr learned my addr 172.21.15.60:0/917196382 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae22507700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af000 0x7fae1c143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae22d08700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c0affa0 0x7fae1c159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 -- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af000 msgr2=0x7fae1c143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af000 0x7fae1c143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 -- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c0affa0 msgr2=0x7fae1c159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.723+0000 7fae21d06700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c0affa0 0x7fae1c159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae21d06700 1 -- 172.21.15.60:0/917196382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009420 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae22d08700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c0affa0 0x7fae1c159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae21d06700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 0x7fae1c1439d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c7c0 tx=0x7fae10007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10005b40 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10005ca0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c009ae0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10007320 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.724+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c0aa3b0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.725+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c0aab70 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.725+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae1001b3b0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.726+0000 7fae1a7fc700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae08066f30 0x7fae080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.726+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae10083a10 con 0x7fae1c0af3d0 2023-10-08T16:10:28.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.726+0000 7fae22507700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae08066f30 0x7fae080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.726+0000 7fae22507700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae08066f30 0x7fae080693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fae14009ea0 tx=0x7fae140091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.730+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae10050c80 con 0x7fae1c0af3d0 2023-10-08T16:10:28.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.924+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fae1c04c3c0 con 0x7fae1c0af3d0 2023-10-08T16:10:28.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.925+0000 7fae1a7fc700 1 -- 172.21.15.60:0/917196382 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+32267 (secure 0 0 0) 0x7fae10017020 con 0x7fae1c0af3d0 2023-10-08T16:10:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:28.927 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 105, 2023-10-08T16:10:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:10:28.547746+0000", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:10:28.928 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 13, 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:10:28.929 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:28.930 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:28.932 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.934 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:28.935 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.936 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.291292+0000", 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:28.937 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:28.938 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:28.939 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:28.940 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:28.941 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:10:28.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.943 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2023-10-08T16:10:28.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:09:56.823764+0000", 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:10:28.946 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:10:28.947 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:10:28.948 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:10:28.949 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:10:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:10:28.951 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.952 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:10:28.956 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.956 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.957 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.957 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.957 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:10:28.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:10:28.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.959 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:10:28.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:10:28.961 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:10:28.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.962 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:10:28.962 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:10:28.962 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:10:28.962 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:10:28.962 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.962 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.963 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.963 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:28.963 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.964 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.964 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.964 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.964 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.964 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.964 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.965 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.965 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.965 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.965 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.965 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:10:28.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:10:28.967 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.968 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:10:28.968 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.970 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:10:28.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:10:28.972 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.972 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:10:28.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.974 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:10:28.974 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:10:28.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.975 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.975 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:10:28.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:10:28.975 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:10:28.975 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:10:28.976 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.976 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.976 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.977 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:28.977 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.977 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.977 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.977 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.979 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.979 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:10:28.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:10:28.981 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.981 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.981 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:10:28.982 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:10:28.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.984 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.984 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.984 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:10:28.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:10:28.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.986 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.986 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:10:28.988 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:28.989 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:28.990 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.992 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.997 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:28.999 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:29.000 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:29.000 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:29.000 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:29.000 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:29.000 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:29.000 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:10:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:10:29.002 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.003 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.003 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.003 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:29.003 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.004 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:10:29.004 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.005 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:10:29.005 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.005 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.005 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:29.006 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.006 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:10:29.006 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.007 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:10:29.007 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.008 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.008 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.008 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:29.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:10:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.010 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.010 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:10:29.010 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:10:29.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.010 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.011 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:10:29.011 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:10:29.011 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:10:29.011 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:10:29.011 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:29.012 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:29.013 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:10:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:29.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.019 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:29.020 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:10:29.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:10:29.028 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.031 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:10:29.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:10:29.034 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.035 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.036 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:10:29.037 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:10:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.040 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:10:29.041 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:10:29.042 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:10:29.043 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:29.044 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.927+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae08066f30 msgr2=0x7fae080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.927+0000 7fae2476b700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae08066f30 0x7fae080693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fae14009ea0 tx=0x7fae140091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.927+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 msgr2=0x7fae1c1439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.927+0000 7fae2476b700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 0x7fae1c1439d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c7c0 tx=0x7fae10007dc0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 shutdown_connections 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae08066f30 0x7fae080693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae1c0af000 0x7fae1c143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c0affa0 0x7fae1c159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 --2- 172.21.15.60:0/917196382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae1c0af3d0 0x7fae1c1439d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 >> 172.21.15.60:0/917196382 conn(0x7fae1c0cd1e0 msgr2=0x7fae1c06ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 shutdown_connections 2023-10-08T16:10:29.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:28.928+0000 7fae2476b700 1 -- 172.21.15.60:0/917196382 wait complete. 2023-10-08T16:10:29.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:29.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.166+0000 7f4ef5a8f700 1 Processor -- start 2023-10-08T16:10:29.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.166+0000 7f4ef5a8f700 1 -- start start 2023-10-08T16:10:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4ef5a8f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ef015a0c0 0x7f4ef015e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4ef5a8f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00cca20 con 0x7f4ef0159cf0 2023-10-08T16:10:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4ef5a8f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef015ea40 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4ef5a8f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef0067660 con 0x7f4ef015a0c0 2023-10-08T16:10:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eef7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4ef0159cf0 0x7f4ef00ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39948/0 (socket says 172.21.15.60:39948) 2023-10-08T16:10:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eeffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ef015a0c0 0x7f4ef015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eef7fe700 1 -- 172.21.15.60:0/947540964 learned_addr learned my addr 172.21.15.60:0/947540964 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eeffff700 1 -- 172.21.15.60:0/947540964 >> v1:172.21.15.144:6789/0 conn(0x7f4ef00cf1c0 legacy=0x7f4ef0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eeffff700 1 -- 172.21.15.60:0/947540964 >> v1:172.21.15.60:6789/0 conn(0x7f4ef0159cf0 legacy=0x7f4ef00ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eee7fc700 1 -- 172.21.15.60:0/947540964 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140010138 0 0) 0x7f4ef00cca20 con 0x7f4ef0159cf0 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eeffff700 1 -- 172.21.15.60:0/947540964 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0067f00 con 0x7f4ef015a0c0 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.167+0000 7f4eeffff700 1 --2- 172.21.15.60:0/947540964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef015a0c0 0x7f4ef015e500 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009e60 tx=0x7f4ee8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd9e9d763a9aeb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4eee7fc700 1 -- 172.21.15.60:0/947540964 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800e070 con 0x7f4ef015a0c0 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4eee7fc700 1 -- 172.21.15.60:0/947540964 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800bc30 con 0x7f4ef015a0c0 2023-10-08T16:10:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4eee7fc700 1 -- 172.21.15.60:0/947540964 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8012430 con 0x7f4ef015a0c0 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/947540964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef015a0c0 msgr2=0x7f4ef015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/947540964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef015a0c0 0x7f4ef015e500 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009e60 tx=0x7f4ee8009780 comp rx=0 tx=0).stop 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/947540964 shutdown_connections 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/947540964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef015a0c0 0x7f4ef015e500 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/947540964 >> 172.21.15.60:0/947540964 conn(0x7f4ef006c6e0 msgr2=0x7f4ef0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/947540964 shutdown_connections 2023-10-08T16:10:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.168+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/947540964 wait complete. 2023-10-08T16:10:29.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.169+0000 7f4ef5a8f700 1 Processor -- start 2023-10-08T16:10:29.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.169+0000 7f4ef5a8f700 1 -- start start 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4ef5a8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 0x7f4ef00abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4ef5a8f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef0159cf0 0x7f4ef01694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4ef5a8f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef015a0c0 0x7f4ef00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4ef5a8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00aba70 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4ef5a8f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00aae60 con 0x7f4ef015a0c0 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4ef5a8f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00ab140 con 0x7f4ef0159cf0 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4eef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 0x7f4ef00abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4eef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 0x7f4ef00abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54414/0 (socket says 172.21.15.60:54414) 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4eef7fe700 1 -- 172.21.15.60:0/3426878134 learned_addr learned my addr 172.21.15.60:0/3426878134 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4eeeffd700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef0159cf0 0x7f4ef01694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.170+0000 7f4eeffff700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef015a0c0 0x7f4ef00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eef7fe700 1 -- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef0159cf0 msgr2=0x7f4ef01694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eef7fe700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef0159cf0 0x7f4ef01694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eef7fe700 1 -- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef015a0c0 msgr2=0x7f4ef00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eef7fe700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef015a0c0 0x7f4ef00b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eef7fe700 1 -- 172.21.15.60:0/3426878134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009a20 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eeffff700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef015a0c0 0x7f4ef00b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4eef7fe700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 0x7f4ef00abf00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800c7e0 tx=0x7f4ed8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8005b30 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8005c90 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00ab420 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8007300 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.171+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef01699e0 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.172+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef004c3c0 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.173+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ed80076b0 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.173+0000 7f4ee77fe700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.173+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ed8083a90 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.173+0000 7f4eeeffd700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.173+0000 7f4eeeffd700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ed0066f30 0x7f4ed00693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0159650 tx=0x7f4ee0000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.177+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ed8050d00 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.418+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ef00ce730 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.418+0000 7f4ee77fe700 1 -- 172.21.15.60:0/3426878134 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f4ed8017090 con 0x7f4ef00cf1c0 2023-10-08T16:10:29.420 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:29.420 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ed0066f30 msgr2=0x7f4ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ed0066f30 0x7f4ed00693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0159650 tx=0x7f4ee0000bc0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 msgr2=0x7f4ef00abf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 0x7f4ef00abf00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800c7e0 tx=0x7f4ed8007df0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 shutdown_connections 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef015a0c0 0x7f4ef00b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ef00cf1c0 0x7f4ef00abf00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 --2- 172.21.15.60:0/3426878134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef0159cf0 0x7f4ef01694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 >> 172.21.15.60:0/3426878134 conn(0x7f4ef006c6e0 msgr2=0x7f4ef00c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 shutdown_connections 2023-10-08T16:10:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:29.421+0000 7f4ef5a8f700 1 -- 172.21.15.60:0/3426878134 wait complete. 2023-10-08T16:10:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:29.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-08T16:10:29.574 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":6381,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.113740071999999,"mdsmap_epoch":52,"osdmap_epoch":105,"osdmap_epoch_barrier":99,"uptime":35.938488554999999} 2023-10-08T16:10:29.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 6381, "mdsmap_epoch": 52, "osdmap_epoch": 105, "osdmap_epoch_barrier": 99, "rank_uptime": 31.113740072, "state": "up:active", "uptime": 35.938488555, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:10:29.575 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:10:29.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:29.575 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-08T16:10:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:10:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:10:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.279692 s, 187 MB/s 2023-10-08T16:10:29.871 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:10:29.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:29.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:29.959 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:10:29.959 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:10:29.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:29.959 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:30.026 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:10:30.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:30.026 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:10:30.043 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:10:30.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:30.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:30.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:10:30.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:30.082 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:10:30.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.255+0000 7f519e025700 1 Processor -- start 2023-10-08T16:10:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.255+0000 7f519e025700 1 -- start start 2023-10-08T16:10:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519e025700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5198159c60 0x7f519815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519e025700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519e025700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5198068de0 con 0x7f519806a060 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519e025700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980affc0 con 0x7f5198159c60 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519e025700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519815b370 con 0x7f519815a030 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5198159c60 0x7f519815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5198159c60 0x7f519815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54428/0 (socket says 172.21.15.60:54428) 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 -- 172.21.15.60:0/2058453174 learned_addr learned my addr 172.21.15.60:0/2058453174 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 -- 172.21.15.60:0/2058453174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 msgr2=0x7f51980b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 --2- 172.21.15.60:0/2058453174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 -- 172.21.15.60:0/2058453174 >> v1:172.21.15.144:6789/0 conn(0x7f519806a060 legacy=0x7f51980ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 -- 172.21.15.60:0/2058453174 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980695f0 con 0x7f5198159c60 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.256+0000 7f519d023700 1 --2- 172.21.15.60:0/2058453174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5198159c60 0x7f519815ae30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5188009f20 tx=0x7f5188009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb2161e0aced224 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f5197fff700 1 -- 172.21.15.60:0/2058453174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800e070 con 0x7f5198159c60 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f5197fff700 1 -- 172.21.15.60:0/2058453174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518800ba40 con 0x7f5198159c60 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f5197fff700 1 -- 172.21.15.60:0/2058453174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880092e0 con 0x7f5198159c60 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 -- 172.21.15.60:0/2058453174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5198159c60 msgr2=0x7f519815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 --2- 172.21.15.60:0/2058453174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5198159c60 0x7f519815ae30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5188009f20 tx=0x7f5188009840 comp rx=0 tx=0).stop 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 -- 172.21.15.60:0/2058453174 shutdown_connections 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 --2- 172.21.15.60:0/2058453174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 --2- 172.21.15.60:0/2058453174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5198159c60 0x7f519815ae30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 -- 172.21.15.60:0/2058453174 >> 172.21.15.60:0/2058453174 conn(0x7f519806c740 msgr2=0x7f5198069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 -- 172.21.15.60:0/2058453174 shutdown_connections 2023-10-08T16:10:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.257+0000 7f519e025700 1 -- 172.21.15.60:0/2058453174 wait complete. 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.258+0000 7f519e025700 1 Processor -- start 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.258+0000 7f519e025700 1 -- start start 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519e025700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 0x7f5198155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519e025700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5198159c60 0x7f519816a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519e025700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519e025700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519816bc90 con 0x7f519806a060 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519e025700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51981556a0 con 0x7f5198159c60 2023-10-08T16:10:30.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519e025700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519816b000 con 0x7f519815a030 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519d023700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 0x7f5198155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519d023700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 0x7f5198155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54444/0 (socket says 172.21.15.60:54444) 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519d023700 1 -- 172.21.15.60:0/508971917 learned_addr learned my addr 172.21.15.60:0/508971917 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.259+0000 7f519c822700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5198159c60 0x7f519816a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d824700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d023700 1 -- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 msgr2=0x7f51980ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d023700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d023700 1 -- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5198159c60 msgr2=0x7f519816a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d023700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5198159c60 0x7f519816a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d023700 1 -- 172.21.15.60:0/508971917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188009ae0 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d824700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519d023700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 0x7f5198155160 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f51980640d0 tx=0x7f5188017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880129d0 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188012b30 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518801e430 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519816b2e0 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.260+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519816b920 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.261+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519816bab0 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.261+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f518801e860 con 0x7f519806a060 2023-10-08T16:10:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.262+0000 7f51957fa700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5184066f60 0x7f5184069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.262+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5188085ef0 con 0x7f519806a060 2023-10-08T16:10:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.262+0000 7f519c822700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5184066f60 0x7f5184069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.262+0000 7f519c822700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5184066f60 0x7f5184069410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f518c006fd0 tx=0x7f518c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.266+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5188053160 con 0x7f519806a060 2023-10-08T16:10:30.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.505+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5198071400 con 0x7f519806a060 2023-10-08T16:10:30.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.505+0000 7f51957fa700 1 -- 172.21.15.60:0/508971917 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f5198071400 con 0x7f519806a060 2023-10-08T16:10:30.507 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:30.507 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:30.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5184066f60 msgr2=0x7f5184069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5184066f60 0x7f5184069410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f518c006fd0 tx=0x7f518c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:30.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 msgr2=0x7f5198155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 0x7f5198155160 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f51980640d0 tx=0x7f5188017000 comp rx=0 tx=0).stop 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 shutdown_connections 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5184066f60 0x7f5184069410 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f519815a030 0x7f51980ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519806a060 0x7f5198155160 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 --2- 172.21.15.60:0/508971917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5198159c60 0x7f519816a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 >> 172.21.15.60:0/508971917 conn(0x7f519806c740 msgr2=0x7f51981568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 shutdown_connections 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.508+0000 7f519e025700 1 -- 172.21.15.60:0/508971917 wait complete. 2023-10-08T16:10:30.510 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:30.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.639+0000 7f7811d4f700 1 Processor -- start 2023-10-08T16:10:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.640+0000 7f7811d4f700 1 -- start start 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.640+0000 7f7811d4f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cd6e0 0x7f780c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.640+0000 7f7811d4f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f780c0cdab0 0x7f780c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.640+0000 7f7811d4f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0cb7c0 con 0x7f780c15dda0 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.640+0000 7f7811d4f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c15e850 con 0x7f780c0cdab0 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.640+0000 7f7811d4f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0cd030 con 0x7f780c0cd6e0 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f781154e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f780c15dda0 0x7f780c15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39956/0 (socket says 172.21.15.60:39956) 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f781154e700 1 -- 172.21.15.60:0/1095896809 learned_addr learned my addr 172.21.15.60:0/1095896809 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f7810d4d700 1 --2- 172.21.15.60:0/1095896809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cd6e0 0x7f780c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780bfff700 1 --2- 172.21.15.60:0/1095896809 >> v2:172.21.15.144:3300/0 conn(0x7f780c0cdab0 0x7f780c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780b7fe700 1 -- 172.21.15.60:0/1095896809 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164693453 0 0) 0x7f780c0cb7c0 con 0x7f780c15dda0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780b7fe700 1 -- 172.21.15.60:0/1095896809 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8003570 con 0x7f780c15dda0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f7810d4d700 1 -- 172.21.15.60:0/1095896809 >> v2:172.21.15.144:3300/0 conn(0x7f780c0cdab0 msgr2=0x7f780c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f7810d4d700 1 --2- 172.21.15.60:0/1095896809 >> v2:172.21.15.144:3300/0 conn(0x7f780c0cdab0 0x7f780c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f7810d4d700 1 -- 172.21.15.60:0/1095896809 >> v1:172.21.15.60:6789/0 conn(0x7f780c15dda0 legacy=0x7f780c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f7810d4d700 1 -- 172.21.15.60:0/1095896809 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c15e290 con 0x7f780c0cd6e0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780bfff700 1 --2- 172.21.15.60:0/1095896809 >> v2:172.21.15.144:3300/0 conn(0x7f780c0cdab0 0x7f780c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f7810d4d700 1 --2- 172.21.15.60:0/1095896809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cd6e0 0x7f780c0cbc50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098e0 tx=0x7f77f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f9ff1617cc10cc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780b7fe700 1 -- 172.21.15.60:0/1095896809 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011630 con 0x7f780c0cd6e0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780b7fe700 1 -- 172.21.15.60:0/1095896809 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4011790 con 0x7f780c0cd6e0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.641+0000 7f780b7fe700 1 -- 172.21.15.60:0/1095896809 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011b30 con 0x7f780c0cd6e0 2023-10-08T16:10:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 -- 172.21.15.60:0/1095896809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cd6e0 msgr2=0x7f780c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1095896809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cd6e0 0x7f780c0cbc50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098e0 tx=0x7f77f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 -- 172.21.15.60:0/1095896809 shutdown_connections 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1095896809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cd6e0 0x7f780c0cbc50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1095896809 >> v2:172.21.15.144:3300/0 conn(0x7f780c0cdab0 0x7f780c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 -- 172.21.15.60:0/1095896809 >> 172.21.15.60:0/1095896809 conn(0x7f780c067660 msgr2=0x7f780c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 -- 172.21.15.60:0/1095896809 shutdown_connections 2023-10-08T16:10:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.642+0000 7f7811d4f700 1 -- 172.21.15.60:0/1095896809 wait complete. 2023-10-08T16:10:30.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.643+0000 7f7811d4f700 1 Processor -- start 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.643+0000 7f7811d4f700 1 -- start start 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7811d4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 0x7f780c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7811d4f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cdab0 0x7f780c16ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7811d4f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780c15dda0 0x7f780c1455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7811d4f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c7f50 con 0x7f780c0cd6e0 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7811d4f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c16b040 con 0x7f780c15dda0 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7811d4f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c16b310 con 0x7f780c0cdab0 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 0x7f780c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 0x7f780c0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54448/0 (socket says 172.21.15.60:54448) 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 -- 172.21.15.60:0/1409835676 learned_addr learned my addr 172.21.15.60:0/1409835676 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f780bfff700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cdab0 0x7f780c16ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f781154e700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780c15dda0 0x7f780c1455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 -- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cdab0 msgr2=0x7f780c16ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cdab0 0x7f780c16ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 -- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780c15dda0 msgr2=0x7f780c1455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780c15dda0 0x7f780c1455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 -- 172.21.15.60:0/1409835676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009a20 con 0x7f780c0cd6e0 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f781154e700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780c15dda0 0x7f780c1455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.644+0000 7f7810d4d700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 0x7f780c0b31c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f780c0ccac0 tx=0x7f77f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.645+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011b10 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.645+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4000cc0 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.645+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f4009420 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.645+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4025620 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.645+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c16b8d0 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.646+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c16baf0 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.646+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77f4025a10 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.646+0000 7f7808ff9700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.646+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77f4085c60 con 0x7f780c0cd6e0 2023-10-08T16:10:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.646+0000 7f780bfff700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.647+0000 7f780bfff700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f77ec066f30 0x7f77ec0693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f780c0d0100 tx=0x7f77fc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.651+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77f4052ed0 con 0x7f780c0cd6e0 2023-10-08T16:10:30.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.845+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f780c0c7d00 con 0x7f780c0cd6e0 2023-10-08T16:10:30.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.846+0000 7f7808ff9700 1 -- 172.21.15.60:0/1409835676 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+15357 (secure 0 0 0) 0x7f77f4015090 con 0x7f780c0cd6e0 2023-10-08T16:10:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:30.847 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":105,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:28.547746+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:56.291292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:56.823764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:30.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f77ec066f30 msgr2=0x7f77ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f77ec066f30 0x7f77ec0693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f780c0d0100 tx=0x7f77fc00b040 comp rx=0 tx=0).stop 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 msgr2=0x7f780c0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 0x7f780c0b31c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f780c0ccac0 tx=0x7f77f4017000 comp rx=0 tx=0).stop 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 shutdown_connections 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780c15dda0 0x7f780c1455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f780c0cd6e0 0x7f780c0b31c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 --2- 172.21.15.60:0/1409835676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780c0cdab0 0x7f780c16ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 >> 172.21.15.60:0/1409835676 conn(0x7f780c067660 msgr2=0x7f780c0cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 shutdown_connections 2023-10-08T16:10:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.848+0000 7f7811d4f700 1 -- 172.21.15.60:0/1409835676 wait complete. 2023-10-08T16:10:30.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:56.291292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:56.823764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:10:30.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:10:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.982+0000 7fc55f59e700 1 Processor -- start 2023-10-08T16:10:30.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.982+0000 7fc55f59e700 1 -- start start 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc5600b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5600b1850 con 0x7fc5600adc80 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55f59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5600b20f0 con 0x7fc5600b0b70 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600cf530 con 0x7fc5600cf0f0 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc5600adc80 0x7fc5600b0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39966/0 (socket says 172.21.15.60:39966) 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55e59c700 1 -- 172.21.15.60:0/3023868340 learned_addr learned my addr 172.21.15.60:0/3023868340 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55ed9d700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc5600b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387228688 0 0) 0x7fc5600b1850 con 0x7fc5600adc80 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.983+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c003570 con 0x7fc5600adc80 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956912396 0 0) 0x7fc5600b20f0 con 0x7fc5600b0b70 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5600b1850 con 0x7fc5600b0b70 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216387436 0 0) 0x7fc54c003570 con 0x7fc5600adc80 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 msgr2=0x7fc5600b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc5600b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 >> v1:172.21.15.144:6789/0 conn(0x7fc5600b0b70 legacy=0x7fc5600ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600cf750 con 0x7fc5600adc80 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fc558001470 con 0x7fc5600adc80 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55ed9d700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc5600b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 >> v1:172.21.15.60:6789/0 conn(0x7fc5600adc80 legacy=0x7fc5600b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc54c003c20 0x7fc54c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c004810 0x7fc54c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc54c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600cf530 con 0x7fc54c003c20 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c00bbe0 con 0x7fc54c004810 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c00bda0 con 0x7fc5600cf0f0 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc54c003c20 0x7fc54c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55dd9b700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c004810 0x7fc54c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55ed9d700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc54c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 -- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 msgr2=0x7fc54c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600cf0f0 0x7fc54c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 -- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c004810 msgr2=0x7fc54c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c004810 0x7fc54c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 -- 172.21.15.60:0/3023868340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550009a20 con 0x7fc54c003c20 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55e59c700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc54c003c20 0x7fc54c004010 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c210 tx=0x7fc5600b2060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd72e3e68dd8ebe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.984+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800cc10 con 0x7fc54c003c20 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55800cd70 con 0x7fc54c003c20 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55d59a700 1 -- 172.21.15.60:0/3023868340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558005b70 con 0x7fc54c003c20 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55f59e700 1 -- 172.21.15.60:0/3023868340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc54c003c20 msgr2=0x7fc54c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55f59e700 1 --2- 172.21.15.60:0/3023868340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc54c003c20 0x7fc54c004010 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c210 tx=0x7fc5600b2060 comp rx=0 tx=0).stop 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55ed9d700 1 -- 172.21.15.60:0/3023868340 reap_dead start 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55f59e700 1 -- 172.21.15.60:0/3023868340 shutdown_connections 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55f59e700 1 -- 172.21.15.60:0/3023868340 >> 172.21.15.60:0/3023868340 conn(0x7fc56006c700 msgr2=0x7fc560069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55f59e700 1 -- 172.21.15.60:0/3023868340 shutdown_connections 2023-10-08T16:10:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.985+0000 7fc55f59e700 1 -- 172.21.15.60:0/3023868340 wait complete. 2023-10-08T16:10:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.986+0000 7fc55f59e700 1 Processor -- start 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.986+0000 7fc55f59e700 1 -- start start 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c003c20 0x7fc5600aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 0x7fc56015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600ac6c0 0x7fc5600acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600ab090 con 0x7fc56015ca10 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56015d3c0 con 0x7fc54c003c20 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600a6460 con 0x7fc5600ac6c0 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 0x7fc56015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 0x7fc56015ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54470/0 (socket says 172.21.15.60:54470) 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 -- 172.21.15.60:0/4267008030 learned_addr learned my addr 172.21.15.60:0/4267008030 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55e59c700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c003c20 0x7fc5600aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55ed9d700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600ac6c0 0x7fc5600acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 -- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600ac6c0 msgr2=0x7fc5600acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600ac6c0 0x7fc5600acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 -- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c003c20 msgr2=0x7fc5600aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c003c20 0x7fc5600aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.987+0000 7fc55dd9b700 1 -- 172.21.15.60:0/4267008030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600a6fe0 con 0x7fc56015ca10 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.988+0000 7fc55dd9b700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 0x7fc56015ce80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc548002bb0 tx=0x7fc548007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.988+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800f9f0 con 0x7fc56015ca10 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.988+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800fb70 con 0x7fc56015ca10 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.988+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480133f0 con 0x7fc56015ca10 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.988+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5600a7470 con 0x7fc56015ca10 2023-10-08T16:10:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.988+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5600a6990 con 0x7fc56015ca10 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.989+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5600a7170 con 0x7fc56015ca10 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.989+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5480137a0 con 0x7fc56015ca10 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.990+0000 7fc5567fc700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc540067000 0x7fc5400694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.990+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc548084cc0 con 0x7fc56015ca10 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.990+0000 7fc55e59c700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc540067000 0x7fc5400694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.990+0000 7fc55e59c700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc540067000 0x7fc5400694b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c210 tx=0x7fc558015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:30.994+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc54808b080 con 0x7fc56015ca10 2023-10-08T16:10:31.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.184+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc56004c3c0 con 0x7fc56015ca10 2023-10-08T16:10:31.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.185+0000 7fc5567fc700 1 -- 172.21.15.60:0/4267008030 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc548017020 con 0x7fc56015ca10 2023-10-08T16:10:31.186 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc540067000 msgr2=0x7fc5400694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc540067000 0x7fc5400694b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c210 tx=0x7fc558015000 comp rx=0 tx=0).stop 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 msgr2=0x7fc56015ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 0x7fc56015ce80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc548002bb0 tx=0x7fc548007d30 comp rx=0 tx=0).stop 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 shutdown_connections 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc540067000 0x7fc5400694b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5600ac6c0 0x7fc5600acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc54c003c20 0x7fc5600aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 --2- 172.21.15.60:0/4267008030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc56015ca10 0x7fc56015ce80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 >> 172.21.15.60:0/4267008030 conn(0x7fc56006c700 msgr2=0x7fc5600cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 shutdown_connections 2023-10-08T16:10:31.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.186+0000 7fc55f59e700 1 -- 172.21.15.60:0/4267008030 wait complete. 2023-10-08T16:10:31.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:10:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.322+0000 7f393c859700 1 Processor -- start 2023-10-08T16:10:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.322+0000 7f393c859700 1 -- start start 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f393c859700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39380cbf10 0x7f393815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f393c859700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380cae70 con 0x7f39380678b0 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f393c859700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380cb150 con 0x7f39380c9390 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f393c859700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39380cb430 con 0x7f39380cbf10 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f3935d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39380cbf10 0x7f393815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f393659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f39380678b0 0x7f393815db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39970/0 (socket says 172.21.15.60:39970) 2023-10-08T16:10:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.323+0000 7f393659c700 1 -- 172.21.15.60:0/2763150485 learned_addr learned my addr 172.21.15.60:0/2763150485 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f3935d9b700 1 -- 172.21.15.60:0/2763150485 >> v1:172.21.15.144:6789/0 conn(0x7f39380c9390 legacy=0x7f393815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f3935d9b700 1 -- 172.21.15.60:0/2763150485 >> v1:172.21.15.60:6789/0 conn(0x7f39380678b0 legacy=0x7f393815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f393559a700 1 -- 172.21.15.60:0/2763150485 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021208907 0 0) 0x7f39380cae70 con 0x7f39380678b0 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f3935d9b700 1 -- 172.21.15.60:0/2763150485 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380cb710 con 0x7f39380cbf10 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f3935d9b700 1 --2- 172.21.15.60:0/2763150485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380cbf10 0x7f393815e290 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f39200098e0 tx=0x7f39200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702c4ad19718905d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f393559a700 1 -- 172.21.15.60:0/2763150485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920009e80 con 0x7f39380cbf10 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f393559a700 1 -- 172.21.15.60:0/2763150485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392000b860 con 0x7f39380cbf10 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f393559a700 1 -- 172.21.15.60:0/2763150485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000bbe0 con 0x7f39380cbf10 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f393c859700 1 -- 172.21.15.60:0/2763150485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380cbf10 msgr2=0x7f393815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.324+0000 7f393c859700 1 --2- 172.21.15.60:0/2763150485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380cbf10 0x7f393815e290 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f39200098e0 tx=0x7f39200091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.325+0000 7f393c859700 1 -- 172.21.15.60:0/2763150485 shutdown_connections 2023-10-08T16:10:31.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.325+0000 7f393c859700 1 --2- 172.21.15.60:0/2763150485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380cbf10 0x7f393815e290 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.325+0000 7f393c859700 1 -- 172.21.15.60:0/2763150485 >> 172.21.15.60:0/2763150485 conn(0x7f3938069870 msgr2=0x7f3938069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.325+0000 7f393c859700 1 -- 172.21.15.60:0/2763150485 shutdown_connections 2023-10-08T16:10:31.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.325+0000 7f393c859700 1 -- 172.21.15.60:0/2763150485 wait complete. 2023-10-08T16:10:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.326+0000 7f393c859700 1 Processor -- start 2023-10-08T16:10:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.326+0000 7f393c859700 1 -- start start 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.326+0000 7f393c859700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 0x7f393816a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39380c9390 0x7f39381550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39380cbf10 0x7f3938155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380c7570 con 0x7f39380678b0 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380c8820 con 0x7f39380cbf10 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380c7c10 con 0x7f39380c9390 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 0x7f393816a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 0x7f393816a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54490/0 (socket says 172.21.15.60:54490) 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 -- 172.21.15.60:0/3107290196 learned_addr learned my addr 172.21.15.60:0/3107290196 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f3936d9d700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39380cbf10 0x7f3938155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f3935d9b700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39380c9390 0x7f39381550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 -- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39380c9390 msgr2=0x7f39381550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39380c9390 0x7f39381550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 -- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39380cbf10 msgr2=0x7f3938155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39380cbf10 0x7f3938155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 -- 172.21.15.60:0/3107290196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920009420 con 0x7f39380678b0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393659c700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 0x7f393816a060 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f393000c810 tx=0x7f3930007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930005c00 con 0x7f39380678b0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3930005d60 con 0x7f39380678b0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39380c7ef0 con 0x7f39380678b0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930007320 con 0x7f39380678b0 2023-10-08T16:10:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.327+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380c84b0 con 0x7f39380678b0 2023-10-08T16:10:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.328+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39380c8640 con 0x7f39380678b0 2023-10-08T16:10:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.329+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f393001b3b0 con 0x7f39380678b0 2023-10-08T16:10:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.329+0000 7f392e7fc700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3918066f30 0x7f39180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.329+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3930083980 con 0x7f39380678b0 2023-10-08T16:10:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.329+0000 7f3935d9b700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3918066f30 0x7f39180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.330+0000 7f3935d9b700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3918066f30 0x7f39180693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f39200093f0 tx=0x7f3920017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.333+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3930050bf0 con 0x7f39380678b0 2023-10-08T16:10:31.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.525+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39380c8b00 con 0x7f39380678b0 2023-10-08T16:10:31.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.525+0000 7f392e7fc700 1 -- 172.21.15.60:0/3107290196 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39300170a0 con 0x7f39380678b0 2023-10-08T16:10:31.527 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3918066f30 msgr2=0x7f39180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3918066f30 0x7f39180693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f39200093f0 tx=0x7f3920017000 comp rx=0 tx=0).stop 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 msgr2=0x7f393816a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 0x7f393816a060 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f393000c810 tx=0x7f3930007d90 comp rx=0 tx=0).stop 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 shutdown_connections 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3918066f30 0x7f39180693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39380cbf10 0x7f3938155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39380678b0 0x7f393816a060 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 --2- 172.21.15.60:0/3107290196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39380c9390 0x7f39381550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.527+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 >> 172.21.15.60:0/3107290196 conn(0x7f3938069870 msgr2=0x7f393806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.528+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 shutdown_connections 2023-10-08T16:10:31.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.528+0000 7f393c859700 1 -- 172.21.15.60:0/3107290196 wait complete. 2023-10-08T16:10:31.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:10:31.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.661+0000 7fca92cd4700 1 Processor -- start 2023-10-08T16:10:31.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.661+0000 7fca92cd4700 1 -- start start 2023-10-08T16:10:31.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca92cd4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca8c152300 0x7fca8c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca92cd4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca92cd4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c15c8d0 con 0x7fca8c06d370 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca92cd4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c0b1400 con 0x7fca8c152300 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca92cd4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0c9370 con 0x7fca8c158df0 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca91271700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fca8c06d370 0x7fca8c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39976/0 (socket says 172.21.15.60:39976) 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.662+0000 7fca91271700 1 -- 172.21.15.60:0/800381309 learned_addr learned my addr 172.21.15.60:0/800381309 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca90a70700 1 --2- 172.21.15.60:0/800381309 >> v2:172.21.15.144:3300/0 conn(0x7fca8c152300 0x7fca8c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8bfff700 1 --2- 172.21.15.60:0/800381309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8b7fe700 1 -- 172.21.15.60:0/800381309 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184247461 0 0) 0x7fca8c15c8d0 con 0x7fca8c06d370 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8b7fe700 1 -- 172.21.15.60:0/800381309 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca78003570 con 0x7fca8c06d370 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8b7fe700 1 -- 172.21.15.60:0/800381309 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765868631 0 0) 0x7fca78003570 con 0x7fca8c06d370 2023-10-08T16:10:31.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8bfff700 1 -- 172.21.15.60:0/800381309 >> v2:172.21.15.144:3300/0 conn(0x7fca8c152300 msgr2=0x7fca8c15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8bfff700 1 --2- 172.21.15.60:0/800381309 >> v2:172.21.15.144:3300/0 conn(0x7fca8c152300 0x7fca8c15b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8bfff700 1 -- 172.21.15.60:0/800381309 >> v1:172.21.15.60:6789/0 conn(0x7fca8c06d370 legacy=0x7fca8c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8bfff700 1 -- 172.21.15.60:0/800381309 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c15c030 con 0x7fca8c158df0 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca90a70700 1 --2- 172.21.15.60:0/800381309 >> v2:172.21.15.144:3300/0 conn(0x7fca8c152300 0x7fca8c15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8bfff700 1 --2- 172.21.15.60:0/800381309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c0caaf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009e60 tx=0x7fca7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7473fdbb04976e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8b7fe700 1 -- 172.21.15.60:0/800381309 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00e070 con 0x7fca8c158df0 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8b7fe700 1 -- 172.21.15.60:0/800381309 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00b7a0 con 0x7fca8c158df0 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.663+0000 7fca8b7fe700 1 -- 172.21.15.60:0/800381309 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74001470 con 0x7fca8c158df0 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 -- 172.21.15.60:0/800381309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 msgr2=0x7fca8c0caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 --2- 172.21.15.60:0/800381309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c0caaf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009e60 tx=0x7fca7c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 -- 172.21.15.60:0/800381309 shutdown_connections 2023-10-08T16:10:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 --2- 172.21.15.60:0/800381309 >> v2:172.21.15.144:3300/0 conn(0x7fca8c152300 0x7fca8c15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 --2- 172.21.15.60:0/800381309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c0caaf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 -- 172.21.15.60:0/800381309 >> 172.21.15.60:0/800381309 conn(0x7fca8c069870 msgr2=0x7fca8c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 -- 172.21.15.60:0/800381309 shutdown_connections 2023-10-08T16:10:31.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.664+0000 7fca92cd4700 1 -- 172.21.15.60:0/800381309 wait complete. 2023-10-08T16:10:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.665+0000 7fca92cd4700 1 Processor -- start 2023-10-08T16:10:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.665+0000 7fca92cd4700 1 -- start start 2023-10-08T16:10:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca92cd4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca8c06d370 0x7fca8c0b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca92cd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 0x7fca8c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca92cd4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca92cd4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0c7340 con 0x7fca8c152300 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca92cd4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0692e0 con 0x7fca8c06d370 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca92cd4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c156ae0 con 0x7fca8c158df0 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 0x7fca8c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 0x7fca8c068860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54502/0 (socket says 172.21.15.60:54502) 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 -- 172.21.15.60:0/236700217 learned_addr learned my addr 172.21.15.60:0/236700217 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca90a70700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca8c06d370 0x7fca8c0b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca91271700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 -- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 msgr2=0x7fca8c068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 -- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca8c06d370 msgr2=0x7fca8c0b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca8c06d370 0x7fca8c0b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 -- 172.21.15.60:0/236700217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84009420 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca91271700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca90a70700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca8c06d370 0x7fca8c0b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.666+0000 7fca8bfff700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 0x7fca8c068860 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c94b0 tx=0x7fca7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.667+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c012af0 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.667+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c012c70 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.667+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c01e430 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.667+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c009a20 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.667+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c157340 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.668+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c1574d0 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.668+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca7c01e7c0 con 0x7fca8c152300 2023-10-08T16:10:31.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.669+0000 7fca88ff9700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.669+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca7c0864f0 con 0x7fca8c152300 2023-10-08T16:10:31.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.669+0000 7fca90a70700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.669+0000 7fca90a70700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fca840093f0 tx=0x7fca84008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.673+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca7c053760 con 0x7fca8c152300 2023-10-08T16:10:31.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.864+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca8c04c3c0 con 0x7fca8c152300 2023-10-08T16:10:31.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.864+0000 7fca88ff9700 1 -- 172.21.15.60:0/236700217 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca7c056d80 con 0x7fca8c152300 2023-10-08T16:10:31.866 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:10:31.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca6c066f30 msgr2=0x7fca6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fca840093f0 tx=0x7fca84008040 comp rx=0 tx=0).stop 2023-10-08T16:10:31.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 msgr2=0x7fca8c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 0x7fca8c068860 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c94b0 tx=0x7fca7c018000 comp rx=0 tx=0).stop 2023-10-08T16:10:31.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 shutdown_connections 2023-10-08T16:10:31.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca8c158df0 0x7fca8c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca8c06d370 0x7fca8c0b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 --2- 172.21.15.60:0/236700217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c152300 0x7fca8c068860 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 >> 172.21.15.60:0/236700217 conn(0x7fca8c069870 msgr2=0x7fca8c0cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 shutdown_connections 2023-10-08T16:10:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.866+0000 7fca92cd4700 1 -- 172.21.15.60:0/236700217 wait complete. 2023-10-08T16:10:31.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:31.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.997+0000 7f1e0d1c2700 1 Processor -- start 2023-10-08T16:10:31.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.997+0000 7f1e0d1c2700 1 -- start start 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0d1c2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e0815a2b0 0x7f1e080b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0d1c2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e080cfe20 0x7f1e080ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0d1c2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080c5d80 con 0x7f1e080d1c30 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0d1c2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e08068470 con 0x7f1e080cfe20 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0d1c2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080c6060 con 0x7f1e0815a2b0 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e080cfe20 0x7f1e080ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1e080d1c30 0x7f1e080cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39984/0 (socket says 172.21.15.60:39984) 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e0659c700 1 -- 172.21.15.60:0/947109193 learned_addr learned my addr 172.21.15.60:0/947109193 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:32.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.998+0000 7f1e06d9d700 1 --2- 172.21.15.60:0/947109193 >> v2:172.21.15.144:3300/0 conn(0x7f1e0815a2b0 0x7f1e080b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0759e700 1 -- 172.21.15.60:0/947109193 >> v2:172.21.15.144:3300/0 conn(0x7f1e0815a2b0 msgr2=0x7f1e080b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0759e700 1 --2- 172.21.15.60:0/947109193 >> v2:172.21.15.144:3300/0 conn(0x7f1e0815a2b0 0x7f1e080b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0759e700 1 -- 172.21.15.60:0/947109193 >> v1:172.21.15.60:6789/0 conn(0x7f1e080d1c30 legacy=0x7f1e080cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e05d9b700 1 -- 172.21.15.60:0/947109193 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858233045 0 0) 0x7f1e080c5d80 con 0x7f1e080d1c30 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0759e700 1 -- 172.21.15.60:0/947109193 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080c6340 con 0x7f1e080cfe20 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0759e700 1 --2- 172.21.15.60:0/947109193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e080ccdd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1e08089220 tx=0x7f1df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85bddb50d0523bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e05d9b700 1 -- 172.21.15.60:0/947109193 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011630 con 0x7f1e080cfe20 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e05d9b700 1 -- 172.21.15.60:0/947109193 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8011790 con 0x7f1e080cfe20 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e05d9b700 1 -- 172.21.15.60:0/947109193 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011b30 con 0x7f1e080cfe20 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/947109193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 msgr2=0x7f1e080ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/947109193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e080ccdd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1e08089220 tx=0x7f1df80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/947109193 shutdown_connections 2023-10-08T16:10:32.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/947109193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e080ccdd0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/947109193 >> v2:172.21.15.144:3300/0 conn(0x7f1e0815a2b0 0x7f1e080b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/947109193 >> 172.21.15.60:0/947109193 conn(0x7f1e08067e40 msgr2=0x7f1e080d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:31.999+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/947109193 shutdown_connections 2023-10-08T16:10:32.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.000+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/947109193 wait complete. 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 Processor -- start 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 -- start start 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e0816b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e080d1c30 0x7f1e0816b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0815a2b0 0x7f1e0815bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0815ab60 con 0x7f1e080cfe20 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0815ae40 con 0x7f1e0815a2b0 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.001+0000 7f1e0d1c2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0815b120 con 0x7f1e080d1c30 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e0816b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e0816b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54522/0 (socket says 172.21.15.60:54522) 2023-10-08T16:10:32.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 -- 172.21.15.60:0/1046627408 learned_addr learned my addr 172.21.15.60:0/1046627408 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e0759e700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0815a2b0 0x7f1e0815bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e0659c700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e080d1c30 0x7f1e0816b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 -- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e080d1c30 msgr2=0x7f1e0816b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e080d1c30 0x7f1e0816b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 -- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0815a2b0 msgr2=0x7f1e0815bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0815a2b0 0x7f1e0815bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 -- 172.21.15.60:0/1046627408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009420 con 0x7f1e080cfe20 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e06d9d700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e0816b220 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009ea0 tx=0x7f1e0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000caa0 con 0x7f1e080cfe20 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000f040 con 0x7f1e080cfe20 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0815b400 con 0x7f1e080cfe20 2023-10-08T16:10:32.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000ce30 con 0x7f1e080cfe20 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.002+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e08159210 con 0x7f1e080cfe20 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.003+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e08159430 con 0x7f1e080cfe20 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.004+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e00014690 con 0x7f1e080cfe20 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.004+0000 7f1dfeffd700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1de8066f60 0x7f1de8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.004+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e00084b50 con 0x7f1e080cfe20 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.004+0000 7f1e0659c700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1de8066f60 0x7f1de8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.004+0000 7f1e0659c700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1de8066f60 0x7f1de8069410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e080caf70 tx=0x7f1df0007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.008+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e08159430 con 0x7f1e080cfe20 2023-10-08T16:10:32.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.246+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e08159430 con 0x7f1e080cfe20 2023-10-08T16:10:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.247+0000 7f1dfeffd700 1 -- 172.21.15.60:0/1046627408 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f1e08159430 con 0x7f1e080cfe20 2023-10-08T16:10:32.248 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:32.248 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.248+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1de8066f60 msgr2=0x7f1de8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.248+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1de8066f60 0x7f1de8069410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e080caf70 tx=0x7f1df0007f50 comp rx=0 tx=0).stop 2023-10-08T16:10:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.248+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 msgr2=0x7f1e0816b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.248+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e0816b220 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009ea0 tx=0x7f1e0000b040 comp rx=0 tx=0).stop 2023-10-08T16:10:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 shutdown_connections 2023-10-08T16:10:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1de8066f60 0x7f1de8069410 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0815a2b0 0x7f1e0815bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e080cfe20 0x7f1e0816b220 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 --2- 172.21.15.60:0/1046627408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e080d1c30 0x7f1e0816b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 >> 172.21.15.60:0/1046627408 conn(0x7f1e08067e40 msgr2=0x7f1e08069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 shutdown_connections 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.249+0000 7f1e0d1c2700 1 -- 172.21.15.60:0/1046627408 wait complete. 2023-10-08T16:10:32.251 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:32.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:32.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.379+0000 7fc870e61700 1 Processor -- start 2023-10-08T16:10:32.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.380+0000 7fc870e61700 1 -- start start 2023-10-08T16:10:32.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc870e61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0af3d0 0x7fc86c0a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc870e61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0ccac0 con 0x7fc86c0af000 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc870e61700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0a8050 con 0x7fc86c0affa0 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc870e61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0b1bd0 con 0x7fc86c0af3d0 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc86c0af000 0x7fc86c0b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36584/0 (socket says 172.21.15.60:36584) 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86a59c700 1 -- 172.21.15.60:0/3025900249 learned_addr learned my addr 172.21.15.60:0/3025900249 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86ad9d700 1 --2- 172.21.15.60:0/3025900249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0af3d0 0x7fc86c0a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114119234 0 0) 0x7fc86c0ccac0 con 0x7fc86c0af000 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc858003570 con 0x7fc86c0af000 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598296852 0 0) 0x7fc86c0a8050 con 0x7fc86c0affa0 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc86c0ccac0 con 0x7fc86c0affa0 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86ad9d700 1 -- 172.21.15.60:0/3025900249 >> v1:172.21.15.144:6789/0 conn(0x7fc86c0affa0 legacy=0x7fc86c0a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86ad9d700 1 -- 172.21.15.60:0/3025900249 >> v1:172.21.15.60:6789/0 conn(0x7fc86c0af000 legacy=0x7fc86c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86ad9d700 1 -- 172.21.15.60:0/3025900249 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0b1eb0 con 0x7fc86c0af3d0 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.381+0000 7fc86ad9d700 1 --2- 172.21.15.60:0/3025900249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0af3d0 0x7fc86c0a7b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009910 tx=0x7fc85c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c1f779b3b8671f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00b690 con 0x7fc86c0af3d0 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c00b7f0 con 0x7fc86c0af3d0 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc86959a700 1 -- 172.21.15.60:0/3025900249 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00bb90 con 0x7fc86c0af3d0 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 -- 172.21.15.60:0/3025900249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0af3d0 msgr2=0x7fc86c0a7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 --2- 172.21.15.60:0/3025900249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0af3d0 0x7fc86c0a7b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009910 tx=0x7fc85c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 -- 172.21.15.60:0/3025900249 shutdown_connections 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 --2- 172.21.15.60:0/3025900249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0af3d0 0x7fc86c0a7b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 -- 172.21.15.60:0/3025900249 >> 172.21.15.60:0/3025900249 conn(0x7fc86c0cd1e0 msgr2=0x7fc86c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 -- 172.21.15.60:0/3025900249 shutdown_connections 2023-10-08T16:10:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.382+0000 7fc870e61700 1 -- 172.21.15.60:0/3025900249 wait complete. 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.383+0000 7fc870e61700 1 Processor -- start 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.383+0000 7fc870e61700 1 -- start start 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc870e61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 0x7fc86c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc870e61700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c0af3d0 0x7fc86c09a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc870e61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0affa0 0x7fc86c06daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc870e61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c1547e0 con 0x7fc86c0af000 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc870e61700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c097ba0 con 0x7fc86c0af3d0 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc870e61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c097e80 con 0x7fc86c0affa0 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc86a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 0x7fc86c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc86a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 0x7fc86c1542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51200/0 (socket says 172.21.15.60:51200) 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc86a59c700 1 -- 172.21.15.60:0/2714457408 learned_addr learned my addr 172.21.15.60:0/2714457408 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc869d9b700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c0af3d0 0x7fc86c09a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.384+0000 7fc86ad9d700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0affa0 0x7fc86c06daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc86a59c700 1 -- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0affa0 msgr2=0x7fc86c06daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc86a59c700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0affa0 0x7fc86c06daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc86a59c700 1 -- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c0af3d0 msgr2=0x7fc86c09a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc86a59c700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c0af3d0 0x7fc86c09a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc86a59c700 1 -- 172.21.15.60:0/2714457408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c009420 con 0x7fc86c0af000 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc86a59c700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 0x7fc86c1542a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc864002250 tx=0x7fc864001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86400ce90 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86400aa80 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86400ae20 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c098160 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.385+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c098720 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.386+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c098940 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.386+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc864007300 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.387+0000 7fc8627fc700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc84c066f30 0x7fc84c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.387+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc864084900 con 0x7fc86c0af000 2023-10-08T16:10:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.387+0000 7fc869d9b700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc84c066f30 0x7fc84c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.387+0000 7fc869d9b700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc84c066f30 0x7fc84c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0ac750 tx=0x7fc854007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.391+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc864055680 con 0x7fc86c0af000 2023-10-08T16:10:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.585+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc86c04c3c0 con 0x7fc86c0af000 2023-10-08T16:10:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.586+0000 7fc8627fc700 1 -- 172.21.15.60:0/2714457408 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+15357 (secure 0 0 0) 0x7fc864055210 con 0x7fc86c0af000 2023-10-08T16:10:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:32.588 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":105,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:28.547746+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:56.291292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:56.823764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc84c066f30 msgr2=0x7fc84c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc84c066f30 0x7fc84c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0ac750 tx=0x7fc854007d50 comp rx=0 tx=0).stop 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 msgr2=0x7fc86c1542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 0x7fc86c1542a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc864002250 tx=0x7fc864001bb0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 shutdown_connections 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc84c066f30 0x7fc84c0693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc86c0affa0 0x7fc86c06daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc86c0af000 0x7fc86c1542a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 --2- 172.21.15.60:0/2714457408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c0af3d0 0x7fc86c09a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 >> 172.21.15.60:0/2714457408 conn(0x7fc86c0cd1e0 msgr2=0x7fc86c156070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 shutdown_connections 2023-10-08T16:10:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.588+0000 7fc870e61700 1 -- 172.21.15.60:0/2714457408 wait complete. 2023-10-08T16:10:32.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:10:32.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:32.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.720+0000 7f40ad9b2700 1 Processor -- start 2023-10-08T16:10:32.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.720+0000 7f40ad9b2700 1 -- start start 2023-10-08T16:10:32.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.721+0000 7f40ad9b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a81523e0 0x7f40a806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.721+0000 7f40ad9b2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 0x7f40a80cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.721+0000 7f40ad9b2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a806c010 con 0x7f40a8152010 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.721+0000 7f40ad9b2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a806bd10 con 0x7f40a8158e50 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.721+0000 7f40ad9b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a815c060 con 0x7f40a81523e0 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a81523e0 0x7f40a806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a77fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 0x7f40a80cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a77fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 0x7f40a80cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:60724/0 (socket says 172.21.15.60:60724) 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a77fe700 1 -- 172.21.15.60:0/3518107796 learned_addr learned my addr 172.21.15.60:0/3518107796 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a67fc700 1 -- 172.21.15.60:0/3518107796 >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 msgr2=0x7f40a80cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a67fc700 1 --2- 172.21.15.60:0/3518107796 >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 0x7f40a80cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a67fc700 1 -- 172.21.15.60:0/3518107796 >> v1:172.21.15.144:6789/0 conn(0x7f40a8152010 legacy=0x7f40a815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a67fc700 1 -- 172.21.15.60:0/3518107796 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a815c340 con 0x7f40a81523e0 2023-10-08T16:10:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a77fe700 1 --2- 172.21.15.60:0/3518107796 >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 0x7f40a80cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a67fc700 1 --2- 172.21.15.60:0/3518107796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a81523e0 0x7f40a806c4a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40900098e0 tx=0x7f40900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cbc80d8a46d5d64 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a5ffb700 1 -- 172.21.15.60:0/3518107796 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000b640 con 0x7f40a81523e0 2023-10-08T16:10:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a5ffb700 1 -- 172.21.15.60:0/3518107796 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000b7a0 con 0x7f40a81523e0 2023-10-08T16:10:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.722+0000 7f40a5ffb700 1 -- 172.21.15.60:0/3518107796 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000bb40 con 0x7f40a81523e0 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3518107796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a81523e0 msgr2=0x7f40a806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3518107796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a81523e0 0x7f40a806c4a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40900098e0 tx=0x7f40900091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3518107796 shutdown_connections 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3518107796 >> v2:172.21.15.144:3300/0 conn(0x7f40a8158e50 0x7f40a80cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3518107796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a81523e0 0x7f40a806c4a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3518107796 >> 172.21.15.60:0/3518107796 conn(0x7f40a8069870 msgr2=0x7f40a8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3518107796 shutdown_connections 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.723+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3518107796 wait complete. 2023-10-08T16:10:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.724+0000 7f40ad9b2700 1 Processor -- start 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.724+0000 7f40ad9b2700 1 -- start start 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40ad9b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a8152010 0x7f40a80692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40ad9b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 0x7f40a80b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40ad9b2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40a8158e50 0x7f40a814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40ad9b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81560b0 con 0x7f40a81523e0 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40ad9b2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80b3700 con 0x7f40a8158e50 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40ad9b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80b39e0 con 0x7f40a8152010 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 0x7f40a80b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 0x7f40a80b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51204/0 (socket says 172.21.15.60:51204) 2023-10-08T16:10:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 -- 172.21.15.60:0/3535132532 learned_addr learned my addr 172.21.15.60:0/3535132532 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a77fe700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40a8158e50 0x7f40a814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a6ffd700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a8152010 0x7f40a80692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 -- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a8152010 msgr2=0x7f40a80692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a8152010 0x7f40a80692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 -- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40a8158e50 msgr2=0x7f40a814f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40a8158e50 0x7f40a814f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.725+0000 7f40a67fc700 1 -- 172.21.15.60:0/3535132532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098009ae0 con 0x7f40a81523e0 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.726+0000 7f40a67fc700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 0x7f40a80b2c90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4090013000 tx=0x7f4090017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.726+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409001bc40 con 0x7f40a81523e0 2023-10-08T16:10:32.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.726+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409001bdc0 con 0x7f40a81523e0 2023-10-08T16:10:32.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.726+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4090009420 con 0x7f40a81523e0 2023-10-08T16:10:32.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.726+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090011670 con 0x7f40a81523e0 2023-10-08T16:10:32.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.726+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a80b3fa0 con 0x7f40a81523e0 2023-10-08T16:10:32.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.727+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8156220 con 0x7f40a81523e0 2023-10-08T16:10:32.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.727+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4090011a20 con 0x7f40a81523e0 2023-10-08T16:10:32.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.728+0000 7f409effd700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4088066f30 0x7f40880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.728+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4090085ab0 con 0x7f40a81523e0 2023-10-08T16:10:32.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.728+0000 7f40a6ffd700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4088066f30 0x7f40880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.728+0000 7f40a6ffd700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4088066f30 0x7f40880693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40a00039e0 tx=0x7f40a0007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.732+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4090052c80 con 0x7f40a81523e0 2023-10-08T16:10:32.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.967+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40a804c3c0 con 0x7f40a81523e0 2023-10-08T16:10:32.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.967+0000 7f409effd700 1 -- 172.21.15.60:0/3535132532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f40900562a0 con 0x7f40a81523e0 2023-10-08T16:10:32.969 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:32.969 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:32.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4088066f30 msgr2=0x7f40880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4088066f30 0x7f40880693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40a00039e0 tx=0x7f40a0007ec0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 msgr2=0x7f40a80b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 0x7f40a80b2c90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4090013000 tx=0x7f4090017000 comp rx=0 tx=0).stop 2023-10-08T16:10:32.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 shutdown_connections 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4088066f30 0x7f40880693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40a8152010 0x7f40a80692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40a8158e50 0x7f40a814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 --2- 172.21.15.60:0/3535132532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40a81523e0 0x7f40a80b2c90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 >> 172.21.15.60:0/3535132532 conn(0x7f40a8069870 msgr2=0x7f40a80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 shutdown_connections 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:32.970+0000 7f40ad9b2700 1 -- 172.21.15.60:0/3535132532 wait complete. 2023-10-08T16:10:32.972 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:32.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:33.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:33.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:33.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.100+0000 7f9b29612700 1 Processor -- start 2023-10-08T16:10:33.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.101+0000 7f9b29612700 1 -- start start 2023-10-08T16:10:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.101+0000 7f9b29612700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b24157870 0x7f9b2415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.101+0000 7f9b29612700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b2415a620 0x7f9b2415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.101+0000 7f9b29612700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2415cbb0 con 0x7f9b2415d580 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.101+0000 7f9b29612700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2415bfa0 con 0x7f9b24157870 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.101+0000 7f9b29612700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2415c280 con 0x7f9b2415a620 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b22ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b24157870 0x7f9b2415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b237fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9b2415d580 0x7f9b24158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36598/0 (socket says 172.21.15.60:36598) 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b237fe700 1 -- 172.21.15.60:0/889981380 learned_addr learned my addr 172.21.15.60:0/889981380 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b227fc700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b2415a620 0x7f9b2415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b22ffd700 1 -- 172.21.15.60:0/889981380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b2415a620 msgr2=0x7f9b2415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b22ffd700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b2415a620 0x7f9b2415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b22ffd700 1 -- 172.21.15.60:0/889981380 >> v1:172.21.15.60:6789/0 conn(0x7f9b2415d580 legacy=0x7f9b24158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b22ffd700 1 -- 172.21.15.60:0/889981380 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2415c560 con 0x7f9b24157870 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b227fc700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b2415a620 0x7f9b2415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b22ffd700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b24157870 0x7f9b2415b6a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b140098e0 tx=0x7f9b140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e546338132a9a39a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b21ffb700 1 -- 172.21.15.60:0/889981380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14009e80 con 0x7f9b24157870 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b21ffb700 1 -- 172.21.15.60:0/889981380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400b860 con 0x7f9b24157870 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.102+0000 7f9b21ffb700 1 -- 172.21.15.60:0/889981380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400bbe0 con 0x7f9b24157870 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 -- 172.21.15.60:0/889981380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b24157870 msgr2=0x7f9b2415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b24157870 0x7f9b2415b6a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b140098e0 tx=0x7f9b140091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 -- 172.21.15.60:0/889981380 shutdown_connections 2023-10-08T16:10:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b24157870 0x7f9b2415b6a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 --2- 172.21.15.60:0/889981380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b2415a620 0x7f9b2415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 -- 172.21.15.60:0/889981380 >> 172.21.15.60:0/889981380 conn(0x7f9b24068ce0 msgr2=0x7f9b240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 -- 172.21.15.60:0/889981380 shutdown_connections 2023-10-08T16:10:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.103+0000 7f9b29612700 1 -- 172.21.15.60:0/889981380 wait complete. 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 Processor -- start 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 -- start start 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b24157870 0x7f9b2416a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2415a620 0x7f9b2416dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 0x7f9b240b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240b0a20 con 0x7f9b2415d580 2023-10-08T16:10:33.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2416e560 con 0x7f9b2415a620 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b29612700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2416e840 con 0x7f9b24157870 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.105+0000 7f9b237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 0x7f9b240b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 0x7f9b240b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51224/0 (socket says 172.21.15.60:51224) 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 -- 172.21.15.60:0/3493687415 learned_addr learned my addr 172.21.15.60:0/3493687415 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b22ffd700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b24157870 0x7f9b2416a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b227fc700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2415a620 0x7f9b2416dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 -- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b24157870 msgr2=0x7f9b2416a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b24157870 0x7f9b2416a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 -- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2415a620 msgr2=0x7f9b2416dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2415a620 0x7f9b2416dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 -- 172.21.15.60:0/3493687415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009420 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b237fe700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 0x7f9b240b5f60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00cbc0 tx=0x7f9b1c001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00a7a0 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00a900 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00ac80 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2416eb20 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.106+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2416ac20 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.107+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b240b0b90 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.108+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b1c007300 con 0x7f9b2415d580 2023-10-08T16:10:33.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.108+0000 7f9b0affd700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b10066f30 0x7f9b100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.108+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b1c084700 con 0x7f9b2415d580 2023-10-08T16:10:33.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.108+0000 7f9b22ffd700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b10066f30 0x7f9b100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.109+0000 7f9b22ffd700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b10066f30 0x7f9b100693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b140091e0 tx=0x7f9b14017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.112+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b1c0519f0 con 0x7f9b2415d580 2023-10-08T16:10:33.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.349+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b2404c3c0 con 0x7f9b2415d580 2023-10-08T16:10:33.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.349+0000 7f9b0affd700 1 -- 172.21.15.60:0/3493687415 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9b1c055010 con 0x7f9b2415d580 2023-10-08T16:10:33.351 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:33.351 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:57.850301+0000","modified":"2023-10-08T16:10:01.467107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/2808352006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2808352006},{"type":"v1","addr":"172.21.15.60:6836","nonce":2808352006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b10066f30 msgr2=0x7f9b100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b10066f30 0x7f9b100693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b140091e0 tx=0x7f9b14017000 comp rx=0 tx=0).stop 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 msgr2=0x7f9b240b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 0x7f9b240b5f60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00cbc0 tx=0x7f9b1c001990 comp rx=0 tx=0).stop 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 shutdown_connections 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9b10066f30 0x7f9b100693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b24157870 0x7f9b2416a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b2415d580 0x7f9b240b5f60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 --2- 172.21.15.60:0/3493687415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2415a620 0x7f9b2416dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 >> 172.21.15.60:0/3493687415 conn(0x7f9b24068ce0 msgr2=0x7f9b24155610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 shutdown_connections 2023-10-08T16:10:33.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.351+0000 7f9b29612700 1 -- 172.21.15.60:0/3493687415 wait complete. 2023-10-08T16:10:33.354 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2023-10-08T16:10:33.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:33.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.482+0000 7f12e29e2700 1 Processor -- start 2023-10-08T16:10:33.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.482+0000 7f12e29e2700 1 -- start start 2023-10-08T16:10:33.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12e29e2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12dc0abae0 0x7f12dc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12e29e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abeb0 0x7f12dc0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12e29e2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12dc0c8400 0x7f12dc0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12e29e2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc0c9cb0 con 0x7f12dc0abae0 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12e29e2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc0c90a0 con 0x7f12dc0c8400 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12e29e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0c9380 con 0x7f12dc0abeb0 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12dbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12dc0abae0 0x7f12dc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12dbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12dc0abae0 0x7f12dc0c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51226/0 (socket says 172.21.15.60:51226) 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.483+0000 7f12dbfff700 1 -- 172.21.15.60:0/2596880276 learned_addr learned my addr 172.21.15.60:0/2596880276 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12e0f7f700 1 --2- 172.21.15.60:0/2596880276 >> v2:172.21.15.144:3300/0 conn(0x7f12dc0c8400 0x7f12dc0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12db7fe700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abeb0 0x7f12dc0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12dbfff700 1 -- 172.21.15.60:0/2596880276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abeb0 msgr2=0x7f12dc0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12dbfff700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abeb0 0x7f12dc0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12dbfff700 1 -- 172.21.15.60:0/2596880276 >> v2:172.21.15.144:3300/0 conn(0x7f12dc0c8400 msgr2=0x7f12dc0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12dbfff700 1 --2- 172.21.15.60:0/2596880276 >> v2:172.21.15.144:3300/0 conn(0x7f12dc0c8400 0x7f12dc0c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12dbfff700 1 -- 172.21.15.60:0/2596880276 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0c9660 con 0x7f12dc0abae0 2023-10-08T16:10:33.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12db7fe700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abeb0 0x7f12dc0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12dbfff700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0abae0 0x7f12dc0c6eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ca160 tx=0x7f12c400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25507dbaf9cefc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12daffd700 1 -- 172.21.15.60:0/2596880276 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400dc50 con 0x7f12dc0abae0 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12daffd700 1 -- 172.21.15.60:0/2596880276 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400ddb0 con 0x7f12dc0abae0 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.484+0000 7f12daffd700 1 -- 172.21.15.60:0/2596880276 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40196d0 con 0x7f12dc0abae0 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 -- 172.21.15.60:0/2596880276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0abae0 msgr2=0x7f12dc0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0abae0 0x7f12dc0c6eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ca160 tx=0x7f12c400b4f0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 -- 172.21.15.60:0/2596880276 shutdown_connections 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 --2- 172.21.15.60:0/2596880276 >> v2:172.21.15.144:3300/0 conn(0x7f12dc0c8400 0x7f12dc0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0abae0 0x7f12dc0c6eb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 --2- 172.21.15.60:0/2596880276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abeb0 0x7f12dc0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 -- 172.21.15.60:0/2596880276 >> 172.21.15.60:0/2596880276 conn(0x7f12dc067660 msgr2=0x7f12dc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 -- 172.21.15.60:0/2596880276 shutdown_connections 2023-10-08T16:10:33.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.485+0000 7f12e29e2700 1 -- 172.21.15.60:0/2596880276 wait complete. 2023-10-08T16:10:33.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.486+0000 7f12e29e2700 1 Processor -- start 2023-10-08T16:10:33.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.486+0000 7f12e29e2700 1 -- start start 2023-10-08T16:10:33.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e29e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abae0 0x7f12dc0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e29e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12dc0abeb0 0x7f12dc0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e29e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 0x7f12dc14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e29e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc14ea30 con 0x7f12dc0c8400 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e29e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0c3fe0 con 0x7f12dc0abeb0 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e29e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0c42c0 con 0x7f12dc0abae0 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 0x7f12dc14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 0x7f12dc14e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51240/0 (socket says 172.21.15.60:51240) 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 -- 172.21.15.60:0/151252223 learned_addr learned my addr 172.21.15.60:0/151252223 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12db7fe700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12dc0abeb0 0x7f12dc0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12dbfff700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abae0 0x7f12dc0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 -- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abae0 msgr2=0x7f12dc0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abae0 0x7f12dc0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 -- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12dc0abeb0 msgr2=0x7f12dc0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12dc0abeb0 0x7f12dc0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 -- 172.21.15.60:0/151252223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c400b790 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12e0f7f700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 0x7f12dc14e4f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f12d4007f20 tx=0x7f12d4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.487+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400eb90 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.488+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400ed10 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.488+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc0c45a0 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.488+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4014670 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.488+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc0c4b60 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.489+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc04c3c0 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.489+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12d40149e0 con 0x7f12dc0c8400 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.489+0000 7f12d3fff700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12bc066f30 0x7f12bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.489+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12d4084a90 con 0x7f12dc0c8400 2023-10-08T16:10:33.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.489+0000 7f12dbfff700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12bc066f30 0x7f12bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.490+0000 7f12dbfff700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12bc066f30 0x7f12bc0693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ca160 tx=0x7f12c401b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.494+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12d4051d00 con 0x7f12dc0c8400 2023-10-08T16:10:33.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.689+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12dc06aeb0 con 0x7f12dc0c8400 2023-10-08T16:10:33.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.689+0000 7f12d3fff700 1 -- 172.21.15.60:0/151252223 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+15357 (secure 0 0 0) 0x7f12d4055320 con 0x7f12dc0c8400 2023-10-08T16:10:33.691 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:33.691 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":105,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:28.547746+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:56.291292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:56.823764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12bc066f30 msgr2=0x7f12bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12bc066f30 0x7f12bc0693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ca160 tx=0x7f12c401b000 comp rx=0 tx=0).stop 2023-10-08T16:10:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 msgr2=0x7f12dc14e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 0x7f12dc14e4f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f12d4007f20 tx=0x7f12d4009860 comp rx=0 tx=0).stop 2023-10-08T16:10:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 shutdown_connections 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12bc066f30 0x7f12bc0693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12dc0abae0 0x7f12dc0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc0c8400 0x7f12dc14e4f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 --2- 172.21.15.60:0/151252223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12dc0abeb0 0x7f12dc0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 >> 172.21.15.60:0/151252223 conn(0x7f12dc067660 msgr2=0x7f12dc068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 shutdown_connections 2023-10-08T16:10:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.692+0000 7f12e29e2700 1 -- 172.21.15.60:0/151252223 wait complete. 2023-10-08T16:10:33.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:10:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.824+0000 7f0b999f0700 1 Processor -- start 2023-10-08T16:10:33.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.824+0000 7f0b999f0700 1 -- start start 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b999f0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b94159850 0x7f0b94159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b999f0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b94069220 0x7f0b940b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b999f0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9415a160 con 0x7f0b940b2be0 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b999f0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940cbaa0 con 0x7f0b94159850 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b999f0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940cbd80 con 0x7f0b94069220 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b94159850 0x7f0b94159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b94159850 0x7f0b94159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51256/0 (socket says 172.21.15.60:51256) 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 -- 172.21.15.60:0/2017263956 learned_addr learned my addr 172.21.15.60:0/2017263956 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b937fe700 1 --2- 172.21.15.60:0/2017263956 >> v2:172.21.15.144:3300/0 conn(0x7f0b94069220 0x7f0b940b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 -- 172.21.15.60:0/2017263956 >> v2:172.21.15.144:3300/0 conn(0x7f0b94069220 msgr2=0x7f0b940b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 --2- 172.21.15.60:0/2017263956 >> v2:172.21.15.144:3300/0 conn(0x7f0b94069220 0x7f0b940b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 -- 172.21.15.60:0/2017263956 >> v1:172.21.15.144:6789/0 conn(0x7f0b940b2be0 legacy=0x7f0b94068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 -- 172.21.15.60:0/2017263956 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940cc060 con 0x7f0b94159850 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b937fe700 1 --2- 172.21.15.60:0/2017263956 >> v2:172.21.15.144:3300/0 conn(0x7f0b94069220 0x7f0b940b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.825+0000 7f0b92ffd700 1 --2- 172.21.15.60:0/2017263956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94159850 0x7f0b94159c20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0b940b2190 tx=0x7f0b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fde32714a25a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b91ffb700 1 -- 172.21.15.60:0/2017263956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00b820 con 0x7f0b94159850 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b91ffb700 1 -- 172.21.15.60:0/2017263956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c00b980 con 0x7f0b94159850 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b91ffb700 1 -- 172.21.15.60:0/2017263956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00bd20 con 0x7f0b94159850 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 -- 172.21.15.60:0/2017263956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94159850 msgr2=0x7f0b94159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 --2- 172.21.15.60:0/2017263956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94159850 0x7f0b94159c20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0b940b2190 tx=0x7f0b8c009250 comp rx=0 tx=0).stop 2023-10-08T16:10:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 -- 172.21.15.60:0/2017263956 shutdown_connections 2023-10-08T16:10:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 --2- 172.21.15.60:0/2017263956 >> v2:172.21.15.144:3300/0 conn(0x7f0b94069220 0x7f0b940b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 --2- 172.21.15.60:0/2017263956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94159850 0x7f0b94159c20 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 -- 172.21.15.60:0/2017263956 >> 172.21.15.60:0/2017263956 conn(0x7f0b94067660 msgr2=0x7f0b94067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 -- 172.21.15.60:0/2017263956 shutdown_connections 2023-10-08T16:10:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.826+0000 7f0b999f0700 1 -- 172.21.15.60:0/2017263956 wait complete. 2023-10-08T16:10:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.827+0000 7f0b999f0700 1 Processor -- start 2023-10-08T16:10:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 -- start start 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 0x7f0b940c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b940b2be0 0x7f0b940c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b94159850 0x7f0b94155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940c8e90 con 0x7f0b94069220 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940c93e0 con 0x7f0b94159850 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b999f0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940c85f0 con 0x7f0b940b2be0 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b92ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 0x7f0b940c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b92ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 0x7f0b940c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51258/0 (socket says 172.21.15.60:51258) 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.828+0000 7f0b92ffd700 1 -- 172.21.15.60:0/341431370 learned_addr learned my addr 172.21.15.60:0/341431370 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b937fe700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b94159850 0x7f0b94155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b927fc700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b940b2be0 0x7f0b940c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b92ffd700 1 -- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b940b2be0 msgr2=0x7f0b940c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b92ffd700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b940b2be0 0x7f0b940c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b92ffd700 1 -- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b94159850 msgr2=0x7f0b94155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b92ffd700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b94159850 0x7f0b94155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b92ffd700 1 -- 172.21.15.60:0/341431370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0094f0 con 0x7f0b94069220 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b92ffd700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 0x7f0b940c6920 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c003080 tx=0x7f0b8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c011e20 con 0x7f0b94069220 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c01b680 con 0x7f0b94069220 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b940c88d0 con 0x7f0b94069220 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c01ba40 con 0x7f0b94069220 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.829+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9415a4f0 con 0x7f0b94069220 2023-10-08T16:10:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.830+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b940c9240 con 0x7f0b94069220 2023-10-08T16:10:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.830+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b8c01c450 con 0x7f0b94069220 2023-10-08T16:10:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.831+0000 7f0b8affd700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b74066f00 0x7f0b740693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.831+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b8c086290 con 0x7f0b94069220 2023-10-08T16:10:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.831+0000 7f0b927fc700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b74066f00 0x7f0b740693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.831+0000 7f0b927fc700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b74066f00 0x7f0b740693b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0b9416d880 tx=0x7f0b7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:33.835+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b940c9240 con 0x7f0b94069220 2023-10-08T16:10:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.071+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0b940c9240 con 0x7f0b94069220 2023-10-08T16:10:34.072 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:10:34.071+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:10:34.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.075+0000 7f0b8affd700 1 -- 172.21.15.60:0/341431370 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0b940c9240 con 0x7f0b94069220 2023-10-08T16:10:34.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b74066f00 msgr2=0x7f0b740693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b74066f00 0x7f0b740693b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0b9416d880 tx=0x7f0b7c009040 comp rx=0 tx=0).stop 2023-10-08T16:10:34.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 msgr2=0x7f0b940c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 0x7f0b940c6920 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c003080 tx=0x7f0b8c016000 comp rx=0 tx=0).stop 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 shutdown_connections 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b74066f00 0x7f0b740693b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b94159850 0x7f0b94155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b94069220 0x7f0b940c6920 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 --2- 172.21.15.60:0/341431370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b940b2be0 0x7f0b940c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 >> 172.21.15.60:0/341431370 conn(0x7f0b94067660 msgr2=0x7f0b940b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 shutdown_connections 2023-10-08T16:10:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.078+0000 7f0b999f0700 1 -- 172.21.15.60:0/341431370 wait complete. 2023-10-08T16:10:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:10:34.081 INFO:tasks.ceph.mds.a.smithi060.stderr: -9174> 2023-10-08T16:10:00.443+0000 7fb120efd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:10:34.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:10:34.110 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:10:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.212+0000 7f84c3d6c700 1 Processor -- start 2023-10-08T16:10:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.212+0000 7f84c3d6c700 1 -- start start 2023-10-08T16:10:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c3d6c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84bc0b3570 0x7f84bc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c3d6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c3d6c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0b14f0 con 0x7f84bc0b4860 2023-10-08T16:10:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c3d6c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0b17d0 con 0x7f84bc0b3570 2023-10-08T16:10:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c3d6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b1ab0 con 0x7f84bc0b4c30 2023-10-08T16:10:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c1307700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84bc0b3570 0x7f84bc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c2309700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c1b08700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f84bc0b4860 0x7f84bc159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:55458/0 (socket says 172.21.15.60:55458) 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c1b08700 1 -- 172.21.15.60:0/1179691791 learned_addr learned my addr 172.21.15.60:0/1179691791 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c0b06700 1 -- 172.21.15.60:0/1179691791 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552091181 0 0) 0x7f84bc0b14f0 con 0x7f84bc0b4860 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c0b06700 1 -- 172.21.15.60:0/1179691791 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a4003570 con 0x7f84bc0b4860 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c2309700 1 -- 172.21.15.60:0/1179691791 >> v2:172.21.15.144:3300/0 conn(0x7f84bc0b3570 msgr2=0x7f84bc15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c2309700 1 --2- 172.21.15.60:0/1179691791 >> v2:172.21.15.144:3300/0 conn(0x7f84bc0b3570 0x7f84bc15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c2309700 1 -- 172.21.15.60:0/1179691791 >> v1:172.21.15.144:6789/0 conn(0x7f84bc0b4860 legacy=0x7f84bc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c2309700 1 -- 172.21.15.60:0/1179691791 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0b1d90 con 0x7f84bc0b4c30 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.213+0000 7f84c1307700 1 --2- 172.21.15.60:0/1179691791 >> v2:172.21.15.144:3300/0 conn(0x7f84bc0b3570 0x7f84bc15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c2309700 1 --2- 172.21.15.60:0/1179691791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc0b6700 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009e60 tx=0x7f84ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b158c2a32f446f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c0b06700 1 -- 172.21.15.60:0/1179691791 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00e070 con 0x7f84bc0b4c30 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c0b06700 1 -- 172.21.15.60:0/1179691791 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00bb40 con 0x7f84bc0b4c30 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c0b06700 1 -- 172.21.15.60:0/1179691791 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac012430 con 0x7f84bc0b4c30 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c3d6c700 1 -- 172.21.15.60:0/1179691791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 msgr2=0x7f84bc0b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/1179691791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc0b6700 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009e60 tx=0x7f84ac009780 comp rx=0 tx=0).stop 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c3d6c700 1 -- 172.21.15.60:0/1179691791 shutdown_connections 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/1179691791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc0b6700 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/1179691791 >> v2:172.21.15.144:3300/0 conn(0x7f84bc0b3570 0x7f84bc15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.214+0000 7f84c3d6c700 1 -- 172.21.15.60:0/1179691791 >> 172.21.15.60:0/1179691791 conn(0x7f84bc09a0f0 msgr2=0x7f84bc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.215+0000 7f84c3d6c700 1 -- 172.21.15.60:0/1179691791 shutdown_connections 2023-10-08T16:10:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.215+0000 7f84c3d6c700 1 -- 172.21.15.60:0/1179691791 wait complete. 2023-10-08T16:10:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 Processor -- start 2023-10-08T16:10:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 -- start start 2023-10-08T16:10:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 0x7f84bc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84bc0b4860 0x7f84bc151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15fed0 con 0x7f84bc0b3570 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc150050 con 0x7f84bc0b4860 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c3d6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15f880 con 0x7f84bc0b4c30 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.216+0000 7f84c1b08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 0x7f84bc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 0x7f84bc155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51284/0 (socket says 172.21.15.60:51284) 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 -- 172.21.15.60:0/2686322275 learned_addr learned my addr 172.21.15.60:0/2686322275 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1307700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84bc0b4860 0x7f84bc151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c2309700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 -- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 msgr2=0x7f84bc151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 -- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84bc0b4860 msgr2=0x7f84bc151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84bc0b4860 0x7f84bc151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 -- 172.21.15.60:0/2686322275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0009420 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c1b08700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 0x7f84bc155df0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c790 tx=0x7f84b4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4005b80 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b4005ce0 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac009a20 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4007300 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.217+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc156330 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.218+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc04c3c0 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.219+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84b40076b0 con 0x7f84bc0b3570 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.219+0000 7f84b9ffb700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f84a8066f30 0x7f84a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.219+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f84b40839f0 con 0x7f84bc0b3570 2023-10-08T16:10:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.219+0000 7f84c1307700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f84a8066f30 0x7f84a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.220+0000 7f84c1307700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f84a8066f30 0x7f84a80693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009f40 tx=0x7f84b00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.223+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b4050c10 con 0x7f84bc0b3570 2023-10-08T16:10:34.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:34.459+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84bc0b2070 con 0x7f84bc0b3570 2023-10-08T16:10:35.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.075+0000 7f84b9ffb700 1 -- 172.21.15.60:0/2686322275 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84b40170a0 con 0x7f84bc0b3570 2023-10-08T16:10:35.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f84a8066f30 msgr2=0x7f84a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f84a8066f30 0x7f84a80693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009f40 tx=0x7f84b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 msgr2=0x7f84bc155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 0x7f84bc155df0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c790 tx=0x7f84b4007e00 comp rx=0 tx=0).stop 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 shutdown_connections 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f84a8066f30 0x7f84a80693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84bc0b4c30 0x7f84bc151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc0b3570 0x7f84bc155df0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 --2- 172.21.15.60:0/2686322275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84bc0b4860 0x7f84bc151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 >> 172.21.15.60:0/2686322275 conn(0x7f84bc09a0f0 msgr2=0x7f84bc15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 shutdown_connections 2023-10-08T16:10:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.078+0000 7f84c3d6c700 1 -- 172.21.15.60:0/2686322275 wait complete. 2023-10-08T16:10:35.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:10:35.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 Processor -- start 2023-10-08T16:10:35.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 -- start start 2023-10-08T16:10:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55a4159e50 0x7f55a40b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a40b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40b0d60 con 0x7f55a40b1730 2023-10-08T16:10:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40d15b0 con 0x7f55a4159e50 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.260+0000 7f55aa474700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40d1890 con 0x7f55a40b3370 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55a4159e50 0x7f55a40b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a37fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a40b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a8a11700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f55a40b1730 0x7f55a4068cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:55474/0 (socket says 172.21.15.60:55474) 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a8a11700 1 -- 172.21.15.60:0/23915310 learned_addr learned my addr 172.21.15.60:0/23915310 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a37fe700 1 -- 172.21.15.60:0/23915310 >> v2:172.21.15.144:3300/0 conn(0x7f55a4159e50 msgr2=0x7f55a40b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a37fe700 1 --2- 172.21.15.60:0/23915310 >> v2:172.21.15.144:3300/0 conn(0x7f55a4159e50 0x7f55a40b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a37fe700 1 -- 172.21.15.60:0/23915310 >> v1:172.21.15.144:6789/0 conn(0x7f55a40b1730 legacy=0x7f55a4068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a37fe700 1 -- 172.21.15.60:0/23915310 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40b09f0 con 0x7f55a40b3370 2023-10-08T16:10:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a3fff700 1 --2- 172.21.15.60:0/23915310 >> v2:172.21.15.144:3300/0 conn(0x7f55a4159e50 0x7f55a40b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:35.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a37fe700 1 --2- 172.21.15.60:0/23915310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a40b11f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f55980098e0 tx=0x7f55980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b44e8dee5162d8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:35.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.261+0000 7f55a2ffd700 1 -- 172.21.15.60:0/23915310 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800b640 con 0x7f55a40b3370 2023-10-08T16:10:35.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55a2ffd700 1 -- 172.21.15.60:0/23915310 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800b7a0 con 0x7f55a40b3370 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55a2ffd700 1 -- 172.21.15.60:0/23915310 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800bb40 con 0x7f55a40b3370 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 -- 172.21.15.60:0/23915310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 msgr2=0x7f55a40b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 --2- 172.21.15.60:0/23915310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a40b11f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f55980098e0 tx=0x7f55980091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 -- 172.21.15.60:0/23915310 shutdown_connections 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 --2- 172.21.15.60:0/23915310 >> v2:172.21.15.144:3300/0 conn(0x7f55a4159e50 0x7f55a40b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 --2- 172.21.15.60:0/23915310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a40b11f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 -- 172.21.15.60:0/23915310 >> 172.21.15.60:0/23915310 conn(0x7f55a4068130 msgr2=0x7f55a40d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 -- 172.21.15.60:0/23915310 shutdown_connections 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.262+0000 7f55aa474700 1 -- 172.21.15.60:0/23915310 wait complete. 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.263+0000 7f55aa474700 1 Processor -- start 2023-10-08T16:10:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.263+0000 7f55aa474700 1 -- start start 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55aa474700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55a40b1730 0x7f55a4151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55aa474700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a41528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55aa474700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 0x7f55a416a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55aa474700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41532c0 con 0x7f55a4159e50 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55aa474700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a414f210 con 0x7f55a40b1730 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55aa474700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a416abc0 con 0x7f55a40b3370 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55a8a11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 0x7f55a416a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55a8a11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 0x7f55a416a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51294/0 (socket says 172.21.15.60:51294) 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55a8a11700 1 -- 172.21.15.60:0/4261277940 learned_addr learned my addr 172.21.15.60:0/4261277940 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55a37fe700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a41528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.264+0000 7f55a3fff700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55a40b1730 0x7f55a4151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55a8a11700 1 -- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 msgr2=0x7f55a41528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55a8a11700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a41528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55a8a11700 1 -- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55a40b1730 msgr2=0x7f55a4151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55a8a11700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55a40b1730 0x7f55a4151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55a8a11700 1 -- 172.21.15.60:0/4261277940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594009420 con 0x7f55a4159e50 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55a8a11700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 0x7f55a416a680 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f559c00cc70 tx=0x7f559c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00a850 con 0x7f55a4159e50 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00a9b0 con 0x7f55a4159e50 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5598009420 con 0x7f55a4159e50 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00ad70 con 0x7f55a4159e50 2023-10-08T16:10:35.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.265+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a414eb50 con 0x7f55a4159e50 2023-10-08T16:10:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.266+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a414e9b0 con 0x7f55a4159e50 2023-10-08T16:10:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.266+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f559c007300 con 0x7f55a4159e50 2023-10-08T16:10:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.267+0000 7f558bfff700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5590066f30 0x7f55900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.267+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f559c0847f0 con 0x7f55a4159e50 2023-10-08T16:10:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.267+0000 7f55a3fff700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5590066f30 0x7f55900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.267+0000 7f55a3fff700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5590066f30 0x7f55900693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5594009ea0 tx=0x7f55940091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:35.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.271+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55a414e9b0 con 0x7f55a4159e50 2023-10-08T16:10:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:35.468+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55a414e9b0 con 0x7f55a4159e50 2023-10-08T16:10:36.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.078+0000 7f558bfff700 1 -- 172.21.15.60:0/4261277940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) v1 ==== 181+0+0 (secure 0 0 0) 0x7f55a414e9b0 con 0x7f55a4159e50 2023-10-08T16:10:36.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5590066f30 msgr2=0x7f55900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:36.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5590066f30 0x7f55900693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5594009ea0 tx=0x7f55940091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 msgr2=0x7f55a416a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:36.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 0x7f55a416a680 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f559c00cc70 tx=0x7f559c001a50 comp rx=0 tx=0).stop 2023-10-08T16:10:36.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 shutdown_connections 2023-10-08T16:10:36.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5590066f30 0x7f55900693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a4159e50 0x7f55a416a680 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55a40b1730 0x7f55a4151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 --2- 172.21.15.60:0/4261277940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55a40b3370 0x7f55a41528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.080+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 >> 172.21.15.60:0/4261277940 conn(0x7f55a4068130 msgr2=0x7f55a4158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.081+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 shutdown_connections 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.081+0000 7f55aa474700 1 -- 172.21.15.60:0/4261277940 wait complete. 2023-10-08T16:10:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:10:36.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:10:36.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.220+0000 7f48e690e700 1 Processor -- start 2023-10-08T16:10:36.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.220+0000 7f48e690e700 1 -- start start 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48e690e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48e00b11f0 0x7f48e00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48e690e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48e0068cb0 0x7f48e00690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48e690e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00b0d60 con 0x7f48e0159e50 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48e690e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e0069620 con 0x7f48e00b11f0 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48e690e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00b3540 con 0x7f48e0068cb0 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48e00b11f0 0x7f48e00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48e00b11f0 0x7f48e00b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51308/0 (socket says 172.21.15.60:51308) 2023-10-08T16:10:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 -- 172.21.15.60:0/2387376741 learned_addr learned my addr 172.21.15.60:0/2387376741 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48e4eab700 1 --2- 172.21.15.60:0/2387376741 >> v2:172.21.15.144:3300/0 conn(0x7f48e0068cb0 0x7f48e00690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 -- 172.21.15.60:0/2387376741 >> v2:172.21.15.144:3300/0 conn(0x7f48e0068cb0 msgr2=0x7f48e00690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 --2- 172.21.15.60:0/2387376741 >> v2:172.21.15.144:3300/0 conn(0x7f48e0068cb0 0x7f48e00690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 -- 172.21.15.60:0/2387376741 >> v1:172.21.15.144:6789/0 conn(0x7f48e0159e50 legacy=0x7f48e00b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.221+0000 7f48df7fe700 1 -- 172.21.15.60:0/2387376741 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00d15b0 con 0x7f48e00b11f0 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48df7fe700 1 --2- 172.21.15.60:0/2387376741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00b11f0 0x7f48e00b1660 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f48e006b810 tx=0x7f48d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bab5221aa96fee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48deffd700 1 -- 172.21.15.60:0/2387376741 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4009e70 con 0x7f48e00b11f0 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48deffd700 1 -- 172.21.15.60:0/2387376741 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d400b860 con 0x7f48e00b11f0 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48deffd700 1 -- 172.21.15.60:0/2387376741 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400bc00 con 0x7f48e00b11f0 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 -- 172.21.15.60:0/2387376741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00b11f0 msgr2=0x7f48e00b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 --2- 172.21.15.60:0/2387376741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00b11f0 0x7f48e00b1660 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f48e006b810 tx=0x7f48d4009250 comp rx=0 tx=0).stop 2023-10-08T16:10:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 -- 172.21.15.60:0/2387376741 shutdown_connections 2023-10-08T16:10:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 --2- 172.21.15.60:0/2387376741 >> v2:172.21.15.144:3300/0 conn(0x7f48e0068cb0 0x7f48e00690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 --2- 172.21.15.60:0/2387376741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e00b11f0 0x7f48e00b1660 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 -- 172.21.15.60:0/2387376741 >> 172.21.15.60:0/2387376741 conn(0x7f48e0068130 msgr2=0x7f48e00d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 -- 172.21.15.60:0/2387376741 shutdown_connections 2023-10-08T16:10:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.222+0000 7f48e690e700 1 -- 172.21.15.60:0/2387376741 wait complete. 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 Processor -- start 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 -- start start 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 0x7f48e01570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48e00b11f0 0x7f48e015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e0159e50 0x7f48e015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00cb8d0 con 0x7f48e0068cb0 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00caa20 con 0x7f48e0159e50 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.224+0000 7f48e690e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00cacc0 con 0x7f48e00b11f0 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 0x7f48e01570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 0x7f48e01570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51318/0 (socket says 172.21.15.60:51318) 2023-10-08T16:10:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 -- 172.21.15.60:0/2304298815 learned_addr learned my addr 172.21.15.60:0/2304298815 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48e4eab700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e0159e50 0x7f48e015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48df7fe700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48e00b11f0 0x7f48e015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 -- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48e00b11f0 msgr2=0x7f48e015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48e00b11f0 0x7f48e015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 -- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e0159e50 msgr2=0x7f48e015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e0159e50 0x7f48e015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 -- 172.21.15.60:0/2304298815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40094f0 con 0x7f48e0068cb0 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48e4eab700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e0159e50 0x7f48e015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48dffff700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 0x7f48e01570b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f48d000c590 tx=0x7f48d000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011590 con 0x7f48e0068cb0 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00116f0 con 0x7f48e0068cb0 2023-10-08T16:10:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00cafa0 con 0x7f48e0068cb0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011ab0 con 0x7f48e0068cb0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.225+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00cb560 con 0x7f48e0068cb0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.226+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00cbbb0 con 0x7f48e0068cb0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.227+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48d001b3b0 con 0x7f48e0068cb0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.227+0000 7f48c7fff700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.227+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f48d0083980 con 0x7f48e0068cb0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.227+0000 7f48df7fe700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.227+0000 7f48df7fe700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f48e006b810 tx=0x7f48d4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:36.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.231+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48d0050d50 con 0x7f48e0068cb0 2023-10-08T16:10:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:36.426+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48e004c3c0 con 0x7f48e0068cb0 2023-10-08T16:10:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.079+0000 7f48c7fff700 1 -- 172.21.15.60:0/2304298815 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) v1 ==== 169+0+0 (secure 0 0 0) 0x7f48d0017070 con 0x7f48e0068cb0 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.082+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48cc066f30 msgr2=0x7f48cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.082+0000 7f48e690e700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f48e006b810 tx=0x7f48d4017000 comp rx=0 tx=0).stop 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.082+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 msgr2=0x7f48e01570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.082+0000 7f48e690e700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 0x7f48e01570b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f48d000c590 tx=0x7f48d000c950 comp rx=0 tx=0).stop 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 shutdown_connections 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e0159e50 0x7f48e015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48e0068cb0 0x7f48e01570b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 --2- 172.21.15.60:0/2304298815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48e00b11f0 0x7f48e015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 >> 172.21.15.60:0/2304298815 conn(0x7f48e0068130 msgr2=0x7f48e00d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 shutdown_connections 2023-10-08T16:10:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.083+0000 7f48e690e700 1 -- 172.21.15.60:0/2304298815 wait complete. 2023-10-08T16:10:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:10:37.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:10:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.221+0000 7fd2ce078700 1 Processor -- start 2023-10-08T16:10:37.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.221+0000 7fd2ce078700 1 -- start start 2023-10-08T16:10:37.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2ce078700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2c8159ec0 0x7fd2c80af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2ce078700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2c815a290 0x7fd2c80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2ce078700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80b0790 con 0x7fd2c806a5a0 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2ce078700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80ce1f0 con 0x7fd2c815a290 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2ce078700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80b0b20 con 0x7fd2c8159ec0 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2c6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2c815a290 0x7fd2c80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2c6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2c815a290 0x7fd2c80afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51326/0 (socket says 172.21.15.60:51326) 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.222+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/2005627328 learned_addr learned my addr 172.21.15.60:0/2005627328 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c77fe700 1 --2- 172.21.15.60:0/2005627328 >> v2:172.21.15.144:3300/0 conn(0x7fd2c8159ec0 0x7fd2c80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/2005627328 >> v2:172.21.15.144:3300/0 conn(0x7fd2c8159ec0 msgr2=0x7fd2c80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c6ffd700 1 --2- 172.21.15.60:0/2005627328 >> v2:172.21.15.144:3300/0 conn(0x7fd2c8159ec0 0x7fd2c80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/2005627328 >> v1:172.21.15.144:6789/0 conn(0x7fd2c806a5a0 legacy=0x7fd2c815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/2005627328 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80b04b0 con 0x7fd2c815a290 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c6ffd700 1 --2- 172.21.15.60:0/2005627328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c815a290 0x7fd2c80afe80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80898e0 tx=0x7fd2bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80cb40413ccceb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c67fc700 1 -- 172.21.15.60:0/2005627328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc00b860 con 0x7fd2c815a290 2023-10-08T16:10:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c67fc700 1 -- 172.21.15.60:0/2005627328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc00b9c0 con 0x7fd2c815a290 2023-10-08T16:10:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.223+0000 7fd2c67fc700 1 -- 172.21.15.60:0/2005627328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc00bd60 con 0x7fd2c815a290 2023-10-08T16:10:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 -- 172.21.15.60:0/2005627328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c815a290 msgr2=0x7fd2c80afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 --2- 172.21.15.60:0/2005627328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c815a290 0x7fd2c80afe80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80898e0 tx=0x7fd2bc009250 comp rx=0 tx=0).stop 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 -- 172.21.15.60:0/2005627328 shutdown_connections 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 --2- 172.21.15.60:0/2005627328 >> v2:172.21.15.144:3300/0 conn(0x7fd2c8159ec0 0x7fd2c80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 --2- 172.21.15.60:0/2005627328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c815a290 0x7fd2c80afe80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 -- 172.21.15.60:0/2005627328 >> 172.21.15.60:0/2005627328 conn(0x7fd2c80d1880 msgr2=0x7fd2c80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 -- 172.21.15.60:0/2005627328 shutdown_connections 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.224+0000 7fd2ce078700 1 -- 172.21.15.60:0/2005627328 wait complete. 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.225+0000 7fd2ce078700 1 Processor -- start 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.225+0000 7fd2ce078700 1 -- start start 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2ce078700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c806a5a0 0x7fd2c814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2ce078700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 0x7fd2c80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2ce078700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c815a290 0x7fd2c8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2ce078700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c814f2e0 con 0x7fd2c8159ec0 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2ce078700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b4ed0 con 0x7fd2c806a5a0 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2ce078700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b51b0 con 0x7fd2c815a290 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 0x7fd2c80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 0x7fd2c80b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51342/0 (socket says 172.21.15.60:51342) 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/3861452792 learned_addr learned my addr 172.21.15.60:0/3861452792 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c77fe700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c806a5a0 0x7fd2c814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c7fff700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c815a290 0x7fd2c8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c815a290 msgr2=0x7fd2c8157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c815a290 0x7fd2c8157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c806a5a0 msgr2=0x7fd2c814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c806a5a0 0x7fd2c814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 -- 172.21.15.60:0/3861452792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0094f0 con 0x7fd2c8159ec0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c7fff700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c815a290 0x7fd2c8157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.226+0000 7fd2c6ffd700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 0x7fd2c80b4530 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8071eb0 tx=0x7fd2bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.227+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc01a450 con 0x7fd2c8159ec0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.227+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc01a5b0 con 0x7fd2c8159ec0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.227+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c80b5490 con 0x7fd2c8159ec0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.227+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc01a950 con 0x7fd2c8159ec0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.227+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c80b5a50 con 0x7fd2c8159ec0 2023-10-08T16:10:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.227+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c80b3470 con 0x7fd2c8159ec0 2023-10-08T16:10:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.228+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2bc01ad40 con 0x7fd2c8159ec0 2023-10-08T16:10:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.228+0000 7fd2af7fe700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2b4066f30 0x7fd2b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.228+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd2bc085dd0 con 0x7fd2c8159ec0 2023-10-08T16:10:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.228+0000 7fd2c77fe700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2b4066f30 0x7fd2b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.229+0000 7fd2c77fe700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2b4066f30 0x7fd2b40693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006fd0 tx=0x7fd2b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.233+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2bc053340 con 0x7fd2c8159ec0 2023-10-08T16:10:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.425+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd2c80b5c40 con 0x7fd2c8159ec0 2023-10-08T16:10:37.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.428+0000 7fd2af7fe700 1 -- 172.21.15.60:0/3861452792 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2bc056960 con 0x7fd2c8159ec0 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2b4066f30 msgr2=0x7fd2b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2b4066f30 0x7fd2b40693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006fd0 tx=0x7fd2b8008040 comp rx=0 tx=0).stop 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 msgr2=0x7fd2c80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 0x7fd2c80b4530 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8071eb0 tx=0x7fd2bc017000 comp rx=0 tx=0).stop 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 shutdown_connections 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd2b4066f30 0x7fd2b40693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c815a290 0x7fd2c8157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c806a5a0 0x7fd2c814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 --2- 172.21.15.60:0/3861452792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2c8159ec0 0x7fd2c80b4530 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 >> 172.21.15.60:0/3861452792 conn(0x7fd2c80d1880 msgr2=0x7fd2c80afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 shutdown_connections 2023-10-08T16:10:37.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.430+0000 7fd2ce078700 1 -- 172.21.15.60:0/3861452792 wait complete. 2023-10-08T16:10:37.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-08T16:10:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.561+0000 7f67898c4700 1 Processor -- start 2023-10-08T16:10:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.561+0000 7f67898c4700 1 -- start start 2023-10-08T16:10:37.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67898c4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6784159db0 0x7f67840d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67898c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f67840b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67898c4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840b5790 con 0x7f67840b1d30 2023-10-08T16:10:37.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67898c4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67840ae9b0 con 0x7f6784159db0 2023-10-08T16:10:37.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67898c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840b2170 con 0x7f6784068240 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67890c3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f67840b1d30 0x7f67840b3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36618/0 (socket says 172.21.15.60:36618) 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67890c3700 1 -- 172.21.15.60:0/3339941938 learned_addr learned my addr 172.21.15.60:0/3339941938 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f67888c2700 1 --2- 172.21.15.60:0/3339941938 >> v2:172.21.15.144:3300/0 conn(0x7f6784159db0 0x7f67840d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.562+0000 7f6783fff700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f67840b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882206356 0 0) 0x7f67840b5790 con 0x7f67840b1d30 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6770003570 con 0x7f67840b1d30 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529535904 0 0) 0x7f6770003570 con 0x7f67840b1d30 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 msgr2=0x7f67840b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f67840b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 >> v2:172.21.15.144:3300/0 conn(0x7f6784159db0 msgr2=0x7f67840d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 --2- 172.21.15.60:0/3339941938 >> v2:172.21.15.144:3300/0 conn(0x7f6784159db0 0x7f67840d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67840b59e0 con 0x7f67840b1d30 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f676c001470 con 0x7f67840b1d30 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 >> v1:172.21.15.60:6789/0 conn(0x7f67840b1d30 legacy=0x7f67840b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f6770003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770003fe0 0x7f6770004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6770004d50 0x7f67700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840ae9b0 con 0x7f6770004d50 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840b2170 con 0x7f6770003fe0 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677000ba90 con 0x7f6784068240 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67890c3700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6770004d50 0x7f67700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67888c2700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f6770003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f6783fff700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770003fe0 0x7f6770004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67890c3700 1 -- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 msgr2=0x7f6770003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67890c3700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f6770003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67890c3700 1 -- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770003fe0 msgr2=0x7f6770004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67890c3700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770003fe0 0x7f6770004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67890c3700 1 -- 172.21.15.60:0/3339941938 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770003570 con 0x7f6770004d50 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.563+0000 7f67888c2700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784068240 0x7f6770003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67890c3700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6770004d50 0x7f67700051c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c3c0 tx=0x7f67840aeaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80cfeae3a186875 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00cc30 con 0x7f6770004d50 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00cd90 con 0x7f6770004d50 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67837fe700 1 -- 172.21.15.60:0/3339941938 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c005b70 con 0x7f6770004d50 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67898c4700 1 -- 172.21.15.60:0/3339941938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6770004d50 msgr2=0x7f67700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67898c4700 1 --2- 172.21.15.60:0/3339941938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6770004d50 0x7f67700051c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c3c0 tx=0x7f67840aeaf0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67890c3700 1 -- 172.21.15.60:0/3339941938 reap_dead start 2023-10-08T16:10:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67898c4700 1 -- 172.21.15.60:0/3339941938 shutdown_connections 2023-10-08T16:10:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67898c4700 1 -- 172.21.15.60:0/3339941938 >> 172.21.15.60:0/3339941938 conn(0x7f6784067e40 msgr2=0x7f67840d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67898c4700 1 -- 172.21.15.60:0/3339941938 shutdown_connections 2023-10-08T16:10:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.564+0000 7f67898c4700 1 -- 172.21.15.60:0/3339941938 wait complete. 2023-10-08T16:10:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.565+0000 7f67898c4700 1 Processor -- start 2023-10-08T16:10:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 -- start start 2023-10-08T16:10:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784169d20 0x7f67840b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 0x7f6784152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784150be0 0x7f6784152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784150570 con 0x7f678416a0f0 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840b0cb0 con 0x7f6784169d20 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f67898c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678415e9a0 con 0x7f6784150be0 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f6783fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 0x7f6784152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f6783fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 0x7f6784152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51350/0 (socket says 172.21.15.60:51350) 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.566+0000 7f6783fff700 1 -- 172.21.15.60:0/2427410533 learned_addr learned my addr 172.21.15.60:0/2427410533 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f67888c2700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784169d20 0x7f67840b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f67890c3700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784150be0 0x7f6784152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6783fff700 1 -- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784150be0 msgr2=0x7f6784152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6783fff700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784150be0 0x7f6784152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6783fff700 1 -- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784169d20 msgr2=0x7f67840b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6783fff700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784169d20 0x7f67840b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6783fff700 1 -- 172.21.15.60:0/2427410533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784153210 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6783fff700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 0x7f6784152790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6774011f60 tx=0x7f677400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400e040 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677400f040 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67840b1780 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400fe70 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.567+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67840b0f90 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.568+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678406ace0 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.568+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6774015680 con 0x7f678416a0f0 2023-10-08T16:10:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.569+0000 7f6780ff9700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6764066f30 0x7f67640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.569+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6774084df0 con 0x7f678416a0f0 2023-10-08T16:10:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.569+0000 7f67888c2700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6764066f30 0x7f67640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.569+0000 7f67888c2700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6764066f30 0x7f67640693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f678415e600 tx=0x7f677c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.573+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6774055df0 con 0x7f678416a0f0 2023-10-08T16:10:37.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:37.849+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f67840b5cc0 con 0x7f678416a0f0 2023-10-08T16:10:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.086+0000 7f6780ff9700 1 -- 172.21.15.60:0/2427410533 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v289) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6774055980 con 0x7f678416a0f0 2023-10-08T16:10:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6764066f30 msgr2=0x7f67640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6764066f30 0x7f67640693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f678415e600 tx=0x7f677c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 msgr2=0x7f6784152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 0x7f6784152790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6774011f60 tx=0x7f677400b040 comp rx=0 tx=0).stop 2023-10-08T16:10:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 shutdown_connections 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6764066f30 0x7f67640693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6784150be0 0x7f6784152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784169d20 0x7f67840b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.088+0000 7f67898c4700 1 --2- 172.21.15.60:0/2427410533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678416a0f0 0x7f6784152790 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.089+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 >> 172.21.15.60:0/2427410533 conn(0x7f6784067e40 msgr2=0x7f678406a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.089+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 shutdown_connections 2023-10-08T16:10:38.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.089+0000 7f67898c4700 1 -- 172.21.15.60:0/2427410533 wait complete. 2023-10-08T16:10:38.102 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-08T16:10:38.102 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-08T16:10:38.103 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-08T16:10:38.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-08T16:10:38.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 Processor -- start 2023-10-08T16:10:38.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 -- start start 2023-10-08T16:10:38.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b3006d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3015a330 0x7f6b3006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b30157c30 con 0x7f6b30156940 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b301584f0 con 0x7f6b3015a330 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.223+0000 7f6b36eaa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30157670 con 0x7f6b30156570 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b2ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3015a330 0x7f6b3006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b34c46700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b3006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b35447700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6b30156940 0x7f6b30156da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:55504/0 (socket says 172.21.15.60:55504) 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b35447700 1 -- 172.21.15.60:0/1691766042 learned_addr learned my addr 172.21.15.60:0/1691766042 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b34c46700 1 -- 172.21.15.60:0/1691766042 >> v2:172.21.15.144:3300/0 conn(0x7f6b3015a330 msgr2=0x7f6b3006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:38.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b34c46700 1 --2- 172.21.15.60:0/1691766042 >> v2:172.21.15.144:3300/0 conn(0x7f6b3015a330 0x7f6b3006d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b34c46700 1 -- 172.21.15.60:0/1691766042 >> v1:172.21.15.144:6789/0 conn(0x7f6b30156940 legacy=0x7f6b30156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b34c46700 1 -- 172.21.15.60:0/1691766042 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30157950 con 0x7f6b30156570 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b2ffff700 1 --2- 172.21.15.60:0/1691766042 >> v2:172.21.15.144:3300/0 conn(0x7f6b3015a330 0x7f6b3006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.224+0000 7f6b34c46700 1 --2- 172.21.15.60:0/1691766042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b3006d380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009e60 tx=0x7f6b28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6be80ad4eecc34b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b2f7fe700 1 -- 172.21.15.60:0/1691766042 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800e070 con 0x7f6b30156570 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b2f7fe700 1 -- 172.21.15.60:0/1691766042 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800bb60 con 0x7f6b30156570 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b2f7fe700 1 -- 172.21.15.60:0/1691766042 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28012430 con 0x7f6b30156570 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 -- 172.21.15.60:0/1691766042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 msgr2=0x7f6b3006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/1691766042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b3006d380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009e60 tx=0x7f6b28009780 comp rx=0 tx=0).stop 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 -- 172.21.15.60:0/1691766042 shutdown_connections 2023-10-08T16:10:38.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/1691766042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b3006d380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/1691766042 >> v2:172.21.15.144:3300/0 conn(0x7f6b3015a330 0x7f6b3006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 -- 172.21.15.60:0/1691766042 >> 172.21.15.60:0/1691766042 conn(0x7f6b30067660 msgr2=0x7f6b30067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 -- 172.21.15.60:0/1691766042 shutdown_connections 2023-10-08T16:10:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.225+0000 7f6b36eaa700 1 -- 172.21.15.60:0/1691766042 wait complete. 2023-10-08T16:10:38.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.226+0000 7f6b36eaa700 1 Processor -- start 2023-10-08T16:10:38.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 -- start start 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b30148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30156940 0x7f6b30150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 0x7f6b300b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3014e510 con 0x7f6b3015a330 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3014d940 con 0x7f6b30156940 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b36eaa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301493b0 con 0x7f6b30156570 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b35447700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 0x7f6b300b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b35447700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 0x7f6b300b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51354/0 (socket says 172.21.15.60:51354) 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.227+0000 7f6b35447700 1 -- 172.21.15.60:0/4149727761 learned_addr learned my addr 172.21.15.60:0/4149727761 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b2ffff700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30156940 0x7f6b30150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b34c46700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b30148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b35447700 1 -- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 msgr2=0x7f6b30148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b35447700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b30148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b35447700 1 -- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30156940 msgr2=0x7f6b30150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b35447700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30156940 0x7f6b30150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b35447700 1 -- 172.21.15.60:0/4149727761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2400a5d0 con 0x7f6b3015a330 2023-10-08T16:10:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b2ffff700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30156940 0x7f6b30150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b34c46700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b30148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b35447700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 0x7f6b300b1a60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000c560 tx=0x7f6b20007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20005b30 con 0x7f6b3015a330 2023-10-08T16:10:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b20005c90 con 0x7f6b3015a330 2023-10-08T16:10:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b28009a20 con 0x7f6b3015a330 2023-10-08T16:10:38.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200072e0 con 0x7f6b3015a330 2023-10-08T16:10:38.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.228+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3014dec0 con 0x7f6b3015a330 2023-10-08T16:10:38.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.229+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3004c3c0 con 0x7f6b3015a330 2023-10-08T16:10:38.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.230+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b20007690 con 0x7f6b3015a330 2023-10-08T16:10:38.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.230+0000 7f6b2cff9700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b1c066f30 0x7f6b1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.230+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6b20083500 con 0x7f6b3015a330 2023-10-08T16:10:38.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.230+0000 7f6b34c46700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b1c066f30 0x7f6b1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.230+0000 7f6b34c46700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b1c066f30 0x7f6b1c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6b3014f4c0 tx=0x7f6b28019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:38.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.234+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b2004b5a0 con 0x7f6b3015a330 2023-10-08T16:10:38.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:38.509+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f6b300ca130 con 0x7f6b3015a330 2023-10-08T16:10:39.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.088+0000 7f6b2cff9700 1 -- 172.21.15.60:0/4149727761 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v290) v1 ==== 131+0+0 (secure 0 0 0) 0x7f6b200170c0 con 0x7f6b3015a330 2023-10-08T16:10:39.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b1c066f30 msgr2=0x7f6b1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b1c066f30 0x7f6b1c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6b3014f4c0 tx=0x7f6b28019000 comp rx=0 tx=0).stop 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 msgr2=0x7f6b300b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 0x7f6b300b1a60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000c560 tx=0x7f6b20007f60 comp rx=0 tx=0).stop 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 shutdown_connections 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b1c066f30 0x7f6b1c0693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b30156570 0x7f6b30148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b3015a330 0x7f6b300b1a60 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 --2- 172.21.15.60:0/4149727761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30156940 0x7f6b30150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 >> 172.21.15.60:0/4149727761 conn(0x7f6b30067660 msgr2=0x7f6b300cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 shutdown_connections 2023-10-08T16:10:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.090+0000 7f6b36eaa700 1 -- 172.21.15.60:0/4149727761 wait complete. 2023-10-08T16:10:39.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:10:39.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.230+0000 7f4e16b24700 1 Processor -- start 2023-10-08T16:10:39.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.230+0000 7f4e16b24700 1 -- start start 2023-10-08T16:10:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e16b24700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e100b6580 0x7f4e1006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e16b24700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1006ac90 con 0x7f4e1006a830 2023-10-08T16:10:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e16b24700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e100b4d70 con 0x7f4e100cce30 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e16b24700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1015b3b0 con 0x7f4e100b6580 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e16323700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e1006a830 0x7f4e100b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36632/0 (socket says 172.21.15.60:36632) 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e16323700 1 -- 172.21.15.60:0/1780527477 learned_addr learned my addr 172.21.15.60:0/1780527477 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e15321700 1 --2- 172.21.15.60:0/1780527477 >> v2:172.21.15.144:3300/0 conn(0x7f4e100b6580 0x7f4e1006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540089107 0 0) 0x7f4e00001490 con 0x7f4e1006a830 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.231+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df8003570 con 0x7f4e1006a830 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222163159 0 0) 0x7f4df8003570 con 0x7f4e1006a830 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 >> v2:172.21.15.144:3300/0 conn(0x7f4e100b6580 msgr2=0x7f4e1006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 --2- 172.21.15.60:0/1780527477 >> v2:172.21.15.144:3300/0 conn(0x7f4e100b6580 0x7f4e1006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 >> v1:172.21.15.144:6789/0 conn(0x7f4e100cce30 legacy=0x7f4e1015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100cd8d0 con 0x7f4e1006a830 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f4e00001980 con 0x7f4e1006a830 2023-10-08T16:10:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15321700 1 --2- 172.21.15.60:0/1780527477 >> v2:172.21.15.144:3300/0 conn(0x7f4e100b6580 0x7f4e1006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 >> v1:172.21.15.60:6789/0 conn(0x7f4e1006a830 legacy=0x7f4e100b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4df8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df8004810 0x7f4df8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80051c0 0x7f4df800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015b3b0 con 0x7f4df8003a60 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df800c160 con 0x7f4df80051c0 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df800c320 con 0x7f4df8004810 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4df8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e16323700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80051c0 0x7f4df800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15321700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df8004810 0x7f4df8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 -- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df8004810 msgr2=0x7f4df8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df8004810 0x7f4df8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 -- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80051c0 msgr2=0x7f4df800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80051c0 0x7f4df800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 -- 172.21.15.60:0/1780527477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8003570 con 0x7f4df8003a60 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e16323700 1 -- 172.21.15.60:0/1780527477 reap_dead start 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15321700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df8004810 0x7f4df8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e15b22700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4df8003e70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e080018b0 tx=0x7f4e08007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ec49615ddad85f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012420 con 0x7f4df8003a60 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080125a0 con 0x7f4df8003a60 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.232+0000 7f4e14b20700 1 -- 172.21.15.60:0/1780527477 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012960 con 0x7f4df8003a60 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 -- 172.21.15.60:0/1780527477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 msgr2=0x7f4df8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4df8003e70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e080018b0 tx=0x7f4e08007d30 comp rx=0 tx=0).stop 2023-10-08T16:10:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 -- 172.21.15.60:0/1780527477 shutdown_connections 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 --2- 172.21.15.60:0/1780527477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4df8003e70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 -- 172.21.15.60:0/1780527477 >> 172.21.15.60:0/1780527477 conn(0x7f4e10068cb0 msgr2=0x7f4e100690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 -- 172.21.15.60:0/1780527477 shutdown_connections 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.233+0000 7f4e16b24700 1 -- 172.21.15.60:0/1780527477 wait complete. 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.234+0000 7f4e16b24700 1 Processor -- start 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.234+0000 7f4e16b24700 1 -- start start 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16b24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4e101554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16b24700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1014fca0 0x7f4e100b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16b24700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e100b24d0 0x7f4e10153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16b24700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b2cc0 con 0x7f4df8003a60 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16b24700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10150110 con 0x7f4e100b24d0 2023-10-08T16:10:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16b24700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b29e0 con 0x7f4e1014fca0 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4e101554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4e101554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51370/0 (socket says 172.21.15.60:51370) 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 -- 172.21.15.60:0/863423038 learned_addr learned my addr 172.21.15.60:0/863423038 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15321700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1014fca0 0x7f4e100b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16323700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e100b24d0 0x7f4e10153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 -- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1014fca0 msgr2=0x7f4e100b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1014fca0 0x7f4e100b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 -- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e100b24d0 msgr2=0x7f4e10153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e100b24d0 0x7f4e10153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15b22700 1 -- 172.21.15.60:0/863423038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e101549c0 con 0x7f4df8003a60 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e16323700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e100b24d0 0x7f4e10153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.235+0000 7f4e15321700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1014fca0 0x7f4e100b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.236+0000 7f4e15b22700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4e101554a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c3f0 tx=0x7f4e08015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.236+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800c800 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.236+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0800c960 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.236+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e10154ca0 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.236+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800cd00 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.236+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100cc5f0 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.237+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e101552f0 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.237+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e0801f620 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.238+0000 7f4e0dffb700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.238+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4e080859c0 con 0x7f4df8003a60 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.238+0000 7f4e15321700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.238+0000 7f4e15321700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dfc066f30 0x7f4dfc0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e04006d80 tx=0x7f4e04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.242+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e08052f30 con 0x7f4df8003a60 2023-10-08T16:10:39.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.438+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4e100b2cc0 con 0x7f4df8003a60 2023-10-08T16:10:39.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.442+0000 7f4e0dffb700 1 -- 172.21.15.60:0/863423038 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4e080230c0 con 0x7f4df8003a60 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dfc066f30 msgr2=0x7f4dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dfc066f30 0x7f4dfc0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e04006d80 tx=0x7f4e04008040 comp rx=0 tx=0).stop 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 msgr2=0x7f4e101554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4e101554a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c3f0 tx=0x7f4e08015000 comp rx=0 tx=0).stop 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 shutdown_connections 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e100b24d0 0x7f4e10153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df8003a60 0x7f4e101554a0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 --2- 172.21.15.60:0/863423038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e1014fca0 0x7f4e100b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 >> 172.21.15.60:0/863423038 conn(0x7f4e10068cb0 msgr2=0x7f4e10069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 shutdown_connections 2023-10-08T16:10:39.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.444+0000 7f4e16b24700 1 -- 172.21.15.60:0/863423038 wait complete. 2023-10-08T16:10:39.458 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:10:39.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:39.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:39.539 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:10:39.539 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:10:39.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 Processor -- start 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 -- start start 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1577d0 0x7f71bc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71bc157ba0 0x7f71bc06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc15c360 con 0x7f71bc15b0d0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc15b790 con 0x7f71bc157ba0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.657+0000 7f71c15cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc15d800 con 0x7f71bc1577d0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71bc157ba0 0x7f71bc06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71bb7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f71bc15b0d0 0x7f71bc15da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36634/0 (socket says 172.21.15.60:36634) 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71bc157ba0 0x7f71bc06a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51376/0 (socket says 172.21.15.60:51376) 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71bb7fe700 1 -- 172.21.15.60:0/3175363285 learned_addr learned my addr 172.21.15.60:0/3175363285 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 -- 172.21.15.60:0/3175363285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1577d0 msgr2=0x7f71bc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71baffd700 1 --2- 172.21.15.60:0/3175363285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1577d0 0x7f71bc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71b9ffb700 1 -- 172.21.15.60:0/3175363285 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656473166 0 0) 0x7f71bc15c360 con 0x7f71bc15b0d0 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 --2- 172.21.15.60:0/3175363285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1577d0 0x7f71bc0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 -- 172.21.15.60:0/3175363285 >> v1:172.21.15.60:6789/0 conn(0x7f71bc15b0d0 legacy=0x7f71bc15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 -- 172.21.15.60:0/3175363285 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc15ba30 con 0x7f71bc157ba0 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71ba7fc700 1 --2- 172.21.15.60:0/3175363285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc06a520 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f71a40098e0 tx=0x7f71a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d35f3fd8da6243 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71b9ffb700 1 -- 172.21.15.60:0/3175363285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4009e80 con 0x7f71bc157ba0 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71b9ffb700 1 -- 172.21.15.60:0/3175363285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400b860 con 0x7f71bc157ba0 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.658+0000 7f71b9ffb700 1 -- 172.21.15.60:0/3175363285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400bbe0 con 0x7f71bc157ba0 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 -- 172.21.15.60:0/3175363285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 msgr2=0x7f71bc06a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 --2- 172.21.15.60:0/3175363285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc06a520 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f71a40098e0 tx=0x7f71a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 -- 172.21.15.60:0/3175363285 shutdown_connections 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 --2- 172.21.15.60:0/3175363285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc1577d0 0x7f71bc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 --2- 172.21.15.60:0/3175363285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc06a520 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 -- 172.21.15.60:0/3175363285 >> 172.21.15.60:0/3175363285 conn(0x7f71bc068ce0 msgr2=0x7f71bc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 -- 172.21.15.60:0/3175363285 shutdown_connections 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.659+0000 7f71c15cd700 1 -- 172.21.15.60:0/3175363285 wait complete. 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.660+0000 7f71c15cd700 1 Processor -- start 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.660+0000 7f71c15cd700 1 -- start start 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71c15cd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc1577d0 0x7f71bc151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71c15cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71c15cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc15b0d0 0x7f71bc0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71c15cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc16b750 con 0x7f71bc157ba0 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71c15cd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc152a80 con 0x7f71bc1577d0 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71c15cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1524e0 con 0x7f71bc15b0d0 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc0b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51388/0 (socket says 172.21.15.60:51388) 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 -- 172.21.15.60:0/1009810400 learned_addr learned my addr 172.21.15.60:0/1009810400 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71baffd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc1577d0 0x7f71bc151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71bb7fe700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc15b0d0 0x7f71bc0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 -- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc15b0d0 msgr2=0x7f71bc0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc15b0d0 0x7f71bc0d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 -- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc1577d0 msgr2=0x7f71bc151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc1577d0 0x7f71bc151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 -- 172.21.15.60:0/1009810400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009420 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71baffd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc1577d0 0x7f71bc151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.661+0000 7f71ba7fc700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc0b05c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f71bc06b580 tx=0x7f71a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.662+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400bbe0 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.662+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4011420 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.662+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc16abd0 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.662+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40117c0 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.662+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc16b190 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.663+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc04c3c0 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.663+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71a4011bb0 con 0x7f71bc157ba0 2023-10-08T16:10:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.663+0000 7f71b2ffd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f719c066f30 0x7f719c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.663+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f71a4085a70 con 0x7f71bc157ba0 2023-10-08T16:10:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.663+0000 7f71baffd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f719c066f30 0x7f719c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.664+0000 7f71baffd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f719c066f30 0x7f719c0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0b1a90 tx=0x7f71b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.668+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71a4052fe0 con 0x7f71bc157ba0 2023-10-08T16:10:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.904+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71bc15bda0 con 0x7f71bc157ba0 2023-10-08T16:10:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.905+0000 7f71b2ffd700 1 -- 172.21.15.60:0/1009810400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f71a4015de0 con 0x7f71bc157ba0 2023-10-08T16:10:39.909 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:39.909 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/310856636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":310856636},{"type":"v1","addr":"172.21.15.144:6835","nonce":310856636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1383290214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1383290214},{"type":"v1","addr":"172.21.15.60:6837","nonce":1383290214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5986,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2706569782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2706569782},{"type":"v1","addr":"172.21.15.144:6834","nonce":2706569782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3360508491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3360508491},{"type":"v1","addr":"172.21.15.60:6836","nonce":3360508491}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-10-08T16:10:39.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f719c066f30 msgr2=0x7f719c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f719c066f30 0x7f719c0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0b1a90 tx=0x7f71b4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:39.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 msgr2=0x7f71bc0b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc0b05c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f71bc06b580 tx=0x7f71a4017000 comp rx=0 tx=0).stop 2023-10-08T16:10:39.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 shutdown_connections 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f719c066f30 0x7f719c0693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71bc15b0d0 0x7f71bc0d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71bc1577d0 0x7f71bc151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 --2- 172.21.15.60:0/1009810400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc157ba0 0x7f71bc0b05c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 >> 172.21.15.60:0/1009810400 conn(0x7f71bc068ce0 msgr2=0x7f71bc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 shutdown_connections 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:39.907+0000 7f71c15cd700 1 -- 172.21.15.60:0/1009810400 wait complete. 2023-10-08T16:10:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 54 2023-10-08T16:10:39.920 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:10:39.921 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:10:39.921 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:10:39.921 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:39.921 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:10:39.921 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:10:39.921 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:10:39.922 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:39.922 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:10:39.922 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:10:39.922 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:10:39.922 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:39.922 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:10:39.923 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:10:39.923 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:10:39.923 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:39.930 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:10:39.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:10:39.931 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:10:39.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:10:39.934 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:10:39.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:10:39.935 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:10:39.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:10:39.972 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:10:39.973 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:39.973 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:10:39.973 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:39.976 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:10:39.977 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:39.977 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:10:39.977 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:39.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:10:40.048 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:10:40.048 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:10:40.059 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:10:40.059 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:10:40.059 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-10-08T16:10:40.058+0000 7f16c51e4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T16:10:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.102+0000 7fd226b71700 1 Processor -- start 2023-10-08T16:10:40.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.102+0000 7fd226b71700 1 -- start start 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd226b71700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2200b0890 0x7fd2200cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd226b71700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd220067d70 0x7fd220159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd226b71700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200cb370 con 0x7fd2200cbd40 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd226b71700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200b0c60 con 0x7fd220067d70 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd226b71700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22006a1e0 con 0x7fd2200b0890 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd220067d70 0x7fd220159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd220067d70 0x7fd220159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51426/0 (socket says 172.21.15.60:51426) 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 -- 172.21.15.60:0/2238086720 learned_addr learned my addr 172.21.15.60:0/2238086720 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22490d700 1 --2- 172.21.15.60:0/2238086720 >> v2:172.21.15.144:3300/0 conn(0x7fd2200b0890 0x7fd2200cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 -- 172.21.15.60:0/2238086720 >> v2:172.21.15.144:3300/0 conn(0x7fd2200b0890 msgr2=0x7fd2200cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 --2- 172.21.15.60:0/2238086720 >> v2:172.21.15.144:3300/0 conn(0x7fd2200b0890 0x7fd2200cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 -- 172.21.15.60:0/2238086720 >> v1:172.21.15.144:6789/0 conn(0x7fd2200cbd40 legacy=0x7fd220067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.103+0000 7fd22510e700 1 -- 172.21.15.60:0/2238086720 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22006cb80 con 0x7fd220067d70 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd22510e700 1 --2- 172.21.15.60:0/2238086720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd220067d70 0x7fd220159790 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd22006aae0 tx=0x7fd218009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc99cb86f79e5ccb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd21f7fe700 1 -- 172.21.15.60:0/2238086720 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21800e070 con 0x7fd220067d70 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd21f7fe700 1 -- 172.21.15.60:0/2238086720 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800ba50 con 0x7fd220067d70 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd21f7fe700 1 -- 172.21.15.60:0/2238086720 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2180092e0 con 0x7fd220067d70 2023-10-08T16:10:40.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 -- 172.21.15.60:0/2238086720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd220067d70 msgr2=0x7fd220159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 --2- 172.21.15.60:0/2238086720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd220067d70 0x7fd220159790 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd22006aae0 tx=0x7fd218009840 comp rx=0 tx=0).stop 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 -- 172.21.15.60:0/2238086720 shutdown_connections 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 --2- 172.21.15.60:0/2238086720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd220067d70 0x7fd220159790 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 --2- 172.21.15.60:0/2238086720 >> v2:172.21.15.144:3300/0 conn(0x7fd2200b0890 0x7fd2200cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 -- 172.21.15.60:0/2238086720 >> 172.21.15.60:0/2238086720 conn(0x7fd22006fe50 msgr2=0x7fd220069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.104+0000 7fd226b71700 1 -- 172.21.15.60:0/2238086720 shutdown_connections 2023-10-08T16:10:40.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.105+0000 7fd226b71700 1 -- 172.21.15.60:0/2238086720 wait complete. 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.106+0000 7fd226b71700 1 Processor -- start 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.106+0000 7fd226b71700 1 -- start start 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.106+0000 7fd226b71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220067d70 0x7fd2200c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2200b0890 0x7fd2200ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 0x7fd220159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200c3310 con 0x7fd2200cbd40 2023-10-08T16:10:40.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200c2700 con 0x7fd220067d70 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200c29e0 con 0x7fd2200b0890 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 0x7fd220159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 0x7fd220159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51436/0 (socket says 172.21.15.60:51436) 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 -- 172.21.15.60:0/1786588893 learned_addr learned my addr 172.21.15.60:0/1786588893 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22490d700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220067d70 0x7fd2200c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd21ffff700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2200b0890 0x7fd2200ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 -- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2200b0890 msgr2=0x7fd2200ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2200b0890 0x7fd2200ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 -- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220067d70 msgr2=0x7fd2200c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220067d70 0x7fd2200c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 -- 172.21.15.60:0/1786588893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218009ae0 con 0x7fd2200cbd40 2023-10-08T16:10:40.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd22510e700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 0x7fd220159cf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd22006ab60 tx=0x7fd218018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218008e80 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800be60 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200c2cc0 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21801c640 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.107+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200cd1e0 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.108+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2200cd400 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.109+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd218003040 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.109+0000 7fd21cff9700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.109+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd218085b60 con 0x7fd2200cbd40 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.109+0000 7fd22490d700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.110+0000 7fd22490d700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd204066f30 0x7fd2040693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd214006fd0 tx=0x7fd214008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.114+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2180530d0 con 0x7fd2200cbd40 2023-10-08T16:10:40.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:40.324+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd22004c3c0 con 0x7fd2200cbd40 2023-10-08T16:10:41.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.100+0000 7fd21cff9700 1 -- 172.21.15.60:0/1786588893 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v113) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd218009940 con 0x7fd2200cbd40 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd204066f30 msgr2=0x7fd2040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd204066f30 0x7fd2040693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd214006fd0 tx=0x7fd214008040 comp rx=0 tx=0).stop 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 msgr2=0x7fd220159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 0x7fd220159cf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd22006ab60 tx=0x7fd218018000 comp rx=0 tx=0).stop 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 shutdown_connections 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2200cbd40 0x7fd220159cf0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220067d70 0x7fd2200c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 --2- 172.21.15.60:0/1786588893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2200b0890 0x7fd2200ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.102+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 >> 172.21.15.60:0/1786588893 conn(0x7fd22006fe50 msgr2=0x7fd2200cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.103+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 shutdown_connections 2023-10-08T16:10:41.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.103+0000 7fd226b71700 1 -- 172.21.15.60:0/1786588893 wait complete. 2023-10-08T16:10:41.105 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:10:41.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:10:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.238+0000 7f228b944700 1 Processor -- start 2023-10-08T16:10:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f228b944700 1 -- start start 2023-10-08T16:10:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f228b944700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2284159e10 0x7f22840b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f228b944700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22840cde50 0x7f22840b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f228b944700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228415db80 con 0x7f228415a1e0 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f228b944700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228415e800 con 0x7f2284159e10 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f228b944700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228415de60 con 0x7f22840cde50 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f22896e0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2284159e10 0x7f22840b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.239+0000 7f2288edf700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f228415a1e0 0x7f22840cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36650/0 (socket says 172.21.15.60:36650) 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f2288edf700 1 -- 172.21.15.60:0/2636823377 learned_addr learned my addr 172.21.15.60:0/2636823377 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f22896e0700 1 -- 172.21.15.60:0/2636823377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22840cde50 msgr2=0x7f22840b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f2289ee1700 1 --2- 172.21.15.60:0/2636823377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22840cde50 0x7f22840b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f22896e0700 1 --2- 172.21.15.60:0/2636823377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22840cde50 0x7f22840b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f22896e0700 1 -- 172.21.15.60:0/2636823377 >> v1:172.21.15.60:6789/0 conn(0x7f228415a1e0 legacy=0x7f22840cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f2283fff700 1 -- 172.21.15.60:0/2636823377 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013432111 0 0) 0x7f228415db80 con 0x7f228415a1e0 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f22896e0700 1 -- 172.21.15.60:0/2636823377 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228415e140 con 0x7f2284159e10 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f22896e0700 1 --2- 172.21.15.60:0/2636823377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840b2d20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f22740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a8b31d146c4a63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f2283fff700 1 -- 172.21.15.60:0/2636823377 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274009e80 con 0x7f2284159e10 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f2283fff700 1 -- 172.21.15.60:0/2636823377 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400b860 con 0x7f2284159e10 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.240+0000 7f2283fff700 1 -- 172.21.15.60:0/2636823377 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400bbe0 con 0x7f2284159e10 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 -- 172.21.15.60:0/2636823377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 msgr2=0x7f22840b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 --2- 172.21.15.60:0/2636823377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840b2d20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f22740091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 -- 172.21.15.60:0/2636823377 shutdown_connections 2023-10-08T16:10:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 --2- 172.21.15.60:0/2636823377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22840cde50 0x7f22840b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 --2- 172.21.15.60:0/2636823377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840b2d20 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 -- 172.21.15.60:0/2636823377 >> 172.21.15.60:0/2636823377 conn(0x7f2284067660 msgr2=0x7f2284067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 -- 172.21.15.60:0/2636823377 shutdown_connections 2023-10-08T16:10:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.241+0000 7f228b944700 1 -- 172.21.15.60:0/2636823377 wait complete. 2023-10-08T16:10:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.242+0000 7f228b944700 1 Processor -- start 2023-10-08T16:10:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.242+0000 7f228b944700 1 -- start start 2023-10-08T16:10:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f228b944700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22840cde50 0x7f22840c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f228b944700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f228b944700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f228415a1e0 0x7f22840c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f228b944700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840cf500 con 0x7f2284159e10 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f228b944700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840cf6e0 con 0x7f22840cde50 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f228b944700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840cf9c0 con 0x7f228415a1e0 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51460/0 (socket says 172.21.15.60:51460) 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 -- 172.21.15.60:0/129371532 learned_addr learned my addr 172.21.15.60:0/129371532 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f22896e0700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22840cde50 0x7f22840c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2289ee1700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f228415a1e0 0x7f22840c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 -- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f228415a1e0 msgr2=0x7f22840c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f228415a1e0 0x7f22840c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 -- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22840cde50 msgr2=0x7f22840c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22840cde50 0x7f22840c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 -- 172.21.15.60:0/129371532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009420 con 0x7f2284159e10 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.243+0000 7f2288edf700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840c4d50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f227800c5e0 tx=0x7f2278000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.244+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278005b30 con 0x7f2284159e10 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.244+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278005c90 con 0x7f2284159e10 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.244+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22840cfca0 con 0x7f2284159e10 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.244+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278007300 con 0x7f2284159e10 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.244+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2284159750 con 0x7f2284159e10 2023-10-08T16:10:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.244+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22840d02d0 con 0x7f2284159e10 2023-10-08T16:10:41.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.245+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f227801b3b0 con 0x7f2284159e10 2023-10-08T16:10:41.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.245+0000 7f22817fa700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2270066f30 0x7f22700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.246+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f22780835e0 con 0x7f2284159e10 2023-10-08T16:10:41.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.246+0000 7f22896e0700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2270066f30 0x7f22700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.246+0000 7f22896e0700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2270066f30 0x7f22700693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f22740091e0 tx=0x7f2274017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.250+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2278050ba0 con 0x7f2284159e10 2023-10-08T16:10:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.522+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f228404c3c0 con 0x7f2284159e10 2023-10-08T16:10:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.523+0000 7f22817fa700 1 -- 172.21.15.60:0/129371532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f22780541c0 con 0x7f2284159e10 2023-10-08T16:10:41.524 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:10:41.525 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:10:41.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:10:41.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:10:41.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.532 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:10:41.533 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:10:41.534 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:10:41.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:10:41.537 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:10:41.538 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:10:41.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:41.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:10:41.543 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:41.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2270066f30 msgr2=0x7f22700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2270066f30 0x7f22700693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f22740091e0 tx=0x7f2274017000 comp rx=0 tx=0).stop 2023-10-08T16:10:41.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 msgr2=0x7f22840c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840c4d50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f227800c5e0 tx=0x7f2278000fe0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 shutdown_connections 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2270066f30 0x7f22700693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f228415a1e0 0x7f22840c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22840cde50 0x7f22840c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 --2- 172.21.15.60:0/129371532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2284159e10 0x7f22840c4d50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 >> 172.21.15.60:0/129371532 conn(0x7f2284067660 msgr2=0x7f22840b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 shutdown_connections 2023-10-08T16:10:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.525+0000 7f228b944700 1 -- 172.21.15.60:0/129371532 wait complete. 2023-10-08T16:10:41.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.664+0000 7ff8bf551700 1 Processor -- start 2023-10-08T16:10:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.664+0000 7ff8bf551700 1 -- start start 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bf551700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 0x7ff8b80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bf551700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8b80d1c30 0x7ff8b80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bf551700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80c5d80 con 0x7ff8b815a680 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bf551700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b8068470 con 0x7ff8b80d1c30 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bf551700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80c6060 con 0x7ff8b815a2b0 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bdaee700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff8b815a680 0x7ff8b80c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36654/0 (socket says 172.21.15.60:36654) 2023-10-08T16:10:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bdaee700 1 -- 172.21.15.60:0/3038519879 learned_addr learned my addr 172.21.15.60:0/3038519879 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bcaec700 1 --2- 172.21.15.60:0/3038519879 >> v2:172.21.15.144:3300/0 conn(0x7ff8b80d1c30 0x7ff8b80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.665+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 0x7ff8b80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537163584 0 0) 0x7ff8b80c5d80 con 0x7ff8b815a680 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a0003570 con 0x7ff8b815a680 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2548144604 0 0) 0x7ff8a0003570 con 0x7ff8b815a680 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 msgr2=0x7ff8b80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 0x7ff8b80b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 >> v2:172.21.15.144:3300/0 conn(0x7ff8b80d1c30 msgr2=0x7ff8b80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 --2- 172.21.15.60:0/3038519879 >> v2:172.21.15.144:3300/0 conn(0x7ff8b80d1c30 0x7ff8b80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80c6340 con 0x7ff8b815a680 2023-10-08T16:10:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7ff8a80017f0 con 0x7ff8b815a680 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 >> v1:172.21.15.60:6789/0 conn(0x7ff8b815a680 legacy=0x7ff8b80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0004810 0x7ff8a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 0x7ff8a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8068470 con 0x7ff8a0003a60 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80c6060 con 0x7ff8a0004810 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a000ba60 con 0x7ff8b815a2b0 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bcaec700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0004810 0x7ff8a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bdaee700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 0x7ff8a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 msgr2=0x7ff8a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815a2b0 0x7ff8a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0004810 msgr2=0x7ff8a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a0004810 0x7ff8a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/3038519879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0003570 con 0x7ff8a0003a60 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.666+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8a0003e70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009c20 tx=0x7ff8b0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15bdf1dc7bd9bca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0005a00 con 0x7ff8a0003a60 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0005b60 con 0x7ff8a0003a60 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8b7fff700 1 -- 172.21.15.60:0/3038519879 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000e710 con 0x7ff8a0003a60 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bf551700 1 -- 172.21.15.60:0/3038519879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 msgr2=0x7ff8a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bf551700 1 --2- 172.21.15.60:0/3038519879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8a0003e70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009c20 tx=0x7ff8b0009120 comp rx=0 tx=0).stop 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bdaee700 1 -- 172.21.15.60:0/3038519879 reap_dead start 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bf551700 1 -- 172.21.15.60:0/3038519879 shutdown_connections 2023-10-08T16:10:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bf551700 1 -- 172.21.15.60:0/3038519879 >> 172.21.15.60:0/3038519879 conn(0x7ff8b8067e40 msgr2=0x7ff8b80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bf551700 1 -- 172.21.15.60:0/3038519879 shutdown_connections 2023-10-08T16:10:41.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.667+0000 7ff8bf551700 1 -- 172.21.15.60:0/3038519879 wait complete. 2023-10-08T16:10:41.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.668+0000 7ff8bf551700 1 Processor -- start 2023-10-08T16:10:41.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.668+0000 7ff8bf551700 1 -- start start 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bf551700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8b816cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bf551700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b816b010 0x7ff8b815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bf551700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815d5e0 0x7ff8b8169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bf551700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8147320 con 0x7ff8a0003a60 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bf551700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80c8ca0 con 0x7ff8b816b010 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bf551700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b815dbb0 con 0x7ff8b815d5e0 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bd2ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8b816cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bd2ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8b816cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51480/0 (socket says 172.21.15.60:51480) 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/2315252000 learned_addr learned my addr 172.21.15.60:0/2315252000 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bcaec700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b816b010 0x7ff8b815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.669+0000 7ff8bdaee700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815d5e0 0x7ff8b8169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815d5e0 msgr2=0x7ff8b8169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815d5e0 0x7ff8b8169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b816b010 msgr2=0x7ff8b815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b816b010 0x7ff8b815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bd2ed700 1 -- 172.21.15.60:0/2315252000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80c8650 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bd2ed700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8b816cbb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00046d0 tx=0x7ff8b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0006310 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b00064d0 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b80c8930 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0006890 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.670+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b816ac00 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.671+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b804c3c0 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.671+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8b0013680 con 0x7ff8a0003a60 2023-10-08T16:10:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.672+0000 7ff8b57fa700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff8a4066f30 0x7ff8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.672+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff8b0085940 con 0x7ff8a0003a60 2023-10-08T16:10:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.672+0000 7ff8bcaec700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff8a4066f30 0x7ff8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.672+0000 7ff8bcaec700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff8a4066f30 0x7ff8a40693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006dc0 tx=0x7ff8ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.676+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8b0052fb0 con 0x7ff8a0003a60 2023-10-08T16:10:41.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.868+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8b8147320 con 0x7ff8a0003a60 2023-10-08T16:10:41.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.869+0000 7ff8b57fa700 1 -- 172.21.15.60:0/2315252000 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+12137 (secure 0 0 0) 0x7ff8b002b090 con 0x7ff8a0003a60 2023-10-08T16:10:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:41.870 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":113,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:41.099154+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:41.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff8a4066f30 msgr2=0x7ff8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff8a4066f30 0x7ff8a40693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006dc0 tx=0x7ff8ac008040 comp rx=0 tx=0).stop 2023-10-08T16:10:41.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 msgr2=0x7ff8b816cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8b816cbb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00046d0 tx=0x7ff8b0019000 comp rx=0 tx=0).stop 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 shutdown_connections 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff8a4066f30 0x7ff8a40693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b815d5e0 0x7ff8b8169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8a0003a60 0x7ff8b816cbb0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 --2- 172.21.15.60:0/2315252000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b816b010 0x7ff8b815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 >> 172.21.15.60:0/2315252000 conn(0x7ff8b8067e40 msgr2=0x7ff8b81586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 shutdown_connections 2023-10-08T16:10:41.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:41.871+0000 7ff8bf551700 1 -- 172.21.15.60:0/2315252000 wait complete. 2023-10-08T16:10:41.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:10:41.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:10:42.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.005+0000 7f0c30f25700 1 Processor -- start 2023-10-08T16:10:42.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.005+0000 7f0c30f25700 1 -- start start 2023-10-08T16:10:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.006+0000 7f0c30f25700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c159e60 0x7f0c2c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.006+0000 7f0c30f25700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c15ea90 con 0x7f0c2c15a230 2023-10-08T16:10:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.006+0000 7f0c30f25700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c0b3100 con 0x7f0c2c0697c0 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.006+0000 7f0c30f25700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0d1cf0 con 0x7f0c2c159e60 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.006+0000 7f0c29d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0c2c15a230 0x7f0c2c0690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36660/0 (socket says 172.21.15.60:36660) 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.006+0000 7f0c29d9b700 1 -- 172.21.15.60:0/1959060075 learned_addr learned my addr 172.21.15.60:0/1959060075 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2a59c700 1 --2- 172.21.15.60:0/1959060075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c159e60 0x7f0c2c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758197537 0 0) 0x7f0c2c15ea90 con 0x7f0c2c15a230 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c18003570 con 0x7f0c2c15a230 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822271215 0 0) 0x7f0c2c0b3100 con 0x7f0c2c0697c0 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c15ea90 con 0x7f0c2c0697c0 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 951272109 0 0) 0x7f0c18003570 con 0x7f0c2c15a230 2023-10-08T16:10:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2a59c700 1 -- 172.21.15.60:0/1959060075 >> v1:172.21.15.144:6789/0 conn(0x7f0c2c0697c0 legacy=0x7f0c2c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2a59c700 1 -- 172.21.15.60:0/1959060075 >> v1:172.21.15.60:6789/0 conn(0x7f0c2c15a230 legacy=0x7f0c2c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2a59c700 1 -- 172.21.15.60:0/1959060075 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c0d10e0 con 0x7f0c2c159e60 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2a59c700 1 --2- 172.21.15.60:0/1959060075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c159e60 0x7f0c2c15e550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009910 tx=0x7f0c1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03cc5bfeac4d968 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14001470 con 0x7f0c2c159e60 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c011420 con 0x7f0c2c159e60 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.007+0000 7f0c2959a700 1 -- 172.21.15.60:0/1959060075 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0117c0 con 0x7f0c2c159e60 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 -- 172.21.15.60:0/1959060075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c159e60 msgr2=0x7f0c2c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 --2- 172.21.15.60:0/1959060075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c159e60 0x7f0c2c15e550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009910 tx=0x7f0c1c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 -- 172.21.15.60:0/1959060075 shutdown_connections 2023-10-08T16:10:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 --2- 172.21.15.60:0/1959060075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c159e60 0x7f0c2c15e550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 -- 172.21.15.60:0/1959060075 >> 172.21.15.60:0/1959060075 conn(0x7f0c2c070700 msgr2=0x7f0c2c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 -- 172.21.15.60:0/1959060075 shutdown_connections 2023-10-08T16:10:42.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.008+0000 7f0c30f25700 1 -- 172.21.15.60:0/1959060075 wait complete. 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.009+0000 7f0c30f25700 1 Processor -- start 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.009+0000 7f0c30f25700 1 -- start start 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c30f25700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 0x7f0c2c15b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c30f25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c2c159e60 0x7f0c2c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c30f25700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c15a230 0x7f0c2c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c30f25700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c16d680 con 0x7f0c2c0697c0 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c30f25700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c16a580 con 0x7f0c2c159e60 2023-10-08T16:10:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c30f25700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c16a860 con 0x7f0c2c15a230 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 0x7f0c2c15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 0x7f0c2c15b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51484/0 (socket says 172.21.15.60:51484) 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 -- 172.21.15.60:0/3513646229 learned_addr learned my addr 172.21.15.60:0/3513646229 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c29d9b700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c2c159e60 0x7f0c2c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 -- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c15a230 msgr2=0x7f0c2c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2ad9d700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c15a230 0x7f0c2c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c15a230 0x7f0c2c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 -- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c2c159e60 msgr2=0x7f0c2c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c2c159e60 0x7f0c2c15d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 -- 172.21.15.60:0/3513646229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c009420 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c29d9b700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c2c159e60 0x7f0c2c15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c2a59c700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 0x7f0c2c15b750 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c069e20 tx=0x7f0c1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.010+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c01cc50 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.011+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c01cdd0 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.011+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c16ab40 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.011+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c01a6a0 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.011+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c15bc90 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.012+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c04c3c0 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.012+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c1c01aa90 con 0x7f0c2c0697c0 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.012+0000 7f0c227fc700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c0c066f60 0x7f0c0c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.012+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0c1c085b90 con 0x7f0c2c0697c0 2023-10-08T16:10:42.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.012+0000 7f0c29d9b700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c0c066f60 0x7f0c0c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.013+0000 7f0c29d9b700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c0c066f60 0x7f0c0c069410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0c9230 tx=0x7f0c14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.017+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c1c053150 con 0x7f0c2c0697c0 2023-10-08T16:10:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.211+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c2c16d960 con 0x7f0c2c0697c0 2023-10-08T16:10:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.212+0000 7f0c227fc700 1 -- 172.21.15.60:0/3513646229 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c1c056770 con 0x7f0c2c0697c0 2023-10-08T16:10:42.213 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:10:42.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c0c066f60 msgr2=0x7f0c0c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c0c066f60 0x7f0c0c069410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0c9230 tx=0x7f0c14009040 comp rx=0 tx=0).stop 2023-10-08T16:10:42.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 msgr2=0x7f0c2c15b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 0x7f0c2c15b750 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c069e20 tx=0x7f0c1c016000 comp rx=0 tx=0).stop 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 shutdown_connections 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c0c066f60 0x7f0c0c069410 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c2c15a230 0x7f0c2c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2c0697c0 0x7f0c2c15b750 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 --2- 172.21.15.60:0/3513646229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c2c159e60 0x7f0c2c15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 >> 172.21.15.60:0/3513646229 conn(0x7f0c2c070700 msgr2=0x7f0c2c0d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 shutdown_connections 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.214+0000 7f0c30f25700 1 -- 172.21.15.60:0/3513646229 wait complete. 2023-10-08T16:10:42.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:10:42.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.345+0000 7fb307ad9700 1 Processor -- start 2023-10-08T16:10:42.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.345+0000 7fb307ad9700 1 -- start start 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb307ad9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 0x7fb300067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb307ad9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb300067ba0 0x7fb300159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb307ad9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb300068000 con 0x7fb3000b0890 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb307ad9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000cb370 con 0x7fb300067ba0 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb307ad9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000b0c60 con 0x7fb30006c630 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb305875700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb3000b0890 0x7fb3000cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55874/0 (socket says 172.21.15.60:55874) 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb305875700 1 -- 172.21.15.60:0/791630060 learned_addr learned my addr 172.21.15.60:0/791630060 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb306076700 1 --2- 172.21.15.60:0/791630060 >> v2:172.21.15.144:3300/0 conn(0x7fb300067ba0 0x7fb300159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535656870 0 0) 0x7fb300068000 con 0x7fb3000b0890 2023-10-08T16:10:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb305074700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 0x7fb300067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e8003570 con 0x7fb3000b0890 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 429913742 0 0) 0x7fb2e8003570 con 0x7fb3000b0890 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 msgr2=0x7fb300067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 0x7fb300067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 >> v2:172.21.15.144:3300/0 conn(0x7fb300067ba0 msgr2=0x7fb300159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 --2- 172.21.15.60:0/791630060 >> v2:172.21.15.144:3300/0 conn(0x7fb300067ba0 0x7fb300159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30006a1e0 con 0x7fb3000b0890 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fb2f80017f0 con 0x7fb3000b0890 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.346+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 >> v1:172.21.15.60:6789/0 conn(0x7fb3000b0890 legacy=0x7fb3000cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2e8003a60 0x7fb2e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 0x7fb2e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e8004d50 0x7fb2e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000cb370 con 0x7fb2e8004d50 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000b0c60 con 0x7fb2e8003a60 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e800ba60 con 0x7fb30006c630 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e8004d50 0x7fb2e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb305875700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2e8003a60 0x7fb2e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb305074700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 0x7fb2e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 -- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 msgr2=0x7fb2e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb30006c630 0x7fb2e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 -- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2e8003a60 msgr2=0x7fb2e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2e8003a60 0x7fb2e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 -- 172.21.15.60:0/791630060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8003570 con 0x7fb2e8004d50 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb306076700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e8004d50 0x7fb2e80051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009c00 tx=0x7fb2f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f0da43cf51f2d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000e6b0 con 0x7fb2e8004d50 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000e810 con 0x7fb2e8004d50 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.347+0000 7fb304873700 1 -- 172.21.15.60:0/791630060 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000ebd0 con 0x7fb2e8004d50 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb307ad9700 1 -- 172.21.15.60:0/791630060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e8004d50 msgr2=0x7fb2e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb307ad9700 1 --2- 172.21.15.60:0/791630060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e8004d50 0x7fb2e80051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009c00 tx=0x7fb2f00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb306076700 1 -- 172.21.15.60:0/791630060 reap_dead start 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb307ad9700 1 -- 172.21.15.60:0/791630060 shutdown_connections 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb307ad9700 1 -- 172.21.15.60:0/791630060 >> 172.21.15.60:0/791630060 conn(0x7fb30006fe50 msgr2=0x7fb300069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb307ad9700 1 -- 172.21.15.60:0/791630060 shutdown_connections 2023-10-08T16:10:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.348+0000 7fb307ad9700 1 -- 172.21.15.60:0/791630060 wait complete. 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.349+0000 7fb307ad9700 1 Processor -- start 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.349+0000 7fb307ad9700 1 -- start start 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2e8004d50 0x7fb30015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 0x7fb3000ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3000ab940 0x7fb3000b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c5b30 con 0x7fb3000ad1b0 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000b18d0 con 0x7fb3000ab940 2023-10-08T16:10:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000abe30 con 0x7fb2e8004d50 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 0x7fb3000ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 0x7fb3000ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36540/0 (socket says 172.21.15.60:36540) 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 -- 172.21.15.60:0/1648294368 learned_addr learned my addr 172.21.15.60:0/1648294368 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305875700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2e8004d50 0x7fb30015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb306076700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3000ab940 0x7fb3000b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 -- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2e8004d50 msgr2=0x7fb30015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2e8004d50 0x7fb30015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 -- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3000ab940 msgr2=0x7fb3000b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3000ab940 0x7fb3000b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 -- 172.21.15.60:0/1648294368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000ac110 con 0x7fb3000ad1b0 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb305074700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 0x7fb3000ab400 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4006ac0 tx=0x7fb2f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400f940 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f400faa0 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000ac3f0 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.350+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400fe20 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.351+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30015b8f0 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.352+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3000b1af0 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.352+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f4014650 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.353+0000 7fb2fdffb700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.353+0000 7fb305875700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.353+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb2f4018030 con 0x7fb3000ad1b0 2023-10-08T16:10:42.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.353+0000 7fb305875700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800a100 tx=0x7fb2f8002210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.357+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3000b1af0 con 0x7fb3000ad1b0 2023-10-08T16:10:42.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.552+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb3000b1a90 con 0x7fb3000ad1b0 2023-10-08T16:10:42.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.552+0000 7fb2fdffb700 1 -- 172.21.15.60:0/1648294368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb2f4052170 con 0x7fb3000ad1b0 2023-10-08T16:10:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:42.554 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:10:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:10:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:10:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:10:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:10:42.554 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2ec066f30 msgr2=0x7fb2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2ec066f30 0x7fb2ec0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800a100 tx=0x7fb2f8002210 comp rx=0 tx=0).stop 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 msgr2=0x7fb3000ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 0x7fb3000ab400 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4006ac0 tx=0x7fb2f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 shutdown_connections 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb2ec066f30 0x7fb2ec0693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2e8004d50 0x7fb30015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3000ab940 0x7fb3000b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 --2- 172.21.15.60:0/1648294368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3000ad1b0 0x7fb3000ab400 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 >> 172.21.15.60:0/1648294368 conn(0x7fb30006fe50 msgr2=0x7fb30015d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 shutdown_connections 2023-10-08T16:10:42.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.554+0000 7fb307ad9700 1 -- 172.21.15.60:0/1648294368 wait complete. 2023-10-08T16:10:42.567 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:10:42.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:10:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.689+0000 7f4a33046700 1 Processor -- start 2023-10-08T16:10:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.689+0000 7f4a33046700 1 -- start start 2023-10-08T16:10:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a33046700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c0cd7f0 0x7f4a2c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a33046700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a2c0cdbc0 0x7f4a2c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a33046700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c15e340 con 0x7f4a2c1595f0 2023-10-08T16:10:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a33046700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c15e890 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a33046700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15a150 con 0x7f4a2c0cd7f0 2023-10-08T16:10:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a31843700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a2c0cdbc0 0x7f4a2c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a32044700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c0cd7f0 0x7f4a2c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a32845700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4a2c1595f0 0x7f4a2c159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:58796/0 (socket says 172.21.15.60:58796) 2023-10-08T16:10:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.690+0000 7f4a32845700 1 -- 172.21.15.60:0/637102072 learned_addr learned my addr 172.21.15.60:0/637102072 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31843700 1 -- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c0cd7f0 msgr2=0x7f4a2c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31843700 1 --2- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c0cd7f0 0x7f4a2c15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31843700 1 -- 172.21.15.60:0/637102072 >> v1:172.21.15.144:6789/0 conn(0x7f4a2c1595f0 legacy=0x7f4a2c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31843700 1 -- 172.21.15.60:0/637102072 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c15e5b0 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a32044700 1 --2- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c0cd7f0 0x7f4a2c15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31843700 1 --2- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c15de00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098e0 tx=0x7f4a200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adbcbc7c4d04f0e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31042700 1 -- 172.21.15.60:0/637102072 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000b640 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31042700 1 -- 172.21.15.60:0/637102072 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2000b7a0 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.691+0000 7f4a31042700 1 -- 172.21.15.60:0/637102072 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000bb40 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 -- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cdbc0 msgr2=0x7f4a2c15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 --2- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c15de00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098e0 tx=0x7f4a200091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 -- 172.21.15.60:0/637102072 shutdown_connections 2023-10-08T16:10:42.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 --2- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c0cd7f0 0x7f4a2c15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 --2- 172.21.15.60:0/637102072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c15de00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 -- 172.21.15.60:0/637102072 >> 172.21.15.60:0/637102072 conn(0x7f4a2c068bf0 msgr2=0x7f4a2c068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 -- 172.21.15.60:0/637102072 shutdown_connections 2023-10-08T16:10:42.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.692+0000 7f4a33046700 1 -- 172.21.15.60:0/637102072 wait complete. 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.693+0000 7f4a33046700 1 Processor -- start 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.693+0000 7f4a33046700 1 -- start start 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a33046700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cd7f0 0x7f4a2c16d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a33046700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a33046700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c1595f0 0x7f4a2c0c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a33046700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0c8000 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a33046700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c14d040 con 0x7f4a2c0cd7f0 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a33046700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0ca5b0 con 0x7f4a2c1595f0 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c0c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36542/0 (socket says 172.21.15.60:36542) 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 -- 172.21.15.60:0/4023251802 learned_addr learned my addr 172.21.15.60:0/4023251802 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a32845700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c1595f0 0x7f4a2c0c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a32044700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cd7f0 0x7f4a2c16d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 -- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c1595f0 msgr2=0x7f4a2c0c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c1595f0 0x7f4a2c0c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 -- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cd7f0 msgr2=0x7f4a2c16d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cd7f0 0x7f4a2c16d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 -- 172.21.15.60:0/4023251802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009a20 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a31843700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c0c8de0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0c7b90 tx=0x7f4a20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.694+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2001bc40 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.695+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2001bdc0 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.695+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20009420 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.695+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20011670 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.695+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c0c9c80 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.695+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c089520 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.696+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a20011a20 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.696+0000 7f4a2a7fc700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4a18066f30 0x7f4a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.696+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4a20085790 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.696+0000 7f4a32044700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4a18066f30 0x7f4a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.697+0000 7f4a32044700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4a18066f30 0x7f4a180693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cf640 tx=0x7f4a1c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.701+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a20052cb0 con 0x7f4a2c0cdbc0 2023-10-08T16:10:42.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:42.892+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4a2c0ceea0 con 0x7f4a2c0cdbc0 2023-10-08T16:10:43.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.111+0000 7f4a2a7fc700 1 -- 172.21.15.60:0/4023251802 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4a200562d0 con 0x7f4a2c0cdbc0 2023-10-08T16:10:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4a18066f30 msgr2=0x7f4a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4a18066f30 0x7f4a180693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cf640 tx=0x7f4a1c00b040 comp rx=0 tx=0).stop 2023-10-08T16:10:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 msgr2=0x7f4a2c0c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c0c8de0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0c7b90 tx=0x7f4a20017000 comp rx=0 tx=0).stop 2023-10-08T16:10:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 shutdown_connections 2023-10-08T16:10:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4a18066f30 0x7f4a180693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a2c1595f0 0x7f4a2c0c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a2c0cd7f0 0x7f4a2c16d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 --2- 172.21.15.60:0/4023251802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a2c0cdbc0 0x7f4a2c0c8de0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 >> 172.21.15.60:0/4023251802 conn(0x7f4a2c068bf0 msgr2=0x7f4a2c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 shutdown_connections 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.115+0000 7f4a33046700 1 -- 172.21.15.60:0/4023251802 wait complete. 2023-10-08T16:10:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:10:43.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:10:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.255+0000 7f3fcb0b6700 1 Processor -- start 2023-10-08T16:10:43.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.255+0000 7f3fcb0b6700 1 -- start start 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fcb0b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc4159ec0 0x7f3fc40af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fcb0b6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fc415a290 0x7f3fc40afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fcb0b6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40b0790 con 0x7f3fc406a5a0 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fcb0b6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40ce1f0 con 0x7f3fc415a290 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fcb0b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40b0b20 con 0x7f3fc4159ec0 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fc3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fc415a290 0x7f3fc40afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fc3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fc415a290 0x7f3fc40afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36550/0 (socket says 172.21.15.60:36550) 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fc9653700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3fc406a5a0 0x7f3fc415db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55890/0 (socket says 172.21.15.60:55890) 2023-10-08T16:10:43.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.256+0000 7f3fc3fff700 1 -- 172.21.15.60:0/358883219 learned_addr learned my addr 172.21.15.60:0/358883219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc8e52700 1 --2- 172.21.15.60:0/358883219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc4159ec0 0x7f3fc40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc3fff700 1 -- 172.21.15.60:0/358883219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc4159ec0 msgr2=0x7f3fc40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc3fff700 1 --2- 172.21.15.60:0/358883219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc4159ec0 0x7f3fc40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc3fff700 1 -- 172.21.15.60:0/358883219 >> v1:172.21.15.60:6789/0 conn(0x7f3fc406a5a0 legacy=0x7f3fc415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc3fff700 1 -- 172.21.15.60:0/358883219 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40b04b0 con 0x7f3fc415a290 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc37fe700 1 -- 172.21.15.60:0/358883219 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350421612 0 0) 0x7f3fc40b0790 con 0x7f3fc406a5a0 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc3fff700 1 --2- 172.21.15.60:0/358883219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc415a290 0x7f3fc40afe80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80099b0 tx=0x7f3fb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6c3a69592fad76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc37fe700 1 -- 172.21.15.60:0/358883219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800b860 con 0x7f3fc415a290 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc37fe700 1 -- 172.21.15.60:0/358883219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800b9c0 con 0x7f3fc415a290 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fc37fe700 1 -- 172.21.15.60:0/358883219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800bd60 con 0x7f3fc415a290 2023-10-08T16:10:43.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/358883219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc415a290 msgr2=0x7f3fc40afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.257+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/358883219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc415a290 0x7f3fc40afe80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80099b0 tx=0x7f3fb8009250 comp rx=0 tx=0).stop 2023-10-08T16:10:43.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.258+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/358883219 shutdown_connections 2023-10-08T16:10:43.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.258+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/358883219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc4159ec0 0x7f3fc40af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.258+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/358883219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc415a290 0x7f3fc40afe80 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.258+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/358883219 >> 172.21.15.60:0/358883219 conn(0x7f3fc40d1880 msgr2=0x7f3fc40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.258+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/358883219 shutdown_connections 2023-10-08T16:10:43.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.258+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/358883219 wait complete. 2023-10-08T16:10:43.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.259+0000 7f3fcb0b6700 1 Processor -- start 2023-10-08T16:10:43.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.259+0000 7f3fcb0b6700 1 -- start start 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc406a5a0 0x7f3fc40c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 0x7f3fc40b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc415a290 0x7f3fc4153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c7e60 con 0x7f3fc4159ec0 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c8700 con 0x7f3fc406a5a0 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c98f0 con 0x7f3fc415a290 2023-10-08T16:10:43.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 0x7f3fc40b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 0x7f3fc40b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36562/0 (socket says 172.21.15.60:36562) 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 -- 172.21.15.60:0/3311236845 learned_addr learned my addr 172.21.15.60:0/3311236845 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc9653700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc415a290 0x7f3fc4153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc8e52700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc406a5a0 0x7f3fc40c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 -- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc415a290 msgr2=0x7f3fc4153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc415a290 0x7f3fc4153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 -- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc406a5a0 msgr2=0x7f3fc40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc406a5a0 0x7f3fc40c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 -- 172.21.15.60:0/3311236845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80094f0 con 0x7f3fc4159ec0 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc3fff700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 0x7f3fc40b2bb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4071eb0 tx=0x7f3fb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8024440 con 0x7f3fc4159ec0 2023-10-08T16:10:43.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb80245a0 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8024960 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40c80b0 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.260+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc40c8b90 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.261+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc40c8d80 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.262+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fb8024d50 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.262+0000 7f3fc0ff9700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3fb0066f30 0x7f3fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.262+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3fb8086070 con 0x7f3fc4159ec0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.262+0000 7f3fc8e52700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3fb0066f30 0x7f3fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.263+0000 7f3fc8e52700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3fb0066f30 0x7f3fb00693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40089b0 tx=0x7f3fb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.267+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fb80534c0 con 0x7f3fc4159ec0 2023-10-08T16:10:43.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:43.463+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3fc404c3f0 con 0x7f3fc4159ec0 2023-10-08T16:10:44.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.118+0000 7f3fc0ff9700 1 -- 172.21.15.60:0/3311236845 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3fb802b340 con 0x7f3fc4159ec0 2023-10-08T16:10:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3fb0066f30 msgr2=0x7f3fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3fb0066f30 0x7f3fb00693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40089b0 tx=0x7f3fb4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 msgr2=0x7f3fc40b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 0x7f3fc40b2bb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4071eb0 tx=0x7f3fb8017000 comp rx=0 tx=0).stop 2023-10-08T16:10:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 shutdown_connections 2023-10-08T16:10:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3fb0066f30 0x7f3fb00693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc415a290 0x7f3fc4153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc406a5a0 0x7f3fc40c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 --2- 172.21.15.60:0/3311236845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fc4159ec0 0x7f3fc40b2bb0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 >> 172.21.15.60:0/3311236845 conn(0x7f3fc40d1880 msgr2=0x7f3fc40b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 shutdown_connections 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.132+0000 7f3fcb0b6700 1 -- 172.21.15.60:0/3311236845 wait complete. 2023-10-08T16:10:44.135 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:10:44.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:10:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 Processor -- start 2023-10-08T16:10:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 -- start start 2023-10-08T16:10:44.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3c015a730 0x7fe3c00caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3c00abce0 0x7fe3c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c00c3430 con 0x7fe3c00ab910 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c00c9100 con 0x7fe3c015a730 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.277+0000 7fe3c52a5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c0158050 con 0x7fe3c00abce0 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3be7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3c015a730 0x7fe3c00caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3beffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe3c00ab910 0x7fe3c00c2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55896/0 (socket says 172.21.15.60:55896) 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3beffd700 1 -- 172.21.15.60:0/65667776 learned_addr learned my addr 172.21.15.60:0/65667776 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3bf7fe700 1 --2- 172.21.15.60:0/65667776 >> v2:172.21.15.144:3300/0 conn(0x7fe3c00abce0 0x7fe3c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3be7fc700 1 -- 172.21.15.60:0/65667776 >> v2:172.21.15.144:3300/0 conn(0x7fe3c00abce0 msgr2=0x7fe3c00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3be7fc700 1 --2- 172.21.15.60:0/65667776 >> v2:172.21.15.144:3300/0 conn(0x7fe3c00abce0 0x7fe3c00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3be7fc700 1 -- 172.21.15.60:0/65667776 >> v1:172.21.15.60:6789/0 conn(0x7fe3c00ab910 legacy=0x7fe3c00c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3be7fc700 1 -- 172.21.15.60:0/65667776 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c015abc0 con 0x7fe3c015a730 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3bdffb700 1 -- 172.21.15.60:0/65667776 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147068884 0 0) 0x7fe3c00c3430 con 0x7fe3c00ab910 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3be7fc700 1 --2- 172.21.15.60:0/65667776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c00caf50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00caa60 tx=0x7fe3a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1244e2028790f09d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3bdffb700 1 -- 172.21.15.60:0/65667776 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8009e80 con 0x7fe3c015a730 2023-10-08T16:10:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3bdffb700 1 -- 172.21.15.60:0/65667776 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800b820 con 0x7fe3c015a730 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.278+0000 7fe3bdffb700 1 -- 172.21.15.60:0/65667776 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800bba0 con 0x7fe3c015a730 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 -- 172.21.15.60:0/65667776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 msgr2=0x7fe3c00caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/65667776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c00caf50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00caa60 tx=0x7fe3a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 -- 172.21.15.60:0/65667776 shutdown_connections 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/65667776 >> v2:172.21.15.144:3300/0 conn(0x7fe3c00abce0 0x7fe3c00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/65667776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c00caf50 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 -- 172.21.15.60:0/65667776 >> 172.21.15.60:0/65667776 conn(0x7fe3c0067660 msgr2=0x7fe3c0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 -- 172.21.15.60:0/65667776 shutdown_connections 2023-10-08T16:10:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.279+0000 7fe3c52a5700 1 -- 172.21.15.60:0/65667776 wait complete. 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.280+0000 7fe3c52a5700 1 Processor -- start 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.280+0000 7fe3c52a5700 1 -- start start 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3c52a5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c00ab910 0x7fe3c0159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3c52a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3c00abce0 0x7fe3c00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3c52a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3c52a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0159ee0 con 0x7fe3c015a730 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3c52a5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00ad2f0 con 0x7fe3c00ab910 2023-10-08T16:10:44.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3c52a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0158390 con 0x7fe3c00abce0 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c014c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36592/0 (socket says 172.21.15.60:36592) 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 -- 172.21.15.60:0/3239864215 learned_addr learned my addr 172.21.15.60:0/3239864215 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3be7fc700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3c00abce0 0x7fe3c00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3beffd700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c00ab910 0x7fe3c0159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 -- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3c00abce0 msgr2=0x7fe3c00acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3c00abce0 0x7fe3c00acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 -- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c00ab910 msgr2=0x7fe3c0159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c00ab910 0x7fe3c0159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 -- 172.21.15.60:0/3239864215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009420 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3bf7fe700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c014c5e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800c880 tx=0x7fe3b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.281+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8011600 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.282+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8011760 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.282+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8011b00 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.282+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c0158670 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.282+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c0158c30 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.282+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c004c3c0 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.283+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3b80193f0 con 0x7fe3c015a730 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.283+0000 7fe3b6ffd700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.284+0000 7fe3beffd700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.284+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe3b8084740 con 0x7fe3c015a730 2023-10-08T16:10:44.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.284+0000 7fe3beffd700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe3a0066f30 0x7fe3a00693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0002250 tx=0x7fe3b0001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.288+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3b8051970 con 0x7fe3c015a730 2023-10-08T16:10:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:44.527+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe3c006de70 con 0x7fe3c015a730 2023-10-08T16:10:45.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.345+0000 7fe3b6ffd700 1 -- 172.21.15.60:0/3239864215 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe3b8054f90 con 0x7fe3c015a730 2023-10-08T16:10:45.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe3a0066f30 msgr2=0x7fe3a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe3a0066f30 0x7fe3a00693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0002250 tx=0x7fe3b0001a20 comp rx=0 tx=0).stop 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 msgr2=0x7fe3c014c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c014c5e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800c880 tx=0x7fe3b8008040 comp rx=0 tx=0).stop 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 shutdown_connections 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c015a730 0x7fe3c014c5e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c00ab910 0x7fe3c0159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 --2- 172.21.15.60:0/3239864215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3c00abce0 0x7fe3c00acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.350+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 >> 172.21.15.60:0/3239864215 conn(0x7fe3c0067660 msgr2=0x7fe3c01564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:45.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.351+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 shutdown_connections 2023-10-08T16:10:45.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.351+0000 7fe3c52a5700 1 -- 172.21.15.60:0/3239864215 wait complete. 2023-10-08T16:10:45.354 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 14 and data pool 15 2023-10-08T16:10:45.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:45.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.492+0000 7f34ad820700 1 Processor -- start 2023-10-08T16:10:45.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.492+0000 7f34ad820700 1 -- start start 2023-10-08T16:10:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad820700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34a80cd6e0 0x7f34a80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad820700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f34a815cbd0 0x7f34a815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad820700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80cb7c0 con 0x7f34a80cdab0 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad820700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a815e850 con 0x7f34a80cd6e0 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad820700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a80cd030 con 0x7f34a815cbd0 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ac81e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34a80cd6e0 0x7f34a80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34a7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34a80cdab0 0x7f34a815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55912/0 (socket says 172.21.15.60:55912) 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34a7fff700 1 -- 172.21.15.60:0/517111381 learned_addr learned my addr 172.21.15.60:0/517111381 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad01f700 1 --2- 172.21.15.60:0/517111381 >> v2:172.21.15.144:3300/0 conn(0x7f34a815cbd0 0x7f34a815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ac81e700 1 -- 172.21.15.60:0/517111381 >> v2:172.21.15.144:3300/0 conn(0x7f34a815cbd0 msgr2=0x7f34a815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ac81e700 1 --2- 172.21.15.60:0/517111381 >> v2:172.21.15.144:3300/0 conn(0x7f34a815cbd0 0x7f34a815d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ac81e700 1 -- 172.21.15.60:0/517111381 >> v1:172.21.15.60:6789/0 conn(0x7f34a80cdab0 legacy=0x7f34a815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ac81e700 1 -- 172.21.15.60:0/517111381 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a815e290 con 0x7f34a80cd6e0 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34a77fe700 1 -- 172.21.15.60:0/517111381 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216193296 0 0) 0x7f34a80cb7c0 con 0x7f34a80cdab0 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.493+0000 7f34ad01f700 1 --2- 172.21.15.60:0/517111381 >> v2:172.21.15.144:3300/0 conn(0x7f34a815cbd0 0x7f34a815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ac81e700 1 --2- 172.21.15.60:0/517111381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80cbc50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f34a80cb730 tx=0x7f34a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb3e5a1848568ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34a77fe700 1 -- 172.21.15.60:0/517111381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000b6b0 con 0x7f34a80cd6e0 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34a77fe700 1 -- 172.21.15.60:0/517111381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000b810 con 0x7f34a80cd6e0 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34a77fe700 1 -- 172.21.15.60:0/517111381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000bbb0 con 0x7f34a80cd6e0 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 -- 172.21.15.60:0/517111381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 msgr2=0x7f34a80cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 --2- 172.21.15.60:0/517111381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80cbc50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f34a80cb730 tx=0x7f34a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 -- 172.21.15.60:0/517111381 shutdown_connections 2023-10-08T16:10:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 --2- 172.21.15.60:0/517111381 >> v2:172.21.15.144:3300/0 conn(0x7f34a815cbd0 0x7f34a815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 --2- 172.21.15.60:0/517111381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80cbc50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 -- 172.21.15.60:0/517111381 >> 172.21.15.60:0/517111381 conn(0x7f34a8067660 msgr2=0x7f34a8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 -- 172.21.15.60:0/517111381 shutdown_connections 2023-10-08T16:10:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.494+0000 7f34ad820700 1 -- 172.21.15.60:0/517111381 wait complete. 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.495+0000 7f34ad820700 1 Processor -- start 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 -- start start 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34a80cdab0 0x7f34a81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34a815cbd0 0x7f34a8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8153340 con 0x7f34a80cd6e0 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c7ec0 con 0x7f34a815cbd0 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ad820700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c81a0 con 0x7f34a80cdab0 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ac81e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ac81e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36616/0 (socket says 172.21.15.60:36616) 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.496+0000 7f34ac81e700 1 -- 172.21.15.60:0/252526156 learned_addr learned my addr 172.21.15.60:0/252526156 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34a7fff700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34a80cdab0 0x7f34a81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ad01f700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34a815cbd0 0x7f34a8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ac81e700 1 -- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34a80cdab0 msgr2=0x7f34a81528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ac81e700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34a80cdab0 0x7f34a81528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ac81e700 1 -- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34a815cbd0 msgr2=0x7f34a8152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ac81e700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34a815cbd0 0x7f34a8152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ac81e700 1 -- 172.21.15.60:0/252526156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009420 con 0x7f34a80cd6e0 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ac81e700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80b60d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f34a80c7b10 tx=0x7f34a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000bb90 con 0x7f34a80cd6e0 2023-10-08T16:10:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011420 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a80c8480 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00117a0 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.497+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a80c8a40 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.498+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a8089280 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.499+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34a0011b90 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.499+0000 7f34a4ff9700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.499+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34a0085ec0 con 0x7f34a80cd6e0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.499+0000 7f34a7fff700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.500+0000 7f34a7fff700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3488066f30 0x7f34880693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3498001560 tx=0x7f3498009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.504+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34a0053130 con 0x7f34a80cd6e0 2023-10-08T16:10:45.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.697+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34a815e570 con 0x7f34a80cd6e0 2023-10-08T16:10:45.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.698+0000 7f34a4ff9700 1 -- 172.21.15.60:0/252526156 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f34a0056750 con 0x7f34a80cd6e0 2023-10-08T16:10:45.699 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:45.699 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:44.529917+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3488066f30 msgr2=0x7f34880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3488066f30 0x7f34880693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3498001560 tx=0x7f3498009040 comp rx=0 tx=0).stop 2023-10-08T16:10:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 msgr2=0x7f34a80b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80b60d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f34a80c7b10 tx=0x7f34a0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 shutdown_connections 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34a815cbd0 0x7f34a8152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34a80cd6e0 0x7f34a80b60d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 --2- 172.21.15.60:0/252526156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34a80cdab0 0x7f34a81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 >> 172.21.15.60:0/252526156 conn(0x7f34a8067660 msgr2=0x7f34a80c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 shutdown_connections 2023-10-08T16:10:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.700+0000 7f34ad820700 1 -- 172.21.15.60:0/252526156 wait complete. 2023-10-08T16:10:45.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.832+0000 7f140999d700 1 Processor -- start 2023-10-08T16:10:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.832+0000 7f140999d700 1 -- start start 2023-10-08T16:10:45.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f140999d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f140415d3a0 0x7f14040d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f140999d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14040c8ca0 0x7f14040cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f140999d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040cf7f0 con 0x7f14040cb1b0 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f140999d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040cd170 con 0x7f14040c8ca0 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f140999d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040cbb70 con 0x7f140415d3a0 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14040c8ca0 0x7f14040cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14027fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f14040cb1b0 0x7f14040ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55922/0 (socket says 172.21.15.60:55922) 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14027fc700 1 -- 172.21.15.60:0/2487415112 learned_addr learned my addr 172.21.15.60:0/2487415112 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f1402ffd700 1 --2- 172.21.15.60:0/2487415112 >> v2:172.21.15.144:3300/0 conn(0x7f140415d3a0 0x7f14040d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14037fe700 1 -- 172.21.15.60:0/2487415112 >> v2:172.21.15.144:3300/0 conn(0x7f140415d3a0 msgr2=0x7f14040d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14037fe700 1 --2- 172.21.15.60:0/2487415112 >> v2:172.21.15.144:3300/0 conn(0x7f140415d3a0 0x7f14040d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14037fe700 1 -- 172.21.15.60:0/2487415112 >> v1:172.21.15.60:6789/0 conn(0x7f14040cb1b0 legacy=0x7f14040ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14037fe700 1 -- 172.21.15.60:0/2487415112 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040cfad0 con 0x7f14040c8ca0 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f1402ffd700 1 --2- 172.21.15.60:0/2487415112 >> v2:172.21.15.144:3300/0 conn(0x7f140415d3a0 0x7f14040d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.833+0000 7f14037fe700 1 --2- 172.21.15.60:0/2487415112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040c8ca0 0x7f14040cb630 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1404089740 tx=0x7f13f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1f2151230ec3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f1401ffb700 1 -- 172.21.15.60:0/2487415112 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4009e80 con 0x7f14040c8ca0 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f1401ffb700 1 -- 172.21.15.60:0/2487415112 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400b820 con 0x7f14040c8ca0 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f1401ffb700 1 -- 172.21.15.60:0/2487415112 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400bba0 con 0x7f14040c8ca0 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 -- 172.21.15.60:0/2487415112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040c8ca0 msgr2=0x7f14040cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 --2- 172.21.15.60:0/2487415112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040c8ca0 0x7f14040cb630 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1404089740 tx=0x7f13f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 -- 172.21.15.60:0/2487415112 shutdown_connections 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 --2- 172.21.15.60:0/2487415112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040c8ca0 0x7f14040cb630 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 --2- 172.21.15.60:0/2487415112 >> v2:172.21.15.144:3300/0 conn(0x7f140415d3a0 0x7f14040d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 -- 172.21.15.60:0/2487415112 >> 172.21.15.60:0/2487415112 conn(0x7f1404067e40 msgr2=0x7f14040d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:45.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 -- 172.21.15.60:0/2487415112 shutdown_connections 2023-10-08T16:10:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.834+0000 7f140999d700 1 -- 172.21.15.60:0/2487415112 wait complete. 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.835+0000 7f140999d700 1 Processor -- start 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.835+0000 7f140999d700 1 -- start start 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f140999d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14040c8ca0 0x7f1404158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f140999d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 0x7f1404151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f140999d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140415d3a0 0x7f14040b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f140999d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404158770 con 0x7f14040cb1b0 2023-10-08T16:10:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f140999d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040b4e30 con 0x7f140415d3a0 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f140999d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140416af20 con 0x7f14040c8ca0 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f14027fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 0x7f1404151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f14027fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 0x7f1404151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36632/0 (socket says 172.21.15.60:36632) 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f14027fc700 1 -- 172.21.15.60:0/3391953514 learned_addr learned my addr 172.21.15.60:0/3391953514 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f1402ffd700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14040c8ca0 0x7f1404158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.836+0000 7f14037fe700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140415d3a0 0x7f14040b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f14027fc700 1 -- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14040c8ca0 msgr2=0x7f1404158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f14027fc700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14040c8ca0 0x7f1404158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f14027fc700 1 -- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140415d3a0 msgr2=0x7f14040b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f14027fc700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140415d3a0 0x7f14040b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f14027fc700 1 -- 172.21.15.60:0/3391953514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4009420 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f14027fc700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 0x7f1404151a30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c7c0 tx=0x7f13ec007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec005b30 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec005cb0 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140416a680 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec004a80 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.837+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140416ac40 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.838+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140406ac50 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.838+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13ec0070f0 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.839+0000 7f13faffd700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.839+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13ec0839b0 con 0x7f14040cb1b0 2023-10-08T16:10:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.839+0000 7f1402ffd700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.839+0000 7f1402ffd700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13e4066f30 0x7f13e40693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00e600 tx=0x7f13fc0076c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:45.843+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13ec050ca0 con 0x7f14040cb1b0 2023-10-08T16:10:46.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.036+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14040cfde0 con 0x7f14040cb1b0 2023-10-08T16:10:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.037+0000 7f13faffd700 1 -- 172.21.15.60:0/3391953514 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f13ec0542c0 con 0x7f14040cb1b0 2023-10-08T16:10:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:46.038 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:44.529917+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:46.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.038+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13e4066f30 msgr2=0x7f13e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.038+0000 7f140999d700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13e4066f30 0x7f13e40693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00e600 tx=0x7f13fc0076c0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.038+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 msgr2=0x7f1404151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.038+0000 7f140999d700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 0x7f1404151a30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c7c0 tx=0x7f13ec007f70 comp rx=0 tx=0).stop 2023-10-08T16:10:46.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 shutdown_connections 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14040c8ca0 0x7f1404158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f140415d3a0 0x7f14040b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 --2- 172.21.15.60:0/3391953514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14040cb1b0 0x7f1404151a30 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 >> 172.21.15.60:0/3391953514 conn(0x7f1404067e40 msgr2=0x7f1404154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 shutdown_connections 2023-10-08T16:10:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.039+0000 7f140999d700 1 -- 172.21.15.60:0/3391953514 wait complete. 2023-10-08T16:10:46.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:10:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.174+0000 7f0ef7c67700 1 Processor -- start 2023-10-08T16:10:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.174+0000 7f0ef7c67700 1 -- start start 2023-10-08T16:10:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef7c67700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ef00697c0 0x7f0ef015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef7c67700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef015a230 0x7f0ef00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef7c67700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef015ea90 con 0x7f0ef0159e60 2023-10-08T16:10:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef7c67700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef00d1cf0 con 0x7f0ef00697c0 2023-10-08T16:10:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef7c67700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00b3100 con 0x7f0ef015a230 2023-10-08T16:10:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef5a03700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0ef0159e60 0x7f0ef00690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55926/0 (socket says 172.21.15.60:55926) 2023-10-08T16:10:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef5a03700 1 -- 172.21.15.60:0/3356939992 learned_addr learned my addr 172.21.15.60:0/3356939992 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef5202700 1 --2- 172.21.15.60:0/3356939992 >> v2:172.21.15.144:3300/0 conn(0x7f0ef00697c0 0x7f0ef015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef6204700 1 --2- 172.21.15.60:0/3356939992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef015a230 0x7f0ef00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.175+0000 7f0ef4a01700 1 -- 172.21.15.60:0/3356939992 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547172692 0 0) 0x7f0ef015ea90 con 0x7f0ef0159e60 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef4a01700 1 -- 172.21.15.60:0/3356939992 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed8003570 con 0x7f0ef0159e60 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef6204700 1 -- 172.21.15.60:0/3356939992 >> v2:172.21.15.144:3300/0 conn(0x7f0ef00697c0 msgr2=0x7f0ef015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef6204700 1 --2- 172.21.15.60:0/3356939992 >> v2:172.21.15.144:3300/0 conn(0x7f0ef00697c0 0x7f0ef015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef6204700 1 -- 172.21.15.60:0/3356939992 >> v1:172.21.15.60:6789/0 conn(0x7f0ef0159e60 legacy=0x7f0ef00690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef6204700 1 -- 172.21.15.60:0/3356939992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00d10e0 con 0x7f0ef015a230 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef5202700 1 --2- 172.21.15.60:0/3356939992 >> v2:172.21.15.144:3300/0 conn(0x7f0ef00697c0 0x7f0ef015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef6204700 1 --2- 172.21.15.60:0/3356939992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef015a230 0x7f0ef00af730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009e60 tx=0x7f0ee0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deff583d1ffa6f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef4a01700 1 -- 172.21.15.60:0/3356939992 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000e070 con 0x7f0ef015a230 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef4a01700 1 -- 172.21.15.60:0/3356939992 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000bab0 con 0x7f0ef015a230 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.176+0000 7f0ef4a01700 1 -- 172.21.15.60:0/3356939992 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000be30 con 0x7f0ef015a230 2023-10-08T16:10:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 -- 172.21.15.60:0/3356939992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef015a230 msgr2=0x7f0ef00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/3356939992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef015a230 0x7f0ef00af730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009e60 tx=0x7f0ee0009780 comp rx=0 tx=0).stop 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 -- 172.21.15.60:0/3356939992 shutdown_connections 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/3356939992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef015a230 0x7f0ef00af730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/3356939992 >> v2:172.21.15.144:3300/0 conn(0x7f0ef00697c0 0x7f0ef015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 -- 172.21.15.60:0/3356939992 >> 172.21.15.60:0/3356939992 conn(0x7f0ef0070700 msgr2=0x7f0ef0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 -- 172.21.15.60:0/3356939992 shutdown_connections 2023-10-08T16:10:46.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.177+0000 7f0ef7c67700 1 -- 172.21.15.60:0/3356939992 wait complete. 2023-10-08T16:10:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.178+0000 7f0ef7c67700 1 Processor -- start 2023-10-08T16:10:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.178+0000 7f0ef7c67700 1 -- start start 2023-10-08T16:10:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef7c67700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef00697c0 0x7f0ef00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef7c67700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef0159e60 0x7f0ef015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef7c67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 0x7f0ef0146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef7c67700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c6cc0 con 0x7f0ef015a230 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef7c67700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef015d2f0 con 0x7f0ef0159e60 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef7c67700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef015d5d0 con 0x7f0ef00697c0 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef6204700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 0x7f0ef0146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef6204700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 0x7f0ef0146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36634/0 (socket says 172.21.15.60:36634) 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef6204700 1 -- 172.21.15.60:0/1478540436 learned_addr learned my addr 172.21.15.60:0/1478540436 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef5a03700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef00697c0 0x7f0ef00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.179+0000 7f0ef5202700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef0159e60 0x7f0ef015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef6204700 1 -- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef00697c0 msgr2=0x7f0ef00c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef6204700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef00697c0 0x7f0ef00c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef6204700 1 -- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef0159e60 msgr2=0x7f0ef015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef6204700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef0159e60 0x7f0ef015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef6204700 1 -- 172.21.15.60:0/1478540436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4009420 con 0x7f0ef015a230 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef6204700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 0x7f0ef0146650 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0013000 tx=0x7f0ee0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0027470 con 0x7f0ef015a230 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0027610 con 0x7f0ef015a230 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee0009a20 con 0x7f0ef015a230 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00279d0 con 0x7f0ef015a230 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.180+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef00c6950 con 0x7f0ef015a230 2023-10-08T16:10:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.181+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef00c6e30 con 0x7f0ef015a230 2023-10-08T16:10:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.182+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ee0024070 con 0x7f0ef015a230 2023-10-08T16:10:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.182+0000 7f0eedffb700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0edc066f30 0x7f0edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.182+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ee0086fc0 con 0x7f0ef015a230 2023-10-08T16:10:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.182+0000 7f0ef5a03700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0edc066f30 0x7f0edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.182+0000 7f0ef5a03700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0edc066f30 0x7f0edc0693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80058d0 tx=0x7f0ee8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:46.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.186+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ee00b85a0 con 0x7f0ef015a230 2023-10-08T16:10:46.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:46.428+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ef004c3c0 con 0x7f0ef015a230 2023-10-08T16:10:47.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.353+0000 7f0eedffb700 1 -- 172.21.15.60:0/1478540436 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0ee0054230 con 0x7f0ef015a230 2023-10-08T16:10:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.356+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0edc066f30 msgr2=0x7f0edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.356+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0edc066f30 0x7f0edc0693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80058d0 tx=0x7f0ee8009040 comp rx=0 tx=0).stop 2023-10-08T16:10:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.356+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 msgr2=0x7f0ef0146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.356+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 0x7f0ef0146650 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0013000 tx=0x7f0ee0019000 comp rx=0 tx=0).stop 2023-10-08T16:10:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 shutdown_connections 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0edc066f30 0x7f0edc0693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ef00697c0 0x7f0ef00c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ef015a230 0x7f0ef0146650 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 --2- 172.21.15.60:0/1478540436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef0159e60 0x7f0ef015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 >> 172.21.15.60:0/1478540436 conn(0x7f0ef0070700 msgr2=0x7f0ef0159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 shutdown_connections 2023-10-08T16:10:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.357+0000 7f0ef7c67700 1 -- 172.21.15.60:0/1478540436 wait complete. 2023-10-08T16:10:47.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:10:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.501+0000 7f078402c700 1 Processor -- start 2023-10-08T16:10:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.501+0000 7f078402c700 1 -- start start 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.501+0000 7f078402c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f077c159e60 0x7f077c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.501+0000 7f078402c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f077c0697c0 0x7f077c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f078402c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c15ea90 con 0x7f077c15a230 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f078402c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0d1cf0 con 0x7f077c159e60 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f078402c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0b3100 con 0x7f077c0697c0 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f077c159e60 0x7f077c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f077c159e60 0x7f077c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36638/0 (socket says 172.21.15.60:36638) 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 -- 172.21.15.60:0/3324214433 learned_addr learned my addr 172.21.15.60:0/3324214433 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f07825c9700 1 --2- 172.21.15.60:0/3324214433 >> v2:172.21.15.144:3300/0 conn(0x7f077c0697c0 0x7f077c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 -- 172.21.15.60:0/3324214433 >> v2:172.21.15.144:3300/0 conn(0x7f077c0697c0 msgr2=0x7f077c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:47.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 --2- 172.21.15.60:0/3324214433 >> v2:172.21.15.144:3300/0 conn(0x7f077c0697c0 0x7f077c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 -- 172.21.15.60:0/3324214433 >> v1:172.21.15.144:6789/0 conn(0x7f077c15a230 legacy=0x7f077c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 -- 172.21.15.60:0/3324214433 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0d10e0 con 0x7f077c159e60 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f07825c9700 1 --2- 172.21.15.60:0/3324214433 >> v2:172.21.15.144:3300/0 conn(0x7f077c0697c0 0x7f077c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0781dc8700 1 --2- 172.21.15.60:0/3324214433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c159e60 0x7f077c15e550 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ce810 tx=0x7f0774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5594475f9d9e980 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0780dc6700 1 -- 172.21.15.60:0/3324214433 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400b860 con 0x7f077c159e60 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0780dc6700 1 -- 172.21.15.60:0/3324214433 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400b9c0 con 0x7f077c159e60 2023-10-08T16:10:47.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.502+0000 7f0780dc6700 1 -- 172.21.15.60:0/3324214433 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400bd60 con 0x7f077c159e60 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 -- 172.21.15.60:0/3324214433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c159e60 msgr2=0x7f077c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 --2- 172.21.15.60:0/3324214433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c159e60 0x7f077c15e550 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ce810 tx=0x7f0774009250 comp rx=0 tx=0).stop 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 -- 172.21.15.60:0/3324214433 shutdown_connections 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 --2- 172.21.15.60:0/3324214433 >> v2:172.21.15.144:3300/0 conn(0x7f077c0697c0 0x7f077c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 --2- 172.21.15.60:0/3324214433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c159e60 0x7f077c15e550 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 -- 172.21.15.60:0/3324214433 >> 172.21.15.60:0/3324214433 conn(0x7f077c070700 msgr2=0x7f077c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 -- 172.21.15.60:0/3324214433 shutdown_connections 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.503+0000 7f078402c700 1 -- 172.21.15.60:0/3324214433 wait complete. 2023-10-08T16:10:47.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.504+0000 7f078402c700 1 Processor -- start 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.504+0000 7f078402c700 1 -- start start 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f078402c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 0x7f077c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f078402c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f077c159e60 0x7f077c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f078402c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f077c15a230 0x7f077c0c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f078402c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c16a8f0 con 0x7f077c0697c0 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f078402c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c16abb0 con 0x7f077c159e60 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f078402c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c16ae90 con 0x7f077c15a230 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 0x7f077c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 0x7f077c15b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36648/0 (socket says 172.21.15.60:36648) 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 -- 172.21.15.60:0/3586133217 learned_addr learned my addr 172.21.15.60:0/3586133217 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f07815c7700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f077c159e60 0x7f077c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f07825c9700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f077c15a230 0x7f077c0c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:47.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 -- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f077c15a230 msgr2=0x7f077c0c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f077c15a230 0x7f077c0c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 -- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f077c159e60 msgr2=0x7f077c0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f077c159e60 0x7f077c0c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.505+0000 7f0781dc8700 1 -- 172.21.15.60:0/3586133217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094f0 con 0x7f077c0697c0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.506+0000 7f0781dc8700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 0x7f077c15b920 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0774009290 tx=0x7f0774017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.506+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774026480 con 0x7f077c0697c0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.506+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077401f070 con 0x7f077c0697c0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.506+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c16b170 con 0x7f077c0697c0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.506+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774026850 con 0x7f077c0697c0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.506+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c15be60 con 0x7f077c0697c0 2023-10-08T16:10:47.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.507+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c16b690 con 0x7f077c0697c0 2023-10-08T16:10:47.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.507+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f077401a430 con 0x7f077c0697c0 2023-10-08T16:10:47.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.508+0000 7f0779ffb700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0768066f30 0x7f07680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:47.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.508+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0774021070 con 0x7f077c0697c0 2023-10-08T16:10:47.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.508+0000 7f07815c7700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0768066f30 0x7f07680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:47.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.508+0000 7f07815c7700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0768066f30 0x7f07680693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f077c15a660 tx=0x7f0770007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:47.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.512+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f077c16b690 con 0x7f077c0697c0 2023-10-08T16:10:47.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:47.751+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f077c04c3c0 con 0x7f077c0697c0 2023-10-08T16:10:48.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.357+0000 7f0779ffb700 1 -- 172.21.15.60:0/3586133217 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0774053590 con 0x7f077c0697c0 2023-10-08T16:10:48.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0768066f30 msgr2=0x7f07680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0768066f30 0x7f07680693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f077c15a660 tx=0x7f0770007ec0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 msgr2=0x7f077c15b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 0x7f077c15b920 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0774009290 tx=0x7f0774017000 comp rx=0 tx=0).stop 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 shutdown_connections 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0768066f30 0x7f07680693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f077c15a230 0x7f077c0c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f077c0697c0 0x7f077c15b920 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 --2- 172.21.15.60:0/3586133217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f077c159e60 0x7f077c0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 >> 172.21.15.60:0/3586133217 conn(0x7f077c070700 msgr2=0x7f077c0afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 shutdown_connections 2023-10-08T16:10:48.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.360+0000 7f078402c700 1 -- 172.21.15.60:0/3586133217 wait complete. 2023-10-08T16:10:48.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:48.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.495+0000 7f392b27f700 1 Processor -- start 2023-10-08T16:10:48.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.495+0000 7f392b27f700 1 -- start start 2023-10-08T16:10:48.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392b27f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3924157c40 0x7f3924158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392b27f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392415cbb0 con 0x7f392415a620 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392b27f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392415bfa0 con 0x7f3924157870 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392b27f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392415bdb0 con 0x7f3924157c40 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392981c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3924157c40 0x7f3924158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392881a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f392415a620 0x7f392415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55932/0 (socket says 172.21.15.60:55932) 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392881a700 1 -- 172.21.15.60:0/1547747662 learned_addr learned my addr 172.21.15.60:0/1547747662 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392981c700 1 -- 172.21.15.60:0/1547747662 >> v1:172.21.15.144:6789/0 conn(0x7f3924157870 legacy=0x7f392415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392981c700 1 -- 172.21.15.60:0/1547747662 >> v1:172.21.15.60:6789/0 conn(0x7f392415a620 legacy=0x7f392415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f3923fff700 1 -- 172.21.15.60:0/1547747662 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147505737 0 0) 0x7f392415cbb0 con 0x7f392415a620 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392981c700 1 -- 172.21.15.60:0/1547747662 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392415c280 con 0x7f3924157c40 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f392981c700 1 --2- 172.21.15.60:0/1547747662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f3924158110 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f391c0098e0 tx=0x7f391c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f9cc85a3df2f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f3923fff700 1 -- 172.21.15.60:0/1547747662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c009e80 con 0x7f3924157c40 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f3923fff700 1 -- 172.21.15.60:0/1547747662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00b820 con 0x7f3924157c40 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.496+0000 7f3923fff700 1 -- 172.21.15.60:0/1547747662 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00bba0 con 0x7f3924157c40 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 -- 172.21.15.60:0/1547747662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 msgr2=0x7f3924158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 --2- 172.21.15.60:0/1547747662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f3924158110 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f391c0098e0 tx=0x7f391c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 -- 172.21.15.60:0/1547747662 shutdown_connections 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 --2- 172.21.15.60:0/1547747662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f3924158110 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 -- 172.21.15.60:0/1547747662 >> 172.21.15.60:0/1547747662 conn(0x7f3924068ce0 msgr2=0x7f39240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 -- 172.21.15.60:0/1547747662 shutdown_connections 2023-10-08T16:10:48.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.497+0000 7f392b27f700 1 -- 172.21.15.60:0/1547747662 wait complete. 2023-10-08T16:10:48.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.498+0000 7f392b27f700 1 Processor -- start 2023-10-08T16:10:48.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.498+0000 7f392b27f700 1 -- start start 2023-10-08T16:10:48.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392b27f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3924157870 0x7f392415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392b27f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f392413f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392b27f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392415a620 0x7f39240b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392b27f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415f730 con 0x7f3924157c40 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392b27f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241503f0 con 0x7f392415a620 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392b27f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392415d6d0 con 0x7f3924157870 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f392413f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f392413f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36666/0 (socket says 172.21.15.60:36666) 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 -- 172.21.15.60:0/619522100 learned_addr learned my addr 172.21.15.60:0/619522100 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392901b700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3924157870 0x7f392415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 -- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3924157870 msgr2=0x7f392415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3924157870 0x7f392415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392981c700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392415a620 0x7f39240b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 -- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392415a620 msgr2=0x7f39240b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392415a620 0x7f39240b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392881a700 1 -- 172.21.15.60:0/619522100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c009420 con 0x7f3924157c40 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.499+0000 7f392901b700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3924157870 0x7f392415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.500+0000 7f392881a700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f392413f6f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f391800c610 tx=0x7f3918000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.500+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918005b30 con 0x7f3924157c40 2023-10-08T16:10:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.500+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918005c90 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.500+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918007300 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.500+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392415f0e0 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.500+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392413fc30 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.501+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392415f8e0 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.501+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f391801b3b0 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.502+0000 7f39217fa700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3910066f30 0x7f39100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.502+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3918083b30 con 0x7f3924157c40 2023-10-08T16:10:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.502+0000 7f392901b700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3910066f30 0x7f39100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.502+0000 7f392901b700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3910066f30 0x7f39100693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3914007fd0 tx=0x7f3914009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.506+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f392415f8e0 con 0x7f3924157c40 2023-10-08T16:10:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.744+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f392415f8e0 con 0x7f3924157c40 2023-10-08T16:10:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.744+0000 7f39217fa700 1 -- 172.21.15.60:0/619522100 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f392415f8e0 con 0x7f3924157c40 2023-10-08T16:10:48.745 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:48.746 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:10:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3910066f30 msgr2=0x7f39100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3910066f30 0x7f39100693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3914007fd0 tx=0x7f3914009040 comp rx=0 tx=0).stop 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 msgr2=0x7f392413f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f392413f6f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f391800c610 tx=0x7f3918000fe0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 shutdown_connections 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3910066f30 0x7f39100693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3924157870 0x7f392415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392415a620 0x7f39240b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 --2- 172.21.15.60:0/619522100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3924157c40 0x7f392413f6f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 >> 172.21.15.60:0/619522100 conn(0x7f3924068ce0 msgr2=0x7f39240b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 shutdown_connections 2023-10-08T16:10:48.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.746+0000 7f392b27f700 1 -- 172.21.15.60:0/619522100 wait complete. 2023-10-08T16:10:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:10:48.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:48.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.877+0000 7fedf2f08700 1 Processor -- start 2023-10-08T16:10:48.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.877+0000 7fedf2f08700 1 -- start start 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf2f08700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fedec0b50c0 0x7fedec15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf2f08700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec0d1960 con 0x7fedec0cf810 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf2f08700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec0d0610 con 0x7fedec15a030 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf2f08700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec15a940 con 0x7fedec0b50c0 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf1705700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fedec0b50c0 0x7fedec15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf2707700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fedec0cf810 0x7fedec0cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55948/0 (socket says 172.21.15.60:55948) 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf2707700 1 -- 172.21.15.60:0/816820173 learned_addr learned my addr 172.21.15.60:0/816820173 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf1705700 1 -- 172.21.15.60:0/816820173 >> v1:172.21.15.144:6789/0 conn(0x7fedec15a030 legacy=0x7fedec0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf1705700 1 -- 172.21.15.60:0/816820173 >> v1:172.21.15.60:6789/0 conn(0x7fedec0cf810 legacy=0x7fedec0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf0f04700 1 -- 172.21.15.60:0/816820173 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506185281 0 0) 0x7fedec0d1960 con 0x7fedec0cf810 2023-10-08T16:10:48.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.878+0000 7fedf1705700 1 -- 172.21.15.60:0/816820173 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0cfd70 con 0x7fedec0b50c0 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf1705700 1 --2- 172.21.15.60:0/816820173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0b50c0 0x7fedec15a400 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fede00098e0 tx=0x7fede00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e735f9e7f47fb45d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf0f04700 1 -- 172.21.15.60:0/816820173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0009e80 con 0x7fedec0b50c0 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf0f04700 1 -- 172.21.15.60:0/816820173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000b860 con 0x7fedec0b50c0 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf0f04700 1 -- 172.21.15.60:0/816820173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000bbe0 con 0x7fedec0b50c0 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 -- 172.21.15.60:0/816820173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0b50c0 msgr2=0x7fedec15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 --2- 172.21.15.60:0/816820173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0b50c0 0x7fedec15a400 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fede00098e0 tx=0x7fede00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 -- 172.21.15.60:0/816820173 shutdown_connections 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 --2- 172.21.15.60:0/816820173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0b50c0 0x7fedec15a400 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 -- 172.21.15.60:0/816820173 >> 172.21.15.60:0/816820173 conn(0x7fedec067e40 msgr2=0x7fedec0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 -- 172.21.15.60:0/816820173 shutdown_connections 2023-10-08T16:10:48.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.879+0000 7fedf2f08700 1 -- 172.21.15.60:0/816820173 wait complete. 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.880+0000 7fedf2f08700 1 Processor -- start 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 -- start start 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b50c0 0x7fedec0d1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 0x7fedec15f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedec15a030 0x7fedec15f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec09c4a0 con 0x7fedec0cf810 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec09c780 con 0x7fedec0b50c0 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf2f08700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec09ca60 con 0x7fedec15a030 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf1705700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 0x7fedec15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf1705700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 0x7fedec15f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36682/0 (socket says 172.21.15.60:36682) 2023-10-08T16:10:48.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.881+0000 7fedf1705700 1 -- 172.21.15.60:0/894627240 learned_addr learned my addr 172.21.15.60:0/894627240 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1f06700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b50c0 0x7fedec0d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf2707700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedec15a030 0x7fedec15f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1705700 1 -- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedec15a030 msgr2=0x7fedec15f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1705700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedec15a030 0x7fedec15f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1705700 1 -- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b50c0 msgr2=0x7fedec0d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1705700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b50c0 0x7fedec0d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1705700 1 -- 172.21.15.60:0/894627240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0009420 con 0x7fedec0cf810 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf2707700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedec15a030 0x7fedec15f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf1705700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 0x7fedec15f040 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fedec089600 tx=0x7fede0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede001f070 con 0x7fedec0cf810 2023-10-08T16:10:48.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000b9d0 con 0x7fedec0cf810 2023-10-08T16:10:48.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec09cd40 con 0x7fedec0cf810 2023-10-08T16:10:48.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0025670 con 0x7fedec0cf810 2023-10-08T16:10:48.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.882+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec09c0c0 con 0x7fedec0cf810 2023-10-08T16:10:48.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.883+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec09d260 con 0x7fedec0cf810 2023-10-08T16:10:48.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.884+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fede0023070 con 0x7fedec0cf810 2023-10-08T16:10:48.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.884+0000 7fede9ffb700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fedd8066f30 0x7fedd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:48.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.884+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fede0085bf0 con 0x7fedec0cf810 2023-10-08T16:10:48.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.884+0000 7fedf1f06700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fedd8066f30 0x7fedd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:48.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.885+0000 7fedf1f06700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fedd8066f30 0x7fedd80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e160 tx=0x7feddc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:48.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:48.888+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedec09d260 con 0x7fedec0cf810 2023-10-08T16:10:49.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.082+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedec09d260 con 0x7fedec0cf810 2023-10-08T16:10:49.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.083+0000 7fede9ffb700 1 -- 172.21.15.60:0/894627240 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fedec09d260 con 0x7fedec0cf810 2023-10-08T16:10:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:49.085 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":117,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:46.129253+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fedd8066f30 msgr2=0x7fedd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fedd8066f30 0x7fedd80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e160 tx=0x7feddc009040 comp rx=0 tx=0).stop 2023-10-08T16:10:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 msgr2=0x7fedec15f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 0x7fedec15f040 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fedec089600 tx=0x7fede0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 shutdown_connections 2023-10-08T16:10:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fedd8066f30 0x7fedd80693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fedec15a030 0x7fedec15f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b50c0 0x7fedec0d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 --2- 172.21.15.60:0/894627240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedec0cf810 0x7fedec15f040 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.085+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 >> 172.21.15.60:0/894627240 conn(0x7fedec067e40 msgr2=0x7fedec0cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.086+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 shutdown_connections 2023-10-08T16:10:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.086+0000 7fedf2f08700 1 -- 172.21.15.60:0/894627240 wait complete. 2023-10-08T16:10:49.099 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:10:49.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:49.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.216+0000 7f3099aca700 1 Processor -- start 2023-10-08T16:10:49.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.217+0000 7f3099aca700 1 -- start start 2023-10-08T16:10:49.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.217+0000 7f3099aca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30940b0890 0x7f30940cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.217+0000 7f3099aca700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3094067d70 0x7f3094159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.217+0000 7f3099aca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30940cb370 con 0x7f30940cbd40 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.217+0000 7f3099aca700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30940b0c60 con 0x7f30940b0890 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.217+0000 7f3099aca700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309406a1e0 con 0x7f3094067d70 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30940b0890 0x7f30940cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30940b0890 0x7f30940cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36690/0 (socket says 172.21.15.60:36690) 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 -- 172.21.15.60:0/3311852649 learned_addr learned my addr 172.21.15.60:0/3311852649 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f3093fff700 1 --2- 172.21.15.60:0/3311852649 >> v2:172.21.15.144:3300/0 conn(0x7f3094067d70 0x7f3094159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 -- 172.21.15.60:0/3311852649 >> v2:172.21.15.144:3300/0 conn(0x7f3094067d70 msgr2=0x7f3094159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 --2- 172.21.15.60:0/3311852649 >> v2:172.21.15.144:3300/0 conn(0x7f3094067d70 0x7f3094159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 -- 172.21.15.60:0/3311852649 >> v1:172.21.15.144:6789/0 conn(0x7f30940cbd40 legacy=0x7f3094067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 -- 172.21.15.60:0/3311852649 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309406cb80 con 0x7f30940b0890 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30927fc700 1 -- 172.21.15.60:0/3311852649 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900631527 0 0) 0x7f30940cb370 con 0x7f30940cbd40 2023-10-08T16:10:49.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30937fe700 1 --2- 172.21.15.60:0/3311852649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940b0890 0x7f30940cb800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f30940b4be0 tx=0x7f3084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933e1182d2e97b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30927fc700 1 -- 172.21.15.60:0/3311852649 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084009e70 con 0x7f30940b0890 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30927fc700 1 -- 172.21.15.60:0/3311852649 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308400b860 con 0x7f30940b0890 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.218+0000 7f30927fc700 1 -- 172.21.15.60:0/3311852649 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400bc00 con 0x7f30940b0890 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 -- 172.21.15.60:0/3311852649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940b0890 msgr2=0x7f30940cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 --2- 172.21.15.60:0/3311852649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940b0890 0x7f30940cb800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f30940b4be0 tx=0x7f3084009250 comp rx=0 tx=0).stop 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 -- 172.21.15.60:0/3311852649 shutdown_connections 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 --2- 172.21.15.60:0/3311852649 >> v2:172.21.15.144:3300/0 conn(0x7f3094067d70 0x7f3094159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 --2- 172.21.15.60:0/3311852649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30940b0890 0x7f30940cb800 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 -- 172.21.15.60:0/3311852649 >> 172.21.15.60:0/3311852649 conn(0x7f309406fe50 msgr2=0x7f3094069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 -- 172.21.15.60:0/3311852649 shutdown_connections 2023-10-08T16:10:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.219+0000 7f3099aca700 1 -- 172.21.15.60:0/3311852649 wait complete. 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.220+0000 7f3099aca700 1 Processor -- start 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.220+0000 7f3099aca700 1 -- start start 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3099aca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 0x7f30940c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3099aca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30940b0890 0x7f309415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3099aca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30940cbd40 0x7f309415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3099aca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c34d0 con 0x7f3094067d70 2023-10-08T16:10:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3099aca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c40f0 con 0x7f30940cbd40 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3099aca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30940acda0 con 0x7f30940b0890 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 0x7f30940c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 0x7f30940c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36702/0 (socket says 172.21.15.60:36702) 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 -- 172.21.15.60:0/3225138015 learned_addr learned my addr 172.21.15.60:0/3225138015 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3093fff700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30940cbd40 0x7f309415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f3092ffd700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30940b0890 0x7f309415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 -- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30940b0890 msgr2=0x7f309415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30940b0890 0x7f309415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 -- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30940cbd40 msgr2=0x7f309415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30940cbd40 0x7f309415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 -- 172.21.15.60:0/3225138015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840094f0 con 0x7f3094067d70 2023-10-08T16:10:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f30937fe700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 0x7f30940c2f90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f309406ab60 tx=0x7f3084017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.221+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400b9d0 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.222+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308400bb50 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.222+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084025670 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.222+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30940ad080 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.222+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30940ad640 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.222+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309415d0b0 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.223+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3084023070 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.223+0000 7f307b7fe700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3080066f30 0x7f30800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.223+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3084085a60 con 0x7f3094067d70 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.223+0000 7f3092ffd700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3080066f30 0x7f30800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.224+0000 7f3092ffd700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3080066f30 0x7f30800693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f309415ff20 tx=0x7f3088009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:49.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.228+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3084052cd0 con 0x7f3094067d70 2023-10-08T16:10:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.414+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f309404c3c0 con 0x7f3080066f30 2023-10-08T16:10:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.422+0000 7f307b7fe700 1 -- 172.21.15.60:0/3225138015 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285354 (secure 0 0 0) 0x7f309404c3c0 con 0x7f3080066f30 2023-10-08T16:10:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3080066f30 msgr2=0x7f30800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3080066f30 0x7f30800693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f309415ff20 tx=0x7f3088009040 comp rx=0 tx=0).stop 2023-10-08T16:10:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 msgr2=0x7f30940c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 0x7f30940c2f90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f309406ab60 tx=0x7f3084017000 comp rx=0 tx=0).stop 2023-10-08T16:10:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 shutdown_connections 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3080066f30 0x7f30800693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30940cbd40 0x7f309415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3094067d70 0x7f30940c2f90 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 --2- 172.21.15.60:0/3225138015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30940b0890 0x7f309415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 >> 172.21.15.60:0/3225138015 conn(0x7f309406fe50 msgr2=0x7f30940ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 shutdown_connections 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.425+0000 7f3099aca700 1 -- 172.21.15.60:0/3225138015 wait complete. 2023-10-08T16:10:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:10:49.439 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-10-08T16:10:47.634784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6092,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556407,"statfs":{"total":1600000000,"available":1593760878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.522484"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137233+0000","last_change":"2023-10-08T16:10:45.137233+0000","last_active":"2023-10-08T16:10:45.137233+0000","last_peered":"2023-10-08T16:10:45.137233+0000","last_clean":"2023-10-08T16:10:45.137233+0000","last_became_active":"2023-10-08T16:10:45.137006+0000","last_became_peered":"2023-10-08T16:10:45.137006+0000","last_unstale":"2023-10-08T16:10:45.137233+0000","last_undegraded":"2023-10-08T16:10:45.137233+0000","last_fullsized":"2023-10-08T16:10:45.137233+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:20.134047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145622+0000","last_change":"2023-10-08T16:10:45.145622+0000","last_active":"2023-10-08T16:10:45.145622+0000","last_peered":"2023-10-08T16:10:45.145622+0000","last_clean":"2023-10-08T16:10:45.145622+0000","last_became_active":"2023-10-08T16:10:45.145075+0000","last_became_peered":"2023-10-08T16:10:45.145075+0000","last_unstale":"2023-10-08T16:10:45.145622+0000","last_undegraded":"2023-10-08T16:10:45.145622+0000","last_fullsized":"2023-10-08T16:10:45.145622+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:20.091814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.136612+0000","last_change":"2023-10-08T16:10:45.136612+0000","last_active":"2023-10-08T16:10:45.136612+0000","last_peered":"2023-10-08T16:10:45.136612+0000","last_clean":"2023-10-08T16:10:45.136612+0000","last_became_active":"2023-10-08T16:10:45.136376+0000","last_became_peered":"2023-10-08T16:10:45.136376+0000","last_unstale":"2023-10-08T16:10:45.136612+0000","last_undegraded":"2023-10-08T16:10:45.136612+0000","last_fullsized":"2023-10-08T16:10:45.136612+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:39.107457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141456+0000","last_change":"2023-10-08T16:10:45.141456+0000","last_active":"2023-10-08T16:10:45.141456+0000","last_peered":"2023-10-08T16:10:45.141456+0000","last_clean":"2023-10-08T16:10:45.141456+0000","last_became_active":"2023-10-08T16:10:45.141233+0000","last_became_peered":"2023-10-08T16:10:45.141233+0000","last_unstale":"2023-10-08T16:10:45.141456+0000","last_undegraded":"2023-10-08T16:10:45.141456+0000","last_fullsized":"2023-10-08T16:10:45.141456+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:26.485355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.146639+0000","last_change":"2023-10-08T16:10:45.146639+0000","last_active":"2023-10-08T16:10:45.146639+0000","last_peered":"2023-10-08T16:10:45.146639+0000","last_clean":"2023-10-08T16:10:45.146639+0000","last_became_active":"2023-10-08T16:10:45.146503+0000","last_became_peered":"2023-10-08T16:10:45.146503+0000","last_unstale":"2023-10-08T16:10:45.146639+0000","last_undegraded":"2023-10-08T16:10:45.146639+0000","last_fullsized":"2023-10-08T16:10:45.146639+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:23.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143074+0000","last_change":"2023-10-08T16:10:45.143074+0000","last_active":"2023-10-08T16:10:45.143074+0000","last_peered":"2023-10-08T16:10:45.143074+0000","last_clean":"2023-10-08T16:10:45.143074+0000","last_became_active":"2023-10-08T16:10:45.142672+0000","last_became_peered":"2023-10-08T16:10:45.142672+0000","last_unstale":"2023-10-08T16:10:45.143074+0000","last_undegraded":"2023-10-08T16:10:45.143074+0000","last_fullsized":"2023-10-08T16:10:45.143074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:26.485355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142815+0000","last_change":"2023-10-08T16:10:45.142815+0000","last_active":"2023-10-08T16:10:45.142815+0000","last_peered":"2023-10-08T16:10:45.142815+0000","last_clean":"2023-10-08T16:10:45.142815+0000","last_became_active":"2023-10-08T16:10:45.142326+0000","last_became_peered":"2023-10-08T16:10:45.142326+0000","last_unstale":"2023-10-08T16:10:45.142815+0000","last_undegraded":"2023-10-08T16:10:45.142815+0000","last_fullsized":"2023-10-08T16:10:45.142815+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:25.936999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144928+0000","last_change":"2023-10-08T16:10:45.144928+0000","last_active":"2023-10-08T16:10:45.144928+0000","last_peered":"2023-10-08T16:10:45.144928+0000","last_clean":"2023-10-08T16:10:45.144928+0000","last_became_active":"2023-10-08T16:10:45.144244+0000","last_became_peered":"2023-10-08T16:10:45.144244+0000","last_unstale":"2023-10-08T16:10:45.144928+0000","last_undegraded":"2023-10-08T16:10:45.144928+0000","last_fullsized":"2023-10-08T16:10:45.144928+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:56.113743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134308+0000","last_change":"2023-10-08T16:10:45.134308+0000","last_active":"2023-10-08T16:10:45.134308+0000","last_peered":"2023-10-08T16:10:45.134308+0000","last_clean":"2023-10-08T16:10:45.134308+0000","last_became_active":"2023-10-08T16:10:45.133244+0000","last_became_peered":"2023-10-08T16:10:45.133244+0000","last_unstale":"2023-10-08T16:10:45.134308+0000","last_undegraded":"2023-10-08T16:10:45.134308+0000","last_fullsized":"2023-10-08T16:10:45.134308+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:23.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145117+0000","last_change":"2023-10-08T16:10:45.145117+0000","last_active":"2023-10-08T16:10:45.145117+0000","last_peered":"2023-10-08T16:10:45.145117+0000","last_clean":"2023-10-08T16:10:45.145117+0000","last_became_active":"2023-10-08T16:10:45.144739+0000","last_became_peered":"2023-10-08T16:10:45.144739+0000","last_unstale":"2023-10-08T16:10:45.145117+0000","last_undegraded":"2023-10-08T16:10:45.145117+0000","last_fullsized":"2023-10-08T16:10:45.145117+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141391+0000","last_change":"2023-10-08T16:10:45.141391+0000","last_active":"2023-10-08T16:10:45.141391+0000","last_peered":"2023-10-08T16:10:45.141391+0000","last_clean":"2023-10-08T16:10:45.141391+0000","last_became_active":"2023-10-08T16:10:45.140843+0000","last_became_peered":"2023-10-08T16:10:45.140843+0000","last_unstale":"2023-10-08T16:10:45.141391+0000","last_undegraded":"2023-10-08T16:10:45.141391+0000","last_fullsized":"2023-10-08T16:10:45.141391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.135820+0000","last_change":"2023-10-08T16:10:45.135820+0000","last_active":"2023-10-08T16:10:45.135820+0000","last_peered":"2023-10-08T16:10:45.135820+0000","last_clean":"2023-10-08T16:10:45.135820+0000","last_became_active":"2023-10-08T16:10:45.135585+0000","last_became_peered":"2023-10-08T16:10:45.135585+0000","last_unstale":"2023-10-08T16:10:45.135820+0000","last_undegraded":"2023-10-08T16:10:45.135820+0000","last_fullsized":"2023-10-08T16:10:45.135820+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.133150+0000","last_change":"2023-10-08T16:10:45.133150+0000","last_active":"2023-10-08T16:10:45.133150+0000","last_peered":"2023-10-08T16:10:45.133150+0000","last_clean":"2023-10-08T16:10:45.133150+0000","last_became_active":"2023-10-08T16:10:45.132921+0000","last_became_peered":"2023-10-08T16:10:45.132921+0000","last_unstale":"2023-10-08T16:10:45.133150+0000","last_undegraded":"2023-10-08T16:10:45.133150+0000","last_fullsized":"2023-10-08T16:10:45.133150+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:45.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144165+0000","last_change":"2023-10-08T16:10:45.144165+0000","last_active":"2023-10-08T16:10:45.144165+0000","last_peered":"2023-10-08T16:10:45.144165+0000","last_clean":"2023-10-08T16:10:45.144165+0000","last_became_active":"2023-10-08T16:10:45.143010+0000","last_became_peered":"2023-10-08T16:10:45.143010+0000","last_unstale":"2023-10-08T16:10:45.144165+0000","last_undegraded":"2023-10-08T16:10:45.144165+0000","last_fullsized":"2023-10-08T16:10:45.144165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:52.210022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137014+0000","last_change":"2023-10-08T16:10:45.137014+0000","last_active":"2023-10-08T16:10:45.137014+0000","last_peered":"2023-10-08T16:10:45.137014+0000","last_clean":"2023-10-08T16:10:45.137014+0000","last_became_active":"2023-10-08T16:10:45.136484+0000","last_became_peered":"2023-10-08T16:10:45.136484+0000","last_unstale":"2023-10-08T16:10:45.137014+0000","last_undegraded":"2023-10-08T16:10:45.137014+0000","last_fullsized":"2023-10-08T16:10:45.137014+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:23.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142920+0000","last_change":"2023-10-08T16:10:45.142920+0000","last_active":"2023-10-08T16:10:45.142920+0000","last_peered":"2023-10-08T16:10:45.142920+0000","last_clean":"2023-10-08T16:10:45.142920+0000","last_became_active":"2023-10-08T16:10:45.142113+0000","last_became_peered":"2023-10-08T16:10:45.142113+0000","last_unstale":"2023-10-08T16:10:45.142920+0000","last_undegraded":"2023-10-08T16:10:45.142920+0000","last_fullsized":"2023-10-08T16:10:45.142920+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:45.127911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141481+0000","last_change":"2023-10-08T16:10:45.141481+0000","last_active":"2023-10-08T16:10:45.141481+0000","last_peered":"2023-10-08T16:10:45.141481+0000","last_clean":"2023-10-08T16:10:45.141481+0000","last_became_active":"2023-10-08T16:10:45.140983+0000","last_became_peered":"2023-10-08T16:10:45.140983+0000","last_unstale":"2023-10-08T16:10:45.141481+0000","last_undegraded":"2023-10-08T16:10:45.141481+0000","last_fullsized":"2023-10-08T16:10:45.141481+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:48.891999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137650+0000","last_change":"2023-10-08T16:10:45.137650+0000","last_active":"2023-10-08T16:10:45.137650+0000","last_peered":"2023-10-08T16:10:45.137650+0000","last_clean":"2023-10-08T16:10:45.137650+0000","last_became_active":"2023-10-08T16:10:45.137381+0000","last_became_peered":"2023-10-08T16:10:45.137381+0000","last_unstale":"2023-10-08T16:10:45.137650+0000","last_undegraded":"2023-10-08T16:10:45.137650+0000","last_fullsized":"2023-10-08T16:10:45.137650+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143736+0000","last_change":"2023-10-08T16:10:45.143736+0000","last_active":"2023-10-08T16:10:45.143736+0000","last_peered":"2023-10-08T16:10:45.143736+0000","last_clean":"2023-10-08T16:10:45.143736+0000","last_became_active":"2023-10-08T16:10:45.142269+0000","last_became_peered":"2023-10-08T16:10:45.142269+0000","last_unstale":"2023-10-08T16:10:45.143736+0000","last_undegraded":"2023-10-08T16:10:45.143736+0000","last_fullsized":"2023-10-08T16:10:45.143736+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:37.002560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.132971+0000","last_change":"2023-10-08T16:10:45.132971+0000","last_active":"2023-10-08T16:10:45.132971+0000","last_peered":"2023-10-08T16:10:45.132971+0000","last_clean":"2023-10-08T16:10:45.132971+0000","last_became_active":"2023-10-08T16:10:45.132722+0000","last_became_peered":"2023-10-08T16:10:45.132722+0000","last_unstale":"2023-10-08T16:10:45.132971+0000","last_undegraded":"2023-10-08T16:10:45.132971+0000","last_fullsized":"2023-10-08T16:10:45.132971+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:07.726133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139916+0000","last_change":"2023-10-08T16:10:45.139916+0000","last_active":"2023-10-08T16:10:45.139916+0000","last_peered":"2023-10-08T16:10:45.139916+0000","last_clean":"2023-10-08T16:10:45.139916+0000","last_became_active":"2023-10-08T16:10:45.139537+0000","last_became_peered":"2023-10-08T16:10:45.139537+0000","last_unstale":"2023-10-08T16:10:45.139916+0000","last_undegraded":"2023-10-08T16:10:45.139916+0000","last_fullsized":"2023-10-08T16:10:45.139916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:13.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141616+0000","last_change":"2023-10-08T16:10:45.141616+0000","last_active":"2023-10-08T16:10:45.141616+0000","last_peered":"2023-10-08T16:10:45.141616+0000","last_clean":"2023-10-08T16:10:45.141616+0000","last_became_active":"2023-10-08T16:10:45.141266+0000","last_became_peered":"2023-10-08T16:10:45.141266+0000","last_unstale":"2023-10-08T16:10:45.141616+0000","last_undegraded":"2023-10-08T16:10:45.141616+0000","last_fullsized":"2023-10-08T16:10:45.141616+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:06.260928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144605+0000","last_change":"2023-10-08T16:10:45.144605+0000","last_active":"2023-10-08T16:10:45.144605+0000","last_peered":"2023-10-08T16:10:45.144605+0000","last_clean":"2023-10-08T16:10:45.144605+0000","last_became_active":"2023-10-08T16:10:45.143917+0000","last_became_peered":"2023-10-08T16:10:45.143917+0000","last_unstale":"2023-10-08T16:10:45.144605+0000","last_undegraded":"2023-10-08T16:10:45.144605+0000","last_fullsized":"2023-10-08T16:10:45.144605+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:02.129509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142606+0000","last_change":"2023-10-08T16:10:45.142606+0000","last_active":"2023-10-08T16:10:45.142606+0000","last_peered":"2023-10-08T16:10:45.142606+0000","last_clean":"2023-10-08T16:10:45.142606+0000","last_became_active":"2023-10-08T16:10:45.142338+0000","last_became_peered":"2023-10-08T16:10:45.142338+0000","last_unstale":"2023-10-08T16:10:45.142606+0000","last_undegraded":"2023-10-08T16:10:45.142606+0000","last_fullsized":"2023-10-08T16:10:45.142606+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142806+0000","last_change":"2023-10-08T16:10:45.142806+0000","last_active":"2023-10-08T16:10:45.142806+0000","last_peered":"2023-10-08T16:10:45.142806+0000","last_clean":"2023-10-08T16:10:45.142806+0000","last_became_active":"2023-10-08T16:10:45.142498+0000","last_became_peered":"2023-10-08T16:10:45.142498+0000","last_unstale":"2023-10-08T16:10:45.142806+0000","last_undegraded":"2023-10-08T16:10:45.142806+0000","last_fullsized":"2023-10-08T16:10:45.142806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:07.726133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144433+0000","last_change":"2023-10-08T16:10:45.144433+0000","last_active":"2023-10-08T16:10:45.144433+0000","last_peered":"2023-10-08T16:10:45.144433+0000","last_clean":"2023-10-08T16:10:45.144433+0000","last_became_active":"2023-10-08T16:10:45.143930+0000","last_became_peered":"2023-10-08T16:10:45.143930+0000","last_unstale":"2023-10-08T16:10:45.144433+0000","last_undegraded":"2023-10-08T16:10:45.144433+0000","last_fullsized":"2023-10-08T16:10:45.144433+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:13.522062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143611+0000","last_change":"2023-10-08T16:10:45.143611+0000","last_active":"2023-10-08T16:10:45.143611+0000","last_peered":"2023-10-08T16:10:45.143611+0000","last_clean":"2023-10-08T16:10:45.143611+0000","last_became_active":"2023-10-08T16:10:45.143369+0000","last_became_peered":"2023-10-08T16:10:45.143369+0000","last_unstale":"2023-10-08T16:10:45.143611+0000","last_undegraded":"2023-10-08T16:10:45.143611+0000","last_fullsized":"2023-10-08T16:10:45.143611+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:38.333090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.146151+0000","last_change":"2023-10-08T16:10:45.146151+0000","last_active":"2023-10-08T16:10:45.146151+0000","last_peered":"2023-10-08T16:10:45.146151+0000","last_clean":"2023-10-08T16:10:45.146151+0000","last_became_active":"2023-10-08T16:10:45.145735+0000","last_became_peered":"2023-10-08T16:10:45.145735+0000","last_unstale":"2023-10-08T16:10:45.146151+0000","last_undegraded":"2023-10-08T16:10:45.146151+0000","last_fullsized":"2023-10-08T16:10:45.146151+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:45.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142956+0000","last_change":"2023-10-08T16:10:45.142956+0000","last_active":"2023-10-08T16:10:45.142956+0000","last_peered":"2023-10-08T16:10:45.142956+0000","last_clean":"2023-10-08T16:10:45.142956+0000","last_became_active":"2023-10-08T16:10:45.142662+0000","last_became_peered":"2023-10-08T16:10:45.142662+0000","last_unstale":"2023-10-08T16:10:45.142956+0000","last_undegraded":"2023-10-08T16:10:45.142956+0000","last_fullsized":"2023-10-08T16:10:45.142956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:03.330905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143744+0000","last_change":"2023-10-08T16:10:45.143744+0000","last_active":"2023-10-08T16:10:45.143744+0000","last_peered":"2023-10-08T16:10:45.143744+0000","last_clean":"2023-10-08T16:10:45.143744+0000","last_became_active":"2023-10-08T16:10:45.143471+0000","last_became_peered":"2023-10-08T16:10:45.143471+0000","last_unstale":"2023-10-08T16:10:45.143744+0000","last_undegraded":"2023-10-08T16:10:45.143744+0000","last_fullsized":"2023-10-08T16:10:45.143744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:45.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.140373+0000","last_change":"2023-10-08T16:10:45.140373+0000","last_active":"2023-10-08T16:10:45.140373+0000","last_peered":"2023-10-08T16:10:45.140373+0000","last_clean":"2023-10-08T16:10:45.140373+0000","last_became_active":"2023-10-08T16:10:45.140048+0000","last_became_peered":"2023-10-08T16:10:45.140048+0000","last_unstale":"2023-10-08T16:10:45.140373+0000","last_undegraded":"2023-10-08T16:10:45.140373+0000","last_fullsized":"2023-10-08T16:10:45.140373+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143756+0000","last_change":"2023-10-08T16:10:45.143756+0000","last_active":"2023-10-08T16:10:45.143756+0000","last_peered":"2023-10-08T16:10:45.143756+0000","last_clean":"2023-10-08T16:10:45.143756+0000","last_became_active":"2023-10-08T16:10:45.143523+0000","last_became_peered":"2023-10-08T16:10:45.143523+0000","last_unstale":"2023-10-08T16:10:45.143756+0000","last_undegraded":"2023-10-08T16:10:45.143756+0000","last_fullsized":"2023-10-08T16:10:45.143756+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:23.916903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144394+0000","last_change":"2023-10-08T16:10:45.144394+0000","last_active":"2023-10-08T16:10:45.144394+0000","last_peered":"2023-10-08T16:10:45.144394+0000","last_clean":"2023-10-08T16:10:45.144394+0000","last_became_active":"2023-10-08T16:10:45.143447+0000","last_became_peered":"2023-10-08T16:10:45.143447+0000","last_unstale":"2023-10-08T16:10:45.144394+0000","last_undegraded":"2023-10-08T16:10:45.144394+0000","last_fullsized":"2023-10-08T16:10:45.144394+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:00.767634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"116'4","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353674+0000","last_change":"2023-10-08T16:10:44.127360+0000","last_active":"2023-10-08T16:10:45.353674+0000","last_peered":"2023-10-08T16:10:45.353674+0000","last_clean":"2023-10-08T16:10:45.353674+0000","last_became_active":"2023-10-08T16:10:44.126142+0000","last_became_peered":"2023-10-08T16:10:44.126142+0000","last_unstale":"2023-10-08T16:10:45.353674+0000","last_undegraded":"2023-10-08T16:10:45.353674+0000","last_fullsized":"2023-10-08T16:10:45.353674+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:25.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141815+0000","last_change":"2023-10-08T16:10:45.141815+0000","last_active":"2023-10-08T16:10:45.141815+0000","last_peered":"2023-10-08T16:10:45.141815+0000","last_clean":"2023-10-08T16:10:45.141815+0000","last_became_active":"2023-10-08T16:10:45.141615+0000","last_became_peered":"2023-10-08T16:10:45.141615+0000","last_unstale":"2023-10-08T16:10:45.141815+0000","last_undegraded":"2023-10-08T16:10:45.141815+0000","last_fullsized":"2023-10-08T16:10:45.141815+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137026+0000","last_change":"2023-10-08T16:10:44.127672+0000","last_active":"2023-10-08T16:10:45.137026+0000","last_peered":"2023-10-08T16:10:45.137026+0000","last_clean":"2023-10-08T16:10:45.137026+0000","last_became_active":"2023-10-08T16:10:44.127436+0000","last_became_peered":"2023-10-08T16:10:44.127436+0000","last_unstale":"2023-10-08T16:10:45.137026+0000","last_undegraded":"2023-10-08T16:10:45.137026+0000","last_fullsized":"2023-10-08T16:10:45.137026+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:59.866517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141801+0000","last_change":"2023-10-08T16:10:45.141801+0000","last_active":"2023-10-08T16:10:45.141801+0000","last_peered":"2023-10-08T16:10:45.141801+0000","last_clean":"2023-10-08T16:10:45.141801+0000","last_became_active":"2023-10-08T16:10:45.141112+0000","last_became_peered":"2023-10-08T16:10:45.141112+0000","last_unstale":"2023-10-08T16:10:45.141801+0000","last_undegraded":"2023-10-08T16:10:45.141801+0000","last_fullsized":"2023-10-08T16:10:45.141801+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:00.872986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.352069+0000","last_change":"2023-10-08T16:10:44.119841+0000","last_active":"2023-10-08T16:10:45.352069+0000","last_peered":"2023-10-08T16:10:45.352069+0000","last_clean":"2023-10-08T16:10:45.352069+0000","last_became_active":"2023-10-08T16:10:44.119586+0000","last_became_peered":"2023-10-08T16:10:44.119586+0000","last_unstale":"2023-10-08T16:10:45.352069+0000","last_undegraded":"2023-10-08T16:10:45.352069+0000","last_fullsized":"2023-10-08T16:10:45.352069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:41.586045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.135602+0000","last_change":"2023-10-08T16:10:45.135602+0000","last_active":"2023-10-08T16:10:45.135602+0000","last_peered":"2023-10-08T16:10:45.135602+0000","last_clean":"2023-10-08T16:10:45.135602+0000","last_became_active":"2023-10-08T16:10:45.135394+0000","last_became_peered":"2023-10-08T16:10:45.135394+0000","last_unstale":"2023-10-08T16:10:45.135602+0000","last_undegraded":"2023-10-08T16:10:45.135602+0000","last_fullsized":"2023-10-08T16:10:45.135602+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.351089+0000","last_change":"2023-10-08T16:10:44.120791+0000","last_active":"2023-10-08T16:10:45.351089+0000","last_peered":"2023-10-08T16:10:45.351089+0000","last_clean":"2023-10-08T16:10:45.351089+0000","last_became_active":"2023-10-08T16:10:44.120556+0000","last_became_peered":"2023-10-08T16:10:44.120556+0000","last_unstale":"2023-10-08T16:10:45.351089+0000","last_undegraded":"2023-10-08T16:10:45.351089+0000","last_fullsized":"2023-10-08T16:10:45.351089+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:37.326621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.133773+0000","last_change":"2023-10-08T16:10:45.133773+0000","last_active":"2023-10-08T16:10:45.133773+0000","last_peered":"2023-10-08T16:10:45.133773+0000","last_clean":"2023-10-08T16:10:45.133773+0000","last_became_active":"2023-10-08T16:10:45.133417+0000","last_became_peered":"2023-10-08T16:10:45.133417+0000","last_unstale":"2023-10-08T16:10:45.133773+0000","last_undegraded":"2023-10-08T16:10:45.133773+0000","last_fullsized":"2023-10-08T16:10:45.133773+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:00.872986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134419+0000","last_change":"2023-10-08T16:10:44.128081+0000","last_active":"2023-10-08T16:10:45.134419+0000","last_peered":"2023-10-08T16:10:45.134419+0000","last_clean":"2023-10-08T16:10:45.134419+0000","last_became_active":"2023-10-08T16:10:44.123339+0000","last_became_peered":"2023-10-08T16:10:44.123339+0000","last_unstale":"2023-10-08T16:10:45.134419+0000","last_undegraded":"2023-10-08T16:10:45.134419+0000","last_fullsized":"2023-10-08T16:10:45.134419+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:37.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139651+0000","last_change":"2023-10-08T16:10:45.139651+0000","last_active":"2023-10-08T16:10:45.139651+0000","last_peered":"2023-10-08T16:10:45.139651+0000","last_clean":"2023-10-08T16:10:45.139651+0000","last_became_active":"2023-10-08T16:10:45.139411+0000","last_became_peered":"2023-10-08T16:10:45.139411+0000","last_unstale":"2023-10-08T16:10:45.139651+0000","last_undegraded":"2023-10-08T16:10:45.139651+0000","last_fullsized":"2023-10-08T16:10:45.139651+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:42.592515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139052+0000","last_change":"2023-10-08T16:10:44.127221+0000","last_active":"2023-10-08T16:10:45.139052+0000","last_peered":"2023-10-08T16:10:45.139052+0000","last_clean":"2023-10-08T16:10:45.139052+0000","last_became_active":"2023-10-08T16:10:44.125818+0000","last_became_peered":"2023-10-08T16:10:44.125818+0000","last_unstale":"2023-10-08T16:10:45.139052+0000","last_undegraded":"2023-10-08T16:10:45.139052+0000","last_fullsized":"2023-10-08T16:10:45.139052+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:44.121442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.136789+0000","last_change":"2023-10-08T16:10:45.136789+0000","last_active":"2023-10-08T16:10:45.136789+0000","last_peered":"2023-10-08T16:10:45.136789+0000","last_clean":"2023-10-08T16:10:45.136789+0000","last_became_active":"2023-10-08T16:10:45.136112+0000","last_became_peered":"2023-10-08T16:10:45.136112+0000","last_unstale":"2023-10-08T16:10:45.136789+0000","last_undegraded":"2023-10-08T16:10:45.136789+0000","last_fullsized":"2023-10-08T16:10:45.136789+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:07.726133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.123870+0000","last_change":"2023-10-08T16:10:44.123793+0000","last_active":"2023-10-08T16:10:44.123870+0000","last_peered":"2023-10-08T16:10:44.123870+0000","last_clean":"2023-10-08T16:10:44.123870+0000","last_became_active":"2023-10-08T16:10:44.123541+0000","last_became_peered":"2023-10-08T16:10:44.123541+0000","last_unstale":"2023-10-08T16:10:44.123870+0000","last_undegraded":"2023-10-08T16:10:44.123870+0000","last_fullsized":"2023-10-08T16:10:44.123870+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:22.910434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134760+0000","last_change":"2023-10-08T16:10:45.134760+0000","last_active":"2023-10-08T16:10:45.134760+0000","last_peered":"2023-10-08T16:10:45.134760+0000","last_clean":"2023-10-08T16:10:45.134760+0000","last_became_active":"2023-10-08T16:10:45.134106+0000","last_became_peered":"2023-10-08T16:10:45.134106+0000","last_unstale":"2023-10-08T16:10:45.134760+0000","last_undegraded":"2023-10-08T16:10:45.134760+0000","last_fullsized":"2023-10-08T16:10:45.134760+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.127756+0000","last_change":"2023-10-08T16:10:44.127668+0000","last_active":"2023-10-08T16:10:44.127756+0000","last_peered":"2023-10-08T16:10:44.127756+0000","last_clean":"2023-10-08T16:10:44.127756+0000","last_became_active":"2023-10-08T16:10:44.127414+0000","last_became_peered":"2023-10-08T16:10:44.127414+0000","last_unstale":"2023-10-08T16:10:44.127756+0000","last_undegraded":"2023-10-08T16:10:44.127756+0000","last_fullsized":"2023-10-08T16:10:44.127756+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:04.469232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145480+0000","last_change":"2023-10-08T16:10:45.145480+0000","last_active":"2023-10-08T16:10:45.145480+0000","last_peered":"2023-10-08T16:10:45.145480+0000","last_clean":"2023-10-08T16:10:45.145480+0000","last_became_active":"2023-10-08T16:10:45.144776+0000","last_became_peered":"2023-10-08T16:10:45.144776+0000","last_unstale":"2023-10-08T16:10:45.145480+0000","last_undegraded":"2023-10-08T16:10:45.145480+0000","last_fullsized":"2023-10-08T16:10:45.145480+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:55.254333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.127738+0000","last_change":"2023-10-08T16:10:44.127484+0000","last_active":"2023-10-08T16:10:44.127738+0000","last_peered":"2023-10-08T16:10:44.127738+0000","last_clean":"2023-10-08T16:10:44.127738+0000","last_became_active":"2023-10-08T16:10:44.126987+0000","last_became_peered":"2023-10-08T16:10:44.126987+0000","last_unstale":"2023-10-08T16:10:44.127738+0000","last_undegraded":"2023-10-08T16:10:44.127738+0000","last_fullsized":"2023-10-08T16:10:44.127738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:20.586715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134712+0000","last_change":"2023-10-08T16:10:45.134712+0000","last_active":"2023-10-08T16:10:45.134712+0000","last_peered":"2023-10-08T16:10:45.134712+0000","last_clean":"2023-10-08T16:10:45.134712+0000","last_became_active":"2023-10-08T16:10:45.133060+0000","last_became_peered":"2023-10-08T16:10:45.133060+0000","last_unstale":"2023-10-08T16:10:45.134712+0000","last_undegraded":"2023-10-08T16:10:45.134712+0000","last_fullsized":"2023-10-08T16:10:45.134712+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:45.127911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.128506+0000","last_change":"2023-10-08T16:10:44.128435+0000","last_active":"2023-10-08T16:10:44.128506+0000","last_peered":"2023-10-08T16:10:44.128506+0000","last_clean":"2023-10-08T16:10:44.128506+0000","last_became_active":"2023-10-08T16:10:44.128194+0000","last_became_peered":"2023-10-08T16:10:44.128194+0000","last_unstale":"2023-10-08T16:10:44.128506+0000","last_undegraded":"2023-10-08T16:10:44.128506+0000","last_fullsized":"2023-10-08T16:10:44.128506+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:10.173684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142169+0000","last_change":"2023-10-08T16:10:45.142169+0000","last_active":"2023-10-08T16:10:45.142169+0000","last_peered":"2023-10-08T16:10:45.142169+0000","last_clean":"2023-10-08T16:10:45.142169+0000","last_became_active":"2023-10-08T16:10:45.141787+0000","last_became_peered":"2023-10-08T16:10:45.141787+0000","last_unstale":"2023-10-08T16:10:45.142169+0000","last_undegraded":"2023-10-08T16:10:45.142169+0000","last_fullsized":"2023-10-08T16:10:45.142169+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:11.265548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"116'3","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353247+0000","last_change":"2023-10-08T16:10:44.125504+0000","last_active":"2023-10-08T16:10:45.353247+0000","last_peered":"2023-10-08T16:10:45.353247+0000","last_clean":"2023-10-08T16:10:45.353247+0000","last_became_active":"2023-10-08T16:10:44.125376+0000","last_became_peered":"2023-10-08T16:10:44.125376+0000","last_unstale":"2023-10-08T16:10:45.353247+0000","last_undegraded":"2023-10-08T16:10:45.353247+0000","last_fullsized":"2023-10-08T16:10:45.353247+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:57:25.736720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144457+0000","last_change":"2023-10-08T16:10:45.144457+0000","last_active":"2023-10-08T16:10:45.144457+0000","last_peered":"2023-10-08T16:10:45.144457+0000","last_clean":"2023-10-08T16:10:45.144457+0000","last_became_active":"2023-10-08T16:10:45.144227+0000","last_became_peered":"2023-10-08T16:10:45.144227+0000","last_unstale":"2023-10-08T16:10:45.144457+0000","last_undegraded":"2023-10-08T16:10:45.144457+0000","last_fullsized":"2023-10-08T16:10:45.144457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"116'6","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.351814+0000","last_change":"2023-10-08T16:10:44.126610+0000","last_active":"2023-10-08T16:10:45.351814+0000","last_peered":"2023-10-08T16:10:45.351814+0000","last_clean":"2023-10-08T16:10:45.351814+0000","last_became_active":"2023-10-08T16:10:44.126404+0000","last_became_peered":"2023-10-08T16:10:44.126404+0000","last_unstale":"2023-10-08T16:10:45.351814+0000","last_undegraded":"2023-10-08T16:10:45.351814+0000","last_fullsized":"2023-10-08T16:10:45.351814+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:19.127577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.140255+0000","last_change":"2023-10-08T16:10:45.140255+0000","last_active":"2023-10-08T16:10:45.140255+0000","last_peered":"2023-10-08T16:10:45.140255+0000","last_clean":"2023-10-08T16:10:45.140255+0000","last_became_active":"2023-10-08T16:10:45.139743+0000","last_became_peered":"2023-10-08T16:10:45.139743+0000","last_unstale":"2023-10-08T16:10:45.140255+0000","last_undegraded":"2023-10-08T16:10:45.140255+0000","last_fullsized":"2023-10-08T16:10:45.140255+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.352003+0000","last_change":"2023-10-08T16:10:44.131408+0000","last_active":"2023-10-08T16:10:45.352003+0000","last_peered":"2023-10-08T16:10:45.352003+0000","last_clean":"2023-10-08T16:10:45.352003+0000","last_became_active":"2023-10-08T16:10:44.131008+0000","last_became_peered":"2023-10-08T16:10:44.131008+0000","last_unstale":"2023-10-08T16:10:45.352003+0000","last_undegraded":"2023-10-08T16:10:45.352003+0000","last_fullsized":"2023-10-08T16:10:45.352003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:34.496064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.147134+0000","last_change":"2023-10-08T16:10:45.147134+0000","last_active":"2023-10-08T16:10:45.147134+0000","last_peered":"2023-10-08T16:10:45.147134+0000","last_clean":"2023-10-08T16:10:45.147134+0000","last_became_active":"2023-10-08T16:10:45.146418+0000","last_became_peered":"2023-10-08T16:10:45.146418+0000","last_unstale":"2023-10-08T16:10:45.147134+0000","last_undegraded":"2023-10-08T16:10:45.147134+0000","last_fullsized":"2023-10-08T16:10:45.147134+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:34.440931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.129727+0000","last_change":"2023-10-08T16:10:44.129652+0000","last_active":"2023-10-08T16:10:44.129727+0000","last_peered":"2023-10-08T16:10:44.129727+0000","last_clean":"2023-10-08T16:10:44.129727+0000","last_became_active":"2023-10-08T16:10:44.129150+0000","last_became_peered":"2023-10-08T16:10:44.129150+0000","last_unstale":"2023-10-08T16:10:44.129727+0000","last_undegraded":"2023-10-08T16:10:44.129727+0000","last_fullsized":"2023-10-08T16:10:44.129727+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:10.382820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.133441+0000","last_change":"2023-10-08T16:10:45.133441+0000","last_active":"2023-10-08T16:10:45.133441+0000","last_peered":"2023-10-08T16:10:45.133441+0000","last_clean":"2023-10-08T16:10:45.133441+0000","last_became_active":"2023-10-08T16:10:45.133055+0000","last_became_peered":"2023-10-08T16:10:45.133055+0000","last_unstale":"2023-10-08T16:10:45.133441+0000","last_undegraded":"2023-10-08T16:10:45.133441+0000","last_fullsized":"2023-10-08T16:10:45.133441+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.126552+0000","last_change":"2023-10-08T16:10:44.126392+0000","last_active":"2023-10-08T16:10:44.126552+0000","last_peered":"2023-10-08T16:10:44.126552+0000","last_clean":"2023-10-08T16:10:44.126552+0000","last_became_active":"2023-10-08T16:10:44.126163+0000","last_became_peered":"2023-10-08T16:10:44.126163+0000","last_unstale":"2023-10-08T16:10:44.126552+0000","last_undegraded":"2023-10-08T16:10:44.126552+0000","last_fullsized":"2023-10-08T16:10:44.126552+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143081+0000","last_change":"2023-10-08T16:10:45.143081+0000","last_active":"2023-10-08T16:10:45.143081+0000","last_peered":"2023-10-08T16:10:45.143081+0000","last_clean":"2023-10-08T16:10:45.143081+0000","last_became_active":"2023-10-08T16:10:45.142624+0000","last_became_peered":"2023-10-08T16:10:45.142624+0000","last_unstale":"2023-10-08T16:10:45.143081+0000","last_undegraded":"2023-10-08T16:10:45.143081+0000","last_fullsized":"2023-10-08T16:10:45.143081+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.114242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"116'8","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.356823+0000","last_change":"2023-10-08T16:10:44.126307+0000","last_active":"2023-10-08T16:10:45.356823+0000","last_peered":"2023-10-08T16:10:45.356823+0000","last_clean":"2023-10-08T16:10:45.356823+0000","last_became_active":"2023-10-08T16:10:44.126083+0000","last_became_peered":"2023-10-08T16:10:44.126083+0000","last_unstale":"2023-10-08T16:10:45.356823+0000","last_undegraded":"2023-10-08T16:10:45.356823+0000","last_fullsized":"2023-10-08T16:10:45.356823+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:44.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142021+0000","last_change":"2023-10-08T16:10:45.142021+0000","last_active":"2023-10-08T16:10:45.142021+0000","last_peered":"2023-10-08T16:10:45.142021+0000","last_clean":"2023-10-08T16:10:45.142021+0000","last_became_active":"2023-10-08T16:10:45.141458+0000","last_became_peered":"2023-10-08T16:10:45.141458+0000","last_unstale":"2023-10-08T16:10:45.142021+0000","last_undegraded":"2023-10-08T16:10:45.142021+0000","last_fullsized":"2023-10-08T16:10:45.142021+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:03:23.193249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.350776+0000","last_change":"2023-10-08T16:10:44.124762+0000","last_active":"2023-10-08T16:10:45.350776+0000","last_peered":"2023-10-08T16:10:45.350776+0000","last_clean":"2023-10-08T16:10:45.350776+0000","last_became_active":"2023-10-08T16:10:44.124514+0000","last_became_peered":"2023-10-08T16:10:44.124514+0000","last_unstale":"2023-10-08T16:10:45.350776+0000","last_undegraded":"2023-10-08T16:10:45.350776+0000","last_fullsized":"2023-10-08T16:10:45.350776+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:22.910434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141589+0000","last_change":"2023-10-08T16:10:45.141589+0000","last_active":"2023-10-08T16:10:45.141589+0000","last_peered":"2023-10-08T16:10:45.141589+0000","last_clean":"2023-10-08T16:10:45.141589+0000","last_became_active":"2023-10-08T16:10:45.140961+0000","last_became_peered":"2023-10-08T16:10:45.140961+0000","last_unstale":"2023-10-08T16:10:45.141589+0000","last_undegraded":"2023-10-08T16:10:45.141589+0000","last_fullsized":"2023-10-08T16:10:45.141589+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137997+0000","last_change":"2023-10-08T16:10:44.120666+0000","last_active":"2023-10-08T16:10:45.137997+0000","last_peered":"2023-10-08T16:10:45.137997+0000","last_clean":"2023-10-08T16:10:45.137997+0000","last_became_active":"2023-10-08T16:10:44.120430+0000","last_became_peered":"2023-10-08T16:10:44.120430+0000","last_unstale":"2023-10-08T16:10:45.137997+0000","last_undegraded":"2023-10-08T16:10:45.137997+0000","last_fullsized":"2023-10-08T16:10:45.137997+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:19.127577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141532+0000","last_change":"2023-10-08T16:10:45.141532+0000","last_active":"2023-10-08T16:10:45.141532+0000","last_peered":"2023-10-08T16:10:45.141532+0000","last_clean":"2023-10-08T16:10:45.141532+0000","last_became_active":"2023-10-08T16:10:45.141176+0000","last_became_peered":"2023-10-08T16:10:45.141176+0000","last_unstale":"2023-10-08T16:10:45.141532+0000","last_undegraded":"2023-10-08T16:10:45.141532+0000","last_fullsized":"2023-10-08T16:10:45.141532+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.125420+0000","last_change":"2023-10-08T16:10:44.125208+0000","last_active":"2023-10-08T16:10:44.125420+0000","last_peered":"2023-10-08T16:10:44.125420+0000","last_clean":"2023-10-08T16:10:44.125420+0000","last_became_active":"2023-10-08T16:10:44.123804+0000","last_became_peered":"2023-10-08T16:10:44.123804+0000","last_unstale":"2023-10-08T16:10:44.125420+0000","last_undegraded":"2023-10-08T16:10:44.125420+0000","last_fullsized":"2023-10-08T16:10:44.125420+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:45:55.400400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142718+0000","last_change":"2023-10-08T16:10:45.142718+0000","last_active":"2023-10-08T16:10:45.142718+0000","last_peered":"2023-10-08T16:10:45.142718+0000","last_clean":"2023-10-08T16:10:45.142718+0000","last_became_active":"2023-10-08T16:10:45.139061+0000","last_became_peered":"2023-10-08T16:10:45.139061+0000","last_unstale":"2023-10-08T16:10:45.142718+0000","last_undegraded":"2023-10-08T16:10:45.142718+0000","last_fullsized":"2023-10-08T16:10:45.142718+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:08.011698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353792+0000","last_change":"2023-10-08T16:10:44.126921+0000","last_active":"2023-10-08T16:10:45.353792+0000","last_peered":"2023-10-08T16:10:45.353792+0000","last_clean":"2023-10-08T16:10:45.353792+0000","last_became_active":"2023-10-08T16:10:44.125234+0000","last_became_peered":"2023-10-08T16:10:44.125234+0000","last_unstale":"2023-10-08T16:10:45.353792+0000","last_undegraded":"2023-10-08T16:10:45.353792+0000","last_fullsized":"2023-10-08T16:10:45.353792+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:51.230999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143775+0000","last_change":"2023-10-08T16:10:45.143775+0000","last_active":"2023-10-08T16:10:45.143775+0000","last_peered":"2023-10-08T16:10:45.143775+0000","last_clean":"2023-10-08T16:10:45.143775+0000","last_became_active":"2023-10-08T16:10:45.143524+0000","last_became_peered":"2023-10-08T16:10:45.143524+0000","last_unstale":"2023-10-08T16:10:45.143775+0000","last_undegraded":"2023-10-08T16:10:45.143775+0000","last_fullsized":"2023-10-08T16:10:45.143775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:29.338793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.121144+0000","last_change":"2023-10-08T16:10:44.121064+0000","last_active":"2023-10-08T16:10:44.121144+0000","last_peered":"2023-10-08T16:10:44.121144+0000","last_clean":"2023-10-08T16:10:44.121144+0000","last_became_active":"2023-10-08T16:10:44.120854+0000","last_became_peered":"2023-10-08T16:10:44.120854+0000","last_unstale":"2023-10-08T16:10:44.121144+0000","last_undegraded":"2023-10-08T16:10:44.121144+0000","last_fullsized":"2023-10-08T16:10:44.121144+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:14.734975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139782+0000","last_change":"2023-10-08T16:10:45.139782+0000","last_active":"2023-10-08T16:10:45.139782+0000","last_peered":"2023-10-08T16:10:45.139782+0000","last_clean":"2023-10-08T16:10:45.139782+0000","last_became_active":"2023-10-08T16:10:45.139221+0000","last_became_peered":"2023-10-08T16:10:45.139221+0000","last_unstale":"2023-10-08T16:10:45.139782+0000","last_undegraded":"2023-10-08T16:10:45.139782+0000","last_fullsized":"2023-10-08T16:10:45.139782+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:02.585925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.123386+0000","last_change":"2023-10-08T16:10:44.123319+0000","last_active":"2023-10-08T16:10:44.123386+0000","last_peered":"2023-10-08T16:10:44.123386+0000","last_clean":"2023-10-08T16:10:44.123386+0000","last_became_active":"2023-10-08T16:10:44.123094+0000","last_became_peered":"2023-10-08T16:10:44.123094+0000","last_unstale":"2023-10-08T16:10:44.123386+0000","last_undegraded":"2023-10-08T16:10:44.123386+0000","last_fullsized":"2023-10-08T16:10:44.123386+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:58.572744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144961+0000","last_change":"2023-10-08T16:10:45.144961+0000","last_active":"2023-10-08T16:10:45.144961+0000","last_peered":"2023-10-08T16:10:45.144961+0000","last_clean":"2023-10-08T16:10:45.144961+0000","last_became_active":"2023-10-08T16:10:45.144440+0000","last_became_peered":"2023-10-08T16:10:45.144440+0000","last_unstale":"2023-10-08T16:10:45.144961+0000","last_undegraded":"2023-10-08T16:10:45.144961+0000","last_fullsized":"2023-10-08T16:10:45.144961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.126839+0000","last_change":"2023-10-08T16:10:44.126766+0000","last_active":"2023-10-08T16:10:44.126839+0000","last_peered":"2023-10-08T16:10:44.126839+0000","last_clean":"2023-10-08T16:10:44.126839+0000","last_became_active":"2023-10-08T16:10:44.126492+0000","last_became_peered":"2023-10-08T16:10:44.126492+0000","last_unstale":"2023-10-08T16:10:44.126839+0000","last_undegraded":"2023-10-08T16:10:44.126839+0000","last_fullsized":"2023-10-08T16:10:44.126839+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:17.380941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144469+0000","last_change":"2023-10-08T16:10:45.144469+0000","last_active":"2023-10-08T16:10:45.144469+0000","last_peered":"2023-10-08T16:10:45.144469+0000","last_clean":"2023-10-08T16:10:45.144469+0000","last_became_active":"2023-10-08T16:10:45.143596+0000","last_became_peered":"2023-10-08T16:10:45.143596+0000","last_unstale":"2023-10-08T16:10:45.144469+0000","last_undegraded":"2023-10-08T16:10:45.144469+0000","last_fullsized":"2023-10-08T16:10:45.144469+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:12.631202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353639+0000","last_change":"2023-10-08T16:10:44.120799+0000","last_active":"2023-10-08T16:10:45.353639+0000","last_peered":"2023-10-08T16:10:45.353639+0000","last_clean":"2023-10-08T16:10:45.353639+0000","last_became_active":"2023-10-08T16:10:44.120582+0000","last_became_peered":"2023-10-08T16:10:44.120582+0000","last_unstale":"2023-10-08T16:10:45.353639+0000","last_undegraded":"2023-10-08T16:10:45.353639+0000","last_fullsized":"2023-10-08T16:10:45.353639+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:38.100987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141363+0000","last_change":"2023-10-08T16:10:45.141363+0000","last_active":"2023-10-08T16:10:45.141363+0000","last_peered":"2023-10-08T16:10:45.141363+0000","last_clean":"2023-10-08T16:10:45.141363+0000","last_became_active":"2023-10-08T16:10:45.141128+0000","last_became_peered":"2023-10-08T16:10:45.141128+0000","last_unstale":"2023-10-08T16:10:45.141363+0000","last_undegraded":"2023-10-08T16:10:45.141363+0000","last_fullsized":"2023-10-08T16:10:45.141363+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:07.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.127157+0000","last_change":"2023-10-08T16:10:44.127079+0000","last_active":"2023-10-08T16:10:44.127157+0000","last_peered":"2023-10-08T16:10:44.127157+0000","last_clean":"2023-10-08T16:10:44.127157+0000","last_became_active":"2023-10-08T16:10:44.125508+0000","last_became_peered":"2023-10-08T16:10:44.125508+0000","last_unstale":"2023-10-08T16:10:44.127157+0000","last_undegraded":"2023-10-08T16:10:44.127157+0000","last_fullsized":"2023-10-08T16:10:44.127157+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:24.930529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142346+0000","last_change":"2023-10-08T16:10:45.142346+0000","last_active":"2023-10-08T16:10:45.142346+0000","last_peered":"2023-10-08T16:10:45.142346+0000","last_clean":"2023-10-08T16:10:45.142346+0000","last_became_active":"2023-10-08T16:10:45.141701+0000","last_became_peered":"2023-10-08T16:10:45.141701+0000","last_unstale":"2023-10-08T16:10:45.142346+0000","last_undegraded":"2023-10-08T16:10:45.142346+0000","last_fullsized":"2023-10-08T16:10:45.142346+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:01:52.188690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.121125+0000","last_change":"2023-10-08T16:10:44.121062+0000","last_active":"2023-10-08T16:10:44.121125+0000","last_peered":"2023-10-08T16:10:44.121125+0000","last_clean":"2023-10-08T16:10:44.121125+0000","last_became_active":"2023-10-08T16:10:44.120851+0000","last_became_peered":"2023-10-08T16:10:44.120851+0000","last_unstale":"2023-10-08T16:10:44.121125+0000","last_undegraded":"2023-10-08T16:10:44.121125+0000","last_fullsized":"2023-10-08T16:10:44.121125+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143057+0000","last_change":"2023-10-08T16:10:45.143057+0000","last_active":"2023-10-08T16:10:45.143057+0000","last_peered":"2023-10-08T16:10:45.143057+0000","last_clean":"2023-10-08T16:10:45.143057+0000","last_became_active":"2023-10-08T16:10:45.142808+0000","last_became_peered":"2023-10-08T16:10:45.142808+0000","last_unstale":"2023-10-08T16:10:45.143057+0000","last_undegraded":"2023-10-08T16:10:45.143057+0000","last_fullsized":"2023-10-08T16:10:45.143057+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.123312+0000","last_change":"2023-10-08T16:10:44.123232+0000","last_active":"2023-10-08T16:10:44.123312+0000","last_peered":"2023-10-08T16:10:44.123312+0000","last_clean":"2023-10-08T16:10:44.123312+0000","last_became_active":"2023-10-08T16:10:44.122998+0000","last_became_peered":"2023-10-08T16:10:44.122998+0000","last_unstale":"2023-10-08T16:10:44.123312+0000","last_undegraded":"2023-10-08T16:10:44.123312+0000","last_fullsized":"2023-10-08T16:10:44.123312+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142864+0000","last_change":"2023-10-08T16:10:45.142864+0000","last_active":"2023-10-08T16:10:45.142864+0000","last_peered":"2023-10-08T16:10:45.142864+0000","last_clean":"2023-10-08T16:10:45.142864+0000","last_became_active":"2023-10-08T16:10:45.142305+0000","last_became_peered":"2023-10-08T16:10:45.142305+0000","last_unstale":"2023-10-08T16:10:45.142864+0000","last_undegraded":"2023-10-08T16:10:45.142864+0000","last_fullsized":"2023-10-08T16:10:45.142864+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:25.220209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.122859+0000","last_change":"2023-10-08T16:10:44.122752+0000","last_active":"2023-10-08T16:10:44.122859+0000","last_peered":"2023-10-08T16:10:44.122859+0000","last_clean":"2023-10-08T16:10:44.122859+0000","last_became_active":"2023-10-08T16:10:44.122490+0000","last_became_peered":"2023-10-08T16:10:44.122490+0000","last_unstale":"2023-10-08T16:10:44.122859+0000","last_undegraded":"2023-10-08T16:10:44.122859+0000","last_fullsized":"2023-10-08T16:10:44.122859+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:10.173684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141014+0000","last_change":"2023-10-08T16:10:45.141014+0000","last_active":"2023-10-08T16:10:45.141014+0000","last_peered":"2023-10-08T16:10:45.141014+0000","last_clean":"2023-10-08T16:10:45.141014+0000","last_became_active":"2023-10-08T16:10:45.140754+0000","last_became_peered":"2023-10-08T16:10:45.140754+0000","last_unstale":"2023-10-08T16:10:45.141014+0000","last_undegraded":"2023-10-08T16:10:45.141014+0000","last_fullsized":"2023-10-08T16:10:45.141014+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:45.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.121604+0000","last_change":"2023-10-08T16:10:44.121310+0000","last_active":"2023-10-08T16:10:44.121604+0000","last_peered":"2023-10-08T16:10:44.121604+0000","last_clean":"2023-10-08T16:10:44.121604+0000","last_became_active":"2023-10-08T16:10:44.120986+0000","last_became_peered":"2023-10-08T16:10:44.120986+0000","last_unstale":"2023-10-08T16:10:44.121604+0000","last_undegraded":"2023-10-08T16:10:44.121604+0000","last_fullsized":"2023-10-08T16:10:44.121604+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:10.173684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142514+0000","last_change":"2023-10-08T16:10:45.142514+0000","last_active":"2023-10-08T16:10:45.142514+0000","last_peered":"2023-10-08T16:10:45.142514+0000","last_clean":"2023-10-08T16:10:45.142514+0000","last_became_active":"2023-10-08T16:10:45.138751+0000","last_became_peered":"2023-10-08T16:10:45.138751+0000","last_unstale":"2023-10-08T16:10:45.142514+0000","last_undegraded":"2023-10-08T16:10:45.142514+0000","last_fullsized":"2023-10-08T16:10:45.142514+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:06.092659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.128986+0000","last_change":"2023-10-08T16:10:44.128920+0000","last_active":"2023-10-08T16:10:44.128986+0000","last_peered":"2023-10-08T16:10:44.128986+0000","last_clean":"2023-10-08T16:10:44.128986+0000","last_became_active":"2023-10-08T16:10:44.128672+0000","last_became_peered":"2023-10-08T16:10:44.128672+0000","last_unstale":"2023-10-08T16:10:44.128986+0000","last_undegraded":"2023-10-08T16:10:44.128986+0000","last_fullsized":"2023-10-08T16:10:44.128986+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145988+0000","last_change":"2023-10-08T16:10:45.145988+0000","last_active":"2023-10-08T16:10:45.145988+0000","last_peered":"2023-10-08T16:10:45.145988+0000","last_clean":"2023-10-08T16:10:45.145988+0000","last_became_active":"2023-10-08T16:10:45.145375+0000","last_became_peered":"2023-10-08T16:10:45.145375+0000","last_unstale":"2023-10-08T16:10:45.145988+0000","last_undegraded":"2023-10-08T16:10:45.145988+0000","last_fullsized":"2023-10-08T16:10:45.145988+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.122243+0000","last_change":"2023-10-08T16:10:44.122139+0000","last_active":"2023-10-08T16:10:44.122243+0000","last_peered":"2023-10-08T16:10:44.122243+0000","last_clean":"2023-10-08T16:10:44.122243+0000","last_became_active":"2023-10-08T16:10:44.121885+0000","last_became_peered":"2023-10-08T16:10:44.121885+0000","last_unstale":"2023-10-08T16:10:44.122243+0000","last_undegraded":"2023-10-08T16:10:44.122243+0000","last_fullsized":"2023-10-08T16:10:44.122243+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:50.741676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.140529+0000","last_change":"2023-10-08T16:10:45.140529+0000","last_active":"2023-10-08T16:10:45.140529+0000","last_peered":"2023-10-08T16:10:45.140529+0000","last_clean":"2023-10-08T16:10:45.140529+0000","last_became_active":"2023-10-08T16:10:45.140279+0000","last_became_peered":"2023-10-08T16:10:45.140279+0000","last_unstale":"2023-10-08T16:10:45.140529+0000","last_undegraded":"2023-10-08T16:10:45.140529+0000","last_fullsized":"2023-10-08T16:10:45.140529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:05.475701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137133+0000","last_change":"2023-10-08T16:10:44.124947+0000","last_active":"2023-10-08T16:10:45.137133+0000","last_peered":"2023-10-08T16:10:45.137133+0000","last_clean":"2023-10-08T16:10:45.137133+0000","last_became_active":"2023-10-08T16:10:44.124779+0000","last_became_peered":"2023-10-08T16:10:44.124779+0000","last_unstale":"2023-10-08T16:10:45.137133+0000","last_undegraded":"2023-10-08T16:10:45.137133+0000","last_fullsized":"2023-10-08T16:10:45.137133+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:51.908269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.122127+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:10:44.122127+0000","last_peered":"2023-10-08T16:10:44.122127+0000","last_clean":"2023-10-08T16:10:44.122127+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:10:44.122127+0000","last_undegraded":"2023-10-08T16:10:44.122127+0000","last_fullsized":"2023-10-08T16:10:44.122127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1190,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194122,"statfs":{"total":200000000,"available":198780992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73399999999999999,"5min":1.756,"15min":1.756},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72499999999999998,"5min":1.79,"15min":1.79},"last":0.46000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":1.823,"15min":1.823},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.44400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":1.252,"15min":1.252},"last":0.56599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.57899999999999996,"15min":0.55300000000000005},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.54600000000000004},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78900000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.621}]},{"osd":5,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65700000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74299999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39800000000000002,"15min":0.47999999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.46800000000000003,"5min":3.593,"15min":3.593},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.437,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.46899999999999997},"min":{"1min":0.222,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57299999999999995,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.317},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.27700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42099999999999999,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.55100000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.25}]},{"osd":4,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.70899999999999996},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84799999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.503},{"interface":"front","average":{"1min":0.623,"5min":0.64100000000000001,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78500000000000003,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.72999999999999998},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":3.532,"15min":3.532},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90700000000000003,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.44800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79900000000000004,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.38700000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":1.095,"15min":1.095},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86199999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.42799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194114,"statfs":{"total":200000000,"available":198773675,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48899999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.66600000000000004,"5min":2.254,"15min":2.254},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.379},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58199999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.374},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72999999999999998,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.378},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83399999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91500000000000004,"5min":1.079,"15min":1.079},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.875,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93799999999999994,"5min":2.355,"15min":2.355},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64200000000000002,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98199999999999998,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":1.002,"15min":1.002},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.246,"5min":0.185,"15min":0.185},"max":{"1min":0.52900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40799999999999997,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56499999999999995,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.746,"15min":0.746},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61699999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.313}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.44},"min":{"1min":0.32000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.44500000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.018,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.67000000000000004},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.046,"5min":1.091,"15min":1.091},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.624},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.499,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34000000000000002,"15min":0.313},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44900000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.45000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.56299999999999994,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.46800000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41399999999999998,"15min":0.39400000000000002},"min":{"1min":0.28999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.502}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.754,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69599999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.621,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78000000000000003,"5min":0.999,"15min":0.999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76800000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362937,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82999999999999996,"5min":1.141,"15min":1.141},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":1.149,"15min":1.149},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89700000000000002,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.875,"5min":14.6,"15min":14.6},"last":0.503}]},{"osd":3,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.63200000000000001,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":7.556,"15min":7.556},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.754,"15min":0.754},"last":0.628}]},{"osd":6,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.621},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51000000000000001,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.505},{"interface":"front","average":{"1min":0.495,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71499999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60599999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55700000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61799999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59799999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58499999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56899999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.628}]}]}],"pool_statfs":[]}} 2023-10-08T16:10:49.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:49.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.652+0000 7f12bd2c7700 1 Processor -- start 2023-10-08T16:10:49.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.652+0000 7f12bd2c7700 1 -- start start 2023-10-08T16:10:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12bd2c7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12b80cf1c0 0x7f12b815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12bd2c7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80cca20 con 0x7f12b815a0c0 2023-10-08T16:10:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12bd2c7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b815ea40 con 0x7f12b8159cf0 2023-10-08T16:10:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12bd2c7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b8067660 con 0x7f12b80cf1c0 2023-10-08T16:10:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12b67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12b80cf1c0 0x7f12b815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12b77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f12b815a0c0 0x7f12b8068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55960/0 (socket says 172.21.15.60:55960) 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.653+0000 7f12b77fe700 1 -- 172.21.15.60:0/2664138805 learned_addr learned my addr 172.21.15.60:0/2664138805 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b67fc700 1 -- 172.21.15.60:0/2664138805 >> v1:172.21.15.144:6789/0 conn(0x7f12b8159cf0 legacy=0x7f12b80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b67fc700 1 -- 172.21.15.60:0/2664138805 >> v1:172.21.15.60:6789/0 conn(0x7f12b815a0c0 legacy=0x7f12b8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b67fc700 1 -- 172.21.15.60:0/2664138805 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8067f00 con 0x7f12b80cf1c0 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b67fc700 1 --2- 172.21.15.60:0/2664138805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80cf1c0 0x7f12b815e500 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f12a00098e0 tx=0x7f12a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e517a3d7543b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b5ffb700 1 -- 172.21.15.60:0/2664138805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0009e80 con 0x7f12b80cf1c0 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b5ffb700 1 -- 172.21.15.60:0/2664138805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a000b760 con 0x7f12b80cf1c0 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12b5ffb700 1 -- 172.21.15.60:0/2664138805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000bae0 con 0x7f12b80cf1c0 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12bd2c7700 1 -- 172.21.15.60:0/2664138805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80cf1c0 msgr2=0x7f12b815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/2664138805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80cf1c0 0x7f12b815e500 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f12a00098e0 tx=0x7f12a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12bd2c7700 1 -- 172.21.15.60:0/2664138805 shutdown_connections 2023-10-08T16:10:49.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/2664138805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b80cf1c0 0x7f12b815e500 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.654+0000 7f12bd2c7700 1 -- 172.21.15.60:0/2664138805 >> 172.21.15.60:0/2664138805 conn(0x7f12b806c6e0 msgr2=0x7f12b8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.655+0000 7f12bd2c7700 1 -- 172.21.15.60:0/2664138805 shutdown_connections 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.655+0000 7f12bd2c7700 1 -- 172.21.15.60:0/2664138805 wait complete. 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.656+0000 7f12bd2c7700 1 Processor -- start 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.656+0000 7f12bd2c7700 1 -- start start 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12b80cf1c0 0x7f12b815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12b8159cf0 0x7f12b8157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 0x7f12b815d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8158070 con 0x7f12b815a0c0 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b4340 con 0x7f12b80cf1c0 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b3730 con 0x7f12b8159cf0 2023-10-08T16:10:49.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 0x7f12b815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 0x7f12b815d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36714/0 (socket says 172.21.15.60:36714) 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 -- 172.21.15.60:0/3940801167 learned_addr learned my addr 172.21.15.60:0/3940801167 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b6ffd700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12b80cf1c0 0x7f12b815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b67fc700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12b8159cf0 0x7f12b8157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 -- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12b8159cf0 msgr2=0x7f12b8157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12b8159cf0 0x7f12b8157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 -- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12b80cf1c0 msgr2=0x7f12b815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12b80cf1c0 0x7f12b815b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 -- 172.21.15.60:0/3940801167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0009420 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12b77fe700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 0x7f12b815d100 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c7e0 tx=0x7f12b0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0005b30 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b0005c90 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0007320 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b80b3a10 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.657+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b80b3fd0 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.658+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b80b44b0 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.659+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12b001b3b0 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.659+0000 7f12aeffd700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1298066f30 0x7f12980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.659+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12b0083980 con 0x7f12b815a0c0 2023-10-08T16:10:49.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.659+0000 7f12b6ffd700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1298066f30 0x7f12980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:49.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.660+0000 7f12b6ffd700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1298066f30 0x7f12980693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f12a8007fd0 tx=0x7f12a80016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:49.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.663+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12b0050bf0 con 0x7f12b815a0c0 2023-10-08T16:10:49.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.852+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12b804c3c0 con 0x7f1298066f30 2023-10-08T16:10:49.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.860+0000 7f12aeffd700 1 -- 172.21.15.60:0/3940801167 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285354 (secure 0 0 0) 0x7f12b804c3c0 con 0x7f1298066f30 2023-10-08T16:10:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:49.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1298066f30 msgr2=0x7f12980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1298066f30 0x7f12980693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f12a8007fd0 tx=0x7f12a80016f0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 msgr2=0x7f12b815d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 0x7f12b815d100 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c7e0 tx=0x7f12b0007ea0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 shutdown_connections 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1298066f30 0x7f12980693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12b815a0c0 0x7f12b815d100 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12b80cf1c0 0x7f12b815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 --2- 172.21.15.60:0/3940801167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12b8159cf0 0x7f12b8157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 >> 172.21.15.60:0/3940801167 conn(0x7f12b806c6e0 msgr2=0x7f12b8158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 shutdown_connections 2023-10-08T16:10:49.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:49.863+0000 7f12bd2c7700 1 -- 172.21.15.60:0/3940801167 wait complete. 2023-10-08T16:10:49.868 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:10:49.877 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2023-10-08T16:10:49.635115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6092,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556407,"statfs":{"total":1600000000,"available":1593760878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000954"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137233+0000","last_change":"2023-10-08T16:10:45.137233+0000","last_active":"2023-10-08T16:10:45.137233+0000","last_peered":"2023-10-08T16:10:45.137233+0000","last_clean":"2023-10-08T16:10:45.137233+0000","last_became_active":"2023-10-08T16:10:45.137006+0000","last_became_peered":"2023-10-08T16:10:45.137006+0000","last_unstale":"2023-10-08T16:10:45.137233+0000","last_undegraded":"2023-10-08T16:10:45.137233+0000","last_fullsized":"2023-10-08T16:10:45.137233+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:20.134047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145622+0000","last_change":"2023-10-08T16:10:45.145622+0000","last_active":"2023-10-08T16:10:45.145622+0000","last_peered":"2023-10-08T16:10:45.145622+0000","last_clean":"2023-10-08T16:10:45.145622+0000","last_became_active":"2023-10-08T16:10:45.145075+0000","last_became_peered":"2023-10-08T16:10:45.145075+0000","last_unstale":"2023-10-08T16:10:45.145622+0000","last_undegraded":"2023-10-08T16:10:45.145622+0000","last_fullsized":"2023-10-08T16:10:45.145622+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:20.091814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.136612+0000","last_change":"2023-10-08T16:10:45.136612+0000","last_active":"2023-10-08T16:10:45.136612+0000","last_peered":"2023-10-08T16:10:45.136612+0000","last_clean":"2023-10-08T16:10:45.136612+0000","last_became_active":"2023-10-08T16:10:45.136376+0000","last_became_peered":"2023-10-08T16:10:45.136376+0000","last_unstale":"2023-10-08T16:10:45.136612+0000","last_undegraded":"2023-10-08T16:10:45.136612+0000","last_fullsized":"2023-10-08T16:10:45.136612+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:39.107457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141456+0000","last_change":"2023-10-08T16:10:45.141456+0000","last_active":"2023-10-08T16:10:45.141456+0000","last_peered":"2023-10-08T16:10:45.141456+0000","last_clean":"2023-10-08T16:10:45.141456+0000","last_became_active":"2023-10-08T16:10:45.141233+0000","last_became_peered":"2023-10-08T16:10:45.141233+0000","last_unstale":"2023-10-08T16:10:45.141456+0000","last_undegraded":"2023-10-08T16:10:45.141456+0000","last_fullsized":"2023-10-08T16:10:45.141456+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:26.485355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.146639+0000","last_change":"2023-10-08T16:10:45.146639+0000","last_active":"2023-10-08T16:10:45.146639+0000","last_peered":"2023-10-08T16:10:45.146639+0000","last_clean":"2023-10-08T16:10:45.146639+0000","last_became_active":"2023-10-08T16:10:45.146503+0000","last_became_peered":"2023-10-08T16:10:45.146503+0000","last_unstale":"2023-10-08T16:10:45.146639+0000","last_undegraded":"2023-10-08T16:10:45.146639+0000","last_fullsized":"2023-10-08T16:10:45.146639+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:23.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143074+0000","last_change":"2023-10-08T16:10:45.143074+0000","last_active":"2023-10-08T16:10:45.143074+0000","last_peered":"2023-10-08T16:10:45.143074+0000","last_clean":"2023-10-08T16:10:45.143074+0000","last_became_active":"2023-10-08T16:10:45.142672+0000","last_became_peered":"2023-10-08T16:10:45.142672+0000","last_unstale":"2023-10-08T16:10:45.143074+0000","last_undegraded":"2023-10-08T16:10:45.143074+0000","last_fullsized":"2023-10-08T16:10:45.143074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:26.485355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142815+0000","last_change":"2023-10-08T16:10:45.142815+0000","last_active":"2023-10-08T16:10:45.142815+0000","last_peered":"2023-10-08T16:10:45.142815+0000","last_clean":"2023-10-08T16:10:45.142815+0000","last_became_active":"2023-10-08T16:10:45.142326+0000","last_became_peered":"2023-10-08T16:10:45.142326+0000","last_unstale":"2023-10-08T16:10:45.142815+0000","last_undegraded":"2023-10-08T16:10:45.142815+0000","last_fullsized":"2023-10-08T16:10:45.142815+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:25.936999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144928+0000","last_change":"2023-10-08T16:10:45.144928+0000","last_active":"2023-10-08T16:10:45.144928+0000","last_peered":"2023-10-08T16:10:45.144928+0000","last_clean":"2023-10-08T16:10:45.144928+0000","last_became_active":"2023-10-08T16:10:45.144244+0000","last_became_peered":"2023-10-08T16:10:45.144244+0000","last_unstale":"2023-10-08T16:10:45.144928+0000","last_undegraded":"2023-10-08T16:10:45.144928+0000","last_fullsized":"2023-10-08T16:10:45.144928+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:56.113743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134308+0000","last_change":"2023-10-08T16:10:45.134308+0000","last_active":"2023-10-08T16:10:45.134308+0000","last_peered":"2023-10-08T16:10:45.134308+0000","last_clean":"2023-10-08T16:10:45.134308+0000","last_became_active":"2023-10-08T16:10:45.133244+0000","last_became_peered":"2023-10-08T16:10:45.133244+0000","last_unstale":"2023-10-08T16:10:45.134308+0000","last_undegraded":"2023-10-08T16:10:45.134308+0000","last_fullsized":"2023-10-08T16:10:45.134308+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:23.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145117+0000","last_change":"2023-10-08T16:10:45.145117+0000","last_active":"2023-10-08T16:10:45.145117+0000","last_peered":"2023-10-08T16:10:45.145117+0000","last_clean":"2023-10-08T16:10:45.145117+0000","last_became_active":"2023-10-08T16:10:45.144739+0000","last_became_peered":"2023-10-08T16:10:45.144739+0000","last_unstale":"2023-10-08T16:10:45.145117+0000","last_undegraded":"2023-10-08T16:10:45.145117+0000","last_fullsized":"2023-10-08T16:10:45.145117+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141391+0000","last_change":"2023-10-08T16:10:45.141391+0000","last_active":"2023-10-08T16:10:45.141391+0000","last_peered":"2023-10-08T16:10:45.141391+0000","last_clean":"2023-10-08T16:10:45.141391+0000","last_became_active":"2023-10-08T16:10:45.140843+0000","last_became_peered":"2023-10-08T16:10:45.140843+0000","last_unstale":"2023-10-08T16:10:45.141391+0000","last_undegraded":"2023-10-08T16:10:45.141391+0000","last_fullsized":"2023-10-08T16:10:45.141391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.135820+0000","last_change":"2023-10-08T16:10:45.135820+0000","last_active":"2023-10-08T16:10:45.135820+0000","last_peered":"2023-10-08T16:10:45.135820+0000","last_clean":"2023-10-08T16:10:45.135820+0000","last_became_active":"2023-10-08T16:10:45.135585+0000","last_became_peered":"2023-10-08T16:10:45.135585+0000","last_unstale":"2023-10-08T16:10:45.135820+0000","last_undegraded":"2023-10-08T16:10:45.135820+0000","last_fullsized":"2023-10-08T16:10:45.135820+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.133150+0000","last_change":"2023-10-08T16:10:45.133150+0000","last_active":"2023-10-08T16:10:45.133150+0000","last_peered":"2023-10-08T16:10:45.133150+0000","last_clean":"2023-10-08T16:10:45.133150+0000","last_became_active":"2023-10-08T16:10:45.132921+0000","last_became_peered":"2023-10-08T16:10:45.132921+0000","last_unstale":"2023-10-08T16:10:45.133150+0000","last_undegraded":"2023-10-08T16:10:45.133150+0000","last_fullsized":"2023-10-08T16:10:45.133150+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:45.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144165+0000","last_change":"2023-10-08T16:10:45.144165+0000","last_active":"2023-10-08T16:10:45.144165+0000","last_peered":"2023-10-08T16:10:45.144165+0000","last_clean":"2023-10-08T16:10:45.144165+0000","last_became_active":"2023-10-08T16:10:45.143010+0000","last_became_peered":"2023-10-08T16:10:45.143010+0000","last_unstale":"2023-10-08T16:10:45.144165+0000","last_undegraded":"2023-10-08T16:10:45.144165+0000","last_fullsized":"2023-10-08T16:10:45.144165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:52.210022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137014+0000","last_change":"2023-10-08T16:10:45.137014+0000","last_active":"2023-10-08T16:10:45.137014+0000","last_peered":"2023-10-08T16:10:45.137014+0000","last_clean":"2023-10-08T16:10:45.137014+0000","last_became_active":"2023-10-08T16:10:45.136484+0000","last_became_peered":"2023-10-08T16:10:45.136484+0000","last_unstale":"2023-10-08T16:10:45.137014+0000","last_undegraded":"2023-10-08T16:10:45.137014+0000","last_fullsized":"2023-10-08T16:10:45.137014+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:23.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142920+0000","last_change":"2023-10-08T16:10:45.142920+0000","last_active":"2023-10-08T16:10:45.142920+0000","last_peered":"2023-10-08T16:10:45.142920+0000","last_clean":"2023-10-08T16:10:45.142920+0000","last_became_active":"2023-10-08T16:10:45.142113+0000","last_became_peered":"2023-10-08T16:10:45.142113+0000","last_unstale":"2023-10-08T16:10:45.142920+0000","last_undegraded":"2023-10-08T16:10:45.142920+0000","last_fullsized":"2023-10-08T16:10:45.142920+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:45.127911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141481+0000","last_change":"2023-10-08T16:10:45.141481+0000","last_active":"2023-10-08T16:10:45.141481+0000","last_peered":"2023-10-08T16:10:45.141481+0000","last_clean":"2023-10-08T16:10:45.141481+0000","last_became_active":"2023-10-08T16:10:45.140983+0000","last_became_peered":"2023-10-08T16:10:45.140983+0000","last_unstale":"2023-10-08T16:10:45.141481+0000","last_undegraded":"2023-10-08T16:10:45.141481+0000","last_fullsized":"2023-10-08T16:10:45.141481+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:48.891999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137650+0000","last_change":"2023-10-08T16:10:45.137650+0000","last_active":"2023-10-08T16:10:45.137650+0000","last_peered":"2023-10-08T16:10:45.137650+0000","last_clean":"2023-10-08T16:10:45.137650+0000","last_became_active":"2023-10-08T16:10:45.137381+0000","last_became_peered":"2023-10-08T16:10:45.137381+0000","last_unstale":"2023-10-08T16:10:45.137650+0000","last_undegraded":"2023-10-08T16:10:45.137650+0000","last_fullsized":"2023-10-08T16:10:45.137650+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143736+0000","last_change":"2023-10-08T16:10:45.143736+0000","last_active":"2023-10-08T16:10:45.143736+0000","last_peered":"2023-10-08T16:10:45.143736+0000","last_clean":"2023-10-08T16:10:45.143736+0000","last_became_active":"2023-10-08T16:10:45.142269+0000","last_became_peered":"2023-10-08T16:10:45.142269+0000","last_unstale":"2023-10-08T16:10:45.143736+0000","last_undegraded":"2023-10-08T16:10:45.143736+0000","last_fullsized":"2023-10-08T16:10:45.143736+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:37.002560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.132971+0000","last_change":"2023-10-08T16:10:45.132971+0000","last_active":"2023-10-08T16:10:45.132971+0000","last_peered":"2023-10-08T16:10:45.132971+0000","last_clean":"2023-10-08T16:10:45.132971+0000","last_became_active":"2023-10-08T16:10:45.132722+0000","last_became_peered":"2023-10-08T16:10:45.132722+0000","last_unstale":"2023-10-08T16:10:45.132971+0000","last_undegraded":"2023-10-08T16:10:45.132971+0000","last_fullsized":"2023-10-08T16:10:45.132971+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:07.726133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139916+0000","last_change":"2023-10-08T16:10:45.139916+0000","last_active":"2023-10-08T16:10:45.139916+0000","last_peered":"2023-10-08T16:10:45.139916+0000","last_clean":"2023-10-08T16:10:45.139916+0000","last_became_active":"2023-10-08T16:10:45.139537+0000","last_became_peered":"2023-10-08T16:10:45.139537+0000","last_unstale":"2023-10-08T16:10:45.139916+0000","last_undegraded":"2023-10-08T16:10:45.139916+0000","last_fullsized":"2023-10-08T16:10:45.139916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:13.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141616+0000","last_change":"2023-10-08T16:10:45.141616+0000","last_active":"2023-10-08T16:10:45.141616+0000","last_peered":"2023-10-08T16:10:45.141616+0000","last_clean":"2023-10-08T16:10:45.141616+0000","last_became_active":"2023-10-08T16:10:45.141266+0000","last_became_peered":"2023-10-08T16:10:45.141266+0000","last_unstale":"2023-10-08T16:10:45.141616+0000","last_undegraded":"2023-10-08T16:10:45.141616+0000","last_fullsized":"2023-10-08T16:10:45.141616+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:06.260928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144605+0000","last_change":"2023-10-08T16:10:45.144605+0000","last_active":"2023-10-08T16:10:45.144605+0000","last_peered":"2023-10-08T16:10:45.144605+0000","last_clean":"2023-10-08T16:10:45.144605+0000","last_became_active":"2023-10-08T16:10:45.143917+0000","last_became_peered":"2023-10-08T16:10:45.143917+0000","last_unstale":"2023-10-08T16:10:45.144605+0000","last_undegraded":"2023-10-08T16:10:45.144605+0000","last_fullsized":"2023-10-08T16:10:45.144605+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:02.129509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142606+0000","last_change":"2023-10-08T16:10:45.142606+0000","last_active":"2023-10-08T16:10:45.142606+0000","last_peered":"2023-10-08T16:10:45.142606+0000","last_clean":"2023-10-08T16:10:45.142606+0000","last_became_active":"2023-10-08T16:10:45.142338+0000","last_became_peered":"2023-10-08T16:10:45.142338+0000","last_unstale":"2023-10-08T16:10:45.142606+0000","last_undegraded":"2023-10-08T16:10:45.142606+0000","last_fullsized":"2023-10-08T16:10:45.142606+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142806+0000","last_change":"2023-10-08T16:10:45.142806+0000","last_active":"2023-10-08T16:10:45.142806+0000","last_peered":"2023-10-08T16:10:45.142806+0000","last_clean":"2023-10-08T16:10:45.142806+0000","last_became_active":"2023-10-08T16:10:45.142498+0000","last_became_peered":"2023-10-08T16:10:45.142498+0000","last_unstale":"2023-10-08T16:10:45.142806+0000","last_undegraded":"2023-10-08T16:10:45.142806+0000","last_fullsized":"2023-10-08T16:10:45.142806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:07.726133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144433+0000","last_change":"2023-10-08T16:10:45.144433+0000","last_active":"2023-10-08T16:10:45.144433+0000","last_peered":"2023-10-08T16:10:45.144433+0000","last_clean":"2023-10-08T16:10:45.144433+0000","last_became_active":"2023-10-08T16:10:45.143930+0000","last_became_peered":"2023-10-08T16:10:45.143930+0000","last_unstale":"2023-10-08T16:10:45.144433+0000","last_undegraded":"2023-10-08T16:10:45.144433+0000","last_fullsized":"2023-10-08T16:10:45.144433+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:13.522062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143611+0000","last_change":"2023-10-08T16:10:45.143611+0000","last_active":"2023-10-08T16:10:45.143611+0000","last_peered":"2023-10-08T16:10:45.143611+0000","last_clean":"2023-10-08T16:10:45.143611+0000","last_became_active":"2023-10-08T16:10:45.143369+0000","last_became_peered":"2023-10-08T16:10:45.143369+0000","last_unstale":"2023-10-08T16:10:45.143611+0000","last_undegraded":"2023-10-08T16:10:45.143611+0000","last_fullsized":"2023-10-08T16:10:45.143611+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:38.333090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.146151+0000","last_change":"2023-10-08T16:10:45.146151+0000","last_active":"2023-10-08T16:10:45.146151+0000","last_peered":"2023-10-08T16:10:45.146151+0000","last_clean":"2023-10-08T16:10:45.146151+0000","last_became_active":"2023-10-08T16:10:45.145735+0000","last_became_peered":"2023-10-08T16:10:45.145735+0000","last_unstale":"2023-10-08T16:10:45.146151+0000","last_undegraded":"2023-10-08T16:10:45.146151+0000","last_fullsized":"2023-10-08T16:10:45.146151+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:45.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142956+0000","last_change":"2023-10-08T16:10:45.142956+0000","last_active":"2023-10-08T16:10:45.142956+0000","last_peered":"2023-10-08T16:10:45.142956+0000","last_clean":"2023-10-08T16:10:45.142956+0000","last_became_active":"2023-10-08T16:10:45.142662+0000","last_became_peered":"2023-10-08T16:10:45.142662+0000","last_unstale":"2023-10-08T16:10:45.142956+0000","last_undegraded":"2023-10-08T16:10:45.142956+0000","last_fullsized":"2023-10-08T16:10:45.142956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:03.330905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143744+0000","last_change":"2023-10-08T16:10:45.143744+0000","last_active":"2023-10-08T16:10:45.143744+0000","last_peered":"2023-10-08T16:10:45.143744+0000","last_clean":"2023-10-08T16:10:45.143744+0000","last_became_active":"2023-10-08T16:10:45.143471+0000","last_became_peered":"2023-10-08T16:10:45.143471+0000","last_unstale":"2023-10-08T16:10:45.143744+0000","last_undegraded":"2023-10-08T16:10:45.143744+0000","last_fullsized":"2023-10-08T16:10:45.143744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:45.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.140373+0000","last_change":"2023-10-08T16:10:45.140373+0000","last_active":"2023-10-08T16:10:45.140373+0000","last_peered":"2023-10-08T16:10:45.140373+0000","last_clean":"2023-10-08T16:10:45.140373+0000","last_became_active":"2023-10-08T16:10:45.140048+0000","last_became_peered":"2023-10-08T16:10:45.140048+0000","last_unstale":"2023-10-08T16:10:45.140373+0000","last_undegraded":"2023-10-08T16:10:45.140373+0000","last_fullsized":"2023-10-08T16:10:45.140373+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143756+0000","last_change":"2023-10-08T16:10:45.143756+0000","last_active":"2023-10-08T16:10:45.143756+0000","last_peered":"2023-10-08T16:10:45.143756+0000","last_clean":"2023-10-08T16:10:45.143756+0000","last_became_active":"2023-10-08T16:10:45.143523+0000","last_became_peered":"2023-10-08T16:10:45.143523+0000","last_unstale":"2023-10-08T16:10:45.143756+0000","last_undegraded":"2023-10-08T16:10:45.143756+0000","last_fullsized":"2023-10-08T16:10:45.143756+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:23.916903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144394+0000","last_change":"2023-10-08T16:10:45.144394+0000","last_active":"2023-10-08T16:10:45.144394+0000","last_peered":"2023-10-08T16:10:45.144394+0000","last_clean":"2023-10-08T16:10:45.144394+0000","last_became_active":"2023-10-08T16:10:45.143447+0000","last_became_peered":"2023-10-08T16:10:45.143447+0000","last_unstale":"2023-10-08T16:10:45.144394+0000","last_undegraded":"2023-10-08T16:10:45.144394+0000","last_fullsized":"2023-10-08T16:10:45.144394+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:00.767634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"116'4","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353674+0000","last_change":"2023-10-08T16:10:44.127360+0000","last_active":"2023-10-08T16:10:45.353674+0000","last_peered":"2023-10-08T16:10:45.353674+0000","last_clean":"2023-10-08T16:10:45.353674+0000","last_became_active":"2023-10-08T16:10:44.126142+0000","last_became_peered":"2023-10-08T16:10:44.126142+0000","last_unstale":"2023-10-08T16:10:45.353674+0000","last_undegraded":"2023-10-08T16:10:45.353674+0000","last_fullsized":"2023-10-08T16:10:45.353674+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:25.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141815+0000","last_change":"2023-10-08T16:10:45.141815+0000","last_active":"2023-10-08T16:10:45.141815+0000","last_peered":"2023-10-08T16:10:45.141815+0000","last_clean":"2023-10-08T16:10:45.141815+0000","last_became_active":"2023-10-08T16:10:45.141615+0000","last_became_peered":"2023-10-08T16:10:45.141615+0000","last_unstale":"2023-10-08T16:10:45.141815+0000","last_undegraded":"2023-10-08T16:10:45.141815+0000","last_fullsized":"2023-10-08T16:10:45.141815+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137026+0000","last_change":"2023-10-08T16:10:44.127672+0000","last_active":"2023-10-08T16:10:45.137026+0000","last_peered":"2023-10-08T16:10:45.137026+0000","last_clean":"2023-10-08T16:10:45.137026+0000","last_became_active":"2023-10-08T16:10:44.127436+0000","last_became_peered":"2023-10-08T16:10:44.127436+0000","last_unstale":"2023-10-08T16:10:45.137026+0000","last_undegraded":"2023-10-08T16:10:45.137026+0000","last_fullsized":"2023-10-08T16:10:45.137026+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:59.866517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141801+0000","last_change":"2023-10-08T16:10:45.141801+0000","last_active":"2023-10-08T16:10:45.141801+0000","last_peered":"2023-10-08T16:10:45.141801+0000","last_clean":"2023-10-08T16:10:45.141801+0000","last_became_active":"2023-10-08T16:10:45.141112+0000","last_became_peered":"2023-10-08T16:10:45.141112+0000","last_unstale":"2023-10-08T16:10:45.141801+0000","last_undegraded":"2023-10-08T16:10:45.141801+0000","last_fullsized":"2023-10-08T16:10:45.141801+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:00.872986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.352069+0000","last_change":"2023-10-08T16:10:44.119841+0000","last_active":"2023-10-08T16:10:45.352069+0000","last_peered":"2023-10-08T16:10:45.352069+0000","last_clean":"2023-10-08T16:10:45.352069+0000","last_became_active":"2023-10-08T16:10:44.119586+0000","last_became_peered":"2023-10-08T16:10:44.119586+0000","last_unstale":"2023-10-08T16:10:45.352069+0000","last_undegraded":"2023-10-08T16:10:45.352069+0000","last_fullsized":"2023-10-08T16:10:45.352069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:41.586045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.135602+0000","last_change":"2023-10-08T16:10:45.135602+0000","last_active":"2023-10-08T16:10:45.135602+0000","last_peered":"2023-10-08T16:10:45.135602+0000","last_clean":"2023-10-08T16:10:45.135602+0000","last_became_active":"2023-10-08T16:10:45.135394+0000","last_became_peered":"2023-10-08T16:10:45.135394+0000","last_unstale":"2023-10-08T16:10:45.135602+0000","last_undegraded":"2023-10-08T16:10:45.135602+0000","last_fullsized":"2023-10-08T16:10:45.135602+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.351089+0000","last_change":"2023-10-08T16:10:44.120791+0000","last_active":"2023-10-08T16:10:45.351089+0000","last_peered":"2023-10-08T16:10:45.351089+0000","last_clean":"2023-10-08T16:10:45.351089+0000","last_became_active":"2023-10-08T16:10:44.120556+0000","last_became_peered":"2023-10-08T16:10:44.120556+0000","last_unstale":"2023-10-08T16:10:45.351089+0000","last_undegraded":"2023-10-08T16:10:45.351089+0000","last_fullsized":"2023-10-08T16:10:45.351089+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:37.326621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.133773+0000","last_change":"2023-10-08T16:10:45.133773+0000","last_active":"2023-10-08T16:10:45.133773+0000","last_peered":"2023-10-08T16:10:45.133773+0000","last_clean":"2023-10-08T16:10:45.133773+0000","last_became_active":"2023-10-08T16:10:45.133417+0000","last_became_peered":"2023-10-08T16:10:45.133417+0000","last_unstale":"2023-10-08T16:10:45.133773+0000","last_undegraded":"2023-10-08T16:10:45.133773+0000","last_fullsized":"2023-10-08T16:10:45.133773+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:00.872986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134419+0000","last_change":"2023-10-08T16:10:44.128081+0000","last_active":"2023-10-08T16:10:45.134419+0000","last_peered":"2023-10-08T16:10:45.134419+0000","last_clean":"2023-10-08T16:10:45.134419+0000","last_became_active":"2023-10-08T16:10:44.123339+0000","last_became_peered":"2023-10-08T16:10:44.123339+0000","last_unstale":"2023-10-08T16:10:45.134419+0000","last_undegraded":"2023-10-08T16:10:45.134419+0000","last_fullsized":"2023-10-08T16:10:45.134419+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:37.205387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139651+0000","last_change":"2023-10-08T16:10:45.139651+0000","last_active":"2023-10-08T16:10:45.139651+0000","last_peered":"2023-10-08T16:10:45.139651+0000","last_clean":"2023-10-08T16:10:45.139651+0000","last_became_active":"2023-10-08T16:10:45.139411+0000","last_became_peered":"2023-10-08T16:10:45.139411+0000","last_unstale":"2023-10-08T16:10:45.139651+0000","last_undegraded":"2023-10-08T16:10:45.139651+0000","last_fullsized":"2023-10-08T16:10:45.139651+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:42.592515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139052+0000","last_change":"2023-10-08T16:10:44.127221+0000","last_active":"2023-10-08T16:10:45.139052+0000","last_peered":"2023-10-08T16:10:45.139052+0000","last_clean":"2023-10-08T16:10:45.139052+0000","last_became_active":"2023-10-08T16:10:44.125818+0000","last_became_peered":"2023-10-08T16:10:44.125818+0000","last_unstale":"2023-10-08T16:10:45.139052+0000","last_undegraded":"2023-10-08T16:10:45.139052+0000","last_fullsized":"2023-10-08T16:10:45.139052+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:44.121442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.136789+0000","last_change":"2023-10-08T16:10:45.136789+0000","last_active":"2023-10-08T16:10:45.136789+0000","last_peered":"2023-10-08T16:10:45.136789+0000","last_clean":"2023-10-08T16:10:45.136789+0000","last_became_active":"2023-10-08T16:10:45.136112+0000","last_became_peered":"2023-10-08T16:10:45.136112+0000","last_unstale":"2023-10-08T16:10:45.136789+0000","last_undegraded":"2023-10-08T16:10:45.136789+0000","last_fullsized":"2023-10-08T16:10:45.136789+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:07.726133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.123870+0000","last_change":"2023-10-08T16:10:44.123793+0000","last_active":"2023-10-08T16:10:44.123870+0000","last_peered":"2023-10-08T16:10:44.123870+0000","last_clean":"2023-10-08T16:10:44.123870+0000","last_became_active":"2023-10-08T16:10:44.123541+0000","last_became_peered":"2023-10-08T16:10:44.123541+0000","last_unstale":"2023-10-08T16:10:44.123870+0000","last_undegraded":"2023-10-08T16:10:44.123870+0000","last_fullsized":"2023-10-08T16:10:44.123870+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:22.910434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134760+0000","last_change":"2023-10-08T16:10:45.134760+0000","last_active":"2023-10-08T16:10:45.134760+0000","last_peered":"2023-10-08T16:10:45.134760+0000","last_clean":"2023-10-08T16:10:45.134760+0000","last_became_active":"2023-10-08T16:10:45.134106+0000","last_became_peered":"2023-10-08T16:10:45.134106+0000","last_unstale":"2023-10-08T16:10:45.134760+0000","last_undegraded":"2023-10-08T16:10:45.134760+0000","last_fullsized":"2023-10-08T16:10:45.134760+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.127756+0000","last_change":"2023-10-08T16:10:44.127668+0000","last_active":"2023-10-08T16:10:44.127756+0000","last_peered":"2023-10-08T16:10:44.127756+0000","last_clean":"2023-10-08T16:10:44.127756+0000","last_became_active":"2023-10-08T16:10:44.127414+0000","last_became_peered":"2023-10-08T16:10:44.127414+0000","last_unstale":"2023-10-08T16:10:44.127756+0000","last_undegraded":"2023-10-08T16:10:44.127756+0000","last_fullsized":"2023-10-08T16:10:44.127756+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:04.469232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145480+0000","last_change":"2023-10-08T16:10:45.145480+0000","last_active":"2023-10-08T16:10:45.145480+0000","last_peered":"2023-10-08T16:10:45.145480+0000","last_clean":"2023-10-08T16:10:45.145480+0000","last_became_active":"2023-10-08T16:10:45.144776+0000","last_became_peered":"2023-10-08T16:10:45.144776+0000","last_unstale":"2023-10-08T16:10:45.145480+0000","last_undegraded":"2023-10-08T16:10:45.145480+0000","last_fullsized":"2023-10-08T16:10:45.145480+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:55.254333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.127738+0000","last_change":"2023-10-08T16:10:44.127484+0000","last_active":"2023-10-08T16:10:44.127738+0000","last_peered":"2023-10-08T16:10:44.127738+0000","last_clean":"2023-10-08T16:10:44.127738+0000","last_became_active":"2023-10-08T16:10:44.126987+0000","last_became_peered":"2023-10-08T16:10:44.126987+0000","last_unstale":"2023-10-08T16:10:44.127738+0000","last_undegraded":"2023-10-08T16:10:44.127738+0000","last_fullsized":"2023-10-08T16:10:44.127738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:20.586715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.134712+0000","last_change":"2023-10-08T16:10:45.134712+0000","last_active":"2023-10-08T16:10:45.134712+0000","last_peered":"2023-10-08T16:10:45.134712+0000","last_clean":"2023-10-08T16:10:45.134712+0000","last_became_active":"2023-10-08T16:10:45.133060+0000","last_became_peered":"2023-10-08T16:10:45.133060+0000","last_unstale":"2023-10-08T16:10:45.134712+0000","last_undegraded":"2023-10-08T16:10:45.134712+0000","last_fullsized":"2023-10-08T16:10:45.134712+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:45.127911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.128506+0000","last_change":"2023-10-08T16:10:44.128435+0000","last_active":"2023-10-08T16:10:44.128506+0000","last_peered":"2023-10-08T16:10:44.128506+0000","last_clean":"2023-10-08T16:10:44.128506+0000","last_became_active":"2023-10-08T16:10:44.128194+0000","last_became_peered":"2023-10-08T16:10:44.128194+0000","last_unstale":"2023-10-08T16:10:44.128506+0000","last_undegraded":"2023-10-08T16:10:44.128506+0000","last_fullsized":"2023-10-08T16:10:44.128506+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:10.173684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142169+0000","last_change":"2023-10-08T16:10:45.142169+0000","last_active":"2023-10-08T16:10:45.142169+0000","last_peered":"2023-10-08T16:10:45.142169+0000","last_clean":"2023-10-08T16:10:45.142169+0000","last_became_active":"2023-10-08T16:10:45.141787+0000","last_became_peered":"2023-10-08T16:10:45.141787+0000","last_unstale":"2023-10-08T16:10:45.142169+0000","last_undegraded":"2023-10-08T16:10:45.142169+0000","last_fullsized":"2023-10-08T16:10:45.142169+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:11.265548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"116'3","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353247+0000","last_change":"2023-10-08T16:10:44.125504+0000","last_active":"2023-10-08T16:10:45.353247+0000","last_peered":"2023-10-08T16:10:45.353247+0000","last_clean":"2023-10-08T16:10:45.353247+0000","last_became_active":"2023-10-08T16:10:44.125376+0000","last_became_peered":"2023-10-08T16:10:44.125376+0000","last_unstale":"2023-10-08T16:10:45.353247+0000","last_undegraded":"2023-10-08T16:10:45.353247+0000","last_fullsized":"2023-10-08T16:10:45.353247+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:57:25.736720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144457+0000","last_change":"2023-10-08T16:10:45.144457+0000","last_active":"2023-10-08T16:10:45.144457+0000","last_peered":"2023-10-08T16:10:45.144457+0000","last_clean":"2023-10-08T16:10:45.144457+0000","last_became_active":"2023-10-08T16:10:45.144227+0000","last_became_peered":"2023-10-08T16:10:45.144227+0000","last_unstale":"2023-10-08T16:10:45.144457+0000","last_undegraded":"2023-10-08T16:10:45.144457+0000","last_fullsized":"2023-10-08T16:10:45.144457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"116'6","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.351814+0000","last_change":"2023-10-08T16:10:44.126610+0000","last_active":"2023-10-08T16:10:45.351814+0000","last_peered":"2023-10-08T16:10:45.351814+0000","last_clean":"2023-10-08T16:10:45.351814+0000","last_became_active":"2023-10-08T16:10:44.126404+0000","last_became_peered":"2023-10-08T16:10:44.126404+0000","last_unstale":"2023-10-08T16:10:45.351814+0000","last_undegraded":"2023-10-08T16:10:45.351814+0000","last_fullsized":"2023-10-08T16:10:45.351814+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:19.127577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.140255+0000","last_change":"2023-10-08T16:10:45.140255+0000","last_active":"2023-10-08T16:10:45.140255+0000","last_peered":"2023-10-08T16:10:45.140255+0000","last_clean":"2023-10-08T16:10:45.140255+0000","last_became_active":"2023-10-08T16:10:45.139743+0000","last_became_peered":"2023-10-08T16:10:45.139743+0000","last_unstale":"2023-10-08T16:10:45.140255+0000","last_undegraded":"2023-10-08T16:10:45.140255+0000","last_fullsized":"2023-10-08T16:10:45.140255+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.352003+0000","last_change":"2023-10-08T16:10:44.131408+0000","last_active":"2023-10-08T16:10:45.352003+0000","last_peered":"2023-10-08T16:10:45.352003+0000","last_clean":"2023-10-08T16:10:45.352003+0000","last_became_active":"2023-10-08T16:10:44.131008+0000","last_became_peered":"2023-10-08T16:10:44.131008+0000","last_unstale":"2023-10-08T16:10:45.352003+0000","last_undegraded":"2023-10-08T16:10:45.352003+0000","last_fullsized":"2023-10-08T16:10:45.352003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:34.496064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.147134+0000","last_change":"2023-10-08T16:10:45.147134+0000","last_active":"2023-10-08T16:10:45.147134+0000","last_peered":"2023-10-08T16:10:45.147134+0000","last_clean":"2023-10-08T16:10:45.147134+0000","last_became_active":"2023-10-08T16:10:45.146418+0000","last_became_peered":"2023-10-08T16:10:45.146418+0000","last_unstale":"2023-10-08T16:10:45.147134+0000","last_undegraded":"2023-10-08T16:10:45.147134+0000","last_fullsized":"2023-10-08T16:10:45.147134+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:34.440931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.129727+0000","last_change":"2023-10-08T16:10:44.129652+0000","last_active":"2023-10-08T16:10:44.129727+0000","last_peered":"2023-10-08T16:10:44.129727+0000","last_clean":"2023-10-08T16:10:44.129727+0000","last_became_active":"2023-10-08T16:10:44.129150+0000","last_became_peered":"2023-10-08T16:10:44.129150+0000","last_unstale":"2023-10-08T16:10:44.129727+0000","last_undegraded":"2023-10-08T16:10:44.129727+0000","last_fullsized":"2023-10-08T16:10:44.129727+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:10.382820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.133441+0000","last_change":"2023-10-08T16:10:45.133441+0000","last_active":"2023-10-08T16:10:45.133441+0000","last_peered":"2023-10-08T16:10:45.133441+0000","last_clean":"2023-10-08T16:10:45.133441+0000","last_became_active":"2023-10-08T16:10:45.133055+0000","last_became_peered":"2023-10-08T16:10:45.133055+0000","last_unstale":"2023-10-08T16:10:45.133441+0000","last_undegraded":"2023-10-08T16:10:45.133441+0000","last_fullsized":"2023-10-08T16:10:45.133441+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:47.848959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.126552+0000","last_change":"2023-10-08T16:10:44.126392+0000","last_active":"2023-10-08T16:10:44.126552+0000","last_peered":"2023-10-08T16:10:44.126552+0000","last_clean":"2023-10-08T16:10:44.126552+0000","last_became_active":"2023-10-08T16:10:44.126163+0000","last_became_peered":"2023-10-08T16:10:44.126163+0000","last_unstale":"2023-10-08T16:10:44.126552+0000","last_undegraded":"2023-10-08T16:10:44.126552+0000","last_fullsized":"2023-10-08T16:10:44.126552+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143081+0000","last_change":"2023-10-08T16:10:45.143081+0000","last_active":"2023-10-08T16:10:45.143081+0000","last_peered":"2023-10-08T16:10:45.143081+0000","last_clean":"2023-10-08T16:10:45.143081+0000","last_became_active":"2023-10-08T16:10:45.142624+0000","last_became_peered":"2023-10-08T16:10:45.142624+0000","last_unstale":"2023-10-08T16:10:45.143081+0000","last_undegraded":"2023-10-08T16:10:45.143081+0000","last_fullsized":"2023-10-08T16:10:45.143081+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.114242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"116'8","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.356823+0000","last_change":"2023-10-08T16:10:44.126307+0000","last_active":"2023-10-08T16:10:45.356823+0000","last_peered":"2023-10-08T16:10:45.356823+0000","last_clean":"2023-10-08T16:10:45.356823+0000","last_became_active":"2023-10-08T16:10:44.126083+0000","last_became_peered":"2023-10-08T16:10:44.126083+0000","last_unstale":"2023-10-08T16:10:45.356823+0000","last_undegraded":"2023-10-08T16:10:45.356823+0000","last_fullsized":"2023-10-08T16:10:45.356823+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:44.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142021+0000","last_change":"2023-10-08T16:10:45.142021+0000","last_active":"2023-10-08T16:10:45.142021+0000","last_peered":"2023-10-08T16:10:45.142021+0000","last_clean":"2023-10-08T16:10:45.142021+0000","last_became_active":"2023-10-08T16:10:45.141458+0000","last_became_peered":"2023-10-08T16:10:45.141458+0000","last_unstale":"2023-10-08T16:10:45.142021+0000","last_undegraded":"2023-10-08T16:10:45.142021+0000","last_fullsized":"2023-10-08T16:10:45.142021+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:03:23.193249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.350776+0000","last_change":"2023-10-08T16:10:44.124762+0000","last_active":"2023-10-08T16:10:45.350776+0000","last_peered":"2023-10-08T16:10:45.350776+0000","last_clean":"2023-10-08T16:10:45.350776+0000","last_became_active":"2023-10-08T16:10:44.124514+0000","last_became_peered":"2023-10-08T16:10:44.124514+0000","last_unstale":"2023-10-08T16:10:45.350776+0000","last_undegraded":"2023-10-08T16:10:45.350776+0000","last_fullsized":"2023-10-08T16:10:45.350776+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:22.910434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141589+0000","last_change":"2023-10-08T16:10:45.141589+0000","last_active":"2023-10-08T16:10:45.141589+0000","last_peered":"2023-10-08T16:10:45.141589+0000","last_clean":"2023-10-08T16:10:45.141589+0000","last_became_active":"2023-10-08T16:10:45.140961+0000","last_became_peered":"2023-10-08T16:10:45.140961+0000","last_unstale":"2023-10-08T16:10:45.141589+0000","last_undegraded":"2023-10-08T16:10:45.141589+0000","last_fullsized":"2023-10-08T16:10:45.141589+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137997+0000","last_change":"2023-10-08T16:10:44.120666+0000","last_active":"2023-10-08T16:10:45.137997+0000","last_peered":"2023-10-08T16:10:45.137997+0000","last_clean":"2023-10-08T16:10:45.137997+0000","last_became_active":"2023-10-08T16:10:44.120430+0000","last_became_peered":"2023-10-08T16:10:44.120430+0000","last_unstale":"2023-10-08T16:10:45.137997+0000","last_undegraded":"2023-10-08T16:10:45.137997+0000","last_fullsized":"2023-10-08T16:10:45.137997+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:19.127577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141532+0000","last_change":"2023-10-08T16:10:45.141532+0000","last_active":"2023-10-08T16:10:45.141532+0000","last_peered":"2023-10-08T16:10:45.141532+0000","last_clean":"2023-10-08T16:10:45.141532+0000","last_became_active":"2023-10-08T16:10:45.141176+0000","last_became_peered":"2023-10-08T16:10:45.141176+0000","last_unstale":"2023-10-08T16:10:45.141532+0000","last_undegraded":"2023-10-08T16:10:45.141532+0000","last_fullsized":"2023-10-08T16:10:45.141532+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.125420+0000","last_change":"2023-10-08T16:10:44.125208+0000","last_active":"2023-10-08T16:10:44.125420+0000","last_peered":"2023-10-08T16:10:44.125420+0000","last_clean":"2023-10-08T16:10:44.125420+0000","last_became_active":"2023-10-08T16:10:44.123804+0000","last_became_peered":"2023-10-08T16:10:44.123804+0000","last_unstale":"2023-10-08T16:10:44.125420+0000","last_undegraded":"2023-10-08T16:10:44.125420+0000","last_fullsized":"2023-10-08T16:10:44.125420+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:45:55.400400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142718+0000","last_change":"2023-10-08T16:10:45.142718+0000","last_active":"2023-10-08T16:10:45.142718+0000","last_peered":"2023-10-08T16:10:45.142718+0000","last_clean":"2023-10-08T16:10:45.142718+0000","last_became_active":"2023-10-08T16:10:45.139061+0000","last_became_peered":"2023-10-08T16:10:45.139061+0000","last_unstale":"2023-10-08T16:10:45.142718+0000","last_undegraded":"2023-10-08T16:10:45.142718+0000","last_fullsized":"2023-10-08T16:10:45.142718+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:08.011698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353792+0000","last_change":"2023-10-08T16:10:44.126921+0000","last_active":"2023-10-08T16:10:45.353792+0000","last_peered":"2023-10-08T16:10:45.353792+0000","last_clean":"2023-10-08T16:10:45.353792+0000","last_became_active":"2023-10-08T16:10:44.125234+0000","last_became_peered":"2023-10-08T16:10:44.125234+0000","last_unstale":"2023-10-08T16:10:45.353792+0000","last_undegraded":"2023-10-08T16:10:45.353792+0000","last_fullsized":"2023-10-08T16:10:45.353792+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:51.230999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143775+0000","last_change":"2023-10-08T16:10:45.143775+0000","last_active":"2023-10-08T16:10:45.143775+0000","last_peered":"2023-10-08T16:10:45.143775+0000","last_clean":"2023-10-08T16:10:45.143775+0000","last_became_active":"2023-10-08T16:10:45.143524+0000","last_became_peered":"2023-10-08T16:10:45.143524+0000","last_unstale":"2023-10-08T16:10:45.143775+0000","last_undegraded":"2023-10-08T16:10:45.143775+0000","last_fullsized":"2023-10-08T16:10:45.143775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:29.338793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.121144+0000","last_change":"2023-10-08T16:10:44.121064+0000","last_active":"2023-10-08T16:10:44.121144+0000","last_peered":"2023-10-08T16:10:44.121144+0000","last_clean":"2023-10-08T16:10:44.121144+0000","last_became_active":"2023-10-08T16:10:44.120854+0000","last_became_peered":"2023-10-08T16:10:44.120854+0000","last_unstale":"2023-10-08T16:10:44.121144+0000","last_undegraded":"2023-10-08T16:10:44.121144+0000","last_fullsized":"2023-10-08T16:10:44.121144+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:52:14.734975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.139782+0000","last_change":"2023-10-08T16:10:45.139782+0000","last_active":"2023-10-08T16:10:45.139782+0000","last_peered":"2023-10-08T16:10:45.139782+0000","last_clean":"2023-10-08T16:10:45.139782+0000","last_became_active":"2023-10-08T16:10:45.139221+0000","last_became_peered":"2023-10-08T16:10:45.139221+0000","last_unstale":"2023-10-08T16:10:45.139782+0000","last_undegraded":"2023-10-08T16:10:45.139782+0000","last_fullsized":"2023-10-08T16:10:45.139782+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:02.585925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.123386+0000","last_change":"2023-10-08T16:10:44.123319+0000","last_active":"2023-10-08T16:10:44.123386+0000","last_peered":"2023-10-08T16:10:44.123386+0000","last_clean":"2023-10-08T16:10:44.123386+0000","last_became_active":"2023-10-08T16:10:44.123094+0000","last_became_peered":"2023-10-08T16:10:44.123094+0000","last_unstale":"2023-10-08T16:10:44.123386+0000","last_undegraded":"2023-10-08T16:10:44.123386+0000","last_fullsized":"2023-10-08T16:10:44.123386+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:58.572744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144961+0000","last_change":"2023-10-08T16:10:45.144961+0000","last_active":"2023-10-08T16:10:45.144961+0000","last_peered":"2023-10-08T16:10:45.144961+0000","last_clean":"2023-10-08T16:10:45.144961+0000","last_became_active":"2023-10-08T16:10:45.144440+0000","last_became_peered":"2023-10-08T16:10:45.144440+0000","last_unstale":"2023-10-08T16:10:45.144961+0000","last_undegraded":"2023-10-08T16:10:45.144961+0000","last_fullsized":"2023-10-08T16:10:45.144961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:44.035053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.126839+0000","last_change":"2023-10-08T16:10:44.126766+0000","last_active":"2023-10-08T16:10:44.126839+0000","last_peered":"2023-10-08T16:10:44.126839+0000","last_clean":"2023-10-08T16:10:44.126839+0000","last_became_active":"2023-10-08T16:10:44.126492+0000","last_became_peered":"2023-10-08T16:10:44.126492+0000","last_unstale":"2023-10-08T16:10:44.126839+0000","last_undegraded":"2023-10-08T16:10:44.126839+0000","last_fullsized":"2023-10-08T16:10:44.126839+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:17.380941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.144469+0000","last_change":"2023-10-08T16:10:45.144469+0000","last_active":"2023-10-08T16:10:45.144469+0000","last_peered":"2023-10-08T16:10:45.144469+0000","last_clean":"2023-10-08T16:10:45.144469+0000","last_became_active":"2023-10-08T16:10:45.143596+0000","last_became_peered":"2023-10-08T16:10:45.143596+0000","last_unstale":"2023-10-08T16:10:45.144469+0000","last_undegraded":"2023-10-08T16:10:45.144469+0000","last_fullsized":"2023-10-08T16:10:45.144469+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:12.631202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"116'2","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.353639+0000","last_change":"2023-10-08T16:10:44.120799+0000","last_active":"2023-10-08T16:10:45.353639+0000","last_peered":"2023-10-08T16:10:45.353639+0000","last_clean":"2023-10-08T16:10:45.353639+0000","last_became_active":"2023-10-08T16:10:44.120582+0000","last_became_peered":"2023-10-08T16:10:44.120582+0000","last_unstale":"2023-10-08T16:10:45.353639+0000","last_undegraded":"2023-10-08T16:10:45.353639+0000","last_fullsized":"2023-10-08T16:10:45.353639+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:38.100987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141363+0000","last_change":"2023-10-08T16:10:45.141363+0000","last_active":"2023-10-08T16:10:45.141363+0000","last_peered":"2023-10-08T16:10:45.141363+0000","last_clean":"2023-10-08T16:10:45.141363+0000","last_became_active":"2023-10-08T16:10:45.141128+0000","last_became_peered":"2023-10-08T16:10:45.141128+0000","last_unstale":"2023-10-08T16:10:45.141363+0000","last_undegraded":"2023-10-08T16:10:45.141363+0000","last_fullsized":"2023-10-08T16:10:45.141363+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:07.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.127157+0000","last_change":"2023-10-08T16:10:44.127079+0000","last_active":"2023-10-08T16:10:44.127157+0000","last_peered":"2023-10-08T16:10:44.127157+0000","last_clean":"2023-10-08T16:10:44.127157+0000","last_became_active":"2023-10-08T16:10:44.125508+0000","last_became_peered":"2023-10-08T16:10:44.125508+0000","last_unstale":"2023-10-08T16:10:44.127157+0000","last_undegraded":"2023-10-08T16:10:44.127157+0000","last_fullsized":"2023-10-08T16:10:44.127157+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:24.930529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142346+0000","last_change":"2023-10-08T16:10:45.142346+0000","last_active":"2023-10-08T16:10:45.142346+0000","last_peered":"2023-10-08T16:10:45.142346+0000","last_clean":"2023-10-08T16:10:45.142346+0000","last_became_active":"2023-10-08T16:10:45.141701+0000","last_became_peered":"2023-10-08T16:10:45.141701+0000","last_unstale":"2023-10-08T16:10:45.142346+0000","last_undegraded":"2023-10-08T16:10:45.142346+0000","last_fullsized":"2023-10-08T16:10:45.142346+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:01:52.188690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.121125+0000","last_change":"2023-10-08T16:10:44.121062+0000","last_active":"2023-10-08T16:10:44.121125+0000","last_peered":"2023-10-08T16:10:44.121125+0000","last_clean":"2023-10-08T16:10:44.121125+0000","last_became_active":"2023-10-08T16:10:44.120851+0000","last_became_peered":"2023-10-08T16:10:44.120851+0000","last_unstale":"2023-10-08T16:10:44.121125+0000","last_undegraded":"2023-10-08T16:10:44.121125+0000","last_fullsized":"2023-10-08T16:10:44.121125+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.143057+0000","last_change":"2023-10-08T16:10:45.143057+0000","last_active":"2023-10-08T16:10:45.143057+0000","last_peered":"2023-10-08T16:10:45.143057+0000","last_clean":"2023-10-08T16:10:45.143057+0000","last_became_active":"2023-10-08T16:10:45.142808+0000","last_became_peered":"2023-10-08T16:10:45.142808+0000","last_unstale":"2023-10-08T16:10:45.143057+0000","last_undegraded":"2023-10-08T16:10:45.143057+0000","last_fullsized":"2023-10-08T16:10:45.143057+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:22.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.123312+0000","last_change":"2023-10-08T16:10:44.123232+0000","last_active":"2023-10-08T16:10:44.123312+0000","last_peered":"2023-10-08T16:10:44.123312+0000","last_clean":"2023-10-08T16:10:44.123312+0000","last_became_active":"2023-10-08T16:10:44.122998+0000","last_became_peered":"2023-10-08T16:10:44.122998+0000","last_unstale":"2023-10-08T16:10:44.123312+0000","last_undegraded":"2023-10-08T16:10:44.123312+0000","last_fullsized":"2023-10-08T16:10:44.123312+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142864+0000","last_change":"2023-10-08T16:10:45.142864+0000","last_active":"2023-10-08T16:10:45.142864+0000","last_peered":"2023-10-08T16:10:45.142864+0000","last_clean":"2023-10-08T16:10:45.142864+0000","last_became_active":"2023-10-08T16:10:45.142305+0000","last_became_peered":"2023-10-08T16:10:45.142305+0000","last_unstale":"2023-10-08T16:10:45.142864+0000","last_undegraded":"2023-10-08T16:10:45.142864+0000","last_fullsized":"2023-10-08T16:10:45.142864+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:25.220209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.122859+0000","last_change":"2023-10-08T16:10:44.122752+0000","last_active":"2023-10-08T16:10:44.122859+0000","last_peered":"2023-10-08T16:10:44.122859+0000","last_clean":"2023-10-08T16:10:44.122859+0000","last_became_active":"2023-10-08T16:10:44.122490+0000","last_became_peered":"2023-10-08T16:10:44.122490+0000","last_unstale":"2023-10-08T16:10:44.122859+0000","last_undegraded":"2023-10-08T16:10:44.122859+0000","last_fullsized":"2023-10-08T16:10:44.122859+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:10.173684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.141014+0000","last_change":"2023-10-08T16:10:45.141014+0000","last_active":"2023-10-08T16:10:45.141014+0000","last_peered":"2023-10-08T16:10:45.141014+0000","last_clean":"2023-10-08T16:10:45.141014+0000","last_became_active":"2023-10-08T16:10:45.140754+0000","last_became_peered":"2023-10-08T16:10:45.140754+0000","last_unstale":"2023-10-08T16:10:45.141014+0000","last_undegraded":"2023-10-08T16:10:45.141014+0000","last_fullsized":"2023-10-08T16:10:45.141014+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:45.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.121604+0000","last_change":"2023-10-08T16:10:44.121310+0000","last_active":"2023-10-08T16:10:44.121604+0000","last_peered":"2023-10-08T16:10:44.121604+0000","last_clean":"2023-10-08T16:10:44.121604+0000","last_became_active":"2023-10-08T16:10:44.120986+0000","last_became_peered":"2023-10-08T16:10:44.120986+0000","last_unstale":"2023-10-08T16:10:44.121604+0000","last_undegraded":"2023-10-08T16:10:44.121604+0000","last_fullsized":"2023-10-08T16:10:44.121604+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:10.173684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.142514+0000","last_change":"2023-10-08T16:10:45.142514+0000","last_active":"2023-10-08T16:10:45.142514+0000","last_peered":"2023-10-08T16:10:45.142514+0000","last_clean":"2023-10-08T16:10:45.142514+0000","last_became_active":"2023-10-08T16:10:45.138751+0000","last_became_peered":"2023-10-08T16:10:45.138751+0000","last_unstale":"2023-10-08T16:10:45.142514+0000","last_undegraded":"2023-10-08T16:10:45.142514+0000","last_fullsized":"2023-10-08T16:10:45.142514+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:06.092659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.128986+0000","last_change":"2023-10-08T16:10:44.128920+0000","last_active":"2023-10-08T16:10:44.128986+0000","last_peered":"2023-10-08T16:10:44.128986+0000","last_clean":"2023-10-08T16:10:44.128986+0000","last_became_active":"2023-10-08T16:10:44.128672+0000","last_became_peered":"2023-10-08T16:10:44.128672+0000","last_unstale":"2023-10-08T16:10:44.128986+0000","last_undegraded":"2023-10-08T16:10:44.128986+0000","last_fullsized":"2023-10-08T16:10:44.128986+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:38.709992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.145988+0000","last_change":"2023-10-08T16:10:45.145988+0000","last_active":"2023-10-08T16:10:45.145988+0000","last_peered":"2023-10-08T16:10:45.145988+0000","last_clean":"2023-10-08T16:10:45.145988+0000","last_became_active":"2023-10-08T16:10:45.145375+0000","last_became_peered":"2023-10-08T16:10:45.145375+0000","last_unstale":"2023-10-08T16:10:45.145988+0000","last_undegraded":"2023-10-08T16:10:45.145988+0000","last_fullsized":"2023-10-08T16:10:45.145988+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:38.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.122243+0000","last_change":"2023-10-08T16:10:44.122139+0000","last_active":"2023-10-08T16:10:44.122243+0000","last_peered":"2023-10-08T16:10:44.122243+0000","last_clean":"2023-10-08T16:10:44.122243+0000","last_became_active":"2023-10-08T16:10:44.121885+0000","last_became_peered":"2023-10-08T16:10:44.121885+0000","last_unstale":"2023-10-08T16:10:44.122243+0000","last_undegraded":"2023-10-08T16:10:44.122243+0000","last_fullsized":"2023-10-08T16:10:44.122243+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:50.741676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.140529+0000","last_change":"2023-10-08T16:10:45.140529+0000","last_active":"2023-10-08T16:10:45.140529+0000","last_peered":"2023-10-08T16:10:45.140529+0000","last_clean":"2023-10-08T16:10:45.140529+0000","last_became_active":"2023-10-08T16:10:45.140279+0000","last_became_peered":"2023-10-08T16:10:45.140279+0000","last_unstale":"2023-10-08T16:10:45.140529+0000","last_undegraded":"2023-10-08T16:10:45.140529+0000","last_fullsized":"2023-10-08T16:10:45.140529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:44.112098+0000","last_clean_scrub_stamp":"2023-10-08T16:10:44.112098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:05.475701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"116'1","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-08T16:10:45.137133+0000","last_change":"2023-10-08T16:10:44.124947+0000","last_active":"2023-10-08T16:10:45.137133+0000","last_peered":"2023-10-08T16:10:45.137133+0000","last_clean":"2023-10-08T16:10:45.137133+0000","last_became_active":"2023-10-08T16:10:44.124779+0000","last_became_peered":"2023-10-08T16:10:44.124779+0000","last_unstale":"2023-10-08T16:10:45.137133+0000","last_undegraded":"2023-10-08T16:10:45.137133+0000","last_fullsized":"2023-10-08T16:10:45.137133+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:43.105628+0000","last_clean_scrub_stamp":"2023-10-08T16:10:43.105628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:51.908269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-10-08T16:10:44.122127+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:10:44.122127+0000","last_peered":"2023-10-08T16:10:44.122127+0000","last_clean":"2023-10-08T16:10:44.122127+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:10:44.122127+0000","last_undegraded":"2023-10-08T16:10:44.122127+0000","last_fullsized":"2023-10-08T16:10:44.122127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1190,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194122,"statfs":{"total":200000000,"available":198780992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.73399999999999999,"5min":1.756,"15min":1.756},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72499999999999998,"5min":1.79,"15min":1.79},"last":0.46000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69299999999999995,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":1.823,"15min":1.823},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.44400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72199999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":1.252,"15min":1.252},"last":0.56599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.57899999999999996,"15min":0.55300000000000005},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.54600000000000004},"min":{"1min":0.44600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78900000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.621}]},{"osd":5,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65700000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:10:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74299999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39800000000000002,"15min":0.47999999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.46800000000000003,"5min":3.593,"15min":3.593},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.437,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.46899999999999997},"min":{"1min":0.222,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57299999999999995,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.317},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.27700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42099999999999999,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.55100000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.25}]},{"osd":4,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.70899999999999996},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84799999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.503},{"interface":"front","average":{"1min":0.623,"5min":0.64100000000000001,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78500000000000003,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.72999999999999998},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":3.532,"15min":3.532},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90700000000000003,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67000000000000004,"15min":0.73399999999999999},"min":{"1min":0.44800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79900000000000004,"5min":3.4929999999999999,"15min":3.4929999999999999},"last":0.38700000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":1.095,"15min":1.095},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86199999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.42799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194114,"statfs":{"total":200000000,"available":198773675,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.377},"min":{"1min":0.23799999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48899999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42499999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.66600000000000004,"5min":2.254,"15min":2.254},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.379},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58199999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.374},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72999999999999998,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.378},"min":{"1min":0.25900000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.47799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83399999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91500000000000004,"5min":1.079,"15min":1.079},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.46600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.875,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93799999999999994,"5min":2.355,"15min":2.355},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64200000000000002,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98199999999999998,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":1.002,"15min":1.002},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.246,"5min":0.185,"15min":0.185},"max":{"1min":0.52900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40799999999999997,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56499999999999995,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.746,"15min":0.746},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61699999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.313}]},{"osd":3,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.44},"min":{"1min":0.32000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.32300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.44500000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.018,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.67000000000000004},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.046,"5min":1.091,"15min":1.091},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.624},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.499,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34000000000000002,"15min":0.313},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44900000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.46800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.45000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.56299999999999994,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.46800000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41399999999999998,"15min":0.39400000000000002},"min":{"1min":0.28999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49399999999999999,"5min":0.628,"15min":0.628},"last":0.502}]},{"osd":4,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.754,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69599999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.621,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78000000000000003,"5min":0.999,"15min":0.999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:09:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76800000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362937,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82999999999999996,"5min":1.141,"15min":1.141},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":1.149,"15min":1.149},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89700000000000002,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60399999999999998,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.875,"5min":14.6,"15min":14.6},"last":0.503}]},{"osd":3,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.63200000000000001,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":7.556,"15min":7.556},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.754,"15min":0.754},"last":0.628}]},{"osd":6,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.621},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63200000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51000000000000001,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68799999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.505},{"interface":"front","average":{"1min":0.495,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71499999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60599999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":0.67900000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55700000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61799999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59799999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58499999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56899999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.628}]}]}],"pool_statfs":[]}} 2023-10-08T16:10:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:10:49.994 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:10:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.120+0000 7f191481c700 1 Processor -- start 2023-10-08T16:10:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.120+0000 7f191481c700 1 -- start start 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.121+0000 7f191481c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19100678b0 0x7f191015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.121+0000 7f191481c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19100cae70 con 0x7f19100c9390 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.121+0000 7f191481c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19100cb150 con 0x7f19100cbf10 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.121+0000 7f191481c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19100cb430 con 0x7f19100678b0 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19100c9390 0x7f191015a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55962/0 (socket says 172.21.15.60:55962) 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190ed9d700 1 -- 172.21.15.60:0/1637116653 learned_addr learned my addr 172.21.15.60:0/1637116653 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190e59c700 1 --2- 172.21.15.60:0/1637116653 >> v2:172.21.15.144:3300/0 conn(0x7f19100678b0 0x7f191015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852338333 0 0) 0x7f19100cae70 con 0x7f19100c9390 2023-10-08T16:10:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f8003570 con 0x7f19100c9390 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224525342 0 0) 0x7f18f8003570 con 0x7f19100c9390 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 >> v2:172.21.15.144:3300/0 conn(0x7f19100678b0 msgr2=0x7f191015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 --2- 172.21.15.60:0/1637116653 >> v2:172.21.15.144:3300/0 conn(0x7f19100678b0 0x7f191015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 >> v1:172.21.15.144:6789/0 conn(0x7f19100cbf10 legacy=0x7f191015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19100cb710 con 0x7f19100c9390 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f19080017f0 con 0x7f19100c9390 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 >> v1:172.21.15.60:6789/0 conn(0x7f19100c9390 legacy=0x7f191015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18f8003a60 0x7f18f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f8004810 0x7f18f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f18f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100cb430 con 0x7f18f80051c0 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f800c0d0 con 0x7f18f8004810 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f800c290 con 0x7f18f8003a60 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190ed9d700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f18f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190e59c700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18f8003a60 0x7f18f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.122+0000 7f190dd9b700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f8004810 0x7f18f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 -- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18f8003a60 msgr2=0x7f18f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18f8003a60 0x7f18f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 -- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f8004810 msgr2=0x7f18f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f8004810 0x7f18f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 -- 172.21.15.60:0/1637116653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8003570 con 0x7f18f80051c0 2023-10-08T16:10:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190dd9b700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f8004810 0x7f18f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 -- 172.21.15.60:0/1637116653 reap_dead start 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190ed9d700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f18f800ba60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f190800a930 tx=0x7f19080021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e012347896208c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080070d0 con 0x7f18f80051c0 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908007230 con 0x7f18f80051c0 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f190d59a700 1 -- 172.21.15.60:0/1637116653 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080075d0 con 0x7f18f80051c0 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f191481c700 1 -- 172.21.15.60:0/1637116653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 msgr2=0x7f18f800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.123+0000 7f191481c700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f18f800ba60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f190800a930 tx=0x7f19080021d0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.124+0000 7f191481c700 1 -- 172.21.15.60:0/1637116653 shutdown_connections 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.124+0000 7f191481c700 1 --2- 172.21.15.60:0/1637116653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f18f800ba60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.124+0000 7f191481c700 1 -- 172.21.15.60:0/1637116653 >> 172.21.15.60:0/1637116653 conn(0x7f1910069870 msgr2=0x7f1910069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.124+0000 7f191481c700 1 -- 172.21.15.60:0/1637116653 shutdown_connections 2023-10-08T16:10:50.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.124+0000 7f191481c700 1 -- 172.21.15.60:0/1637116653 wait complete. 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.125+0000 7f191481c700 1 Processor -- start 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.125+0000 7f191481c700 1 -- start start 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.125+0000 7f191481c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f1910148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.125+0000 7f191481c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19100ab230 0x7f191015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f191481c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100ab6a0 0x7f1910160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f191481c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191016a1d0 con 0x7f18f80051c0 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f191481c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100abc60 con 0x7f19100ab6a0 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f191481c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100abf40 con 0x7f19100ab230 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f1910148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f1910148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36730/0 (socket says 172.21.15.60:36730) 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 -- 172.21.15.60:0/3708359759 learned_addr learned my addr 172.21.15.60:0/3708359759 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190dd9b700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19100ab230 0x7f191015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190ed9d700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100ab6a0 0x7f1910160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 -- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19100ab230 msgr2=0x7f191015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19100ab230 0x7f191015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 -- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100ab6a0 msgr2=0x7f1910160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100ab6a0 0x7f1910160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 -- 172.21.15.60:0/3708359759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19100ac220 con 0x7f18f80051c0 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190dd9b700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19100ab230 0x7f191015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190ed9d700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100ab6a0 0x7f1910160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f190e59c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f1910148590 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1900006ac0 tx=0x7f19000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190000fa10 con 0x7f18f80051c0 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190000fb70 con 0x7f18f80051c0 2023-10-08T16:10:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900014440 con 0x7f18f80051c0 2023-10-08T16:10:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1910148ad0 con 0x7f18f80051c0 2023-10-08T16:10:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.126+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19100ac6c0 con 0x7f18f80051c0 2023-10-08T16:10:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.127+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191016a4d0 con 0x7f18f80051c0 2023-10-08T16:10:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.128+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1900014830 con 0x7f18f80051c0 2023-10-08T16:10:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.128+0000 7f18fe7fc700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18f0066f30 0x7f18f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.128+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1900018030 con 0x7f18f80051c0 2023-10-08T16:10:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.128+0000 7f190dd9b700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18f0066f30 0x7f18f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.128+0000 7f190dd9b700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18f0066f30 0x7f18f00693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1904007a80 tx=0x7f190400c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.132+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19000521f0 con 0x7f18f80051c0 2023-10-08T16:10:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.411+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f191016a310 con 0x7f18f80051c0 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.414+0000 7f18fe7fc700 1 -- 172.21.15.60:0/3708359759 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f191016a310 con 0x7f18f80051c0 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18f0066f30 msgr2=0x7f18f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18f0066f30 0x7f18f00693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1904007a80 tx=0x7f190400c040 comp rx=0 tx=0).stop 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 msgr2=0x7f1910148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f1910148590 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1900006ac0 tx=0x7f19000091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 shutdown_connections 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18f0066f30 0x7f18f00693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19100ab6a0 0x7f1910160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80051c0 0x7f1910148590 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 --2- 172.21.15.60:0/3708359759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19100ab230 0x7f191015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 >> 172.21.15.60:0/3708359759 conn(0x7f1910069870 msgr2=0x7f19100b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 shutdown_connections 2023-10-08T16:10:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.416+0000 7f191481c700 1 -- 172.21.15.60:0/3708359759 wait complete. 2023-10-08T16:10:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:10:50.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:50.450 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-10-08T16:10:50.449+0000 7f58ce8be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:10:50.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.554+0000 7fbad2462700 1 Processor -- start 2023-10-08T16:10:50.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.554+0000 7fbad2462700 1 -- start start 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad2462700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbacc15a2b0 0x7fbacc0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad2462700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbacc0cfe20 0x7fbacc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad2462700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc0c5d80 con 0x7fbacc0d1c30 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad2462700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc068470 con 0x7fbacc0cfe20 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad2462700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0c6060 con 0x7fbacc15a2b0 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbacc0cfe20 0x7fbacc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbacc0cfe20 0x7fbacc0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36744/0 (socket says 172.21.15.60:36744) 2023-10-08T16:10:50.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 -- 172.21.15.60:0/1741680525 learned_addr learned my addr 172.21.15.60:0/1741680525 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 -- 172.21.15.60:0/1741680525 >> v2:172.21.15.144:3300/0 conn(0x7fbacc15a2b0 msgr2=0x7fbacc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 --2- 172.21.15.60:0/1741680525 >> v2:172.21.15.144:3300/0 conn(0x7fbacc15a2b0 0x7fbacc0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 -- 172.21.15.60:0/1741680525 >> v1:172.21.15.144:6789/0 conn(0x7fbacc0d1c30 legacy=0x7fbacc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 -- 172.21.15.60:0/1741680525 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0c6340 con 0x7fbacc0cfe20 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.555+0000 7fbad09ff700 1 --2- 172.21.15.60:0/1741680525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc0cfe20 0x7fbacc0ccdd0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbacc089220 tx=0x7fbac4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8720bd11d038f1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbacaffd700 1 -- 172.21.15.60:0/1741680525 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400e070 con 0x7fbacc0cfe20 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbacaffd700 1 -- 172.21.15.60:0/1741680525 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400ba10 con 0x7fbacc0cfe20 2023-10-08T16:10:50.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbacaffd700 1 -- 172.21.15.60:0/1741680525 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40092e0 con 0x7fbacc0cfe20 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 -- 172.21.15.60:0/1741680525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc0cfe20 msgr2=0x7fbacc0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 --2- 172.21.15.60:0/1741680525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc0cfe20 0x7fbacc0ccdd0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbacc089220 tx=0x7fbac4009840 comp rx=0 tx=0).stop 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 -- 172.21.15.60:0/1741680525 shutdown_connections 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 --2- 172.21.15.60:0/1741680525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc0cfe20 0x7fbacc0ccdd0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 --2- 172.21.15.60:0/1741680525 >> v2:172.21.15.144:3300/0 conn(0x7fbacc15a2b0 0x7fbacc0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 -- 172.21.15.60:0/1741680525 >> 172.21.15.60:0/1741680525 conn(0x7fbacc067e40 msgr2=0x7fbacc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 -- 172.21.15.60:0/1741680525 shutdown_connections 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.556+0000 7fbad2462700 1 -- 172.21.15.60:0/1741680525 wait complete. 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.557+0000 7fbad2462700 1 Processor -- start 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 -- start start 2023-10-08T16:10:50.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbacc0cfe20 0x7fbacc1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbacc0d1c30 0x7fbacc0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 0x7fbacc15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0b47e0 con 0x7fbacc15a2b0 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0b5610 con 0x7fbacc0cfe20 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad2462700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0b4a00 con 0x7fbacc0d1c30 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad09ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 0x7fbacc15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad09ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 0x7fbacc15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36754/0 (socket says 172.21.15.60:36754) 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.558+0000 7fbad09ff700 1 -- 172.21.15.60:0/1497625896 learned_addr learned my addr 172.21.15.60:0/1497625896 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbacbfff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbacc0cfe20 0x7fbacc1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad09ff700 1 -- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbacc0d1c30 msgr2=0x7fbacc0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbacb7fe700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbacc0d1c30 0x7fbacc0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad09ff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbacc0d1c30 0x7fbacc0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad09ff700 1 -- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbacc0cfe20 msgr2=0x7fbacc1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad09ff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbacc0cfe20 0x7fbacc1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad09ff700 1 -- 172.21.15.60:0/1497625896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4009ae0 con 0x7fbacc15a2b0 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbacb7fe700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbacc0d1c30 0x7fbacc0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbacbfff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbacc0cfe20 0x7fbacc1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad09ff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 0x7fbacc15a680 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbac4003000 tx=0x7fbac4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4012e60 con 0x7fbacc15a2b0 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400be80 con 0x7fbacc15a2b0 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac401e660 con 0x7fbacc15a2b0 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc0b4ce0 con 0x7fbacc15a2b0 2023-10-08T16:10:50.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.559+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc0b52a0 con 0x7fbacc15a2b0 2023-10-08T16:10:50.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.560+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc158060 con 0x7fbacc15a2b0 2023-10-08T16:10:50.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.560+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbac401ea50 con 0x7fbacc15a2b0 2023-10-08T16:10:50.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.561+0000 7fbab3fff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbab8066f30 0x7fbab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.561+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbac40861c0 con 0x7fbacc15a2b0 2023-10-08T16:10:50.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.561+0000 7fbacbfff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbab8066f30 0x7fbab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.561+0000 7fbacbfff700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbab8066f30 0x7fbab80693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006fd0 tx=0x7fbabc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.565+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbac4053430 con 0x7fbacc15a2b0 2023-10-08T16:10:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.803+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbacc0b57a0 con 0x7fbacc15a2b0 2023-10-08T16:10:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.804+0000 7fbab3fff700 1 -- 172.21.15.60:0/1497625896 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbac4056a50 con 0x7fbacc15a2b0 2023-10-08T16:10:50.916 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:50.916 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbab8066f30 msgr2=0x7fbab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbab8066f30 0x7fbab80693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006fd0 tx=0x7fbabc008040 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 msgr2=0x7fbacc15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 0x7fbacc15a680 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbac4003000 tx=0x7fbac4017000 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 shutdown_connections 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbab8066f30 0x7fbab80693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbacc15a2b0 0x7fbacc15a680 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbacc0cfe20 0x7fbacc1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 --2- 172.21.15.60:0/1497625896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbacc0d1c30 0x7fbacc0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 >> 172.21.15.60:0/1497625896 conn(0x7fbacc067e40 msgr2=0x7fbacc0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:50.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 shutdown_connections 2023-10-08T16:10:50.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:50.806+0000 7fbad2462700 1 -- 172.21.15.60:0/1497625896 wait complete. 2023-10-08T16:10:50.919 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:10:51.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:10:44.530224+0000', 'modified': '2023-10-08T16:10:48.354044+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6756}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6756': {'gid': 6756, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2777041684', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6835', 'nonce': 2777041684}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2777041684}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:10:51.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:10:51.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:10:51.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.450+0000 7fe05bf15700 1 Processor -- start 2023-10-08T16:10:51.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.450+0000 7fe05bf15700 1 -- start start 2023-10-08T16:10:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe05bf15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe05bf15700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0540cb4f0 0x7fe0540cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe05bf15700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05415de60 con 0x7fe0540b1220 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe05bf15700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540cbed0 con 0x7fe0540cb4f0 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe05bf15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415e140 con 0x7fe0540b0e50 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe0594b0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe0540b1220 0x7fe05406d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55978/0 (socket says 172.21.15.60:55978) 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.451+0000 7fe0594b0700 1 -- 172.21.15.60:0/323217128 learned_addr learned my addr 172.21.15.60:0/323217128 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe059cb1700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/323217128 >> v2:172.21.15.144:3300/0 conn(0x7fe0540cb4f0 0x7fe0540cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe058caf700 1 -- 172.21.15.60:0/323217128 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826327676 0 0) 0x7fe05415de60 con 0x7fe0540b1220 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe058caf700 1 -- 172.21.15.60:0/323217128 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c003570 con 0x7fe0540b1220 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe05a4b2700 1 -- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 msgr2=0x7fe0540c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe05a4b2700 1 -- 172.21.15.60:0/323217128 >> v1:172.21.15.60:6789/0 conn(0x7fe0540b1220 legacy=0x7fe05406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe05a4b2700 1 -- 172.21.15.60:0/323217128 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05415e420 con 0x7fe0540cb4f0 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe059cb1700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0540cb990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe044009e60 tx=0x7fe044009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=673165b09b52689d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe058caf700 1 -- 172.21.15.60:0/323217128 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400e070 con 0x7fe0540cb4f0 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe058caf700 1 -- 172.21.15.60:0/323217128 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400bab0 con 0x7fe0540cb4f0 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.452+0000 7fe058caf700 1 -- 172.21.15.60:0/323217128 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400be50 con 0x7fe0540cb4f0 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 -- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 msgr2=0x7fe0540cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0540cb990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe044009e60 tx=0x7fe044009780 comp rx=0 tx=0).stop 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 -- 172.21.15.60:0/323217128 shutdown_connections 2023-10-08T16:10:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0540cb990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 --2- 172.21.15.60:0/323217128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 -- 172.21.15.60:0/323217128 >> 172.21.15.60:0/323217128 conn(0x7fe054069870 msgr2=0x7fe054069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 -- 172.21.15.60:0/323217128 shutdown_connections 2023-10-08T16:10:51.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.453+0000 7fe05bf15700 1 -- 172.21.15.60:0/323217128 wait complete. 2023-10-08T16:10:51.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.454+0000 7fe05bf15700 1 Processor -- start 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.454+0000 7fe05bf15700 1 -- start start 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05bf15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05bf15700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 0x7fe05414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05bf15700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0541719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05bf15700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054155030 con 0x7fe0540b1220 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05bf15700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415faa0 con 0x7fe0540cb4f0 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05bf15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415fd80 con 0x7fe0540b0e50 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 0x7fe05414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 0x7fe05414c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36762/0 (socket says 172.21.15.60:36762) 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 -- 172.21.15.60:0/176273643 learned_addr learned my addr 172.21.15.60:0/176273643 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0541719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe059cb1700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 -- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 msgr2=0x7fe0540c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 -- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 msgr2=0x7fe0541719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0541719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe0594b0700 1 -- 172.21.15.60:0/176273643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009420 con 0x7fe0540b1220 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe059cb1700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:51.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.455+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0541719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:51.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.456+0000 7fe0594b0700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 0x7fe05414c4f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c7c0 tx=0x7fe048007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.456+0000 7fe051ffb700 1 -- 172.21.15.60:0/176273643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048005b30 con 0x7fe0540b1220 2023-10-08T16:10:51.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.456+0000 7fe051ffb700 1 -- 172.21.15.60:0/176273643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048005c90 con 0x7fe0540b1220 2023-10-08T16:10:51.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.456+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe044009a20 con 0x7fe0540b1220 2023-10-08T16:10:51.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.456+0000 7fe051ffb700 1 -- 172.21.15.60:0/176273643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048007340 con 0x7fe0540b1220 2023-10-08T16:10:51.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.456+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe054160340 con 0x7fe0540b1220 2023-10-08T16:10:51.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.457+0000 7fe051ffb700 1 -- 172.21.15.60:0/176273643 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe04801b400 con 0x7fe0540b1220 2023-10-08T16:10:51.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.458+0000 7fe051ffb700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.458+0000 7fe051ffb700 1 -- 172.21.15.60:0/176273643 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0480840f0 con 0x7fe0540b1220 2023-10-08T16:10:51.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.458+0000 7fe059cb1700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.458+0000 7fe059cb1700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe040066f30 0x7fe0400693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0093f0 tx=0x7fe04c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.460+0000 7fe06520db80 1 Processor -- start 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.460+0000 7fe06520db80 1 -- start start 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.460+0000 7fe06520db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 0x560366f2de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.460+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f77d00 0x560366f56a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.460+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f56f60 0x560366f29cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe06520db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366e84a70 con 0x560366f2da50 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366e82270 con 0x560366f77d00 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x560366e7e060 con 0x560366f56f60 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 0x560366f2de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 0x560366f2de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36764/0 (socket says 172.21.15.60:36764) 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 -- 172.21.15.60:0/1398688239 learned_addr learned my addr 172.21.15.60:0/1398688239 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe0594b0700 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f77d00 0x560366f56a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 -- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f56f60 msgr2=0x560366f29cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f56f60 0x560366f29cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f56f60 0x560366f29cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 -- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f77d00 msgr2=0x560366f56a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f77d00 0x560366f56a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 -- 172.21.15.60:0/1398688239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560366d18270 con 0x560366f2da50 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe059cb1700 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 0x560366f2de20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe04c015440 tx=0x7fe04c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5f80d8fe8aa66e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe03affd700 1 -- 172.21.15.60:0/1398688239 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c015d40 con 0x560366f2da50 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe03affd700 1 -- 172.21.15.60:0/1398688239 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c021440 con 0x560366f2da50 2023-10-08T16:10:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.461+0000 7fe03affd700 1 -- 172.21.15.60:0/1398688239 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c015ea0 con 0x560366f2da50 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 -- 172.21.15.60:0/1398688239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 msgr2=0x560366f2de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 0x560366f2de20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe04c015440 tx=0x7fe04c018000 comp rx=0 tx=0).stop 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 -- 172.21.15.60:0/1398688239 shutdown_connections 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f56f60 0x560366f29cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f2da50 0x560366f2de20 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 --2- 172.21.15.60:0/1398688239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f77d00 0x560366f56a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 -- 172.21.15.60:0/1398688239 >> 172.21.15.60:0/1398688239 conn(0x560366f2f370 msgr2=0x560366f2f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 -- 172.21.15.60:0/1398688239 shutdown_connections 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.462+0000 7fe06520db80 1 -- 172.21.15.60:0/1398688239 wait complete. 2023-10-08T16:10:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.463+0000 7fe06520db80 1 -- start start 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.463+0000 7fe06520db80 1 Processor -- start 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f6e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f70300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366e29890 con 0x560366f56f60 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366e44ea0 con 0x560366f2da50 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x560366d00e30 con 0x560366f77d00 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f6e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 10 client.0 _ll_register_callbacks cb 0x560366ef1110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f6e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36770/0 (socket says 172.21.15.60:36770) 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 -- 172.21.15.60:0/409656967 learned_addr learned my addr 172.21.15.60:0/409656967 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f70300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe059cb1700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 -- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 msgr2=0x560366f70300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f70300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 -- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 msgr2=0x560366f84090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f84090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 -- 172.21.15.60:0/409656967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c011c10 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe059cb1700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe0594b0700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f6e2d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe048054d00 tx=0x7fe04805a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93cdf5b11e7e2af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe033fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe033fff700 1 -- 172.21.15.60:0/409656967 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048005e00 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe033fff700 1 -- 172.21.15.60:0/409656967 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0480076b0 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560366f22b70 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe033fff700 1 -- 172.21.15.60:0/409656967 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0480544f0 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 10 client.6909 fetch_fsmap learned FSMap version 60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.464+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x560366cbafe0 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe033fff700 1 -- 172.21.15.60:0/409656967 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560366f22b70 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe033fff700 1 -- 172.21.15.60:0/409656967 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe04805bb10 con 0x560366f56f60 2023-10-08T16:10:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe06520db80 10 client.6909 fetch_fsmap finished waiting for FSMap version 60 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe06520db80 10 client.6909 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe06520db80 20 client.6909 populate_metadata read hostname 'smithi060' 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe06520db80 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f71bf0 0x560366f71fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe06520db80 4 client.6909 mds_command: new command op to 6756 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 --> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560366effaa0 con 0x560366f71bf0 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe059cb1700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f71bf0 0x560366f71fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe059cb1700 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f71bf0 0x560366f71fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee5327e17186a0 server_cookie=1dc231f279b1e7c6 in_seq=0 out_seq=0 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.465+0000 7fe033fff700 10 client.6909 ms_handle_connect on v2:172.21.15.60:6835/2777041684 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe033fff700 1 -- 172.21.15.60:0/409656967 <== mds.0 v2:172.21.15.60:6835/2777041684 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560366effaa0 con 0x560366f71bf0 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe033fff700 10 client.6909 handle_command_reply: tid=0 2023-10-08T16:10:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 client.6909 shutdown 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 msgr2=0x560366f6e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f6e2d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe048054d00 tx=0x7fe04805a040 comp rx=0 tx=0).stop 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 shutdown_connections 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f71bf0 0x560366f71fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f70300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe033fff700 0 client.6909 ms_handle_reset on v2:172.21.15.60:6835/2777041684 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 --2- 172.21.15.60:0/409656967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f6e2d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 >> 172.21.15.60:0/409656967 conn(0x560366f2f370 msgr2=0x560366f2e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 shutdown_connections 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 1 -- 172.21.15.60:0/409656967 wait complete. 2023-10-08T16:10:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.466+0000 7fe06520db80 20 client.6909 trim_cache size 0 max 16384 2023-10-08T16:10:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.483+0000 7fe06520db80 1 Processor -- start 2023-10-08T16:10:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.483+0000 7fe06520db80 1 -- start start 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f2da50 0x560366f2f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f56f60 0x560366f702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe06520db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 0x560366f29460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe06520db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366f56e20 con 0x560366f77d00 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366f70800 con 0x560366f56f60 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x560366f2a390 con 0x560366f2da50 2023-10-08T16:10:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 0x560366f29460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 0x560366f29460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36776/0 (socket says 172.21.15.60:36776) 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 -- 172.21.15.60:0/2588566619 learned_addr learned my addr 172.21.15.60:0/2588566619 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe059cb1700 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f2da50 0x560366f2f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe0594b0700 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f56f60 0x560366f702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 -- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f2da50 msgr2=0x560366f2f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f2da50 0x560366f2f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 -- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f56f60 msgr2=0x560366f702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f56f60 0x560366f702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 -- 172.21.15.60:0/2588566619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560366e4c780 con 0x560366f77d00 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.484+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 0x560366f29460 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe0540c59e0 tx=0x7fe044019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bb90e84b63012 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe03b7fe700 1 -- 172.21.15.60:0/2588566619 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400bd20 con 0x560366f77d00 2023-10-08T16:10:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe03b7fe700 1 -- 172.21.15.60:0/2588566619 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044021050 con 0x560366f77d00 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe03b7fe700 1 -- 172.21.15.60:0/2588566619 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044012890 con 0x560366f77d00 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 -- 172.21.15.60:0/2588566619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 msgr2=0x560366f29460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 0x560366f29460 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe0540c59e0 tx=0x7fe044019000 comp rx=0 tx=0).stop 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 -- 172.21.15.60:0/2588566619 shutdown_connections 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f2da50 0x560366f2f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f77d00 0x560366f29460 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 --2- 172.21.15.60:0/2588566619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f56f60 0x560366f702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 -- 172.21.15.60:0/2588566619 >> 172.21.15.60:0/2588566619 conn(0x560366f2f370 msgr2=0x560366f264b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 -- 172.21.15.60:0/2588566619 shutdown_connections 2023-10-08T16:10:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.485+0000 7fe06520db80 1 -- 172.21.15.60:0/2588566619 wait complete. 2023-10-08T16:10:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.486+0000 7fe06520db80 1 -- start start 2023-10-08T16:10:51.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.486+0000 7fe06520db80 1 Processor -- start 2023-10-08T16:10:51.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f84070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f55490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366f97580 con 0x560366f56f60 2023-10-08T16:10:51.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560366fdae90 con 0x560366f2da50 2023-10-08T16:10:51.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x560366f87c40 con 0x560366f77d00 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 10 client.0 _ll_register_callbacks cb 0x560366ef1110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f84070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f84070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36790/0 (socket says 172.21.15.60:36790) 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 -- 172.21.15.60:0/3720769968 learned_addr learned my addr 172.21.15.60:0/3720769968 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe059cb1700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe05a4b2700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f55490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 -- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 msgr2=0x560366f55490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f55490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 -- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 msgr2=0x560366f880d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f880d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 -- 172.21.15.60:0/3720769968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05415e420 con 0x560366f56f60 2023-10-08T16:10:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe0594b0700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f84070 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe048054f90 tx=0x7fe04800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a20278721863088 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe033fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe033fff700 1 -- 172.21.15.60:0/3720769968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800e040 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe033fff700 1 -- 172.21.15.60:0/3720769968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe04805bfa0 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560366f71a80 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe033fff700 1 -- 172.21.15.60:0/3720769968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe048054700 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 10 client.6915 fetch_fsmap learned FSMap version 60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.487+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x560366e33470 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe033fff700 1 -- 172.21.15.60:0/3720769968 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560366f71a80 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe033fff700 1 -- 172.21.15.60:0/3720769968 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe04806b180 con 0x560366f56f60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 10 client.6915 fetch_fsmap finished waiting for FSMap version 60 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 10 client.6915 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:10:51.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 20 client.6915 populate_metadata read hostname 'smithi060' 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f8ee00 0x560366f8f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 4 client.6915 mds_command: new command op to 6756 tid=0[{"prefix": "status"}] 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 --> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe04c021440 con 0x560366f8ee00 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe059cb1700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f8ee00 0x560366f8f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe059cb1700 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f8ee00 0x560366f8f1d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1056d03525dc4d1 server_cookie=d9afcbe9622cddc7 in_seq=0 out_seq=0 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe033fff700 10 client.6915 ms_handle_connect on v2:172.21.15.60:6835/2777041684 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe033fff700 1 -- 172.21.15.60:0/3720769968 <== mds.0 v2:172.21.15.60:6835/2777041684 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7fe04c021440 con 0x560366f8ee00 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe033fff700 10 client.6915 handle_command_reply: tid=0 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 client.6915 shutdown 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 msgr2=0x560366f84070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f84070 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe048054f90 tx=0x7fe04800a000 comp rx=0 tx=0).stop 2023-10-08T16:10:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 shutdown_connections 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:6835/2777041684,v1:172.21.15.60:6837/2777041684] conn(0x560366f8ee00 0x560366f8f1d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x560366f77d00 0x560366f55490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560366f2da50 0x560366f880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 --2- 172.21.15.60:0/3720769968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560366f56f60 0x560366f84070 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe033fff700 0 client.6915 ms_handle_reset on v2:172.21.15.60:6835/2777041684 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.488+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 >> 172.21.15.60:0/3720769968 conn(0x560366f2f370 msgr2=0x560366f700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 shutdown_connections 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe06520db80 1 -- 172.21.15.60:0/3720769968 wait complete. 2023-10-08T16:10:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe06520db80 20 client.6915 trim_cache size 0 max 16384 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 6756, 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 6.1445652810000002, 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 60, 2023-10-08T16:10:51.499 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 117, 2023-10-08T16:10:51.500 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 117, 2023-10-08T16:10:51.500 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11.439243318000001 2023-10-08T16:10:51.500 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:10:51.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe040066f30 msgr2=0x7fe0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe040066f30 0x7fe0400693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0093f0 tx=0x7fe04c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 msgr2=0x7fe05414c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 0x7fe05414c4f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c7c0 tx=0x7fe048007e00 comp rx=0 tx=0).stop 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 shutdown_connections 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0540b0e50 0x7fe0540c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0540cb4f0 0x7fe0541719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 --2- 172.21.15.60:0/176273643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0540b1220 0x7fe05414c4f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 >> 172.21.15.60:0/176273643 conn(0x7fe054069870 msgr2=0x7fe0540ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 shutdown_connections 2023-10-08T16:10:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.489+0000 7fe05bf15700 1 -- 172.21.15.60:0/176273643 wait complete. 2023-10-08T16:10:51.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:10:51.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.620+0000 7ff52a8a0700 1 Processor -- start 2023-10-08T16:10:51.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.620+0000 7ff52a8a0700 1 -- start start 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff52a8a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff524157870 0x7ff52415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff52a8a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff524157c40 0x7ff524158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff52a8a0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52415cbb0 con 0x7ff52415a620 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff52a8a0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52415bfa0 con 0x7ff524157c40 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff52a8a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52415c280 con 0x7ff524157870 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff528e3d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff524157c40 0x7ff524158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff5237fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff52415a620 0x7ff52415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55982/0 (socket says 172.21.15.60:55982) 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff5237fe700 1 -- 172.21.15.60:0/4154396850 learned_addr learned my addr 172.21.15.60:0/4154396850 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff523fff700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff524157870 0x7ff52415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff528e3d700 1 -- 172.21.15.60:0/4154396850 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff524157870 msgr2=0x7ff52415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff528e3d700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff524157870 0x7ff52415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff528e3d700 1 -- 172.21.15.60:0/4154396850 >> v1:172.21.15.60:6789/0 conn(0x7ff52415a620 legacy=0x7ff52415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff528e3d700 1 -- 172.21.15.60:0/4154396850 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52415c560 con 0x7ff524157c40 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff522ffd700 1 -- 172.21.15.60:0/4154396850 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018756090 0 0) 0x7ff52415cbb0 con 0x7ff52415a620 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.621+0000 7ff523fff700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff524157870 0x7ff52415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff528e3d700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff524158110 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009e60 tx=0x7ff51c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70296f259fdc0ca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff522ffd700 1 -- 172.21.15.60:0/4154396850 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00e070 con 0x7ff524157c40 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff522ffd700 1 -- 172.21.15.60:0/4154396850 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00bc30 con 0x7ff524157c40 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff522ffd700 1 -- 172.21.15.60:0/4154396850 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c012430 con 0x7ff524157c40 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 -- 172.21.15.60:0/4154396850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 msgr2=0x7ff524158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff524158110 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009e60 tx=0x7ff51c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 -- 172.21.15.60:0/4154396850 shutdown_connections 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff524158110 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/4154396850 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff524157870 0x7ff52415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 -- 172.21.15.60:0/4154396850 >> 172.21.15.60:0/4154396850 conn(0x7ff524068ce0 msgr2=0x7ff5240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 -- 172.21.15.60:0/4154396850 shutdown_connections 2023-10-08T16:10:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.622+0000 7ff52a8a0700 1 -- 172.21.15.60:0/4154396850 wait complete. 2023-10-08T16:10:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.623+0000 7ff52a8a0700 1 Processor -- start 2023-10-08T16:10:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 -- start start 2023-10-08T16:10:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff524157870 0x7ff52416aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff5240c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff52415a620 0x7ff52416b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240c62d0 con 0x7ff524157c40 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52415da10 con 0x7ff524157870 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff52a8a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240c6050 con 0x7ff52415a620 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff5237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff5240c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff5237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff5240c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36808/0 (socket says 172.21.15.60:36808) 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.624+0000 7ff5237fe700 1 -- 172.21.15.60:0/77741692 learned_addr learned my addr 172.21.15.60:0/77741692 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff523fff700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff524157870 0x7ff52416aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff528e3d700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff52415a620 0x7ff52416b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff5237fe700 1 -- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff52415a620 msgr2=0x7ff52416b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff5237fe700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff52415a620 0x7ff52416b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff5237fe700 1 -- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff524157870 msgr2=0x7ff52416aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff5237fe700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff524157870 0x7ff52416aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff5237fe700 1 -- 172.21.15.60:0/77741692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c009a20 con 0x7ff524157c40 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff528e3d700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff52415a620 0x7ff52416b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff5237fe700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff5240c5b10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c5e0 tx=0x7ff518001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518005b30 con 0x7ff524157c40 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518005c90 con 0x7ff524157c40 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52415d0e0 con 0x7ff524157c40 2023-10-08T16:10:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5180072e0 con 0x7ff524157c40 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.625+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52415d6a0 con 0x7ff524157c40 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.626+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52404c3c0 con 0x7ff524157c40 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.627+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff518012400 con 0x7ff524157c40 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.627+0000 7ff50bfff700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff510066f30 0x7ff5100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.627+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff518083970 con 0x7ff524157c40 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.627+0000 7ff523fff700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff510066f30 0x7ff5100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.628+0000 7ff523fff700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff510066f30 0x7ff5100693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff514006f00 tx=0x7ff514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.631+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff51804b5a0 con 0x7ff524157c40 2023-10-08T16:10:51.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.870+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff52415db50 con 0x7ff524157c40 2023-10-08T16:10:51.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.870+0000 7ff50bfff700 1 -- 172.21.15.60:0/77741692 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff518017020 con 0x7ff524157c40 2023-10-08T16:10:51.871 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:10:51.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff510066f30 msgr2=0x7ff5100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff510066f30 0x7ff5100693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff514006f00 tx=0x7ff514008040 comp rx=0 tx=0).stop 2023-10-08T16:10:51.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 msgr2=0x7ff5240c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff5240c5b10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c5e0 tx=0x7ff518001070 comp rx=0 tx=0).stop 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 shutdown_connections 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff510066f30 0x7ff5100693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff52415a620 0x7ff52416b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff524157870 0x7ff52416aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 --2- 172.21.15.60:0/77741692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff524157c40 0x7ff5240c5b10 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 >> 172.21.15.60:0/77741692 conn(0x7ff524068ce0 msgr2=0x7ff5240b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 shutdown_connections 2023-10-08T16:10:51.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:51.872+0000 7ff52a8a0700 1 -- 172.21.15.60:0/77741692 wait complete. 2023-10-08T16:10:51.885 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:10:51.885 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:10:51.886 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:51.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:51.886 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:10:51.902 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42089sec preferred_lft 42089sec 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:51.903 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:10:51.904 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.905 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:51.905 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:10:51.905 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:10:51.905 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:51.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:51.905 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:10:51.966 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:10:51.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:51.967 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:10:52.023 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:10:52.023 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:10:52.024 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:10:52.024 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:10:52.024 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:10:52.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:52.024 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:10:52.024 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:10:52.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:10:52.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:10:52.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:10:52.025 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:10:52.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:52.127 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:10:52.141 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:10:52.142 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:10:52.142 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:52.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:52.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:10:52.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:52.208 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:52.263 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:52.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:52.264 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:52.318 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:10:52.318 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:10:52.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:52.399 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:52.399 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:52.418 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:52.418 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:52.418 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:52.418 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:52.418 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:52.419 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:52.419 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:52.419 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:52.439 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:52.439 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:52.439 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:10:52.440 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:10:52.441 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:10:52.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:52.441 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:52.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:10:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.665+0000 7f535514c700 1 Processor -- start 2023-10-08T16:10:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.665+0000 7f535514c700 1 -- start start 2023-10-08T16:10:52.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f535514c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 0x7f5350161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f535514c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500c9cb0 con 0x7f53500abae0 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f535514c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500c90a0 con 0x7f53500c75c0 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f535514c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c9380 con 0x7f53500ade00 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f53500abae0 0x7f53500c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53300/0 (socket says 172.21.15.60:53300) 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534ed9d700 1 -- 172.21.15.60:0/3876669277 learned_addr learned my addr 172.21.15.60:0/3876669277 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534f59e700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 0x7f5350161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269088719 0 0) 0x7f53500c9cb0 con 0x7f53500abae0 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338005780 con 0x7f53500abae0 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519017455 0 0) 0x7f5338005780 con 0x7f53500abae0 2023-10-08T16:10:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 msgr2=0x7f5350161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 0x7f5350161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 >> v1:172.21.15.144:6789/0 conn(0x7f53500c75c0 legacy=0x7f53500c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500c9660 con 0x7f53500abae0 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f5340001470 con 0x7f53500abae0 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 >> v1:172.21.15.60:6789/0 conn(0x7f53500abae0 legacy=0x7f53500c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 0x7f5338005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53380061e0 0x7f5338006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5338006f60 0x7f53380073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c9380 con 0x7f5338006f60 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533800ddb0 con 0x7f53380061e0 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533800df70 con 0x7f53500ade00 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.666+0000 7f534f59e700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5338006f60 0x7f53380073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534ed9d700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 0x7f5338005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534e59c700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53380061e0 0x7f5338006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 -- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 msgr2=0x7f5338005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ade00 0x7f5338005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 -- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53380061e0 msgr2=0x7f5338006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53380061e0 0x7f5338006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 -- 172.21.15.60:0/3876669277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338005780 con 0x7f5338006f60 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534e59c700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53380061e0 0x7f5338006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5338006f60 0x7f53380073d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f534800e210 tx=0x7f534800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92767c96f803aa6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800eac0 con 0x7f5338006f60 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800f040 con 0x7f5338006f60 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534dd9b700 1 -- 172.21.15.60:0/3876669277 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800ee70 con 0x7f5338006f60 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f535514c700 1 -- 172.21.15.60:0/3876669277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5338006f60 msgr2=0x7f53380073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f535514c700 1 --2- 172.21.15.60:0/3876669277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5338006f60 0x7f53380073d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f534800e210 tx=0x7f534800b040 comp rx=0 tx=0).stop 2023-10-08T16:10:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.667+0000 7f534f59e700 1 -- 172.21.15.60:0/3876669277 reap_dead start 2023-10-08T16:10:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.668+0000 7f535514c700 1 -- 172.21.15.60:0/3876669277 shutdown_connections 2023-10-08T16:10:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.668+0000 7f535514c700 1 -- 172.21.15.60:0/3876669277 >> 172.21.15.60:0/3876669277 conn(0x7f5350067660 msgr2=0x7f5350067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.668+0000 7f535514c700 1 -- 172.21.15.60:0/3876669277 shutdown_connections 2023-10-08T16:10:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.668+0000 7f535514c700 1 -- 172.21.15.60:0/3876669277 wait complete. 2023-10-08T16:10:52.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.669+0000 7f535514c700 1 Processor -- start 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.669+0000 7f535514c700 1 -- start start 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.669+0000 7f535514c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 0x7f53500b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350156280 0x7f53500b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ccac0 0x7f53500ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500b0d70 con 0x7f5350155eb0 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500cb680 con 0x7f5350156280 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500b2490 con 0x7f53500ccac0 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 0x7f53500b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 0x7f53500b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47834/0 (socket says 172.21.15.60:47834) 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 -- 172.21.15.60:0/2311578991 learned_addr learned my addr 172.21.15.60:0/2311578991 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534e59c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350156280 0x7f53500b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534f59e700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ccac0 0x7f53500ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 -- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ccac0 msgr2=0x7f53500ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ccac0 0x7f53500ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 -- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350156280 msgr2=0x7f53500b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350156280 0x7f53500b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 -- 172.21.15.60:0/2311578991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500cade0 con 0x7f5350155eb0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f534ed9d700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 0x7f53500b1f50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f53400073c0 tx=0x7f5340001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400077a0 con 0x7f5350155eb0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000f8d0 con 0x7f5350155eb0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53500cb0c0 con 0x7f5350155eb0 2023-10-08T16:10:52.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000fc90 con 0x7f5350155eb0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.670+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53500b0f50 con 0x7f5350155eb0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.671+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535004c3c0 con 0x7f5350155eb0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.672+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f534001d460 con 0x7f5350155eb0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.672+0000 7f5336ffd700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.672+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5340084650 con 0x7f5350155eb0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.672+0000 7f534e59c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.673+0000 7f534e59c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f533c066f30 0x7f533c0693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5344007ba0 tx=0x7f534400c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:52.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.677+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53400518c0 con 0x7f5350155eb0 2023-10-08T16:10:52.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.918+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f535006aeb0 con 0x7f5350155eb0 2023-10-08T16:10:52.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.918+0000 7f5336ffd700 1 -- 172.21.15.60:0/2311578991 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5340054ee0 con 0x7f5350155eb0 2023-10-08T16:10:52.919 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:10:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f533c066f30 msgr2=0x7f533c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f533c066f30 0x7f533c0693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5344007ba0 tx=0x7f534400c040 comp rx=0 tx=0).stop 2023-10-08T16:10:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 msgr2=0x7f53500b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 0x7f53500b1f50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f53400073c0 tx=0x7f5340001da0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 shutdown_connections 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53500ccac0 0x7f53500ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5350155eb0 0x7f53500b1f50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 --2- 172.21.15.60:0/2311578991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350156280 0x7f53500b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 >> 172.21.15.60:0/2311578991 conn(0x7f5350067660 msgr2=0x7f53500c3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 shutdown_connections 2023-10-08T16:10:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:52.920+0000 7f535514c700 1 -- 172.21.15.60:0/2311578991 wait complete. 2023-10-08T16:10:52.933 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:10:52.934 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:10:52.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:52.934 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:10:52.952 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:10:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:10:52.954 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:10:52.954 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:52.954 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:10:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:10:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42090sec preferred_lft 42090sec 2023-10-08T16:10:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:10:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.955 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:10:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:10:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:10:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.956 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:10:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:10:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.957 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:10:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:10:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:52.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:52.958 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:10:53.018 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:10:53.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:53.019 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:10:53.077 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:10:53.077 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:10:53.077 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:10:53.078 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:10:53.078 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:10:53.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:53.078 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:10:53.078 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:10:53.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:10:53.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:10:53.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:10:53.078 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:10:53.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:53.182 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:10:53.197 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:10:53.197 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:10:53.197 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:10:53.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:53.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:10:53.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:53.262 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:53.317 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:10:53.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:53.317 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:53.371 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:10:53.371 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:10:53.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:53.453 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:53.453 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:53.472 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:53.472 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:53.472 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:53.473 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:53.473 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:53.473 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:53.473 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:53.473 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:53.494 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:10:53.495 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:10:53.497 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:10:53.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:53.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:53.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:53.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.687+0000 7f229bd47700 1 Processor -- start 2023-10-08T16:10:53.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.688+0000 7f229bd47700 1 -- start start 2023-10-08T16:10:53.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.688+0000 7f229bd47700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f22941510f0 0x7f229406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.688+0000 7f229bd47700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2294070700 0x7f2294070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.688+0000 7f229bd47700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2294071040 con 0x7f22940c9af0 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.688+0000 7f229bd47700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940ca0b0 con 0x7f2294070700 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.688+0000 7f229bd47700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2294068a10 con 0x7f22941510f0 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2294070700 0x7f2294070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2294070700 0x7f2294070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47846/0 (socket says 172.21.15.60:47846) 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 -- 172.21.15.60:0/839147676 learned_addr learned my addr 172.21.15.60:0/839147676 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f22992e2700 1 --1- 172.21.15.60:0/839147676 >> v1:172.21.15.60:6789/0 conn(0x7f22940c9af0 0x7f229415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53310/0 (socket says 172.21.15.60:53310) 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f2299ae3700 1 --2- 172.21.15.60:0/839147676 >> v2:172.21.15.144:3300/0 conn(0x7f22941510f0 0x7f229406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 -- 172.21.15.60:0/839147676 >> v2:172.21.15.144:3300/0 conn(0x7f22941510f0 msgr2=0x7f229406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 --2- 172.21.15.60:0/839147676 >> v2:172.21.15.144:3300/0 conn(0x7f22941510f0 0x7f229406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 -- 172.21.15.60:0/839147676 >> v1:172.21.15.60:6789/0 conn(0x7f22940c9af0 legacy=0x7f229415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f2298ae1700 1 -- 172.21.15.60:0/839147676 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023647973 0 0) 0x7f2294071040 con 0x7f22940c9af0 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 -- 172.21.15.60:0/839147676 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294068cf0 con 0x7f2294070700 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f229a2e4700 1 --2- 172.21.15.60:0/839147676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2294070700 0x7f2294070b00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f229406e0b0 tx=0x7f2284009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858e5b0e73c4261 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f2298ae1700 1 -- 172.21.15.60:0/839147676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400e070 con 0x7f2294070700 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f2298ae1700 1 -- 172.21.15.60:0/839147676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400ba20 con 0x7f2294070700 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.689+0000 7f2298ae1700 1 -- 172.21.15.60:0/839147676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840092e0 con 0x7f2294070700 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 -- 172.21.15.60:0/839147676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2294070700 msgr2=0x7f2294070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 --2- 172.21.15.60:0/839147676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2294070700 0x7f2294070b00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f229406e0b0 tx=0x7f2284009840 comp rx=0 tx=0).stop 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 -- 172.21.15.60:0/839147676 shutdown_connections 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 --2- 172.21.15.60:0/839147676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2294070700 0x7f2294070b00 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 --2- 172.21.15.60:0/839147676 >> v2:172.21.15.144:3300/0 conn(0x7f22941510f0 0x7f229406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 -- 172.21.15.60:0/839147676 >> 172.21.15.60:0/839147676 conn(0x7f22940ca4f0 msgr2=0x7f22940ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 -- 172.21.15.60:0/839147676 shutdown_connections 2023-10-08T16:10:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.690+0000 7f229bd47700 1 -- 172.21.15.60:0/839147676 wait complete. 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.691+0000 7f229bd47700 1 Processor -- start 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.691+0000 7f229bd47700 1 -- start start 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229bd47700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2294070700 0x7f22940afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229bd47700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22940c9af0 0x7f22940c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229bd47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 0x7f22940c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229bd47700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229416a910 con 0x7f22941510f0 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229bd47700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c79c0 con 0x7f2294070700 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229bd47700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c6920 con 0x7f22940c9af0 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 0x7f22940c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 0x7f22940c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47854/0 (socket says 172.21.15.60:47854) 2023-10-08T16:10:53.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 -- 172.21.15.60:0/1726482576 learned_addr learned my addr 172.21.15.60:0/1726482576 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f22992e2700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22940c9af0 0x7f22940c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f2299ae3700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2294070700 0x7f22940afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 -- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22940c9af0 msgr2=0x7f22940c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22940c9af0 0x7f22940c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 -- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2294070700 msgr2=0x7f22940afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2294070700 0x7f22940afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 -- 172.21.15.60:0/1726482576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284009ae0 con 0x7f22941510f0 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f2299ae3700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2294070700 0x7f22940afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f22992e2700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22940c9af0 0x7f22940c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.692+0000 7f229a2e4700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 0x7f22940c3fc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2284009880 tx=0x7f2284018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.693+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284008be0 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.693+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2284008d40 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.693+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940c6c00 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.693+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840266b0 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.693+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22940c71c0 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.694+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229406dec0 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.694+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2284003040 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.695+0000 7f2291ffb700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2280066f30 0x7f22800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.695+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22840865a0 con 0x7f22941510f0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.695+0000 7f2299ae3700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2280066f30 0x7f22800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.695+0000 7f2299ae3700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2280066f30 0x7f22800693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f228c006f00 tx=0x7f228c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.699+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2284053810 con 0x7f22941510f0 2023-10-08T16:10:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.935+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f229404c3c0 con 0x7f22941510f0 2023-10-08T16:10:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.935+0000 7f2291ffb700 1 -- 172.21.15.60:0/1726482576 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f2284009940 con 0x7f22941510f0 2023-10-08T16:10:53.937 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:53.937 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:10:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2280066f30 msgr2=0x7f22800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2280066f30 0x7f22800693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f228c006f00 tx=0x7f228c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 msgr2=0x7f22940c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 0x7f22940c3fc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2284009880 tx=0x7f2284018000 comp rx=0 tx=0).stop 2023-10-08T16:10:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 shutdown_connections 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2280066f30 0x7f22800693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22941510f0 0x7f22940c3fc0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2294070700 0x7f22940afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 --2- 172.21.15.60:0/1726482576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22940c9af0 0x7f22940c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 >> 172.21.15.60:0/1726482576 conn(0x7f22940ca4f0 msgr2=0x7f2294070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 shutdown_connections 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:53.938+0000 7f229bd47700 1 -- 172.21.15.60:0/1726482576 wait complete. 2023-10-08T16:10:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:10:53.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-08T16:10:54.089 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":6756,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.7343570810000006,"mdsmap_epoch":60,"osdmap_epoch":117,"osdmap_epoch_barrier":117,"uptime":14.029037978} 2023-10-08T16:10:54.090 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 6756, "mdsmap_epoch": 60, "osdmap_epoch": 117, "osdmap_epoch_barrier": 117, "rank_uptime": 8.734357081, "state": "up:active", "uptime": 14.029037978, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:10:54.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-08T16:10:54.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.212+0000 7f5fcd5c4700 1 Processor -- start 2023-10-08T16:10:54.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.212+0000 7f5fcd5c4700 1 -- start start 2023-10-08T16:10:54.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fcd5c4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fc809a1d0 0x7f5fc80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fcd5c4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5fc806e9e0 0x7f5fc80cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fcd5c4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc8097a00 con 0x7f5fc809a5a0 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fcd5c4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80c8480 con 0x7f5fc806e9e0 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fcd5c4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80c7870 con 0x7f5fc809a1d0 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5fc806e9e0 0x7f5fc80cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc67fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5fc809a5a0 0x7f5fc806e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53322/0 (socket says 172.21.15.60:53322) 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5fc806e9e0 0x7f5fc80cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47856/0 (socket says 172.21.15.60:47856) 2023-10-08T16:10:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc67fc700 1 -- 172.21.15.60:0/4269160614 learned_addr learned my addr 172.21.15.60:0/4269160614 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc6ffd700 1 --2- 172.21.15.60:0/4269160614 >> v2:172.21.15.144:3300/0 conn(0x7f5fc809a1d0 0x7f5fc80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 -- 172.21.15.60:0/4269160614 >> v2:172.21.15.144:3300/0 conn(0x7f5fc809a1d0 msgr2=0x7f5fc80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 --2- 172.21.15.60:0/4269160614 >> v2:172.21.15.144:3300/0 conn(0x7f5fc809a1d0 0x7f5fc80cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 -- 172.21.15.60:0/4269160614 >> v1:172.21.15.60:6789/0 conn(0x7f5fc809a5a0 legacy=0x7f5fc806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc5ffb700 1 -- 172.21.15.60:0/4269160614 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037024343 0 0) 0x7f5fc8097a00 con 0x7f5fc809a5a0 2023-10-08T16:10:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 -- 172.21.15.60:0/4269160614 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80c7b50 con 0x7f5fc806e9e0 2023-10-08T16:10:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc77fe700 1 --2- 172.21.15.60:0/4269160614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cc3b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5fc806d3d0 tx=0x7f5fc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2747b2150adbeb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.213+0000 7f5fc5ffb700 1 -- 172.21.15.60:0/4269160614 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000e070 con 0x7f5fc806e9e0 2023-10-08T16:10:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fc5ffb700 1 -- 172.21.15.60:0/4269160614 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc000bb60 con 0x7f5fc806e9e0 2023-10-08T16:10:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fc5ffb700 1 -- 172.21.15.60:0/4269160614 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0012430 con 0x7f5fc806e9e0 2023-10-08T16:10:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4269160614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 msgr2=0x7f5fc80cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4269160614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cc3b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5fc806d3d0 tx=0x7f5fc0009780 comp rx=0 tx=0).stop 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4269160614 shutdown_connections 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4269160614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cc3b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4269160614 >> v2:172.21.15.144:3300/0 conn(0x7f5fc809a1d0 0x7f5fc80cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4269160614 >> 172.21.15.60:0/4269160614 conn(0x7f5fc80cd230 msgr2=0x7f5fc80cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4269160614 shutdown_connections 2023-10-08T16:10:54.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.214+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4269160614 wait complete. 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.215+0000 7f5fcd5c4700 1 Processor -- start 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.215+0000 7f5fcd5c4700 1 -- start start 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fcd5c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fcd5c4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fc809a1d0 0x7f5fc80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fcd5c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fc809a5a0 0x7f5fc8098700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fcd5c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80b2ed0 con 0x7f5fc806e9e0 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fcd5c4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80c65b0 con 0x7f5fc809a1d0 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fcd5c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80affe0 con 0x7f5fc809a5a0 2023-10-08T16:10:54.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fc6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fc6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47870/0 (socket says 172.21.15.60:47870) 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fc6ffd700 1 -- 172.21.15.60:0/4149276297 learned_addr learned my addr 172.21.15.60:0/4149276297 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fc67fc700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fc809a1d0 0x7f5fc80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fc77fe700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fc809a5a0 0x7f5fc8098700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.216+0000 7f5fc6ffd700 1 -- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fc809a5a0 msgr2=0x7f5fc8098700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fc6ffd700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fc809a5a0 0x7f5fc8098700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fc6ffd700 1 -- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fc809a1d0 msgr2=0x7f5fc80c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fc6ffd700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fc809a1d0 0x7f5fc80c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fc6ffd700 1 -- 172.21.15.60:0/4149276297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0009a20 con 0x7f5fc806e9e0 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fc6ffd700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cb810 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800ec80 tx=0x7f5fb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800c850 con 0x7f5fc806e9e0 2023-10-08T16:10:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb800c9b0 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc80b0880 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800cd50 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.217+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc80b02b0 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.218+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc80b0b60 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.218+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fb8013680 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.219+0000 7f5faeffd700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5fb4066f30 0x7f5fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.219+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fb8084800 con 0x7f5fc806e9e0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.219+0000 7f5fc67fc700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5fb4066f30 0x7f5fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.219+0000 7f5fc67fc700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5fb4066f30 0x7f5fb40693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5fc816b490 tx=0x7f5fbc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.223+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fb80519d0 con 0x7f5fc806e9e0 2023-10-08T16:10:54.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:54.417+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f5fc804c3c0 con 0x7f5fc806e9e0 2023-10-08T16:10:55.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.379+0000 7f5faeffd700 1 -- 172.21.15.60:0/4149276297 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v118) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5fb8054ff0 con 0x7f5fc806e9e0 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5fb4066f30 msgr2=0x7f5fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5fb4066f30 0x7f5fb40693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5fc816b490 tx=0x7f5fbc007d30 comp rx=0 tx=0).stop 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 msgr2=0x7f5fc80cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cb810 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800ec80 tx=0x7f5fb80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 shutdown_connections 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5fb4066f30 0x7f5fb40693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fc809a5a0 0x7f5fc8098700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fc806e9e0 0x7f5fc80cb810 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 --2- 172.21.15.60:0/4149276297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fc809a1d0 0x7f5fc80c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 >> 172.21.15.60:0/4149276297 conn(0x7f5fc80cd230 msgr2=0x7f5fc806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:55.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 shutdown_connections 2023-10-08T16:10:55.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.382+0000 7f5fcd5c4700 1 -- 172.21.15.60:0/4149276297 wait complete. 2023-10-08T16:10:55.385 INFO:teuthology.orchestra.run.smithi060.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-08T16:10:55.399 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:10:55.399 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:10:55.399 DEBUG:teuthology.orchestra.run.smithi060:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T16:10:55.399 DEBUG:teuthology.orchestra.run.smithi060:> os.fchmod(fd, 0O666) 2023-10-08T16:10:55.399 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(fd) 2023-10-08T16:10:55.400 DEBUG:teuthology.orchestra.run.smithi060:> os.close(fd) 2023-10-08T16:10:55.400 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:10:55.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:55.659 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:10:55.730 INFO:teuthology.orchestra.run.smithi060.stdout:client6927 2023-10-08T16:10:55.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:55.730 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client6927/osdmap') 2023-10-08T16:10:55.809 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 117 barrier 117 flags 0x588000 2023-10-08T16:10:55.809 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:55.809 INFO:teuthology.orchestra.run.smithi060.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:10:55.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:10:55.811 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:10:55.811 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:10:55.811 INFO:teuthology.orchestra.run.smithi060.stderr:799 bytes copied, 4.0835e-05 s, 19.6 MB/s 2023-10-08T16:10:55.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-08T16:10:55.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.971+0000 7f508ae26700 1 Processor -- start 2023-10-08T16:10:55.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.971+0000 7f508ae26700 1 -- start start 2023-10-08T16:10:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.971+0000 7f508ae26700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f508415a2b0 0x7f50840b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.971+0000 7f508ae26700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840c5d80 con 0x7f50840cfe20 2023-10-08T16:10:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.971+0000 7f508ae26700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840c6060 con 0x7f50840d1c30 2023-10-08T16:10:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.971+0000 7f508ae26700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5084068470 con 0x7f508415a2b0 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f5088bc2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f508415a2b0 0x7f50840b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f50893c3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f50840cfe20 0x7f50840c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53338/0 (socket says 172.21.15.60:53338) 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f50893c3700 1 -- 172.21.15.60:0/774978809 learned_addr learned my addr 172.21.15.60:0/774978809 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f5088bc2700 1 -- 172.21.15.60:0/774978809 >> v1:172.21.15.144:6789/0 conn(0x7f50840d1c30 legacy=0x7f50840cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f5088bc2700 1 -- 172.21.15.60:0/774978809 >> v1:172.21.15.60:6789/0 conn(0x7f50840cfe20 legacy=0x7f50840c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f5088bc2700 1 -- 172.21.15.60:0/774978809 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840c6340 con 0x7f508415a2b0 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f50837fe700 1 -- 172.21.15.60:0/774978809 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320154291 0 0) 0x7f50840c5d80 con 0x7f50840cfe20 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f5088bc2700 1 --2- 172.21.15.60:0/774978809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f508415a2b0 0x7f50840b3da0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f507c0098d0 tx=0x7f507c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62caba944c4c7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f50837fe700 1 -- 172.21.15.60:0/774978809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c009e70 con 0x7f508415a2b0 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f50837fe700 1 -- 172.21.15.60:0/774978809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c005c10 con 0x7f508415a2b0 2023-10-08T16:10:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.972+0000 7f50837fe700 1 -- 172.21.15.60:0/774978809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00b610 con 0x7f508415a2b0 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 -- 172.21.15.60:0/774978809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f508415a2b0 msgr2=0x7f50840b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 --2- 172.21.15.60:0/774978809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f508415a2b0 0x7f50840b3da0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f507c0098d0 tx=0x7f507c009120 comp rx=0 tx=0).stop 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 -- 172.21.15.60:0/774978809 shutdown_connections 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 --2- 172.21.15.60:0/774978809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f508415a2b0 0x7f50840b3da0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 -- 172.21.15.60:0/774978809 >> 172.21.15.60:0/774978809 conn(0x7f5084067e40 msgr2=0x7f50840d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 -- 172.21.15.60:0/774978809 shutdown_connections 2023-10-08T16:10:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.973+0000 7f508ae26700 1 -- 172.21.15.60:0/774978809 wait complete. 2023-10-08T16:10:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.974+0000 7f508ae26700 1 Processor -- start 2023-10-08T16:10:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.974+0000 7f508ae26700 1 -- start start 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f508ae26700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 0x7f5084159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f508ae26700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50840d1c30 0x7f508416b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f508ae26700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508415a2b0 0x7f508416a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f508ae26700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508416b790 con 0x7f50840cfe20 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f508ae26700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508415ab50 con 0x7f508415a2b0 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f508ae26700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508415a820 con 0x7f50840d1c30 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 0x7f5084159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 0x7f5084159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47884/0 (socket says 172.21.15.60:47884) 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 -- 172.21.15.60:0/290202748 learned_addr learned my addr 172.21.15.60:0/290202748 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f50893c3700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508415a2b0 0x7f508416a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5083fff700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50840d1c30 0x7f508416b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 -- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50840d1c30 msgr2=0x7f508416b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50840d1c30 0x7f508416b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 -- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508415a2b0 msgr2=0x7f508416a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508415a2b0 0x7f508416a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5088bc2700 1 -- 172.21.15.60:0/290202748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0093c0 con 0x7f50840cfe20 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f5083fff700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50840d1c30 0x7f508416b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.975+0000 7f50893c3700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508415a2b0 0x7f508416a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.976+0000 7f5088bc2700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 0x7f5084159270 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f507c009390 tx=0x7f507c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.976+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0066c0 con 0x7f50840cfe20 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.976+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c006820 con 0x7f50840cfe20 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.976+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508416b1d0 con 0x7f50840cfe20 2023-10-08T16:10:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.976+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c026680 con 0x7f50840cfe20 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.976+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5084159c90 con 0x7f50840cfe20 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.977+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508415a680 con 0x7f50840cfe20 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.977+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f507c023070 con 0x7f50840cfe20 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.977+0000 7f5080ff9700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5064066f30 0x7f50640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.978+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f507c086950 con 0x7f50840cfe20 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.978+0000 7f5083fff700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5064066f30 0x7f50640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.978+0000 7f5083fff700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5064066f30 0x7f50640693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f50840d2000 tx=0x7f5074007440 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:55.982+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f508415a680 con 0x7f50840cfe20 2023-10-08T16:10:56.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.190+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f508415a680 con 0x7f50840cfe20 2023-10-08T16:10:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.384+0000 7f5080ff9700 1 -- 172.21.15.60:0/290202748 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v119) v1 ==== 93+0+0 (secure 0 0 0) 0x7f508415a680 con 0x7f50840cfe20 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5064066f30 msgr2=0x7f50640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5064066f30 0x7f50640693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f50840d2000 tx=0x7f5074007440 comp rx=0 tx=0).stop 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 msgr2=0x7f5084159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 0x7f5084159270 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f507c009390 tx=0x7f507c015000 comp rx=0 tx=0).stop 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 shutdown_connections 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5064066f30 0x7f50640693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f508415a2b0 0x7f508416a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50840cfe20 0x7f5084159270 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 --2- 172.21.15.60:0/290202748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50840d1c30 0x7f508416b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.386+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 >> 172.21.15.60:0/290202748 conn(0x7f5084067e40 msgr2=0x7f5084069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.387+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 shutdown_connections 2023-10-08T16:10:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.387+0000 7f508ae26700 1 -- 172.21.15.60:0/290202748 wait complete. 2023-10-08T16:10:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:pauserd,pausewr is set 2023-10-08T16:10:56.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-08T16:10:56.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.521+0000 7f991f59e700 1 Processor -- start 2023-10-08T16:10:56.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.521+0000 7f991f59e700 1 -- start start 2023-10-08T16:10:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f99200cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99201579c0 0x7f992015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991f59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200d0540 con 0x7f99201575f0 2023-10-08T16:10:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200697b0 con 0x7f99201579c0 2023-10-08T16:10:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992015b240 con 0x7f99200d1160 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991dd9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f99200cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991ed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99201579c0 0x7f992015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991ed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99201579c0 0x7f992015ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:50476/0 (socket says 172.21.15.60:50476) 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991e59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f99201575f0 0x7f99200d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37190/0 (socket says 172.21.15.60:37190) 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991ed9d700 1 -- 172.21.15.60:0/2715233189 learned_addr learned my addr 172.21.15.60:0/2715233189 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.522+0000 7f991dd9b700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f99200cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:56962/0 (socket says 172.21.15.60:56962) 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991ed9d700 1 -- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 msgr2=0x7f99200cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991ed9d700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f99200cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991ed9d700 1 -- 172.21.15.60:0/2715233189 >> v1:172.21.15.144:6789/0 conn(0x7f99201575f0 legacy=0x7f99200d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991ed9d700 1 -- 172.21.15.60:0/2715233189 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200cf930 con 0x7f99201579c0 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991dd9b700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f99200cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:56.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991ed9d700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f992015ad00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9910009f20 tx=0x7f9910009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360aa264902d1948 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991d59a700 1 -- 172.21.15.60:0/2715233189 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000e070 con 0x7f99201579c0 2023-10-08T16:10:56.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991d59a700 1 -- 172.21.15.60:0/2715233189 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000b9d0 con 0x7f99201579c0 2023-10-08T16:10:56.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.523+0000 7f991d59a700 1 -- 172.21.15.60:0/2715233189 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100092e0 con 0x7f99201579c0 2023-10-08T16:10:56.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 -- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 msgr2=0x7f992015ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f992015ad00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9910009f20 tx=0x7f9910009840 comp rx=0 tx=0).stop 2023-10-08T16:10:56.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 -- 172.21.15.60:0/2715233189 shutdown_connections 2023-10-08T16:10:56.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f992015ad00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 --2- 172.21.15.60:0/2715233189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f99200cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 -- 172.21.15.60:0/2715233189 >> 172.21.15.60:0/2715233189 conn(0x7f9920068130 msgr2=0x7f9920068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 -- 172.21.15.60:0/2715233189 shutdown_connections 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.524+0000 7f991f59e700 1 -- 172.21.15.60:0/2715233189 wait complete. 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.525+0000 7f991f59e700 1 Processor -- start 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.525+0000 7f991f59e700 1 -- start start 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f992016d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 0x7f992015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f99201502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992016a2a0 con 0x7f99201575f0 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992015f760 con 0x7f99201579c0 2023-10-08T16:10:56.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992016a540 con 0x7f99200d1160 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 0x7f992015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 0x7f992015f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47886/0 (socket says 172.21.15.60:47886) 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 -- 172.21.15.60:0/2309319340 learned_addr learned my addr 172.21.15.60:0/2309319340 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991e59c700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f992016d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991ed9d700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f99201502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 -- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 msgr2=0x7f992016d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f992016d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 -- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 msgr2=0x7f99201502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f99201502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009420 con 0x7f99201575f0 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991ed9d700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f99201502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f991dd9b700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 0x7f992015f220 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f990800ec80 tx=0x7f99080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800c920 con 0x7f99201575f0 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.526+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800ca80 con 0x7f99201575f0 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.527+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800ce00 con 0x7f99201575f0 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.527+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910009ae0 con 0x7f99201575f0 2023-10-08T16:10:56.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.527+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992016e190 con 0x7f99201575f0 2023-10-08T16:10:56.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.527+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99200d0fa0 con 0x7f99201575f0 2023-10-08T16:10:56.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.528+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9908013680 con 0x7f99201575f0 2023-10-08T16:10:56.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.528+0000 7f99167fc700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.528+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9908084910 con 0x7f99201575f0 2023-10-08T16:10:56.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.528+0000 7f991e59c700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.529+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=120+}) v3 -- 0x7f990006ea50 con 0x7f99201575f0 2023-10-08T16:10:56.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.529+0000 7f991e59c700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9918000c00 tx=0x7f9918007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.533+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9908017060 con 0x7f99201575f0 2023-10-08T16:10:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:56.740+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f992016a680 con 0x7f99201575f0 2023-10-08T16:10:57.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.386+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(120..120 src has 1..120) v4 ==== 280+0+0 (secure 0 0 0) 0x7f9908055f40 con 0x7f99201575f0 2023-10-08T16:10:57.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.386+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=121}) v3 -- 0x7f990006f340 con 0x7f99201575f0 2023-10-08T16:10:57.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.389+0000 7f99167fc700 1 -- 172.21.15.60:0/2309319340 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v120) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9908021020 con 0x7f99201575f0 2023-10-08T16:10:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9900066f30 msgr2=0x7f99000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9900066f30 0x7f99000693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9918000c00 tx=0x7f9918007e70 comp rx=0 tx=0).stop 2023-10-08T16:10:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 msgr2=0x7f992015f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 0x7f992015f220 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f990800ec80 tx=0x7f99080091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 shutdown_connections 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9900066f30 0x7f99000693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99200d1160 0x7f992016d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99201579c0 0x7f99201502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 --2- 172.21.15.60:0/2309319340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99201575f0 0x7f992015f220 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 >> 172.21.15.60:0/2309319340 conn(0x7f9920068130 msgr2=0x7f992014fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 shutdown_connections 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.392+0000 7f991f59e700 1 -- 172.21.15.60:0/2309319340 wait complete. 2023-10-08T16:10:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:pauserd,pausewr is unset 2023-10-08T16:10:57.407 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.527+0000 7f434ea11700 1 Processor -- start 2023-10-08T16:10:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.527+0000 7f434ea11700 1 -- start start 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434ea11700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f434815cbd0 0x7f434815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434ea11700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43480cb7c0 con 0x7f43480cd6e0 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434ea11700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434815e290 con 0x7f43480cdab0 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434ea11700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434815e850 con 0x7f434815cbd0 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434e210700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f434815cbd0 0x7f434815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434da0f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43480cd6e0 0x7f43480cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53354/0 (socket says 172.21.15.60:53354) 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434da0f700 1 -- 172.21.15.60:0/2932851187 learned_addr learned my addr 172.21.15.60:0/2932851187 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434e210700 1 -- 172.21.15.60:0/2932851187 >> v1:172.21.15.144:6789/0 conn(0x7f43480cdab0 legacy=0x7f434815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434e210700 1 -- 172.21.15.60:0/2932851187 >> v1:172.21.15.60:6789/0 conn(0x7f43480cd6e0 legacy=0x7f43480cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434e210700 1 -- 172.21.15.60:0/2932851187 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434815e570 con 0x7f434815cbd0 2023-10-08T16:10:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.528+0000 7f434e210700 1 --2- 172.21.15.60:0/2932851187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f434815d050 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f43380098e0 tx=0x7f43380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826a1361faa4aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ca0d700 1 -- 172.21.15.60:0/2932851187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338009e80 con 0x7f434815cbd0 2023-10-08T16:10:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ca0d700 1 -- 172.21.15.60:0/2932851187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433800b820 con 0x7f434815cbd0 2023-10-08T16:10:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ca0d700 1 -- 172.21.15.60:0/2932851187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800bba0 con 0x7f434815cbd0 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 -- 172.21.15.60:0/2932851187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 msgr2=0x7f434815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 --2- 172.21.15.60:0/2932851187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f434815d050 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f43380098e0 tx=0x7f43380091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 -- 172.21.15.60:0/2932851187 shutdown_connections 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 --2- 172.21.15.60:0/2932851187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f434815d050 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 -- 172.21.15.60:0/2932851187 >> 172.21.15.60:0/2932851187 conn(0x7f4348067660 msgr2=0x7f4348067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 -- 172.21.15.60:0/2932851187 shutdown_connections 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.529+0000 7f434ea11700 1 -- 172.21.15.60:0/2932851187 wait complete. 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.530+0000 7f434ea11700 1 Processor -- start 2023-10-08T16:10:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.530+0000 7f434ea11700 1 -- start start 2023-10-08T16:10:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434ea11700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43480cd6e0 0x7f4348144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434ea11700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43480cdab0 0x7f43481577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434ea11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f4348157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434ea11700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43480cc360 con 0x7f434815cbd0 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434ea11700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43480c7ec0 con 0x7f43480cd6e0 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434ea11700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43480c81a0 con 0x7f43480cdab0 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f4348157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f4348157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47906/0 (socket says 172.21.15.60:47906) 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 -- 172.21.15.60:0/77672176 learned_addr learned my addr 172.21.15.60:0/77672176 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434da0f700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43480cd6e0 0x7f4348144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434d20e700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43480cdab0 0x7f43481577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 -- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43480cdab0 msgr2=0x7f43481577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43480cdab0 0x7f43481577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 -- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43480cd6e0 msgr2=0x7f4348144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.531+0000 7f434e210700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43480cd6e0 0x7f4348144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f434e210700 1 -- 172.21.15.60:0/77672176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338009420 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f434e210700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f4348157cf0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f43380093f0 tx=0x7f4338016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433801c520 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4338020070 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43480c8480 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433801c8f0 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.532+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4348145340 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.533+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348089280 con 0x7f434815cbd0 2023-10-08T16:10:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.533+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4338022030 con 0x7f434815cbd0 2023-10-08T16:10:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.534+0000 7f4345ffb700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4334066f60 0x7f4334069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.534+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4338086770 con 0x7f434815cbd0 2023-10-08T16:10:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.534+0000 7f434da0f700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4334066f60 0x7f4334069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.534+0000 7f434da0f700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4334066f60 0x7f4334069410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f43480c9810 tx=0x7f4340009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.538+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43380539e0 con 0x7f434815cbd0 2023-10-08T16:10:57.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.733+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4348089280 con 0x7f434815cbd0 2023-10-08T16:10:57.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.734+0000 7f4345ffb700 1 -- 172.21.15.60:0/77672176 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f4338057000 con 0x7f434815cbd0 2023-10-08T16:10:57.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:57.735 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:57.384146+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:57.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4334066f60 msgr2=0x7f4334069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4334066f60 0x7f4334069410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f43480c9810 tx=0x7f4340009040 comp rx=0 tx=0).stop 2023-10-08T16:10:57.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 msgr2=0x7f4348157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f4348157cf0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f43380093f0 tx=0x7f4338016000 comp rx=0 tx=0).stop 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 shutdown_connections 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4334066f60 0x7f4334069410 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f434815cbd0 0x7f4348157cf0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43480cd6e0 0x7f4348144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 --2- 172.21.15.60:0/77672176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43480cdab0 0x7f43481577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 >> 172.21.15.60:0/77672176 conn(0x7f4348067660 msgr2=0x7f43480c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 shutdown_connections 2023-10-08T16:10:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:57.736+0000 7f434ea11700 1 -- 172.21.15.60:0/77672176 wait complete. 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> os.fchmod(fd, 0O666) 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(fd) 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> os.close(fd) 2023-10-08T16:10:57.750 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:10:58.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:58.004 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:10:58.073 INFO:teuthology.orchestra.run.smithi060.stdout:client6927 2023-10-08T16:10:58.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:58.074 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client6927/osdmap') 2023-10-08T16:10:58.151 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 117 barrier 117 flags 0x588000 2023-10-08T16:10:58.151 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:58.151 INFO:teuthology.orchestra.run.smithi060.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:58.151 INFO:teuthology.orchestra.run.smithi060.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:58.151 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:10:58.152 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:10:58.153 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:10:58.153 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:10:58.153 INFO:teuthology.orchestra.run.smithi060.stderr:799 bytes copied, 3.6372e-05 s, 22.0 MB/s 2023-10-08T16:10:58.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:58.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.310+0000 7fae75a38700 1 Processor -- start 2023-10-08T16:10:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.310+0000 7fae75a38700 1 -- start start 2023-10-08T16:10:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75a38700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae70159f10 0x7fae700c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75a38700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fae7015a2e0 0x7fae700cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75a38700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700ae320 con 0x7fae700cc240 2023-10-08T16:10:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75a38700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7015a760 con 0x7fae7015a2e0 2023-10-08T16:10:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75a38700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700ad710 con 0x7fae70159f10 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae6ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fae7015a2e0 0x7fae700cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75237700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fae700cc240 0x7fae700ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53358/0 (socket says 172.21.15.60:53358) 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae75237700 1 -- 172.21.15.60:0/308950603 learned_addr learned my addr 172.21.15.60:0/308950603 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae74a36700 1 --2- 172.21.15.60:0/308950603 >> v2:172.21.15.144:3300/0 conn(0x7fae70159f10 0x7fae700c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae6f7fe700 1 -- 172.21.15.60:0/308950603 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694923033 0 0) 0x7fae700ae320 con 0x7fae700cc240 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.311+0000 7fae6f7fe700 1 -- 172.21.15.60:0/308950603 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae5c003570 con 0x7fae700cc240 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6ffff700 1 -- 172.21.15.60:0/308950603 >> v2:172.21.15.144:3300/0 conn(0x7fae70159f10 msgr2=0x7fae700c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6ffff700 1 --2- 172.21.15.60:0/308950603 >> v2:172.21.15.144:3300/0 conn(0x7fae70159f10 0x7fae700c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6ffff700 1 -- 172.21.15.60:0/308950603 >> v1:172.21.15.60:6789/0 conn(0x7fae700cc240 legacy=0x7fae700ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6ffff700 1 -- 172.21.15.60:0/308950603 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700ad9f0 con 0x7fae7015a2e0 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6ffff700 1 --2- 172.21.15.60:0/308950603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae700cbd00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fae7008b3c0 tx=0x7fae600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01bb867d763ec05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6f7fe700 1 -- 172.21.15.60:0/308950603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60011630 con 0x7fae7015a2e0 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6f7fe700 1 -- 172.21.15.60:0/308950603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae60011790 con 0x7fae7015a2e0 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae6f7fe700 1 -- 172.21.15.60:0/308950603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60011b30 con 0x7fae7015a2e0 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 -- 172.21.15.60:0/308950603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 msgr2=0x7fae700cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 --2- 172.21.15.60:0/308950603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae700cbd00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fae7008b3c0 tx=0x7fae600091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 -- 172.21.15.60:0/308950603 shutdown_connections 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 --2- 172.21.15.60:0/308950603 >> v2:172.21.15.144:3300/0 conn(0x7fae70159f10 0x7fae700c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 --2- 172.21.15.60:0/308950603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae700cbd00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 -- 172.21.15.60:0/308950603 >> 172.21.15.60:0/308950603 conn(0x7fae70067e40 msgr2=0x7fae700d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:58.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 -- 172.21.15.60:0/308950603 shutdown_connections 2023-10-08T16:10:58.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.312+0000 7fae75a38700 1 -- 172.21.15.60:0/308950603 wait complete. 2023-10-08T16:10:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.314+0000 7fae75a38700 1 Processor -- start 2023-10-08T16:10:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.314+0000 7fae75a38700 1 -- start start 2023-10-08T16:10:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.314+0000 7fae75a38700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae700cc240 0x7fae700ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae70159f10 0x7fae70169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae70143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700ca660 con 0x7fae7015a2e0 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700c9c90 con 0x7fae700cc240 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae70169fc0 con 0x7fae70159f10 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae70143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae70143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47926/0 (socket says 172.21.15.60:47926) 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 -- 172.21.15.60:0/2505167414 learned_addr learned my addr 172.21.15.60:0/2505167414 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae74a36700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae700cc240 0x7fae700ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae6ffff700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae70159f10 0x7fae70169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 -- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae70159f10 msgr2=0x7fae70169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae70159f10 0x7fae70169a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 -- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae700cc240 msgr2=0x7fae700ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae700cc240 0x7fae700ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 -- 172.21.15.60:0/2505167414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009420 con 0x7fae7015a2e0 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae6ffff700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae70159f10 0x7fae70169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae74a36700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae700cc240 0x7fae700ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75237700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae70143520 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fae6800cca0 tx=0x7fae68001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800ab30 con 0x7fae7015a2e0 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800ac90 con 0x7fae7015a2e0 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae700c9080 con 0x7fae7015a2e0 2023-10-08T16:10:58.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68007300 con 0x7fae7015a2e0 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.315+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae700c9640 con 0x7fae7015a2e0 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.316+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70089300 con 0x7fae7015a2e0 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.317+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae68007730 con 0x7fae7015a2e0 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.317+0000 7fae6cff9700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae50066f30 0x7fae500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.317+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae680849c0 con 0x7fae7015a2e0 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.317+0000 7fae74a36700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae50066f30 0x7fae500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.318+0000 7fae74a36700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae50066f30 0x7fae500693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fae58006fd0 tx=0x7fae58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.321+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae68051cb0 con 0x7fae7015a2e0 2023-10-08T16:10:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.561+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae700adcd0 con 0x7fae7015a2e0 2023-10-08T16:10:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.562+0000 7fae6cff9700 1 -- 172.21.15.60:0/2505167414 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fae680552d0 con 0x7fae7015a2e0 2023-10-08T16:10:58.563 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:58.563 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:10:58.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae50066f30 msgr2=0x7fae500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae50066f30 0x7fae500693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fae58006fd0 tx=0x7fae58008040 comp rx=0 tx=0).stop 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 msgr2=0x7fae70143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae70143520 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fae6800cca0 tx=0x7fae68001ae0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 shutdown_connections 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae50066f30 0x7fae500693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae7015a2e0 0x7fae70143520 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae700cc240 0x7fae700ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 --2- 172.21.15.60:0/2505167414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae70159f10 0x7fae70169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 >> 172.21.15.60:0/2505167414 conn(0x7fae70067e40 msgr2=0x7fae700ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 shutdown_connections 2023-10-08T16:10:58.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:58.564+0000 7fae75a38700 1 -- 172.21.15.60:0/2505167414 wait complete. 2023-10-08T16:10:58.567 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:10:58.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 120 2023-10-08T16:10:58.713 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-08T16:10:58.713 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:10:58.714 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:10:58.714 DEBUG:teuthology.orchestra.run.smithi060:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T16:10:58.714 DEBUG:teuthology.orchestra.run.smithi060:> os.fchmod(fd, 0O666) 2023-10-08T16:10:58.714 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(fd) 2023-10-08T16:10:58.714 DEBUG:teuthology.orchestra.run.smithi060:> os.close(fd) 2023-10-08T16:10:58.714 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:10:58.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:58.968 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:10:59.038 INFO:teuthology.orchestra.run.smithi060.stdout:client6927 2023-10-08T16:10:59.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:59.038 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client6927/osdmap') 2023-10-08T16:10:59.115 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 120 barrier 120 flags 0x588000 2023-10-08T16:10:59.115 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:59.115 INFO:teuthology.orchestra.run.smithi060.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:59.115 INFO:teuthology.orchestra.run.smithi060.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:10:59.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:10:59.117 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:10:59.117 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:10:59.117 INFO:teuthology.orchestra.run.smithi060.stderr:799 bytes copied, 4.0601e-05 s, 19.7 MB/s 2023-10-08T16:10:59.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:59.118 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T16:10:59.186 INFO:teuthology.orchestra.run.smithi060.stdout:client6927 2023-10-08T16:10:59.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:59.186 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.client6927/osdmap') 2023-10-08T16:10:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 120 barrier 120 flags 0x588000 2023-10-08T16:10:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T16:10:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:osd0 (1)172.21.15.60:6811 100% (exists, up) 100% -1 2023-10-08T16:10:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:osd1 (1)172.21.15.60:6810 100% (exists, up) 100% -1 2023-10-08T16:10:59.264 INFO:teuthology.orchestra.run.smithi060.stdout:osd2 (1)172.21.15.60:6801 100% (exists, up) 100% -1 2023-10-08T16:10:59.264 INFO:teuthology.orchestra.run.smithi060.stdout:osd3 (1)172.21.15.60:6824 100% (exists, up) 100% -1 2023-10-08T16:10:59.264 INFO:teuthology.orchestra.run.smithi060.stdout:osd4 (1)172.21.15.144:6806 100% (exists, up) 100% -1 2023-10-08T16:10:59.264 INFO:teuthology.orchestra.run.smithi060.stdout:osd5 (1)172.21.15.144:6802 100% (exists, up) 100% -1 2023-10-08T16:10:59.264 INFO:teuthology.orchestra.run.smithi060.stdout:osd6 (1)172.21.15.144:6808 100% (exists, up) 100% -1 2023-10-08T16:10:59.264 INFO:teuthology.orchestra.run.smithi060.stdout:osd7 (1)172.21.15.144:6804 100% (exists, up) 100% -1 2023-10-08T16:10:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records in 2023-10-08T16:10:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:1+1 records out 2023-10-08T16:10:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:799 bytes copied, 4.143e-05 s, 19.3 MB/s 2023-10-08T16:10:59.265 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:10:59.265 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:10:59.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:59.345 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:59.385 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:10:59.385 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:10:59.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:59.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:59.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:10:59.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:59.448 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:10:59.466 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:10:59.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:59.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:10:59.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:10:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:59.510 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:10:59.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:59.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.682+0000 7fa859454700 1 Processor -- start 2023-10-08T16:10:59.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.682+0000 7fa859454700 1 -- start start 2023-10-08T16:10:59.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8540cc410 0x7fa8540c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85415a740 con 0x7fa85415a2e0 2023-10-08T16:10:59.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540ae320 con 0x7fa854159f10 2023-10-08T16:10:59.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8540ad710 con 0x7fa8540cc410 2023-10-08T16:10:59.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa8537fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8540cc410 0x7fa8540c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa858c53700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa85415a2e0 0x7fa8540cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53368/0 (socket says 172.21.15.60:53368) 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa858c53700 1 -- 172.21.15.60:0/3976350753 learned_addr learned my addr 172.21.15.60:0/3976350753 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa8537fe700 1 -- 172.21.15.60:0/3976350753 >> v1:172.21.15.144:6789/0 conn(0x7fa854159f10 legacy=0x7fa8540cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa8537fe700 1 -- 172.21.15.60:0/3976350753 >> v1:172.21.15.60:6789/0 conn(0x7fa85415a2e0 legacy=0x7fa8540cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa8537fe700 1 -- 172.21.15.60:0/3976350753 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540ad9f0 con 0x7fa8540cc410 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa8537fe700 1 --2- 172.21.15.60:0/3976350753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8540cc410 0x7fa8540c59e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa8440098e0 tx=0x7fa8440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca2edf1a6dbfcfb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa852ffd700 1 -- 172.21.15.60:0/3976350753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844009e80 con 0x7fa8540cc410 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa852ffd700 1 -- 172.21.15.60:0/3976350753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84400b760 con 0x7fa8540cc410 2023-10-08T16:10:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa852ffd700 1 -- 172.21.15.60:0/3976350753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400bae0 con 0x7fa8540cc410 2023-10-08T16:10:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- 172.21.15.60:0/3976350753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8540cc410 msgr2=0x7fa8540c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 --2- 172.21.15.60:0/3976350753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8540cc410 0x7fa8540c59e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa8440098e0 tx=0x7fa8440091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- 172.21.15.60:0/3976350753 shutdown_connections 2023-10-08T16:10:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 --2- 172.21.15.60:0/3976350753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8540cc410 0x7fa8540c59e0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- 172.21.15.60:0/3976350753 >> 172.21.15.60:0/3976350753 conn(0x7fa854067e40 msgr2=0x7fa8540d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:59.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- 172.21.15.60:0/3976350753 shutdown_connections 2023-10-08T16:10:59.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.684+0000 7fa859454700 1 -- 172.21.15.60:0/3976350753 wait complete. 2023-10-08T16:10:59.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.685+0000 7fa859454700 1 Processor -- start 2023-10-08T16:10:59.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 -- start start 2023-10-08T16:10:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8540cc410 0x7fa85414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 0x7fa8540ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa85415a2e0 0x7fa85414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85414fc20 con 0x7fa854159f10 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c71a0 con 0x7fa8540cc410 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.686+0000 7fa859454700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c62f0 con 0x7fa85415a2e0 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 0x7fa8540ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 0x7fa8540ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47948/0 (socket says 172.21.15.60:47948) 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 -- 172.21.15.60:0/1843843851 learned_addr learned my addr 172.21.15.60:0/1843843851 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa853fff700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8540cc410 0x7fa85414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa858c53700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa85415a2e0 0x7fa85414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 -- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa85415a2e0 msgr2=0x7fa85414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa85415a2e0 0x7fa85414fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 -- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8540cc410 msgr2=0x7fa85414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8540cc410 0x7fa85414f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 -- 172.21.15.60:0/1843843851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844009420 con 0x7fa854159f10 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa853fff700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8540cc410 0x7fa85414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa858c53700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa85415a2e0 0x7fa85414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa8537fe700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 0x7fa8540ca500 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa8440093f0 tx=0x7fa844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84401c480 con 0x7fa854159f10 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84401c5e0 con 0x7fa854159f10 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8540c6590 con 0x7fa854159f10 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84401c9a0 con 0x7fa854159f10 2023-10-08T16:10:59.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.687+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8540c6920 con 0x7fa854159f10 2023-10-08T16:10:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.688+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa854089300 con 0x7fa854159f10 2023-10-08T16:10:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.689+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8440193f0 con 0x7fa854159f10 2023-10-08T16:10:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.689+0000 7fa84bfff700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa834066f30 0x7fa8340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.689+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa844086030 con 0x7fa854159f10 2023-10-08T16:10:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.689+0000 7fa853fff700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa834066f30 0x7fa8340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.690+0000 7fa853fff700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa834066f30 0x7fa8340693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa83c007fd0 tx=0x7fa83c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.694+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8440532a0 con 0x7fa854159f10 2023-10-08T16:10:59.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.932+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8540adcd0 con 0x7fa854159f10 2023-10-08T16:10:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.932+0000 7fa84bfff700 1 -- 172.21.15.60:0/1843843851 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa8440568c0 con 0x7fa854159f10 2023-10-08T16:10:59.934 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:10:59.934 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:10:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa834066f30 msgr2=0x7fa8340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa834066f30 0x7fa8340693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa83c007fd0 tx=0x7fa83c009040 comp rx=0 tx=0).stop 2023-10-08T16:10:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 msgr2=0x7fa8540ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 0x7fa8540ca500 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa8440093f0 tx=0x7fa844016000 comp rx=0 tx=0).stop 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 shutdown_connections 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa834066f30 0x7fa8340693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa85415a2e0 0x7fa85414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8540cc410 0x7fa85414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 --2- 172.21.15.60:0/1843843851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa854159f10 0x7fa8540ca500 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 >> 172.21.15.60:0/1843843851 conn(0x7fa854067e40 msgr2=0x7fa854069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 shutdown_connections 2023-10-08T16:10:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:10:59.935+0000 7fa859454700 1 -- 172.21.15.60:0/1843843851 wait complete. 2023-10-08T16:10:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:10:59.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 Processor -- start 2023-10-08T16:11:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 -- start start 2023-10-08T16:11:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f724c15a2b0 0x7f724c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c0c5d80 con 0x7f724c0d1c30 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c068470 con 0x7f724c15a2b0 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f72543c1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c6060 con 0x7f724c0cfe20 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f724c15a2b0 0x7f724c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f724c15a2b0 0x7f724c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47952/0 (socket says 172.21.15.60:47952) 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 -- 172.21.15.60:0/4282707589 learned_addr learned my addr 172.21.15.60:0/4282707589 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725295e700 1 --2- 172.21.15.60:0/4282707589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 -- 172.21.15.60:0/4282707589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 msgr2=0x7f724c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 --2- 172.21.15.60:0/4282707589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 -- 172.21.15.60:0/4282707589 >> v1:172.21.15.144:6789/0 conn(0x7f724c0d1c30 legacy=0x7f724c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 -- 172.21.15.60:0/4282707589 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0c6340 con 0x7f724c15a2b0 2023-10-08T16:11:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725215d700 1 --2- 172.21.15.60:0/4282707589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c15a2b0 0x7f724c0b3da0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f723c009990 tx=0x7f723c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11473862709b990 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.068+0000 7f725115b700 1 -- 172.21.15.60:0/4282707589 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c009e80 con 0x7f724c15a2b0 2023-10-08T16:11:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f725115b700 1 -- 172.21.15.60:0/4282707589 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c005c10 con 0x7f724c15a2b0 2023-10-08T16:11:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f725115b700 1 -- 172.21.15.60:0/4282707589 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c00b650 con 0x7f724c15a2b0 2023-10-08T16:11:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 -- 172.21.15.60:0/4282707589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c15a2b0 msgr2=0x7f724c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 --2- 172.21.15.60:0/4282707589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c15a2b0 0x7f724c0b3da0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f723c009990 tx=0x7f723c009220 comp rx=0 tx=0).stop 2023-10-08T16:11:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 -- 172.21.15.60:0/4282707589 shutdown_connections 2023-10-08T16:11:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 --2- 172.21.15.60:0/4282707589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 --2- 172.21.15.60:0/4282707589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c15a2b0 0x7f724c0b3da0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 -- 172.21.15.60:0/4282707589 >> 172.21.15.60:0/4282707589 conn(0x7f724c067e40 msgr2=0x7f724c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 -- 172.21.15.60:0/4282707589 shutdown_connections 2023-10-08T16:11:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.069+0000 7f72543c1700 1 -- 172.21.15.60:0/4282707589 wait complete. 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.070+0000 7f72543c1700 1 Processor -- start 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.070+0000 7f72543c1700 1 -- start start 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f72543c1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f72543c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 0x7f724c16a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f72543c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f724c15a2b0 0x7f724c16a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f72543c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0caf10 con 0x7f724c0d1c30 2023-10-08T16:11:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f72543c1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c8d40 con 0x7f724c15a2b0 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f72543c1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c15a0c0 con 0x7f724c0cfe20 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 0x7f724c16a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 0x7f724c16a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47956/0 (socket says 172.21.15.60:47956) 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 -- 172.21.15.60:0/830309477 learned_addr learned my addr 172.21.15.60:0/830309477 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725295e700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f724c15a2b0 0x7f724c16a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725215d700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 -- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 msgr2=0x7f724c159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 -- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f724c15a2b0 msgr2=0x7f724c16a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f724c15a2b0 0x7f724c16a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.071+0000 7f725195c700 1 -- 172.21.15.60:0/830309477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c009480 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.072+0000 7f725195c700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 0x7f724c16a3c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f724000c590 tx=0x7f7240007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.072+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240011590 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.072+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7240011710 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.072+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240011ad0 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.072+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c0c8130 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.072+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c0c86f0 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.073+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c04c3c0 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.073+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f724001a360 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.073+0000 7f724a7fc700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7238066f30 0x7f72380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.074+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7240083420 con 0x7f724c0d1c30 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.074+0000 7f725215d700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7238066f30 0x7f72380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.074+0000 7f725215d700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7238066f30 0x7f72380693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f723c009260 tx=0x7f723c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.078+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7240050690 con 0x7f724c0d1c30 2023-10-08T16:11:00.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.272+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f724c064a00 con 0x7f724c0d1c30 2023-10-08T16:11:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.273+0000 7f724a7fc700 1 -- 172.21.15.60:0/830309477 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f7240053cb0 con 0x7f724c0d1c30 2023-10-08T16:11:00.278 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:00.278 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:57.384146+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7238066f30 msgr2=0x7f72380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7238066f30 0x7f72380693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f723c009260 tx=0x7f723c016000 comp rx=0 tx=0).stop 2023-10-08T16:11:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 msgr2=0x7f724c16a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 0x7f724c16a3c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f724000c590 tx=0x7f7240007f50 comp rx=0 tx=0).stop 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 shutdown_connections 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7238066f30 0x7f72380693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f724c0cfe20 0x7f724c159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f724c15a2b0 0x7f724c16a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 --2- 172.21.15.60:0/830309477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f724c0d1c30 0x7f724c16a3c0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 >> 172.21.15.60:0/830309477 conn(0x7f724c067e40 msgr2=0x7f724c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 shutdown_connections 2023-10-08T16:11:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.276+0000 7f72543c1700 1 -- 172.21.15.60:0/830309477 wait complete. 2023-10-08T16:11:00.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:10:42.924309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:10:43.494603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:11:00.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:11:00.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.412+0000 7fbd69597700 1 Processor -- start 2023-10-08T16:11:00.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.412+0000 7fbd69597700 1 -- start start 2023-10-08T16:11:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd69597700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbd640cf590 0x7fbd640adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd69597700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd640b18c0 con 0x7fbd64067f00 2023-10-08T16:11:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd69597700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd640b1ba0 con 0x7fbd640ad910 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd69597700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd640cfa30 con 0x7fbd640cf590 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd637fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbd64067f00 0x7fbd640b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53374/0 (socket says 172.21.15.60:53374) 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd637fe700 1 -- 172.21.15.60:0/1270367134 learned_addr learned my addr 172.21.15.60:0/1270367134 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47959385 0 0) 0x7fbd640b18c0 con 0x7fbd64067f00 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd627fc700 1 --2- 172.21.15.60:0/1270367134 >> v2:172.21.15.144:3300/0 conn(0x7fbd640cf590 0x7fbd640adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.413+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd4c003570 con 0x7fbd64067f00 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 254068349 0 0) 0x7fbd4c003570 con 0x7fbd64067f00 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 >> v2:172.21.15.144:3300/0 conn(0x7fbd640cf590 msgr2=0x7fbd640adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 --2- 172.21.15.60:0/1270367134 >> v2:172.21.15.144:3300/0 conn(0x7fbd640cf590 0x7fbd640adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 >> v1:172.21.15.144:6789/0 conn(0x7fbd640ad910 legacy=0x7fbd6415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640b1e80 con 0x7fbd64067f00 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fbd5c0017f0 con 0x7fbd64067f00 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 >> v1:172.21.15.60:6789/0 conn(0x7fbd64067f00 legacy=0x7fbd640b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4c003a60 0x7fbd4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c004810 0x7fbd4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd4c0051c0 0x7fbd4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640cfa30 con 0x7fbd4c003a60 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c00c0d0 con 0x7fbd4c0051c0 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c00c290 con 0x7fbd4c004810 2023-10-08T16:11:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4c003a60 0x7fbd4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd637fe700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd4c0051c0 0x7fbd4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd627fc700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c004810 0x7fbd4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 -- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c004810 msgr2=0x7fbd4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c004810 0x7fbd4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 -- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd4c0051c0 msgr2=0x7fbd4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd4c0051c0 0x7fbd4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 -- 172.21.15.60:0/1270367134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c003570 con 0x7fbd4c003a60 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd627fc700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c004810 0x7fbd4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd637fe700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd4c0051c0 0x7fbd4c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd637fe700 1 -- 172.21.15.60:0/1270367134 reap_dead start 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4c003a60 0x7fbd4c003e70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbd540018b0 tx=0x7fbd54007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5544622b2401bf7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54012420 con 0x7fbd4c003a60 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd540125a0 con 0x7fbd4c003a60 2023-10-08T16:11:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.414+0000 7fbd61ffb700 1 -- 172.21.15.60:0/1270367134 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54012960 con 0x7fbd4c003a60 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 -- 172.21.15.60:0/1270367134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4c003a60 msgr2=0x7fbd4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4c003a60 0x7fbd4c003e70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbd540018b0 tx=0x7fbd54007d30 comp rx=0 tx=0).stop 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 -- 172.21.15.60:0/1270367134 shutdown_connections 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 --2- 172.21.15.60:0/1270367134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4c003a60 0x7fbd4c003e70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 -- 172.21.15.60:0/1270367134 >> 172.21.15.60:0/1270367134 conn(0x7fbd6406bc70 msgr2=0x7fbd6406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 -- 172.21.15.60:0/1270367134 shutdown_connections 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.415+0000 7fbd69597700 1 -- 172.21.15.60:0/1270367134 wait complete. 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.416+0000 7fbd69597700 1 Processor -- start 2023-10-08T16:11:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.416+0000 7fbd69597700 1 -- start start 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd69597700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c003a60 0x7fbd64155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd69597700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 0x7fbd64158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd69597700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd640c8a20 0x7fbd64158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd69597700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640afa40 con 0x7fbd640c85b0 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd69597700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640b0cf0 con 0x7fbd640c8a20 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd69597700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640b0860 con 0x7fbd4c003a60 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 0x7fbd64158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 0x7fbd64158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47962/0 (socket says 172.21.15.60:47962) 2023-10-08T16:11:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 -- 172.21.15.60:0/698436818 learned_addr learned my addr 172.21.15.60:0/698436818 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd637fe700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd640c8a20 0x7fbd64158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c003a60 0x7fbd64155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 -- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c003a60 msgr2=0x7fbd64155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c003a60 0x7fbd64155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 -- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd640c8a20 msgr2=0x7fbd64158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd640c8a20 0x7fbd64158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 -- 172.21.15.60:0/698436818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640afc50 con 0x7fbd640c85b0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.417+0000 7fbd627fc700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 0x7fbd64158610 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fbd58011910 tx=0x7fbd58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.418+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58011eb0 con 0x7fbd640c85b0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.418+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5800f880 con 0x7fbd640c85b0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.418+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd640aff30 con 0x7fbd640c85b0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.418+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800fc20 con 0x7fbd640c85b0 2023-10-08T16:11:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.418+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd640b04f0 con 0x7fbd640c85b0 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.419+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6406e850 con 0x7fbd640c85b0 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.419+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd58015460 con 0x7fbd640c85b0 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.419+0000 7fbd4affd700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd50066f30 0x7fbd500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.419+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd58084cb0 con 0x7fbd640c85b0 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.420+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd50066f30 0x7fbd500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.420+0000 7fbd62ffd700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd50066f30 0x7fbd500693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbd640cdc00 tx=0x7fbd54015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.424+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd58051f20 con 0x7fbd640c85b0 2023-10-08T16:11:00.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.616+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd640b09a0 con 0x7fbd640c85b0 2023-10-08T16:11:00.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.616+0000 7fbd4affd700 1 -- 172.21.15.60:0/698436818 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd58055540 con 0x7fbd640c85b0 2023-10-08T16:11:00.617 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:11:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd50066f30 msgr2=0x7fbd500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd50066f30 0x7fbd500693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbd640cdc00 tx=0x7fbd54015000 comp rx=0 tx=0).stop 2023-10-08T16:11:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 msgr2=0x7fbd64158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 0x7fbd64158610 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fbd58011910 tx=0x7fbd58008040 comp rx=0 tx=0).stop 2023-10-08T16:11:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 shutdown_connections 2023-10-08T16:11:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbd50066f30 0x7fbd500693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd4c003a60 0x7fbd64155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd640c8a20 0x7fbd64158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 --2- 172.21.15.60:0/698436818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd640c85b0 0x7fbd64158610 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 >> 172.21.15.60:0/698436818 conn(0x7fbd6406bc70 msgr2=0x7fbd64068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 shutdown_connections 2023-10-08T16:11:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.618+0000 7fbd69597700 1 -- 172.21.15.60:0/698436818 wait complete. 2023-10-08T16:11:00.631 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:11:00.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.753+0000 7fc436520700 1 Processor -- start 2023-10-08T16:11:00.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.753+0000 7fc436520700 1 -- start start 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc436520700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc43015a290 0x7fc43006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc436520700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300b0790 con 0x7fc430159ec0 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc436520700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43006af20 con 0x7fc43006aae0 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc436520700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4300ce1f0 con 0x7fc43015a290 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc43015a290 0x7fc43006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc430159ec0 0x7fc4300af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53386/0 (socket says 172.21.15.60:53386) 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42ffff700 1 -- 172.21.15.60:0/3737394627 learned_addr learned my addr 172.21.15.60:0/3737394627 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42f7fe700 1 -- 172.21.15.60:0/3737394627 >> v1:172.21.15.144:6789/0 conn(0x7fc43006aae0 legacy=0x7fc4300cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42f7fe700 1 -- 172.21.15.60:0/3737394627 >> v1:172.21.15.60:6789/0 conn(0x7fc430159ec0 legacy=0x7fc4300af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42f7fe700 1 -- 172.21.15.60:0/3737394627 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300b0b20 con 0x7fc43015a290 2023-10-08T16:11:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42effd700 1 -- 172.21.15.60:0/3737394627 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238110907 0 0) 0x7fc4300b0790 con 0x7fc430159ec0 2023-10-08T16:11:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.754+0000 7fc42f7fe700 1 --2- 172.21.15.60:0/3737394627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc43015a290 0x7fc43006a5a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc4200098e0 tx=0x7fc4200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d148c52ebd8cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc42effd700 1 -- 172.21.15.60:0/3737394627 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420009e80 con 0x7fc43015a290 2023-10-08T16:11:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc42effd700 1 -- 172.21.15.60:0/3737394627 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42000b820 con 0x7fc43015a290 2023-10-08T16:11:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc42effd700 1 -- 172.21.15.60:0/3737394627 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42000bba0 con 0x7fc43015a290 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 -- 172.21.15.60:0/3737394627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc43015a290 msgr2=0x7fc43006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 --2- 172.21.15.60:0/3737394627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc43015a290 0x7fc43006a5a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc4200098e0 tx=0x7fc4200091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 -- 172.21.15.60:0/3737394627 shutdown_connections 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 --2- 172.21.15.60:0/3737394627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc43015a290 0x7fc43006a5a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 -- 172.21.15.60:0/3737394627 >> 172.21.15.60:0/3737394627 conn(0x7fc4300d1880 msgr2=0x7fc4300cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 -- 172.21.15.60:0/3737394627 shutdown_connections 2023-10-08T16:11:00.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.755+0000 7fc436520700 1 -- 172.21.15.60:0/3737394627 wait complete. 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.756+0000 7fc436520700 1 Processor -- start 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.756+0000 7fc436520700 1 -- start start 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc436520700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43006aae0 0x7fc4301554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc436520700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 0x7fc4300b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc436520700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43015a290 0x7fc4300c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc436520700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300b69f0 con 0x7fc430159ec0 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc436520700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43016a2e0 con 0x7fc43015a290 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc436520700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300b4630 con 0x7fc43006aae0 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc42f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 0x7fc4300b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc42f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 0x7fc4300b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47986/0 (socket says 172.21.15.60:47986) 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc42f7fe700 1 -- 172.21.15.60:0/80541515 learned_addr learned my addr 172.21.15.60:0/80541515 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:00.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc42ffff700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43006aae0 0x7fc4301554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.757+0000 7fc434abd700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43015a290 0x7fc4300c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42f7fe700 1 -- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43006aae0 msgr2=0x7fc4301554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42f7fe700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43006aae0 0x7fc4301554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42f7fe700 1 -- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43015a290 msgr2=0x7fc4300c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42f7fe700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43015a290 0x7fc4300c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42f7fe700 1 -- 172.21.15.60:0/80541515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420009420 con 0x7fc430159ec0 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42ffff700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43006aae0 0x7fc4301554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:00.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc434abd700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43015a290 0x7fc4300c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc42f7fe700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 0x7fc4300b3d30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc4200030c0 tx=0x7fc420016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42001c460 con 0x7fc430159ec0 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42001c5c0 con 0x7fc430159ec0 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42001c980 con 0x7fc430159ec0 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4300b4910 con 0x7fc430159ec0 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.758+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300b4ed0 con 0x7fc430159ec0 2023-10-08T16:11:00.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.759+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43016a450 con 0x7fc430159ec0 2023-10-08T16:11:00.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.759+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc42001ccf0 con 0x7fc430159ec0 2023-10-08T16:11:00.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.760+0000 7fc427fff700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc410066f30 0x7fc4100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.760+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc420086b20 con 0x7fc430159ec0 2023-10-08T16:11:00.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.760+0000 7fc42ffff700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc410066f30 0x7fc4100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.760+0000 7fc42ffff700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc410066f30 0x7fc4100693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc4180018d0 tx=0x7fc418009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.764+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc420053d90 con 0x7fc430159ec0 2023-10-08T16:11:00.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.954+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc43016a450 con 0x7fc430159ec0 2023-10-08T16:11:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.955+0000 7fc427fff700 1 -- 172.21.15.60:0/80541515 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4200573b0 con 0x7fc430159ec0 2023-10-08T16:11:00.955 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:11:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc410066f30 msgr2=0x7fc4100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc410066f30 0x7fc4100693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc4180018d0 tx=0x7fc418009040 comp rx=0 tx=0).stop 2023-10-08T16:11:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 msgr2=0x7fc4300b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 0x7fc4300b3d30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc4200030c0 tx=0x7fc420016000 comp rx=0 tx=0).stop 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 shutdown_connections 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc410066f30 0x7fc4100693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43006aae0 0x7fc4301554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43015a290 0x7fc4300c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 --2- 172.21.15.60:0/80541515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc430159ec0 0x7fc4300b3d30 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 >> 172.21.15.60:0/80541515 conn(0x7fc4300d1880 msgr2=0x7fc4300b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 shutdown_connections 2023-10-08T16:11:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:00.957+0000 7fc436520700 1 -- 172.21.15.60:0/80541515 wait complete. 2023-10-08T16:11:00.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:11:01.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.090+0000 7f1e3f59e700 1 Processor -- start 2023-10-08T16:11:01.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.090+0000 7f1e3f59e700 1 -- start start 2023-10-08T16:11:01.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 0x7f1e400cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e4015ade0 0x7f1e400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400cc760 con 0x7f1e4015a300 2023-10-08T16:11:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4015b460 con 0x7f1e4015ade0 2023-10-08T16:11:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4015ba20 con 0x7f1e4015cec0 2023-10-08T16:11:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1e4015a300 0x7f1e4015a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53398/0 (socket says 172.21.15.60:53398) 2023-10-08T16:11:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3e59c700 1 -- 172.21.15.60:0/2174224632 learned_addr learned my addr 172.21.15.60:0/2174224632 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3dd9b700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 0x7f1e400cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272677574 0 0) 0x7f1e400cc760 con 0x7f1e4015a300 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e2c003570 con 0x7f1e4015a300 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.091+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2174224632 >> v2:172.21.15.144:3300/0 conn(0x7f1e4015ade0 0x7f1e400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1067580184 0 0) 0x7f1e2c003570 con 0x7f1e4015a300 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 msgr2=0x7f1e400cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 0x7f1e400cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 >> v2:172.21.15.144:3300/0 conn(0x7f1e4015ade0 msgr2=0x7f1e400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 --2- 172.21.15.60:0/2174224632 >> v2:172.21.15.144:3300/0 conn(0x7f1e4015ade0 0x7f1e400cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400cc1a0 con 0x7f1e4015a300 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f1e380015f0 con 0x7f1e4015a300 2023-10-08T16:11:01.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 >> v1:172.21.15.60:6789/0 conn(0x7f1e4015a300 legacy=0x7f1e4015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 0x7f1e2c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004090 0x7f1e2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c004d50 0x7f1e2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4015b460 con 0x7f1e2c004d50 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4015ba20 con 0x7f1e2c004090 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c00bbf0 con 0x7f1e4015cec0 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2174224632 >> v2:172.21.15.144:3300/0 conn(0x7f1e4015ade0 0x7f1e400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3e59c700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 0x7f1e2c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c004d50 0x7f1e2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3dd9b700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004090 0x7f1e2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 -- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 msgr2=0x7f1e2c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e4015cec0 0x7f1e2c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 -- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004090 msgr2=0x7f1e2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004090 0x7f1e2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 -- 172.21.15.60:0/2174224632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c003570 con 0x7f1e2c004d50 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.092+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c004d50 0x7f1e2c0051c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1e30007580 tx=0x7f1e300097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193a7fd33a52892b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30009ad0 con 0x7f1e2c004d50 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e30007dd0 con 0x7f1e2c004d50 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3d59a700 1 -- 172.21.15.60:0/2174224632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30014610 con 0x7f1e2c004d50 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2174224632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c004d50 msgr2=0x7f1e2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2174224632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c004d50 0x7f1e2c0051c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1e30007580 tx=0x7f1e300097a0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3ed9d700 1 -- 172.21.15.60:0/2174224632 reap_dead start 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2174224632 shutdown_connections 2023-10-08T16:11:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2174224632 >> 172.21.15.60:0/2174224632 conn(0x7f1e40099f50 msgr2=0x7f1e40067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2174224632 shutdown_connections 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.093+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2174224632 wait complete. 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.094+0000 7f1e3f59e700 1 Processor -- start 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.094+0000 7f1e3f59e700 1 -- start start 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004d50 0x7f1e400ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 0x7f1e400c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e400c5bf0 0x7f1e400c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c5760 con 0x7f1e400c9310 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c4e30 con 0x7f1e2c004d50 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c5110 con 0x7f1e400c5bf0 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 0x7f1e400c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 0x7f1e400c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48012/0 (socket says 172.21.15.60:48012) 2023-10-08T16:11:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3dd9b700 1 -- 172.21.15.60:0/2165228401 learned_addr learned my addr 172.21.15.60:0/2165228401 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e400c5bf0 0x7f1e400c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.095+0000 7f1e3e59c700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004d50 0x7f1e400ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3dd9b700 1 -- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e400c5bf0 msgr2=0x7f1e400c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3dd9b700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e400c5bf0 0x7f1e400c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3dd9b700 1 -- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004d50 msgr2=0x7f1e400ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3dd9b700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004d50 0x7f1e400ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3dd9b700 1 -- 172.21.15.60:0/2165228401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400c53f0 con 0x7f1e400c9310 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3ed9d700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e400c5bf0 0x7f1e400c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3e59c700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004d50 0x7f1e400ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3dd9b700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 0x7f1e400c9780 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1e28010aa0 tx=0x7f1e28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800ea30 con 0x7f1e400c9310 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2800eb90 con 0x7f1e400c9310 2023-10-08T16:11:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28014430 con 0x7f1e400c9310 2023-10-08T16:11:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e400c9cc0 con 0x7f1e400c9310 2023-10-08T16:11:01.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.096+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e400cabd0 con 0x7f1e400c9310 2023-10-08T16:11:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.097+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e400c5910 con 0x7f1e400c9310 2023-10-08T16:11:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.097+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e28014820 con 0x7f1e400c9310 2023-10-08T16:11:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.098+0000 7f1e367fc700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e20066f30 0x7f1e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.098+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e28084db0 con 0x7f1e400c9310 2023-10-08T16:11:01.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.098+0000 7f1e3e59c700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e20066f30 0x7f1e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.098+0000 7f1e3e59c700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e20066f30 0x7f1e200693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1e380011d0 tx=0x7f1e38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.102+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e400c5910 con 0x7f1e400c9310 2023-10-08T16:11:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.297+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e400c5910 con 0x7f1e400c9310 2023-10-08T16:11:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.297+0000 7f1e367fc700 1 -- 172.21.15.60:0/2165228401 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e400c5910 con 0x7f1e400c9310 2023-10-08T16:11:01.298 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:11:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e20066f30 msgr2=0x7f1e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e20066f30 0x7f1e200693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1e380011d0 tx=0x7f1e38009040 comp rx=0 tx=0).stop 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 msgr2=0x7f1e400c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 0x7f1e400c9780 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1e28010aa0 tx=0x7f1e28008040 comp rx=0 tx=0).stop 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 shutdown_connections 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1e20066f30 0x7f1e200693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e400c5bf0 0x7f1e400c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e2c004d50 0x7f1e400ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 --2- 172.21.15.60:0/2165228401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e400c9310 0x7f1e400c9780 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 >> 172.21.15.60:0/2165228401 conn(0x7f1e40099f50 msgr2=0x7f1e40150160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 shutdown_connections 2023-10-08T16:11:01.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.299+0000 7f1e3f59e700 1 -- 172.21.15.60:0/2165228401 wait complete. 2023-10-08T16:11:01.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.430+0000 7fde0e5ed700 1 Processor -- start 2023-10-08T16:11:01.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.430+0000 7fde0e5ed700 1 -- start start 2023-10-08T16:11:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde0e5ed700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde08158e50 0x7fde080cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde0e5ed700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0806c010 con 0x7fde08152010 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde0e5ed700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0806bd10 con 0x7fde081523e0 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde0e5ed700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0815c060 con 0x7fde08158e50 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde07fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fde08152010 0x7fde0815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53402/0 (socket says 172.21.15.60:53402) 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde07fff700 1 -- 172.21.15.60:0/596641461 learned_addr learned my addr 172.21.15.60:0/596641461 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.431+0000 7fde0cb8a700 1 --2- 172.21.15.60:0/596641461 >> v2:172.21.15.144:3300/0 conn(0x7fde08158e50 0x7fde080cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456447691 0 0) 0x7fde0806c010 con 0x7fde08152010 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf4003570 con 0x7fde08152010 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077916237 0 0) 0x7fde0806bd10 con 0x7fde081523e0 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0806c010 con 0x7fde081523e0 2023-10-08T16:11:01.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011610067 0 0) 0x7fddf4003570 con 0x7fde08152010 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 >> v2:172.21.15.144:3300/0 conn(0x7fde08158e50 msgr2=0x7fde080cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 --2- 172.21.15.60:0/596641461 >> v2:172.21.15.144:3300/0 conn(0x7fde08158e50 0x7fde080cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 >> v1:172.21.15.144:6789/0 conn(0x7fde081523e0 legacy=0x7fde0806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0815c340 con 0x7fde08152010 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fddf0001470 con 0x7fde08152010 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 >> v1:172.21.15.60:6789/0 conn(0x7fde08152010 legacy=0x7fde0815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf4003bf0 0x7fddf4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf40051c0 0x7fddf400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815c060 con 0x7fddf4003bf0 2023-10-08T16:11:01.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf400c0b0 con 0x7fddf40051c0 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf400c270 con 0x7fddf4004810 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf4003bf0 0x7fddf4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde077fe700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde0cb8a700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf40051c0 0x7fddf400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 -- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4004810 msgr2=0x7fddf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 -- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf40051c0 msgr2=0x7fddf400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf40051c0 0x7fddf400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 -- 172.21.15.60:0/596641461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4003570 con 0x7fddf4003bf0 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde077fe700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde0cb8a700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf40051c0 0x7fddf400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde0cb8a700 1 -- 172.21.15.60:0/596641461 reap_dead start 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.432+0000 7fde07fff700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf4003bf0 0x7fddf4003fe0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c2d0 tx=0x7fddf0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbf919494e27803 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000cba0 con 0x7fddf4003bf0 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf000cd00 con 0x7fddf4003bf0 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde06ffd700 1 -- 172.21.15.60:0/596641461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0005b70 con 0x7fddf4003bf0 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 -- 172.21.15.60:0/596641461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf4003bf0 msgr2=0x7fddf4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf4003bf0 0x7fddf4003fe0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c2d0 tx=0x7fddf0001e10 comp rx=0 tx=0).stop 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 -- 172.21.15.60:0/596641461 shutdown_connections 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/596641461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf4003bf0 0x7fddf4003fe0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 -- 172.21.15.60:0/596641461 >> 172.21.15.60:0/596641461 conn(0x7fde08069870 msgr2=0x7fde08069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 -- 172.21.15.60:0/596641461 shutdown_connections 2023-10-08T16:11:01.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.433+0000 7fde0e5ed700 1 -- 172.21.15.60:0/596641461 wait complete. 2023-10-08T16:11:01.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.434+0000 7fde0e5ed700 1 Processor -- start 2023-10-08T16:11:01.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.434+0000 7fde0e5ed700 1 -- start start 2023-10-08T16:11:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0e5ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4003bf0 0x7fde0815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0e5ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde08068880 0x7fde080afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0e5ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 0x7fde08159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0e5ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0814f6c0 con 0x7fde08159220 2023-10-08T16:11:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0e5ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0816e0c0 con 0x7fde08068880 2023-10-08T16:11:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0e5ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde08068d90 con 0x7fddf4003bf0 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0cb8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 0x7fde08159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0cb8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 0x7fde08159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48032/0 (socket says 172.21.15.60:48032) 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.435+0000 7fde0cb8a700 1 -- 172.21.15.60:0/1515966859 learned_addr learned my addr 172.21.15.60:0/1515966859 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde077fe700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde08068880 0x7fde080afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde07fff700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4003bf0 0x7fde0815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0cb8a700 1 -- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4003bf0 msgr2=0x7fde0815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0cb8a700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4003bf0 0x7fde0815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0cb8a700 1 -- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde08068880 msgr2=0x7fde080afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0cb8a700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde08068880 0x7fde080afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0cb8a700 1 -- 172.21.15.60:0/1515966859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08069070 con 0x7fde08159220 2023-10-08T16:11:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde07fff700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4003bf0 0x7fde0815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde077fe700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde08068880 0x7fde080afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0cb8a700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 0x7fde08159680 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fde080b1660 tx=0x7fde0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0001b070 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000f040 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde08069350 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000e050 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.436+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0815abe0 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.437+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0816e230 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.437+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde00003020 con 0x7fde08159220 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.438+0000 7fddfffff700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdde8066f30 0x7fdde80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.438+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde00084b10 con 0x7fde08159220 2023-10-08T16:11:01.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.438+0000 7fde07fff700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdde8066f30 0x7fdde80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.438+0000 7fde07fff700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdde8066f30 0x7fdde80693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001e50 tx=0x7fddf0015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.442+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde00051d80 con 0x7fde08159220 2023-10-08T16:11:01.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.677+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde0804c3c0 con 0x7fde08159220 2023-10-08T16:11:01.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.678+0000 7fddfffff700 1 -- 172.21.15.60:0/1515966859 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fde000553a0 con 0x7fde08159220 2023-10-08T16:11:01.678 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:01.678 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:11:01.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.679+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdde8066f30 msgr2=0x7fdde80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.679+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdde8066f30 0x7fdde80693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001e50 tx=0x7fddf0015000 comp rx=0 tx=0).stop 2023-10-08T16:11:01.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.679+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 msgr2=0x7fde08159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.679+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 0x7fde08159680 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fde080b1660 tx=0x7fde0000b040 comp rx=0 tx=0).stop 2023-10-08T16:11:01.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.679+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 shutdown_connections 2023-10-08T16:11:01.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.679+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdde8066f30 0x7fdde80693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.680+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddf4003bf0 0x7fde0815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.680+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08159220 0x7fde08159680 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.680+0000 7fde0e5ed700 1 --2- 172.21.15.60:0/1515966859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde08068880 0x7fde080afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.680+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 >> 172.21.15.60:0/1515966859 conn(0x7fde08069870 msgr2=0x7fde080cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.680+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 shutdown_connections 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.680+0000 7fde0e5ed700 1 -- 172.21.15.60:0/1515966859 wait complete. 2023-10-08T16:11:01.681 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:11:01.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:01.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.810+0000 7f7646975700 1 Processor -- start 2023-10-08T16:11:01.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.810+0000 7f7646975700 1 -- start start 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7646975700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7646975700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76400c87a0 0x7f764006a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7646975700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7640067ba0 con 0x7f76400ad9b0 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7646975700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764015aa90 con 0x7f76400c87a0 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7646975700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7640067870 con 0x7f76401568d0 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7644f12700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76400c87a0 0x7f764006a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7644f12700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76400c87a0 0x7f764006a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48048/0 (socket says 172.21.15.60:48048) 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.811+0000 7f7644f12700 1 -- 172.21.15.60:0/951183084 learned_addr learned my addr 172.21.15.60:0/951183084 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f763ffff700 1 --2- 172.21.15.60:0/951183084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f7644f12700 1 -- 172.21.15.60:0/951183084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 msgr2=0x7f7640069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f7644f12700 1 --2- 172.21.15.60:0/951183084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f7644f12700 1 -- 172.21.15.60:0/951183084 >> v1:172.21.15.144:6789/0 conn(0x7f76400ad9b0 legacy=0x7f76400c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f7644f12700 1 -- 172.21.15.60:0/951183084 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400c8ca0 con 0x7f76400c87a0 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f7644f12700 1 --2- 172.21.15.60:0/951183084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400c87a0 0x7f764006a360 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7638009f20 tx=0x7f7638009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24752f2e810517a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f763effd700 1 -- 172.21.15.60:0/951183084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800e070 con 0x7f76400c87a0 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f763effd700 1 -- 172.21.15.60:0/951183084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763800ba40 con 0x7f76400c87a0 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.812+0000 7f763effd700 1 -- 172.21.15.60:0/951183084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380092e0 con 0x7f76400c87a0 2023-10-08T16:11:01.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 -- 172.21.15.60:0/951183084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400c87a0 msgr2=0x7f764006a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 --2- 172.21.15.60:0/951183084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400c87a0 0x7f764006a360 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7638009f20 tx=0x7f7638009840 comp rx=0 tx=0).stop 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 -- 172.21.15.60:0/951183084 shutdown_connections 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 --2- 172.21.15.60:0/951183084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400c87a0 0x7f764006a360 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 --2- 172.21.15.60:0/951183084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 -- 172.21.15.60:0/951183084 >> 172.21.15.60:0/951183084 conn(0x7f76400cda50 msgr2=0x7f76400cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 -- 172.21.15.60:0/951183084 shutdown_connections 2023-10-08T16:11:01.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.813+0000 7f7646975700 1 -- 172.21.15.60:0/951183084 wait complete. 2023-10-08T16:11:01.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.814+0000 7f7646975700 1 Processor -- start 2023-10-08T16:11:01.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.814+0000 7f7646975700 1 -- start start 2023-10-08T16:11:01.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 0x7f7640151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76400c87a0 0x7f7640158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400ae240 con 0x7f76400ad9b0 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b3270 con 0x7f76400c87a0 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b3550 con 0x7f76401568d0 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 0x7f7640151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 0x7f7640151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48052/0 (socket says 172.21.15.60:48052) 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 -- 172.21.15.60:0/2830824803 learned_addr learned my addr 172.21.15.60:0/2830824803 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7644f12700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763f7fe700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76400c87a0 0x7f7640158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 -- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 msgr2=0x7f7640159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 -- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76400c87a0 msgr2=0x7f7640158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76400c87a0 0x7f7640158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 -- 172.21.15.60:0/2830824803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638009ae0 con 0x7f76400ad9b0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f763ffff700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 0x7f7640151f10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f763000d890 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000b600 con 0x7f76400ad9b0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763000b760 con 0x7f76400ad9b0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000bae0 con 0x7f76400ad9b0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76400b3830 con 0x7f76400ad9b0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.815+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76401533c0 con 0x7f76400ad9b0 2023-10-08T16:11:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.816+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76400ae520 con 0x7f76400ad9b0 2023-10-08T16:11:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.817+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f763001e460 con 0x7f76400ad9b0 2023-10-08T16:11:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.817+0000 7f7627fff700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f762c066f30 0x7f762c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.817+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7630084be0 con 0x7f76400ad9b0 2023-10-08T16:11:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.817+0000 7f763f7fe700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f762c066f30 0x7f762c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.818+0000 7f763f7fe700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f762c066f30 0x7f762c0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7634006fd0 tx=0x7f7634008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:01.821+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7630051e50 con 0x7f76400ad9b0 2023-10-08T16:11:02.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.015+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f764004c3c0 con 0x7f76400ad9b0 2023-10-08T16:11:02.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.016+0000 7f7627fff700 1 -- 172.21.15.60:0/2830824803 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f7630055470 con 0x7f76400ad9b0 2023-10-08T16:11:02.016 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:02.016 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:57.384146+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f762c066f30 msgr2=0x7f762c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f762c066f30 0x7f762c0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7634006fd0 tx=0x7f7634008040 comp rx=0 tx=0).stop 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 msgr2=0x7f7640151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 0x7f7640151f10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f763000d890 tx=0x7f7630008040 comp rx=0 tx=0).stop 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 shutdown_connections 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f762c066f30 0x7f762c0693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76401568d0 0x7f7640159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76400ad9b0 0x7f7640151f10 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 --2- 172.21.15.60:0/2830824803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76400c87a0 0x7f7640158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 >> 172.21.15.60:0/2830824803 conn(0x7f76400cda50 msgr2=0x7f76400cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 shutdown_connections 2023-10-08T16:11:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.018+0000 7f7646975700 1 -- 172.21.15.60:0/2830824803 wait complete. 2023-10-08T16:11:02.031 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:11:02.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:02.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.149+0000 7fbf25fdd700 1 Processor -- start 2023-10-08T16:11:02.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.149+0000 7fbf25fdd700 1 -- start start 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf25fdd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf20159e10 0x7fbf200b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf25fdd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf200cde50 0x7fbf200b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf25fdd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2015db80 con 0x7fbf2015a1e0 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf25fdd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2015e800 con 0x7fbf200cde50 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf25fdd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2015de60 con 0x7fbf20159e10 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf20159e10 0x7fbf200b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf200cde50 0x7fbf200b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf200cde50 0x7fbf200b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:50620/0 (socket says 172.21.15.60:50620) 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 -- 172.21.15.60:0/546073408 learned_addr learned my addr 172.21.15.60:0/546073408 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1effd700 1 --1- 172.21.15.60:0/546073408 >> v1:172.21.15.144:6789/0 conn(0x7fbf2015a1e0 0x7fbf200cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:37268/0 (socket says 172.21.15.60:37268) 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1e7fc700 1 -- 172.21.15.60:0/546073408 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142260129 0 0) 0x7fbf2015db80 con 0x7fbf2015a1e0 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1e7fc700 1 -- 172.21.15.60:0/546073408 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf0c003570 con 0x7fbf2015a1e0 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 -- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf20159e10 msgr2=0x7fbf200b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 --2- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf20159e10 0x7fbf200b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 -- 172.21.15.60:0/546073408 >> v1:172.21.15.144:6789/0 conn(0x7fbf2015a1e0 legacy=0x7fbf200cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1ffff700 1 -- 172.21.15.60:0/546073408 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2015e140 con 0x7fbf200cde50 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.150+0000 7fbf1f7fe700 1 --2- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf20159e10 0x7fbf200b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf1ffff700 1 --2- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf200cde50 0x7fbf200b3260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009f20 tx=0x7fbf18009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d138ab6efa1ec22f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf1e7fc700 1 -- 172.21.15.60:0/546073408 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800e070 con 0x7fbf200cde50 2023-10-08T16:11:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf1e7fc700 1 -- 172.21.15.60:0/546073408 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1800b970 con 0x7fbf200cde50 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf1e7fc700 1 -- 172.21.15.60:0/546073408 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180092e0 con 0x7fbf200cde50 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 -- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf200cde50 msgr2=0x7fbf200b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf200cde50 0x7fbf200b3260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009f20 tx=0x7fbf18009840 comp rx=0 tx=0).stop 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 -- 172.21.15.60:0/546073408 shutdown_connections 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf200cde50 0x7fbf200b3260 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/546073408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf20159e10 0x7fbf200b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 -- 172.21.15.60:0/546073408 >> 172.21.15.60:0/546073408 conn(0x7fbf20067660 msgr2=0x7fbf20067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 -- 172.21.15.60:0/546073408 shutdown_connections 2023-10-08T16:11:02.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.151+0000 7fbf25fdd700 1 -- 172.21.15.60:0/546073408 wait complete. 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 Processor -- start 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 -- start start 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf200cde50 0x7fbf20169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf20159e10 0x7fbf2015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 0x7fbf201591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2015bb10 con 0x7fbf2015a1e0 2023-10-08T16:11:02.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2015ac30 con 0x7fbf20159e10 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf25fdd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2015af00 con 0x7fbf200cde50 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.153+0000 7fbf1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 0x7fbf201591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 0x7fbf201591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48056/0 (socket says 172.21.15.60:48056) 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 -- 172.21.15.60:0/1226450784 learned_addr learned my addr 172.21.15.60:0/1226450784 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1effd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf20159e10 0x7fbf2015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1f7fe700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf200cde50 0x7fbf20169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 -- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf200cde50 msgr2=0x7fbf20169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf200cde50 0x7fbf20169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 -- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf20159e10 msgr2=0x7fbf2015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf20159e10 0x7fbf2015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 -- 172.21.15.60:0/1226450784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10009420 con 0x7fbf2015a1e0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1effd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf20159e10 0x7fbf2015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf1ffff700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 0x7fbf201591d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbf20089c80 tx=0x7fbf18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180032f0 con 0x7fbf2015a1e0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf18009ae0 con 0x7fbf2015a1e0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18008c30 con 0x7fbf2015a1e0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18026460 con 0x7fbf2015a1e0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.154+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2015b4c0 con 0x7fbf2015a1e0 2023-10-08T16:11:02.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.155+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2015bcc0 con 0x7fbf2015a1e0 2023-10-08T16:11:02.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.156+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf18003040 con 0x7fbf2015a1e0 2023-10-08T16:11:02.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.156+0000 7fbf177fe700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf00066f30 0x7fbf000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.156+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf18086380 con 0x7fbf2015a1e0 2023-10-08T16:11:02.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.156+0000 7fbf1f7fe700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf00066f30 0x7fbf000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.156+0000 7fbf1f7fe700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf00066f30 0x7fbf000693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbf100093f0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.160+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf2015bcc0 con 0x7fbf2015a1e0 2023-10-08T16:11:02.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.396+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf200b2380 con 0x7fbf2015a1e0 2023-10-08T16:11:02.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.397+0000 7fbf177fe700 1 -- 172.21.15.60:0/1226450784 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbf180535f0 con 0x7fbf2015a1e0 2023-10-08T16:11:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:02.398 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:11:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf00066f30 msgr2=0x7fbf000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf00066f30 0x7fbf000693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbf100093f0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2023-10-08T16:11:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 msgr2=0x7fbf201591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 0x7fbf201591d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbf20089c80 tx=0x7fbf18018000 comp rx=0 tx=0).stop 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 shutdown_connections 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf00066f30 0x7fbf000693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf200cde50 0x7fbf20169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf2015a1e0 0x7fbf201591d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 --2- 172.21.15.60:0/1226450784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf20159e10 0x7fbf2015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.399+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 >> 172.21.15.60:0/1226450784 conn(0x7fbf20067660 msgr2=0x7fbf200d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.400+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 shutdown_connections 2023-10-08T16:11:02.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.400+0000 7fbf25fdd700 1 -- 172.21.15.60:0/1226450784 wait complete. 2023-10-08T16:11:02.402 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:11:02.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:02.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 Processor -- start 2023-10-08T16:11:02.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 -- start start 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f422c0a79f0 0x7f422c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 0x7f422c06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c0b26d0 con 0x7f422c0a7dc0 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c0aeab0 con 0x7f422c0a79f0 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.532+0000 7f4233bb4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0b2b60 con 0x7f422c0b15e0 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f4232151700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f422c0a7dc0 0x7f422c15dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45862/0 (socket says 172.21.15.60:45862) 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f4232151700 1 -- 172.21.15.60:0/3035504629 learned_addr learned my addr 172.21.15.60:0/3035504629 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423114f700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 0x7f422c06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f4231950700 1 --2- 172.21.15.60:0/3035504629 >> v2:172.21.15.144:3300/0 conn(0x7f422c0a79f0 0x7f422c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689247672 0 0) 0x7f422c0b26d0 con 0x7f422c0a7dc0 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4214003570 con 0x7f422c0a7dc0 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463408593 0 0) 0x7f4214003570 con 0x7f422c0a7dc0 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 msgr2=0x7f422c06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 0x7f422c06eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 >> v2:172.21.15.144:3300/0 conn(0x7f422c0a79f0 msgr2=0x7f422c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 --2- 172.21.15.60:0/3035504629 >> v2:172.21.15.144:3300/0 conn(0x7f422c0a79f0 0x7f422c06eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0b1ac0 con 0x7f422c0a7dc0 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f421c001470 con 0x7f422c0a7dc0 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 >> v1:172.21.15.60:6789/0 conn(0x7f422c0a7dc0 legacy=0x7f422c15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4214003a60 0x7f4214003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 0x7f4214004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4214004d50 0x7f42140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0aeab0 con 0x7f4214004d50 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0b2b60 con 0x7f4214003a60 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421400ba60 con 0x7f422c0b15e0 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f4232151700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4214004d50 0x7f42140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.533+0000 7f4231950700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4214003a60 0x7f4214003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f423114f700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 0x7f4214004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 -- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 msgr2=0x7f4214004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f422c0b15e0 0x7f4214004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 -- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4214003a60 msgr2=0x7f4214003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4214003a60 0x7f4214003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 -- 172.21.15.60:0/3035504629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214003570 con 0x7f4214004d50 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4214004d50 0x7f42140051c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c3c0 tx=0x7f421c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62084a091449ae67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00cc30 con 0x7f4214004d50 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c00cdb0 con 0x7f4214004d50 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f423094e700 1 -- 172.21.15.60:0/3035504629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c005b70 con 0x7f4214004d50 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4233bb4700 1 -- 172.21.15.60:0/3035504629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4214004d50 msgr2=0x7f42140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4233bb4700 1 --2- 172.21.15.60:0/3035504629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4214004d50 0x7f42140051c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c3c0 tx=0x7f421c001e90 comp rx=0 tx=0).stop 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.534+0000 7f4232151700 1 -- 172.21.15.60:0/3035504629 reap_dead start 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.535+0000 7f4233bb4700 1 -- 172.21.15.60:0/3035504629 shutdown_connections 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.535+0000 7f4233bb4700 1 -- 172.21.15.60:0/3035504629 >> 172.21.15.60:0/3035504629 conn(0x7f422c0cd1e0 msgr2=0x7f422c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.535+0000 7f4233bb4700 1 -- 172.21.15.60:0/3035504629 shutdown_connections 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.535+0000 7f4233bb4700 1 -- 172.21.15.60:0/3035504629 wait complete. 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 Processor -- start 2023-10-08T16:11:02.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 -- start start 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4214004d50 0x7f422c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 0x7f422c0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422c15f6f0 0x7f422c158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0cc680 con 0x7f422c0c28c0 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0c2210 con 0x7f422c15f6f0 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.536+0000 7f4233bb4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c15cee0 con 0x7f4214004d50 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 0x7f422c0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 0x7f422c0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46100/0 (socket says 172.21.15.60:46100) 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 -- 172.21.15.60:0/2571909125 learned_addr learned my addr 172.21.15.60:0/2571909125 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4232151700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422c15f6f0 0x7f422c158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4231950700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4214004d50 0x7f422c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 -- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4214004d50 msgr2=0x7f422c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4214004d50 0x7f422c15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 -- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422c15f6f0 msgr2=0x7f422c158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422c15f6f0 0x7f422c158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 -- 172.21.15.60:0/2571909125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c15c5b0 con 0x7f422c0c28c0 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4232151700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422c15f6f0 0x7f422c158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f423114f700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 0x7f422c0cbf80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4220011b70 tx=0x7f42200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000fa10 con 0x7f422c0c28c0 2023-10-08T16:11:02.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000fb70 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c15c890 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220014440 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.537+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c15fb40 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.538+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c15fe20 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.539+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4220014870 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.539+0000 7f4229ffb700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4218066f60 0x7f4218069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.539+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4220018030 con 0x7f422c0c28c0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.539+0000 7f4231950700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4218066f60 0x7f4218069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.540+0000 7f4231950700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4218066f60 0x7f4218069410 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42240094a0 tx=0x7f422400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.543+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4220052590 con 0x7f422c0c28c0 2023-10-08T16:11:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.783+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f422c06f930 con 0x7f422c0c28c0 2023-10-08T16:11:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.783+0000 7f4229ffb700 1 -- 172.21.15.60:0/2571909125 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f4220055bb0 con 0x7f422c0c28c0 2023-10-08T16:11:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:02.784 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:44.530224+0000","modified":"2023-10-08T16:10:48.354044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6756},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6756":{"gid":6756,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2777041684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2777041684},{"type":"v1","addr":"172.21.15.60:6837","nonce":2777041684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4218066f60 msgr2=0x7f4218069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4218066f60 0x7f4218069410 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42240094a0 tx=0x7f422400b040 comp rx=0 tx=0).stop 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 msgr2=0x7f422c0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 0x7f422c0cbf80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4220011b70 tx=0x7f42200091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 shutdown_connections 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4218066f60 0x7f4218069410 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4214004d50 0x7f422c15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422c15f6f0 0x7f422c158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 --2- 172.21.15.60:0/2571909125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f422c0c28c0 0x7f422c0cbf80 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 >> 172.21.15.60:0/2571909125 conn(0x7f422c0cd1e0 msgr2=0x7f422c0af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 shutdown_connections 2023-10-08T16:11:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.785+0000 7f4233bb4700 1 -- 172.21.15.60:0/2571909125 wait complete. 2023-10-08T16:11:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 60 2023-10-08T16:11:02.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:02.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.916+0000 7f9ea645b700 1 Processor -- start 2023-10-08T16:11:02.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.916+0000 7f9ea645b700 1 -- start start 2023-10-08T16:11:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.916+0000 7f9ea645b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a2b0 0x7f9ea00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.916+0000 7f9ea645b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea00d1c30 0x7f9ea00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.916+0000 7f9ea645b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ea015a680 0x7f9ea00cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.916+0000 7f9ea645b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea0068470 con 0x7f9ea015a680 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea645b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea00c5d80 con 0x7f9ea00d1c30 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea645b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00c6060 con 0x7f9ea015a2b0 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ea015a680 0x7f9ea00cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ea015a680 0x7f9ea00cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46102/0 (socket says 172.21.15.60:46102) 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 -- 172.21.15.60:0/3116952353 learned_addr learned my addr 172.21.15.60:0/3116952353 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9e9f7fe700 1 --2- 172.21.15.60:0/3116952353 >> v2:172.21.15.144:3300/0 conn(0x7f9ea00d1c30 0x7f9ea00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9e9ffff700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a2b0 0x7f9ea00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 -- 172.21.15.60:0/3116952353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a2b0 msgr2=0x7f9ea00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a2b0 0x7f9ea00b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 -- 172.21.15.60:0/3116952353 >> v2:172.21.15.144:3300/0 conn(0x7f9ea00d1c30 msgr2=0x7f9ea00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:02.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 --2- 172.21.15.60:0/3116952353 >> v2:172.21.15.144:3300/0 conn(0x7f9ea00d1c30 0x7f9ea00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 -- 172.21.15.60:0/3116952353 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00c6340 con 0x7f9ea015a680 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9e9ffff700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a2b0 0x7f9ea00b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9ea49f8700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea015a680 0x7f9ea00cfc50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0089050 tx=0x7f9e98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62edc7a8c5e89ded server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9e9effd700 1 -- 172.21.15.60:0/3116952353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800e070 con 0x7f9ea015a680 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9e9effd700 1 -- 172.21.15.60:0/3116952353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800ba20 con 0x7f9ea015a680 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.917+0000 7f9e9effd700 1 -- 172.21.15.60:0/3116952353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980092e0 con 0x7f9ea015a680 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 -- 172.21.15.60:0/3116952353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea015a680 msgr2=0x7f9ea00cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea015a680 0x7f9ea00cfc50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0089050 tx=0x7f9e98009840 comp rx=0 tx=0).stop 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 -- 172.21.15.60:0/3116952353 shutdown_connections 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea015a680 0x7f9ea00cfc50 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 --2- 172.21.15.60:0/3116952353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a2b0 0x7f9ea00b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 --2- 172.21.15.60:0/3116952353 >> v2:172.21.15.144:3300/0 conn(0x7f9ea00d1c30 0x7f9ea00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 -- 172.21.15.60:0/3116952353 >> 172.21.15.60:0/3116952353 conn(0x7f9ea0067e40 msgr2=0x7f9ea00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:02.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 -- 172.21.15.60:0/3116952353 shutdown_connections 2023-10-08T16:11:02.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.918+0000 7f9ea645b700 1 -- 172.21.15.60:0/3116952353 wait complete. 2023-10-08T16:11:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.919+0000 7f9ea645b700 1 Processor -- start 2023-10-08T16:11:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.919+0000 7f9ea645b700 1 -- start start 2023-10-08T16:11:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea645b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 0x7f9ea016d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea645b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea015a2b0 0x7f9ea0146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea645b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a680 0x7f9ea0146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea645b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea01473a0 con 0x7f9ea00d1c30 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea645b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0168820 con 0x7f9ea015a2b0 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea645b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0167c10 con 0x7f9ea015a680 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 0x7f9ea016d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 0x7f9ea016d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46104/0 (socket says 172.21.15.60:46104) 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 -- 172.21.15.60:0/2956349325 learned_addr learned my addr 172.21.15.60:0/2956349325 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9f7fe700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea015a2b0 0x7f9ea0146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9ea49f8700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a680 0x7f9ea0146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 -- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a680 msgr2=0x7f9ea0146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a680 0x7f9ea0146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 -- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea015a2b0 msgr2=0x7f9ea0146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:02.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea015a2b0 0x7f9ea0146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.920+0000 7f9e9ffff700 1 -- 172.21.15.60:0/2956349325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009ae0 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.921+0000 7f9e9ffff700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 0x7f9ea016d780 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400d890 tx=0x7f9e94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.921+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94005a00 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.921+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94005b60 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.921+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e940125f0 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.921+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea0167ef0 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.921+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea01684b0 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.922+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea016b100 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.922+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e940129a0 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.922+0000 7f9e87fff700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9e8c066f30 0x7f9e8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.923+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e94084780 con 0x7f9ea00d1c30 2023-10-08T16:11:02.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.923+0000 7f9e9f7fe700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9e8c066f30 0x7f9e8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:02.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.923+0000 7f9e9f7fe700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9e8c066f30 0x7f9e8c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00cb450 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:02.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:02.927+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e94051aa0 con 0x7f9ea00d1c30 2023-10-08T16:11:03.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.122+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ea004c3c0 con 0x7f9ea00d1c30 2023-10-08T16:11:03.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.123+0000 7f9e87fff700 1 -- 172.21.15.60:0/2956349325 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f9e940550c0 con 0x7f9ea00d1c30 2023-10-08T16:11:03.123 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:03.123 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:10:57.384146+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:42.924309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:43.494603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9e8c066f30 msgr2=0x7f9e8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9e8c066f30 0x7f9e8c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00cb450 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 msgr2=0x7f9ea016d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 0x7f9ea016d780 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400d890 tx=0x7f9e94008040 comp rx=0 tx=0).stop 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 shutdown_connections 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9e8c066f30 0x7f9e8c0693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ea015a680 0x7f9ea0146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ea00d1c30 0x7f9ea016d780 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 --2- 172.21.15.60:0/2956349325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea015a2b0 0x7f9ea0146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 >> 172.21.15.60:0/2956349325 conn(0x7f9ea0067e40 msgr2=0x7f9ea006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 shutdown_connections 2023-10-08T16:11:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.125+0000 7f9ea645b700 1 -- 172.21.15.60:0/2956349325 wait complete. 2023-10-08T16:11:03.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:11:03.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:03.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:03.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.260+0000 7f68c18b1700 1 Processor -- start 2023-10-08T16:11:03.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.260+0000 7f68c18b1700 1 -- start start 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c18b1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d0160 0x7f68bc0af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c18b1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f68bc0d15c0 0x7f68bc0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c18b1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc15d8d0 con 0x7f68bc15e600 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c18b1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc15e170 con 0x7f68bc0d15c0 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c18b1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0b00c0 con 0x7f68bc0d0160 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68bbfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f68bc0d15c0 0x7f68bc0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c10b0700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f68bc15e600 0x7f68bc0ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:51200/0 (socket says 172.21.15.60:51200) 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c10b0700 1 -- 172.21.15.60:0/619881306 learned_addr learned my addr 172.21.15.60:0/619881306 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.261+0000 7f68c08af700 1 --2- 172.21.15.60:0/619881306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d0160 0x7f68bc0af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68bb7fe700 1 -- 172.21.15.60:0/619881306 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316720626 0 0) 0x7f68bc15d8d0 con 0x7f68bc15e600 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68bb7fe700 1 -- 172.21.15.60:0/619881306 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4003570 con 0x7f68bc15e600 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68c08af700 1 -- 172.21.15.60:0/619881306 >> v2:172.21.15.144:3300/0 conn(0x7f68bc0d15c0 msgr2=0x7f68bc0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68c08af700 1 --2- 172.21.15.60:0/619881306 >> v2:172.21.15.144:3300/0 conn(0x7f68bc0d15c0 0x7f68bc0cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68c08af700 1 -- 172.21.15.60:0/619881306 >> v1:172.21.15.144:6789/0 conn(0x7f68bc15e600 legacy=0x7f68bc0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68c08af700 1 -- 172.21.15.60:0/619881306 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc15db20 con 0x7f68bc0d0160 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68bbfff700 1 --2- 172.21.15.60:0/619881306 >> v2:172.21.15.144:3300/0 conn(0x7f68bc0d15c0 0x7f68bc0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68c08af700 1 --2- 172.21.15.60:0/619881306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d0160 0x7f68bc0af750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009e60 tx=0x7f68b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce82d0a2a2bd107 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68bb7fe700 1 -- 172.21.15.60:0/619881306 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400e070 con 0x7f68bc0d0160 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68bb7fe700 1 -- 172.21.15.60:0/619881306 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b400bab0 con 0x7f68bc0d0160 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.262+0000 7f68bb7fe700 1 -- 172.21.15.60:0/619881306 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400be30 con 0x7f68bc0d0160 2023-10-08T16:11:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 -- 172.21.15.60:0/619881306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d0160 msgr2=0x7f68bc0af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 --2- 172.21.15.60:0/619881306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d0160 0x7f68bc0af750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009e60 tx=0x7f68b4009780 comp rx=0 tx=0).stop 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 -- 172.21.15.60:0/619881306 shutdown_connections 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 --2- 172.21.15.60:0/619881306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d0160 0x7f68bc0af750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 --2- 172.21.15.60:0/619881306 >> v2:172.21.15.144:3300/0 conn(0x7f68bc0d15c0 0x7f68bc0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 -- 172.21.15.60:0/619881306 >> 172.21.15.60:0/619881306 conn(0x7f68bc0695d0 msgr2=0x7f68bc0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 -- 172.21.15.60:0/619881306 shutdown_connections 2023-10-08T16:11:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.263+0000 7f68c18b1700 1 -- 172.21.15.60:0/619881306 wait complete. 2023-10-08T16:11:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.264+0000 7f68c18b1700 1 Processor -- start 2023-10-08T16:11:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.264+0000 7f68c18b1700 1 -- start start 2023-10-08T16:11:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c18b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 0x7f68bc0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c18b1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d15c0 0x7f68bc0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c18b1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68bc15e600 0x7f68bc15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c18b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0b5700 con 0x7f68bc0d0160 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c18b1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0b4d30 con 0x7f68bc15e600 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c18b1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0b3ea0 con 0x7f68bc0d15c0 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 0x7f68bc0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 0x7f68bc0b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46118/0 (socket says 172.21.15.60:46118) 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 -- 172.21.15.60:0/2978033180 learned_addr learned my addr 172.21.15.60:0/2978033180 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c10b0700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68bc15e600 0x7f68bc15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68bbfff700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d15c0 0x7f68bc0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 -- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d15c0 msgr2=0x7f68bc0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d15c0 0x7f68bc0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 -- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68bc15e600 msgr2=0x7f68bc15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68bc15e600 0x7f68bc15c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 -- 172.21.15.60:0/2978033180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009420 con 0x7f68bc0d0160 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68c08af700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 0x7f68bc0b51c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f68bc15b450 tx=0x7f68b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.265+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4001010 con 0x7f68bc0d0160 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.266+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4012d80 con 0x7f68bc0d0160 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.266+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b4009a20 con 0x7f68bc0d0160 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.266+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40276c0 con 0x7f68bc0d0160 2023-10-08T16:11:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.266+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc0b46e0 con 0x7f68bc0d0160 2023-10-08T16:11:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.267+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc04bb80 con 0x7f68bc0d0160 2023-10-08T16:11:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.267+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b4024070 con 0x7f68bc0d0160 2023-10-08T16:11:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.267+0000 7f68b8ff9700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f68a8066f30 0x7f68a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.268+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68b4086990 con 0x7f68bc0d0160 2023-10-08T16:11:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.268+0000 7f68bbfff700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f68a8066f30 0x7f68a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.268+0000 7f68bbfff700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f68a8066f30 0x7f68a80693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0b68b0 tx=0x7f68b00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.272+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b4053c00 con 0x7f68bc0d0160 2023-10-08T16:11:03.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.512+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f68bc0b5010 con 0x7f68bc0d0160 2023-10-08T16:11:03.513 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:11:03.513+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:11:03.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.517+0000 7f68b8ff9700 1 -- 172.21.15.60:0/2978033180 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f68b4057220 con 0x7f68bc0d0160 2023-10-08T16:11:03.519 INFO:tasks.ceph.mds.a.smithi060.stderr: -3349> 2023-10-08T16:10:50.449+0000 7f58ce8be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f68a8066f30 msgr2=0x7f68a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f68a8066f30 0x7f68a80693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0b68b0 tx=0x7f68b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 msgr2=0x7f68bc0b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 0x7f68bc0b51c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f68bc15b450 tx=0x7f68b4019000 comp rx=0 tx=0).stop 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 shutdown_connections 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f68a8066f30 0x7f68a80693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68bc15e600 0x7f68bc15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68bc0d0160 0x7f68bc0b51c0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 --2- 172.21.15.60:0/2978033180 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68bc0d15c0 0x7f68bc0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 >> 172.21.15.60:0/2978033180 conn(0x7f68bc0695d0 msgr2=0x7f68bc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:03.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.519+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 shutdown_connections 2023-10-08T16:11:03.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.520+0000 7f68c18b1700 1 -- 172.21.15.60:0/2978033180 wait complete. 2023-10-08T16:11:03.521 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:11:03.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:11:03.547 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:11:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.667+0000 7f99c44a1700 1 Processor -- start 2023-10-08T16:11:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.667+0000 7f99c44a1700 1 -- start start 2023-10-08T16:11:03.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.668+0000 7f99c44a1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99bc0678b0 0x7f99bc15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.668+0000 7f99c44a1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f99bc0c9390 0x7f99bc15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.668+0000 7f99c44a1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0cae70 con 0x7f99bc0cbf10 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.668+0000 7f99c44a1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0cb150 con 0x7f99bc0c9390 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.668+0000 7f99c44a1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0cb430 con 0x7f99bc0678b0 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f99bc0c9390 0x7f99bc15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f99bc0c9390 0x7f99bc15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46136/0 (socket says 172.21.15.60:46136) 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 -- 172.21.15.60:0/3742017444 learned_addr learned my addr 172.21.15.60:0/3742017444 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c223d700 1 --2- 172.21.15.60:0/3742017444 >> v2:172.21.15.144:3300/0 conn(0x7f99bc0678b0 0x7f99bc15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 -- 172.21.15.60:0/3742017444 >> v2:172.21.15.144:3300/0 conn(0x7f99bc0678b0 msgr2=0x7f99bc15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 --2- 172.21.15.60:0/3742017444 >> v2:172.21.15.144:3300/0 conn(0x7f99bc0678b0 0x7f99bc15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 -- 172.21.15.60:0/3742017444 >> v1:172.21.15.144:6789/0 conn(0x7f99bc0cbf10 legacy=0x7f99bc15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 -- 172.21.15.60:0/3742017444 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cb710 con 0x7f99bc0c9390 2023-10-08T16:11:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c2a3e700 1 --2- 172.21.15.60:0/3742017444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc15a370 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0c5b10 tx=0x7f99ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6639d3c0a414683f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c123b700 1 -- 172.21.15.60:0/3742017444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00e070 con 0x7f99bc0c9390 2023-10-08T16:11:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c123b700 1 -- 172.21.15.60:0/3742017444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00ba20 con 0x7f99bc0c9390 2023-10-08T16:11:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.669+0000 7f99c123b700 1 -- 172.21.15.60:0/3742017444 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0092e0 con 0x7f99bc0c9390 2023-10-08T16:11:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 -- 172.21.15.60:0/3742017444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 msgr2=0x7f99bc15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 --2- 172.21.15.60:0/3742017444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc15a370 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0c5b10 tx=0x7f99ac009840 comp rx=0 tx=0).stop 2023-10-08T16:11:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 -- 172.21.15.60:0/3742017444 shutdown_connections 2023-10-08T16:11:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 --2- 172.21.15.60:0/3742017444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc15a370 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 --2- 172.21.15.60:0/3742017444 >> v2:172.21.15.144:3300/0 conn(0x7f99bc0678b0 0x7f99bc15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 -- 172.21.15.60:0/3742017444 >> 172.21.15.60:0/3742017444 conn(0x7f99bc069870 msgr2=0x7f99bc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 -- 172.21.15.60:0/3742017444 shutdown_connections 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.670+0000 7f99c44a1700 1 -- 172.21.15.60:0/3742017444 wait complete. 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.671+0000 7f99c44a1700 1 Processor -- start 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.671+0000 7f99c44a1700 1 -- start start 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c44a1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99bc0678b0 0x7f99bc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c44a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c44a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99bc0cbf10 0x7f99bc158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c44a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0ce3b0 con 0x7f99bc0c9390 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c44a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1559c0 con 0x7f99bc0cbf10 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c44a1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0cd7a0 con 0x7f99bc0678b0 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46146/0 (socket says 172.21.15.60:46146) 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 -- 172.21.15.60:0/356994977 learned_addr learned my addr 172.21.15.60:0/356994977 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c223d700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99bc0678b0 0x7f99bc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c2a3e700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99bc0cbf10 0x7f99bc158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 -- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99bc0678b0 msgr2=0x7f99bc0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99bc0678b0 0x7f99bc0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 -- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99bc0cbf10 msgr2=0x7f99bc158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99bc0cbf10 0x7f99bc158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 -- 172.21.15.60:0/356994977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009ae0 con 0x7f99bc0c9390 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c223d700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99bc0678b0 0x7f99bc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99c1a3c700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc157f30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c590 tx=0x7f99b000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.672+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0011590 con 0x7f99bc0c9390 2023-10-08T16:11:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.673+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b00116f0 con 0x7f99bc0c9390 2023-10-08T16:11:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.673+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0cda80 con 0x7f99bc0c9390 2023-10-08T16:11:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.673+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0011ab0 con 0x7f99bc0c9390 2023-10-08T16:11:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.673+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0ce040 con 0x7f99bc0c9390 2023-10-08T16:11:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.674+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc04c3c0 con 0x7f99bc0c9390 2023-10-08T16:11:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.674+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99b001b3b0 con 0x7f99bc0c9390 2023-10-08T16:11:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.675+0000 7f99ba7fc700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f99a8066f30 0x7f99a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.675+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f99b0083b00 con 0x7f99bc0c9390 2023-10-08T16:11:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.675+0000 7f99c223d700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f99a8066f30 0x7f99a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.676+0000 7f99c223d700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f99a8066f30 0x7f99a80693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f99b4006f00 tx=0x7f99b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.679+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99b0050d20 con 0x7f99bc0c9390 2023-10-08T16:11:03.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:03.916+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f99bc0ce4f0 con 0x7f99bc0c9390 2023-10-08T16:11:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.519+0000 7f99ba7fc700 1 -- 172.21.15.60:0/356994977 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f99b00170a0 con 0x7f99bc0c9390 2023-10-08T16:11:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f99a8066f30 msgr2=0x7f99a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f99a8066f30 0x7f99a80693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f99b4006f00 tx=0x7f99b4008040 comp rx=0 tx=0).stop 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 msgr2=0x7f99bc157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc157f30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c590 tx=0x7f99b000c950 comp rx=0 tx=0).stop 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 shutdown_connections 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f99a8066f30 0x7f99a80693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99bc0678b0 0x7f99bc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99bc0cbf10 0x7f99bc158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 --2- 172.21.15.60:0/356994977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99bc0c9390 0x7f99bc157f30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 >> 172.21.15.60:0/356994977 conn(0x7f99bc069870 msgr2=0x7f99bc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 shutdown_connections 2023-10-08T16:11:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.521+0000 7f99c44a1700 1 -- 172.21.15.60:0/356994977 wait complete. 2023-10-08T16:11:04.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:11:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.663+0000 7f3002f61700 1 Processor -- start 2023-10-08T16:11:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.663+0000 7f3002f61700 1 -- start start 2023-10-08T16:11:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f3002f61700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ffc0affc0 0x7f2ffc0b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f3002f61700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2ffc0ca410 0x7f2ffc0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f3002f61700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc0b0430 con 0x7f2ffc0aedd0 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f3002f61700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc0b2550 con 0x7f2ffc0ca410 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f3002f61700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc06eb70 con 0x7f2ffc0affc0 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2ffc0ca410 0x7f2ffc0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2ffc0ca410 0x7f2ffc0ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46148/0 (socket says 172.21.15.60:46148) 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 -- 172.21.15.60:0/2247543173 learned_addr learned my addr 172.21.15.60:0/2247543173 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f2ffbfff700 1 --2- 172.21.15.60:0/2247543173 >> v2:172.21.15.144:3300/0 conn(0x7f2ffc0affc0 0x7f2ffc0b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 -- 172.21.15.60:0/2247543173 >> v2:172.21.15.144:3300/0 conn(0x7f2ffc0affc0 msgr2=0x7f2ffc0b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 --2- 172.21.15.60:0/2247543173 >> v2:172.21.15.144:3300/0 conn(0x7f2ffc0affc0 0x7f2ffc0b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 -- 172.21.15.60:0/2247543173 >> v1:172.21.15.144:6789/0 conn(0x7f2ffc0aedd0 legacy=0x7f2ffc0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 -- 172.21.15.60:0/2247543173 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc0b06f0 con 0x7f2ffc0ca410 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.664+0000 7f30014fe700 1 --2- 172.21.15.60:0/2247543173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0ca410 0x7f2ffc0ca860 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc063ee0 tx=0x7f2ff4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0699a5048bae5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f2ffb7fe700 1 -- 172.21.15.60:0/2247543173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400e070 con 0x7f2ffc0ca410 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f2ffb7fe700 1 -- 172.21.15.60:0/2247543173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400bae0 con 0x7f2ffc0ca410 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f2ffb7fe700 1 -- 172.21.15.60:0/2247543173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40092e0 con 0x7f2ffc0ca410 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 -- 172.21.15.60:0/2247543173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0ca410 msgr2=0x7f2ffc0ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 --2- 172.21.15.60:0/2247543173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0ca410 0x7f2ffc0ca860 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc063ee0 tx=0x7f2ff4009840 comp rx=0 tx=0).stop 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 -- 172.21.15.60:0/2247543173 shutdown_connections 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 --2- 172.21.15.60:0/2247543173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0ca410 0x7f2ffc0ca860 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 --2- 172.21.15.60:0/2247543173 >> v2:172.21.15.144:3300/0 conn(0x7f2ffc0affc0 0x7f2ffc0b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 -- 172.21.15.60:0/2247543173 >> 172.21.15.60:0/2247543173 conn(0x7f2ffc068130 msgr2=0x7f2ffc0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 -- 172.21.15.60:0/2247543173 shutdown_connections 2023-10-08T16:11:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.665+0000 7f3002f61700 1 -- 172.21.15.60:0/2247543173 wait complete. 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.666+0000 7f3002f61700 1 Processor -- start 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.666+0000 7f3002f61700 1 -- start start 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3002f61700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ffc0aedd0 0x7f2ffc0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3002f61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 0x7f2ffc168090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3002f61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ffc0ca410 0x7f2ffc155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3002f61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc156890 con 0x7f2ffc0affc0 2023-10-08T16:11:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3002f61700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc158530 con 0x7f2ffc0aedd0 2023-10-08T16:11:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3002f61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc158d90 con 0x7f2ffc0ca410 2023-10-08T16:11:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f2ffbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 0x7f2ffc168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f2ffbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 0x7f2ffc168090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46158/0 (socket says 172.21.15.60:46158) 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f2ffbfff700 1 -- 172.21.15.60:0/3969151874 learned_addr learned my addr 172.21.15.60:0/3969151874 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f30014fe700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ffc0ca410 0x7f2ffc155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.667+0000 7f3000cfd700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ffc0aedd0 0x7f2ffc0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ffbfff700 1 -- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ffc0ca410 msgr2=0x7f2ffc155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ffbfff700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ffc0ca410 0x7f2ffc155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ffbfff700 1 -- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ffc0aedd0 msgr2=0x7f2ffc0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ffbfff700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ffc0aedd0 0x7f2ffc0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ffbfff700 1 -- 172.21.15.60:0/3969151874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4009ae0 con 0x7f2ffc0affc0 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ffbfff700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 0x7f2ffc168090 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000d890 tx=0x7f2ff0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00125f0 con 0x7f2ffc0affc0 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff0012750 con 0x7f2ffc0affc0 2023-10-08T16:11:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc1685d0 con 0x7f2ffc0affc0 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0012af0 con 0x7f2ffc0affc0 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.668+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc158740 con 0x7f2ffc0affc0 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.669+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc15c330 con 0x7f2ffc0affc0 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.669+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ff001e460 con 0x7f2ffc0affc0 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.670+0000 7f2ff8ff9700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fe8066f30 0x7f2fe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.670+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2ff0084ab0 con 0x7f2ffc0affc0 2023-10-08T16:11:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.670+0000 7f3000cfd700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fe8066f30 0x7f2fe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.670+0000 7f3000cfd700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fe8066f30 0x7f2fe80693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0039e0 tx=0x7f2fec007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.674+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ff0051cd0 con 0x7f2ffc0affc0 2023-10-08T16:11:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:04.867+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ffc04c3c0 con 0x7f2ffc0affc0 2023-10-08T16:11:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.521+0000 7f2ff8ff9700 1 -- 172.21.15.60:0/3969151874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2ff00552f0 con 0x7f2ffc0affc0 2023-10-08T16:11:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fe8066f30 msgr2=0x7f2fe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fe8066f30 0x7f2fe80693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0039e0 tx=0x7f2fec007ec0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 msgr2=0x7f2ffc168090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 0x7f2ffc168090 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000d890 tx=0x7f2ff0008040 comp rx=0 tx=0).stop 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 shutdown_connections 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fe8066f30 0x7f2fe80693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ffc0ca410 0x7f2ffc155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ffc0aedd0 0x7f2ffc0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 --2- 172.21.15.60:0/3969151874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ffc0affc0 0x7f2ffc168090 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 >> 172.21.15.60:0/3969151874 conn(0x7f2ffc068130 msgr2=0x7f2ffc0af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 shutdown_connections 2023-10-08T16:11:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.524+0000 7f3002f61700 1 -- 172.21.15.60:0/3969151874 wait complete. 2023-10-08T16:11:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:11:05.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:11:05.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.668+0000 7f53abd2c700 1 Processor -- start 2023-10-08T16:11:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.668+0000 7f53abd2c700 1 -- start start 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53abd2c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53a4067d70 0x7f53a415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53abd2c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53a415aee0 0x7f53a40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53abd2c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40cf350 con 0x7f53a4157b10 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53abd2c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a415e9e0 con 0x7f53a415aee0 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53abd2c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a4157ee0 con 0x7f53a4067d70 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53aa2c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53a415aee0 0x7f53a40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53a9ac8700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f53a4157b10 0x7f53a4067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45882/0 (socket says 172.21.15.60:45882) 2023-10-08T16:11:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.669+0000 7f53a9ac8700 1 -- 172.21.15.60:0/936023148 learned_addr learned my addr 172.21.15.60:0/936023148 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53aa2c9700 1 -- 172.21.15.60:0/936023148 >> v2:172.21.15.144:3300/0 conn(0x7f53a4067d70 msgr2=0x7f53a415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53a92c7700 1 --2- 172.21.15.60:0/936023148 >> v2:172.21.15.144:3300/0 conn(0x7f53a4067d70 0x7f53a415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53a8ac6700 1 -- 172.21.15.60:0/936023148 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508754765 0 0) 0x7f53a40cf350 con 0x7f53a4157b10 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53aa2c9700 1 --2- 172.21.15.60:0/936023148 >> v2:172.21.15.144:3300/0 conn(0x7f53a4067d70 0x7f53a415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53aa2c9700 1 -- 172.21.15.60:0/936023148 >> v1:172.21.15.60:6789/0 conn(0x7f53a4157b10 legacy=0x7f53a4067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53aa2c9700 1 -- 172.21.15.60:0/936023148 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a415b360 con 0x7f53a415aee0 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53a92c7700 1 --2- 172.21.15.60:0/936023148 >> v2:172.21.15.144:3300/0 conn(0x7f53a4067d70 0x7f53a415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53aa2c9700 1 --2- 172.21.15.60:0/936023148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a415aee0 0x7f53a40cf7e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f539c0098e0 tx=0x7f539c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc0b79d17adcdec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53a8ac6700 1 -- 172.21.15.60:0/936023148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c009e80 con 0x7f53a415aee0 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53a8ac6700 1 -- 172.21.15.60:0/936023148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c00b820 con 0x7f53a415aee0 2023-10-08T16:11:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53a8ac6700 1 -- 172.21.15.60:0/936023148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00bba0 con 0x7f53a415aee0 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53abd2c700 1 -- 172.21.15.60:0/936023148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a415aee0 msgr2=0x7f53a40cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53abd2c700 1 --2- 172.21.15.60:0/936023148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a415aee0 0x7f53a40cf7e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f539c0098e0 tx=0x7f539c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53abd2c700 1 -- 172.21.15.60:0/936023148 shutdown_connections 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53abd2c700 1 --2- 172.21.15.60:0/936023148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a415aee0 0x7f53a40cf7e0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.670+0000 7f53abd2c700 1 --2- 172.21.15.60:0/936023148 >> v2:172.21.15.144:3300/0 conn(0x7f53a4067d70 0x7f53a415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.671+0000 7f53abd2c700 1 -- 172.21.15.60:0/936023148 >> 172.21.15.60:0/936023148 conn(0x7f53a40d0de0 msgr2=0x7f53a40d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.671+0000 7f53abd2c700 1 -- 172.21.15.60:0/936023148 shutdown_connections 2023-10-08T16:11:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.671+0000 7f53abd2c700 1 -- 172.21.15.60:0/936023148 wait complete. 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 Processor -- start 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 -- start start 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 0x7f53a4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a4157b10 0x7f53a414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a415aee0 0x7f53a4152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a415da90 con 0x7f53a4067d70 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40b1700 con 0x7f53a4157b10 2023-10-08T16:11:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.672+0000 7f53abd2c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40b2480 con 0x7f53a415aee0 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 0x7f53a4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 0x7f53a4153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46174/0 (socket says 172.21.15.60:46174) 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 -- 172.21.15.60:0/3325427104 learned_addr learned my addr 172.21.15.60:0/3325427104 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 -- 172.21.15.60:0/3325427104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a415aee0 msgr2=0x7f53a4152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a415aee0 0x7f53a4152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 -- 172.21.15.60:0/3325427104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a4157b10 msgr2=0x7f53a414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a4157b10 0x7f53a414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 -- 172.21.15.60:0/3325427104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009420 con 0x7f53a4067d70 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a9ac8700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 0x7f53a4153090 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f539400cd80 tx=0x7f5394001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400ab10 con 0x7f53a4067d70 2023-10-08T16:11:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539400ac70 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40b19a0 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940070f0 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.673+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a40b1f60 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.674+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a40b2180 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.675+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53940074e0 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.675+0000 7f53a1ffb700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5390066f30 0x7f53900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.675+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5394084960 con 0x7f53a4067d70 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.675+0000 7f53a92c7700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5390066f30 0x7f53900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.676+0000 7f53a92c7700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5390066f30 0x7f53900693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5398006fd0 tx=0x7f5398008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:05.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.679+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5394051db0 con 0x7f53a4067d70 2023-10-08T16:11:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:05.872+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53a404c3c0 con 0x7f53a4067d70 2023-10-08T16:11:06.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.529+0000 7f53a1ffb700 1 -- 172.21.15.60:0/3325427104 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53940553d0 con 0x7f53a4067d70 2023-10-08T16:11:06.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5390066f30 msgr2=0x7f53900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5390066f30 0x7f53900693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5398006fd0 tx=0x7f5398008040 comp rx=0 tx=0).stop 2023-10-08T16:11:06.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 msgr2=0x7f53a4153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 0x7f53a4153090 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f539400cd80 tx=0x7f5394001ae0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 shutdown_connections 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5390066f30 0x7f53900693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53a415aee0 0x7f53a4152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53a4067d70 0x7f53a4153090 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 --2- 172.21.15.60:0/3325427104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a4157b10 0x7f53a414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.532+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 >> 172.21.15.60:0/3325427104 conn(0x7f53a40d0de0 msgr2=0x7f53a41548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.533+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 shutdown_connections 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.533+0000 7f53abd2c700 1 -- 172.21.15.60:0/3325427104 wait complete. 2023-10-08T16:11:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:11:06.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:11:06.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.671+0000 7f523759e700 1 Processor -- start 2023-10-08T16:11:06.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.671+0000 7f523759e700 1 -- start start 2023-10-08T16:11:06.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52380b6580 0x7f523806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 0x7f52380b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523806ac90 con 0x7f52380cce30 2023-10-08T16:11:06.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380b4d70 con 0x7f52380b6580 2023-10-08T16:11:06.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523815b3b0 con 0x7f523806a830 2023-10-08T16:11:06.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f52380cce30 0x7f523815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45886/0 (socket says 172.21.15.60:45886) 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523659c700 1 -- 172.21.15.60:0/2933710622 learned_addr learned my addr 172.21.15.60:0/2933710622 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523517429 0 0) 0x7f5230001490 con 0x7f52380cce30 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f5236d9d700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 0x7f52380b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f5235d9b700 1 --2- 172.21.15.60:0/2933710622 >> v2:172.21.15.144:3300/0 conn(0x7f52380b6580 0x7f523806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.672+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5224003570 con 0x7f52380cce30 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845308260 0 0) 0x7f5224003570 con 0x7f52380cce30 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 msgr2=0x7f52380b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 0x7f52380b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 >> v2:172.21.15.144:3300/0 conn(0x7f52380b6580 msgr2=0x7f523806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 --2- 172.21.15.60:0/2933710622 >> v2:172.21.15.144:3300/0 conn(0x7f52380b6580 0x7f523806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380cd8d0 con 0x7f52380cce30 2023-10-08T16:11:06.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f5230001980 con 0x7f52380cce30 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 >> v1:172.21.15.60:6789/0 conn(0x7f52380cce30 legacy=0x7f523815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224003a60 0x7f5224003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 0x7f5224004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f52240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b4d70 con 0x7f5224004d50 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815b3b0 con 0x7f5224003a60 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522400ba60 con 0x7f523806a830 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f52240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5235d9b700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 0x7f5224004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523659c700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224003a60 0x7f5224003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 -- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 msgr2=0x7f5224004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523806a830 0x7f5224004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 -- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224003a60 msgr2=0x7f5224003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224003a60 0x7f5224003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 -- 172.21.15.60:0/2933710622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224003570 con 0x7f5224004d50 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523659c700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5224003a60 0x7f5224003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f5236d9d700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f52240051c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5228009c00 tx=0x7f52280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f855c589ad007c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800e6b0 con 0x7f5224004d50 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800e810 con 0x7f5224004d50 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.673+0000 7f523559a700 1 -- 172.21.15.60:0/2933710622 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800ebd0 con 0x7f5224004d50 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f523759e700 1 -- 172.21.15.60:0/2933710622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 msgr2=0x7f52240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f523759e700 1 --2- 172.21.15.60:0/2933710622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f52240051c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5228009c00 tx=0x7f52280091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f5236d9d700 1 -- 172.21.15.60:0/2933710622 reap_dead start 2023-10-08T16:11:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f523759e700 1 -- 172.21.15.60:0/2933710622 shutdown_connections 2023-10-08T16:11:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f523759e700 1 -- 172.21.15.60:0/2933710622 >> 172.21.15.60:0/2933710622 conn(0x7f5238068cb0 msgr2=0x7f52380690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f523759e700 1 -- 172.21.15.60:0/2933710622 shutdown_connections 2023-10-08T16:11:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.674+0000 7f523759e700 1 -- 172.21.15.60:0/2933710622 wait complete. 2023-10-08T16:11:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.675+0000 7f523759e700 1 Processor -- start 2023-10-08T16:11:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.675+0000 7f523759e700 1 -- start start 2023-10-08T16:11:06.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f5238151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523814fb70 0x7f52380af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f523815ecf0 0x7f523815f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815f6a0 con 0x7f5224004d50 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52381512e0 con 0x7f523815ecf0 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5238153fb0 con 0x7f523814fb70 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f5238151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f5238151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46182/0 (socket says 172.21.15.60:46182) 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 -- 172.21.15.60:0/3412860525 learned_addr learned my addr 172.21.15.60:0/3412860525 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f5235d9b700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523814fb70 0x7f52380af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f5236d9d700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f523815ecf0 0x7f523815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 -- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523814fb70 msgr2=0x7f52380af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523814fb70 0x7f52380af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 -- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f523815ecf0 msgr2=0x7f523815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f523815ecf0 0x7f523815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 -- 172.21.15.60:0/3412860525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52381533a0 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f5236d9d700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f523815ecf0 0x7f523815f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f523659c700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f5238151d30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5230007c10 tx=0x7f52380b4eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.676+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000ac00 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.677+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230010040 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.677+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5238153640 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.677+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300143f0 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.677+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238151530 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.677+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5238089550 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.678+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5230014820 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.678+0000 7f522e7fc700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.679+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f52300843f0 con 0x7f5224004d50 2023-10-08T16:11:06.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.679+0000 7f5235d9b700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.679+0000 7f5235d9b700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5218066f30 0x7f52180693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f523815b2b0 tx=0x7f52200091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:06.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.683+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5230051960 con 0x7f5224004d50 2023-10-08T16:11:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.878+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f523806ac90 con 0x7f5224004d50 2023-10-08T16:11:06.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.882+0000 7f522e7fc700 1 -- 172.21.15.60:0/3412860525 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f523806ac90 con 0x7f5224004d50 2023-10-08T16:11:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5218066f30 msgr2=0x7f52180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5218066f30 0x7f52180693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f523815b2b0 tx=0x7f52200091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 msgr2=0x7f5238151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f5238151d30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5230007c10 tx=0x7f52380b4eb0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 shutdown_connections 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f523815ecf0 0x7f523815f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5224004d50 0x7f5238151d30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 --2- 172.21.15.60:0/3412860525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f523814fb70 0x7f52380af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 >> 172.21.15.60:0/3412860525 conn(0x7f5238068cb0 msgr2=0x7f5238150460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 shutdown_connections 2023-10-08T16:11:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:06.884+0000 7f523759e700 1 -- 172.21.15.60:0/3412860525 wait complete. 2023-10-08T16:11:06.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-08T16:11:07.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.015+0000 7f1d7759e700 1 Processor -- start 2023-10-08T16:11:07.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.015+0000 7f1d7759e700 1 -- start start 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d780cdab0 0x7f1d7815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d7815dda0 0x7f1d7815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780cb7c0 con 0x7f1d780cd6e0 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7815e850 con 0x7f1d780cdab0 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d780cc360 con 0x7f1d7815dda0 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d75d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d780cdab0 0x7f1d7815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1d780cd6e0 0x7f1d780cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45890/0 (socket says 172.21.15.60:45890) 2023-10-08T16:11:07.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7659c700 1 -- 172.21.15.60:0/4011904294 learned_addr learned my addr 172.21.15.60:0/4011904294 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d76d9d700 1 --2- 172.21.15.60:0/4011904294 >> v2:172.21.15.144:3300/0 conn(0x7f1d7815dda0 0x7f1d7815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d75d9b700 1 -- 172.21.15.60:0/4011904294 >> v2:172.21.15.144:3300/0 conn(0x7f1d7815dda0 msgr2=0x7f1d7815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d75d9b700 1 --2- 172.21.15.60:0/4011904294 >> v2:172.21.15.144:3300/0 conn(0x7f1d7815dda0 0x7f1d7815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d75d9b700 1 -- 172.21.15.60:0/4011904294 >> v1:172.21.15.60:6789/0 conn(0x7f1d780cd6e0 legacy=0x7f1d780cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d75d9b700 1 -- 172.21.15.60:0/4011904294 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7815e290 con 0x7f1d780cdab0 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.016+0000 7f1d7559a700 1 -- 172.21.15.60:0/4011904294 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327020273 0 0) 0x7f1d780cb7c0 con 0x7f1d780cd6e0 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d75d9b700 1 --2- 172.21.15.60:0/4011904294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d7815d860 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f1d780cb730 tx=0x7f1d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f44ee168fc35bd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7559a700 1 -- 172.21.15.60:0/4011904294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000b6b0 con 0x7f1d780cdab0 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7559a700 1 -- 172.21.15.60:0/4011904294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000b810 con 0x7f1d780cdab0 2023-10-08T16:11:07.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7559a700 1 -- 172.21.15.60:0/4011904294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000bbb0 con 0x7f1d780cdab0 2023-10-08T16:11:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 -- 172.21.15.60:0/4011904294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 msgr2=0x7f1d7815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 --2- 172.21.15.60:0/4011904294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d7815d860 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f1d780cb730 tx=0x7f1d600091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 -- 172.21.15.60:0/4011904294 shutdown_connections 2023-10-08T16:11:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 --2- 172.21.15.60:0/4011904294 >> v2:172.21.15.144:3300/0 conn(0x7f1d7815dda0 0x7f1d7815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 --2- 172.21.15.60:0/4011904294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d7815d860 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 -- 172.21.15.60:0/4011904294 >> 172.21.15.60:0/4011904294 conn(0x7f1d78067660 msgr2=0x7f1d78067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 -- 172.21.15.60:0/4011904294 shutdown_connections 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.017+0000 7f1d7759e700 1 -- 172.21.15.60:0/4011904294 wait complete. 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.018+0000 7f1d7759e700 1 Processor -- start 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.018+0000 7f1d7759e700 1 -- start start 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d780cd6e0 0x7f1d780b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d780af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7815dda0 0x7f1d780afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7816b560 con 0x7f1d780cdab0 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780c7d20 con 0x7f1d780cd6e0 2023-10-08T16:11:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780c8000 con 0x7f1d7815dda0 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d75d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d780af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d75d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d780af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46190/0 (socket says 172.21.15.60:46190) 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d75d9b700 1 -- 172.21.15.60:0/2946022794 learned_addr learned my addr 172.21.15.60:0/2946022794 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.019+0000 7f1d7659c700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d780cd6e0 0x7f1d780b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d76d9d700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7815dda0 0x7f1d780afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d75d9b700 1 -- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7815dda0 msgr2=0x7f1d780afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d75d9b700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7815dda0 0x7f1d780afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d75d9b700 1 -- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d780cd6e0 msgr2=0x7f1d780b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d75d9b700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d780cd6e0 0x7f1d780b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d75d9b700 1 -- 172.21.15.60:0/2946022794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60009420 con 0x7f1d780cdab0 2023-10-08T16:11:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d75d9b700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d780af950 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f1d780c7b10 tx=0x7f1d60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60011420 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60011580 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780c82e0 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60011940 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.020+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d780c8ae0 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.021+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d780c8800 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.021+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d60011d30 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.022+0000 7f1d6e7fc700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d58066f30 0x7f1d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.022+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1d60085c90 con 0x7f1d780cdab0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.022+0000 7f1d7659c700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d58066f30 0x7f1d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.022+0000 7f1d7659c700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d58066f30 0x7f1d580693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1d700011e0 tx=0x7f1d70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:07.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.026+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d780c8800 con 0x7f1d780cdab0 2023-10-08T16:11:07.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.310+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f1d780c8800 con 0x7f1d780cdab0 2023-10-08T16:11:07.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.530+0000 7f1d6e7fc700 1 -- 172.21.15.60:0/2946022794 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v318) v1 ==== 128+0+0 (secure 0 0 0) 0x7f1d780c8800 con 0x7f1d780cdab0 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d58066f30 msgr2=0x7f1d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d58066f30 0x7f1d580693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1d700011e0 tx=0x7f1d70009040 comp rx=0 tx=0).stop 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 msgr2=0x7f1d780af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d780af950 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f1d780c7b10 tx=0x7f1d60017000 comp rx=0 tx=0).stop 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 shutdown_connections 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1d58066f30 0x7f1d580693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7815dda0 0x7f1d780afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d780cd6e0 0x7f1d780b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 --2- 172.21.15.60:0/2946022794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d780cdab0 0x7f1d780af950 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 >> 172.21.15.60:0/2946022794 conn(0x7f1d78067660 msgr2=0x7f1d7815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:07.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.532+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 shutdown_connections 2023-10-08T16:11:07.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.533+0000 7f1d7759e700 1 -- 172.21.15.60:0/2946022794 wait complete. 2023-10-08T16:11:07.551 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-08T16:11:07.551 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-08T16:11:07.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-08T16:11:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.670+0000 7f2610f32700 1 Processor -- start 2023-10-08T16:11:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.670+0000 7f2610f32700 1 -- start start 2023-10-08T16:11:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f2610f32700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f260c157870 0x7f260c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f2610f32700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c15cbb0 con 0x7f260c15a620 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f2610f32700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c15bfa0 con 0x7f260c157c40 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f2610f32700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15c280 con 0x7f260c157870 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f260c157870 0x7f260c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f260c157870 0x7f260c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46202/0 (socket says 172.21.15.60:46202) 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f2609d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f260c15a620 0x7f260c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45898/0 (socket says 172.21.15.60:45898) 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 -- 172.21.15.60:0/3102077871 learned_addr learned my addr 172.21.15.60:0/3102077871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 -- 172.21.15.60:0/3102077871 >> v1:172.21.15.144:6789/0 conn(0x7f260c157c40 legacy=0x7f260c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 -- 172.21.15.60:0/3102077871 >> v1:172.21.15.60:6789/0 conn(0x7f260c15a620 legacy=0x7f260c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 -- 172.21.15.60:0/3102077871 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c15c560 con 0x7f260c157870 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260959a700 1 -- 172.21.15.60:0/3102077871 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002114364 0 0) 0x7f260c15cbb0 con 0x7f260c15a620 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.671+0000 7f260a59c700 1 --2- 172.21.15.60:0/3102077871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c15b6a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0099b0 tx=0x7f25fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d539d9313ce08804 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f260959a700 1 -- 172.21.15.60:0/3102077871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00b820 con 0x7f260c157870 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f260959a700 1 -- 172.21.15.60:0/3102077871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc00b980 con 0x7f260c157870 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f260959a700 1 -- 172.21.15.60:0/3102077871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00bd20 con 0x7f260c157870 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 -- 172.21.15.60:0/3102077871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 msgr2=0x7f260c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 --2- 172.21.15.60:0/3102077871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c15b6a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0099b0 tx=0x7f25fc009250 comp rx=0 tx=0).stop 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 -- 172.21.15.60:0/3102077871 shutdown_connections 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 --2- 172.21.15.60:0/3102077871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c15b6a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 -- 172.21.15.60:0/3102077871 >> 172.21.15.60:0/3102077871 conn(0x7f260c068ce0 msgr2=0x7f260c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:07.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 -- 172.21.15.60:0/3102077871 shutdown_connections 2023-10-08T16:11:07.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.672+0000 7f2610f32700 1 -- 172.21.15.60:0/3102077871 wait complete. 2023-10-08T16:11:07.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.673+0000 7f2610f32700 1 Processor -- start 2023-10-08T16:11:07.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.673+0000 7f2610f32700 1 -- start start 2023-10-08T16:11:07.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2610f32700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2610f32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c157c40 0x7f260c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2610f32700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c15a620 0x7f260c152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2610f32700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c14da40 con 0x7f260c157870 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2610f32700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c14e2e0 con 0x7f260c15a620 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2610f32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c153b10 con 0x7f260c157c40 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46210/0 (socket says 172.21.15.60:46210) 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 -- 172.21.15.60:0/3231015797 learned_addr learned my addr 172.21.15.60:0/3231015797 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260ad9d700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c15a620 0x7f260c152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f2609d9b700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c157c40 0x7f260c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 -- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c157c40 msgr2=0x7f260c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c157c40 0x7f260c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 -- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c15a620 msgr2=0x7f260c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c15a620 0x7f260c152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260a59c700 1 -- 172.21.15.60:0/3231015797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0094f0 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.674+0000 7f260ad9d700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c15a620 0x7f260c152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.675+0000 7f260a59c700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c150160 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009290 tx=0x7f25fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.675+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc01b470 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.675+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc01b5f0 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.675+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c14dc90 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.675+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc01b9b0 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.675+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c153320 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.676+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c04c3c0 con 0x7f260c157870 2023-10-08T16:11:07.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.676+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25fc01bd20 con 0x7f260c157870 2023-10-08T16:11:07.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.676+0000 7f25fa7fc700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f25ec066f30 0x7f25ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:07.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.677+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f25fc085fc0 con 0x7f260c157870 2023-10-08T16:11:07.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.677+0000 7f2609d9b700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f25ec066f30 0x7f25ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:07.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.677+0000 7f2609d9b700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f25ec066f30 0x7f25ec0693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f260c0afa70 tx=0x7f2600007d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:07.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.681+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25fc0b75a0 con 0x7f260c157870 2023-10-08T16:11:07.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:07.955+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f260c15c840 con 0x7f260c157870 2023-10-08T16:11:08.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.530+0000 7f25fa7fc700 1 -- 172.21.15.60:0/3231015797 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v319) v1 ==== 143+0+0 (secure 0 0 0) 0x7f25fc02a0d0 con 0x7f260c157870 2023-10-08T16:11:08.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f25ec066f30 msgr2=0x7f25ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f25ec066f30 0x7f25ec0693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f260c0afa70 tx=0x7f2600007d80 comp rx=0 tx=0).stop 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 msgr2=0x7f260c150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c150160 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009290 tx=0x7f25fc016000 comp rx=0 tx=0).stop 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 shutdown_connections 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f25ec066f30 0x7f25ec0693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c15a620 0x7f260c152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c157870 0x7f260c150160 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 --2- 172.21.15.60:0/3231015797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c157c40 0x7f260c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 >> 172.21.15.60:0/3231015797 conn(0x7f260c068ce0 msgr2=0x7f260c0d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 shutdown_connections 2023-10-08T16:11:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.533+0000 7f2610f32700 1 -- 172.21.15.60:0/3231015797 wait complete. 2023-10-08T16:11:08.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:11:08.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.673+0000 7fa008cec700 1 Processor -- start 2023-10-08T16:11:08.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.673+0000 7fa008cec700 1 -- start start 2023-10-08T16:11:08.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa008cec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 0x7fa00406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa008cec700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040b2a00 con 0x7fa004157980 2023-10-08T16:11:08.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa008cec700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00406f290 con 0x7fa00415b6b0 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa008cec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b1df0 con 0x7fa00406e920 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa0037fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa004157980 0x7fa0040b1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45906/0 (socket says 172.21.15.60:45906) 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa0037fe700 1 -- 172.21.15.60:0/1190689430 learned_addr learned my addr 172.21.15.60:0/1190689430 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.674+0000 7fa002ffd700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 0x7fa00406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536356397 0 0) 0x7fa0040b2a00 con 0x7fa004157980 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec003570 con 0x7fa004157980 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445878669 0 0) 0x7fa00406f290 con 0x7fa00415b6b0 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0040b2a00 con 0x7fa00415b6b0 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698800004 0 0) 0x7f9fec003570 con 0x7fa004157980 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 msgr2=0x7fa00406ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 0x7fa00406ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 >> v1:172.21.15.144:6789/0 conn(0x7fa00415b6b0 legacy=0x7fa00415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040b20d0 con 0x7fa004157980 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f9ff4001470 con 0x7fa004157980 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 >> v1:172.21.15.60:6789/0 conn(0x7fa004157980 legacy=0x7fa0040b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 0x7f9fec003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fec0041d0 0x7f9fec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fec004d50 0x7f9fec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b1df0 con 0x7f9fec004d50 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec00bbf0 con 0x7f9fec0041d0 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec00bdb0 con 0x7fa00406e920 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa003fff700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fec004d50 0x7f9fec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa0037fe700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 0x7f9fec003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa002ffd700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fec0041d0 0x7f9fec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa003fff700 1 -- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 msgr2=0x7f9fec003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa003fff700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa00406e920 0x7f9fec003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa003fff700 1 -- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fec0041d0 msgr2=0x7f9fec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa003fff700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fec0041d0 0x7f9fec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.675+0000 7fa003fff700 1 -- 172.21.15.60:0/1190689430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec003570 con 0x7f9fec004d50 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa003fff700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fec004d50 0x7f9fec0051c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc002120 tx=0x7f9ffc0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7e6a686b02c88 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc001ab0 con 0x7f9fec004d50 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00c980 con 0x7f9fec004d50 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa0027fc700 1 -- 172.21.15.60:0/1190689430 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00cd20 con 0x7f9fec004d50 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa008cec700 1 -- 172.21.15.60:0/1190689430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fec004d50 msgr2=0x7f9fec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa008cec700 1 --2- 172.21.15.60:0/1190689430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fec004d50 0x7f9fec0051c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc002120 tx=0x7f9ffc0017a0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa003fff700 1 -- 172.21.15.60:0/1190689430 reap_dead start 2023-10-08T16:11:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa008cec700 1 -- 172.21.15.60:0/1190689430 shutdown_connections 2023-10-08T16:11:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa008cec700 1 -- 172.21.15.60:0/1190689430 >> 172.21.15.60:0/1190689430 conn(0x7fa004068130 msgr2=0x7fa0040cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa008cec700 1 -- 172.21.15.60:0/1190689430 shutdown_connections 2023-10-08T16:11:08.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.676+0000 7fa008cec700 1 -- 172.21.15.60:0/1190689430 wait complete. 2023-10-08T16:11:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 Processor -- start 2023-10-08T16:11:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 -- start start 2023-10-08T16:11:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 0x7fa0040c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0041542a0 0x7fa0040c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0040aeae0 0x7fa0040aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004098f90 con 0x7fa004153ed0 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004098380 con 0x7fa0041542a0 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa008cec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa004098660 con 0x7fa0040aeae0 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa0037fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 0x7fa0040c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa0037fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 0x7fa0040c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46218/0 (socket says 172.21.15.60:46218) 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.678+0000 7fa0037fe700 1 -- 172.21.15.60:0/2314368723 learned_addr learned my addr 172.21.15.60:0/2314368723 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa002ffd700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0041542a0 0x7fa0040c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa003fff700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0040aeae0 0x7fa0040aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa0037fe700 1 -- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0040aeae0 msgr2=0x7fa0040aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa0037fe700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0040aeae0 0x7fa0040aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa0037fe700 1 -- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0041542a0 msgr2=0x7fa0040c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa0037fe700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0041542a0 0x7fa0040c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa0037fe700 1 -- 172.21.15.60:0/2314368723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004098940 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa002ffd700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0041542a0 0x7fa0040c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa0037fe700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 0x7fa0040c1e30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4007160 tx=0x7fa00415a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4018030 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400f630 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400f9f0 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa004098c20 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.679+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0040af490 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.680+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00404c3c0 con 0x7fa004153ed0 2023-10-08T16:11:08.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.681+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ff401b070 con 0x7fa004153ed0 2023-10-08T16:11:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.681+0000 7f9feb7fe700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.681+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ff4019070 con 0x7fa004153ed0 2023-10-08T16:11:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.681+0000 7fa002ffd700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.681+0000 7fa002ffd700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa0040982b0 tx=0x7f9ff8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:08.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.685+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ff40515d0 con 0x7fa004153ed0 2023-10-08T16:11:08.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.876+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa00406f9d0 con 0x7fa004153ed0 2023-10-08T16:11:08.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.881+0000 7f9feb7fe700 1 -- 172.21.15.60:0/2314368723 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9ff4054bf0 con 0x7fa004153ed0 2023-10-08T16:11:08.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 msgr2=0x7f9ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa0040982b0 tx=0x7f9ff8008040 comp rx=0 tx=0).stop 2023-10-08T16:11:08.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 msgr2=0x7fa0040c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 0x7fa0040c1e30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4007160 tx=0x7fa00415a4e0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 shutdown_connections 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9ff0066f30 0x7f9ff00693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0040aeae0 0x7fa0040aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa004153ed0 0x7fa0040c1e30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 --2- 172.21.15.60:0/2314368723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0041542a0 0x7fa0040c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 >> 172.21.15.60:0/2314368723 conn(0x7fa004068130 msgr2=0x7fa0041552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 shutdown_connections 2023-10-08T16:11:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:08.883+0000 7fa008cec700 1 -- 172.21.15.60:0/2314368723 wait complete. 2023-10-08T16:11:08.896 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:11:08.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:11:08.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:11:08.991 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:11:08.991 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:11:08.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:09.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.110+0000 7f8984f3c700 1 Processor -- start 2023-10-08T16:11:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.110+0000 7f8984f3c700 1 -- start start 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f8984f3c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f89800cfe20 0x7f89800ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f8984f3c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c5d80 con 0x7f898015a2b0 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f8984f3c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c6060 con 0x7f89800d1c30 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f8984f3c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8980068470 con 0x7f89800cfe20 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f897ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f89800cfe20 0x7f89800ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f897e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f898015a2b0 0x7f89800b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45922/0 (socket says 172.21.15.60:45922) 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.111+0000 7f897e59c700 1 -- 172.21.15.60:0/314947153 learned_addr learned my addr 172.21.15.60:0/314947153 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897ed9d700 1 -- 172.21.15.60:0/314947153 >> v1:172.21.15.144:6789/0 conn(0x7f89800d1c30 legacy=0x7f89800cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897ed9d700 1 -- 172.21.15.60:0/314947153 >> v1:172.21.15.60:6789/0 conn(0x7f898015a2b0 legacy=0x7f89800b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897d59a700 1 -- 172.21.15.60:0/314947153 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619840085 0 0) 0x7f89800c5d80 con 0x7f898015a2b0 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897ed9d700 1 -- 172.21.15.60:0/314947153 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800c6340 con 0x7f89800cfe20 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897ed9d700 1 --2- 172.21.15.60:0/314947153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800cfe20 0x7f89800ccdd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f89780098e0 tx=0x7f89780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf380ed995e439 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897d59a700 1 -- 172.21.15.60:0/314947153 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978009e80 con 0x7f89800cfe20 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897d59a700 1 -- 172.21.15.60:0/314947153 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800b820 con 0x7f89800cfe20 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f897d59a700 1 -- 172.21.15.60:0/314947153 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bba0 con 0x7f89800cfe20 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f8984f3c700 1 -- 172.21.15.60:0/314947153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800cfe20 msgr2=0x7f89800ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.112+0000 7f8984f3c700 1 --2- 172.21.15.60:0/314947153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800cfe20 0x7f89800ccdd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f89780098e0 tx=0x7f89780091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.113+0000 7f8984f3c700 1 -- 172.21.15.60:0/314947153 shutdown_connections 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.113+0000 7f8984f3c700 1 --2- 172.21.15.60:0/314947153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800cfe20 0x7f89800ccdd0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.113+0000 7f8984f3c700 1 -- 172.21.15.60:0/314947153 >> 172.21.15.60:0/314947153 conn(0x7f8980067e40 msgr2=0x7f89800d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.113+0000 7f8984f3c700 1 -- 172.21.15.60:0/314947153 shutdown_connections 2023-10-08T16:11:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.113+0000 7f8984f3c700 1 -- 172.21.15.60:0/314947153 wait complete. 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 Processor -- start 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 -- start start 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89800cfe20 0x7f8980146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 0x7f89800c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f898015a2b0 0x7f89800c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898016e520 con 0x7f89800d1c30 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800c9bd0 con 0x7f898015a2b0 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.114+0000 7f8984f3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800c9eb0 con 0x7f89800cfe20 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 0x7f89800c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 0x7f89800c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46238/0 (socket says 172.21.15.60:46238) 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 -- 172.21.15.60:0/2612468684 learned_addr learned my addr 172.21.15.60:0/2612468684 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897ed9d700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f898015a2b0 0x7f89800c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897e59c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89800cfe20 0x7f8980146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 -- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89800cfe20 msgr2=0x7f8980146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89800cfe20 0x7f8980146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 -- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f898015a2b0 msgr2=0x7f89800c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f898015a2b0 0x7f89800c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 -- 172.21.15.60:0/2612468684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009420 con 0x7f89800d1c30 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897ed9d700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f898015a2b0 0x7f89800c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f897dd9b700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 0x7f89800c9060 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f896800b5e0 tx=0x7f89680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800f510 con 0x7f89800d1c30 2023-10-08T16:11:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800f6b0 con 0x7f89800d1c30 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89800ca190 con 0x7f89800d1c30 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800fa70 con 0x7f89800d1c30 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.115+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89800ca750 con 0x7f89800d1c30 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.116+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89800ca940 con 0x7f89800d1c30 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.117+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f896801a400 con 0x7f89800d1c30 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.117+0000 7f89767fc700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8960066f30 0x7f89600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.117+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8968083d80 con 0x7f89800d1c30 2023-10-08T16:11:09.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.117+0000 7f897e59c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8960066f30 0x7f89600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.117+0000 7f897e59c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8960066f30 0x7f89600693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8970001de0 tx=0x7f8970009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:09.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.121+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8968051370 con 0x7f89800d1c30 2023-10-08T16:11:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.357+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f898004c3c0 con 0x7f89800d1c30 2023-10-08T16:11:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.357+0000 7f89767fc700 1 -- 172.21.15.60:0/2612468684 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f8968054990 con 0x7f89800d1c30 2023-10-08T16:11:09.358 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:09.358 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/700814688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":700814688},{"type":"v1","addr":"172.21.15.144:6834","nonce":700814688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3955364969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3955364969},{"type":"v1","addr":"172.21.15.60:6836","nonce":3955364969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2270595707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":2270595707},{"type":"v1","addr":"172.21.15.144:6835","nonce":2270595707}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1532649485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1532649485},{"type":"v1","addr":"172.21.15.60:6837","nonce":1532649485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8960066f30 msgr2=0x7f89600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8960066f30 0x7f89600693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8970001de0 tx=0x7f8970009040 comp rx=0 tx=0).stop 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 msgr2=0x7f89800c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 0x7f89800c9060 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f896800b5e0 tx=0x7f89680090f0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 shutdown_connections 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8960066f30 0x7f89600693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89800cfe20 0x7f8980146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f898015a2b0 0x7f89800c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 --2- 172.21.15.60:0/2612468684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89800d1c30 0x7f89800c9060 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.359+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 >> 172.21.15.60:0/2612468684 conn(0x7f8980067e40 msgr2=0x7f89800cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.360+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 shutdown_connections 2023-10-08T16:11:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.360+0000 7f8984f3c700 1 -- 172.21.15.60:0/2612468684 wait complete. 2023-10-08T16:11:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 62 2023-10-08T16:11:09.372 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:11:09.372 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:11:09.373 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:11:09.373 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:09.373 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:11:09.373 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:11:09.373 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:11:09.373 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:09.373 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:11:09.373 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:11:09.374 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:11:09.374 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:09.374 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:11:09.374 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:11:09.374 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:11:09.374 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:09.381 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:11:09.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:11:09.382 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:11:09.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:11:09.384 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:11:09.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:11:09.385 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:11:09.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:11:09.424 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:11:09.425 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:09.426 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:11:09.426 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:09.427 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:11:09.427 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:09.427 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:11:09.427 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:09.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:11:09.500 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:11:09.501 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:11:09.506 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:11:09.507 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:11:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.555+0000 7f92736d4700 1 Processor -- start 2023-10-08T16:11:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.555+0000 7f92736d4700 1 -- start start 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f92736d4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f926c0d1c30 0x7f926c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f92736d4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0c5d80 con 0x7f926c15a2b0 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f92736d4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0c6060 con 0x7f926c15a680 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f92736d4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c068470 con 0x7f926c0d1c30 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9270c6f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f926c0d1c30 0x7f926c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9271470700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f926c15a2b0 0x7f926c0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45932/0 (socket says 172.21.15.60:45932) 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9271470700 1 -- 172.21.15.60:0/4246686248 learned_addr learned my addr 172.21.15.60:0/4246686248 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9270c6f700 1 -- 172.21.15.60:0/4246686248 >> v1:172.21.15.144:6789/0 conn(0x7f926c15a680 legacy=0x7f926c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9270c6f700 1 -- 172.21.15.60:0/4246686248 >> v1:172.21.15.60:6789/0 conn(0x7f926c15a2b0 legacy=0x7f926c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9270c6f700 1 -- 172.21.15.60:0/4246686248 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0c6340 con 0x7f926c0d1c30 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f9270c6f700 1 --2- 172.21.15.60:0/4246686248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c0d1c30 0x7f926c0ccdd0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f92600098e0 tx=0x7f92600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02141610e14de9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f926bfff700 1 -- 172.21.15.60:0/4246686248 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260009e80 con 0x7f926c0d1c30 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f926bfff700 1 -- 172.21.15.60:0/4246686248 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926000b860 con 0x7f926c0d1c30 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.556+0000 7f926bfff700 1 -- 172.21.15.60:0/4246686248 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926000bbe0 con 0x7f926c0d1c30 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 -- 172.21.15.60:0/4246686248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c0d1c30 msgr2=0x7f926c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 --2- 172.21.15.60:0/4246686248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c0d1c30 0x7f926c0ccdd0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f92600098e0 tx=0x7f92600091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 -- 172.21.15.60:0/4246686248 shutdown_connections 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 --2- 172.21.15.60:0/4246686248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c0d1c30 0x7f926c0ccdd0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 -- 172.21.15.60:0/4246686248 >> 172.21.15.60:0/4246686248 conn(0x7f926c067e40 msgr2=0x7f926c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 -- 172.21.15.60:0/4246686248 shutdown_connections 2023-10-08T16:11:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.557+0000 7f92736d4700 1 -- 172.21.15.60:0/4246686248 wait complete. 2023-10-08T16:11:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.558+0000 7f92736d4700 1 Processor -- start 2023-10-08T16:11:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.558+0000 7f92736d4700 1 -- start start 2023-10-08T16:11:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f92736d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f926c0d1c30 0x7f926c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f92736d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f926c15a2b0 0x7f926c15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f92736d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 0x7f926c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f92736d4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ca240 con 0x7f926c15a680 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f92736d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ca490 con 0x7f926c15a2b0 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f92736d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ca770 con 0x7f926c0d1c30 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f9271c71700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 0x7f926c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f9271c71700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 0x7f926c0cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46268/0 (socket says 172.21.15.60:46268) 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f9271c71700 1 -- 172.21.15.60:0/317021945 learned_addr learned my addr 172.21.15.60:0/317021945 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f9270c6f700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f926c15a2b0 0x7f926c15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.559+0000 7f9271470700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f926c0d1c30 0x7f926c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271c71700 1 -- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f926c0d1c30 msgr2=0x7f926c15ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271c71700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f926c0d1c30 0x7f926c15ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271c71700 1 -- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f926c15a2b0 msgr2=0x7f926c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271c71700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f926c15a2b0 0x7f926c15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271c71700 1 -- 172.21.15.60:0/317021945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260009420 con 0x7f926c15a680 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271470700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f926c0d1c30 0x7f926c15ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f9271c71700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 0x7f926c0cda50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f926400c4c0 tx=0x7f9264007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011590 con 0x7f926c15a680 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264011710 con 0x7f926c15a680 2023-10-08T16:11:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011ad0 con 0x7f926c15a680 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c0caa50 con 0x7f926c15a680 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.560+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c155ce0 con 0x7f926c15a680 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.561+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c15ab30 con 0x7f926c15a680 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.561+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f926401b3b0 con 0x7f926c15a680 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.562+0000 7f92697fa700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.562+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9264083610 con 0x7f926c15a680 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.562+0000 7f9271470700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.562+0000 7f9271470700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9258066f30 0x7f92580693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f925c007fd0 tx=0x7f925c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:09.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.566+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f926c15ab30 con 0x7f926c15a680 2023-10-08T16:11:09.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:09.775+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f926c15ab30 con 0x7f926c15a680 2023-10-08T16:11:10.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.550+0000 7f92697fa700 1 -- 172.21.15.60:0/317021945 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v128) v1 ==== 97+0+0 (secure 0 0 0) 0x7f926c15ab30 con 0x7f926c15a680 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9258066f30 msgr2=0x7f92580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9258066f30 0x7f92580693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f925c007fd0 tx=0x7f925c009040 comp rx=0 tx=0).stop 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 msgr2=0x7f926c0cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 0x7f926c0cda50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f926400c4c0 tx=0x7f9264007f50 comp rx=0 tx=0).stop 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 shutdown_connections 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f926c0d1c30 0x7f926c15ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c15a680 0x7f926c0cda50 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 --2- 172.21.15.60:0/317021945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f926c15a2b0 0x7f926c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 >> 172.21.15.60:0/317021945 conn(0x7f926c067e40 msgr2=0x7f926c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 shutdown_connections 2023-10-08T16:11:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.552+0000 7f92736d4700 1 -- 172.21.15.60:0/317021945 wait complete. 2023-10-08T16:11:10.591 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:11:10.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:11:10.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.713+0000 7fae321a0700 1 Processor -- start 2023-10-08T16:11:10.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.713+0000 7fae321a0700 1 -- start start 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae321a0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 0x7fae2c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae321a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 0x7fae2c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae321a0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c15a730 con 0x7fae2c0cc240 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae321a0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0ae320 con 0x7fae2c159f10 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae321a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0ad710 con 0x7fae2c15a2e0 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae3099d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 0x7fae2c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae3119e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 0x7fae2c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.714+0000 7fae3199f700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fae2c0cc240 0x7fae2c0ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:51264/0 (socket says 172.21.15.60:51264) 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3119e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 0x7fae2c0c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:42764/0 (socket says 172.21.15.60:42764) 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3199f700 1 -- 172.21.15.60:0/3578720755 learned_addr learned my addr 172.21.15.60:0/3578720755 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3099d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 0x7fae2c0cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:54100/0 (socket says 172.21.15.60:54100) 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3099d700 1 -- 172.21.15.60:0/3578720755 >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 msgr2=0x7fae2c0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3099d700 1 --2- 172.21.15.60:0/3578720755 >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 0x7fae2c0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3099d700 1 -- 172.21.15.60:0/3578720755 >> v1:172.21.15.144:6789/0 conn(0x7fae2c0cc240 legacy=0x7fae2c0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3099d700 1 -- 172.21.15.60:0/3578720755 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0ad9f0 con 0x7fae2c15a2e0 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3119e700 1 --2- 172.21.15.60:0/3578720755 >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 0x7fae2c0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae3099d700 1 --2- 172.21.15.60:0/3578720755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 0x7fae2c0cbd00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae200098e0 tx=0x7fae200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c269726ca80bf0c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae2bfff700 1 -- 172.21.15.60:0/3578720755 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000b640 con 0x7fae2c15a2e0 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae2bfff700 1 -- 172.21.15.60:0/3578720755 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000b7a0 con 0x7fae2c15a2e0 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.715+0000 7fae2bfff700 1 -- 172.21.15.60:0/3578720755 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000bb40 con 0x7fae2c15a2e0 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 -- 172.21.15.60:0/3578720755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 msgr2=0x7fae2c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 --2- 172.21.15.60:0/3578720755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 0x7fae2c0cbd00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae200098e0 tx=0x7fae200091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 -- 172.21.15.60:0/3578720755 shutdown_connections 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 --2- 172.21.15.60:0/3578720755 >> v2:172.21.15.144:3300/0 conn(0x7fae2c159f10 0x7fae2c0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 --2- 172.21.15.60:0/3578720755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c15a2e0 0x7fae2c0cbd00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 -- 172.21.15.60:0/3578720755 >> 172.21.15.60:0/3578720755 conn(0x7fae2c067e40 msgr2=0x7fae2c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 -- 172.21.15.60:0/3578720755 shutdown_connections 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.716+0000 7fae321a0700 1 -- 172.21.15.60:0/3578720755 wait complete. 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.717+0000 7fae321a0700 1 Processor -- start 2023-10-08T16:11:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.717+0000 7fae321a0700 1 -- start start 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae321a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c0cc240 0x7fae2c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae321a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae2c159f10 0x7fae2c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae321a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 0x7fae2c153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae321a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c8230 con 0x7fae2c15a2e0 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae321a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c8490 con 0x7fae2c159f10 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae321a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c8770 con 0x7fae2c0cc240 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 0x7fae2c153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 0x7fae2c153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46278/0 (socket says 172.21.15.60:46278) 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 -- 172.21.15.60:0/1800858993 learned_addr learned my addr 172.21.15.60:0/1800858993 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3119e700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c0cc240 0x7fae2c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3099d700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae2c159f10 0x7fae2c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:10.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 -- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c0cc240 msgr2=0x7fae2c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c0cc240 0x7fae2c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 -- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae2c159f10 msgr2=0x7fae2c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae2c159f10 0x7fae2c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.718+0000 7fae3199f700 1 -- 172.21.15.60:0/1800858993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c009a20 con 0x7fae2c15a2e0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.719+0000 7fae3199f700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 0x7fae2c153bb0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c590 tx=0x7fae24007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.719+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24005b30 con 0x7fae2c15a2e0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.719+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae24005cb0 con 0x7fae2c15a2e0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.719+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae20009420 con 0x7fae2c15a2e0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.719+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24007320 con 0x7fae2c15a2e0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.719+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c0c8d30 con 0x7fae2c15a2e0 2023-10-08T16:11:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.720+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c089300 con 0x7fae2c15a2e0 2023-10-08T16:11:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.720+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae2401b3b0 con 0x7fae2c15a2e0 2023-10-08T16:11:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.721+0000 7fae297fa700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae18066f30 0x7fae180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.721+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fae24083430 con 0x7fae2c15a2e0 2023-10-08T16:11:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.721+0000 7fae3119e700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae18066f30 0x7fae180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.721+0000 7fae3119e700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae18066f30 0x7fae180693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009fd0 tx=0x7fae1c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:10.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.725+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae240509f0 con 0x7fae2c15a2e0 2023-10-08T16:11:10.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.993+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fae2c15a730 con 0x7fae2c15a2e0 2023-10-08T16:11:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.994+0000 7fae297fa700 1 -- 172.21.15.60:0/1800858993 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fae2c15a730 con 0x7fae2c15a2e0 2023-10-08T16:11:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:11.022 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:11:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:11:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:11:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.048 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:11:11.049 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.050 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.053 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:11:11.054 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:11.056 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:11.056 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:11.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae18066f30 msgr2=0x7fae180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae18066f30 0x7fae180693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009fd0 tx=0x7fae1c00b040 comp rx=0 tx=0).stop 2023-10-08T16:11:11.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 msgr2=0x7fae2c153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 0x7fae2c153bb0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c590 tx=0x7fae24007ef0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 shutdown_connections 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fae18066f30 0x7fae180693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae2c0cc240 0x7fae2c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae2c15a2e0 0x7fae2c153bb0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 --2- 172.21.15.60:0/1800858993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae2c159f10 0x7fae2c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 >> 172.21.15.60:0/1800858993 conn(0x7fae2c067e40 msgr2=0x7fae2c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 shutdown_connections 2023-10-08T16:11:11.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:10.996+0000 7fae321a0700 1 -- 172.21.15.60:0/1800858993 wait complete. 2023-10-08T16:11:11.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:11.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.177+0000 7fa44ce88700 1 Processor -- start 2023-10-08T16:11:11.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.177+0000 7fa44ce88700 1 -- start start 2023-10-08T16:11:11.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa44ce88700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa448159e10 0x7fa4480b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa44ce88700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa44815a1e0 0x7fa4480b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa44ce88700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44815db80 con 0x7fa4480b1610 2023-10-08T16:11:11.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa44ce88700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44815e800 con 0x7fa44815a1e0 2023-10-08T16:11:11.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa44ce88700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44815de60 con 0x7fa448159e10 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa445d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa44815a1e0 0x7fa4480b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.178+0000 7fa445d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa44815a1e0 0x7fa4480b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46290/0 (socket says 172.21.15.60:46290) 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa445d9b700 1 -- 172.21.15.60:0/2847872664 learned_addr learned my addr 172.21.15.60:0/2847872664 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa445d9b700 1 -- 172.21.15.60:0/2847872664 >> v2:172.21.15.144:3300/0 conn(0x7fa448159e10 msgr2=0x7fa4480b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa44659c700 1 --2- 172.21.15.60:0/2847872664 >> v2:172.21.15.144:3300/0 conn(0x7fa448159e10 0x7fa4480b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa445d9b700 1 --2- 172.21.15.60:0/2847872664 >> v2:172.21.15.144:3300/0 conn(0x7fa448159e10 0x7fa4480b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa445d9b700 1 -- 172.21.15.60:0/2847872664 >> v1:172.21.15.144:6789/0 conn(0x7fa4480b1610 legacy=0x7fa4480cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa445d9b700 1 -- 172.21.15.60:0/2847872664 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44815e140 con 0x7fa44815a1e0 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa445d9b700 1 --2- 172.21.15.60:0/2847872664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44815a1e0 0x7fa4480b3260 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa448068a60 tx=0x7fa430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb095fdf7cc875dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa44559a700 1 -- 172.21.15.60:0/2847872664 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000b820 con 0x7fa44815a1e0 2023-10-08T16:11:11.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa44559a700 1 -- 172.21.15.60:0/2847872664 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000b980 con 0x7fa44815a1e0 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.179+0000 7fa44559a700 1 -- 172.21.15.60:0/2847872664 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000bd20 con 0x7fa44815a1e0 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 -- 172.21.15.60:0/2847872664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44815a1e0 msgr2=0x7fa4480b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 --2- 172.21.15.60:0/2847872664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44815a1e0 0x7fa4480b3260 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa448068a60 tx=0x7fa430009250 comp rx=0 tx=0).stop 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 -- 172.21.15.60:0/2847872664 shutdown_connections 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 --2- 172.21.15.60:0/2847872664 >> v2:172.21.15.144:3300/0 conn(0x7fa448159e10 0x7fa4480b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 --2- 172.21.15.60:0/2847872664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44815a1e0 0x7fa4480b3260 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 -- 172.21.15.60:0/2847872664 >> 172.21.15.60:0/2847872664 conn(0x7fa448067660 msgr2=0x7fa448067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 -- 172.21.15.60:0/2847872664 shutdown_connections 2023-10-08T16:11:11.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.180+0000 7fa44ce88700 1 -- 172.21.15.60:0/2847872664 wait complete. 2023-10-08T16:11:11.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.181+0000 7fa44ce88700 1 Processor -- start 2023-10-08T16:11:11.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.181+0000 7fa44ce88700 1 -- start start 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 0x7fa4480ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa448159e10 0x7fa4480cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa44815a1e0 0x7fa4480d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480cf780 con 0x7fa4480b1610 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480ca840 con 0x7fa448159e10 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480ceb70 con 0x7fa44815a1e0 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 0x7fa4480ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 0x7fa4480ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46294/0 (socket says 172.21.15.60:46294) 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 -- 172.21.15.60:0/3833008642 learned_addr learned my addr 172.21.15.60:0/3833008642 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:11.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa445d9b700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa448159e10 0x7fa4480cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa446d9d700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa44815a1e0 0x7fa4480d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 -- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa44815a1e0 msgr2=0x7fa4480d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa44815a1e0 0x7fa4480d0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 -- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa448159e10 msgr2=0x7fa4480cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa448159e10 0x7fa4480cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 -- 172.21.15.60:0/3833008642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300094f0 con 0x7fa4480b1610 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44659c700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 0x7fa4480ca300 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa440007fc0 tx=0x7fa4400078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000ae60 con 0x7fa4480b1610 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440016430 con 0x7fa4480b1610 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480cee50 con 0x7fa4480b1610 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.182+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400167d0 con 0x7fa4480b1610 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.183+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480cf410 con 0x7fa4480b1610 2023-10-08T16:11:11.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.183+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4480cfa60 con 0x7fa4480b1610 2023-10-08T16:11:11.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.184+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa440003020 con 0x7fa4480b1610 2023-10-08T16:11:11.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.184+0000 7fa43e7fc700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.184+0000 7fa445d9b700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.184+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa440012070 con 0x7fa4480b1610 2023-10-08T16:11:11.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.185+0000 7fa445d9b700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa428066f30 0x7fa4280693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa448068a60 tx=0x7fa430016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.189+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa440052670 con 0x7fa4480b1610 2023-10-08T16:11:11.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.382+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44804c3c0 con 0x7fa4480b1610 2023-10-08T16:11:11.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.383+0000 7fa43e7fc700 1 -- 172.21.15.60:0/3833008642 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+12145 (secure 0 0 0) 0x7fa440055c90 con 0x7fa4480b1610 2023-10-08T16:11:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:11.384 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":128,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:10.542066+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:11.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa428066f30 msgr2=0x7fa4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa428066f30 0x7fa4280693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa448068a60 tx=0x7fa430016000 comp rx=0 tx=0).stop 2023-10-08T16:11:11.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 msgr2=0x7fa4480ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 0x7fa4480ca300 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa440007fc0 tx=0x7fa4400078b0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 shutdown_connections 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa44815a1e0 0x7fa4480d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4480b1610 0x7fa4480ca300 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 --2- 172.21.15.60:0/3833008642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa448159e10 0x7fa4480cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 >> 172.21.15.60:0/3833008642 conn(0x7fa448067660 msgr2=0x7fa4481592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 shutdown_connections 2023-10-08T16:11:11.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.385+0000 7fa44ce88700 1 -- 172.21.15.60:0/3833008642 wait complete. 2023-10-08T16:11:11.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:11:11.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:11:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.520+0000 7f3d1474e700 1 Processor -- start 2023-10-08T16:11:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.520+0000 7f3d1474e700 1 -- start start 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d1474e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d0c0cd300 0x7f3d0c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d1474e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c1513f0 con 0x7f3d0c0d1470 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d1474e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c15db20 con 0x7f3d0c0b6760 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d1474e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c15e7a0 con 0x7f3d0c0cd300 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d12ceb700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3d0c0d1470 0x7f3d0c0cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45934/0 (socket says 172.21.15.60:45934) 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d12ceb700 1 -- 172.21.15.60:0/1713499379 learned_addr learned my addr 172.21.15.60:0/1713499379 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1713499379 >> v2:172.21.15.144:3300/0 conn(0x7f3d0c0cd300 0x7f3d0c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248196890 0 0) 0x7f3d0c1513f0 con 0x7f3d0c0d1470 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf4003570 con 0x7f3d0c0d1470 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 779732444 0 0) 0x7f3cf4003570 con 0x7f3d0c0d1470 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 >> v2:172.21.15.144:3300/0 conn(0x7f3d0c0cd300 msgr2=0x7f3d0c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 --2- 172.21.15.60:0/1713499379 >> v2:172.21.15.144:3300/0 conn(0x7f3d0c0cd300 0x7f3d0c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 >> v1:172.21.15.144:6789/0 conn(0x7f3d0c0b6760 legacy=0x7f3d0c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c15de00 con 0x7f3d0c0d1470 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f3cfc001470 con 0x7f3d0c0d1470 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 >> v1:172.21.15.60:6789/0 conn(0x7f3d0c0d1470 legacy=0x7f3d0c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c15e7a0 con 0x7f3cf4003a60 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf400c050 con 0x7f3cf4004810 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.521+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf400c210 con 0x7f3cf40051c0 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d11ce9700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d12ceb700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 -- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40051c0 msgr2=0x7f3cf400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 -- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf4004810 msgr2=0x7f3cf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 -- 172.21.15.60:0/1713499379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4003570 con 0x7f3cf4003a60 2023-10-08T16:11:11.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d11ce9700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d12ceb700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d12ceb700 1 -- 172.21.15.60:0/1713499379 reap_dead start 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e210 tx=0x7f3d0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0645ccb98825b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400eac0 con 0x7f3cf4003a60 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400f040 con 0x7f3cf4003a60 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.522+0000 7f3d114e8700 1 -- 172.21.15.60:0/1713499379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400ee70 con 0x7f3cf4003a60 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 -- 172.21.15.60:0/1713499379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cf4003a60 msgr2=0x7f3cf4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e210 tx=0x7f3d0400b040 comp rx=0 tx=0).stop 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 -- 172.21.15.60:0/1713499379 shutdown_connections 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1713499379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e30 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 -- 172.21.15.60:0/1713499379 >> 172.21.15.60:0/1713499379 conn(0x7f3d0c068d90 msgr2=0x7f3d0c069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 -- 172.21.15.60:0/1713499379 shutdown_connections 2023-10-08T16:11:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.523+0000 7f3d1474e700 1 -- 172.21.15.60:0/1713499379 wait complete. 2023-10-08T16:11:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.524+0000 7f3d1474e700 1 Processor -- start 2023-10-08T16:11:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.524+0000 7f3d1474e700 1 -- start start 2023-10-08T16:11:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf4003a60 0x7f3d0c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 0x7f3d0c13e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d0c16dd00 0x7f3d0c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c157660 con 0x7f3d0c157af0 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c156d30 con 0x7f3d0c16dd00 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c157010 con 0x7f3cf4003a60 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 0x7f3d0c13e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 0x7f3d0c13e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46318/0 (socket says 172.21.15.60:46318) 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 -- 172.21.15.60:0/1753747716 learned_addr learned my addr 172.21.15.60:0/1753747716 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf4003a60 0x7f3d0c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d12ceb700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d0c16dd00 0x7f3d0c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 -- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf4003a60 msgr2=0x7f3d0c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf4003a60 0x7f3d0c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 -- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d0c16dd00 msgr2=0x7f3d0c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d0c16dd00 0x7f3d0c159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 -- 172.21.15.60:0/1753747716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c1572f0 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d11ce9700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 0x7f3d0c13e0c0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000e890 tx=0x7f3d00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00012590 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d000126f0 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c156970 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.525+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00012a90 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.526+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c155400 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.526+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c1577f0 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.527+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d0001d460 con 0x7f3d0c157af0 2023-10-08T16:11:11.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.527+0000 7f3d0a7fc700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.528+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.528+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d00083fc0 con 0x7f3d0c157af0 2023-10-08T16:11:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.528+0000 7f3d124ea700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cf8066f30 0x7f3cf80693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3d040094a0 tx=0x7f3d0401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.532+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d000b55a0 con 0x7f3d0c157af0 2023-10-08T16:11:11.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.726+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d0c04c3c0 con 0x7f3d0c157af0 2023-10-08T16:11:11.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.726+0000 7f3d0a7fc700 1 -- 172.21.15.60:0/1753747716 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d00051640 con 0x7f3d0c157af0 2023-10-08T16:11:11.727 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:11:11.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cf8066f30 msgr2=0x7f3cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cf8066f30 0x7f3cf80693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3d040094a0 tx=0x7f3d0401a000 comp rx=0 tx=0).stop 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 msgr2=0x7f3d0c13e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 0x7f3d0c13e0c0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000e890 tx=0x7f3d00009040 comp rx=0 tx=0).stop 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 shutdown_connections 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cf4003a60 0x7f3d0c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d0c16dd00 0x7f3d0c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 --2- 172.21.15.60:0/1753747716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0c157af0 0x7f3d0c13e0c0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 >> 172.21.15.60:0/1753747716 conn(0x7f3d0c068d90 msgr2=0x7f3d0c0cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 shutdown_connections 2023-10-08T16:11:11.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.729+0000 7f3d1474e700 1 -- 172.21.15.60:0/1753747716 wait complete. 2023-10-08T16:11:11.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:11:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.860+0000 7f6e82b61700 1 Processor -- start 2023-10-08T16:11:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.860+0000 7f6e82b61700 1 -- start start 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.861+0000 7f6e82b61700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e7c15a1e0 0x7f6e7c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.861+0000 7f6e82b61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7c15db80 con 0x7f6e7c0b3430 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.861+0000 7f6e82b61700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7c15de60 con 0x7f6e7c159e10 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.861+0000 7f6e82b61700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7c15e800 con 0x7f6e7c15a1e0 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.861+0000 7f6e810fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e7c0b3430 0x7f6e7c0cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45942/0 (socket says 172.21.15.60:45942) 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.861+0000 7f6e810fe700 1 -- 172.21.15.60:0/50712502 learned_addr learned my addr 172.21.15.60:0/50712502 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7bfff700 1 --2- 172.21.15.60:0/50712502 >> v2:172.21.15.144:3300/0 conn(0x7f6e7c15a1e0 0x7f6e7c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233372171 0 0) 0x7f6e7c15db80 con 0x7f6e7c0b3430 2023-10-08T16:11:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e68003570 con 0x7f6e7c0b3430 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 758450458 0 0) 0x7f6e68003570 con 0x7f6e7c0b3430 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 >> v2:172.21.15.144:3300/0 conn(0x7f6e7c15a1e0 msgr2=0x7f6e7c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 --2- 172.21.15.60:0/50712502 >> v2:172.21.15.144:3300/0 conn(0x7f6e7c15a1e0 0x7f6e7c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 >> v1:172.21.15.144:6789/0 conn(0x7f6e7c159e10 legacy=0x7f6e7c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c15e140 con 0x7f6e7c0b3430 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f6e64001470 con 0x7f6e7c0b3430 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 >> v1:172.21.15.60:6789/0 conn(0x7f6e7c0b3430 legacy=0x7f6e7c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e68003a60 0x7f6e68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004810 0x7f6e68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680051c0 0x7f6e6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c15e800 con 0x7f6e68003a60 2023-10-08T16:11:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800c0e0 con 0x7f6e68004810 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800c2a0 con 0x7f6e680051c0 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e68003a60 0x7f6e68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7bfff700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004810 0x7f6e68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e810fe700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680051c0 0x7f6e6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 -- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680051c0 msgr2=0x7f6e6800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680051c0 0x7f6e6800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 -- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004810 msgr2=0x7f6e68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004810 0x7f6e68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 -- 172.21.15.60:0/50712502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68003570 con 0x7f6e68003a60 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e810fe700 1 -- 172.21.15.60:0/50712502 reap_dead start 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e7bfff700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004810 0x7f6e68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.862+0000 7f6e808fd700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e68003a60 0x7f6e68003e30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6e740020a0 tx=0x7f6e740016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b31031510c6c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740019e0 con 0x7f6e68003a60 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7400c8b0 con 0x7f6e68003a60 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e7b7fe700 1 -- 172.21.15.60:0/50712502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400cc50 con 0x7f6e68003a60 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 -- 172.21.15.60:0/50712502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e68003a60 msgr2=0x7f6e68003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e68003a60 0x7f6e68003e30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6e740020a0 tx=0x7f6e740016d0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 -- 172.21.15.60:0/50712502 shutdown_connections 2023-10-08T16:11:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 --2- 172.21.15.60:0/50712502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e68003a60 0x7f6e68003e30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 -- 172.21.15.60:0/50712502 >> 172.21.15.60:0/50712502 conn(0x7f6e7c067660 msgr2=0x7f6e7c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 -- 172.21.15.60:0/50712502 shutdown_connections 2023-10-08T16:11:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.863+0000 7f6e82b61700 1 -- 172.21.15.60:0/50712502 wait complete. 2023-10-08T16:11:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.864+0000 7f6e82b61700 1 Processor -- start 2023-10-08T16:11:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.864+0000 7f6e82b61700 1 -- start start 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e82b61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e68003a60 0x7f6e7c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e82b61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 0x7f6e7c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e82b61700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e7c0c4760 0x7f6e7c0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e82b61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0c5110 con 0x7f6e7c16a320 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e82b61700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0c7a90 con 0x7f6e7c0c4760 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e82b61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0c71f0 con 0x7f6e68003a60 2023-10-08T16:11:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 0x7f6e7c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 0x7f6e7c0c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46330/0 (socket says 172.21.15.60:46330) 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e7bfff700 1 -- 172.21.15.60:0/1936634304 learned_addr learned my addr 172.21.15.60:0/1936634304 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.865+0000 7f6e808fd700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e68003a60 0x7f6e7c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e810fe700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e7c0c4760 0x7f6e7c0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e7bfff700 1 -- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e68003a60 msgr2=0x7f6e7c156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e7bfff700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e68003a60 0x7f6e7c156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e7bfff700 1 -- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e7c0c4760 msgr2=0x7f6e7c0c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e7bfff700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e7c0c4760 0x7f6e7c0c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e7bfff700 1 -- 172.21.15.60:0/1936634304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0c74d0 con 0x7f6e7c16a320 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e808fd700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e68003a60 0x7f6e7c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e7bfff700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 0x7f6e7c0c6910 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c011730 tx=0x7f6e6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c015670 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c0157d0 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c015b90 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c0c77b0 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.866+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c0c6e50 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.867+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7c15b4e0 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.867+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e6c013410 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.868+0000 7f6e78ff9700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e5c066f30 0x7f6e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.868+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6e6c084860 con 0x7f6e7c16a320 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.868+0000 7f6e808fd700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e5c066f30 0x7f6e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.868+0000 7f6e808fd700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e5c066f30 0x7f6e5c0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6e74001370 tx=0x7f6e74016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:11.872+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e6c051e20 con 0x7f6e7c16a320 2023-10-08T16:11:12.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.068+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6e7c04c3c0 con 0x7f6e7c16a320 2023-10-08T16:11:12.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.069+0000 7f6e78ff9700 1 -- 172.21.15.60:0/1936634304 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v128) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6e6c055440 con 0x7f6e7c16a320 2023-10-08T16:11:12.069 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:12.069 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:11:12.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:12.070 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:11:12.070 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:11:12.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:12.070 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:11:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e5c066f30 msgr2=0x7f6e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e5c066f30 0x7f6e5c0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6e74001370 tx=0x7f6e74016000 comp rx=0 tx=0).stop 2023-10-08T16:11:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 msgr2=0x7f6e7c0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 0x7f6e7c0c6910 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c011730 tx=0x7f6e6c008040 comp rx=0 tx=0).stop 2023-10-08T16:11:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 shutdown_connections 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e5c066f30 0x7f6e5c0693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e68003a60 0x7f6e7c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e7c0c4760 0x7f6e7c0c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 --2- 172.21.15.60:0/1936634304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e7c16a320 0x7f6e7c0c6910 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 >> 172.21.15.60:0/1936634304 conn(0x7f6e7c067660 msgr2=0x7f6e7c0b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 shutdown_connections 2023-10-08T16:11:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.071+0000 7f6e82b61700 1 -- 172.21.15.60:0/1936634304 wait complete. 2023-10-08T16:11:12.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:11:12.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:11:12.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.206+0000 7f2907366700 1 Processor -- start 2023-10-08T16:11:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.206+0000 7f2907366700 1 -- start start 2023-10-08T16:11:12.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.207+0000 7f2907366700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 0x7f290015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.207+0000 7f2907366700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29000b46f0 0x7f29000b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.207+0000 7f2907366700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000b5090 con 0x7f29000b6a10 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.207+0000 7f2907366700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29000b17b0 con 0x7f29000b46f0 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.207+0000 7f2907366700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000b1a60 con 0x7f2900159ef0 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 0x7f290015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905903700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29000b46f0 0x7f29000b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2904901700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f29000b6a10 0x7f29000b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:51318/0 (socket says 172.21.15.60:51318) 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 0x7f290015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:54162/0 (socket says 172.21.15.60:54162) 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2904901700 1 -- 172.21.15.60:0/204686865 learned_addr learned my addr 172.21.15.60:0/204686865 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 -- 172.21.15.60:0/204686865 >> v2:172.21.15.144:3300/0 conn(0x7f29000b46f0 msgr2=0x7f29000b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 --2- 172.21.15.60:0/204686865 >> v2:172.21.15.144:3300/0 conn(0x7f29000b46f0 0x7f29000b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 -- 172.21.15.60:0/204686865 >> v1:172.21.15.144:6789/0 conn(0x7f29000b6a10 legacy=0x7f29000b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 -- 172.21.15.60:0/204686865 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000b1d40 con 0x7f2900159ef0 2023-10-08T16:11:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905903700 1 --2- 172.21.15.60:0/204686865 >> v2:172.21.15.144:3300/0 conn(0x7f29000b46f0 0x7f29000b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f2905102700 1 --2- 172.21.15.60:0/204686865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 0x7f290015a2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009eb0 tx=0x7f28f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b58c9a876dc33f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f28fffff700 1 -- 172.21.15.60:0/204686865 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800e070 con 0x7f2900159ef0 2023-10-08T16:11:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f28fffff700 1 -- 172.21.15.60:0/204686865 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800bc30 con 0x7f2900159ef0 2023-10-08T16:11:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.208+0000 7f28fffff700 1 -- 172.21.15.60:0/204686865 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8012430 con 0x7f2900159ef0 2023-10-08T16:11:12.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 -- 172.21.15.60:0/204686865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 msgr2=0x7f290015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 --2- 172.21.15.60:0/204686865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 0x7f290015a2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009eb0 tx=0x7f28f8009780 comp rx=0 tx=0).stop 2023-10-08T16:11:12.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 -- 172.21.15.60:0/204686865 shutdown_connections 2023-10-08T16:11:12.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 --2- 172.21.15.60:0/204686865 >> v2:172.21.15.144:3300/0 conn(0x7f29000b46f0 0x7f29000b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 --2- 172.21.15.60:0/204686865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2900159ef0 0x7f290015a2c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 -- 172.21.15.60:0/204686865 >> 172.21.15.60:0/204686865 conn(0x7f290009a0a0 msgr2=0x7f2900067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 -- 172.21.15.60:0/204686865 shutdown_connections 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.209+0000 7f2907366700 1 -- 172.21.15.60:0/204686865 wait complete. 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.210+0000 7f2907366700 1 Processor -- start 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.210+0000 7f2907366700 1 -- start start 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2907366700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29000b46f0 0x7f2900153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2907366700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29000b6a10 0x7f29000abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2907366700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 0x7f290016dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2907366700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290016b9d0 con 0x7f2900159ef0 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2907366700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000aea10 con 0x7f29000b6a10 2023-10-08T16:11:12.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2907366700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000aecf0 con 0x7f29000b46f0 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 0x7f290016dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 0x7f290016dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46344/0 (socket says 172.21.15.60:46344) 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 -- 172.21.15.60:0/4130684359 learned_addr learned my addr 172.21.15.60:0/4130684359 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2904901700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29000b6a10 0x7f29000abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905102700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29000b46f0 0x7f2900153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 -- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29000b46f0 msgr2=0x7f2900153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29000b46f0 0x7f2900153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 -- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29000b6a10 msgr2=0x7f29000abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29000b6a10 0x7f29000abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.211+0000 7f2905903700 1 -- 172.21.15.60:0/4130684359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f0009420 con 0x7f2900159ef0 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.212+0000 7f2905903700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 0x7f290016dec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f28f000ec80 tx=0x7f28f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.212+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000c850 con 0x7f2900159ef0 2023-10-08T16:11:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.212+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000c9b0 con 0x7f2900159ef0 2023-10-08T16:11:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.212+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f8009a20 con 0x7f2900159ef0 2023-10-08T16:11:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.212+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000cd50 con 0x7f2900159ef0 2023-10-08T16:11:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.212+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2900154570 con 0x7f2900159ef0 2023-10-08T16:11:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.213+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290004c3c0 con 0x7f2900159ef0 2023-10-08T16:11:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.213+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28f0013680 con 0x7f2900159ef0 2023-10-08T16:11:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.214+0000 7f28fd7fa700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f28ec066f30 0x7f28ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.214+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f28f00842b0 con 0x7f2900159ef0 2023-10-08T16:11:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.214+0000 7f2905102700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f28ec066f30 0x7f28ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.214+0000 7f2905102700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f28ec066f30 0x7f28ec0693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009eb0 tx=0x7f28f8019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.218+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28f00517d0 con 0x7f2900159ef0 2023-10-08T16:11:12.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.410+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f290006ac00 con 0x7f2900159ef0 2023-10-08T16:11:12.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.559+0000 7f28fd7fa700 1 -- 172.21.15.60:0/4130684359 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v129) v1 ==== 138+0+0 (secure 0 0 0) 0x7f28f0054df0 con 0x7f2900159ef0 2023-10-08T16:11:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f28ec066f30 msgr2=0x7f28ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f28ec066f30 0x7f28ec0693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009eb0 tx=0x7f28f8019000 comp rx=0 tx=0).stop 2023-10-08T16:11:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 msgr2=0x7f290016dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 0x7f290016dec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f28f000ec80 tx=0x7f28f00091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 shutdown_connections 2023-10-08T16:11:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f28ec066f30 0x7f28ec0693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29000b46f0 0x7f2900153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2900159ef0 0x7f290016dec0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 --2- 172.21.15.60:0/4130684359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29000b6a10 0x7f29000abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 >> 172.21.15.60:0/4130684359 conn(0x7f290009a0a0 msgr2=0x7f2900157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 shutdown_connections 2023-10-08T16:11:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.562+0000 7f2907366700 1 -- 172.21.15.60:0/4130684359 wait complete. 2023-10-08T16:11:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:11:12.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:11:12.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.702+0000 7f693af11700 1 Processor -- start 2023-10-08T16:11:12.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.702+0000 7f693af11700 1 -- start start 2023-10-08T16:11:12.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f693af11700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f693415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f693af11700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69340b4c30 0x7f69340b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f693af11700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69340b14f0 con 0x7f69340b4860 2023-10-08T16:11:12.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f693af11700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69340b17d0 con 0x7f69340b4c30 2023-10-08T16:11:12.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f693af11700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69340b1ab0 con 0x7f69340b3570 2023-10-08T16:11:12.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f6938cad700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f69340b4860 0x7f6934159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43678/0 (socket says 172.21.15.60:43678) 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f6938cad700 1 -- 172.21.15.60:0/3552356151 learned_addr learned my addr 172.21.15.60:0/3552356151 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f6933fff700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f693415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69394ae700 1 --2- 172.21.15.60:0/3552356151 >> v2:172.21.15.144:3300/0 conn(0x7f69340b4c30 0x7f69340b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981730830 0 0) 0x7f69340b14f0 con 0x7f69340b4860 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f691c003570 con 0x7f69340b4860 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535313637 0 0) 0x7f691c003570 con 0x7f69340b4860 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 msgr2=0x7f693415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f693415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 >> v2:172.21.15.144:3300/0 conn(0x7f69340b4c30 msgr2=0x7f69340b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 --2- 172.21.15.60:0/3552356151 >> v2:172.21.15.144:3300/0 conn(0x7f69340b4c30 0x7f69340b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69340b1d90 con 0x7f69340b4860 2023-10-08T16:11:12.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f69240015f0 con 0x7f69340b4860 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f6933fff700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f693415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 >> v1:172.21.15.60:6789/0 conn(0x7f69340b4860 legacy=0x7f6934159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f691c003a60 0x7f691c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c004810 0x7f691c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f691c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340b17d0 con 0x7f691c003a60 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340b1ab0 con 0x7f691c004810 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.703+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c00ba60 con 0x7f69340b3570 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f69394ae700 1 --2- 172.21.15.60:0/3552356151 >> v2:172.21.15.144:3300/0 conn(0x7f69340b4c30 0x7f69340b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f691c003a60 0x7f691c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6933fff700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c004810 0x7f691c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f69394ae700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f691c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 -- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 msgr2=0x7f691c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69340b3570 0x7f691c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 -- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c004810 msgr2=0x7f691c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c004810 0x7f691c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 -- 172.21.15.60:0/3552356151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928009420 con 0x7f691c003a60 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f6938cad700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f691c003a60 0x7f691c003e70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f692400c3c0 tx=0x7f6924007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6abe0d0c1f0850 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400cc90 con 0x7f691c003a60 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400cdf0 con 0x7f691c003a60 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.704+0000 7f69337fe700 1 -- 172.21.15.60:0/3552356151 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924007320 con 0x7f691c003a60 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f693af11700 1 -- 172.21.15.60:0/3552356151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f691c003a60 msgr2=0x7f691c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f693af11700 1 --2- 172.21.15.60:0/3552356151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f691c003a60 0x7f691c003e70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f692400c3c0 tx=0x7f6924007920 comp rx=0 tx=0).stop 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f69394ae700 1 -- 172.21.15.60:0/3552356151 reap_dead start 2023-10-08T16:11:12.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f693af11700 1 -- 172.21.15.60:0/3552356151 shutdown_connections 2023-10-08T16:11:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f693af11700 1 -- 172.21.15.60:0/3552356151 >> 172.21.15.60:0/3552356151 conn(0x7f693409a0f0 msgr2=0x7f6934067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f693af11700 1 -- 172.21.15.60:0/3552356151 shutdown_connections 2023-10-08T16:11:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.705+0000 7f693af11700 1 -- 172.21.15.60:0/3552356151 wait complete. 2023-10-08T16:11:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.706+0000 7f693af11700 1 Processor -- start 2023-10-08T16:11:12.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.706+0000 7f693af11700 1 -- start start 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f691c003a60 0x7f69341584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 0x7f69340ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693409d570 0x7f693409d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693409df20 con 0x7f69340abe00 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693409af30 con 0x7f693409d570 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69340aff90 con 0x7f691c003a60 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 0x7f69340ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 0x7f69340ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48034/0 (socket says 172.21.15.60:48034) 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 -- 172.21.15.60:0/3637371888 learned_addr learned my addr 172.21.15.60:0/3637371888 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:12.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6938cad700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f691c003a60 0x7f69341584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f69394ae700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693409d570 0x7f693409d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 -- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f691c003a60 msgr2=0x7f69341584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f691c003a60 0x7f69341584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 -- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693409d570 msgr2=0x7f693409d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693409d570 0x7f693409d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 -- 172.21.15.60:0/3637371888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693409ac00 con 0x7f69340abe00 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6933fff700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 0x7f69340ac270 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f69280119f0 tx=0x7f6928008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928015670 con 0x7f69340abe00 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69280157d0 con 0x7f69340abe00 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69340ac8c0 con 0x7f69340abe00 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.707+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928015b50 con 0x7f69340abe00 2023-10-08T16:11:12.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.708+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693416a190 con 0x7f69340abe00 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.709+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693409b0a0 con 0x7f69340abe00 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.709+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f692800f4a0 con 0x7f69340abe00 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.710+0000 7f6930ff9700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6920066f30 0x7f69200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.710+0000 7f6938cad700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6920066f30 0x7f69200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.710+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6928084b50 con 0x7f69340abe00 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.710+0000 7f6938cad700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6920066f30 0x7f69200693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6924008fd0 tx=0x7f6924015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:12.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.714+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6928052000 con 0x7f69340abe00 2023-10-08T16:11:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:12.906+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f693404c3c0 con 0x7f69340abe00 2023-10-08T16:11:13.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.562+0000 7f6930ff9700 1 -- 172.21.15.60:0/3637371888 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v130) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6928055620 con 0x7f69340abe00 2023-10-08T16:11:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.572+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6920066f30 msgr2=0x7f69200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.572+0000 7f693af11700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6920066f30 0x7f69200693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6924008fd0 tx=0x7f6924015000 comp rx=0 tx=0).stop 2023-10-08T16:11:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.572+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 msgr2=0x7f69340ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.572+0000 7f693af11700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 0x7f69340ac270 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f69280119f0 tx=0x7f6928008040 comp rx=0 tx=0).stop 2023-10-08T16:11:13.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 shutdown_connections 2023-10-08T16:11:13.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6920066f30 0x7f69200693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f691c003a60 0x7f69341584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693409d570 0x7f693409d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 --2- 172.21.15.60:0/3637371888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69340abe00 0x7f69340ac270 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 >> 172.21.15.60:0/3637371888 conn(0x7f693409a0f0 msgr2=0x7f6934068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:13.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.574+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 shutdown_connections 2023-10-08T16:11:13.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.576+0000 7f693af11700 1 -- 172.21.15.60:0/3637371888 wait complete. 2023-10-08T16:11:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:11:13.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:11:13.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.720+0000 7f6e11b93700 1 Processor -- start 2023-10-08T16:11:13.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.720+0000 7f6e11b93700 1 -- start start 2023-10-08T16:11:13.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e11b93700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6e0c15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e11b93700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e0c0cbf10 0x7f6e0c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e11b93700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c0cae70 con 0x7f6e0c0c9390 2023-10-08T16:11:13.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e11b93700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c0cb150 con 0x7f6e0c0cbf10 2023-10-08T16:11:13.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e11b93700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0cb430 con 0x7f6e0c0678b0 2023-10-08T16:11:13.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e0bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e0c0c9390 0x7f6e0c06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43690/0 (socket says 172.21.15.60:43690) 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.721+0000 7f6e0bfff700 1 -- 172.21.15.60:0/3736316570 learned_addr learned my addr 172.21.15.60:0/3736316570 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0affd700 1 --2- 172.21.15.60:0/3736316570 >> v2:172.21.15.144:3300/0 conn(0x7f6e0c0cbf10 0x7f6e0c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6e0c15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885459833 0 0) 0x7f6e0c0cae70 con 0x7f6e0c0c9390 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df8003570 con 0x7f6e0c0c9390 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953104348 0 0) 0x7f6df8003570 con 0x7f6e0c0c9390 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 msgr2=0x7f6e0c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6e0c15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 >> v2:172.21.15.144:3300/0 conn(0x7f6e0c0cbf10 msgr2=0x7f6e0c15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 --2- 172.21.15.60:0/3736316570 >> v2:172.21.15.144:3300/0 conn(0x7f6e0c0cbf10 0x7f6e0c15e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0cb710 con 0x7f6e0c0c9390 2023-10-08T16:11:13.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f6dfc001470 con 0x7f6e0c0c9390 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 >> v1:172.21.15.60:6789/0 conn(0x7f6e0c0c9390 legacy=0x7f6e0c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6df8003a60 0x7f6df8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6df8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0cb150 con 0x7f6df8003a60 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0cb430 con 0x7f6df8004d50 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df800ba60 con 0x7f6e0c0678b0 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6df8003a60 0x7f6df8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0affd700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6df8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0bfff700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 -- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 msgr2=0x7f6df8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:13.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6df8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 -- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6df8004d50 msgr2=0x7f6df80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0b7fe700 1 -- 172.21.15.60:0/3736316570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8003570 con 0x7f6df8003a60 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.722+0000 7f6e0affd700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e0c0678b0 0x7f6df8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6df8003a60 0x7f6df8003e70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e210 tx=0x7f6e0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e55fdf645d1f41e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400ea60 con 0x7f6df8003a60 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400f040 con 0x7f6df8003a60 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e0a7fc700 1 -- 172.21.15.60:0/3736316570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400ee10 con 0x7f6df8003a60 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e11b93700 1 -- 172.21.15.60:0/3736316570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6df8003a60 msgr2=0x7f6df8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3736316570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6df8003a60 0x7f6df8003e70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e210 tx=0x7f6e0400b040 comp rx=0 tx=0).stop 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e0bfff700 1 -- 172.21.15.60:0/3736316570 reap_dead start 2023-10-08T16:11:13.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e11b93700 1 -- 172.21.15.60:0/3736316570 shutdown_connections 2023-10-08T16:11:13.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e11b93700 1 -- 172.21.15.60:0/3736316570 >> 172.21.15.60:0/3736316570 conn(0x7f6e0c069870 msgr2=0x7f6e0c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:13.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e11b93700 1 -- 172.21.15.60:0/3736316570 shutdown_connections 2023-10-08T16:11:13.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.723+0000 7f6e11b93700 1 -- 172.21.15.60:0/3736316570 wait complete. 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.724+0000 7f6e11b93700 1 Processor -- start 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 -- start start 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6df8003a60 0x7f6e0c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 0x7f6e0c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e0c0ce890 0x7f6e0c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b36a0 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0c62e0 con 0x7f6e0c0ce890 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e11b93700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0c5cb0 con 0x7f6df8003a60 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e0affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 0x7f6e0c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e0affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 0x7f6e0c0b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48054/0 (socket says 172.21.15.60:48054) 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e0affd700 1 -- 172.21.15.60:0/3452737661 learned_addr learned my addr 172.21.15.60:0/3452737661 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6df8003a60 0x7f6e0c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.725+0000 7f6e0bfff700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e0c0ce890 0x7f6e0c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0affd700 1 -- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6df8003a60 msgr2=0x7f6e0c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0affd700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6df8003a60 0x7f6e0c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0affd700 1 -- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e0c0ce890 msgr2=0x7f6e0c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0affd700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e0c0ce890 0x7f6e0c0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0affd700 1 -- 172.21.15.60:0/3452737661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0cf5e0 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0bfff700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e0c0ce890 0x7f6e0c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6df8003a60 0x7f6e0c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e0affd700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 0x7f6e0c0b3160 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6df40118e0 tx=0x7f6df4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4011e80 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df400f8e0 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c0cf8c0 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df400fc80 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.726+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c158a10 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.727+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c0c6490 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.728+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6df4015460 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.728+0000 7f6e037fe700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6dec066f30 0x7f6dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.728+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6df4084c70 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.728+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6dec066f30 0x7f6dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:13.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.729+0000 7f6e0b7fe700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6dec066f30 0x7f6dec0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400afd0 tx=0x7f6e0401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:13.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.733+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e0c0c6490 con 0x7f6e0c0b2cf0 2023-10-08T16:11:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:13.971+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6e0c0c6450 con 0x7f6e0c0b2cf0 2023-10-08T16:11:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.590+0000 7f6e037fe700 1 -- 172.21.15.60:0/3452737661 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6df4051f40 con 0x7f6e0c0b2cf0 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6dec066f30 msgr2=0x7f6dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6dec066f30 0x7f6dec0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400afd0 tx=0x7f6e0401a000 comp rx=0 tx=0).stop 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 msgr2=0x7f6e0c0b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 0x7f6e0c0b3160 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6df40118e0 tx=0x7f6df4008040 comp rx=0 tx=0).stop 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 shutdown_connections 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6dec066f30 0x7f6dec0693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6df8003a60 0x7f6e0c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e0c0ce890 0x7f6e0c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 --2- 172.21.15.60:0/3452737661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e0c0b2cf0 0x7f6e0c0b3160 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.595+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 >> 172.21.15.60:0/3452737661 conn(0x7f6e0c069870 msgr2=0x7f6e0c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:14.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.597+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 shutdown_connections 2023-10-08T16:11:14.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.597+0000 7f6e11b93700 1 -- 172.21.15.60:0/3452737661 wait complete. 2023-10-08T16:11:14.601 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 16 and data pool 17 2023-10-08T16:11:14.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:14.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.734+0000 7f4e48d1f700 1 Processor -- start 2023-10-08T16:11:14.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.734+0000 7f4e48d1f700 1 -- start start 2023-10-08T16:11:14.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e48d1f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e440b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:14.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e48d1f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4415db80 con 0x7f4e440cde50 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e48d1f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4415de60 con 0x7f4e4415a1e0 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e48d1f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4415e800 con 0x7f4e44159e10 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e42d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e440cde50 0x7f4e440cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43702/0 (socket says 172.21.15.60:43702) 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e42d9d700 1 -- 172.21.15.60:0/70904027 learned_addr learned my addr 172.21.15.60:0/70904027 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.735+0000 7f4e4259c700 1 --2- 172.21.15.60:0/70904027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e440b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111301030 0 0) 0x7f4e4415db80 con 0x7f4e440cde50 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e30003570 con 0x7f4e440cde50 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633969657 0 0) 0x7f4e4415de60 con 0x7f4e4415a1e0 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e4415db80 con 0x7f4e4415a1e0 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4259c700 1 -- 172.21.15.60:0/70904027 >> v1:172.21.15.144:6789/0 conn(0x7f4e4415a1e0 legacy=0x7f4e440cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4259c700 1 -- 172.21.15.60:0/70904027 >> v1:172.21.15.60:6789/0 conn(0x7f4e440cde50 legacy=0x7f4e440cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4259c700 1 -- 172.21.15.60:0/70904027 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4415e140 con 0x7f4e44159e10 2023-10-08T16:11:14.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4259c700 1 --2- 172.21.15.60:0/70904027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e440b2d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009e90 tx=0x7f4e3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35521d6c6ecbc0db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:14.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00e070 con 0x7f4e44159e10 2023-10-08T16:11:14.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00bb80 con 0x7f4e44159e10 2023-10-08T16:11:14.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.736+0000 7f4e4159a700 1 -- 172.21.15.60:0/70904027 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c012430 con 0x7f4e44159e10 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 -- 172.21.15.60:0/70904027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 msgr2=0x7f4e440b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/70904027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e440b2d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009e90 tx=0x7f4e3c009780 comp rx=0 tx=0).stop 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 -- 172.21.15.60:0/70904027 shutdown_connections 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/70904027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e440b2d20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 -- 172.21.15.60:0/70904027 >> 172.21.15.60:0/70904027 conn(0x7f4e44067660 msgr2=0x7f4e44067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 -- 172.21.15.60:0/70904027 shutdown_connections 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.737+0000 7f4e48d1f700 1 -- 172.21.15.60:0/70904027 wait complete. 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.738+0000 7f4e48d1f700 1 Processor -- start 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.738+0000 7f4e48d1f700 1 -- start start 2023-10-08T16:11:14.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e48d1f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 0x7f4e440ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e48d1f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e4416deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e48d1f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e4415a1e0 0x7f4e4416e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e48d1f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440c8ed0 con 0x7f4e440cde50 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e48d1f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440c9cf0 con 0x7f4e4415a1e0 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e48d1f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440c90e0 con 0x7f4e44159e10 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 0x7f4e440ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 0x7f4e440ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48060/0 (socket says 172.21.15.60:48060) 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 -- 172.21.15.60:0/1417798282 learned_addr learned my addr 172.21.15.60:0/1417798282 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e41d9b700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e4416deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e42d9d700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e4415a1e0 0x7f4e4416e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:14.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 -- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 msgr2=0x7f4e4416deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e4416deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 -- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e4415a1e0 msgr2=0x7f4e4416e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e4415a1e0 0x7f4e4416e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 -- 172.21.15.60:0/1417798282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c009a20 con 0x7f4e440cde50 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e41d9b700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e4416deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e42d9d700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e4415a1e0 0x7f4e4416e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.739+0000 7f4e4259c700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 0x7f4e440ca180 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0097c0 tx=0x7f4e3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.740+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c012e30 con 0x7f4e440cde50 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.740+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c01b420 con 0x7f4e440cde50 2023-10-08T16:11:14.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.740+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e440c93c0 con 0x7f4e440cde50 2023-10-08T16:11:14.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.740+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c01b7e0 con 0x7f4e440cde50 2023-10-08T16:11:14.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.740+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e440c9980 con 0x7f4e440cde50 2023-10-08T16:11:14.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.741+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e440c9fd0 con 0x7f4e440cde50 2023-10-08T16:11:14.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.741+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e3c01bbd0 con 0x7f4e440cde50 2023-10-08T16:11:14.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.741+0000 7f4e3a7fc700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e24066f30 0x7f4e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:14.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.742+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e3c086060 con 0x7f4e440cde50 2023-10-08T16:11:14.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.742+0000 7f4e41d9b700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e24066f30 0x7f4e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:14.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.742+0000 7f4e41d9b700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e24066f30 0x7f4e240693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c007fd0 tx=0x7f4e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:14.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.746+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e3c0532d0 con 0x7f4e440cde50 2023-10-08T16:11:14.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.941+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e4404c3c0 con 0x7f4e440cde50 2023-10-08T16:11:14.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.942+0000 7f4e3a7fc700 1 -- 172.21.15.60:0/1417798282 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f4e3c0568f0 con 0x7f4e440cde50 2023-10-08T16:11:14.942 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:14.942 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":131,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:13.972949+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:11:12.441833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:11:12.936737+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e24066f30 msgr2=0x7f4e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e24066f30 0x7f4e240693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c007fd0 tx=0x7f4e2c009040 comp rx=0 tx=0).stop 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 msgr2=0x7f4e440ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 0x7f4e440ca180 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0097c0 tx=0x7f4e3c019000 comp rx=0 tx=0).stop 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 shutdown_connections 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4e24066f30 0x7f4e240693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e4415a1e0 0x7f4e4416e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e440cde50 0x7f4e440ca180 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 --2- 172.21.15.60:0/1417798282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e44159e10 0x7f4e4416deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 >> 172.21.15.60:0/1417798282 conn(0x7f4e44067660 msgr2=0x7f4e44159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 shutdown_connections 2023-10-08T16:11:14.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:14.944+0000 7f4e48d1f700 1 -- 172.21.15.60:0/1417798282 wait complete. 2023-10-08T16:11:14.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.075+0000 7f8cb895f700 1 Processor -- start 2023-10-08T16:11:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.075+0000 7f8cb895f700 1 -- start start 2023-10-08T16:11:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb895f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 0x7f8cb40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb895f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8cb415a2e0 0x7f8cb40cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb895f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40ae320 con 0x7f8cb4159f10 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb895f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb415a760 con 0x7f8cb415a2e0 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb895f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40ad710 con 0x7f8cb40cc410 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8cb4159f10 0x7f8cb40cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43712/0 (socket says 172.21.15.60:43712) 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb37fe700 1 -- 172.21.15.60:0/42153939 learned_addr learned my addr 172.21.15.60:0/42153939 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 0x7f8cb40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb3fff700 1 --2- 172.21.15.60:0/42153939 >> v2:172.21.15.144:3300/0 conn(0x7f8cb415a2e0 0x7f8cb40cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282418931 0 0) 0x7f8cb40ae320 con 0x7f8cb4159f10 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.076+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c9c003570 con 0x7f8cb4159f10 2023-10-08T16:11:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096813744 0 0) 0x7f8c9c003570 con 0x7f8cb4159f10 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 msgr2=0x7f8cb40c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 0x7f8cb40c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 >> v2:172.21.15.144:3300/0 conn(0x7f8cb415a2e0 msgr2=0x7f8cb40cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 --2- 172.21.15.60:0/42153939 >> v2:172.21.15.144:3300/0 conn(0x7f8cb415a2e0 0x7f8cb40cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40ad9f0 con 0x7f8cb4159f10 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f8ca4001470 con 0x7f8cb4159f10 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb3fff700 1 --2- 172.21.15.60:0/42153939 >> v2:172.21.15.144:3300/0 conn(0x7f8cb415a2e0 0x7f8cb40cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 >> v1:172.21.15.60:6789/0 conn(0x7f8cb4159f10 legacy=0x7f8cb40cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c9c003a60 0x7f8c9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c9c004810 0x7f8c9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 0x7f8c9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb415a760 con 0x7f8c9c004810 2023-10-08T16:11:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40ad710 con 0x7f8c9c003a60 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c00ba60 con 0x7f8cb40cc410 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c9c004810 0x7f8c9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb37fe700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c9c003a60 0x7f8c9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb3fff700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 0x7f8c9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 msgr2=0x7f8c9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb40cc410 0x7f8c9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c9c003a60 msgr2=0x7f8c9c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c9c003a60 0x7f8c9c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/42153939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c003570 con 0x7f8c9c004810 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb37fe700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c9c003a60 0x7f8c9c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c9c004810 0x7f8c9c004c80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009c30 tx=0x7f8ca80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50d2e21b46dd4cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800e710 con 0x7f8c9c004810 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800e870 con 0x7f8c9c004810 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.077+0000 7f8cb27fc700 1 -- 172.21.15.60:0/42153939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800ec30 con 0x7f8c9c004810 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb895f700 1 -- 172.21.15.60:0/42153939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c9c004810 msgr2=0x7f8c9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb895f700 1 --2- 172.21.15.60:0/42153939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c9c004810 0x7f8c9c004c80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009c30 tx=0x7f8ca80091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb3fff700 1 -- 172.21.15.60:0/42153939 reap_dead start 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb895f700 1 -- 172.21.15.60:0/42153939 shutdown_connections 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb895f700 1 -- 172.21.15.60:0/42153939 >> 172.21.15.60:0/42153939 conn(0x7f8cb4067e40 msgr2=0x7f8cb40d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb895f700 1 -- 172.21.15.60:0/42153939 shutdown_connections 2023-10-08T16:11:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.078+0000 7f8cb895f700 1 -- 172.21.15.60:0/42153939 wait complete. 2023-10-08T16:11:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.079+0000 7f8cb895f700 1 Processor -- start 2023-10-08T16:11:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.079+0000 7f8cb895f700 1 -- start start 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb895f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c9c004810 0x7f8cb40b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb895f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 0x7f8cb40d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb895f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40d14c0 0x7f8cb41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb895f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c95f0 con 0x7f8cb40b5c50 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb895f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40b60f0 con 0x7f8cb40d14c0 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb895f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c8cc0 con 0x7f8c9c004810 2023-10-08T16:11:15.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 0x7f8cb40d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 0x7f8cb40d0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48074/0 (socket says 172.21.15.60:48074) 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/1845626650 learned_addr learned my addr 172.21.15.60:0/1845626650 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb3fff700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40d14c0 0x7f8cb41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb37fe700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c9c004810 0x7f8cb40b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c9c004810 msgr2=0x7f8cb40b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c9c004810 0x7f8cb40b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40d14c0 msgr2=0x7f8cb41514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40d14c0 0x7f8cb41514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.080+0000 7f8cb2ffd700 1 -- 172.21.15.60:0/1845626650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40c8fa0 con 0x7f8cb40b5c50 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.081+0000 7f8cb2ffd700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 0x7f8cb40d0f80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c004700 tx=0x7f8ca801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.081+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8022070 con 0x7f8cb40b5c50 2023-10-08T16:11:15.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.081+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800e9e0 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.081+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb40c9280 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.081+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8006e50 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.081+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb40ca210 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.082+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb4089300 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.082+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ca801c660 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.083+0000 7f8c9b7fe700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ca0066f30 0x7f8ca00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.083+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ca8085a10 con 0x7f8cb40b5c50 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.083+0000 7f8cb37fe700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ca0066f30 0x7f8ca00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.083+0000 7f8cb37fe700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ca0066f30 0x7f8ca00693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000fd0 tx=0x7f8ca4007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:15.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.087+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ca8052d70 con 0x7f8cb40b5c50 2023-10-08T16:11:15.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.282+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb40890a0 con 0x7f8cb40b5c50 2023-10-08T16:11:15.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.282+0000 7f8c9b7fe700 1 -- 172.21.15.60:0/1845626650 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f8ca8056350 con 0x7f8cb40b5c50 2023-10-08T16:11:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:15.283 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":131,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:13.972949+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:11:12.441833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:11:12.936737+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.284+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ca0066f30 msgr2=0x7f8ca00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.284+0000 7f8cb895f700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ca0066f30 0x7f8ca00693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000fd0 tx=0x7f8ca4007040 comp rx=0 tx=0).stop 2023-10-08T16:11:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.284+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 msgr2=0x7f8cb40d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.284+0000 7f8cb895f700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 0x7f8cb40d0f80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c004700 tx=0x7f8ca801a000 comp rx=0 tx=0).stop 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 shutdown_connections 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ca0066f30 0x7f8ca00693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c9c004810 0x7f8cb40b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb40d14c0 0x7f8cb41514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 --2- 172.21.15.60:0/1845626650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b5c50 0x7f8cb40d0f80 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 >> 172.21.15.60:0/1845626650 conn(0x7f8cb4067e40 msgr2=0x7f8cb406a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 shutdown_connections 2023-10-08T16:11:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.285+0000 7f8cb895f700 1 -- 172.21.15.60:0/1845626650 wait complete. 2023-10-08T16:11:15.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:11:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.418+0000 7f5563c98700 1 Processor -- start 2023-10-08T16:11:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5563c98700 1 -- start start 2023-10-08T16:11:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5563c98700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f555c0697c0 0x7f555c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5563c98700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f555c15a230 0x7f555c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5563c98700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c15ea90 con 0x7f555c159e60 2023-10-08T16:11:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5563c98700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0d1cf0 con 0x7f555c15a230 2023-10-08T16:11:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5563c98700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0b3100 con 0x7f555c0697c0 2023-10-08T16:11:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5562235700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f555c15a230 0x7f555c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5561a34700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f555c159e60 0x7f555c0690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43718/0 (socket says 172.21.15.60:43718) 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.419+0000 7f5561a34700 1 -- 172.21.15.60:0/3227416921 learned_addr learned my addr 172.21.15.60:0/3227416921 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5561233700 1 --2- 172.21.15.60:0/3227416921 >> v2:172.21.15.144:3300/0 conn(0x7f555c0697c0 0x7f555c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5562235700 1 -- 172.21.15.60:0/3227416921 >> v2:172.21.15.144:3300/0 conn(0x7f555c0697c0 msgr2=0x7f555c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5562235700 1 --2- 172.21.15.60:0/3227416921 >> v2:172.21.15.144:3300/0 conn(0x7f555c0697c0 0x7f555c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5562235700 1 -- 172.21.15.60:0/3227416921 >> v1:172.21.15.60:6789/0 conn(0x7f555c159e60 legacy=0x7f555c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5560a32700 1 -- 172.21.15.60:0/3227416921 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919111831 0 0) 0x7f555c15ea90 con 0x7f555c159e60 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5562235700 1 -- 172.21.15.60:0/3227416921 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0d10e0 con 0x7f555c15a230 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5562235700 1 --2- 172.21.15.60:0/3227416921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c15a230 0x7f555c0af730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f555c0b3860 tx=0x7f554c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b373a44a8c82624c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5560a32700 1 -- 172.21.15.60:0/3227416921 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00e070 con 0x7f555c15a230 2023-10-08T16:11:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5560a32700 1 -- 172.21.15.60:0/3227416921 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00bc30 con 0x7f555c15a230 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.420+0000 7f5560a32700 1 -- 172.21.15.60:0/3227416921 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c012430 con 0x7f555c15a230 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 -- 172.21.15.60:0/3227416921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c15a230 msgr2=0x7f555c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 --2- 172.21.15.60:0/3227416921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c15a230 0x7f555c0af730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f555c0b3860 tx=0x7f554c009780 comp rx=0 tx=0).stop 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 -- 172.21.15.60:0/3227416921 shutdown_connections 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 --2- 172.21.15.60:0/3227416921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c15a230 0x7f555c0af730 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 --2- 172.21.15.60:0/3227416921 >> v2:172.21.15.144:3300/0 conn(0x7f555c0697c0 0x7f555c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 -- 172.21.15.60:0/3227416921 >> 172.21.15.60:0/3227416921 conn(0x7f555c070700 msgr2=0x7f555c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 -- 172.21.15.60:0/3227416921 shutdown_connections 2023-10-08T16:11:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.421+0000 7f5563c98700 1 -- 172.21.15.60:0/3227416921 wait complete. 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.422+0000 7f5563c98700 1 Processor -- start 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.422+0000 7f5563c98700 1 -- start start 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 0x7f555c16d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f555c159e60 0x7f555c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f555c15a230 0x7f555c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c15bdb0 con 0x7f555c0697c0 2023-10-08T16:11:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c15b1e0 con 0x7f555c15a230 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c15b480 con 0x7f555c159e60 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 0x7f555c16d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 0x7f555c16d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48088/0 (socket says 172.21.15.60:48088) 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 -- 172.21.15.60:0/248737175 learned_addr learned my addr 172.21.15.60:0/248737175 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561233700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f555c159e60 0x7f555c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5562235700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f555c15a230 0x7f555c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 -- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f555c159e60 msgr2=0x7f555c1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f555c159e60 0x7f555c1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 -- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f555c15a230 msgr2=0x7f555c157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f555c15a230 0x7f555c157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 -- 172.21.15.60:0/248737175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c009a20 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5561a34700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 0x7f555c16d400 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f555400c7e0 tx=0x7f5554007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554005b30 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5554005c90 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c15b760 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.423+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554007300 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.424+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c0b5b70 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.424+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c159a50 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.425+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f555401b3b0 con 0x7f555c0697c0 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.425+0000 7f5559ffb700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5548066f30 0x7f55480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.425+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5554083b30 con 0x7f555c0697c0 2023-10-08T16:11:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.425+0000 7f5561233700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5548066f30 0x7f55480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.426+0000 7f5561233700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5548066f30 0x7f55480693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f555c0b2110 tx=0x7f5550008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.430+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5554050d00 con 0x7f555c0697c0 2023-10-08T16:11:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:15.672+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f555c0b3380 con 0x7f555c0697c0 2023-10-08T16:11:16.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.600+0000 7f5559ffb700 1 -- 172.21.15.60:0/248737175 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f55540170b0 con 0x7f555c0697c0 2023-10-08T16:11:16.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5548066f30 msgr2=0x7f55480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5548066f30 0x7f55480693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f555c0b2110 tx=0x7f5550008040 comp rx=0 tx=0).stop 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 msgr2=0x7f555c16d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 0x7f555c16d400 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f555400c7e0 tx=0x7f5554007df0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 shutdown_connections 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5548066f30 0x7f55480693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f555c15a230 0x7f555c157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f555c0697c0 0x7f555c16d400 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 --2- 172.21.15.60:0/248737175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f555c159e60 0x7f555c1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 >> 172.21.15.60:0/248737175 conn(0x7f555c070700 msgr2=0x7f555c0af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:16.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 shutdown_connections 2023-10-08T16:11:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.603+0000 7f5563c98700 1 -- 172.21.15.60:0/248737175 wait complete. 2023-10-08T16:11:16.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:11:16.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.748+0000 7f86b7b3f700 1 Processor -- start 2023-10-08T16:11:16.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.748+0000 7f86b7b3f700 1 -- start start 2023-10-08T16:11:16.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b7b3f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86b0159ec0 0x7f86b00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b7b3f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b00b0790 con 0x7f86b006acb0 2023-10-08T16:11:16.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b7b3f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b00ce1f0 con 0x7f86b015a290 2023-10-08T16:11:16.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b7b3f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b00b0b20 con 0x7f86b0159ec0 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b60dc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f86b006acb0 0x7f86b00cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43724/0 (socket says 172.21.15.60:43724) 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b60dc700 1 -- 172.21.15.60:0/2079658952 learned_addr learned my addr 172.21.15.60:0/2079658952 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b58db700 1 --2- 172.21.15.60:0/2079658952 >> v2:172.21.15.144:3300/0 conn(0x7f86b0159ec0 0x7f86b00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960815172 0 0) 0x7f86b00b0790 con 0x7f86b006acb0 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f869c003570 con 0x7f86b006acb0 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480842492 0 0) 0x7f869c003570 con 0x7f86b006acb0 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 >> v2:172.21.15.144:3300/0 conn(0x7f86b0159ec0 msgr2=0x7f86b00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 --2- 172.21.15.60:0/2079658952 >> v2:172.21.15.144:3300/0 conn(0x7f86b0159ec0 0x7f86b00af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 >> v1:172.21.15.144:6789/0 conn(0x7f86b015a290 legacy=0x7f86b006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00b04b0 con 0x7f86b006acb0 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f86a80017f0 con 0x7f86b006acb0 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 >> v1:172.21.15.60:6789/0 conn(0x7f86b006acb0 legacy=0x7f86b00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.749+0000 7f86b48d9700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869c003a60 0x7f869c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f869c004810 0x7f869c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c0051c0 0x7f869c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b0b20 con 0x7f869c003a60 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c00c160 con 0x7f869c0051c0 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c00c320 con 0x7f869c004810 2023-10-08T16:11:16.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869c003a60 0x7f869c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b60dc700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c0051c0 0x7f869c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b50da700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f869c004810 0x7f869c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 -- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f869c004810 msgr2=0x7f869c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f869c004810 0x7f869c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 -- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c0051c0 msgr2=0x7f869c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c0051c0 0x7f869c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b60dc700 1 -- 172.21.15.60:0/2079658952 reap_dead start 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 -- 172.21.15.60:0/2079658952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c003570 con 0x7f869c003a60 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b58db700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869c003a60 0x7f869c003e70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009c00 tx=0x7f86ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba8c9dc9e1a4529 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00e710 con 0x7f869c003a60 2023-10-08T16:11:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac00e870 con 0x7f869c003a60 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.750+0000 7f86b48d9700 1 -- 172.21.15.60:0/2079658952 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00ec30 con 0x7f869c003a60 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 -- 172.21.15.60:0/2079658952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869c003a60 msgr2=0x7f869c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869c003a60 0x7f869c003e70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009c00 tx=0x7f86ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 -- 172.21.15.60:0/2079658952 shutdown_connections 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/2079658952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869c003a60 0x7f869c003e70 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 -- 172.21.15.60:0/2079658952 >> 172.21.15.60:0/2079658952 conn(0x7f86b00d1880 msgr2=0x7f86b00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 -- 172.21.15.60:0/2079658952 shutdown_connections 2023-10-08T16:11:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.751+0000 7f86b7b3f700 1 -- 172.21.15.60:0/2079658952 wait complete. 2023-10-08T16:11:16.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.752+0000 7f86b7b3f700 1 Processor -- start 2023-10-08T16:11:16.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.752+0000 7f86b7b3f700 1 -- start start 2023-10-08T16:11:16.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c003a60 0x7f86b00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00b3b50 0x7f86b00c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 0x7f86b01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b4bf0 con 0x7f86b00c8ff0 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b3fe0 con 0x7f869c003a60 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b42c0 con 0x7f86b00b3b50 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 0x7f86b01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 0x7f86b01573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48116/0 (socket says 172.21.15.60:48116) 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 -- 172.21.15.60:0/1623685380 learned_addr learned my addr 172.21.15.60:0/1623685380 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:16.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b58db700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c003a60 0x7f86b00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b50da700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00b3b50 0x7f86b00c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 -- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00b3b50 msgr2=0x7f86b00c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00b3b50 0x7f86b00c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 -- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c003a60 msgr2=0x7f86b00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c003a60 0x7f86b00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 -- 172.21.15.60:0/1623685380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00b45a0 con 0x7f86b00c8ff0 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b50da700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00b3b50 0x7f86b00c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b60dc700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 0x7f86b01573a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f86b006b0b0 tx=0x7f86a8001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800ebc0 con 0x7f86b00c8ff0 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a800ed60 con 0x7f86b00c8ff0 2023-10-08T16:11:16.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b00b4880 con 0x7f86b00c8ff0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.753+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8013670 con 0x7f86b00c8ff0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.754+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b01578e0 con 0x7f86b00c8ff0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.754+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b004c3c0 con 0x7f86b00c8ff0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.755+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86a80139e0 con 0x7f86b00c8ff0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.755+0000 7f86a5ffb700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.755+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86a8084b50 con 0x7f86b00c8ff0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.755+0000 7f86b58db700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.756+0000 7f86b58db700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8694066f30 0x7f86940693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0091e0 tx=0x7f86ac01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:16.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:16.760+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86a8051dc0 con 0x7f86b00c8ff0 2023-10-08T16:11:17.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.000+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86b00b4d30 con 0x7f86b00c8ff0 2023-10-08T16:11:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.601+0000 7f86a5ffb700 1 -- 172.21.15.60:0/1623685380 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86a80553e0 con 0x7f86b00c8ff0 2023-10-08T16:11:17.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8694066f30 msgr2=0x7f86940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8694066f30 0x7f86940693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0091e0 tx=0x7f86ac01a000 comp rx=0 tx=0).stop 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 msgr2=0x7f86b01573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 0x7f86b01573a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f86b006b0b0 tx=0x7f86a8001330 comp rx=0 tx=0).stop 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 shutdown_connections 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86b00c8ff0 0x7f86b01573a0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869c003a60 0x7f86b00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 --2- 172.21.15.60:0/1623685380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00b3b50 0x7f86b00c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 >> 172.21.15.60:0/1623685380 conn(0x7f86b00d1880 msgr2=0x7f86b00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 shutdown_connections 2023-10-08T16:11:17.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.603+0000 7f86b7b3f700 1 -- 172.21.15.60:0/1623685380 wait complete. 2023-10-08T16:11:17.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.740+0000 7f2395337700 1 Processor -- start 2023-10-08T16:11:17.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.740+0000 7f2395337700 1 -- start start 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f2395337700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23900688c0 0x7f2390153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f2395337700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 0x7f23901542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f2395337700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239015e7f0 con 0x7f2390068c90 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f2395337700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900ae180 con 0x7f23900688c0 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f2395337700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2390154820 con 0x7f239015acd0 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f238e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2390068c90 0x7f239015a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43732/0 (socket says 172.21.15.60:43732) 2023-10-08T16:11:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f238e7fc700 1 -- 172.21.15.60:0/1025233132 learned_addr learned my addr 172.21.15.60:0/1025233132 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949065727 0 0) 0x7f2378001110 con 0x7f2390068c90 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c003570 con 0x7f2390068c90 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f238f7fe700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 0x7f23901542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.741+0000 7f238effd700 1 --2- 172.21.15.60:0/1025233132 >> v2:172.21.15.144:3300/0 conn(0x7f23900688c0 0x7f2390153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130438111 0 0) 0x7f237c003570 con 0x7f2390068c90 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 msgr2=0x7f23901542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 0x7f23901542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 >> v2:172.21.15.144:3300/0 conn(0x7f23900688c0 msgr2=0x7f2390153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 --2- 172.21.15.60:0/1025233132 >> v2:172.21.15.144:3300/0 conn(0x7f23900688c0 0x7f2390153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239015da50 con 0x7f2390068c90 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f2378001600 con 0x7f2390068c90 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 >> v1:172.21.15.60:6789/0 conn(0x7f2390068c90 legacy=0x7f239015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 0x7f237c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c003fe0 0x7f237c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c004d50 0x7f237c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900ae180 con 0x7f237c004d50 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390154820 con 0x7f237c003fe0 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c00ba90 con 0x7f239015acd0 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c004d50 0x7f237c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238effd700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 0x7f237c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238e7fc700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c003fe0 0x7f237c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 -- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 msgr2=0x7f237c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f239015acd0 0x7f237c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 -- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c003fe0 msgr2=0x7f237c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f237c003fe0 0x7f237c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 -- 172.21.15.60:0/1025233132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c003570 con 0x7f237c004d50 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.742+0000 7f238f7fe700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c004d50 0x7f237c0051c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f238000e210 tx=0x7f238000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bec972ca3d20bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000ea60 con 0x7f237c004d50 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238000f040 con 0x7f237c004d50 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f238dffb700 1 -- 172.21.15.60:0/1025233132 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000ee10 con 0x7f237c004d50 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f2395337700 1 -- 172.21.15.60:0/1025233132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c004d50 msgr2=0x7f237c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f2395337700 1 --2- 172.21.15.60:0/1025233132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c004d50 0x7f237c0051c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f238000e210 tx=0x7f238000b040 comp rx=0 tx=0).stop 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f238f7fe700 1 -- 172.21.15.60:0/1025233132 reap_dead start 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f2395337700 1 -- 172.21.15.60:0/1025233132 shutdown_connections 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f2395337700 1 -- 172.21.15.60:0/1025233132 >> 172.21.15.60:0/1025233132 conn(0x7f23900ce390 msgr2=0x7f2390069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f2395337700 1 -- 172.21.15.60:0/1025233132 shutdown_connections 2023-10-08T16:11:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.743+0000 7f2395337700 1 -- 172.21.15.60:0/1025233132 wait complete. 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.744+0000 7f2395337700 1 Processor -- start 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.744+0000 7f2395337700 1 -- start start 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f2395337700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 0x7f239015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f2395337700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2390151ff0 0x7f2390155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f2395337700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f239015b3c0 0x7f23901591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f2395337700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239015c540 con 0x7f2390151c20 2023-10-08T16:11:17.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f2395337700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239015b930 con 0x7f239015b3c0 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f2395337700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239015bc10 con 0x7f2390151ff0 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 0x7f239015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 0x7f239015c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48142/0 (socket says 172.21.15.60:48142) 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238effd700 1 -- 172.21.15.60:0/1113840469 learned_addr learned my addr 172.21.15.60:0/1113840469 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238e7fc700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2390151ff0 0x7f2390155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238f7fe700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f239015b3c0 0x7f23901591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238effd700 1 -- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2390151ff0 msgr2=0x7f2390155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238effd700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2390151ff0 0x7f2390155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.745+0000 7f238effd700 1 -- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f239015b3c0 msgr2=0x7f23901591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f238effd700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f239015b3c0 0x7f23901591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f238effd700 1 -- 172.21.15.60:0/1113840469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239015bef0 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f238effd700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 0x7f239015c9d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2388006ac0 tx=0x7f23880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800fa10 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800fb70 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239015c1d0 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388014440 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.746+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2390159720 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.747+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239006d3a0 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.747+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2388014830 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.748+0000 7f2386ffd700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2370066f30 0x7f23700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.748+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2388018030 con 0x7f2390151c20 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.748+0000 7f238e7fc700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2370066f30 0x7f23700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:17.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.748+0000 7f238e7fc700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2370066f30 0x7f23700693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2378000e10 tx=0x7f2378009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:17.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.752+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23880521f0 con 0x7f2390151c20 2023-10-08T16:11:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.990+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f239006e160 con 0x7f2390151c20 2023-10-08T16:11:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.990+0000 7f2386ffd700 1 -- 172.21.15.60:0/1113840469 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2388055810 con 0x7f2390151c20 2023-10-08T16:11:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:17.991 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2370066f30 msgr2=0x7f23700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2370066f30 0x7f23700693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2378000e10 tx=0x7f2378009040 comp rx=0 tx=0).stop 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 msgr2=0x7f239015c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 0x7f239015c9d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2388006ac0 tx=0x7f23880091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 shutdown_connections 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2370066f30 0x7f23700693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f239015b3c0 0x7f23901591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390151c20 0x7f239015c9d0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 --2- 172.21.15.60:0/1113840469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2390151ff0 0x7f2390155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:17.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 >> 172.21.15.60:0/1113840469 conn(0x7f23900ce390 msgr2=0x7f23900ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:17.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.992+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 shutdown_connections 2023-10-08T16:11:17.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:17.993+0000 7f2395337700 1 -- 172.21.15.60:0/1113840469 wait complete. 2023-10-08T16:11:17.994 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:18.005 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.125+0000 7fa441ef0700 1 Processor -- start 2023-10-08T16:11:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.125+0000 7fa441ef0700 1 -- start start 2023-10-08T16:11:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.125+0000 7fa441ef0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa43c157870 0x7fa43c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.125+0000 7fa441ef0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa43c15a620 0x7fa43c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.125+0000 7fa441ef0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c15cbb0 con 0x7fa43c15d580 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.125+0000 7fa441ef0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c15bfa0 con 0x7fa43c15a620 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa441ef0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c15c280 con 0x7fa43c157870 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa43c15a620 0x7fa43c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa43c15d580 0x7fa43c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43734/0 (socket says 172.21.15.60:43734) 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43bfff700 1 -- 172.21.15.60:0/604578820 learned_addr learned my addr 172.21.15.60:0/604578820 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43b7fe700 1 --2- 172.21.15.60:0/604578820 >> v2:172.21.15.144:3300/0 conn(0x7fa43c157870 0x7fa43c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43affd700 1 -- 172.21.15.60:0/604578820 >> v2:172.21.15.144:3300/0 conn(0x7fa43c157870 msgr2=0x7fa43c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43affd700 1 --2- 172.21.15.60:0/604578820 >> v2:172.21.15.144:3300/0 conn(0x7fa43c157870 0x7fa43c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43affd700 1 -- 172.21.15.60:0/604578820 >> v1:172.21.15.60:6789/0 conn(0x7fa43c15d580 legacy=0x7fa43c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43affd700 1 -- 172.21.15.60:0/604578820 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c15c560 con 0x7fa43c15a620 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43a7fc700 1 -- 172.21.15.60:0/604578820 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937855452 0 0) 0x7fa43c15cbb0 con 0x7fa43c15d580 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43affd700 1 --2- 172.21.15.60:0/604578820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15a620 0x7fa43c15d040 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fa43c069d80 tx=0x7fa4240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42266dc8c984d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43a7fc700 1 -- 172.21.15.60:0/604578820 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011630 con 0x7fa43c15a620 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43a7fc700 1 -- 172.21.15.60:0/604578820 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424011790 con 0x7fa43c15a620 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.126+0000 7fa43a7fc700 1 -- 172.21.15.60:0/604578820 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011b30 con 0x7fa43c15a620 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 -- 172.21.15.60:0/604578820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15a620 msgr2=0x7fa43c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 --2- 172.21.15.60:0/604578820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15a620 0x7fa43c15d040 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fa43c069d80 tx=0x7fa4240091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 -- 172.21.15.60:0/604578820 shutdown_connections 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 --2- 172.21.15.60:0/604578820 >> v2:172.21.15.144:3300/0 conn(0x7fa43c157870 0x7fa43c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 --2- 172.21.15.60:0/604578820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15a620 0x7fa43c15d040 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 -- 172.21.15.60:0/604578820 >> 172.21.15.60:0/604578820 conn(0x7fa43c068ce0 msgr2=0x7fa43c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 -- 172.21.15.60:0/604578820 shutdown_connections 2023-10-08T16:11:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.127+0000 7fa441ef0700 1 -- 172.21.15.60:0/604578820 wait complete. 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.128+0000 7fa441ef0700 1 Processor -- start 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.128+0000 7fa441ef0700 1 -- start start 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa441ef0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c157870 0x7fa43c16e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa441ef0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa43c15a620 0x7fa43c1494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa441ef0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 0x7fa43c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa441ef0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0b4960 con 0x7fa43c15d580 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa441ef0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0b54a0 con 0x7fa43c157870 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa441ef0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0b1da0 con 0x7fa43c15a620 2023-10-08T16:11:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 0x7fa43c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 0x7fa43c14b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48166/0 (socket says 172.21.15.60:48166) 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 -- 172.21.15.60:0/2033080502 learned_addr learned my addr 172.21.15.60:0/2033080502 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43b7fe700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c157870 0x7fa43c16e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43affd700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa43c15a620 0x7fa43c1494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 -- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa43c15a620 msgr2=0x7fa43c1494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa43c15a620 0x7fa43c1494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 -- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c157870 msgr2=0x7fa43c16e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c157870 0x7fa43c16e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 -- 172.21.15.60:0/2033080502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424009420 con 0x7fa43c15d580 2023-10-08T16:11:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43affd700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa43c15a620 0x7fa43c1494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.129+0000 7fa43bfff700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 0x7fa43c14b270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa43400cbc0 tx=0x7fa434001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.130+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400a940 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.130+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400aaa0 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.130+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c0b6c10 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.130+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400ae60 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.130+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c0b4e50 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.131+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0b5610 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.131+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa434007300 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.131+0000 7fa4337fe700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa41c066f60 0x7fa41c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.131+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4340848b0 con 0x7fa43c15d580 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.131+0000 7fa43b7fe700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa41c066f60 0x7fa41c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.132+0000 7fa43b7fe700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa41c066f60 0x7fa41c069410 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009d40 tx=0x7fa42c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.136+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa434051ba0 con 0x7fa43c15d580 2023-10-08T16:11:18.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.333+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa43c04c3c0 con 0x7fa43c15d580 2023-10-08T16:11:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.334+0000 7fa4337fe700 1 -- 172.21.15.60:0/2033080502 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fa4340551c0 con 0x7fa43c15d580 2023-10-08T16:11:18.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:18.334 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":132,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:15.573296+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:11:12.441833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:11:12.936737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa41c066f60 msgr2=0x7fa41c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa41c066f60 0x7fa41c069410 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009d40 tx=0x7fa42c008040 comp rx=0 tx=0).stop 2023-10-08T16:11:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 msgr2=0x7fa43c14b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 0x7fa43c14b270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa43400cbc0 tx=0x7fa434001980 comp rx=0 tx=0).stop 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 shutdown_connections 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa41c066f60 0x7fa41c069410 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c15d580 0x7fa43c14b270 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c157870 0x7fa43c16e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 --2- 172.21.15.60:0/2033080502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa43c15a620 0x7fa43c1494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 >> 172.21.15.60:0/2033080502 conn(0x7fa43c068ce0 msgr2=0x7fa43c14c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 shutdown_connections 2023-10-08T16:11:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.336+0000 7fa441ef0700 1 -- 172.21.15.60:0/2033080502 wait complete. 2023-10-08T16:11:18.349 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:11:18.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:11:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.468+0000 7fe11507a700 1 Processor -- start 2023-10-08T16:11:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.468+0000 7fe11507a700 1 -- start start 2023-10-08T16:11:18.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe11507a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1100cc720 0x7fe1100cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe11507a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1100caa60 con 0x7fe1100c9200 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe11507a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1100cf570 con 0x7fe1100cba50 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe11507a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100cb5c0 con 0x7fe1100cc720 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe10e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe1100c9200 0x7fe1100b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43750/0 (socket says 172.21.15.60:43750) 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe10e59c700 1 -- 172.21.15.60:0/1418368005 learned_addr learned my addr 172.21.15.60:0/1418368005 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe10ed9d700 1 --2- 172.21.15.60:0/1418368005 >> v2:172.21.15.144:3300/0 conn(0x7fe1100cc720 0x7fe1100cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970099474 0 0) 0x7fe1100caa60 con 0x7fe1100c9200 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.469+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0fc003570 con 0x7fe1100c9200 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518986295 0 0) 0x7fe0fc003570 con 0x7fe1100c9200 2023-10-08T16:11:18.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 >> v2:172.21.15.144:3300/0 conn(0x7fe1100cc720 msgr2=0x7fe1100cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 --2- 172.21.15.60:0/1418368005 >> v2:172.21.15.144:3300/0 conn(0x7fe1100cc720 0x7fe1100cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 >> v1:172.21.15.144:6789/0 conn(0x7fe1100cba50 legacy=0x7fe1100cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100b2000 con 0x7fe1100c9200 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fe0f8001470 con 0x7fe1100c9200 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 >> v1:172.21.15.60:6789/0 conn(0x7fe1100c9200 legacy=0x7fe1100b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc003a60 0x7fe0fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0fc004810 0x7fe0fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0fc0051c0 0x7fe0fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100cb5c0 con 0x7fe0fc004810 2023-10-08T16:11:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc00c0d0 con 0x7fe0fc003a60 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc00c290 con 0x7fe0fc0051c0 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0fc004810 0x7fe0fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10ed9d700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc003a60 0x7fe0fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 -- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0fc0051c0 msgr2=0x7fe0fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10f59e700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0fc0051c0 0x7fe0fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0fc0051c0 0x7fe0fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 -- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc003a60 msgr2=0x7fe0fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc003a60 0x7fe0fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 -- 172.21.15.60:0/1418368005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc003570 con 0x7fe0fc004810 2023-10-08T16:11:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10f59e700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0fc0051c0 0x7fe0fc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10f59e700 1 -- 172.21.15.60:0/1418368005 reap_dead start 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.470+0000 7fe10e59c700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0fc004810 0x7fe0fc004c80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c9640 tx=0x7fe1100cb700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb655c5769913b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800cc30 con 0x7fe0fc004810 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f800cd90 con 0x7fe0fc004810 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe10dd9b700 1 -- 172.21.15.60:0/1418368005 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8005b70 con 0x7fe0fc004810 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 -- 172.21.15.60:0/1418368005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0fc004810 msgr2=0x7fe0fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0fc004810 0x7fe0fc004c80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c9640 tx=0x7fe1100cb700 comp rx=0 tx=0).stop 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 -- 172.21.15.60:0/1418368005 shutdown_connections 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 --2- 172.21.15.60:0/1418368005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0fc004810 0x7fe0fc004c80 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 -- 172.21.15.60:0/1418368005 >> 172.21.15.60:0/1418368005 conn(0x7fe11006c6e0 msgr2=0x7fe110069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 -- 172.21.15.60:0/1418368005 shutdown_connections 2023-10-08T16:11:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.471+0000 7fe11507a700 1 -- 172.21.15.60:0/1418368005 wait complete. 2023-10-08T16:11:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.472+0000 7fe11507a700 1 Processor -- start 2023-10-08T16:11:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.472+0000 7fe11507a700 1 -- start start 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe11507a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc004810 0x7fe110168350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe11507a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 0x7fe11015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe11507a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1100a8050 0x7fe1100a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe11507a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100a8a10 con 0x7fe1100a78c0 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe11507a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100a6820 con 0x7fe0fc004810 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe11507a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100a6b00 con 0x7fe1100a8050 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe10e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 0x7fe11015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe10e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 0x7fe11015a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48184/0 (socket says 172.21.15.60:48184) 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.473+0000 7fe10e59c700 1 -- 172.21.15.60:0/257513892 learned_addr learned my addr 172.21.15.60:0/257513892 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10e59c700 1 -- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1100a8050 msgr2=0x7fe1100a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10e59c700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1100a8050 0x7fe1100a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10e59c700 1 -- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc004810 msgr2=0x7fe110168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10ed9d700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc004810 0x7fe110168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10e59c700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc004810 0x7fe110168350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10e59c700 1 -- 172.21.15.60:0/257513892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100a6de0 con 0x7fe1100a78c0 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe10e59c700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 0x7fe11015a940 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c0a0 tx=0x7fe0f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80017e0 con 0x7fe1100a78c0 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f80070d0 con 0x7fe1100a78c0 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100a70c0 con 0x7fe1100a78c0 2023-10-08T16:11:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80074b0 con 0x7fe1100a78c0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.474+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110168890 con 0x7fe1100a78c0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.475+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11004c3c0 con 0x7fe1100a78c0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.475+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0f80273b0 con 0x7fe1100a78c0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.476+0000 7fe106ffd700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe0f0066f30 0x7fe0f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.476+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0f8085130 con 0x7fe1100a78c0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.476+0000 7fe10ed9d700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe0f0066f30 0x7fe0f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.476+0000 7fe10ed9d700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe0f0066f30 0x7fe0f00693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe1080093f0 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.480+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0f8052300 con 0x7fe1100a78c0 2023-10-08T16:11:18.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.668+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1100cac90 con 0x7fe0f0066f30 2023-10-08T16:11:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.676+0000 7fe106ffd700 1 -- 172.21.15.60:0/257513892 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285144 (secure 0 0 0) 0x7fe1100cac90 con 0x7fe0f0066f30 2023-10-08T16:11:18.679 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.679+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe0f0066f30 msgr2=0x7fe0f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.679+0000 7fe11507a700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe0f0066f30 0x7fe0f00693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe1080093f0 tx=0x7fe108008040 comp rx=0 tx=0).stop 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.679+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 msgr2=0x7fe11015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.679+0000 7fe11507a700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 0x7fe11015a940 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c0a0 tx=0x7fe0f8015000 comp rx=0 tx=0).stop 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 shutdown_connections 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe0f0066f30 0x7fe0f00693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1100a8050 0x7fe1100a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc004810 0x7fe110168350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 --2- 172.21.15.60:0/257513892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1100a78c0 0x7fe11015a940 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 >> 172.21.15.60:0/257513892 conn(0x7fe11006c6e0 msgr2=0x7fe1100c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 shutdown_connections 2023-10-08T16:11:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.680+0000 7fe11507a700 1 -- 172.21.15.60:0/257513892 wait complete. 2023-10-08T16:11:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:11:18.692 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-08T16:11:17.640484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555696,"statfs":{"total":1600000000,"available":1593033516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.082313"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.595165+0000","last_change":"2023-10-08T16:11:14.595165+0000","last_active":"2023-10-08T16:11:14.595165+0000","last_peered":"2023-10-08T16:11:14.595165+0000","last_clean":"2023-10-08T16:11:14.595165+0000","last_became_active":"2023-10-08T16:11:14.594868+0000","last_became_peered":"2023-10-08T16:11:14.594868+0000","last_unstale":"2023-10-08T16:11:14.595165+0000","last_undegraded":"2023-10-08T16:11:14.595165+0000","last_fullsized":"2023-10-08T16:11:14.595165+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:31.844401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585772+0000","last_change":"2023-10-08T16:11:14.585772+0000","last_active":"2023-10-08T16:11:14.585772+0000","last_peered":"2023-10-08T16:11:14.585772+0000","last_clean":"2023-10-08T16:11:14.585772+0000","last_became_active":"2023-10-08T16:11:14.583326+0000","last_became_peered":"2023-10-08T16:11:14.583326+0000","last_unstale":"2023-10-08T16:11:14.585772+0000","last_undegraded":"2023-10-08T16:11:14.585772+0000","last_fullsized":"2023-10-08T16:11:14.585772+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591668+0000","last_change":"2023-10-08T16:11:14.591668+0000","last_active":"2023-10-08T16:11:14.591668+0000","last_peered":"2023-10-08T16:11:14.591668+0000","last_clean":"2023-10-08T16:11:14.591668+0000","last_became_active":"2023-10-08T16:11:14.591136+0000","last_became_peered":"2023-10-08T16:11:14.591136+0000","last_unstale":"2023-10-08T16:11:14.591668+0000","last_undegraded":"2023-10-08T16:11:14.591668+0000","last_fullsized":"2023-10-08T16:11:14.591668+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589795+0000","last_change":"2023-10-08T16:11:14.589795+0000","last_active":"2023-10-08T16:11:14.589795+0000","last_peered":"2023-10-08T16:11:14.589795+0000","last_clean":"2023-10-08T16:11:14.589795+0000","last_became_active":"2023-10-08T16:11:14.589062+0000","last_became_peered":"2023-10-08T16:11:14.589062+0000","last_unstale":"2023-10-08T16:11:14.589795+0000","last_undegraded":"2023-10-08T16:11:14.589795+0000","last_fullsized":"2023-10-08T16:11:14.589795+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:09.422866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579604+0000","last_change":"2023-10-08T16:11:14.579604+0000","last_active":"2023-10-08T16:11:14.579604+0000","last_peered":"2023-10-08T16:11:14.579604+0000","last_clean":"2023-10-08T16:11:14.579604+0000","last_became_active":"2023-10-08T16:11:14.579368+0000","last_became_peered":"2023-10-08T16:11:14.579368+0000","last_unstale":"2023-10-08T16:11:14.579604+0000","last_undegraded":"2023-10-08T16:11:14.579604+0000","last_fullsized":"2023-10-08T16:11:14.579604+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:45.213395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585431+0000","last_change":"2023-10-08T16:11:14.585385+0000","last_active":"2023-10-08T16:11:14.585431+0000","last_peered":"2023-10-08T16:11:14.585431+0000","last_clean":"2023-10-08T16:11:14.585431+0000","last_became_active":"2023-10-08T16:11:14.584913+0000","last_became_peered":"2023-10-08T16:11:14.584913+0000","last_unstale":"2023-10-08T16:11:14.585431+0000","last_undegraded":"2023-10-08T16:11:14.585431+0000","last_fullsized":"2023-10-08T16:11:14.585431+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.061947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591228+0000","last_change":"2023-10-08T16:11:14.590960+0000","last_active":"2023-10-08T16:11:14.591228+0000","last_peered":"2023-10-08T16:11:14.591228+0000","last_clean":"2023-10-08T16:11:14.591228+0000","last_became_active":"2023-10-08T16:11:14.590705+0000","last_became_peered":"2023-10-08T16:11:14.590705+0000","last_unstale":"2023-10-08T16:11:14.591228+0000","last_undegraded":"2023-10-08T16:11:14.591228+0000","last_fullsized":"2023-10-08T16:11:14.591228+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:40.435123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585324+0000","last_change":"2023-10-08T16:11:14.585324+0000","last_active":"2023-10-08T16:11:14.585324+0000","last_peered":"2023-10-08T16:11:14.585324+0000","last_clean":"2023-10-08T16:11:14.585324+0000","last_became_active":"2023-10-08T16:11:14.585085+0000","last_became_peered":"2023-10-08T16:11:14.585085+0000","last_unstale":"2023-10-08T16:11:14.585324+0000","last_undegraded":"2023-10-08T16:11:14.585324+0000","last_fullsized":"2023-10-08T16:11:14.585324+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589937+0000","last_change":"2023-10-08T16:11:14.589937+0000","last_active":"2023-10-08T16:11:14.589937+0000","last_peered":"2023-10-08T16:11:14.589937+0000","last_clean":"2023-10-08T16:11:14.589937+0000","last_became_active":"2023-10-08T16:11:14.589561+0000","last_became_peered":"2023-10-08T16:11:14.589561+0000","last_unstale":"2023-10-08T16:11:14.589937+0000","last_undegraded":"2023-10-08T16:11:14.589937+0000","last_fullsized":"2023-10-08T16:11:14.589937+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:37.329054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591416+0000","last_change":"2023-10-08T16:11:14.591416+0000","last_active":"2023-10-08T16:11:14.591416+0000","last_peered":"2023-10-08T16:11:14.591416+0000","last_clean":"2023-10-08T16:11:14.591416+0000","last_became_active":"2023-10-08T16:11:14.590716+0000","last_became_peered":"2023-10-08T16:11:14.590716+0000","last_unstale":"2023-10-08T16:11:14.591416+0000","last_undegraded":"2023-10-08T16:11:14.591416+0000","last_fullsized":"2023-10-08T16:11:14.591416+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:45.648926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584025+0000","last_change":"2023-10-08T16:11:14.584025+0000","last_active":"2023-10-08T16:11:14.584025+0000","last_peered":"2023-10-08T16:11:14.584025+0000","last_clean":"2023-10-08T16:11:14.584025+0000","last_became_active":"2023-10-08T16:11:14.583810+0000","last_became_peered":"2023-10-08T16:11:14.583810+0000","last_unstale":"2023-10-08T16:11:14.584025+0000","last_undegraded":"2023-10-08T16:11:14.584025+0000","last_fullsized":"2023-10-08T16:11:14.584025+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:06.503245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582843+0000","last_change":"2023-10-08T16:11:14.582843+0000","last_active":"2023-10-08T16:11:14.582843+0000","last_peered":"2023-10-08T16:11:14.582843+0000","last_clean":"2023-10-08T16:11:14.582843+0000","last_became_active":"2023-10-08T16:11:14.582613+0000","last_became_peered":"2023-10-08T16:11:14.582613+0000","last_unstale":"2023-10-08T16:11:14.582843+0000","last_undegraded":"2023-10-08T16:11:14.582843+0000","last_fullsized":"2023-10-08T16:11:14.582843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:34.444738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586303+0000","last_change":"2023-10-08T16:11:14.586303+0000","last_active":"2023-10-08T16:11:14.586303+0000","last_peered":"2023-10-08T16:11:14.586303+0000","last_clean":"2023-10-08T16:11:14.586303+0000","last_became_active":"2023-10-08T16:11:14.585890+0000","last_became_peered":"2023-10-08T16:11:14.585890+0000","last_unstale":"2023-10-08T16:11:14.586303+0000","last_undegraded":"2023-10-08T16:11:14.586303+0000","last_fullsized":"2023-10-08T16:11:14.586303+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.592635+0000","last_change":"2023-10-08T16:11:14.592635+0000","last_active":"2023-10-08T16:11:14.592635+0000","last_peered":"2023-10-08T16:11:14.592635+0000","last_clean":"2023-10-08T16:11:14.592635+0000","last_became_active":"2023-10-08T16:11:14.592112+0000","last_became_peered":"2023-10-08T16:11:14.592112+0000","last_unstale":"2023-10-08T16:11:14.592635+0000","last_undegraded":"2023-10-08T16:11:14.592635+0000","last_fullsized":"2023-10-08T16:11:14.592635+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:53.910334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579986+0000","last_change":"2023-10-08T16:11:14.579759+0000","last_active":"2023-10-08T16:11:14.579986+0000","last_peered":"2023-10-08T16:11:14.579986+0000","last_clean":"2023-10-08T16:11:14.579986+0000","last_became_active":"2023-10-08T16:11:14.579520+0000","last_became_peered":"2023-10-08T16:11:14.579520+0000","last_unstale":"2023-10-08T16:11:14.579986+0000","last_undegraded":"2023-10-08T16:11:14.579986+0000","last_fullsized":"2023-10-08T16:11:14.579986+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:29:27.212256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.593664+0000","last_change":"2023-10-08T16:11:14.593664+0000","last_active":"2023-10-08T16:11:14.593664+0000","last_peered":"2023-10-08T16:11:14.593664+0000","last_clean":"2023-10-08T16:11:14.593664+0000","last_became_active":"2023-10-08T16:11:14.592892+0000","last_became_peered":"2023-10-08T16:11:14.592892+0000","last_unstale":"2023-10-08T16:11:14.593664+0000","last_undegraded":"2023-10-08T16:11:14.593664+0000","last_fullsized":"2023-10-08T16:11:14.593664+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:44.383672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586557+0000","last_change":"2023-10-08T16:11:14.586557+0000","last_active":"2023-10-08T16:11:14.586557+0000","last_peered":"2023-10-08T16:11:14.586557+0000","last_clean":"2023-10-08T16:11:14.586557+0000","last_became_active":"2023-10-08T16:11:14.586142+0000","last_became_peered":"2023-10-08T16:11:14.586142+0000","last_unstale":"2023-10-08T16:11:14.586557+0000","last_undegraded":"2023-10-08T16:11:14.586557+0000","last_fullsized":"2023-10-08T16:11:14.586557+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589044+0000","last_change":"2023-10-08T16:11:14.588970+0000","last_active":"2023-10-08T16:11:14.589044+0000","last_peered":"2023-10-08T16:11:14.589044+0000","last_clean":"2023-10-08T16:11:14.589044+0000","last_became_active":"2023-10-08T16:11:14.588741+0000","last_became_peered":"2023-10-08T16:11:14.588741+0000","last_unstale":"2023-10-08T16:11:14.589044+0000","last_undegraded":"2023-10-08T16:11:14.589044+0000","last_fullsized":"2023-10-08T16:11:14.589044+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:10.122569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588588+0000","last_change":"2023-10-08T16:11:14.588588+0000","last_active":"2023-10-08T16:11:14.588588+0000","last_peered":"2023-10-08T16:11:14.588588+0000","last_clean":"2023-10-08T16:11:14.588588+0000","last_became_active":"2023-10-08T16:11:14.588008+0000","last_became_peered":"2023-10-08T16:11:14.588008+0000","last_unstale":"2023-10-08T16:11:14.588588+0000","last_undegraded":"2023-10-08T16:11:14.588588+0000","last_fullsized":"2023-10-08T16:11:14.588588+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:20.196343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585046+0000","last_change":"2023-10-08T16:11:14.585046+0000","last_active":"2023-10-08T16:11:14.585046+0000","last_peered":"2023-10-08T16:11:14.585046+0000","last_clean":"2023-10-08T16:11:14.585046+0000","last_became_active":"2023-10-08T16:11:14.584516+0000","last_became_peered":"2023-10-08T16:11:14.584516+0000","last_unstale":"2023-10-08T16:11:14.585046+0000","last_undegraded":"2023-10-08T16:11:14.585046+0000","last_fullsized":"2023-10-08T16:11:14.585046+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:03.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583573+0000","last_change":"2023-10-08T16:11:14.583573+0000","last_active":"2023-10-08T16:11:14.583573+0000","last_peered":"2023-10-08T16:11:14.583573+0000","last_clean":"2023-10-08T16:11:14.583573+0000","last_became_active":"2023-10-08T16:11:14.583196+0000","last_became_peered":"2023-10-08T16:11:14.583196+0000","last_unstale":"2023-10-08T16:11:14.583573+0000","last_undegraded":"2023-10-08T16:11:14.583573+0000","last_fullsized":"2023-10-08T16:11:14.583573+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:58.288656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584414+0000","last_change":"2023-10-08T16:11:14.584414+0000","last_active":"2023-10-08T16:11:14.584414+0000","last_peered":"2023-10-08T16:11:14.584414+0000","last_clean":"2023-10-08T16:11:14.584414+0000","last_became_active":"2023-10-08T16:11:14.584154+0000","last_became_peered":"2023-10-08T16:11:14.584154+0000","last_unstale":"2023-10-08T16:11:14.584414+0000","last_undegraded":"2023-10-08T16:11:14.584414+0000","last_fullsized":"2023-10-08T16:11:14.584414+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588041+0000","last_change":"2023-10-08T16:11:14.588041+0000","last_active":"2023-10-08T16:11:14.588041+0000","last_peered":"2023-10-08T16:11:14.588041+0000","last_clean":"2023-10-08T16:11:14.588041+0000","last_became_active":"2023-10-08T16:11:14.587801+0000","last_became_peered":"2023-10-08T16:11:14.587801+0000","last_unstale":"2023-10-08T16:11:14.588041+0000","last_undegraded":"2023-10-08T16:11:14.588041+0000","last_fullsized":"2023-10-08T16:11:14.588041+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.587842+0000","last_change":"2023-10-08T16:11:14.587842+0000","last_active":"2023-10-08T16:11:14.587842+0000","last_peered":"2023-10-08T16:11:14.587842+0000","last_clean":"2023-10-08T16:11:14.587842+0000","last_became_active":"2023-10-08T16:11:14.587596+0000","last_became_peered":"2023-10-08T16:11:14.587596+0000","last_unstale":"2023-10-08T16:11:14.587842+0000","last_undegraded":"2023-10-08T16:11:14.587842+0000","last_fullsized":"2023-10-08T16:11:14.587842+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:11.562994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585190+0000","last_change":"2023-10-08T16:11:14.585190+0000","last_active":"2023-10-08T16:11:14.585190+0000","last_peered":"2023-10-08T16:11:14.585190+0000","last_clean":"2023-10-08T16:11:14.585190+0000","last_became_active":"2023-10-08T16:11:14.584828+0000","last_became_peered":"2023-10-08T16:11:14.584828+0000","last_unstale":"2023-10-08T16:11:14.585190+0000","last_undegraded":"2023-10-08T16:11:14.585190+0000","last_fullsized":"2023-10-08T16:11:14.585190+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:36.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.593397+0000","last_change":"2023-10-08T16:11:14.593397+0000","last_active":"2023-10-08T16:11:14.593397+0000","last_peered":"2023-10-08T16:11:14.593397+0000","last_clean":"2023-10-08T16:11:14.593397+0000","last_became_active":"2023-10-08T16:11:14.592608+0000","last_became_peered":"2023-10-08T16:11:14.592608+0000","last_unstale":"2023-10-08T16:11:14.593397+0000","last_undegraded":"2023-10-08T16:11:14.593397+0000","last_fullsized":"2023-10-08T16:11:14.593397+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:42.726267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584608+0000","last_change":"2023-10-08T16:11:14.584531+0000","last_active":"2023-10-08T16:11:14.584608+0000","last_peered":"2023-10-08T16:11:14.584608+0000","last_clean":"2023-10-08T16:11:14.584608+0000","last_became_active":"2023-10-08T16:11:14.584287+0000","last_became_peered":"2023-10-08T16:11:14.584287+0000","last_unstale":"2023-10-08T16:11:14.584608+0000","last_undegraded":"2023-10-08T16:11:14.584608+0000","last_fullsized":"2023-10-08T16:11:14.584608+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:23.041664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589150+0000","last_change":"2023-10-08T16:11:14.589150+0000","last_active":"2023-10-08T16:11:14.589150+0000","last_peered":"2023-10-08T16:11:14.589150+0000","last_clean":"2023-10-08T16:11:14.589150+0000","last_became_active":"2023-10-08T16:11:14.588842+0000","last_became_peered":"2023-10-08T16:11:14.588842+0000","last_unstale":"2023-10-08T16:11:14.589150+0000","last_undegraded":"2023-10-08T16:11:14.589150+0000","last_fullsized":"2023-10-08T16:11:14.589150+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:06.503245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590052+0000","last_change":"2023-10-08T16:11:14.590052+0000","last_active":"2023-10-08T16:11:14.590052+0000","last_peered":"2023-10-08T16:11:14.590052+0000","last_clean":"2023-10-08T16:11:14.590052+0000","last_became_active":"2023-10-08T16:11:14.589627+0000","last_became_peered":"2023-10-08T16:11:14.589627+0000","last_unstale":"2023-10-08T16:11:14.590052+0000","last_undegraded":"2023-10-08T16:11:14.590052+0000","last_fullsized":"2023-10-08T16:11:14.590052+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:48.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579983+0000","last_change":"2023-10-08T16:11:14.579877+0000","last_active":"2023-10-08T16:11:14.579983+0000","last_peered":"2023-10-08T16:11:14.579983+0000","last_clean":"2023-10-08T16:11:14.579983+0000","last_became_active":"2023-10-08T16:11:14.579635+0000","last_became_peered":"2023-10-08T16:11:14.579635+0000","last_unstale":"2023-10-08T16:11:14.579983+0000","last_undegraded":"2023-10-08T16:11:14.579983+0000","last_fullsized":"2023-10-08T16:11:14.579983+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:01.353992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589188+0000","last_change":"2023-10-08T16:11:14.589188+0000","last_active":"2023-10-08T16:11:14.589188+0000","last_peered":"2023-10-08T16:11:14.589188+0000","last_clean":"2023-10-08T16:11:14.589188+0000","last_became_active":"2023-10-08T16:11:14.588898+0000","last_became_peered":"2023-10-08T16:11:14.588898+0000","last_unstale":"2023-10-08T16:11:14.589188+0000","last_undegraded":"2023-10-08T16:11:14.589188+0000","last_fullsized":"2023-10-08T16:11:14.589188+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:42.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580895+0000","last_change":"2023-10-08T16:11:14.580828+0000","last_active":"2023-10-08T16:11:14.580895+0000","last_peered":"2023-10-08T16:11:14.580895+0000","last_clean":"2023-10-08T16:11:14.580895+0000","last_became_active":"2023-10-08T16:11:14.580112+0000","last_became_peered":"2023-10-08T16:11:14.580112+0000","last_unstale":"2023-10-08T16:11:14.580895+0000","last_undegraded":"2023-10-08T16:11:14.580895+0000","last_fullsized":"2023-10-08T16:11:14.580895+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:22:27.843140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579241+0000","last_change":"2023-10-08T16:11:14.579174+0000","last_active":"2023-10-08T16:11:14.579241+0000","last_peered":"2023-10-08T16:11:14.579241+0000","last_clean":"2023-10-08T16:11:14.579241+0000","last_became_active":"2023-10-08T16:11:14.578932+0000","last_became_peered":"2023-10-08T16:11:14.578932+0000","last_unstale":"2023-10-08T16:11:14.579241+0000","last_undegraded":"2023-10-08T16:11:14.579241+0000","last_fullsized":"2023-10-08T16:11:14.579241+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:22.432335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"131'4","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596159+0000","last_change":"2023-10-08T16:11:13.576673+0000","last_active":"2023-10-08T16:11:14.596159+0000","last_peered":"2023-10-08T16:11:14.596159+0000","last_clean":"2023-10-08T16:11:14.596159+0000","last_became_active":"2023-10-08T16:11:13.576435+0000","last_became_peered":"2023-10-08T16:11:13.576435+0000","last_unstale":"2023-10-08T16:11:14.596159+0000","last_undegraded":"2023-10-08T16:11:14.596159+0000","last_fullsized":"2023-10-08T16:11:14.596159+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:44.206838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584755+0000","last_change":"2023-10-08T16:11:14.584524+0000","last_active":"2023-10-08T16:11:14.584755+0000","last_peered":"2023-10-08T16:11:14.584755+0000","last_clean":"2023-10-08T16:11:14.584755+0000","last_became_active":"2023-10-08T16:11:14.584297+0000","last_became_peered":"2023-10-08T16:11:14.584297+0000","last_unstale":"2023-10-08T16:11:14.584755+0000","last_undegraded":"2023-10-08T16:11:14.584755+0000","last_fullsized":"2023-10-08T16:11:14.584755+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"131'1","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582716+0000","last_change":"2023-10-08T16:11:13.575451+0000","last_active":"2023-10-08T16:11:14.582716+0000","last_peered":"2023-10-08T16:11:14.582716+0000","last_clean":"2023-10-08T16:11:14.582716+0000","last_became_active":"2023-10-08T16:11:13.575234+0000","last_became_peered":"2023-10-08T16:11:13.575234+0000","last_unstale":"2023-10-08T16:11:14.582716+0000","last_undegraded":"2023-10-08T16:11:14.582716+0000","last_fullsized":"2023-10-08T16:11:14.582716+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:21.425778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585524+0000","last_change":"2023-10-08T16:11:14.585481+0000","last_active":"2023-10-08T16:11:14.585524+0000","last_peered":"2023-10-08T16:11:14.585524+0000","last_clean":"2023-10-08T16:11:14.585524+0000","last_became_active":"2023-10-08T16:11:14.585251+0000","last_became_peered":"2023-10-08T16:11:14.585251+0000","last_unstale":"2023-10-08T16:11:14.585524+0000","last_undegraded":"2023-10-08T16:11:14.585524+0000","last_fullsized":"2023-10-08T16:11:14.585524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:09.845088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596118+0000","last_change":"2023-10-08T16:11:13.572382+0000","last_active":"2023-10-08T16:11:14.596118+0000","last_peered":"2023-10-08T16:11:14.596118+0000","last_clean":"2023-10-08T16:11:14.596118+0000","last_became_active":"2023-10-08T16:11:13.572154+0000","last_became_peered":"2023-10-08T16:11:13.572154+0000","last_unstale":"2023-10-08T16:11:14.596118+0000","last_undegraded":"2023-10-08T16:11:14.596118+0000","last_fullsized":"2023-10-08T16:11:14.596118+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:24.552931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585254+0000","last_change":"2023-10-08T16:11:14.585254+0000","last_active":"2023-10-08T16:11:14.585254+0000","last_peered":"2023-10-08T16:11:14.585254+0000","last_clean":"2023-10-08T16:11:14.585254+0000","last_became_active":"2023-10-08T16:11:14.584739+0000","last_became_peered":"2023-10-08T16:11:14.584739+0000","last_unstale":"2023-10-08T16:11:14.585254+0000","last_undegraded":"2023-10-08T16:11:14.585254+0000","last_fullsized":"2023-10-08T16:11:14.585254+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:48.540791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596565+0000","last_change":"2023-10-08T16:11:13.566206+0000","last_active":"2023-10-08T16:11:14.596565+0000","last_peered":"2023-10-08T16:11:14.596565+0000","last_clean":"2023-10-08T16:11:14.596565+0000","last_became_active":"2023-10-08T16:11:13.565618+0000","last_became_peered":"2023-10-08T16:11:13.565618+0000","last_unstale":"2023-10-08T16:11:14.596565+0000","last_undegraded":"2023-10-08T16:11:14.596565+0000","last_fullsized":"2023-10-08T16:11:14.596565+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:36.674755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584081+0000","last_change":"2023-10-08T16:11:14.584081+0000","last_active":"2023-10-08T16:11:14.584081+0000","last_peered":"2023-10-08T16:11:14.584081+0000","last_clean":"2023-10-08T16:11:14.584081+0000","last_became_active":"2023-10-08T16:11:14.583653+0000","last_became_peered":"2023-10-08T16:11:14.583653+0000","last_unstale":"2023-10-08T16:11:14.584081+0000","last_undegraded":"2023-10-08T16:11:14.584081+0000","last_fullsized":"2023-10-08T16:11:14.584081+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:45.151802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"131'1","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596105+0000","last_change":"2023-10-08T16:11:13.574524+0000","last_active":"2023-10-08T16:11:14.596105+0000","last_peered":"2023-10-08T16:11:14.596105+0000","last_clean":"2023-10-08T16:11:14.596105+0000","last_became_active":"2023-10-08T16:11:13.574195+0000","last_became_peered":"2023-10-08T16:11:13.574195+0000","last_unstale":"2023-10-08T16:11:14.596105+0000","last_undegraded":"2023-10-08T16:11:14.596105+0000","last_fullsized":"2023-10-08T16:11:14.596105+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:34:58.236500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585919+0000","last_change":"2023-10-08T16:11:14.585919+0000","last_active":"2023-10-08T16:11:14.585919+0000","last_peered":"2023-10-08T16:11:14.585919+0000","last_clean":"2023-10-08T16:11:14.585919+0000","last_became_active":"2023-10-08T16:11:14.583635+0000","last_became_peered":"2023-10-08T16:11:14.583635+0000","last_unstale":"2023-10-08T16:11:14.585919+0000","last_undegraded":"2023-10-08T16:11:14.585919+0000","last_fullsized":"2023-10-08T16:11:14.585919+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"131'1","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.574967+0000","last_change":"2023-10-08T16:11:13.569944+0000","last_active":"2023-10-08T16:11:14.574967+0000","last_peered":"2023-10-08T16:11:14.574967+0000","last_clean":"2023-10-08T16:11:14.574967+0000","last_became_active":"2023-10-08T16:11:13.569767+0000","last_became_peered":"2023-10-08T16:11:13.569767+0000","last_unstale":"2023-10-08T16:11:14.574967+0000","last_undegraded":"2023-10-08T16:11:14.574967+0000","last_fullsized":"2023-10-08T16:11:14.574967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:22.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591288+0000","last_change":"2023-10-08T16:11:14.591288+0000","last_active":"2023-10-08T16:11:14.591288+0000","last_peered":"2023-10-08T16:11:14.591288+0000","last_clean":"2023-10-08T16:11:14.591288+0000","last_became_active":"2023-10-08T16:11:14.590300+0000","last_became_peered":"2023-10-08T16:11:14.590300+0000","last_unstale":"2023-10-08T16:11:14.591288+0000","last_undegraded":"2023-10-08T16:11:14.591288+0000","last_fullsized":"2023-10-08T16:11:14.591288+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:54.581312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.574663+0000","last_change":"2023-10-08T16:11:13.574174+0000","last_active":"2023-10-08T16:11:13.574663+0000","last_peered":"2023-10-08T16:11:13.574663+0000","last_clean":"2023-10-08T16:11:13.574663+0000","last_became_active":"2023-10-08T16:11:13.573912+0000","last_became_peered":"2023-10-08T16:11:13.573912+0000","last_unstale":"2023-10-08T16:11:13.574663+0000","last_undegraded":"2023-10-08T16:11:13.574663+0000","last_fullsized":"2023-10-08T16:11:13.574663+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:22.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585259+0000","last_change":"2023-10-08T16:11:14.584704+0000","last_active":"2023-10-08T16:11:14.585259+0000","last_peered":"2023-10-08T16:11:14.585259+0000","last_clean":"2023-10-08T16:11:14.585259+0000","last_became_active":"2023-10-08T16:11:14.584498+0000","last_became_peered":"2023-10-08T16:11:14.584498+0000","last_unstale":"2023-10-08T16:11:14.585259+0000","last_undegraded":"2023-10-08T16:11:14.585259+0000","last_fullsized":"2023-10-08T16:11:14.585259+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:00.283505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.578674+0000","last_change":"2023-10-08T16:11:13.578595+0000","last_active":"2023-10-08T16:11:13.578674+0000","last_peered":"2023-10-08T16:11:13.578674+0000","last_clean":"2023-10-08T16:11:13.578674+0000","last_became_active":"2023-10-08T16:11:13.578323+0000","last_became_peered":"2023-10-08T16:11:13.578323+0000","last_unstale":"2023-10-08T16:11:13.578674+0000","last_undegraded":"2023-10-08T16:11:13.578674+0000","last_fullsized":"2023-10-08T16:11:13.578674+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:35.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.581259+0000","last_change":"2023-10-08T16:11:14.581035+0000","last_active":"2023-10-08T16:11:14.581259+0000","last_peered":"2023-10-08T16:11:14.581259+0000","last_clean":"2023-10-08T16:11:14.581259+0000","last_became_active":"2023-10-08T16:11:14.580742+0000","last_became_peered":"2023-10-08T16:11:14.580742+0000","last_unstale":"2023-10-08T16:11:14.581259+0000","last_undegraded":"2023-10-08T16:11:14.581259+0000","last_fullsized":"2023-10-08T16:11:14.581259+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:22:27.843140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.567062+0000","last_change":"2023-10-08T16:11:13.566358+0000","last_active":"2023-10-08T16:11:13.567062+0000","last_peered":"2023-10-08T16:11:13.567062+0000","last_clean":"2023-10-08T16:11:13.567062+0000","last_became_active":"2023-10-08T16:11:13.565984+0000","last_became_peered":"2023-10-08T16:11:13.565984+0000","last_unstale":"2023-10-08T16:11:13.567062+0000","last_undegraded":"2023-10-08T16:11:13.567062+0000","last_fullsized":"2023-10-08T16:11:13.567062+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:30.568698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591266+0000","last_change":"2023-10-08T16:11:14.591172+0000","last_active":"2023-10-08T16:11:14.591266+0000","last_peered":"2023-10-08T16:11:14.591266+0000","last_clean":"2023-10-08T16:11:14.591266+0000","last_became_active":"2023-10-08T16:11:14.590935+0000","last_became_peered":"2023-10-08T16:11:14.590935+0000","last_unstale":"2023-10-08T16:11:14.591266+0000","last_undegraded":"2023-10-08T16:11:14.591266+0000","last_fullsized":"2023-10-08T16:11:14.591266+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.571211+0000","last_change":"2023-10-08T16:11:13.570872+0000","last_active":"2023-10-08T16:11:13.571211+0000","last_peered":"2023-10-08T16:11:13.571211+0000","last_clean":"2023-10-08T16:11:13.571211+0000","last_became_active":"2023-10-08T16:11:13.570391+0000","last_became_peered":"2023-10-08T16:11:13.570391+0000","last_unstale":"2023-10-08T16:11:13.571211+0000","last_undegraded":"2023-10-08T16:11:13.571211+0000","last_fullsized":"2023-10-08T16:11:13.571211+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:05.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580091+0000","last_change":"2023-10-08T16:11:14.580091+0000","last_active":"2023-10-08T16:11:14.580091+0000","last_peered":"2023-10-08T16:11:14.580091+0000","last_clean":"2023-10-08T16:11:14.580091+0000","last_became_active":"2023-10-08T16:11:14.579841+0000","last_became_peered":"2023-10-08T16:11:14.579841+0000","last_unstale":"2023-10-08T16:11:14.580091+0000","last_undegraded":"2023-10-08T16:11:14.580091+0000","last_fullsized":"2023-10-08T16:11:14.580091+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"131'3","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.599080+0000","last_change":"2023-10-08T16:11:13.578127+0000","last_active":"2023-10-08T16:11:14.599080+0000","last_peered":"2023-10-08T16:11:14.599080+0000","last_clean":"2023-10-08T16:11:14.599080+0000","last_became_active":"2023-10-08T16:11:13.577880+0000","last_became_peered":"2023-10-08T16:11:13.577880+0000","last_unstale":"2023-10-08T16:11:14.599080+0000","last_undegraded":"2023-10-08T16:11:14.599080+0000","last_fullsized":"2023-10-08T16:11:14.599080+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:05.496688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586439+0000","last_change":"2023-10-08T16:11:14.586369+0000","last_active":"2023-10-08T16:11:14.586439+0000","last_peered":"2023-10-08T16:11:14.586439+0000","last_clean":"2023-10-08T16:11:14.586439+0000","last_became_active":"2023-10-08T16:11:14.586092+0000","last_became_peered":"2023-10-08T16:11:14.586092+0000","last_unstale":"2023-10-08T16:11:14.586439+0000","last_undegraded":"2023-10-08T16:11:14.586439+0000","last_fullsized":"2023-10-08T16:11:14.586439+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:22.432335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"131'6","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.599288+0000","last_change":"2023-10-08T16:11:13.578335+0000","last_active":"2023-10-08T16:11:14.599288+0000","last_peered":"2023-10-08T16:11:14.599288+0000","last_clean":"2023-10-08T16:11:14.599288+0000","last_became_active":"2023-10-08T16:11:13.577212+0000","last_became_peered":"2023-10-08T16:11:13.577212+0000","last_unstale":"2023-10-08T16:11:14.599288+0000","last_undegraded":"2023-10-08T16:11:14.599288+0000","last_fullsized":"2023-10-08T16:11:14.599288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:57.282100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582063+0000","last_change":"2023-10-08T16:11:14.582063+0000","last_active":"2023-10-08T16:11:14.582063+0000","last_peered":"2023-10-08T16:11:14.582063+0000","last_clean":"2023-10-08T16:11:14.582063+0000","last_became_active":"2023-10-08T16:11:14.581818+0000","last_became_peered":"2023-10-08T16:11:14.581818+0000","last_unstale":"2023-10-08T16:11:14.582063+0000","last_undegraded":"2023-10-08T16:11:14.582063+0000","last_fullsized":"2023-10-08T16:11:14.582063+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"131'2","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.597348+0000","last_change":"2023-10-08T16:11:13.574266+0000","last_active":"2023-10-08T16:11:14.597348+0000","last_peered":"2023-10-08T16:11:14.597348+0000","last_clean":"2023-10-08T16:11:14.597348+0000","last_became_active":"2023-10-08T16:11:13.574040+0000","last_became_peered":"2023-10-08T16:11:13.574040+0000","last_unstale":"2023-10-08T16:11:14.597348+0000","last_undegraded":"2023-10-08T16:11:14.597348+0000","last_fullsized":"2023-10-08T16:11:14.597348+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:55:42.158746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583632+0000","last_change":"2023-10-08T16:11:14.583632+0000","last_active":"2023-10-08T16:11:14.583632+0000","last_peered":"2023-10-08T16:11:14.583632+0000","last_clean":"2023-10-08T16:11:14.583632+0000","last_became_active":"2023-10-08T16:11:14.583390+0000","last_became_peered":"2023-10-08T16:11:14.583390+0000","last_unstale":"2023-10-08T16:11:14.583632+0000","last_undegraded":"2023-10-08T16:11:14.583632+0000","last_fullsized":"2023-10-08T16:11:14.583632+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:03.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582246+0000","last_change":"2023-10-08T16:11:13.579203+0000","last_active":"2023-10-08T16:11:14.582246+0000","last_peered":"2023-10-08T16:11:14.582246+0000","last_clean":"2023-10-08T16:11:14.582246+0000","last_became_active":"2023-10-08T16:11:13.578946+0000","last_became_peered":"2023-10-08T16:11:13.578946+0000","last_unstale":"2023-10-08T16:11:14.582246+0000","last_undegraded":"2023-10-08T16:11:14.582246+0000","last_fullsized":"2023-10-08T16:11:14.582246+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:50.154016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580232+0000","last_change":"2023-10-08T16:11:14.580232+0000","last_active":"2023-10-08T16:11:14.580232+0000","last_peered":"2023-10-08T16:11:14.580232+0000","last_clean":"2023-10-08T16:11:14.580232+0000","last_became_active":"2023-10-08T16:11:14.580019+0000","last_became_peered":"2023-10-08T16:11:14.580019+0000","last_unstale":"2023-10-08T16:11:14.580232+0000","last_undegraded":"2023-10-08T16:11:14.580232+0000","last_fullsized":"2023-10-08T16:11:14.580232+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"131'8","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.599425+0000","last_change":"2023-10-08T16:11:13.575141+0000","last_active":"2023-10-08T16:11:14.599425+0000","last_peered":"2023-10-08T16:11:14.599425+0000","last_clean":"2023-10-08T16:11:14.599425+0000","last_became_active":"2023-10-08T16:11:13.574925+0000","last_became_peered":"2023-10-08T16:11:13.574925+0000","last_unstale":"2023-10-08T16:11:14.599425+0000","last_undegraded":"2023-10-08T16:11:14.599425+0000","last_fullsized":"2023-10-08T16:11:14.599425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:01.930473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589827+0000","last_change":"2023-10-08T16:11:14.589827+0000","last_active":"2023-10-08T16:11:14.589827+0000","last_peered":"2023-10-08T16:11:14.589827+0000","last_clean":"2023-10-08T16:11:14.589827+0000","last_became_active":"2023-10-08T16:11:14.589528+0000","last_became_peered":"2023-10-08T16:11:14.589528+0000","last_unstale":"2023-10-08T16:11:14.589827+0000","last_undegraded":"2023-10-08T16:11:14.589827+0000","last_fullsized":"2023-10-08T16:11:14.589827+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:58.227223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"131'1","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586910+0000","last_change":"2023-10-08T16:11:13.577450+0000","last_active":"2023-10-08T16:11:14.586910+0000","last_peered":"2023-10-08T16:11:14.586910+0000","last_clean":"2023-10-08T16:11:14.586910+0000","last_became_active":"2023-10-08T16:11:13.576321+0000","last_became_peered":"2023-10-08T16:11:13.576321+0000","last_unstale":"2023-10-08T16:11:14.586910+0000","last_undegraded":"2023-10-08T16:11:14.586910+0000","last_fullsized":"2023-10-08T16:11:14.586910+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:10.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588538+0000","last_change":"2023-10-08T16:11:14.588271+0000","last_active":"2023-10-08T16:11:14.588538+0000","last_peered":"2023-10-08T16:11:14.588538+0000","last_clean":"2023-10-08T16:11:14.588538+0000","last_became_active":"2023-10-08T16:11:14.588020+0000","last_became_peered":"2023-10-08T16:11:14.588020+0000","last_unstale":"2023-10-08T16:11:14.588538+0000","last_undegraded":"2023-10-08T16:11:14.588538+0000","last_fullsized":"2023-10-08T16:11:14.588538+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:48.057694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.594932+0000","last_change":"2023-10-08T16:11:13.576323+0000","last_active":"2023-10-08T16:11:14.594932+0000","last_peered":"2023-10-08T16:11:14.594932+0000","last_clean":"2023-10-08T16:11:14.594932+0000","last_became_active":"2023-10-08T16:11:13.576044+0000","last_became_peered":"2023-10-08T16:11:13.576044+0000","last_unstale":"2023-10-08T16:11:14.594932+0000","last_undegraded":"2023-10-08T16:11:14.594932+0000","last_fullsized":"2023-10-08T16:11:14.594932+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:57.636754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.592072+0000","last_change":"2023-10-08T16:11:14.592072+0000","last_active":"2023-10-08T16:11:14.592072+0000","last_peered":"2023-10-08T16:11:14.592072+0000","last_clean":"2023-10-08T16:11:14.592072+0000","last_became_active":"2023-10-08T16:11:14.591866+0000","last_became_peered":"2023-10-08T16:11:14.591866+0000","last_unstale":"2023-10-08T16:11:14.592072+0000","last_undegraded":"2023-10-08T16:11:14.592072+0000","last_fullsized":"2023-10-08T16:11:14.592072+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:48.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"131'1","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596414+0000","last_change":"2023-10-08T16:11:13.571567+0000","last_active":"2023-10-08T16:11:14.596414+0000","last_peered":"2023-10-08T16:11:14.596414+0000","last_clean":"2023-10-08T16:11:14.596414+0000","last_became_active":"2023-10-08T16:11:13.571292+0000","last_became_peered":"2023-10-08T16:11:13.571292+0000","last_unstale":"2023-10-08T16:11:14.596414+0000","last_undegraded":"2023-10-08T16:11:14.596414+0000","last_fullsized":"2023-10-08T16:11:14.596414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:18.848253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591041+0000","last_change":"2023-10-08T16:11:14.591041+0000","last_active":"2023-10-08T16:11:14.591041+0000","last_peered":"2023-10-08T16:11:14.591041+0000","last_clean":"2023-10-08T16:11:14.591041+0000","last_became_active":"2023-10-08T16:11:14.590804+0000","last_became_peered":"2023-10-08T16:11:14.590804+0000","last_unstale":"2023-10-08T16:11:14.591041+0000","last_undegraded":"2023-10-08T16:11:14.591041+0000","last_fullsized":"2023-10-08T16:11:14.591041+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580603+0000","last_change":"2023-10-08T16:11:13.577839+0000","last_active":"2023-10-08T16:11:14.580603+0000","last_peered":"2023-10-08T16:11:14.580603+0000","last_clean":"2023-10-08T16:11:14.580603+0000","last_became_active":"2023-10-08T16:11:13.577535+0000","last_became_peered":"2023-10-08T16:11:13.577535+0000","last_unstale":"2023-10-08T16:11:14.580603+0000","last_undegraded":"2023-10-08T16:11:14.580603+0000","last_fullsized":"2023-10-08T16:11:14.580603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:42.235791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588425+0000","last_change":"2023-10-08T16:11:14.588425+0000","last_active":"2023-10-08T16:11:14.588425+0000","last_peered":"2023-10-08T16:11:14.588425+0000","last_clean":"2023-10-08T16:11:14.588425+0000","last_became_active":"2023-10-08T16:11:14.587735+0000","last_became_peered":"2023-10-08T16:11:14.587735+0000","last_unstale":"2023-10-08T16:11:14.588425+0000","last_undegraded":"2023-10-08T16:11:14.588425+0000","last_fullsized":"2023-10-08T16:11:14.588425+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:10.122569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"131'2","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.597061+0000","last_change":"2023-10-08T16:11:13.569560+0000","last_active":"2023-10-08T16:11:14.597061+0000","last_peered":"2023-10-08T16:11:14.597061+0000","last_clean":"2023-10-08T16:11:14.597061+0000","last_became_active":"2023-10-08T16:11:13.569321+0000","last_became_peered":"2023-10-08T16:11:13.569321+0000","last_unstale":"2023-10-08T16:11:14.597061+0000","last_undegraded":"2023-10-08T16:11:14.597061+0000","last_fullsized":"2023-10-08T16:11:14.597061+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:26.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590095+0000","last_change":"2023-10-08T16:11:14.590095+0000","last_active":"2023-10-08T16:11:14.590095+0000","last_peered":"2023-10-08T16:11:14.590095+0000","last_clean":"2023-10-08T16:11:14.590095+0000","last_became_active":"2023-10-08T16:11:14.588583+0000","last_became_peered":"2023-10-08T16:11:14.588583+0000","last_unstale":"2023-10-08T16:11:14.590095+0000","last_undegraded":"2023-10-08T16:11:14.590095+0000","last_fullsized":"2023-10-08T16:11:14.590095+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:44.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.567023+0000","last_change":"2023-10-08T16:11:13.566040+0000","last_active":"2023-10-08T16:11:13.567023+0000","last_peered":"2023-10-08T16:11:13.567023+0000","last_clean":"2023-10-08T16:11:13.567023+0000","last_became_active":"2023-10-08T16:11:13.565625+0000","last_became_peered":"2023-10-08T16:11:13.565625+0000","last_unstale":"2023-10-08T16:11:13.567023+0000","last_undegraded":"2023-10-08T16:11:13.567023+0000","last_fullsized":"2023-10-08T16:11:13.567023+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:41.070391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586751+0000","last_change":"2023-10-08T16:11:14.586751+0000","last_active":"2023-10-08T16:11:14.586751+0000","last_peered":"2023-10-08T16:11:14.586751+0000","last_clean":"2023-10-08T16:11:14.586751+0000","last_became_active":"2023-10-08T16:11:14.586530+0000","last_became_peered":"2023-10-08T16:11:14.586530+0000","last_unstale":"2023-10-08T16:11:14.586751+0000","last_undegraded":"2023-10-08T16:11:14.586751+0000","last_fullsized":"2023-10-08T16:11:14.586751+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:40.438084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.577671+0000","last_change":"2023-10-08T16:11:13.570934+0000","last_active":"2023-10-08T16:11:14.577671+0000","last_peered":"2023-10-08T16:11:14.577671+0000","last_clean":"2023-10-08T16:11:14.577671+0000","last_became_active":"2023-10-08T16:11:13.570658+0000","last_became_peered":"2023-10-08T16:11:13.570658+0000","last_unstale":"2023-10-08T16:11:14.577671+0000","last_undegraded":"2023-10-08T16:11:14.577671+0000","last_fullsized":"2023-10-08T16:11:14.577671+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:34:58.236500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588339+0000","last_change":"2023-10-08T16:11:14.588339+0000","last_active":"2023-10-08T16:11:14.588339+0000","last_peered":"2023-10-08T16:11:14.588339+0000","last_clean":"2023-10-08T16:11:14.588339+0000","last_became_active":"2023-10-08T16:11:14.588102+0000","last_became_peered":"2023-10-08T16:11:14.588102+0000","last_unstale":"2023-10-08T16:11:14.588339+0000","last_undegraded":"2023-10-08T16:11:14.588339+0000","last_fullsized":"2023-10-08T16:11:14.588339+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:36.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.575338+0000","last_change":"2023-10-08T16:11:13.574484+0000","last_active":"2023-10-08T16:11:13.575338+0000","last_peered":"2023-10-08T16:11:13.575338+0000","last_clean":"2023-10-08T16:11:13.575338+0000","last_became_active":"2023-10-08T16:11:13.574239+0000","last_became_peered":"2023-10-08T16:11:13.574239+0000","last_unstale":"2023-10-08T16:11:13.575338+0000","last_undegraded":"2023-10-08T16:11:13.575338+0000","last_fullsized":"2023-10-08T16:11:13.575338+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:50.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589960+0000","last_change":"2023-10-08T16:11:14.589893+0000","last_active":"2023-10-08T16:11:14.589960+0000","last_peered":"2023-10-08T16:11:14.589960+0000","last_clean":"2023-10-08T16:11:14.589960+0000","last_became_active":"2023-10-08T16:11:14.589608+0000","last_became_peered":"2023-10-08T16:11:14.589608+0000","last_unstale":"2023-10-08T16:11:14.589960+0000","last_undegraded":"2023-10-08T16:11:14.589960+0000","last_fullsized":"2023-10-08T16:11:14.589960+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.595482+0000","last_change":"2023-10-08T16:11:13.576391+0000","last_active":"2023-10-08T16:11:14.595482+0000","last_peered":"2023-10-08T16:11:14.595482+0000","last_clean":"2023-10-08T16:11:14.595482+0000","last_became_active":"2023-10-08T16:11:13.576126+0000","last_became_peered":"2023-10-08T16:11:13.576126+0000","last_unstale":"2023-10-08T16:11:14.595482+0000","last_undegraded":"2023-10-08T16:11:14.595482+0000","last_fullsized":"2023-10-08T16:11:14.595482+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:15:54.724784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590112+0000","last_change":"2023-10-08T16:11:14.590112+0000","last_active":"2023-10-08T16:11:14.590112+0000","last_peered":"2023-10-08T16:11:14.590112+0000","last_clean":"2023-10-08T16:11:14.590112+0000","last_became_active":"2023-10-08T16:11:14.587323+0000","last_became_peered":"2023-10-08T16:11:14.587323+0000","last_unstale":"2023-10-08T16:11:14.590112+0000","last_undegraded":"2023-10-08T16:11:14.590112+0000","last_fullsized":"2023-10-08T16:11:14.590112+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:28.409126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582777+0000","last_change":"2023-10-08T16:11:13.572510+0000","last_active":"2023-10-08T16:11:14.582777+0000","last_peered":"2023-10-08T16:11:14.582777+0000","last_clean":"2023-10-08T16:11:14.582777+0000","last_became_active":"2023-10-08T16:11:13.572291+0000","last_became_peered":"2023-10-08T16:11:13.572291+0000","last_unstale":"2023-10-08T16:11:14.582777+0000","last_undegraded":"2023-10-08T16:11:14.582777+0000","last_fullsized":"2023-10-08T16:11:14.582777+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:34.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590993+0000","last_change":"2023-10-08T16:11:14.590993+0000","last_active":"2023-10-08T16:11:14.590993+0000","last_peered":"2023-10-08T16:11:14.590993+0000","last_clean":"2023-10-08T16:11:14.590993+0000","last_became_active":"2023-10-08T16:11:14.589975+0000","last_became_peered":"2023-10-08T16:11:14.589975+0000","last_unstale":"2023-10-08T16:11:14.590993+0000","last_undegraded":"2023-10-08T16:11:14.590993+0000","last_fullsized":"2023-10-08T16:11:14.590993+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:06.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.577973+0000","last_change":"2023-10-08T16:11:13.577623+0000","last_active":"2023-10-08T16:11:13.577973+0000","last_peered":"2023-10-08T16:11:13.577973+0000","last_clean":"2023-10-08T16:11:13.577973+0000","last_became_active":"2023-10-08T16:11:13.576589+0000","last_became_peered":"2023-10-08T16:11:13.576589+0000","last_unstale":"2023-10-08T16:11:13.577973+0000","last_undegraded":"2023-10-08T16:11:13.577973+0000","last_fullsized":"2023-10-08T16:11:13.577973+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:02.353626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590284+0000","last_change":"2023-10-08T16:11:14.590077+0000","last_active":"2023-10-08T16:11:14.590284+0000","last_peered":"2023-10-08T16:11:14.590284+0000","last_clean":"2023-10-08T16:11:14.590284+0000","last_became_active":"2023-10-08T16:11:14.589850+0000","last_became_peered":"2023-10-08T16:11:14.589850+0000","last_unstale":"2023-10-08T16:11:14.590284+0000","last_undegraded":"2023-10-08T16:11:14.590284+0000","last_fullsized":"2023-10-08T16:11:14.590284+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.572405+0000","last_change":"2023-10-08T16:11:13.572336+0000","last_active":"2023-10-08T16:11:13.572405+0000","last_peered":"2023-10-08T16:11:13.572405+0000","last_clean":"2023-10-08T16:11:13.572405+0000","last_became_active":"2023-10-08T16:11:13.572114+0000","last_became_peered":"2023-10-08T16:11:13.572114+0000","last_unstale":"2023-10-08T16:11:13.572405+0000","last_undegraded":"2023-10-08T16:11:13.572405+0000","last_fullsized":"2023-10-08T16:11:13.572405+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:34.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586413+0000","last_change":"2023-10-08T16:11:14.586413+0000","last_active":"2023-10-08T16:11:14.586413+0000","last_peered":"2023-10-08T16:11:14.586413+0000","last_clean":"2023-10-08T16:11:14.586413+0000","last_became_active":"2023-10-08T16:11:14.585552+0000","last_became_peered":"2023-10-08T16:11:14.585552+0000","last_unstale":"2023-10-08T16:11:14.586413+0000","last_undegraded":"2023-10-08T16:11:14.586413+0000","last_fullsized":"2023-10-08T16:11:14.586413+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:11.562994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579436+0000","last_change":"2023-10-08T16:11:13.576798+0000","last_active":"2023-10-08T16:11:14.579436+0000","last_peered":"2023-10-08T16:11:14.579436+0000","last_clean":"2023-10-08T16:11:14.579436+0000","last_became_active":"2023-10-08T16:11:13.576523+0000","last_became_peered":"2023-10-08T16:11:13.576523+0000","last_unstale":"2023-10-08T16:11:14.579436+0000","last_undegraded":"2023-10-08T16:11:14.579436+0000","last_fullsized":"2023-10-08T16:11:14.579436+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:57.220666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583425+0000","last_change":"2023-10-08T16:11:14.583425+0000","last_active":"2023-10-08T16:11:14.583425+0000","last_peered":"2023-10-08T16:11:14.583425+0000","last_clean":"2023-10-08T16:11:14.583425+0000","last_became_active":"2023-10-08T16:11:14.582898+0000","last_became_peered":"2023-10-08T16:11:14.582898+0000","last_unstale":"2023-10-08T16:11:14.583425+0000","last_undegraded":"2023-10-08T16:11:14.583425+0000","last_fullsized":"2023-10-08T16:11:14.583425+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:10.122569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.574682+0000","last_change":"2023-10-08T16:11:13.574599+0000","last_active":"2023-10-08T16:11:13.574682+0000","last_peered":"2023-10-08T16:11:13.574682+0000","last_clean":"2023-10-08T16:11:13.574682+0000","last_became_active":"2023-10-08T16:11:13.574362+0000","last_became_peered":"2023-10-08T16:11:13.574362+0000","last_unstale":"2023-10-08T16:11:13.574682+0000","last_undegraded":"2023-10-08T16:11:13.574682+0000","last_fullsized":"2023-10-08T16:11:13.574682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:47.051137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588284+0000","last_change":"2023-10-08T16:11:14.588284+0000","last_active":"2023-10-08T16:11:14.588284+0000","last_peered":"2023-10-08T16:11:14.588284+0000","last_clean":"2023-10-08T16:11:14.588284+0000","last_became_active":"2023-10-08T16:11:14.587455+0000","last_became_peered":"2023-10-08T16:11:14.587455+0000","last_unstale":"2023-10-08T16:11:14.588284+0000","last_undegraded":"2023-10-08T16:11:14.588284+0000","last_fullsized":"2023-10-08T16:11:14.588284+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:38.579714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.569767+0000","last_change":"2023-10-08T16:11:13.569707+0000","last_active":"2023-10-08T16:11:13.569767+0000","last_peered":"2023-10-08T16:11:13.569767+0000","last_clean":"2023-10-08T16:11:13.569767+0000","last_became_active":"2023-10-08T16:11:13.569464+0000","last_became_peered":"2023-10-08T16:11:13.569464+0000","last_unstale":"2023-10-08T16:11:13.569767+0000","last_undegraded":"2023-10-08T16:11:13.569767+0000","last_fullsized":"2023-10-08T16:11:13.569767+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:54.874323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583939+0000","last_change":"2023-10-08T16:11:14.583939+0000","last_active":"2023-10-08T16:11:14.583939+0000","last_peered":"2023-10-08T16:11:14.583939+0000","last_clean":"2023-10-08T16:11:14.583939+0000","last_became_active":"2023-10-08T16:11:14.583367+0000","last_became_peered":"2023-10-08T16:11:14.583367+0000","last_unstale":"2023-10-08T16:11:14.583939+0000","last_undegraded":"2023-10-08T16:11:14.583939+0000","last_fullsized":"2023-10-08T16:11:14.583939+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:20.040960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.577991+0000","last_change":"2023-10-08T16:11:13.577777+0000","last_active":"2023-10-08T16:11:13.577991+0000","last_peered":"2023-10-08T16:11:13.577991+0000","last_clean":"2023-10-08T16:11:13.577991+0000","last_became_active":"2023-10-08T16:11:13.576853+0000","last_became_peered":"2023-10-08T16:11:13.576853+0000","last_unstale":"2023-10-08T16:11:13.577991+0000","last_undegraded":"2023-10-08T16:11:13.577991+0000","last_fullsized":"2023-10-08T16:11:13.577991+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:47.440464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585110+0000","last_change":"2023-10-08T16:11:14.585110+0000","last_active":"2023-10-08T16:11:14.585110+0000","last_peered":"2023-10-08T16:11:14.585110+0000","last_clean":"2023-10-08T16:11:14.585110+0000","last_became_active":"2023-10-08T16:11:14.584866+0000","last_became_peered":"2023-10-08T16:11:14.584866+0000","last_unstale":"2023-10-08T16:11:14.585110+0000","last_undegraded":"2023-10-08T16:11:14.585110+0000","last_fullsized":"2023-10-08T16:11:14.585110+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:48.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580425+0000","last_change":"2023-10-08T16:11:13.577717+0000","last_active":"2023-10-08T16:11:14.580425+0000","last_peered":"2023-10-08T16:11:14.580425+0000","last_clean":"2023-10-08T16:11:14.580425+0000","last_became_active":"2023-10-08T16:11:13.577307+0000","last_became_peered":"2023-10-08T16:11:13.577307+0000","last_unstale":"2023-10-08T16:11:14.580425+0000","last_undegraded":"2023-10-08T16:11:14.580425+0000","last_fullsized":"2023-10-08T16:11:14.580425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:26.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.572377+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:11:13.572377+0000","last_peered":"2023-10-08T16:11:13.572377+0000","last_clean":"2023-10-08T16:11:13.572377+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:11:13.572377+0000","last_undegraded":"2023-10-08T16:11:13.572377+0000","last_fullsized":"2023-10-08T16:11:13.572377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1282,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194030,"statfs":{"total":200000000,"available":198687188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64100000000000001,"5min":0.72599999999999998,"15min":0.83099999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.79800000000000004,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.62},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82499999999999996,"5min":1.756,"15min":1.756},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.79,"15min":1.79},"last":0.60299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.74299999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.504,"15min":0.503},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.34399999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.823,"15min":1.823},"last":0.76800000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194601,"statfs":{"total":200000000,"available":199271786,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.34399999999999997,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.59199999999999997,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":0.626},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58399999999999996,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.55800000000000005,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.29799999999999999},"max":{"1min":3.516,"5min":3.516,"15min":3.516},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.65800000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.441,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.58799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.33800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64500000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73099999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278020,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36099999999999999,"15min":0.46700000000000003},"min":{"1min":0.23300000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.59899999999999998,"15min":3.593},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.28799999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63600000000000001,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.622,"5min":0.622,"15min":3.6259999999999999},"last":0.437},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40999999999999998,"15min":0.439},"min":{"1min":0.26800000000000002,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.80400000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63,"15min":0.70199999999999996},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0620000000000001,"15min":3.5630000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.60099999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":1.2969999999999999,"15min":1.7030000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.71899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.94099999999999995,"15min":3.532},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.83499999999999996,"5min":1.341,"15min":1.6699999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64000000000000001,"15min":0.72399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":3.4929999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91600000000000004,"5min":1.0740000000000001,"15min":1.095},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.5429999999999999,"15min":1.6279999999999999},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1283,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194029,"statfs":{"total":200000000,"available":198686128,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35899999999999999,"15min":0.376},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.41999999999999998,"15min":0.47799999999999998},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":3.044,"5min":3.044,"15min":3.044},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.24399999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.28999999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65500000000000003,"15min":0.70799999999999996},"min":{"1min":0.45000000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.65500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.622},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.623,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.69799999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"max":{"1min":3.665,"5min":3.665,"15min":3.665},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.69599999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.435,"5min":0.56899999999999995,"15min":0.65500000000000003},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":2.7109999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.67100000000000004,"15min":0.746},"last":0.252},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.25600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.50600000000000001,"5min":0.68899999999999995,"15min":0.70299999999999996},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.436},"min":{"1min":0.32400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52300000000000002,"5min":0.74099999999999999,"15min":1.3260000000000001},"last":0.379},{"interface":"front","average":{"1min":0.437,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":1.2549999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.37},"max":{"1min":0.80800000000000005,"5min":0.93500000000000005,"15min":2.8980000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74099999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.434}]},{"osd":5,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76500000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":2.9319999999999999},"last":0.40799999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.627,"15min":0.60199999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":1.091,"15min":1.091},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":1.042,"15min":3.0030000000000001},"last":0.443},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64700000000000002,"15min":0.621},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199276538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34499999999999997,"15min":0.315},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.35999999999999999},"min":{"1min":0.23400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55000000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34699999999999998},"min":{"1min":0.25900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.216},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.374},"min":{"1min":0.30399999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.57199999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.378},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.39400000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58299999999999996,"5min":0.628,"15min":0.628},"last":0.34899999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97899999999999998,"5min":0.999,"15min":0.999},"last":0.503},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84299999999999997,"5min":1.026,"15min":1.026},"last":0.626}]},{"osd":7,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.878,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28899999999999998},"max":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":1.141},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":1.149},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60299999999999998,"15min":0.55600000000000005},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.77000000000000002,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.34899999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.77500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.70199999999999996,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":14.6,"15min":14.6},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.624,"15min":0.56799999999999995},"min":{"1min":0.34799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.752,"5min":7.556,"15min":7.556},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77300000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.45200000000000001,"15min":0.47199999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.754,"15min":0.754},"last":0.502}]},{"osd":6,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64800000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67700000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199277568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.315,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.374,"5min":0.315,"15min":0.31},"max":{"1min":0.73099999999999998,"5min":0.77400000000000002,"15min":0.79700000000000004},"last":0.46500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.79500000000000004,"15min":0.81200000000000006},"last":0.52700000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76700000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.48599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.754,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.44800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.36899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70199999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38200000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.41299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.84199999999999997},"last":0.47899999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.46400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.42599999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:11:18.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:11:18.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.851+0000 7faf1989c700 1 Processor -- start 2023-10-08T16:11:18.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.851+0000 7faf1989c700 1 -- start start 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf1989c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf14157870 0x7faf1415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf1989c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf1415a620 0x7faf1415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf1989c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1415cbb0 con 0x7faf1415d580 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf1989c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1415bfa0 con 0x7faf1415a620 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf1989c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1415c280 con 0x7faf14157870 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf137fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faf1415d580 0x7faf14158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43762/0 (socket says 172.21.15.60:43762) 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.852+0000 7faf127fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf1415a620 0x7faf1415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf137fe700 1 -- 172.21.15.60:0/2834288327 learned_addr learned my addr 172.21.15.60:0/2834288327 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf12ffd700 1 --2- 172.21.15.60:0/2834288327 >> v2:172.21.15.144:3300/0 conn(0x7faf14157870 0x7faf1415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf11ffb700 1 -- 172.21.15.60:0/2834288327 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994123275 0 0) 0x7faf1415cbb0 con 0x7faf1415d580 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf11ffb700 1 -- 172.21.15.60:0/2834288327 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf00003570 con 0x7faf1415d580 2023-10-08T16:11:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf127fc700 1 -- 172.21.15.60:0/2834288327 >> v2:172.21.15.144:3300/0 conn(0x7faf14157870 msgr2=0x7faf1415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf127fc700 1 --2- 172.21.15.60:0/2834288327 >> v2:172.21.15.144:3300/0 conn(0x7faf14157870 0x7faf1415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf127fc700 1 -- 172.21.15.60:0/2834288327 >> v1:172.21.15.60:6789/0 conn(0x7faf1415d580 legacy=0x7faf14158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf127fc700 1 -- 172.21.15.60:0/2834288327 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1415c560 con 0x7faf1415a620 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf127fc700 1 --2- 172.21.15.60:0/2834288327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf1415a620 0x7faf1415d040 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7faf14069d80 tx=0x7faefc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87a49edc731a7c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf11ffb700 1 -- 172.21.15.60:0/2834288327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc011630 con 0x7faf1415a620 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf11ffb700 1 -- 172.21.15.60:0/2834288327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc011790 con 0x7faf1415a620 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.853+0000 7faf11ffb700 1 -- 172.21.15.60:0/2834288327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc011b30 con 0x7faf1415a620 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 -- 172.21.15.60:0/2834288327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf1415a620 msgr2=0x7faf1415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 --2- 172.21.15.60:0/2834288327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf1415a620 0x7faf1415d040 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7faf14069d80 tx=0x7faefc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 -- 172.21.15.60:0/2834288327 shutdown_connections 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 --2- 172.21.15.60:0/2834288327 >> v2:172.21.15.144:3300/0 conn(0x7faf14157870 0x7faf1415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 --2- 172.21.15.60:0/2834288327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf1415a620 0x7faf1415d040 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 -- 172.21.15.60:0/2834288327 >> 172.21.15.60:0/2834288327 conn(0x7faf14068ce0 msgr2=0x7faf140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 -- 172.21.15.60:0/2834288327 shutdown_connections 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.854+0000 7faf1989c700 1 -- 172.21.15.60:0/2834288327 wait complete. 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.855+0000 7faf1989c700 1 Processor -- start 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.855+0000 7faf1989c700 1 -- start start 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 0x7faf14152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf1415a620 0x7faf140b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf1415d580 0x7faf140b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140b1f60 con 0x7faf14157870 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140b5db0 con 0x7faf1415d580 2023-10-08T16:11:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140b51e0 con 0x7faf1415a620 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 0x7faf14152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 0x7faf14152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48190/0 (socket says 172.21.15.60:48190) 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 -- 172.21.15.60:0/2292271672 learned_addr learned my addr 172.21.15.60:0/2292271672 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 -- 172.21.15.60:0/2292271672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf1415a620 msgr2=0x7faf140b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf1415a620 0x7faf140b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 -- 172.21.15.60:0/2292271672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf1415d580 msgr2=0x7faf140b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf1415d580 0x7faf140b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 -- 172.21.15.60:0/2292271672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc009420 con 0x7faf14157870 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf12ffd700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 0x7faf14152580 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00d890 tx=0x7faf0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00b600 con 0x7faf14157870 2023-10-08T16:11:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00b760 con 0x7faf14157870 2023-10-08T16:11:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf140b5480 con 0x7faf14157870 2023-10-08T16:11:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00bae0 con 0x7faf14157870 2023-10-08T16:11:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.856+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf140b5a40 con 0x7faf14157870 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.857+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1404c3c0 con 0x7faf14157870 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.858+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf0c01e460 con 0x7faf14157870 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.858+0000 7faf0affd700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faef4066fb0 0x7faef4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.858+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf0c084c90 con 0x7faf14157870 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.858+0000 7faf127fc700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faef4066fb0 0x7faef4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.859+0000 7faf127fc700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faef4066fb0 0x7faef4069460 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7faf1415aa20 tx=0x7faefc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:18.863+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf0c051e60 con 0x7faf14157870 2023-10-08T16:11:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.049+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf1415c840 con 0x7faef4066fb0 2023-10-08T16:11:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.057+0000 7faf0affd700 1 -- 172.21.15.60:0/2292271672 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285144 (secure 0 0 0) 0x7faf1415c840 con 0x7faef4066fb0 2023-10-08T16:11:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:19.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faef4066fb0 msgr2=0x7faef4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faef4066fb0 0x7faef4069460 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7faf1415aa20 tx=0x7faefc017000 comp rx=0 tx=0).stop 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 msgr2=0x7faf14152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 0x7faf14152580 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00d890 tx=0x7faf0c008040 comp rx=0 tx=0).stop 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 shutdown_connections 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7faef4066fb0 0x7faef4069460 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf1415d580 0x7faf140b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14157870 0x7faf14152580 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 --2- 172.21.15.60:0/2292271672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faf1415a620 0x7faf140b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 >> 172.21.15.60:0/2292271672 conn(0x7faf14068ce0 msgr2=0x7faf14155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 shutdown_connections 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.060+0000 7faf1989c700 1 -- 172.21.15.60:0/2292271672 wait complete. 2023-10-08T16:11:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:11:19.102 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-08T16:11:17.640484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555696,"statfs":{"total":1600000000,"available":1593033516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.082313"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.595165+0000","last_change":"2023-10-08T16:11:14.595165+0000","last_active":"2023-10-08T16:11:14.595165+0000","last_peered":"2023-10-08T16:11:14.595165+0000","last_clean":"2023-10-08T16:11:14.595165+0000","last_became_active":"2023-10-08T16:11:14.594868+0000","last_became_peered":"2023-10-08T16:11:14.594868+0000","last_unstale":"2023-10-08T16:11:14.595165+0000","last_undegraded":"2023-10-08T16:11:14.595165+0000","last_fullsized":"2023-10-08T16:11:14.595165+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:31.844401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585772+0000","last_change":"2023-10-08T16:11:14.585772+0000","last_active":"2023-10-08T16:11:14.585772+0000","last_peered":"2023-10-08T16:11:14.585772+0000","last_clean":"2023-10-08T16:11:14.585772+0000","last_became_active":"2023-10-08T16:11:14.583326+0000","last_became_peered":"2023-10-08T16:11:14.583326+0000","last_unstale":"2023-10-08T16:11:14.585772+0000","last_undegraded":"2023-10-08T16:11:14.585772+0000","last_fullsized":"2023-10-08T16:11:14.585772+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591668+0000","last_change":"2023-10-08T16:11:14.591668+0000","last_active":"2023-10-08T16:11:14.591668+0000","last_peered":"2023-10-08T16:11:14.591668+0000","last_clean":"2023-10-08T16:11:14.591668+0000","last_became_active":"2023-10-08T16:11:14.591136+0000","last_became_peered":"2023-10-08T16:11:14.591136+0000","last_unstale":"2023-10-08T16:11:14.591668+0000","last_undegraded":"2023-10-08T16:11:14.591668+0000","last_fullsized":"2023-10-08T16:11:14.591668+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589795+0000","last_change":"2023-10-08T16:11:14.589795+0000","last_active":"2023-10-08T16:11:14.589795+0000","last_peered":"2023-10-08T16:11:14.589795+0000","last_clean":"2023-10-08T16:11:14.589795+0000","last_became_active":"2023-10-08T16:11:14.589062+0000","last_became_peered":"2023-10-08T16:11:14.589062+0000","last_unstale":"2023-10-08T16:11:14.589795+0000","last_undegraded":"2023-10-08T16:11:14.589795+0000","last_fullsized":"2023-10-08T16:11:14.589795+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:09.422866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579604+0000","last_change":"2023-10-08T16:11:14.579604+0000","last_active":"2023-10-08T16:11:14.579604+0000","last_peered":"2023-10-08T16:11:14.579604+0000","last_clean":"2023-10-08T16:11:14.579604+0000","last_became_active":"2023-10-08T16:11:14.579368+0000","last_became_peered":"2023-10-08T16:11:14.579368+0000","last_unstale":"2023-10-08T16:11:14.579604+0000","last_undegraded":"2023-10-08T16:11:14.579604+0000","last_fullsized":"2023-10-08T16:11:14.579604+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:45.213395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585431+0000","last_change":"2023-10-08T16:11:14.585385+0000","last_active":"2023-10-08T16:11:14.585431+0000","last_peered":"2023-10-08T16:11:14.585431+0000","last_clean":"2023-10-08T16:11:14.585431+0000","last_became_active":"2023-10-08T16:11:14.584913+0000","last_became_peered":"2023-10-08T16:11:14.584913+0000","last_unstale":"2023-10-08T16:11:14.585431+0000","last_undegraded":"2023-10-08T16:11:14.585431+0000","last_fullsized":"2023-10-08T16:11:14.585431+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.061947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591228+0000","last_change":"2023-10-08T16:11:14.590960+0000","last_active":"2023-10-08T16:11:14.591228+0000","last_peered":"2023-10-08T16:11:14.591228+0000","last_clean":"2023-10-08T16:11:14.591228+0000","last_became_active":"2023-10-08T16:11:14.590705+0000","last_became_peered":"2023-10-08T16:11:14.590705+0000","last_unstale":"2023-10-08T16:11:14.591228+0000","last_undegraded":"2023-10-08T16:11:14.591228+0000","last_fullsized":"2023-10-08T16:11:14.591228+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:40.435123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585324+0000","last_change":"2023-10-08T16:11:14.585324+0000","last_active":"2023-10-08T16:11:14.585324+0000","last_peered":"2023-10-08T16:11:14.585324+0000","last_clean":"2023-10-08T16:11:14.585324+0000","last_became_active":"2023-10-08T16:11:14.585085+0000","last_became_peered":"2023-10-08T16:11:14.585085+0000","last_unstale":"2023-10-08T16:11:14.585324+0000","last_undegraded":"2023-10-08T16:11:14.585324+0000","last_fullsized":"2023-10-08T16:11:14.585324+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589937+0000","last_change":"2023-10-08T16:11:14.589937+0000","last_active":"2023-10-08T16:11:14.589937+0000","last_peered":"2023-10-08T16:11:14.589937+0000","last_clean":"2023-10-08T16:11:14.589937+0000","last_became_active":"2023-10-08T16:11:14.589561+0000","last_became_peered":"2023-10-08T16:11:14.589561+0000","last_unstale":"2023-10-08T16:11:14.589937+0000","last_undegraded":"2023-10-08T16:11:14.589937+0000","last_fullsized":"2023-10-08T16:11:14.589937+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:37.329054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591416+0000","last_change":"2023-10-08T16:11:14.591416+0000","last_active":"2023-10-08T16:11:14.591416+0000","last_peered":"2023-10-08T16:11:14.591416+0000","last_clean":"2023-10-08T16:11:14.591416+0000","last_became_active":"2023-10-08T16:11:14.590716+0000","last_became_peered":"2023-10-08T16:11:14.590716+0000","last_unstale":"2023-10-08T16:11:14.591416+0000","last_undegraded":"2023-10-08T16:11:14.591416+0000","last_fullsized":"2023-10-08T16:11:14.591416+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:45.648926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584025+0000","last_change":"2023-10-08T16:11:14.584025+0000","last_active":"2023-10-08T16:11:14.584025+0000","last_peered":"2023-10-08T16:11:14.584025+0000","last_clean":"2023-10-08T16:11:14.584025+0000","last_became_active":"2023-10-08T16:11:14.583810+0000","last_became_peered":"2023-10-08T16:11:14.583810+0000","last_unstale":"2023-10-08T16:11:14.584025+0000","last_undegraded":"2023-10-08T16:11:14.584025+0000","last_fullsized":"2023-10-08T16:11:14.584025+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:06.503245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582843+0000","last_change":"2023-10-08T16:11:14.582843+0000","last_active":"2023-10-08T16:11:14.582843+0000","last_peered":"2023-10-08T16:11:14.582843+0000","last_clean":"2023-10-08T16:11:14.582843+0000","last_became_active":"2023-10-08T16:11:14.582613+0000","last_became_peered":"2023-10-08T16:11:14.582613+0000","last_unstale":"2023-10-08T16:11:14.582843+0000","last_undegraded":"2023-10-08T16:11:14.582843+0000","last_fullsized":"2023-10-08T16:11:14.582843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:34.444738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586303+0000","last_change":"2023-10-08T16:11:14.586303+0000","last_active":"2023-10-08T16:11:14.586303+0000","last_peered":"2023-10-08T16:11:14.586303+0000","last_clean":"2023-10-08T16:11:14.586303+0000","last_became_active":"2023-10-08T16:11:14.585890+0000","last_became_peered":"2023-10-08T16:11:14.585890+0000","last_unstale":"2023-10-08T16:11:14.586303+0000","last_undegraded":"2023-10-08T16:11:14.586303+0000","last_fullsized":"2023-10-08T16:11:14.586303+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.592635+0000","last_change":"2023-10-08T16:11:14.592635+0000","last_active":"2023-10-08T16:11:14.592635+0000","last_peered":"2023-10-08T16:11:14.592635+0000","last_clean":"2023-10-08T16:11:14.592635+0000","last_became_active":"2023-10-08T16:11:14.592112+0000","last_became_peered":"2023-10-08T16:11:14.592112+0000","last_unstale":"2023-10-08T16:11:14.592635+0000","last_undegraded":"2023-10-08T16:11:14.592635+0000","last_fullsized":"2023-10-08T16:11:14.592635+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:53.910334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579986+0000","last_change":"2023-10-08T16:11:14.579759+0000","last_active":"2023-10-08T16:11:14.579986+0000","last_peered":"2023-10-08T16:11:14.579986+0000","last_clean":"2023-10-08T16:11:14.579986+0000","last_became_active":"2023-10-08T16:11:14.579520+0000","last_became_peered":"2023-10-08T16:11:14.579520+0000","last_unstale":"2023-10-08T16:11:14.579986+0000","last_undegraded":"2023-10-08T16:11:14.579986+0000","last_fullsized":"2023-10-08T16:11:14.579986+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:29:27.212256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.593664+0000","last_change":"2023-10-08T16:11:14.593664+0000","last_active":"2023-10-08T16:11:14.593664+0000","last_peered":"2023-10-08T16:11:14.593664+0000","last_clean":"2023-10-08T16:11:14.593664+0000","last_became_active":"2023-10-08T16:11:14.592892+0000","last_became_peered":"2023-10-08T16:11:14.592892+0000","last_unstale":"2023-10-08T16:11:14.593664+0000","last_undegraded":"2023-10-08T16:11:14.593664+0000","last_fullsized":"2023-10-08T16:11:14.593664+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:44.383672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586557+0000","last_change":"2023-10-08T16:11:14.586557+0000","last_active":"2023-10-08T16:11:14.586557+0000","last_peered":"2023-10-08T16:11:14.586557+0000","last_clean":"2023-10-08T16:11:14.586557+0000","last_became_active":"2023-10-08T16:11:14.586142+0000","last_became_peered":"2023-10-08T16:11:14.586142+0000","last_unstale":"2023-10-08T16:11:14.586557+0000","last_undegraded":"2023-10-08T16:11:14.586557+0000","last_fullsized":"2023-10-08T16:11:14.586557+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589044+0000","last_change":"2023-10-08T16:11:14.588970+0000","last_active":"2023-10-08T16:11:14.589044+0000","last_peered":"2023-10-08T16:11:14.589044+0000","last_clean":"2023-10-08T16:11:14.589044+0000","last_became_active":"2023-10-08T16:11:14.588741+0000","last_became_peered":"2023-10-08T16:11:14.588741+0000","last_unstale":"2023-10-08T16:11:14.589044+0000","last_undegraded":"2023-10-08T16:11:14.589044+0000","last_fullsized":"2023-10-08T16:11:14.589044+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:10.122569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588588+0000","last_change":"2023-10-08T16:11:14.588588+0000","last_active":"2023-10-08T16:11:14.588588+0000","last_peered":"2023-10-08T16:11:14.588588+0000","last_clean":"2023-10-08T16:11:14.588588+0000","last_became_active":"2023-10-08T16:11:14.588008+0000","last_became_peered":"2023-10-08T16:11:14.588008+0000","last_unstale":"2023-10-08T16:11:14.588588+0000","last_undegraded":"2023-10-08T16:11:14.588588+0000","last_fullsized":"2023-10-08T16:11:14.588588+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:20.196343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585046+0000","last_change":"2023-10-08T16:11:14.585046+0000","last_active":"2023-10-08T16:11:14.585046+0000","last_peered":"2023-10-08T16:11:14.585046+0000","last_clean":"2023-10-08T16:11:14.585046+0000","last_became_active":"2023-10-08T16:11:14.584516+0000","last_became_peered":"2023-10-08T16:11:14.584516+0000","last_unstale":"2023-10-08T16:11:14.585046+0000","last_undegraded":"2023-10-08T16:11:14.585046+0000","last_fullsized":"2023-10-08T16:11:14.585046+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:03.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583573+0000","last_change":"2023-10-08T16:11:14.583573+0000","last_active":"2023-10-08T16:11:14.583573+0000","last_peered":"2023-10-08T16:11:14.583573+0000","last_clean":"2023-10-08T16:11:14.583573+0000","last_became_active":"2023-10-08T16:11:14.583196+0000","last_became_peered":"2023-10-08T16:11:14.583196+0000","last_unstale":"2023-10-08T16:11:14.583573+0000","last_undegraded":"2023-10-08T16:11:14.583573+0000","last_fullsized":"2023-10-08T16:11:14.583573+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:58.288656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584414+0000","last_change":"2023-10-08T16:11:14.584414+0000","last_active":"2023-10-08T16:11:14.584414+0000","last_peered":"2023-10-08T16:11:14.584414+0000","last_clean":"2023-10-08T16:11:14.584414+0000","last_became_active":"2023-10-08T16:11:14.584154+0000","last_became_peered":"2023-10-08T16:11:14.584154+0000","last_unstale":"2023-10-08T16:11:14.584414+0000","last_undegraded":"2023-10-08T16:11:14.584414+0000","last_fullsized":"2023-10-08T16:11:14.584414+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588041+0000","last_change":"2023-10-08T16:11:14.588041+0000","last_active":"2023-10-08T16:11:14.588041+0000","last_peered":"2023-10-08T16:11:14.588041+0000","last_clean":"2023-10-08T16:11:14.588041+0000","last_became_active":"2023-10-08T16:11:14.587801+0000","last_became_peered":"2023-10-08T16:11:14.587801+0000","last_unstale":"2023-10-08T16:11:14.588041+0000","last_undegraded":"2023-10-08T16:11:14.588041+0000","last_fullsized":"2023-10-08T16:11:14.588041+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.587842+0000","last_change":"2023-10-08T16:11:14.587842+0000","last_active":"2023-10-08T16:11:14.587842+0000","last_peered":"2023-10-08T16:11:14.587842+0000","last_clean":"2023-10-08T16:11:14.587842+0000","last_became_active":"2023-10-08T16:11:14.587596+0000","last_became_peered":"2023-10-08T16:11:14.587596+0000","last_unstale":"2023-10-08T16:11:14.587842+0000","last_undegraded":"2023-10-08T16:11:14.587842+0000","last_fullsized":"2023-10-08T16:11:14.587842+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:11.562994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585190+0000","last_change":"2023-10-08T16:11:14.585190+0000","last_active":"2023-10-08T16:11:14.585190+0000","last_peered":"2023-10-08T16:11:14.585190+0000","last_clean":"2023-10-08T16:11:14.585190+0000","last_became_active":"2023-10-08T16:11:14.584828+0000","last_became_peered":"2023-10-08T16:11:14.584828+0000","last_unstale":"2023-10-08T16:11:14.585190+0000","last_undegraded":"2023-10-08T16:11:14.585190+0000","last_fullsized":"2023-10-08T16:11:14.585190+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:36.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.593397+0000","last_change":"2023-10-08T16:11:14.593397+0000","last_active":"2023-10-08T16:11:14.593397+0000","last_peered":"2023-10-08T16:11:14.593397+0000","last_clean":"2023-10-08T16:11:14.593397+0000","last_became_active":"2023-10-08T16:11:14.592608+0000","last_became_peered":"2023-10-08T16:11:14.592608+0000","last_unstale":"2023-10-08T16:11:14.593397+0000","last_undegraded":"2023-10-08T16:11:14.593397+0000","last_fullsized":"2023-10-08T16:11:14.593397+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:42.726267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584608+0000","last_change":"2023-10-08T16:11:14.584531+0000","last_active":"2023-10-08T16:11:14.584608+0000","last_peered":"2023-10-08T16:11:14.584608+0000","last_clean":"2023-10-08T16:11:14.584608+0000","last_became_active":"2023-10-08T16:11:14.584287+0000","last_became_peered":"2023-10-08T16:11:14.584287+0000","last_unstale":"2023-10-08T16:11:14.584608+0000","last_undegraded":"2023-10-08T16:11:14.584608+0000","last_fullsized":"2023-10-08T16:11:14.584608+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:23.041664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589150+0000","last_change":"2023-10-08T16:11:14.589150+0000","last_active":"2023-10-08T16:11:14.589150+0000","last_peered":"2023-10-08T16:11:14.589150+0000","last_clean":"2023-10-08T16:11:14.589150+0000","last_became_active":"2023-10-08T16:11:14.588842+0000","last_became_peered":"2023-10-08T16:11:14.588842+0000","last_unstale":"2023-10-08T16:11:14.589150+0000","last_undegraded":"2023-10-08T16:11:14.589150+0000","last_fullsized":"2023-10-08T16:11:14.589150+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:06.503245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590052+0000","last_change":"2023-10-08T16:11:14.590052+0000","last_active":"2023-10-08T16:11:14.590052+0000","last_peered":"2023-10-08T16:11:14.590052+0000","last_clean":"2023-10-08T16:11:14.590052+0000","last_became_active":"2023-10-08T16:11:14.589627+0000","last_became_peered":"2023-10-08T16:11:14.589627+0000","last_unstale":"2023-10-08T16:11:14.590052+0000","last_undegraded":"2023-10-08T16:11:14.590052+0000","last_fullsized":"2023-10-08T16:11:14.590052+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:48.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579983+0000","last_change":"2023-10-08T16:11:14.579877+0000","last_active":"2023-10-08T16:11:14.579983+0000","last_peered":"2023-10-08T16:11:14.579983+0000","last_clean":"2023-10-08T16:11:14.579983+0000","last_became_active":"2023-10-08T16:11:14.579635+0000","last_became_peered":"2023-10-08T16:11:14.579635+0000","last_unstale":"2023-10-08T16:11:14.579983+0000","last_undegraded":"2023-10-08T16:11:14.579983+0000","last_fullsized":"2023-10-08T16:11:14.579983+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:01.353992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589188+0000","last_change":"2023-10-08T16:11:14.589188+0000","last_active":"2023-10-08T16:11:14.589188+0000","last_peered":"2023-10-08T16:11:14.589188+0000","last_clean":"2023-10-08T16:11:14.589188+0000","last_became_active":"2023-10-08T16:11:14.588898+0000","last_became_peered":"2023-10-08T16:11:14.588898+0000","last_unstale":"2023-10-08T16:11:14.589188+0000","last_undegraded":"2023-10-08T16:11:14.589188+0000","last_fullsized":"2023-10-08T16:11:14.589188+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:42.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580895+0000","last_change":"2023-10-08T16:11:14.580828+0000","last_active":"2023-10-08T16:11:14.580895+0000","last_peered":"2023-10-08T16:11:14.580895+0000","last_clean":"2023-10-08T16:11:14.580895+0000","last_became_active":"2023-10-08T16:11:14.580112+0000","last_became_peered":"2023-10-08T16:11:14.580112+0000","last_unstale":"2023-10-08T16:11:14.580895+0000","last_undegraded":"2023-10-08T16:11:14.580895+0000","last_fullsized":"2023-10-08T16:11:14.580895+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:22:27.843140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579241+0000","last_change":"2023-10-08T16:11:14.579174+0000","last_active":"2023-10-08T16:11:14.579241+0000","last_peered":"2023-10-08T16:11:14.579241+0000","last_clean":"2023-10-08T16:11:14.579241+0000","last_became_active":"2023-10-08T16:11:14.578932+0000","last_became_peered":"2023-10-08T16:11:14.578932+0000","last_unstale":"2023-10-08T16:11:14.579241+0000","last_undegraded":"2023-10-08T16:11:14.579241+0000","last_fullsized":"2023-10-08T16:11:14.579241+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:22.432335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"131'4","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596159+0000","last_change":"2023-10-08T16:11:13.576673+0000","last_active":"2023-10-08T16:11:14.596159+0000","last_peered":"2023-10-08T16:11:14.596159+0000","last_clean":"2023-10-08T16:11:14.596159+0000","last_became_active":"2023-10-08T16:11:13.576435+0000","last_became_peered":"2023-10-08T16:11:13.576435+0000","last_unstale":"2023-10-08T16:11:14.596159+0000","last_undegraded":"2023-10-08T16:11:14.596159+0000","last_fullsized":"2023-10-08T16:11:14.596159+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:44.206838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584755+0000","last_change":"2023-10-08T16:11:14.584524+0000","last_active":"2023-10-08T16:11:14.584755+0000","last_peered":"2023-10-08T16:11:14.584755+0000","last_clean":"2023-10-08T16:11:14.584755+0000","last_became_active":"2023-10-08T16:11:14.584297+0000","last_became_peered":"2023-10-08T16:11:14.584297+0000","last_unstale":"2023-10-08T16:11:14.584755+0000","last_undegraded":"2023-10-08T16:11:14.584755+0000","last_fullsized":"2023-10-08T16:11:14.584755+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"131'1","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582716+0000","last_change":"2023-10-08T16:11:13.575451+0000","last_active":"2023-10-08T16:11:14.582716+0000","last_peered":"2023-10-08T16:11:14.582716+0000","last_clean":"2023-10-08T16:11:14.582716+0000","last_became_active":"2023-10-08T16:11:13.575234+0000","last_became_peered":"2023-10-08T16:11:13.575234+0000","last_unstale":"2023-10-08T16:11:14.582716+0000","last_undegraded":"2023-10-08T16:11:14.582716+0000","last_fullsized":"2023-10-08T16:11:14.582716+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:21.425778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585524+0000","last_change":"2023-10-08T16:11:14.585481+0000","last_active":"2023-10-08T16:11:14.585524+0000","last_peered":"2023-10-08T16:11:14.585524+0000","last_clean":"2023-10-08T16:11:14.585524+0000","last_became_active":"2023-10-08T16:11:14.585251+0000","last_became_peered":"2023-10-08T16:11:14.585251+0000","last_unstale":"2023-10-08T16:11:14.585524+0000","last_undegraded":"2023-10-08T16:11:14.585524+0000","last_fullsized":"2023-10-08T16:11:14.585524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:09.845088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596118+0000","last_change":"2023-10-08T16:11:13.572382+0000","last_active":"2023-10-08T16:11:14.596118+0000","last_peered":"2023-10-08T16:11:14.596118+0000","last_clean":"2023-10-08T16:11:14.596118+0000","last_became_active":"2023-10-08T16:11:13.572154+0000","last_became_peered":"2023-10-08T16:11:13.572154+0000","last_unstale":"2023-10-08T16:11:14.596118+0000","last_undegraded":"2023-10-08T16:11:14.596118+0000","last_fullsized":"2023-10-08T16:11:14.596118+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:24.552931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585254+0000","last_change":"2023-10-08T16:11:14.585254+0000","last_active":"2023-10-08T16:11:14.585254+0000","last_peered":"2023-10-08T16:11:14.585254+0000","last_clean":"2023-10-08T16:11:14.585254+0000","last_became_active":"2023-10-08T16:11:14.584739+0000","last_became_peered":"2023-10-08T16:11:14.584739+0000","last_unstale":"2023-10-08T16:11:14.585254+0000","last_undegraded":"2023-10-08T16:11:14.585254+0000","last_fullsized":"2023-10-08T16:11:14.585254+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:48.540791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596565+0000","last_change":"2023-10-08T16:11:13.566206+0000","last_active":"2023-10-08T16:11:14.596565+0000","last_peered":"2023-10-08T16:11:14.596565+0000","last_clean":"2023-10-08T16:11:14.596565+0000","last_became_active":"2023-10-08T16:11:13.565618+0000","last_became_peered":"2023-10-08T16:11:13.565618+0000","last_unstale":"2023-10-08T16:11:14.596565+0000","last_undegraded":"2023-10-08T16:11:14.596565+0000","last_fullsized":"2023-10-08T16:11:14.596565+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:36.674755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.584081+0000","last_change":"2023-10-08T16:11:14.584081+0000","last_active":"2023-10-08T16:11:14.584081+0000","last_peered":"2023-10-08T16:11:14.584081+0000","last_clean":"2023-10-08T16:11:14.584081+0000","last_became_active":"2023-10-08T16:11:14.583653+0000","last_became_peered":"2023-10-08T16:11:14.583653+0000","last_unstale":"2023-10-08T16:11:14.584081+0000","last_undegraded":"2023-10-08T16:11:14.584081+0000","last_fullsized":"2023-10-08T16:11:14.584081+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:45.151802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"131'1","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596105+0000","last_change":"2023-10-08T16:11:13.574524+0000","last_active":"2023-10-08T16:11:14.596105+0000","last_peered":"2023-10-08T16:11:14.596105+0000","last_clean":"2023-10-08T16:11:14.596105+0000","last_became_active":"2023-10-08T16:11:13.574195+0000","last_became_peered":"2023-10-08T16:11:13.574195+0000","last_unstale":"2023-10-08T16:11:14.596105+0000","last_undegraded":"2023-10-08T16:11:14.596105+0000","last_fullsized":"2023-10-08T16:11:14.596105+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:34:58.236500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585919+0000","last_change":"2023-10-08T16:11:14.585919+0000","last_active":"2023-10-08T16:11:14.585919+0000","last_peered":"2023-10-08T16:11:14.585919+0000","last_clean":"2023-10-08T16:11:14.585919+0000","last_became_active":"2023-10-08T16:11:14.583635+0000","last_became_peered":"2023-10-08T16:11:14.583635+0000","last_unstale":"2023-10-08T16:11:14.585919+0000","last_undegraded":"2023-10-08T16:11:14.585919+0000","last_fullsized":"2023-10-08T16:11:14.585919+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"131'1","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.574967+0000","last_change":"2023-10-08T16:11:13.569944+0000","last_active":"2023-10-08T16:11:14.574967+0000","last_peered":"2023-10-08T16:11:14.574967+0000","last_clean":"2023-10-08T16:11:14.574967+0000","last_became_active":"2023-10-08T16:11:13.569767+0000","last_became_peered":"2023-10-08T16:11:13.569767+0000","last_unstale":"2023-10-08T16:11:14.574967+0000","last_undegraded":"2023-10-08T16:11:14.574967+0000","last_fullsized":"2023-10-08T16:11:14.574967+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:22.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591288+0000","last_change":"2023-10-08T16:11:14.591288+0000","last_active":"2023-10-08T16:11:14.591288+0000","last_peered":"2023-10-08T16:11:14.591288+0000","last_clean":"2023-10-08T16:11:14.591288+0000","last_became_active":"2023-10-08T16:11:14.590300+0000","last_became_peered":"2023-10-08T16:11:14.590300+0000","last_unstale":"2023-10-08T16:11:14.591288+0000","last_undegraded":"2023-10-08T16:11:14.591288+0000","last_fullsized":"2023-10-08T16:11:14.591288+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:54.581312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.574663+0000","last_change":"2023-10-08T16:11:13.574174+0000","last_active":"2023-10-08T16:11:13.574663+0000","last_peered":"2023-10-08T16:11:13.574663+0000","last_clean":"2023-10-08T16:11:13.574663+0000","last_became_active":"2023-10-08T16:11:13.573912+0000","last_became_peered":"2023-10-08T16:11:13.573912+0000","last_unstale":"2023-10-08T16:11:13.574663+0000","last_undegraded":"2023-10-08T16:11:13.574663+0000","last_fullsized":"2023-10-08T16:11:13.574663+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:22.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585259+0000","last_change":"2023-10-08T16:11:14.584704+0000","last_active":"2023-10-08T16:11:14.585259+0000","last_peered":"2023-10-08T16:11:14.585259+0000","last_clean":"2023-10-08T16:11:14.585259+0000","last_became_active":"2023-10-08T16:11:14.584498+0000","last_became_peered":"2023-10-08T16:11:14.584498+0000","last_unstale":"2023-10-08T16:11:14.585259+0000","last_undegraded":"2023-10-08T16:11:14.585259+0000","last_fullsized":"2023-10-08T16:11:14.585259+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:00.283505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.578674+0000","last_change":"2023-10-08T16:11:13.578595+0000","last_active":"2023-10-08T16:11:13.578674+0000","last_peered":"2023-10-08T16:11:13.578674+0000","last_clean":"2023-10-08T16:11:13.578674+0000","last_became_active":"2023-10-08T16:11:13.578323+0000","last_became_peered":"2023-10-08T16:11:13.578323+0000","last_unstale":"2023-10-08T16:11:13.578674+0000","last_undegraded":"2023-10-08T16:11:13.578674+0000","last_fullsized":"2023-10-08T16:11:13.578674+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:35.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.581259+0000","last_change":"2023-10-08T16:11:14.581035+0000","last_active":"2023-10-08T16:11:14.581259+0000","last_peered":"2023-10-08T16:11:14.581259+0000","last_clean":"2023-10-08T16:11:14.581259+0000","last_became_active":"2023-10-08T16:11:14.580742+0000","last_became_peered":"2023-10-08T16:11:14.580742+0000","last_unstale":"2023-10-08T16:11:14.581259+0000","last_undegraded":"2023-10-08T16:11:14.581259+0000","last_fullsized":"2023-10-08T16:11:14.581259+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:22:27.843140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.567062+0000","last_change":"2023-10-08T16:11:13.566358+0000","last_active":"2023-10-08T16:11:13.567062+0000","last_peered":"2023-10-08T16:11:13.567062+0000","last_clean":"2023-10-08T16:11:13.567062+0000","last_became_active":"2023-10-08T16:11:13.565984+0000","last_became_peered":"2023-10-08T16:11:13.565984+0000","last_unstale":"2023-10-08T16:11:13.567062+0000","last_undegraded":"2023-10-08T16:11:13.567062+0000","last_fullsized":"2023-10-08T16:11:13.567062+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:30.568698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591266+0000","last_change":"2023-10-08T16:11:14.591172+0000","last_active":"2023-10-08T16:11:14.591266+0000","last_peered":"2023-10-08T16:11:14.591266+0000","last_clean":"2023-10-08T16:11:14.591266+0000","last_became_active":"2023-10-08T16:11:14.590935+0000","last_became_peered":"2023-10-08T16:11:14.590935+0000","last_unstale":"2023-10-08T16:11:14.591266+0000","last_undegraded":"2023-10-08T16:11:14.591266+0000","last_fullsized":"2023-10-08T16:11:14.591266+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.571211+0000","last_change":"2023-10-08T16:11:13.570872+0000","last_active":"2023-10-08T16:11:13.571211+0000","last_peered":"2023-10-08T16:11:13.571211+0000","last_clean":"2023-10-08T16:11:13.571211+0000","last_became_active":"2023-10-08T16:11:13.570391+0000","last_became_peered":"2023-10-08T16:11:13.570391+0000","last_unstale":"2023-10-08T16:11:13.571211+0000","last_undegraded":"2023-10-08T16:11:13.571211+0000","last_fullsized":"2023-10-08T16:11:13.571211+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:05.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580091+0000","last_change":"2023-10-08T16:11:14.580091+0000","last_active":"2023-10-08T16:11:14.580091+0000","last_peered":"2023-10-08T16:11:14.580091+0000","last_clean":"2023-10-08T16:11:14.580091+0000","last_became_active":"2023-10-08T16:11:14.579841+0000","last_became_peered":"2023-10-08T16:11:14.579841+0000","last_unstale":"2023-10-08T16:11:14.580091+0000","last_undegraded":"2023-10-08T16:11:14.580091+0000","last_fullsized":"2023-10-08T16:11:14.580091+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"131'3","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.599080+0000","last_change":"2023-10-08T16:11:13.578127+0000","last_active":"2023-10-08T16:11:14.599080+0000","last_peered":"2023-10-08T16:11:14.599080+0000","last_clean":"2023-10-08T16:11:14.599080+0000","last_became_active":"2023-10-08T16:11:13.577880+0000","last_became_peered":"2023-10-08T16:11:13.577880+0000","last_unstale":"2023-10-08T16:11:14.599080+0000","last_undegraded":"2023-10-08T16:11:14.599080+0000","last_fullsized":"2023-10-08T16:11:14.599080+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:05.496688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586439+0000","last_change":"2023-10-08T16:11:14.586369+0000","last_active":"2023-10-08T16:11:14.586439+0000","last_peered":"2023-10-08T16:11:14.586439+0000","last_clean":"2023-10-08T16:11:14.586439+0000","last_became_active":"2023-10-08T16:11:14.586092+0000","last_became_peered":"2023-10-08T16:11:14.586092+0000","last_unstale":"2023-10-08T16:11:14.586439+0000","last_undegraded":"2023-10-08T16:11:14.586439+0000","last_fullsized":"2023-10-08T16:11:14.586439+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:22.432335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"131'6","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.599288+0000","last_change":"2023-10-08T16:11:13.578335+0000","last_active":"2023-10-08T16:11:14.599288+0000","last_peered":"2023-10-08T16:11:14.599288+0000","last_clean":"2023-10-08T16:11:14.599288+0000","last_became_active":"2023-10-08T16:11:13.577212+0000","last_became_peered":"2023-10-08T16:11:13.577212+0000","last_unstale":"2023-10-08T16:11:14.599288+0000","last_undegraded":"2023-10-08T16:11:14.599288+0000","last_fullsized":"2023-10-08T16:11:14.599288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:57.282100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582063+0000","last_change":"2023-10-08T16:11:14.582063+0000","last_active":"2023-10-08T16:11:14.582063+0000","last_peered":"2023-10-08T16:11:14.582063+0000","last_clean":"2023-10-08T16:11:14.582063+0000","last_became_active":"2023-10-08T16:11:14.581818+0000","last_became_peered":"2023-10-08T16:11:14.581818+0000","last_unstale":"2023-10-08T16:11:14.582063+0000","last_undegraded":"2023-10-08T16:11:14.582063+0000","last_fullsized":"2023-10-08T16:11:14.582063+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:24.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"131'2","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.597348+0000","last_change":"2023-10-08T16:11:13.574266+0000","last_active":"2023-10-08T16:11:14.597348+0000","last_peered":"2023-10-08T16:11:14.597348+0000","last_clean":"2023-10-08T16:11:14.597348+0000","last_became_active":"2023-10-08T16:11:13.574040+0000","last_became_peered":"2023-10-08T16:11:13.574040+0000","last_unstale":"2023-10-08T16:11:14.597348+0000","last_undegraded":"2023-10-08T16:11:14.597348+0000","last_fullsized":"2023-10-08T16:11:14.597348+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:55:42.158746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583632+0000","last_change":"2023-10-08T16:11:14.583632+0000","last_active":"2023-10-08T16:11:14.583632+0000","last_peered":"2023-10-08T16:11:14.583632+0000","last_clean":"2023-10-08T16:11:14.583632+0000","last_became_active":"2023-10-08T16:11:14.583390+0000","last_became_peered":"2023-10-08T16:11:14.583390+0000","last_unstale":"2023-10-08T16:11:14.583632+0000","last_undegraded":"2023-10-08T16:11:14.583632+0000","last_fullsized":"2023-10-08T16:11:14.583632+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:03.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582246+0000","last_change":"2023-10-08T16:11:13.579203+0000","last_active":"2023-10-08T16:11:14.582246+0000","last_peered":"2023-10-08T16:11:14.582246+0000","last_clean":"2023-10-08T16:11:14.582246+0000","last_became_active":"2023-10-08T16:11:13.578946+0000","last_became_peered":"2023-10-08T16:11:13.578946+0000","last_unstale":"2023-10-08T16:11:14.582246+0000","last_undegraded":"2023-10-08T16:11:14.582246+0000","last_fullsized":"2023-10-08T16:11:14.582246+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:50.154016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580232+0000","last_change":"2023-10-08T16:11:14.580232+0000","last_active":"2023-10-08T16:11:14.580232+0000","last_peered":"2023-10-08T16:11:14.580232+0000","last_clean":"2023-10-08T16:11:14.580232+0000","last_became_active":"2023-10-08T16:11:14.580019+0000","last_became_peered":"2023-10-08T16:11:14.580019+0000","last_unstale":"2023-10-08T16:11:14.580232+0000","last_undegraded":"2023-10-08T16:11:14.580232+0000","last_fullsized":"2023-10-08T16:11:14.580232+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:51.990784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"131'8","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.599425+0000","last_change":"2023-10-08T16:11:13.575141+0000","last_active":"2023-10-08T16:11:14.599425+0000","last_peered":"2023-10-08T16:11:14.599425+0000","last_clean":"2023-10-08T16:11:14.599425+0000","last_became_active":"2023-10-08T16:11:13.574925+0000","last_became_peered":"2023-10-08T16:11:13.574925+0000","last_unstale":"2023-10-08T16:11:14.599425+0000","last_undegraded":"2023-10-08T16:11:14.599425+0000","last_fullsized":"2023-10-08T16:11:14.599425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:01.930473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589827+0000","last_change":"2023-10-08T16:11:14.589827+0000","last_active":"2023-10-08T16:11:14.589827+0000","last_peered":"2023-10-08T16:11:14.589827+0000","last_clean":"2023-10-08T16:11:14.589827+0000","last_became_active":"2023-10-08T16:11:14.589528+0000","last_became_peered":"2023-10-08T16:11:14.589528+0000","last_unstale":"2023-10-08T16:11:14.589827+0000","last_undegraded":"2023-10-08T16:11:14.589827+0000","last_fullsized":"2023-10-08T16:11:14.589827+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:58.227223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"131'1","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586910+0000","last_change":"2023-10-08T16:11:13.577450+0000","last_active":"2023-10-08T16:11:14.586910+0000","last_peered":"2023-10-08T16:11:14.586910+0000","last_clean":"2023-10-08T16:11:14.586910+0000","last_became_active":"2023-10-08T16:11:13.576321+0000","last_became_peered":"2023-10-08T16:11:13.576321+0000","last_unstale":"2023-10-08T16:11:14.586910+0000","last_undegraded":"2023-10-08T16:11:14.586910+0000","last_fullsized":"2023-10-08T16:11:14.586910+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:10.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588538+0000","last_change":"2023-10-08T16:11:14.588271+0000","last_active":"2023-10-08T16:11:14.588538+0000","last_peered":"2023-10-08T16:11:14.588538+0000","last_clean":"2023-10-08T16:11:14.588538+0000","last_became_active":"2023-10-08T16:11:14.588020+0000","last_became_peered":"2023-10-08T16:11:14.588020+0000","last_unstale":"2023-10-08T16:11:14.588538+0000","last_undegraded":"2023-10-08T16:11:14.588538+0000","last_fullsized":"2023-10-08T16:11:14.588538+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:48.057694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.594932+0000","last_change":"2023-10-08T16:11:13.576323+0000","last_active":"2023-10-08T16:11:14.594932+0000","last_peered":"2023-10-08T16:11:14.594932+0000","last_clean":"2023-10-08T16:11:14.594932+0000","last_became_active":"2023-10-08T16:11:13.576044+0000","last_became_peered":"2023-10-08T16:11:13.576044+0000","last_unstale":"2023-10-08T16:11:14.594932+0000","last_undegraded":"2023-10-08T16:11:14.594932+0000","last_fullsized":"2023-10-08T16:11:14.594932+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:57.636754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.592072+0000","last_change":"2023-10-08T16:11:14.592072+0000","last_active":"2023-10-08T16:11:14.592072+0000","last_peered":"2023-10-08T16:11:14.592072+0000","last_clean":"2023-10-08T16:11:14.592072+0000","last_became_active":"2023-10-08T16:11:14.591866+0000","last_became_peered":"2023-10-08T16:11:14.591866+0000","last_unstale":"2023-10-08T16:11:14.592072+0000","last_undegraded":"2023-10-08T16:11:14.592072+0000","last_fullsized":"2023-10-08T16:11:14.592072+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:48.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"131'1","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.596414+0000","last_change":"2023-10-08T16:11:13.571567+0000","last_active":"2023-10-08T16:11:14.596414+0000","last_peered":"2023-10-08T16:11:14.596414+0000","last_clean":"2023-10-08T16:11:14.596414+0000","last_became_active":"2023-10-08T16:11:13.571292+0000","last_became_peered":"2023-10-08T16:11:13.571292+0000","last_unstale":"2023-10-08T16:11:14.596414+0000","last_undegraded":"2023-10-08T16:11:14.596414+0000","last_fullsized":"2023-10-08T16:11:14.596414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:18.848253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.591041+0000","last_change":"2023-10-08T16:11:14.591041+0000","last_active":"2023-10-08T16:11:14.591041+0000","last_peered":"2023-10-08T16:11:14.591041+0000","last_clean":"2023-10-08T16:11:14.591041+0000","last_became_active":"2023-10-08T16:11:14.590804+0000","last_became_peered":"2023-10-08T16:11:14.590804+0000","last_unstale":"2023-10-08T16:11:14.591041+0000","last_undegraded":"2023-10-08T16:11:14.591041+0000","last_fullsized":"2023-10-08T16:11:14.591041+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580603+0000","last_change":"2023-10-08T16:11:13.577839+0000","last_active":"2023-10-08T16:11:14.580603+0000","last_peered":"2023-10-08T16:11:14.580603+0000","last_clean":"2023-10-08T16:11:14.580603+0000","last_became_active":"2023-10-08T16:11:13.577535+0000","last_became_peered":"2023-10-08T16:11:13.577535+0000","last_unstale":"2023-10-08T16:11:14.580603+0000","last_undegraded":"2023-10-08T16:11:14.580603+0000","last_fullsized":"2023-10-08T16:11:14.580603+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:42.235791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588425+0000","last_change":"2023-10-08T16:11:14.588425+0000","last_active":"2023-10-08T16:11:14.588425+0000","last_peered":"2023-10-08T16:11:14.588425+0000","last_clean":"2023-10-08T16:11:14.588425+0000","last_became_active":"2023-10-08T16:11:14.587735+0000","last_became_peered":"2023-10-08T16:11:14.587735+0000","last_unstale":"2023-10-08T16:11:14.588425+0000","last_undegraded":"2023-10-08T16:11:14.588425+0000","last_fullsized":"2023-10-08T16:11:14.588425+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:10.122569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"131'2","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.597061+0000","last_change":"2023-10-08T16:11:13.569560+0000","last_active":"2023-10-08T16:11:14.597061+0000","last_peered":"2023-10-08T16:11:14.597061+0000","last_clean":"2023-10-08T16:11:14.597061+0000","last_became_active":"2023-10-08T16:11:13.569321+0000","last_became_peered":"2023-10-08T16:11:13.569321+0000","last_unstale":"2023-10-08T16:11:14.597061+0000","last_undegraded":"2023-10-08T16:11:14.597061+0000","last_fullsized":"2023-10-08T16:11:14.597061+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:26.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590095+0000","last_change":"2023-10-08T16:11:14.590095+0000","last_active":"2023-10-08T16:11:14.590095+0000","last_peered":"2023-10-08T16:11:14.590095+0000","last_clean":"2023-10-08T16:11:14.590095+0000","last_became_active":"2023-10-08T16:11:14.588583+0000","last_became_peered":"2023-10-08T16:11:14.588583+0000","last_unstale":"2023-10-08T16:11:14.590095+0000","last_undegraded":"2023-10-08T16:11:14.590095+0000","last_fullsized":"2023-10-08T16:11:14.590095+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:44.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.567023+0000","last_change":"2023-10-08T16:11:13.566040+0000","last_active":"2023-10-08T16:11:13.567023+0000","last_peered":"2023-10-08T16:11:13.567023+0000","last_clean":"2023-10-08T16:11:13.567023+0000","last_became_active":"2023-10-08T16:11:13.565625+0000","last_became_peered":"2023-10-08T16:11:13.565625+0000","last_unstale":"2023-10-08T16:11:13.567023+0000","last_undegraded":"2023-10-08T16:11:13.567023+0000","last_fullsized":"2023-10-08T16:11:13.567023+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:41.070391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586751+0000","last_change":"2023-10-08T16:11:14.586751+0000","last_active":"2023-10-08T16:11:14.586751+0000","last_peered":"2023-10-08T16:11:14.586751+0000","last_clean":"2023-10-08T16:11:14.586751+0000","last_became_active":"2023-10-08T16:11:14.586530+0000","last_became_peered":"2023-10-08T16:11:14.586530+0000","last_unstale":"2023-10-08T16:11:14.586751+0000","last_undegraded":"2023-10-08T16:11:14.586751+0000","last_fullsized":"2023-10-08T16:11:14.586751+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:40.438084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.577671+0000","last_change":"2023-10-08T16:11:13.570934+0000","last_active":"2023-10-08T16:11:14.577671+0000","last_peered":"2023-10-08T16:11:14.577671+0000","last_clean":"2023-10-08T16:11:14.577671+0000","last_became_active":"2023-10-08T16:11:13.570658+0000","last_became_peered":"2023-10-08T16:11:13.570658+0000","last_unstale":"2023-10-08T16:11:14.577671+0000","last_undegraded":"2023-10-08T16:11:14.577671+0000","last_fullsized":"2023-10-08T16:11:14.577671+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:34:58.236500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588339+0000","last_change":"2023-10-08T16:11:14.588339+0000","last_active":"2023-10-08T16:11:14.588339+0000","last_peered":"2023-10-08T16:11:14.588339+0000","last_clean":"2023-10-08T16:11:14.588339+0000","last_became_active":"2023-10-08T16:11:14.588102+0000","last_became_peered":"2023-10-08T16:11:14.588102+0000","last_unstale":"2023-10-08T16:11:14.588339+0000","last_undegraded":"2023-10-08T16:11:14.588339+0000","last_fullsized":"2023-10-08T16:11:14.588339+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:36.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.575338+0000","last_change":"2023-10-08T16:11:13.574484+0000","last_active":"2023-10-08T16:11:13.575338+0000","last_peered":"2023-10-08T16:11:13.575338+0000","last_clean":"2023-10-08T16:11:13.575338+0000","last_became_active":"2023-10-08T16:11:13.574239+0000","last_became_peered":"2023-10-08T16:11:13.574239+0000","last_unstale":"2023-10-08T16:11:13.575338+0000","last_undegraded":"2023-10-08T16:11:13.575338+0000","last_fullsized":"2023-10-08T16:11:13.575338+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:50.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.589960+0000","last_change":"2023-10-08T16:11:14.589893+0000","last_active":"2023-10-08T16:11:14.589960+0000","last_peered":"2023-10-08T16:11:14.589960+0000","last_clean":"2023-10-08T16:11:14.589960+0000","last_became_active":"2023-10-08T16:11:14.589608+0000","last_became_peered":"2023-10-08T16:11:14.589608+0000","last_unstale":"2023-10-08T16:11:14.589960+0000","last_undegraded":"2023-10-08T16:11:14.589960+0000","last_fullsized":"2023-10-08T16:11:14.589960+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:39.730029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"131'2","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.595482+0000","last_change":"2023-10-08T16:11:13.576391+0000","last_active":"2023-10-08T16:11:14.595482+0000","last_peered":"2023-10-08T16:11:14.595482+0000","last_clean":"2023-10-08T16:11:14.595482+0000","last_became_active":"2023-10-08T16:11:13.576126+0000","last_became_peered":"2023-10-08T16:11:13.576126+0000","last_unstale":"2023-10-08T16:11:14.595482+0000","last_undegraded":"2023-10-08T16:11:14.595482+0000","last_fullsized":"2023-10-08T16:11:14.595482+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:15:54.724784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590112+0000","last_change":"2023-10-08T16:11:14.590112+0000","last_active":"2023-10-08T16:11:14.590112+0000","last_peered":"2023-10-08T16:11:14.590112+0000","last_clean":"2023-10-08T16:11:14.590112+0000","last_became_active":"2023-10-08T16:11:14.587323+0000","last_became_peered":"2023-10-08T16:11:14.587323+0000","last_unstale":"2023-10-08T16:11:14.590112+0000","last_undegraded":"2023-10-08T16:11:14.590112+0000","last_fullsized":"2023-10-08T16:11:14.590112+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:28.409126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.582777+0000","last_change":"2023-10-08T16:11:13.572510+0000","last_active":"2023-10-08T16:11:14.582777+0000","last_peered":"2023-10-08T16:11:14.582777+0000","last_clean":"2023-10-08T16:11:14.582777+0000","last_became_active":"2023-10-08T16:11:13.572291+0000","last_became_peered":"2023-10-08T16:11:13.572291+0000","last_unstale":"2023-10-08T16:11:14.582777+0000","last_undegraded":"2023-10-08T16:11:14.582777+0000","last_fullsized":"2023-10-08T16:11:14.582777+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:34.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590993+0000","last_change":"2023-10-08T16:11:14.590993+0000","last_active":"2023-10-08T16:11:14.590993+0000","last_peered":"2023-10-08T16:11:14.590993+0000","last_clean":"2023-10-08T16:11:14.590993+0000","last_became_active":"2023-10-08T16:11:14.589975+0000","last_became_peered":"2023-10-08T16:11:14.589975+0000","last_unstale":"2023-10-08T16:11:14.590993+0000","last_undegraded":"2023-10-08T16:11:14.590993+0000","last_fullsized":"2023-10-08T16:11:14.590993+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:06.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.577973+0000","last_change":"2023-10-08T16:11:13.577623+0000","last_active":"2023-10-08T16:11:13.577973+0000","last_peered":"2023-10-08T16:11:13.577973+0000","last_clean":"2023-10-08T16:11:13.577973+0000","last_became_active":"2023-10-08T16:11:13.576589+0000","last_became_peered":"2023-10-08T16:11:13.576589+0000","last_unstale":"2023-10-08T16:11:13.577973+0000","last_undegraded":"2023-10-08T16:11:13.577973+0000","last_fullsized":"2023-10-08T16:11:13.577973+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:02.353626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.590284+0000","last_change":"2023-10-08T16:11:14.590077+0000","last_active":"2023-10-08T16:11:14.590284+0000","last_peered":"2023-10-08T16:11:14.590284+0000","last_clean":"2023-10-08T16:11:14.590284+0000","last_became_active":"2023-10-08T16:11:14.589850+0000","last_became_peered":"2023-10-08T16:11:14.589850+0000","last_unstale":"2023-10-08T16:11:14.590284+0000","last_undegraded":"2023-10-08T16:11:14.590284+0000","last_fullsized":"2023-10-08T16:11:14.590284+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:34.225133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.572405+0000","last_change":"2023-10-08T16:11:13.572336+0000","last_active":"2023-10-08T16:11:13.572405+0000","last_peered":"2023-10-08T16:11:13.572405+0000","last_clean":"2023-10-08T16:11:13.572405+0000","last_became_active":"2023-10-08T16:11:13.572114+0000","last_became_peered":"2023-10-08T16:11:13.572114+0000","last_unstale":"2023-10-08T16:11:13.572405+0000","last_undegraded":"2023-10-08T16:11:13.572405+0000","last_fullsized":"2023-10-08T16:11:13.572405+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:34.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.586413+0000","last_change":"2023-10-08T16:11:14.586413+0000","last_active":"2023-10-08T16:11:14.586413+0000","last_peered":"2023-10-08T16:11:14.586413+0000","last_clean":"2023-10-08T16:11:14.586413+0000","last_became_active":"2023-10-08T16:11:14.585552+0000","last_became_peered":"2023-10-08T16:11:14.585552+0000","last_unstale":"2023-10-08T16:11:14.586413+0000","last_undegraded":"2023-10-08T16:11:14.586413+0000","last_fullsized":"2023-10-08T16:11:14.586413+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:11.562994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.579436+0000","last_change":"2023-10-08T16:11:13.576798+0000","last_active":"2023-10-08T16:11:14.579436+0000","last_peered":"2023-10-08T16:11:14.579436+0000","last_clean":"2023-10-08T16:11:14.579436+0000","last_became_active":"2023-10-08T16:11:13.576523+0000","last_became_peered":"2023-10-08T16:11:13.576523+0000","last_unstale":"2023-10-08T16:11:14.579436+0000","last_undegraded":"2023-10-08T16:11:14.579436+0000","last_fullsized":"2023-10-08T16:11:14.579436+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:57.220666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583425+0000","last_change":"2023-10-08T16:11:14.583425+0000","last_active":"2023-10-08T16:11:14.583425+0000","last_peered":"2023-10-08T16:11:14.583425+0000","last_clean":"2023-10-08T16:11:14.583425+0000","last_became_active":"2023-10-08T16:11:14.582898+0000","last_became_peered":"2023-10-08T16:11:14.582898+0000","last_unstale":"2023-10-08T16:11:14.583425+0000","last_undegraded":"2023-10-08T16:11:14.583425+0000","last_fullsized":"2023-10-08T16:11:14.583425+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:10.122569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.574682+0000","last_change":"2023-10-08T16:11:13.574599+0000","last_active":"2023-10-08T16:11:13.574682+0000","last_peered":"2023-10-08T16:11:13.574682+0000","last_clean":"2023-10-08T16:11:13.574682+0000","last_became_active":"2023-10-08T16:11:13.574362+0000","last_became_peered":"2023-10-08T16:11:13.574362+0000","last_unstale":"2023-10-08T16:11:13.574682+0000","last_undegraded":"2023-10-08T16:11:13.574682+0000","last_fullsized":"2023-10-08T16:11:13.574682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:47.051137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.588284+0000","last_change":"2023-10-08T16:11:14.588284+0000","last_active":"2023-10-08T16:11:14.588284+0000","last_peered":"2023-10-08T16:11:14.588284+0000","last_clean":"2023-10-08T16:11:14.588284+0000","last_became_active":"2023-10-08T16:11:14.587455+0000","last_became_peered":"2023-10-08T16:11:14.587455+0000","last_unstale":"2023-10-08T16:11:14.588284+0000","last_undegraded":"2023-10-08T16:11:14.588284+0000","last_fullsized":"2023-10-08T16:11:14.588284+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:38.579714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.569767+0000","last_change":"2023-10-08T16:11:13.569707+0000","last_active":"2023-10-08T16:11:13.569767+0000","last_peered":"2023-10-08T16:11:13.569767+0000","last_clean":"2023-10-08T16:11:13.569767+0000","last_became_active":"2023-10-08T16:11:13.569464+0000","last_became_peered":"2023-10-08T16:11:13.569464+0000","last_unstale":"2023-10-08T16:11:13.569767+0000","last_undegraded":"2023-10-08T16:11:13.569767+0000","last_fullsized":"2023-10-08T16:11:13.569767+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:54.874323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.583939+0000","last_change":"2023-10-08T16:11:14.583939+0000","last_active":"2023-10-08T16:11:14.583939+0000","last_peered":"2023-10-08T16:11:14.583939+0000","last_clean":"2023-10-08T16:11:14.583939+0000","last_became_active":"2023-10-08T16:11:14.583367+0000","last_became_peered":"2023-10-08T16:11:14.583367+0000","last_unstale":"2023-10-08T16:11:14.583939+0000","last_undegraded":"2023-10-08T16:11:14.583939+0000","last_fullsized":"2023-10-08T16:11:14.583939+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:20.040960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.577991+0000","last_change":"2023-10-08T16:11:13.577777+0000","last_active":"2023-10-08T16:11:13.577991+0000","last_peered":"2023-10-08T16:11:13.577991+0000","last_clean":"2023-10-08T16:11:13.577991+0000","last_became_active":"2023-10-08T16:11:13.576853+0000","last_became_peered":"2023-10-08T16:11:13.576853+0000","last_unstale":"2023-10-08T16:11:13.577991+0000","last_undegraded":"2023-10-08T16:11:13.577991+0000","last_fullsized":"2023-10-08T16:11:13.577991+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:47.440464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.585110+0000","last_change":"2023-10-08T16:11:14.585110+0000","last_active":"2023-10-08T16:11:14.585110+0000","last_peered":"2023-10-08T16:11:14.585110+0000","last_clean":"2023-10-08T16:11:14.585110+0000","last_became_active":"2023-10-08T16:11:14.584866+0000","last_became_peered":"2023-10-08T16:11:14.584866+0000","last_unstale":"2023-10-08T16:11:14.585110+0000","last_undegraded":"2023-10-08T16:11:14.585110+0000","last_fullsized":"2023-10-08T16:11:14.585110+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:13.557843+0000","last_clean_scrub_stamp":"2023-10-08T16:11:13.557843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:48.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-10-08T16:11:14.580425+0000","last_change":"2023-10-08T16:11:13.577717+0000","last_active":"2023-10-08T16:11:14.580425+0000","last_peered":"2023-10-08T16:11:14.580425+0000","last_clean":"2023-10-08T16:11:14.580425+0000","last_became_active":"2023-10-08T16:11:13.577307+0000","last_became_peered":"2023-10-08T16:11:13.577307+0000","last_unstale":"2023-10-08T16:11:14.580425+0000","last_undegraded":"2023-10-08T16:11:14.580425+0000","last_fullsized":"2023-10-08T16:11:14.580425+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:11:12.551286+0000","last_clean_scrub_stamp":"2023-10-08T16:11:12.551286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:26.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-10-08T16:11:13.572377+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:11:13.572377+0000","last_peered":"2023-10-08T16:11:13.572377+0000","last_clean":"2023-10-08T16:11:13.572377+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:11:13.572377+0000","last_undegraded":"2023-10-08T16:11:13.572377+0000","last_fullsized":"2023-10-08T16:11:13.572377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1282,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194030,"statfs":{"total":200000000,"available":198687188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.377,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64100000000000001,"5min":0.72599999999999998,"15min":0.83099999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.79800000000000004,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.62},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82499999999999996,"5min":1.756,"15min":1.756},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.79,"15min":1.79},"last":0.60299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.74299999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.504,"15min":0.503},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.34399999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.823,"15min":1.823},"last":0.76800000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78000000000000003,"5min":1.252,"15min":1.252},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194601,"statfs":{"total":200000000,"available":199271786,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.34399999999999997,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.59199999999999997,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":0.626},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58399999999999996,"15min":0.56000000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.55800000000000005,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.29799999999999999},"max":{"1min":3.516,"5min":3.516,"15min":3.516},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.65800000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.441,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.58799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.33800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64500000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.30399999999999999,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73099999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278020,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36099999999999999,"15min":0.46700000000000003},"min":{"1min":0.23300000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.59899999999999998,"15min":3.593},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.28799999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63600000000000001,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.622,"5min":0.622,"15min":3.6259999999999999},"last":0.437},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.34899999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40999999999999998,"15min":0.439},"min":{"1min":0.26800000000000002,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.80400000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63,"15min":0.70199999999999996},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0620000000000001,"15min":3.5630000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.60099999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":1.2969999999999999,"15min":1.7030000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.71899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.94099999999999995,"15min":3.532},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.83499999999999996,"5min":1.341,"15min":1.6699999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64000000000000001,"15min":0.72399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":3.4929999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91600000000000004,"5min":1.0740000000000001,"15min":1.095},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.5429999999999999,"15min":1.6279999999999999},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1283,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194029,"statfs":{"total":200000000,"available":198686128,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35899999999999999,"15min":0.376},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.41999999999999998,"15min":0.47799999999999998},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.24199999999999999},"max":{"1min":3.044,"5min":3.044,"15min":3.044},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.24399999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.28999999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65500000000000003,"15min":0.70799999999999996},"min":{"1min":0.45000000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.65500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.622},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.623,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.69799999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"max":{"1min":3.665,"5min":3.665,"15min":3.665},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.69599999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.435,"5min":0.56899999999999995,"15min":0.65500000000000003},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":2.7109999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.26400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.67100000000000004,"15min":0.746},"last":0.252},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.25600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.50600000000000001,"5min":0.68899999999999995,"15min":0.70299999999999996},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.436},"min":{"1min":0.32400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52300000000000002,"5min":0.74099999999999999,"15min":1.3260000000000001},"last":0.379},{"interface":"front","average":{"1min":0.437,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":1.2549999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.37},"max":{"1min":0.80800000000000005,"5min":0.93500000000000005,"15min":2.8980000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.58699999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74099999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.434}]},{"osd":5,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76500000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.66500000000000004},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.99299999999999999,"15min":2.9319999999999999},"last":0.40799999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.627,"15min":0.60199999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":1.091,"15min":1.091},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83199999999999996,"5min":1.042,"15min":3.0030000000000001},"last":0.443},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64700000000000002,"15min":0.621},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199276538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34499999999999997,"15min":0.315},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.35999999999999999},"min":{"1min":0.23400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55000000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36499999999999999,"15min":0.34699999999999998},"min":{"1min":0.25900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.216},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.374},"min":{"1min":0.30399999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.57199999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.39100000000000001,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.378},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.39400000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58299999999999996,"5min":0.628,"15min":0.628},"last":0.34899999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59699999999999998,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97899999999999998,"5min":0.999,"15min":0.999},"last":0.503},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84299999999999997,"5min":1.026,"15min":1.026},"last":0.626}]},{"osd":7,"last update":"Sun Oct 8 16:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.878,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28899999999999998},"max":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":1.141},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":1.149},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60299999999999998,"15min":0.55600000000000005},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.77000000000000002,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.34899999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.77500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.70199999999999996,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":14.6,"15min":14.6},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.624,"15min":0.56799999999999995},"min":{"1min":0.34799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.752,"5min":7.556,"15min":7.556},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77300000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.45200000000000001,"15min":0.47199999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.754,"15min":0.754},"last":0.502}]},{"osd":6,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64800000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67700000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199277568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.315,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.374,"5min":0.315,"15min":0.31},"max":{"1min":0.73099999999999998,"5min":0.77400000000000002,"15min":0.79700000000000004},"last":0.46500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.79500000000000004,"15min":0.81200000000000006},"last":0.52700000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76700000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.48599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.754,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.44800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.36899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70199999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38200000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.41299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.84199999999999997},"last":0.47899999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.46400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.42599999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:11:19.328 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:11:19.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:11:19.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.456+0000 7f8418146700 1 Processor -- start 2023-10-08T16:11:19.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.457+0000 7f8418146700 1 -- start start 2023-10-08T16:11:19.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8418146700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f841015a290 0x7f841006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8418146700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f841006aae0 0x7f84100cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8418146700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100b0790 con 0x7f8410159ec0 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8418146700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841006af20 con 0x7f841006aae0 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8418146700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100ce1f0 con 0x7f841015a290 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8415ee2700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8410159ec0 0x7f84100af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43770/0 (socket says 172.21.15.60:43770) 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8415ee2700 1 -- 172.21.15.60:0/4214984991 learned_addr learned my addr 172.21.15.60:0/4214984991 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84166e3700 1 --2- 172.21.15.60:0/4214984991 >> v2:172.21.15.60:3300/0 conn(0x7f841006aae0 0x7f84100cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84156e1700 1 --2- 172.21.15.60:0/4214984991 >> v2:172.21.15.144:3300/0 conn(0x7f841015a290 0x7f841006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8414ee0700 1 -- 172.21.15.60:0/4214984991 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876998435 0 0) 0x7f84100b0790 con 0x7f8410159ec0 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8414ee0700 1 -- 172.21.15.60:0/4214984991 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f8003570 con 0x7f8410159ec0 2023-10-08T16:11:19.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84166e3700 1 -- 172.21.15.60:0/4214984991 >> v2:172.21.15.144:3300/0 conn(0x7f841015a290 msgr2=0x7f841006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84166e3700 1 --2- 172.21.15.60:0/4214984991 >> v2:172.21.15.144:3300/0 conn(0x7f841015a290 0x7f841006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84166e3700 1 -- 172.21.15.60:0/4214984991 >> v1:172.21.15.60:6789/0 conn(0x7f8410159ec0 legacy=0x7f84100af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84166e3700 1 -- 172.21.15.60:0/4214984991 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100b0b20 con 0x7f841006aae0 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f84166e3700 1 --2- 172.21.15.60:0/4214984991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841006aae0 0x7f84100cf590 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8410089910 tx=0x7f84080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848665d914f9cf35 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8414ee0700 1 -- 172.21.15.60:0/4214984991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408011630 con 0x7f841006aae0 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8414ee0700 1 -- 172.21.15.60:0/4214984991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080117b0 con 0x7f841006aae0 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.458+0000 7f8414ee0700 1 -- 172.21.15.60:0/4214984991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408011b70 con 0x7f841006aae0 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 -- 172.21.15.60:0/4214984991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841006aae0 msgr2=0x7f84100cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 --2- 172.21.15.60:0/4214984991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841006aae0 0x7f84100cf590 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8410089910 tx=0x7f84080091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 -- 172.21.15.60:0/4214984991 shutdown_connections 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 --2- 172.21.15.60:0/4214984991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841006aae0 0x7f84100cf590 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 --2- 172.21.15.60:0/4214984991 >> v2:172.21.15.144:3300/0 conn(0x7f841015a290 0x7f841006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 -- 172.21.15.60:0/4214984991 >> 172.21.15.60:0/4214984991 conn(0x7f84100d1880 msgr2=0x7f84100cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 -- 172.21.15.60:0/4214984991 shutdown_connections 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.459+0000 7f8418146700 1 -- 172.21.15.60:0/4214984991 wait complete. 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.460+0000 7f8418146700 1 Processor -- start 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.460+0000 7f8418146700 1 -- start start 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f8418146700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f841006aae0 0x7f84100c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f8418146700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8410159ec0 0x7f84100b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f8418146700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 0x7f84100cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f8418146700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410155cc0 con 0x7f841015a290 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f8418146700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c92e0 con 0x7f8410159ec0 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f8418146700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c95c0 con 0x7f841006aae0 2023-10-08T16:11:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 0x7f84100cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 0x7f84100cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48208/0 (socket says 172.21.15.60:48208) 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 -- 172.21.15.60:0/3946440138 learned_addr learned my addr 172.21.15.60:0/3946440138 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 -- 172.21.15.60:0/3946440138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f841006aae0 msgr2=0x7f84100c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f841006aae0 0x7f84100c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 -- 172.21.15.60:0/3946440138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8410159ec0 msgr2=0x7f84100b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8410159ec0 0x7f84100b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 -- 172.21.15.60:0/3946440138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009420 con 0x7f841015a290 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.461+0000 7f84166e3700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 0x7f84100cb010 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f84080093f0 tx=0x7f8408017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.462+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840801f070 con 0x7f841015a290 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.462+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408011b30 con 0x7f841015a290 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.462+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100b3c80 con 0x7f841015a290 2023-10-08T16:11:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.462+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408023640 con 0x7f841015a290 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.462+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84100c98a0 con 0x7f841015a290 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.463+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841004c3c0 con 0x7f841015a290 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.463+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f840802c3b0 con 0x7f841015a290 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.464+0000 7f840dffb700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83fc066f30 0x7f83fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.464+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8408085b20 con 0x7f841015a290 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.464+0000 7f8415ee2700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83fc066f30 0x7f83fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.464+0000 7f8415ee2700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83fc066f30 0x7f83fc0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8400005c50 tx=0x7f84000016e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.468+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8408052cf0 con 0x7f841015a290 2023-10-08T16:11:19.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.741+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f84100b04b0 con 0x7f841015a290 2023-10-08T16:11:19.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.744+0000 7f840dffb700 1 -- 172.21.15.60:0/3946440138 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8408056310 con 0x7f841015a290 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83fc066f30 msgr2=0x7f83fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83fc066f30 0x7f83fc0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8400005c50 tx=0x7f84000016e0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 msgr2=0x7f84100cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 0x7f84100cb010 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f84080093f0 tx=0x7f8408017000 comp rx=0 tx=0).stop 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 shutdown_connections 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f83fc066f30 0x7f83fc0693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f841006aae0 0x7f84100c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841015a290 0x7f84100cb010 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 --2- 172.21.15.60:0/3946440138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8410159ec0 0x7f84100b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 >> 172.21.15.60:0/3946440138 conn(0x7f84100d1880 msgr2=0x7f84100cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:19.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 shutdown_connections 2023-10-08T16:11:19.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.746+0000 7f8418146700 1 -- 172.21.15.60:0/3946440138 wait complete. 2023-10-08T16:11:19.748 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:11:19.759 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:19.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.878+0000 7f27dc913700 1 Processor -- start 2023-10-08T16:11:19.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.878+0000 7f27dc913700 1 -- start start 2023-10-08T16:11:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27dc913700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f27d815a620 0x7f27d815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27dc913700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d815cbb0 con 0x7f27d8157870 2023-10-08T16:11:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27dc913700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d815bfa0 con 0x7f27d815d580 2023-10-08T16:11:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27dc913700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d815bdb0 con 0x7f27d815a620 2023-10-08T16:11:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27d659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f27d8157870 0x7f27d815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43784/0 (socket says 172.21.15.60:43784) 2023-10-08T16:11:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27d659c700 1 -- 172.21.15.60:0/3035958271 learned_addr learned my addr 172.21.15.60:0/3035958271 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/3035958271 >> v2:172.21.15.144:3300/0 conn(0x7f27d815a620 0x7f27d815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214602359 0 0) 0x7f27d815cbb0 con 0x7f27d8157870 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.879+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c4003570 con 0x7f27d8157870 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356217241 0 0) 0x7f27c4003570 con 0x7f27d8157870 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 >> v2:172.21.15.144:3300/0 conn(0x7f27d815a620 msgr2=0x7f27d815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 --2- 172.21.15.60:0/3035958271 >> v2:172.21.15.144:3300/0 conn(0x7f27d815a620 0x7f27d815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 >> v1:172.21.15.144:6789/0 conn(0x7f27d815d580 legacy=0x7f27d8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d815c280 con 0x7f27d8157870 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f27d0001470 con 0x7f27d8157870 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 >> v1:172.21.15.60:6789/0 conn(0x7f27d8157870 legacy=0x7f27d815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27c4004810 0x7f27c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27c40051c0 0x7f27c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c400c130 con 0x7f27c4003a60 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c400c2a0 con 0x7f27c40051c0 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c400c460 con 0x7f27c4004810 2023-10-08T16:11:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/3035958271 >> v2:172.21.15.144:3300/0 conn(0x7f27d815a620 0x7f27d815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27c4004810 0x7f27c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d6d9d700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27c40051c0 0x7f27c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 -- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27c4004810 msgr2=0x7f27c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27c4004810 0x7f27c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 -- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27c40051c0 msgr2=0x7f27c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27c40051c0 0x7f27c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 -- 172.21.15.60:0/3035958271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4003570 con 0x7f27c4003a60 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d6d9d700 1 -- 172.21.15.60:0/3035958271 reap_dead start 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.880+0000 7f27d659c700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27c4003e70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c3c0 tx=0x7f27d0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff8d729340bf523 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000cc90 con 0x7f27c4003a60 2023-10-08T16:11:19.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000cdf0 con 0x7f27c4003a60 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27d559a700 1 -- 172.21.15.60:0/3035958271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0005b50 con 0x7f27c4003a60 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 -- 172.21.15.60:0/3035958271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 msgr2=0x7f27c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27c4003e70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c3c0 tx=0x7f27d0001e50 comp rx=0 tx=0).stop 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 -- 172.21.15.60:0/3035958271 shutdown_connections 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 --2- 172.21.15.60:0/3035958271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27c4003e70 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 -- 172.21.15.60:0/3035958271 >> 172.21.15.60:0/3035958271 conn(0x7f27d8068ce0 msgr2=0x7f27d80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 -- 172.21.15.60:0/3035958271 shutdown_connections 2023-10-08T16:11:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.881+0000 7f27dc913700 1 -- 172.21.15.60:0/3035958271 wait complete. 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.882+0000 7f27dc913700 1 Processor -- start 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.882+0000 7f27dc913700 1 -- start start 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27dc913700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27d814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27dc913700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27d80d0f00 0x7f27d80b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27dc913700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d80d1370 0x7f27d80b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27dc913700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80d0a70 con 0x7f27c4003a60 2023-10-08T16:11:19.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27dc913700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80cfe60 con 0x7f27d80d1370 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27dc913700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80d0140 con 0x7f27d80d0f00 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27d814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27d814ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48230/0 (socket says 172.21.15.60:48230) 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 -- 172.21.15.60:0/419942942 learned_addr learned my addr 172.21.15.60:0/419942942 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d6d9d700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d80d1370 0x7f27d80b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27d80d0f00 0x7f27d80b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 -- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27d80d0f00 msgr2=0x7f27d80b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27d80d0f00 0x7f27d80b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 -- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d80d1370 msgr2=0x7f27d80b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d80d1370 0x7f27d80b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d659c700 1 -- 172.21.15.60:0/419942942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80d0420 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d6d9d700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d80d1370 0x7f27d80b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.883+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27d80d0f00 0x7f27d80b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.884+0000 7f27d659c700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27d814ad00 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c270 tx=0x7f27d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.884+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00070d0 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.884+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0007270 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.884+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d80d0700 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.884+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0007630 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.884+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d814d0a0 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.885+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d80d0d50 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.885+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27d0028460 con 0x7f27c4003a60 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.885+0000 7f27ce7fc700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f27b8066f30 0x7f27b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.886+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27d0085b60 con 0x7f27c4003a60 2023-10-08T16:11:19.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.886+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f27b8066f30 0x7f27b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:19.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.886+0000 7f27d5d9b700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f27b8066f30 0x7f27b80693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006f00 tx=0x7f27c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:19.892 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-10-08T16:11:19.887+0000 7f82f67c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:11:19.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:19.890+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27d0052dd0 con 0x7f27c4003a60 2023-10-08T16:11:20.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.128+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27d804c3c0 con 0x7f27c4003a60 2023-10-08T16:11:20.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.129+0000 7f27ce7fc700 1 -- 172.21.15.60:0/419942942 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f27d0017020 con 0x7f27c4003a60 2023-10-08T16:11:20.130 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:20.130 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:20.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f27b8066f30 msgr2=0x7f27b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f27b8066f30 0x7f27b80693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006f00 tx=0x7f27c0008040 comp rx=0 tx=0).stop 2023-10-08T16:11:20.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 msgr2=0x7f27d814ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27d814ad00 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c270 tx=0x7f27d0015000 comp rx=0 tx=0).stop 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 shutdown_connections 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f27b8066f30 0x7f27b80693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d80d1370 0x7f27d80b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c4003a60 0x7f27d814ad00 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 --2- 172.21.15.60:0/419942942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f27d80d0f00 0x7f27d80b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 >> 172.21.15.60:0/419942942 conn(0x7f27d8068ce0 msgr2=0x7f27d814c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 shutdown_connections 2023-10-08T16:11:20.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.131+0000 7f27dc913700 1 -- 172.21.15.60:0/419942942 wait complete. 2023-10-08T16:11:20.133 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:20.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:11:13.973264+0000', 'modified': '2023-10-08T16:11:17.599185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7140}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7140': {'gid': 7140, 'name': 'd', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/3605425710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6833', 'nonce': 3605425710}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3605425710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:11:20.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:11:20.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T16:11:20.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.669+0000 7fab2f17d700 1 Processor -- start 2023-10-08T16:11:20.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.669+0000 7fab2f17d700 1 -- start start 2023-10-08T16:11:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2f17d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab280d1c30 0x7fab280ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2f17d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab2815a680 0x7fab280cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2f17d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab280c5d80 con 0x7fab2815a2b0 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2f17d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab28068470 con 0x7fab2815a680 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2f17d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280c6060 con 0x7fab280d1c30 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2d71a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab2815a680 0x7fab280cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2d71a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab2815a680 0x7fab280cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48234/0 (socket says 172.21.15.60:48234) 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.670+0000 7fab2d71a700 1 -- 172.21.15.60:0/1962455519 learned_addr learned my addr 172.21.15.60:0/1962455519 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab27fff700 1 --2- 172.21.15.60:0/1962455519 >> v2:172.21.15.144:3300/0 conn(0x7fab280d1c30 0x7fab280ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2d71a700 1 -- 172.21.15.60:0/1962455519 >> v2:172.21.15.144:3300/0 conn(0x7fab280d1c30 msgr2=0x7fab280ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2d71a700 1 --2- 172.21.15.60:0/1962455519 >> v2:172.21.15.144:3300/0 conn(0x7fab280d1c30 0x7fab280ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2d71a700 1 -- 172.21.15.60:0/1962455519 >> v1:172.21.15.144:6789/0 conn(0x7fab2815a2b0 legacy=0x7fab280b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2d71a700 1 -- 172.21.15.60:0/1962455519 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280c6340 con 0x7fab2815a680 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2d71a700 1 --2- 172.21.15.60:0/1962455519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a680 0x7fab280cf710 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fab28089190 tx=0x7fab18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3605c76d12b92738 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab277fe700 1 -- 172.21.15.60:0/1962455519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800b820 con 0x7fab2815a680 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab277fe700 1 -- 172.21.15.60:0/1962455519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1800b980 con 0x7fab2815a680 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab277fe700 1 -- 172.21.15.60:0/1962455519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800bd20 con 0x7fab2815a680 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2f17d700 1 -- 172.21.15.60:0/1962455519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a680 msgr2=0x7fab280cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.671+0000 7fab2f17d700 1 --2- 172.21.15.60:0/1962455519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a680 0x7fab280cf710 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fab28089190 tx=0x7fab18009250 comp rx=0 tx=0).stop 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.672+0000 7fab2f17d700 1 -- 172.21.15.60:0/1962455519 shutdown_connections 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.672+0000 7fab2f17d700 1 --2- 172.21.15.60:0/1962455519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a680 0x7fab280cf710 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.672+0000 7fab2f17d700 1 --2- 172.21.15.60:0/1962455519 >> v2:172.21.15.144:3300/0 conn(0x7fab280d1c30 0x7fab280ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.672+0000 7fab2f17d700 1 -- 172.21.15.60:0/1962455519 >> 172.21.15.60:0/1962455519 conn(0x7fab28067e40 msgr2=0x7fab280d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.672+0000 7fab2f17d700 1 -- 172.21.15.60:0/1962455519 shutdown_connections 2023-10-08T16:11:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.672+0000 7fab2f17d700 1 -- 172.21.15.60:0/1962455519 wait complete. 2023-10-08T16:11:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.673+0000 7fab2f17d700 1 Processor -- start 2023-10-08T16:11:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.673+0000 7fab2f17d700 1 -- start start 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2f17d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab280d1c30 0x7fab28157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2f17d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 0x7fab2815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2f17d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab2815a680 0x7fab2815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2f17d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2815b810 con 0x7fab2815a2b0 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2f17d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2815ac00 con 0x7fab280d1c30 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2f17d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2815aee0 con 0x7fab2815a680 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 0x7fab2815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 0x7fab2815c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48242/0 (socket says 172.21.15.60:48242) 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 -- 172.21.15.60:0/2588343445 learned_addr learned my addr 172.21.15.60:0/2588343445 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2cf19700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab280d1c30 0x7fab28157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab2d71a700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab2815a680 0x7fab2815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 -- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab2815a680 msgr2=0x7fab2815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab2815a680 0x7fab2815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 -- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab280d1c30 msgr2=0x7fab28157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab280d1c30 0x7fab28157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 -- 172.21.15.60:0/2588343445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab180094f0 con 0x7fab2815a2b0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab27fff700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 0x7fab2815c610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fab1c006b00 tx=0x7fab1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab24ff9700 1 -- 172.21.15.60:0/2588343445 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0125f0 con 0x7fab2815a2b0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.674+0000 7fab24ff9700 1 -- 172.21.15.60:0/2588343445 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c012770 con 0x7fab2815a2b0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.675+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2815b1c0 con 0x7fab2815a2b0 2023-10-08T16:11:20.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.675+0000 7fab24ff9700 1 -- 172.21.15.60:0/2588343445 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c012b30 con 0x7fab2815a2b0 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.675+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2815bca0 con 0x7fab2815a2b0 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.676+0000 7fab24ff9700 1 -- 172.21.15.60:0/2588343445 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab1c01e460 con 0x7fab2815a2b0 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.676+0000 7fab24ff9700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fab14066f30 0x7fab140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.676+0000 7fab24ff9700 1 -- 172.21.15.60:0/2588343445 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab1c0849f0 con 0x7fab2815a2b0 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.676+0000 7fab2cf19700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fab14066f30 0x7fab140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.677+0000 7fab2cf19700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fab14066f30 0x7fab140693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab20007560 tx=0x7fab20009760 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.678+0000 7fab38475b80 1 Processor -- start 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.678+0000 7fab38475b80 1 -- start start 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab38475b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 0x559f15e63e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15eadd00 0x559f15e8ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e5fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab38475b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15dbaa70 con 0x559f15e63a50 2023-10-08T16:11:20.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15db8270 con 0x559f15e8cf60 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f15db4060 con 0x559f15eadd00 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 0x559f15e63e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 0x559f15e63e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48250/0 (socket says 172.21.15.60:48250) 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 -- 172.21.15.60:0/3228737932 learned_addr learned my addr 172.21.15.60:0/3228737932 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2d71a700 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e5fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab27fff700 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15eadd00 0x559f15e8ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 -- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15eadd00 msgr2=0x559f15e8ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15eadd00 0x559f15e8ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 -- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 msgr2=0x559f15e5fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e5fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 -- 172.21.15.60:0/3228737932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f15c4e270 con 0x559f15e63a50 2023-10-08T16:11:20.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2d71a700 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e5fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.679+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 0x559f15e63e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fab200137e0 tx=0x7fab20014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3523c982afd7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab0dffb700 1 -- 172.21.15.60:0/3228737932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20012670 con 0x559f15e63a50 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab0dffb700 1 -- 172.21.15.60:0/3228737932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000f040 con 0x559f15e63a50 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab0dffb700 1 -- 172.21.15.60:0/3228737932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200129e0 con 0x559f15e63a50 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 -- 172.21.15.60:0/3228737932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 msgr2=0x559f15e63e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 0x559f15e63e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fab200137e0 tx=0x7fab20014000 comp rx=0 tx=0).stop 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 -- 172.21.15.60:0/3228737932 shutdown_connections 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e5fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e63a50 0x559f15e63e20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 --2- 172.21.15.60:0/3228737932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15eadd00 0x559f15e8ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 -- 172.21.15.60:0/3228737932 >> 172.21.15.60:0/3228737932 conn(0x559f15e65370 msgr2=0x559f15e65740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 -- 172.21.15.60:0/3228737932 shutdown_connections 2023-10-08T16:11:20.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.680+0000 7fab38475b80 1 -- 172.21.15.60:0/3228737932 wait complete. 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.681+0000 7fab38475b80 1 -- start start 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.681+0000 7fab38475b80 1 Processor -- start 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15ea1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e92e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15e933c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15d5f890 con 0x559f15eadd00 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15d7aea0 con 0x559f15e8cf60 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f15c36e30 con 0x559f15e63a50 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab38475b80 10 client.0 _ll_register_callbacks cb 0x559f15e27110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15e933c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15e933c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48266/0 (socket says 172.21.15.60:48266) 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 -- 172.21.15.60:0/221079211 learned_addr learned my addr 172.21.15.60:0/221079211 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab27fff700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e92e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2cf19700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15ea1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 -- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 msgr2=0x559f15ea1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15ea1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 -- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 msgr2=0x559f15e92e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e92e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 -- 172.21.15.60:0/221079211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab20013400 con 0x559f15eadd00 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab27fff700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e92e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab2d71a700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15e933c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fab18006fd0 tx=0x7fab18016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193ce8b276aef6a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.682+0000 7fab06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab06ffd700 1 -- 172.21.15.60:0/221079211 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18011910 con 0x559f15eadd00 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab06ffd700 1 -- 172.21.15.60:0/221079211 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab18011a70 con 0x559f15eadd00 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f15e58b70 con 0x559f15eadd00 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab06ffd700 1 -- 172.21.15.60:0/221079211 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab18011e40 con 0x559f15eadd00 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 10 client.7269 fetch_fsmap learned FSMap version 68 2023-10-08T16:11:20.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x559f15bf0fe0 con 0x559f15eadd00 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab06ffd700 1 -- 172.21.15.60:0/221079211 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f15e58b70 con 0x559f15eadd00 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab06ffd700 1 -- 172.21.15.60:0/221079211 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fab18025070 con 0x559f15eadd00 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 10 client.7269 fetch_fsmap finished waiting for FSMap version 68 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 10 client.7269 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 20 client.7269 populate_metadata read hostname 'smithi060' 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15ebbef0 0x559f15ebc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 4 client.7269 mds_command: new command op to 7140 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 --> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f15e35aa0 con 0x559f15ebbef0 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.683+0000 7fab2cf19700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15ebbef0 0x559f15ebc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.684+0000 7fab2cf19700 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15ebbef0 0x559f15ebc2c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c5e9f499f11da2 server_cookie=176b772cc30cd3af in_seq=0 out_seq=0 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.684+0000 7fab06ffd700 10 client.7269 ms_handle_connect on v2:172.21.15.144:6833/3605425710 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.684+0000 7fab06ffd700 1 -- 172.21.15.60:0/221079211 <== mds.0 v2:172.21.15.144:6833/3605425710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559f15e35aa0 con 0x559f15ebbef0 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.684+0000 7fab06ffd700 10 client.7269 handle_command_reply: tid=0 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.684+0000 7fab38475b80 1 client.7269 shutdown 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 msgr2=0x559f15e933c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15e933c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fab18006fd0 tx=0x7fab18016000 comp rx=0 tx=0).stop 2023-10-08T16:11:20.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 shutdown_connections 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15ebbef0 0x559f15ebc2c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15ea1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab06ffd700 0 client.7269 ms_handle_reset on v2:172.21.15.144:6833/3605425710 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15e933c0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 --2- 172.21.15.60:0/221079211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e8cf60 0x559f15e92e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 >> 172.21.15.60:0/221079211 conn(0x559f15e65370 msgr2=0x559f15e64350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 shutdown_connections 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 1 -- 172.21.15.60:0/221079211 wait complete. 2023-10-08T16:11:20.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.685+0000 7fab38475b80 20 client.7269 trim_cache size 0 max 16384 2023-10-08T16:11:20.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.702+0000 7fab38475b80 1 Processor -- start 2023-10-08T16:11:20.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.702+0000 7fab38475b80 1 -- start start 2023-10-08T16:11:20.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15e8f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab38475b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 0x559f15f09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15eadd00 0x559f15eb9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab38475b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15ea92c0 con 0x559f15e8cf60 2023-10-08T16:11:20.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15ea90a0 con 0x559f15eadd00 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f15e3c410 con 0x559f15e63a50 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 0x559f15f09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 0x559f15f09d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48276/0 (socket says 172.21.15.60:48276) 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 -- 172.21.15.60:0/4133147535 learned_addr learned my addr 172.21.15.60:0/4133147535 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab2cf19700 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15e8f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 -- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 msgr2=0x559f15e8f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15e8f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab2d71a700 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15eadd00 0x559f15eb9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 -- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15eadd00 msgr2=0x559f15eb9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15eadd00 0x559f15eb9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 -- 172.21.15.60:0/4133147535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f15d82780 con 0x559f15e8cf60 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab27fff700 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 0x559f15f09d20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fab1c055670 tx=0x7fab1c082e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cdc49f711bdc4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab0e7fc700 1 -- 172.21.15.60:0/4133147535 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c05c860 con 0x559f15e8cf60 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab0e7fc700 1 -- 172.21.15.60:0/4133147535 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c053ab0 con 0x559f15e8cf60 2023-10-08T16:11:20.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.703+0000 7fab0e7fc700 1 -- 172.21.15.60:0/4133147535 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0712c0 con 0x559f15e8cf60 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 -- 172.21.15.60:0/4133147535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 msgr2=0x559f15f09d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 0x559f15f09d20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fab1c055670 tx=0x7fab1c082e10 comp rx=0 tx=0).stop 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 -- 172.21.15.60:0/4133147535 shutdown_connections 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e63a50 0x559f15e8f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15eadd00 0x559f15eb9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 --2- 172.21.15.60:0/4133147535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15e8cf60 0x559f15f09d20 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 -- 172.21.15.60:0/4133147535 >> 172.21.15.60:0/4133147535 conn(0x559f15e65370 msgr2=0x559f15ea34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 -- 172.21.15.60:0/4133147535 shutdown_connections 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 -- 172.21.15.60:0/4133147535 wait complete. 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.704+0000 7fab38475b80 1 -- start start 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 Processor -- start 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e63a50 0x559f15f01b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e8cf60 0x559f15f050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15ec34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15f06f60 con 0x559f15eadd00 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f15f10870 con 0x559f15e63a50 2023-10-08T16:11:20.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.705+0000 7fab38475b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f15ebc650 con 0x559f15e8cf60 2023-10-08T16:11:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab38475b80 10 client.0 _ll_register_callbacks cb 0x559f15e27110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:11:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15ec34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15ec34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48280/0 (socket says 172.21.15.60:48280) 2023-10-08T16:11:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 -- 172.21.15.60:0/3953219076 learned_addr learned my addr 172.21.15.60:0/3953219076 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e63a50 0x559f15f01b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab27fff700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e8cf60 0x559f15f050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 -- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e8cf60 msgr2=0x559f15f050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e8cf60 0x559f15f050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 -- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e63a50 msgr2=0x559f15f01b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e63a50 0x559f15f01b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 -- 172.21.15.60:0/3953219076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2815bca0 con 0x559f15eadd00 2023-10-08T16:11:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e63a50 0x559f15f01b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab27fff700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e8cf60 0x559f15f050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab2d71a700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15ec34c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fab180116d0 tx=0x7fab1801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49de41e095f63ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab06ffd700 1 -- 172.21.15.60:0/3953219076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18011e40 con 0x559f15eadd00 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab06ffd700 1 -- 172.21.15.60:0/3953219076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab18000e40 con 0x559f15eadd00 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab2000f040 con 0x559f15eadd00 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab06ffd700 1 -- 172.21.15.60:0/3953219076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab1801c590 con 0x559f15eadd00 2023-10-08T16:11:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab38475b80 10 client.7275 fetch_fsmap learned FSMap version 68 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.706+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x559f15d69470 con 0x559f15eadd00 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab06ffd700 1 -- 172.21.15.60:0/3953219076 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000f040 con 0x559f15eadd00 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab06ffd700 1 -- 172.21.15.60:0/3953219076 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fab18025040 con 0x559f15eadd00 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 10 client.7275 fetch_fsmap finished waiting for FSMap version 68 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 10 client.7275 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 20 client.7275 populate_metadata read hostname 'smithi060' 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15f05ca0 0x559f15f06070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 4 client.7275 mds_command: new command op to 7140 tid=0[{"prefix": "status"}] 2023-10-08T16:11:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 --> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f15d56e00 con 0x559f15f05ca0 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15f05ca0 0x559f15f06070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab06ffd700 10 client.7275 ms_handle_connect on v2:172.21.15.144:6833/3605425710 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab2cf19700 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15f05ca0 0x559f15f06070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc76f6335a7926a server_cookie=a1634c3376b4d279 in_seq=0 out_seq=0 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab06ffd700 1 -- 172.21.15.60:0/3953219076 <== mds.0 v2:172.21.15.144:6833/3605425710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x559f15d56e00 con 0x559f15f05ca0 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab06ffd700 10 client.7275 handle_command_reply: tid=0 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.707+0000 7fab38475b80 1 client.7275 shutdown 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 msgr2=0x559f15ec34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15ec34c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fab180116d0 tx=0x7fab1801e070 comp rx=0 tx=0).stop 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 shutdown_connections 2023-10-08T16:11:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:6833/3605425710,v1:172.21.15.144:6835/3605425710] conn(0x559f15f05ca0 0x559f15f06070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f15eadd00 0x559f15ec34c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab06ffd700 0 client.7275 ms_handle_reset on v2:172.21.15.144:6833/3605425710 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f15e63a50 0x559f15f01b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 --2- 172.21.15.60:0/3953219076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559f15e8cf60 0x559f15f050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 >> 172.21.15.60:0/3953219076 conn(0x559f15e65370 msgr2=0x559f15e63fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 shutdown_connections 2023-10-08T16:11:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 1 -- 172.21.15.60:0/3953219076 wait complete. 2023-10-08T16:11:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab38475b80 20 client.7275 trim_cache size 0 max 16384 2023-10-08T16:11:20.724 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:20.724 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:20.724 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 7140, 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 6.1216024190000002, 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 68, 2023-10-08T16:11:20.725 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 132, 2023-10-08T16:11:20.726 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 132, 2023-10-08T16:11:20.726 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11.199585949999999 2023-10-08T16:11:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:20.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fab14066f30 msgr2=0x7fab140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fab14066f30 0x7fab140693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab20007560 tx=0x7fab20009760 comp rx=0 tx=0).stop 2023-10-08T16:11:20.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 msgr2=0x7fab2815c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 0x7fab2815c610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fab1c006b00 tx=0x7fab1c008040 comp rx=0 tx=0).stop 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 shutdown_connections 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fab14066f30 0x7fab140693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab2815a680 0x7fab2815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab280d1c30 0x7fab28157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 --2- 172.21.15.60:0/2588343445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2815a2b0 0x7fab2815c610 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.708+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 >> 172.21.15.60:0/2588343445 conn(0x7fab28067e40 msgr2=0x7fab280cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.709+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 shutdown_connections 2023-10-08T16:11:20.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.709+0000 7fab2f17d700 1 -- 172.21.15.60:0/2588343445 wait complete. 2023-10-08T16:11:20.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:11:20.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.848+0000 7fc7a359e700 1 Processor -- start 2023-10-08T16:11:20.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.848+0000 7fc7a359e700 1 -- start start 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc7a40cd6e0 0x7fc7a40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cdab0 0x7fc7a415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a359e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7a415dda0 0x7fc7a415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a415e850 con 0x7fc7a40cd6e0 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a359e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40cd030 con 0x7fc7a415dda0 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40cb7c0 con 0x7fc7a40cdab0 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc7a40cd6e0 0x7fc7a40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc7a40cd6e0 0x7fc7a40cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48286/0 (socket says 172.21.15.60:48286) 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 -- 172.21.15.60:0/2707892294 learned_addr learned my addr 172.21.15.60:0/2707892294 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a2d9d700 1 --2- 172.21.15.60:0/2707892294 >> v2:172.21.15.144:3300/0 conn(0x7fc7a415dda0 0x7fc7a415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a1d9b700 1 --2- 172.21.15.60:0/2707892294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cdab0 0x7fc7a415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 -- 172.21.15.60:0/2707892294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cdab0 msgr2=0x7fc7a415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 --2- 172.21.15.60:0/2707892294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cdab0 0x7fc7a415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 -- 172.21.15.60:0/2707892294 >> v2:172.21.15.144:3300/0 conn(0x7fc7a415dda0 msgr2=0x7fc7a415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 --2- 172.21.15.60:0/2707892294 >> v2:172.21.15.144:3300/0 conn(0x7fc7a415dda0 0x7fc7a415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 -- 172.21.15.60:0/2707892294 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a415e290 con 0x7fc7a40cd6e0 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.849+0000 7fc7a259c700 1 --2- 172.21.15.60:0/2707892294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cd6e0 0x7fc7a40cbc50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4089ac0 tx=0x7fc794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24045d10a517928 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a159a700 1 -- 172.21.15.60:0/2707892294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400e070 con 0x7fc7a40cd6e0 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a159a700 1 -- 172.21.15.60:0/2707892294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400ba50 con 0x7fc7a40cd6e0 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a159a700 1 -- 172.21.15.60:0/2707892294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940092e0 con 0x7fc7a40cd6e0 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 -- 172.21.15.60:0/2707892294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cd6e0 msgr2=0x7fc7a40cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 --2- 172.21.15.60:0/2707892294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cd6e0 0x7fc7a40cbc50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4089ac0 tx=0x7fc794009840 comp rx=0 tx=0).stop 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 -- 172.21.15.60:0/2707892294 shutdown_connections 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 --2- 172.21.15.60:0/2707892294 >> v2:172.21.15.144:3300/0 conn(0x7fc7a415dda0 0x7fc7a415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 --2- 172.21.15.60:0/2707892294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cd6e0 0x7fc7a40cbc50 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 --2- 172.21.15.60:0/2707892294 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cdab0 0x7fc7a415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 -- 172.21.15.60:0/2707892294 >> 172.21.15.60:0/2707892294 conn(0x7fc7a4067660 msgr2=0x7fc7a4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 -- 172.21.15.60:0/2707892294 shutdown_connections 2023-10-08T16:11:20.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.850+0000 7fc7a359e700 1 -- 172.21.15.60:0/2707892294 wait complete. 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.851+0000 7fc7a359e700 1 Processor -- start 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.851+0000 7fc7a359e700 1 -- start start 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cd6e0 0x7fc7a4147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 0x7fc7a40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a415dda0 0x7fc7a41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4147cb0 con 0x7fc7a40cdab0 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40c8be0 con 0x7fc7a415dda0 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40c91a0 con 0x7fc7a40cd6e0 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 0x7fc7a40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 0x7fc7a40b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48292/0 (socket says 172.21.15.60:48292) 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 -- 172.21.15.60:0/4269370120 learned_addr learned my addr 172.21.15.60:0/4269370120 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a2d9d700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a415dda0 0x7fc7a41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a259c700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cd6e0 0x7fc7a4147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 -- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cd6e0 msgr2=0x7fc7a4147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cd6e0 0x7fc7a4147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 -- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a415dda0 msgr2=0x7fc7a41590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a415dda0 0x7fc7a41590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a1d9b700 1 -- 172.21.15.60:0/4269370120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc794009ae0 con 0x7fc7a40cdab0 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a2d9d700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a415dda0 0x7fc7a41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.852+0000 7fc7a259c700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cd6e0 0x7fc7a4147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.853+0000 7fc7a1d9b700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 0x7fc7a40b1bf0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00d8c0 tx=0x7fc78c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.853+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00de60 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.853+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c00b780 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.853+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a40b2690 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.853+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00bb20 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.853+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a40c8e30 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.854+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a4089280 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.854+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc78c01e460 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.855+0000 7fc79a7fc700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc784066f30 0x7fc7840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.855+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc78c084b70 con 0x7fc7a40cdab0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.855+0000 7fc7a259c700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc784066f30 0x7fc7840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:20.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.855+0000 7fc7a259c700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc784066f30 0x7fc7840693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc794009880 tx=0x7fc794018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:20.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:20.859+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc78c051de0 con 0x7fc7a40cdab0 2023-10-08T16:11:21.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.096+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7a40c92e0 con 0x7fc7a40cdab0 2023-10-08T16:11:21.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.096+0000 7fc79a7fc700 1 -- 172.21.15.60:0/4269370120 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc78c055400 con 0x7fc7a40cdab0 2023-10-08T16:11:21.097 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc784066f30 msgr2=0x7fc7840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc784066f30 0x7fc7840693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc794009880 tx=0x7fc794018000 comp rx=0 tx=0).stop 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 msgr2=0x7fc7a40b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 0x7fc7a40b1bf0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00d8c0 tx=0x7fc78c008040 comp rx=0 tx=0).stop 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 shutdown_connections 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc784066f30 0x7fc7840693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7a40cd6e0 0x7fc7a4147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a415dda0 0x7fc7a41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 --2- 172.21.15.60:0/4269370120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7a40cdab0 0x7fc7a40b1bf0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 >> 172.21.15.60:0/4269370120 conn(0x7fc7a4067660 msgr2=0x7fc7a4156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:21.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 shutdown_connections 2023-10-08T16:11:21.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.098+0000 7fc7a359e700 1 -- 172.21.15.60:0/4269370120 wait complete. 2023-10-08T16:11:21.110 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:11:21.110 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:11:21.110 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:11:21.110 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:11:21.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:11:21.111 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:11:21.111 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:11:21.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:11:21.111 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:11:21.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.111 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:11:21.126 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:11:21.126 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:11:21.126 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:21.127 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42060sec preferred_lft 42060sec 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.128 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:21.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.129 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:11:21.191 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:11:21.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.192 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:11:21.249 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:11:21.249 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:11:21.249 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:11:21.249 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:11:21.249 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:11:21.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.249 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:11:21.250 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:11:21.250 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:11:21.250 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:11:21.250 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:11:21.250 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:11:21.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.353 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:11:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:11:21.368 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:11:21.368 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:11:21.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:11:21.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:11:21.433 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:11:21.488 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:11:21.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:11:21.489 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:11:21.543 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:11:21.543 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:11:21.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:21.625 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:21.625 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:11:21.644 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:21.644 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:11:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:11:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:11:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:11:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:11:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:11:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:11:21.668 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:21.668 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:11:21.668 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:11:21.668 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:11:21.668 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:11:21.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:11:21.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:11:21.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:11:21.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:11:21.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:11:21.669 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:11:21.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:11:21.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:21.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:11:21.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:11:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.896+0000 7f20e178e700 1 Processor -- start 2023-10-08T16:11:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.896+0000 7f20e178e700 1 -- start start 2023-10-08T16:11:21.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20e178e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20dc0cd6e0 0x7f20dc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20e178e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0cb7c0 con 0x7f20dc15cbd0 2023-10-08T16:11:21.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20e178e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc15e290 con 0x7f20dc0cdab0 2023-10-08T16:11:21.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20e178e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc15e850 con 0x7f20dc0cd6e0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20e0f8d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20dc15cbd0 0x7f20dc15d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43798/0 (socket says 172.21.15.60:43798) 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20e0f8d700 1 -- 172.21.15.60:0/1319131907 learned_addr learned my addr 172.21.15.60:0/1319131907 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20dbfff700 1 --2- 172.21.15.60:0/1319131907 >> v2:172.21.15.144:3300/0 conn(0x7f20dc0cd6e0 0x7f20dc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752821763 0 0) 0x7f20dc0cb7c0 con 0x7f20dc15cbd0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c8003570 con 0x7f20dc15cbd0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2317479680 0 0) 0x7f20c8003570 con 0x7f20dc15cbd0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 >> v2:172.21.15.144:3300/0 conn(0x7f20dc0cd6e0 msgr2=0x7f20dc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 --2- 172.21.15.60:0/1319131907 >> v2:172.21.15.144:3300/0 conn(0x7f20dc0cd6e0 0x7f20dc0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 >> v1:172.21.15.144:6789/0 conn(0x7f20dc0cdab0 legacy=0x7f20dc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc15e570 con 0x7f20dc15cbd0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.897+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f20d40017f0 con 0x7f20dc15cbd0 2023-10-08T16:11:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 >> v1:172.21.15.60:6789/0 conn(0x7f20dc15cbd0 legacy=0x7f20dc15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20c8003a60 0x7f20c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c8004810 0x7f20c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80051c0 0x7f20c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc15e850 con 0x7f20c8003a60 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c800c050 con 0x7f20c80051c0 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c800c210 con 0x7f20c8004810 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20c8003a60 0x7f20c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20e0f8d700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80051c0 0x7f20c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20db7fe700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c8004810 0x7f20c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 -- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c8004810 msgr2=0x7f20c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c8004810 0x7f20c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 -- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80051c0 msgr2=0x7f20c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80051c0 0x7f20c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20e0f8d700 1 -- 172.21.15.60:0/1319131907 reap_dead start 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 -- 172.21.15.60:0/1319131907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8003570 con 0x7f20c8003a60 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20db7fe700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c8004810 0x7f20c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20dbfff700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20c8003a60 0x7f20c8003e30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009c00 tx=0x7f20cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84828c411bbd50e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00e710 con 0x7f20c8003a60 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc00e870 con 0x7f20c8003a60 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.898+0000 7f20daffd700 1 -- 172.21.15.60:0/1319131907 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00ec30 con 0x7f20c8003a60 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 -- 172.21.15.60:0/1319131907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20c8003a60 msgr2=0x7f20c8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20c8003a60 0x7f20c8003e30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009c00 tx=0x7f20cc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 -- 172.21.15.60:0/1319131907 shutdown_connections 2023-10-08T16:11:21.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 --2- 172.21.15.60:0/1319131907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20c8003a60 0x7f20c8003e30 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 -- 172.21.15.60:0/1319131907 >> 172.21.15.60:0/1319131907 conn(0x7f20dc067660 msgr2=0x7f20dc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:21.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 -- 172.21.15.60:0/1319131907 shutdown_connections 2023-10-08T16:11:21.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.899+0000 7f20e178e700 1 -- 172.21.15.60:0/1319131907 wait complete. 2023-10-08T16:11:21.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.900+0000 7f20e178e700 1 Processor -- start 2023-10-08T16:11:21.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.900+0000 7f20e178e700 1 -- start start 2023-10-08T16:11:21.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e178e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8003a60 0x7f20dc0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e178e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20dc15c1d0 0x7f20dc1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e178e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 0x7f20dc160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e178e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0c8400 con 0x7f20dc15fea0 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e178e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0cac00 con 0x7f20c8003a60 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e178e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc160850 con 0x7f20dc15c1d0 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 0x7f20dc160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 0x7f20dc160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48314/0 (socket says 172.21.15.60:48314) 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 -- 172.21.15.60:0/2352080791 learned_addr learned my addr 172.21.15.60:0/2352080791 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20dbfff700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8003a60 0x7f20dc0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20db7fe700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20dc15c1d0 0x7f20dc1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 -- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20dc15c1d0 msgr2=0x7f20dc1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20dc15c1d0 0x7f20dc1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 -- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8003a60 msgr2=0x7f20dc0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:21.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8003a60 0x7f20dc0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 -- 172.21.15.60:0/2352080791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0b4d70 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20db7fe700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20dc15c1d0 0x7f20dc1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.901+0000 7f20e0f8d700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 0x7f20dc160310 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f20dc15d7c0 tx=0x7f20d40021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.902+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400ad00 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.902+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d400ae80 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.902+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc0c8940 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.902+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4013640 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.902+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc0c8dd0 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.903+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc0c8ad0 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.903+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20d40139b0 con 0x7f20dc15fea0 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.903+0000 7f20d3fff700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:21.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.903+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20d4084e80 con 0x7f20dc15fea0 2023-10-08T16:11:21.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.903+0000 7f20dbfff700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:21.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.904+0000 7f20dbfff700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0091e0 tx=0x7f20cc01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:21.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:21.908+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20d40520f0 con 0x7f20dc15fea0 2023-10-08T16:11:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.148+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20dc04bb80 con 0x7f20dc15fea0 2023-10-08T16:11:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.148+0000 7f20d3fff700 1 -- 172.21.15.60:0/2352080791 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f20d4055710 con 0x7f20dc15fea0 2023-10-08T16:11:22.148 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:11:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 msgr2=0x7f20bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0091e0 tx=0x7f20cc01a000 comp rx=0 tx=0).stop 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 msgr2=0x7f20dc160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 0x7f20dc160310 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f20dc15d7c0 tx=0x7f20d40021f0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 shutdown_connections 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f20bc066f30 0x7f20bc0693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20dc15fea0 0x7f20dc160310 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8003a60 0x7f20dc0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 --2- 172.21.15.60:0/2352080791 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20dc15c1d0 0x7f20dc1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 >> 172.21.15.60:0/2352080791 conn(0x7f20dc067660 msgr2=0x7f20dc156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 shutdown_connections 2023-10-08T16:11:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.150+0000 7f20e178e700 1 -- 172.21.15.60:0/2352080791 wait complete. 2023-10-08T16:11:22.162 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:11:22.162 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:11:22.163 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:11:22.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.163 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:11:22.182 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:11:22.182 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:11:22.182 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:11:22.182 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.182 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:22.183 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42061sec preferred_lft 42061sec 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:11:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:11:22.185 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.185 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:11:22.185 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:11:22.185 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:11:22.185 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:11:22.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.185 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:11:22.250 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:11:22.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.252 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:11:22.311 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:11:22.311 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:11:22.311 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:11:22.311 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:11:22.311 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:11:22.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.311 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:11:22.311 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:11:22.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:11:22.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:11:22.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:11:22.312 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:11:22.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.418 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:11:22.433 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:11:22.433 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:11:22.433 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:11:22.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:11:22.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:11:22.498 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:11:22.554 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:11:22.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:11:22.554 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:11:22.608 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:11:22.608 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:11:22.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:22.688 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:22.688 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:11:22.707 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:22.707 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:11:22.708 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:11:22.708 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:11:22.708 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:11:22.708 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:11:22.708 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:11:22.708 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:11:22.729 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:11:22.730 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:11:22.730 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:11:22.731 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:11:22.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:22.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:11:22.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.916+0000 7fcf671fb700 1 Processor -- start 2023-10-08T16:11:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.916+0000 7fcf671fb700 1 -- start start 2023-10-08T16:11:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf671fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf600cd420 0x7fcf600cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf671fb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf600ad5c0 con 0x7fcf60156980 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf671fb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf600ac9b0 con 0x7fcf60156d50 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf671fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600acc90 con 0x7fcf600cd420 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf661f9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcf60156980 0x7fcf600ac0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60772/0 (socket says 172.21.15.60:60772) 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf661f9700 1 -- 172.21.15.60:0/2876233589 learned_addr learned my addr 172.21.15.60:0/2876233589 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf659f8700 1 --2- 172.21.15.60:0/2876233589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf600cd420 0x7fcf600cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875441983 0 0) 0x7fcf600ad5c0 con 0x7fcf60156980 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.917+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003570 con 0x7fcf60156980 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678251833 0 0) 0x7fcf600ac9b0 con 0x7fcf60156d50 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf600ad5c0 con 0x7fcf60156d50 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf659f8700 1 -- 172.21.15.60:0/2876233589 >> v1:172.21.15.144:6789/0 conn(0x7fcf60156d50 legacy=0x7fcf6006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf659f8700 1 -- 172.21.15.60:0/2876233589 >> v1:172.21.15.60:6789/0 conn(0x7fcf60156980 legacy=0x7fcf600ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652493832 0 0) 0x7fcf48003570 con 0x7fcf60156980 2023-10-08T16:11:22.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf659f8700 1 -- 172.21.15.60:0/2876233589 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600acf70 con 0x7fcf600cd420 2023-10-08T16:11:22.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf659f8700 1 --2- 172.21.15.60:0/2876233589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf600cd420 0x7fcf600cb800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009910 tx=0x7fcf540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42df118dfa78083d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:22.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf500017f0 con 0x7fcf600cd420 2023-10-08T16:11:22.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54011420 con 0x7fcf600cd420 2023-10-08T16:11:22.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.918+0000 7fcf651f7700 1 -- 172.21.15.60:0/2876233589 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540117c0 con 0x7fcf600cd420 2023-10-08T16:11:22.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 -- 172.21.15.60:0/2876233589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf600cd420 msgr2=0x7fcf600cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 --2- 172.21.15.60:0/2876233589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf600cd420 0x7fcf600cb800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009910 tx=0x7fcf540091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 -- 172.21.15.60:0/2876233589 shutdown_connections 2023-10-08T16:11:22.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 --2- 172.21.15.60:0/2876233589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf600cd420 0x7fcf600cb800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 -- 172.21.15.60:0/2876233589 >> 172.21.15.60:0/2876233589 conn(0x7fcf600680e0 msgr2=0x7fcf600cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 -- 172.21.15.60:0/2876233589 shutdown_connections 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.919+0000 7fcf671fb700 1 -- 172.21.15.60:0/2876233589 wait complete. 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.920+0000 7fcf671fb700 1 Processor -- start 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.920+0000 7fcf671fb700 1 -- start start 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf671fb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf600cd420 0x7fcf60149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf671fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 0x7fcf60167c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf671fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf60156d50 0x7fcf6006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf671fb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6014ad80 con 0x7fcf60156980 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf671fb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6014a200 con 0x7fcf600cd420 2023-10-08T16:11:22.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf671fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6014a4e0 con 0x7fcf60156d50 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 0x7fcf60167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 0x7fcf60167c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59076/0 (socket says 172.21.15.60:59076) 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 -- 172.21.15.60:0/1411450628 learned_addr learned my addr 172.21.15.60:0/1411450628 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf669fa700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf60156d50 0x7fcf6006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf661f9700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf600cd420 0x7fcf60149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 -- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf60156d50 msgr2=0x7fcf6006dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf60156d50 0x7fcf6006dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 -- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf600cd420 msgr2=0x7fcf60149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf600cd420 0x7fcf60149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 -- 172.21.15.60:0/1411450628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009420 con 0x7fcf60156980 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf659f8700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 0x7fcf60167c00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009860 tx=0x7fcf54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:22.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.921+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5401cb30 con 0x7fcf60156980 2023-10-08T16:11:22.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.922+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5401cc90 con 0x7fcf60156980 2023-10-08T16:11:22.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.922+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6014a7c0 con 0x7fcf60156980 2023-10-08T16:11:22.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.922+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5401a6a0 con 0x7fcf60156980 2023-10-08T16:11:22.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.922+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf60149e60 con 0x7fcf60156980 2023-10-08T16:11:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.923+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6006bc70 con 0x7fcf60156980 2023-10-08T16:11:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.923+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf5401aad0 con 0x7fcf60156980 2023-10-08T16:11:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.923+0000 7fcf5e7fc700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf4c066f30 0x7fcf4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.923+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf540862d0 con 0x7fcf60156980 2023-10-08T16:11:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.923+0000 7fcf661f9700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf4c066f30 0x7fcf4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.924+0000 7fcf661f9700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf4c066f30 0x7fcf4c0693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcf50007fd0 tx=0x7fcf50000f40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:22.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:22.928+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf54053540 con 0x7fcf60156980 2023-10-08T16:11:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.165+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf6004bb80 con 0x7fcf60156980 2023-10-08T16:11:23.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.165+0000 7fcf5e7fc700 1 -- 172.21.15.60:0/1411450628 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fcf54056b60 con 0x7fcf60156980 2023-10-08T16:11:23.166 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:23.166 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf4c066f30 msgr2=0x7fcf4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf4c066f30 0x7fcf4c0693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcf50007fd0 tx=0x7fcf50000f40 comp rx=0 tx=0).stop 2023-10-08T16:11:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 msgr2=0x7fcf60167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 0x7fcf60167c00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009860 tx=0x7fcf54016000 comp rx=0 tx=0).stop 2023-10-08T16:11:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 shutdown_connections 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcf4c066f30 0x7fcf4c0693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf60156d50 0x7fcf6006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf600cd420 0x7fcf60149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 --2- 172.21.15.60:0/1411450628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf60156980 0x7fcf60167c00 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 >> 172.21.15.60:0/1411450628 conn(0x7fcf600680e0 msgr2=0x7fcf600696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 shutdown_connections 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.168+0000 7fcf671fb700 1 -- 172.21.15.60:0/1411450628 wait complete. 2023-10-08T16:11:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:23.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-08T16:11:23.315 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":7140,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.7189426599999997,"mdsmap_epoch":68,"osdmap_epoch":132,"osdmap_epoch_barrier":132,"uptime":13.796926963000001} 2023-10-08T16:11:23.315 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 7140, "mdsmap_epoch": 68, "osdmap_epoch": 132, "osdmap_epoch_barrier": 132, "rank_uptime": 8.71894266, "state": "up:active", "uptime": 13.796926963, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:11:23.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-08T16:11:23.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.438+0000 7f33ee1c6700 1 Processor -- start 2023-10-08T16:11:23.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.438+0000 7f33ee1c6700 1 -- start start 2023-10-08T16:11:23.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33ee1c6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33e8156210 0x7f33e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:23.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33ee1c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e81565e0 0x7f33e80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:23.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33ee1c6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80c6f20 con 0x7f33e80af8f0 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33ee1c6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e80c7200 con 0x7f33e8156210 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33ee1c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80c74e0 con 0x7f33e81565e0 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33e77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33e8156210 0x7f33e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33e77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33e8156210 0x7f33e806d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59088/0 (socket says 172.21.15.60:59088) 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.439+0000 7f33e77fe700 1 -- 172.21.15.60:0/3175648297 learned_addr learned my addr 172.21.15.60:0/3175648297 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e7fff700 1 --2- 172.21.15.60:0/3175648297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e81565e0 0x7f33e80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e77fe700 1 -- 172.21.15.60:0/3175648297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e81565e0 msgr2=0x7f33e80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e77fe700 1 --2- 172.21.15.60:0/3175648297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e81565e0 0x7f33e80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e77fe700 1 -- 172.21.15.60:0/3175648297 >> v1:172.21.15.144:6789/0 conn(0x7f33e80af8f0 legacy=0x7f33e80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e77fe700 1 -- 172.21.15.60:0/3175648297 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80c77c0 con 0x7f33e8156210 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e77fe700 1 --2- 172.21.15.60:0/3175648297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e806d3c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099b0 tx=0x7f33d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2989f0de982229b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:23.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e67fc700 1 -- 172.21.15.60:0/3175648297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8009ea0 con 0x7f33e8156210 2023-10-08T16:11:23.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e67fc700 1 -- 172.21.15.60:0/3175648297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800b860 con 0x7f33e8156210 2023-10-08T16:11:23.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.440+0000 7f33e67fc700 1 -- 172.21.15.60:0/3175648297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800bc00 con 0x7f33e8156210 2023-10-08T16:11:23.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 -- 172.21.15.60:0/3175648297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 msgr2=0x7f33e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:23.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/3175648297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e806d3c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099b0 tx=0x7f33d8009250 comp rx=0 tx=0).stop 2023-10-08T16:11:23.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 -- 172.21.15.60:0/3175648297 shutdown_connections 2023-10-08T16:11:23.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/3175648297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e81565e0 0x7f33e80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/3175648297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e806d3c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 -- 172.21.15.60:0/3175648297 >> 172.21.15.60:0/3175648297 conn(0x7f33e80cd450 msgr2=0x7f33e80c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 -- 172.21.15.60:0/3175648297 shutdown_connections 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.441+0000 7f33ee1c6700 1 -- 172.21.15.60:0/3175648297 wait complete. 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.442+0000 7f33ee1c6700 1 Processor -- start 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.442+0000 7f33ee1c6700 1 -- start start 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e80af8f0 0x7f33e814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e8159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e81565e0 0x7f33e81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8156a10 con 0x7f33e8156210 2023-10-08T16:11:23.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8156cf0 con 0x7f33e81565e0 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8156fd0 con 0x7f33e80af8f0 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e8159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59094/0 (socket says 172.21.15.60:59094) 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 -- 172.21.15.60:0/2360431647 learned_addr learned my addr 172.21.15.60:0/2360431647 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e7fff700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e81565e0 0x7f33e81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e77fe700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e80af8f0 0x7f33e814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 -- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e80af8f0 msgr2=0x7f33e814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e80af8f0 0x7f33e814c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 -- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e81565e0 msgr2=0x7f33e81511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e81565e0 0x7f33e81511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 -- 172.21.15.60:0/2360431647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80094f0 con 0x7f33e8156210 2023-10-08T16:11:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e8159030 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c4c0 tx=0x7f33d0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d000ce70 con 0x7f33e8156210 2023-10-08T16:11:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d0001080 con 0x7f33e8156210 2023-10-08T16:11:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e81572b0 con 0x7f33e8156210 2023-10-08T16:11:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0011800 con 0x7f33e8156210 2023-10-08T16:11:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.443+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e814e180 con 0x7f33e8156210 2023-10-08T16:11:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.444+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e804c3c0 con 0x7f33e8156210 2023-10-08T16:11:23.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.445+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33d0011b70 con 0x7f33e8156210 2023-10-08T16:11:23.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.445+0000 7f33df7fe700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f33c8066f30 0x7f33c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:23.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.445+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33d00837a0 con 0x7f33e8156210 2023-10-08T16:11:23.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.445+0000 7f33e77fe700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f33c8066f30 0x7f33c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:23.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.446+0000 7f33e77fe700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f33c8066f30 0x7f33c80693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099b0 tx=0x7f33d8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:23.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.450+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33d0050a10 con 0x7f33e8156210 2023-10-08T16:11:23.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:23.642+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f33e8157750 con 0x7f33e8156210 2023-10-08T16:11:24.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.626+0000 7f33df7fe700 1 -- 172.21.15.60:0/2360431647 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v133) v1 ==== 181+0+0 (secure 0 0 0) 0x7f33d0017020 con 0x7f33e8156210 2023-10-08T16:11:24.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.628+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f33c8066f30 msgr2=0x7f33c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:24.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.628+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f33c8066f30 0x7f33c80693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099b0 tx=0x7f33d8017000 comp rx=0 tx=0).stop 2023-10-08T16:11:24.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.628+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 msgr2=0x7f33e8159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:24.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.628+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e8159030 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c4c0 tx=0x7f33d0007ef0 comp rx=0 tx=0).stop 2023-10-08T16:11:24.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 shutdown_connections 2023-10-08T16:11:24.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f33c8066f30 0x7f33c80693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33e80af8f0 0x7f33e814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e81565e0 0x7f33e81511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 --2- 172.21.15.60:0/2360431647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e8156210 0x7f33e8159030 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 >> 172.21.15.60:0/2360431647 conn(0x7f33e80cd450 msgr2=0x7f33e8067b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 shutdown_connections 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:24.629+0000 7f33ee1c6700 1 -- 172.21.15.60:0/2360431647 wait complete. 2023-10-08T16:11:24.630 INFO:teuthology.orchestra.run.smithi060.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-08T16:11:24.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:11:24.785 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:11:24.786 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:11:24.786 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-08T16:11:24.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:24.786 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-08T16:11:24.895 INFO:teuthology.orchestra.run.smithi060.stderr:16+0 records in 2023-10-08T16:11:24.895 INFO:teuthology.orchestra.run.smithi060.stderr:16+0 records out 2023-10-08T16:11:24.895 INFO:teuthology.orchestra.run.smithi060.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0907738 s, 185 MB/s 2023-10-08T16:11:24.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:24.896 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-08T16:11:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:17+0 records in 2023-10-08T16:11:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:17+0 records out 2023-10-08T16:11:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0974098 s, 183 MB/s 2023-10-08T16:11:25.011 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-08T16:11:25.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:25.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.130+0000 7f9277c12700 1 Processor -- start 2023-10-08T16:11:25.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.130+0000 7f9277c12700 1 -- start start 2023-10-08T16:11:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f9277c12700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9270067d70 0x7f927015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f9277c12700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92700cb370 con 0x7f92700b0890 2023-10-08T16:11:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f9277c12700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92700b0c60 con 0x7f927006c630 2023-10-08T16:11:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f9277c12700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927006a1e0 con 0x7f9270067d70 2023-10-08T16:11:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f92759ae700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f92700b0890 0x7f92700cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60784/0 (socket says 172.21.15.60:60784) 2023-10-08T16:11:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f92759ae700 1 -- 172.21.15.60:0/801877808 learned_addr learned my addr 172.21.15.60:0/801877808 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f92761af700 1 --2- 172.21.15.60:0/801877808 >> v2:172.21.15.60:3300/0 conn(0x7f9270067d70 0x7f927015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f92749ac700 1 -- 172.21.15.60:0/801877808 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762617253 0 0) 0x7f92700cb370 con 0x7f92700b0890 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.131+0000 7f92749ac700 1 -- 172.21.15.60:0/801877808 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9258003570 con 0x7f92700b0890 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92761af700 1 -- 172.21.15.60:0/801877808 >> v1:172.21.15.144:6789/0 conn(0x7f927006c630 legacy=0x7f9270067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92761af700 1 -- 172.21.15.60:0/801877808 >> v1:172.21.15.60:6789/0 conn(0x7f92700b0890 legacy=0x7f92700cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92761af700 1 -- 172.21.15.60:0/801877808 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927006cb80 con 0x7f9270067d70 2023-10-08T16:11:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92761af700 1 --2- 172.21.15.60:0/801877808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9270067d70 0x7f927015a7a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9260009e60 tx=0x7f9260009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac0780a991165cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92749ac700 1 -- 172.21.15.60:0/801877808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926000e070 con 0x7f9270067d70 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92749ac700 1 -- 172.21.15.60:0/801877808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926000bb20 con 0x7f9270067d70 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f92749ac700 1 -- 172.21.15.60:0/801877808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260012430 con 0x7f9270067d70 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f9277c12700 1 -- 172.21.15.60:0/801877808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9270067d70 msgr2=0x7f927015a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f9277c12700 1 --2- 172.21.15.60:0/801877808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9270067d70 0x7f927015a7a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9260009e60 tx=0x7f9260009780 comp rx=0 tx=0).stop 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f9277c12700 1 -- 172.21.15.60:0/801877808 shutdown_connections 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f9277c12700 1 --2- 172.21.15.60:0/801877808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9270067d70 0x7f927015a7a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.132+0000 7f9277c12700 1 -- 172.21.15.60:0/801877808 >> 172.21.15.60:0/801877808 conn(0x7f927006fe50 msgr2=0x7f9270069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.133+0000 7f9277c12700 1 -- 172.21.15.60:0/801877808 shutdown_connections 2023-10-08T16:11:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.133+0000 7f9277c12700 1 -- 172.21.15.60:0/801877808 wait complete. 2023-10-08T16:11:25.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 Processor -- start 2023-10-08T16:11:25.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 -- start start 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9270067d70 0x7f92700b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 0x7f927015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92700b0890 0x7f927016a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700abcf0 con 0x7f927006c630 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700c8390 con 0x7f9270067d70 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.134+0000 7f9277c12700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927016b170 con 0x7f92700b0890 2023-10-08T16:11:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 0x7f927015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 0x7f927015c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59108/0 (socket says 172.21.15.60:59108) 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 -- 172.21.15.60:0/1544645631 learned_addr learned my addr 172.21.15.60:0/1544645631 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92761af700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92700b0890 0x7f927016a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92759ae700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9270067d70 0x7f92700b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 -- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92700b0890 msgr2=0x7f927016a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92700b0890 0x7f927016a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 -- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9270067d70 msgr2=0x7f92700b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9270067d70 0x7f92700b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 -- 172.21.15.60:0/1544645631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260009a20 con 0x7f927006c630 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92759ae700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9270067d70 0x7f92700b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92761af700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92700b0890 0x7f927016a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f92751ad700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 0x7f927015c120 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f926400c590 tx=0x7f9264007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011590 con 0x7f927006c630 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264011730 con 0x7f927006c630 2023-10-08T16:11:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011af0 con 0x7f927006c630 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927016b450 con 0x7f927006c630 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.135+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92700ab980 con 0x7f927006c630 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.136+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92700ab7e0 con 0x7f927006c630 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.137+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f926401c460 con 0x7f927006c630 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.137+0000 7f926dffb700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f925c066f30 0x7f925c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.137+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92640842e0 con 0x7f927006c630 2023-10-08T16:11:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.137+0000 7f92759ae700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f925c066f30 0x7f925c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:25.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.138+0000 7f92759ae700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f925c066f30 0x7f925c0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f92680058d0 tx=0x7f9268009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:25.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.141+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92700ab7e0 con 0x7f927006c630 2023-10-08T16:11:25.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.336+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f92700ab7e0 con 0x7f927006c630 2023-10-08T16:11:25.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.337+0000 7f926dffb700 1 -- 172.21.15.60:0/1544645631 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v133) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f92700ab7e0 con 0x7f927006c630 2023-10-08T16:11:25.337 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 133, 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:24.617797+0000", 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "133", 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:25.419 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:25.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f925c066f30 msgr2=0x7f925c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:25.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f925c066f30 0x7f925c0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f92680058d0 tx=0x7f9268009040 comp rx=0 tx=0).stop 2023-10-08T16:11:25.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 msgr2=0x7f927015c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 0x7f927015c120 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f926400c590 tx=0x7f9264007f30 comp rx=0 tx=0).stop 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 shutdown_connections 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f925c066f30 0x7f925c0693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92700b0890 0x7f927016a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9270067d70 0x7f92700b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 --2- 172.21.15.60:0/1544645631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927006c630 0x7f927015c120 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 >> 172.21.15.60:0/1544645631 conn(0x7f927006fe50 msgr2=0x7f92700af570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 shutdown_connections 2023-10-08T16:11:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:25.339+0000 7f9277c12700 1 -- 172.21.15.60:0/1544645631 wait complete. 2023-10-08T16:11:25.422 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:11:30.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:30.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.556+0000 7f2f4b8c3700 1 Processor -- start 2023-10-08T16:11:30.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.556+0000 7f2f4b8c3700 1 -- start start 2023-10-08T16:11:30.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4b8c3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 0x7f2f440b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:30.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4b8c3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f440cde50 0x7f2f440b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:30.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4b8c3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4415db80 con 0x7f2f4415a1e0 2023-10-08T16:11:30.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4b8c3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4415e800 con 0x7f2f440cde50 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4b8c3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4415de60 con 0x7f2f44159e10 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f49e60700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f440cde50 0x7f2f440b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4965f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 0x7f2f440b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f48e5e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2f4415a1e0 0x7f2f440cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:56812/0 (socket says 172.21.15.60:56812) 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f49e60700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f440cde50 0x7f2f440b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:44432/0 (socket says 172.21.15.60:44432) 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f4965f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 0x7f2f440b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:33530/0 (socket says 172.21.15.60:33530) 2023-10-08T16:11:30.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f48e5e700 1 -- 172.21.15.60:0/3834442877 learned_addr learned my addr 172.21.15.60:0/3834442877 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.557+0000 7f2f3bfff700 1 -- 172.21.15.60:0/3834442877 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604022230 0 0) 0x7f2f4415db80 con 0x7f2f4415a1e0 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f3bfff700 1 -- 172.21.15.60:0/3834442877 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f30003570 con 0x7f2f4415a1e0 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f49e60700 1 -- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 msgr2=0x7f2f440b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f49e60700 1 --2- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 0x7f2f440b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f49e60700 1 -- 172.21.15.60:0/3834442877 >> v1:172.21.15.144:6789/0 conn(0x7f2f4415a1e0 legacy=0x7f2f440cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f49e60700 1 -- 172.21.15.60:0/3834442877 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4415e140 con 0x7f2f440cde50 2023-10-08T16:11:30.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f4965f700 1 --2- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 0x7f2f440b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f49e60700 1 --2- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f440cde50 0x7f2f440b3260 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009e60 tx=0x7f2f3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284834ca17e34d02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f3bfff700 1 -- 172.21.15.60:0/3834442877 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00e070 con 0x7f2f440cde50 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f3bfff700 1 -- 172.21.15.60:0/3834442877 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00bab0 con 0x7f2f440cde50 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.558+0000 7f2f3bfff700 1 -- 172.21.15.60:0/3834442877 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00be30 con 0x7f2f440cde50 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f440cde50 msgr2=0x7f2f440b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f440cde50 0x7f2f440b3260 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009e60 tx=0x7f2f3c009780 comp rx=0 tx=0).stop 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3834442877 shutdown_connections 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f440cde50 0x7f2f440b3260 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3834442877 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f44159e10 0x7f2f440b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3834442877 >> 172.21.15.60:0/3834442877 conn(0x7f2f44067660 msgr2=0x7f2f44067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3834442877 shutdown_connections 2023-10-08T16:11:30.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.559+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3834442877 wait complete. 2023-10-08T16:11:30.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.560+0000 7f2f4b8c3700 1 Processor -- start 2023-10-08T16:11:30.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.560+0000 7f2f4b8c3700 1 -- start start 2023-10-08T16:11:30.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4b8c3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f440cde50 0x7f2f4416c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:30.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4b8c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 0x7f2f44169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:30.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4b8c3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f4415a1e0 0x7f2f4415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:30.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4b8c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4415b630 con 0x7f2f44159e10 2023-10-08T16:11:30.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4b8c3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4415aa20 con 0x7f2f4415a1e0 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4b8c3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4415ad00 con 0x7f2f440cde50 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 0x7f2f44169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 0x7f2f44169970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59120/0 (socket says 172.21.15.60:59120) 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 -- 172.21.15.60:0/3106917708 learned_addr learned my addr 172.21.15.60:0/3106917708 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4965f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f440cde50 0x7f2f4416c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f49e60700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f4415a1e0 0x7f2f4415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 -- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f440cde50 msgr2=0x7f2f4416c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f440cde50 0x7f2f4416c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 -- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f4415a1e0 msgr2=0x7f2f4415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f4415a1e0 0x7f2f4415bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 -- 172.21.15.60:0/3106917708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40009420 con 0x7f2f44159e10 2023-10-08T16:11:30.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f4965f700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f440cde50 0x7f2f4416c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.561+0000 7f2f48e5e700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 0x7f2f44169970 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c560 tx=0x7f2f34007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.562+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34005c00 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.562+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34005d60 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.562+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c009a20 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.562+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34007320 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.562+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4415b2c0 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.562+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4404c3c0 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.563+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f34007690 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.563+0000 7f2f397fa700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2f28066f30 0x7f2f280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.564+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f34083900 con 0x7f2f44159e10 2023-10-08T16:11:30.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.564+0000 7f2f4965f700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2f28066f30 0x7f2f280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:30.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.564+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=135}) v3 -- 0x7f2f2806ea50 con 0x7f2f44159e10 2023-10-08T16:11:30.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.564+0000 7f2f4965f700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2f28066f30 0x7f2f280693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2f40011600 tx=0x7f2f400091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:30.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.568+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f34017020 con 0x7f2f44159e10 2023-10-08T16:11:30.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.765+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2f4415e420 con 0x7f2f44159e10 2023-10-08T16:11:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.766+0000 7f2f397fa700 1 -- 172.21.15.60:0/3106917708 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f2f34050b70 con 0x7f2f44159e10 2023-10-08T16:11:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:30.766 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:30.766 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 134, 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:28.349932+0000", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:30.767 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:30.768 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:30.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:30.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:30.772 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:30.773 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:30.774 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:30.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:30.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.777 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:30.778 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:30.779 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:30.779 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:30.779 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:30.779 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:30.779 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:30.779 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:30.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:30.781 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:30.782 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:30.783 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:30.784 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:30.787 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:30.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "134", 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:30.790 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:30.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:30.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:30.793 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.796 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.796 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.796 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.797 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.797 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.797 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.797 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:30.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:30.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.800 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:30.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:30.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:30.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.811 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:30.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:30.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:30.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:30.818 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.819 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.823 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.825 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:30.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.827 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.828 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.829 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.829 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:30.829 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:30.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:30.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:30.836 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.837 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:30.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:30.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.843 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:30.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:30.845 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.846 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:30.854 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:30.855 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:30.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:30.862 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:30.863 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:30.871 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:30.873 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.874 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.875 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.876 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:30.877 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:30.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:30.879 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2f28066f30 msgr2=0x7f2f280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2f28066f30 0x7f2f280693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2f40011600 tx=0x7f2f400091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 msgr2=0x7f2f44169970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 0x7f2f44169970 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c560 tx=0x7f2f34007db0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 shutdown_connections 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2f28066f30 0x7f2f280693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f440cde50 0x7f2f4416c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f4415a1e0 0x7f2f4415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 --2- 172.21.15.60:0/3106917708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f44159e10 0x7f2f44169970 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 >> 172.21.15.60:0/3106917708 conn(0x7f2f44067660 msgr2=0x7f2f440d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 shutdown_connections 2023-10-08T16:11:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:30.768+0000 7f2f4b8c3700 1 -- 172.21.15.60:0/3106917708 wait complete. 2023-10-08T16:11:30.882 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-08T16:11:30.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:30.882 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-08T16:11:31.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:11:31.133 INFO:teuthology.orchestra.run.smithi060.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-08T16:11:31.134 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:11:31.134 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:11:31.134 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.231246 s, 227 MB/s 2023-10-08T16:11:31.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:31.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.252+0000 7fcd4f59e700 1 Processor -- start 2023-10-08T16:11:31.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.252+0000 7fcd4f59e700 1 -- start start 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd500cd6e0 0x7fcd500cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5015e850 con 0x7fcd500cdab0 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd500cd030 con 0x7fcd500cd6e0 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500cb7c0 con 0x7fcd5015dda0 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59132/0 (socket says 172.21.15.60:59132) 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/4253799190 learned_addr learned my addr 172.21.15.60:0/4253799190 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4ed9d700 1 --2- 172.21.15.60:0/4253799190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4e59c700 1 --2- 172.21.15.60:0/4253799190 >> v2:172.21.15.144:3300/0 conn(0x7fcd500cd6e0 0x7fcd500cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/4253799190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd5015dda0 msgr2=0x7fcd5015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 --2- 172.21.15.60:0/4253799190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/4253799190 >> v2:172.21.15.144:3300/0 conn(0x7fcd500cd6e0 msgr2=0x7fcd500cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 --2- 172.21.15.60:0/4253799190 >> v2:172.21.15.144:3300/0 conn(0x7fcd500cd6e0 0x7fcd500cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.253+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/4253799190 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5015e290 con 0x7fcd500cdab0 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4dd9b700 1 --2- 172.21.15.60:0/4253799190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd5015d860 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006b730 tx=0x7fcd38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ccf12dbaaa5fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4d59a700 1 -- 172.21.15.60:0/4253799190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800b860 con 0x7fcd500cdab0 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4d59a700 1 -- 172.21.15.60:0/4253799190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800b9c0 con 0x7fcd500cdab0 2023-10-08T16:11:31.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4d59a700 1 -- 172.21.15.60:0/4253799190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800bd60 con 0x7fcd500cdab0 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 -- 172.21.15.60:0/4253799190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 msgr2=0x7fcd5015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/4253799190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd5015d860 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006b730 tx=0x7fcd38009250 comp rx=0 tx=0).stop 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 -- 172.21.15.60:0/4253799190 shutdown_connections 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/4253799190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd5015dda0 0x7fcd5015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/4253799190 >> v2:172.21.15.144:3300/0 conn(0x7fcd500cd6e0 0x7fcd500cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/4253799190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd5015d860 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 -- 172.21.15.60:0/4253799190 >> 172.21.15.60:0/4253799190 conn(0x7fcd50067660 msgr2=0x7fcd50067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 -- 172.21.15.60:0/4253799190 shutdown_connections 2023-10-08T16:11:31.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.254+0000 7fcd4f59e700 1 -- 172.21.15.60:0/4253799190 wait complete. 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.255+0000 7fcd4f59e700 1 Processor -- start 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.255+0000 7fcd4f59e700 1 -- start start 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd500cd6e0 0x7fcd50155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd50158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5015dda0 0x7fcd501570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c8c10 con 0x7fcd500cdab0 2023-10-08T16:11:31.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50156150 con 0x7fcd5015dda0 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c7d20 con 0x7fcd500cd6e0 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd50158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd50158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59140/0 (socket says 172.21.15.60:59140) 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/384059266 learned_addr learned my addr 172.21.15.60:0/384059266 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.256+0000 7fcd4ed9d700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5015dda0 0x7fcd501570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd500cd6e0 msgr2=0x7fcd50155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4dd9b700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd500cd6e0 0x7fcd50155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5015dda0 msgr2=0x7fcd501570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4dd9b700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5015dda0 0x7fcd501570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4dd9b700 1 -- 172.21.15.60:0/384059266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380094f0 con 0x7fcd500cdab0 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4dd9b700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd50158790 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcd500c7b10 tx=0x7fcd38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:31.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38024440 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380245a0 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38024960 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500c8000 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.257+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500c85c0 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.258+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5015b400 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.258+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd3801a420 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.259+0000 7fcd467fc700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.259+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd38086350 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.259+0000 7fcd4e59c700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.259+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=135}) v3 -- 0x7fcd3006ea50 con 0x7fcd500cdab0 2023-10-08T16:11:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.259+0000 7fcd4e59c700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd30066f30 0x7fcd300693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009a60 tx=0x7fcd48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:31.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.263+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd380535c0 con 0x7fcd500cdab0 2023-10-08T16:11:31.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.458+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcd5015e570 con 0x7fcd500cdab0 2023-10-08T16:11:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.459+0000 7fcd467fc700 1 -- 172.21.15.60:0/384059266 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fcd38015070 con 0x7fcd500cdab0 2023-10-08T16:11:31.460 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:31.460 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:31.460 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 134, 2023-10-08T16:11:31.460 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:31.460 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:28.349932+0000", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:31.461 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:31.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:31.463 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:31.464 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:31.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:31.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:31.468 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:31.469 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:31.470 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:31.471 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:31.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:31.471 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:31.471 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:31.471 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:31.471 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:31.472 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:31.473 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:31.474 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:31.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:31.477 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:31.478 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:31.479 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:31.481 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "134", 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:31.482 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:31.483 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.484 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:31.485 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.486 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.487 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:31.488 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.489 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.490 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.491 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.492 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:31.493 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.501 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:31.505 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.507 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:31.508 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.510 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:31.511 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.513 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.514 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:31.516 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.518 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:31.518 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.519 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:31.519 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.519 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.520 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.520 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:31.520 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.521 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.521 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:31.521 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.521 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.521 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.522 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:31.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.524 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:31.524 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:31.524 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:31.524 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:31.525 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.525 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.525 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.525 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.526 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:31.526 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.526 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.526 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.526 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.526 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.527 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.527 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.527 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.527 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.527 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.528 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.528 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:31.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:31.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.530 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:31.531 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:31.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.532 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.532 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:31.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:31.535 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.537 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:31.537 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:31.537 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:31.537 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:31.537 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.537 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.538 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:31.539 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.541 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:31.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:31.545 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.546 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:31.547 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.548 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:31.550 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.551 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.552 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:31.553 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.556 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.557 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.558 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.558 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:31.558 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.558 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:31.559 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.559 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.559 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.559 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.559 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.559 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.560 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:31.561 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:31.562 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:31.563 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:31.564 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd30066f30 msgr2=0x7fcd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd30066f30 0x7fcd300693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009a60 tx=0x7fcd48008040 comp rx=0 tx=0).stop 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 msgr2=0x7fcd50158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd50158790 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcd500c7b10 tx=0x7fcd38017000 comp rx=0 tx=0).stop 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 shutdown_connections 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd500cd6e0 0x7fcd50155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5015dda0 0x7fcd501570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 --2- 172.21.15.60:0/384059266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd500cdab0 0x7fcd50158790 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 >> 172.21.15.60:0/384059266 conn(0x7fcd50067660 msgr2=0x7fcd500d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:31.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 shutdown_connections 2023-10-08T16:11:31.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.462+0000 7fcd4f59e700 1 -- 172.21.15.60:0/384059266 wait complete. 2023-10-08T16:11:31.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:31.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.686+0000 7f71dae94700 1 Processor -- start 2023-10-08T16:11:31.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.686+0000 7f71dae94700 1 -- start start 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71dae94700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71d4157870 0x7f71d415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71dae94700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d415cbb0 con 0x7f71d4157c40 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71dae94700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d415bfa0 con 0x7f71d415a620 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71dae94700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d415c280 con 0x7f71d4157870 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71d9431700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f71d4157c40 0x7f71d4158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60800/0 (socket says 172.21.15.60:60800) 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71d9431700 1 -- 172.21.15.60:0/4109141825 learned_addr learned my addr 172.21.15.60:0/4109141825 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71d8c30700 1 --2- 172.21.15.60:0/4109141825 >> v2:172.21.15.144:3300/0 conn(0x7f71d4157870 0x7f71d415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841877015 0 0) 0x7f71d415cbb0 con 0x7f71d4157c40 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.687+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c0003570 con 0x7f71d4157c40 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393665647 0 0) 0x7f71d415bfa0 con 0x7f71d415a620 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d415cbb0 con 0x7f71d415a620 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2086906504 0 0) 0x7f71c0003570 con 0x7f71d4157c40 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 >> v2:172.21.15.144:3300/0 conn(0x7f71d4157870 msgr2=0x7f71d415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 --2- 172.21.15.60:0/4109141825 >> v2:172.21.15.144:3300/0 conn(0x7f71d4157870 0x7f71d415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 >> v1:172.21.15.144:6789/0 conn(0x7f71d415a620 legacy=0x7f71d415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d415c560 con 0x7f71d4157c40 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f71bc001470 con 0x7f71d4157c40 2023-10-08T16:11:31.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 >> v1:172.21.15.60:6789/0 conn(0x7f71d4157c40 legacy=0x7f71d4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c0003bf0 0x7f71c0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c0004810 0x7f71c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c00051c0 0x7f71c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d415c280 con 0x7f71c00051c0 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000c160 con 0x7f71c0003bf0 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000c320 con 0x7f71c0004810 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c00051c0 0x7f71c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d8c30700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c0003bf0 0x7f71c0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d3fff700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c0004810 0x7f71c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 -- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c0004810 msgr2=0x7f71c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c0004810 0x7f71c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 -- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c0003bf0 msgr2=0x7f71c0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c0003bf0 0x7f71c0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 -- 172.21.15.60:0/4109141825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0003570 con 0x7f71c00051c0 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 -- 172.21.15.60:0/4109141825 reap_dead start 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.688+0000 7f71d9431700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c00051c0 0x7f71c000ba60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f71d41580c0 tx=0x7f71bc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee8d3639379a844 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00cb40 con 0x7f71c00051c0 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00cca0 con 0x7f71c00051c0 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71d37fe700 1 -- 172.21.15.60:0/4109141825 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc005b70 con 0x7f71c00051c0 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 -- 172.21.15.60:0/4109141825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c00051c0 msgr2=0x7f71c000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c00051c0 0x7f71c000ba60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f71d41580c0 tx=0x7f71bc001e10 comp rx=0 tx=0).stop 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 -- 172.21.15.60:0/4109141825 shutdown_connections 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 --2- 172.21.15.60:0/4109141825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c00051c0 0x7f71c000ba60 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 -- 172.21.15.60:0/4109141825 >> 172.21.15.60:0/4109141825 conn(0x7f71d4068ce0 msgr2=0x7f71d40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:31.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 -- 172.21.15.60:0/4109141825 shutdown_connections 2023-10-08T16:11:31.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.689+0000 7f71dae94700 1 -- 172.21.15.60:0/4109141825 wait complete. 2023-10-08T16:11:31.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.690+0000 7f71dae94700 1 Processor -- start 2023-10-08T16:11:31.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.690+0000 7f71dae94700 1 -- start start 2023-10-08T16:11:31.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71dae94700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c00051c0 0x7f71d4151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71dae94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 0x7f71d4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71dae94700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71d414efc0 0x7f71d414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71dae94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4151980 con 0x7f71d416ab30 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71dae94700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d416afa0 con 0x7f71c00051c0 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71dae94700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d414f980 con 0x7f71d414efc0 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 0x7f71d4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 0x7f71d4144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59162/0 (socket says 172.21.15.60:59162) 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71d3fff700 1 -- 172.21.15.60:0/1537111918 learned_addr learned my addr 172.21.15.60:0/1537111918 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71d8c30700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c00051c0 0x7f71d4151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.691+0000 7f71d9431700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71d414efc0 0x7f71d414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d3fff700 1 -- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71d414efc0 msgr2=0x7f71d414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d3fff700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71d414efc0 0x7f71d414f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d3fff700 1 -- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c00051c0 msgr2=0x7f71d4151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d3fff700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c00051c0 0x7f71d4151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d3fff700 1 -- 172.21.15.60:0/1537111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d416bdd0 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d8c30700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c00051c0 0x7f71d4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d3fff700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 0x7f71d4144770 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f71c400eb00 tx=0x7f71c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40032e0 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4010040 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d414e580 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40016e0 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.692+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d416b4a0 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.693+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d416bf60 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.693+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71c4001a90 con 0x7f71d416ab30 2023-10-08T16:11:31.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.694+0000 7f71d0ff9700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71b4066f30 0x7f71b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.694+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71c40841c0 con 0x7f71d416ab30 2023-10-08T16:11:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.694+0000 7f71d8c30700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71b4066f30 0x7f71b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.694+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=135}) v3 -- 0x7f71b406ea50 con 0x7f71d416ab30 2023-10-08T16:11:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.694+0000 7f71d8c30700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71b4066f30 0x7f71b40693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f71d40b6330 tx=0x7f71cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:31.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.698+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71c4051430 con 0x7f71d416ab30 2023-10-08T16:11:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.935+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d404c3c0 con 0x7f71d416ab30 2023-10-08T16:11:31.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.935+0000 7f71d0ff9700 1 -- 172.21.15.60:0/1537111918 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f71c4054a50 con 0x7f71d416ab30 2023-10-08T16:11:31.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:31.936 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:31.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.937+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71b4066f30 msgr2=0x7f71b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.937+0000 7f71dae94700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71b4066f30 0x7f71b40693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f71d40b6330 tx=0x7f71cc008040 comp rx=0 tx=0).stop 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.937+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 msgr2=0x7f71d4144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.937+0000 7f71dae94700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 0x7f71d4144770 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f71c400eb00 tx=0x7f71c4009040 comp rx=0 tx=0).stop 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 shutdown_connections 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71b4066f30 0x7f71b40693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71d414efc0 0x7f71d414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c00051c0 0x7f71d4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 --2- 172.21.15.60:0/1537111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d416ab30 0x7f71d4144770 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 >> 172.21.15.60:0/1537111918 conn(0x7f71d4068ce0 msgr2=0x7f71d41598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 shutdown_connections 2023-10-08T16:11:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:31.938+0000 7f71dae94700 1 -- 172.21.15.60:0/1537111918 wait complete. 2023-10-08T16:11:31.940 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:31.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-08T16:11:32.096 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":7140,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.499775657000001,"mdsmap_epoch":68,"osdmap_epoch":134,"osdmap_epoch_barrier":134,"uptime":22.577761359} 2023-10-08T16:11:32.096 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 7140, "mdsmap_epoch": 68, "osdmap_epoch": 134, "osdmap_epoch_barrier": 134, "rank_uptime": 17.499775657, "state": "up:active", "uptime": 22.577761359, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:11:32.097 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:11:32.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:32.097 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-08T16:11:32.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:32.114 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-08T16:11:32.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:32.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 Processor -- start 2023-10-08T16:11:32.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 -- start start 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f090c0b0890 0x7f090c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f090c067d70 0x7f090c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c0cb370 con 0x7f090c0cbd40 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c0b0c60 con 0x7f090c0b0890 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.332+0000 7f0912c83700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c06a1e0 con 0x7f090c067d70 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f090c0b0890 0x7f090c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f090c0b0890 0x7f090c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59172/0 (socket says 172.21.15.60:59172) 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 -- 172.21.15.60:0/3527222014 learned_addr learned my addr 172.21.15.60:0/3527222014 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0911220700 1 --2- 172.21.15.60:0/3527222014 >> v2:172.21.15.144:3300/0 conn(0x7f090c067d70 0x7f090c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 -- 172.21.15.60:0/3527222014 >> v2:172.21.15.144:3300/0 conn(0x7f090c067d70 msgr2=0x7f090c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 --2- 172.21.15.60:0/3527222014 >> v2:172.21.15.144:3300/0 conn(0x7f090c067d70 0x7f090c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 -- 172.21.15.60:0/3527222014 >> v1:172.21.15.144:6789/0 conn(0x7f090c0cbd40 legacy=0x7f090c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 -- 172.21.15.60:0/3527222014 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c06cb80 con 0x7f090c0b0890 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f0910a1f700 1 --2- 172.21.15.60:0/3527222014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c0cb800 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f090c0b4be0 tx=0x7f0904009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceed89b15e23068e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f090b7fe700 1 -- 172.21.15.60:0/3527222014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400e070 con 0x7f090c0b0890 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f090b7fe700 1 -- 172.21.15.60:0/3527222014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400ba20 con 0x7f090c0b0890 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.333+0000 7f090b7fe700 1 -- 172.21.15.60:0/3527222014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040092e0 con 0x7f090c0b0890 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 -- 172.21.15.60:0/3527222014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 msgr2=0x7f090c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 --2- 172.21.15.60:0/3527222014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c0cb800 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f090c0b4be0 tx=0x7f0904009840 comp rx=0 tx=0).stop 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 -- 172.21.15.60:0/3527222014 shutdown_connections 2023-10-08T16:11:32.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 --2- 172.21.15.60:0/3527222014 >> v2:172.21.15.144:3300/0 conn(0x7f090c067d70 0x7f090c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 --2- 172.21.15.60:0/3527222014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c0cb800 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 -- 172.21.15.60:0/3527222014 >> 172.21.15.60:0/3527222014 conn(0x7f090c06fe50 msgr2=0x7f090c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 -- 172.21.15.60:0/3527222014 shutdown_connections 2023-10-08T16:11:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.334+0000 7f0912c83700 1 -- 172.21.15.60:0/3527222014 wait complete. 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.335+0000 7f0912c83700 1 Processor -- start 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.335+0000 7f0912c83700 1 -- start start 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0912c83700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f090c067d70 0x7f090c068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0912c83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0912c83700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f090c0cbd40 0x7f090c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0912c83700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0c47b0 con 0x7f090c0b0890 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0912c83700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0c3ba0 con 0x7f090c067d70 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0912c83700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0c3e80 con 0x7f090c0cbd40 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48530/0 (socket says 172.21.15.60:48530) 2023-10-08T16:11:32.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 -- 172.21.15.60:0/589742252 learned_addr learned my addr 172.21.15.60:0/589742252 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0911220700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f090c0cbd40 0x7f090c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f0910a1f700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f090c067d70 0x7f090c068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 -- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f090c0cbd40 msgr2=0x7f090c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f090c0cbd40 0x7f090c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 -- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f090c067d70 msgr2=0x7f090c068f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f090c067d70 0x7f090c068f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.336+0000 7f090bfff700 1 -- 172.21.15.60:0/589742252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009ae0 con 0x7f090c0b0890 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.337+0000 7f090bfff700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c1589b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00c590 tx=0x7f08fc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.337+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc011590 con 0x7f090c0b0890 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.337+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc0116f0 con 0x7f090c0b0890 2023-10-08T16:11:32.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.337+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c0c4160 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.337+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc011ab0 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.337+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c159470 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.338+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c0c4960 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.338+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08fc01b3b0 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.338+0000 7f0908ff9700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.339+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08fc083ac0 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.339+0000 7f0910a1f700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.339+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=135}) v3 -- 0x7f08ec06ea50 con 0x7f090c0b0890 2023-10-08T16:11:32.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.339+0000 7f0910a1f700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0904009880 tx=0x7f0904018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:32.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.343+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08fc017070 con 0x7f090c0b0890 2023-10-08T16:11:32.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.535+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f090c04c3c0 con 0x7f090c0b0890 2023-10-08T16:11:32.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.536+0000 7f0908ff9700 1 -- 172.21.15.60:0/589742252 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f08fc083e60 con 0x7f090c0b0890 2023-10-08T16:11:32.537 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:32.537 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:32.537 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 134, 2023-10-08T16:11:32.537 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:32.537 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:32.537 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:28.349932+0000", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:32.538 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:32.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:32.541 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:32.542 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:32.543 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:32.544 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:32.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:32.546 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:32.547 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:32.548 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:32.549 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.550 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:32.551 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:32.553 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:32.554 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "134", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:32.555 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:32.556 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:32.557 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:32.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.563 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.564 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.565 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.567 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.570 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.572 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:32.573 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:32.576 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.578 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.583 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.584 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.586 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:32.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.592 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.596 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.602 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:32.603 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.604 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:32.606 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:32.608 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.609 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.611 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.612 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:32.614 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:32.615 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:32.616 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:32.617 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.538+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08ec066f30 msgr2=0x7f08ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.538+0000 7f0912c83700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0904009880 tx=0x7f0904018000 comp rx=0 tx=0).stop 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 msgr2=0x7f090c1589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c1589b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00c590 tx=0x7f08fc00c950 comp rx=0 tx=0).stop 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 shutdown_connections 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f090c0cbd40 0x7f090c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f090c067d70 0x7f090c068f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 --2- 172.21.15.60:0/589742252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0b0890 0x7f090c1589b0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:32.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 >> 172.21.15.60:0/589742252 conn(0x7f090c06fe50 msgr2=0x7f090c15c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:32.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 shutdown_connections 2023-10-08T16:11:32.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:32.539+0000 7f0912c83700 1 -- 172.21.15.60:0/589742252 wait complete. 2023-10-08T16:11:32.620 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:11:33.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:33.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:37.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.754+0000 7fdc9797b700 1 Processor -- start 2023-10-08T16:11:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc9797b700 1 -- start start 2023-10-08T16:11:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc9797b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdc901577d0 0x7fdc900cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc9797b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc90157ba0 0x7fdc9006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc9797b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9015c360 con 0x7fdc9015b0d0 2023-10-08T16:11:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc9797b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9015b790 con 0x7fdc901577d0 2023-10-08T16:11:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc9797b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9015d800 con 0x7fdc90157ba0 2023-10-08T16:11:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.755+0000 7fdc95717700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdc901577d0 0x7fdc900cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdc901577d0 0x7fdc900cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48542/0 (socket says 172.21.15.60:48542) 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 -- 172.21.15.60:0/2273607212 learned_addr learned my addr 172.21.15.60:0/2273607212 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc94f16700 1 --2- 172.21.15.60:0/2273607212 >> v2:172.21.15.144:3300/0 conn(0x7fdc90157ba0 0x7fdc9006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 -- 172.21.15.60:0/2273607212 >> v2:172.21.15.144:3300/0 conn(0x7fdc90157ba0 msgr2=0x7fdc9006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 --2- 172.21.15.60:0/2273607212 >> v2:172.21.15.144:3300/0 conn(0x7fdc90157ba0 0x7fdc9006a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 -- 172.21.15.60:0/2273607212 >> v1:172.21.15.144:6789/0 conn(0x7fdc9015b0d0 legacy=0x7fdc9015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 -- 172.21.15.60:0/2273607212 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9015ba30 con 0x7fdc901577d0 2023-10-08T16:11:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc95717700 1 --2- 172.21.15.60:0/2273607212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc901577d0 0x7fdc900cd770 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fdc900b38b0 tx=0x7fdc88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14762f0ce43d9766 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc8ffff700 1 -- 172.21.15.60:0/2273607212 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88009e70 con 0x7fdc901577d0 2023-10-08T16:11:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc8ffff700 1 -- 172.21.15.60:0/2273607212 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8800b860 con 0x7fdc901577d0 2023-10-08T16:11:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.756+0000 7fdc8ffff700 1 -- 172.21.15.60:0/2273607212 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800bc00 con 0x7fdc901577d0 2023-10-08T16:11:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 -- 172.21.15.60:0/2273607212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc901577d0 msgr2=0x7fdc900cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 --2- 172.21.15.60:0/2273607212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc901577d0 0x7fdc900cd770 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fdc900b38b0 tx=0x7fdc88009250 comp rx=0 tx=0).stop 2023-10-08T16:11:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 -- 172.21.15.60:0/2273607212 shutdown_connections 2023-10-08T16:11:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 --2- 172.21.15.60:0/2273607212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc901577d0 0x7fdc900cd770 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 --2- 172.21.15.60:0/2273607212 >> v2:172.21.15.144:3300/0 conn(0x7fdc90157ba0 0x7fdc9006a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 -- 172.21.15.60:0/2273607212 >> 172.21.15.60:0/2273607212 conn(0x7fdc90068ce0 msgr2=0x7fdc900690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 -- 172.21.15.60:0/2273607212 shutdown_connections 2023-10-08T16:11:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.757+0000 7fdc9797b700 1 -- 172.21.15.60:0/2273607212 wait complete. 2023-10-08T16:11:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.758+0000 7fdc9797b700 1 Processor -- start 2023-10-08T16:11:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.758+0000 7fdc9797b700 1 -- start start 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc9797b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc901577d0 0x7fdc900b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc9797b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc90157ba0 0x7fdc900d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc9797b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 0x7fdc900d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc9797b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc900b1020 con 0x7fdc9015b0d0 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc9797b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc900b06f0 con 0x7fdc901577d0 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc9797b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc900b09d0 con 0x7fdc90157ba0 2023-10-08T16:11:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc95f18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 0x7fdc900d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc95f18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 0x7fdc900d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48548/0 (socket says 172.21.15.60:48548) 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc95f18700 1 -- 172.21.15.60:0/3080735557 learned_addr learned my addr 172.21.15.60:0/3080735557 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.759+0000 7fdc95717700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc901577d0 0x7fdc900b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc94f16700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc90157ba0 0x7fdc900d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95f18700 1 -- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc90157ba0 msgr2=0x7fdc900d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95f18700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc90157ba0 0x7fdc900d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95f18700 1 -- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc901577d0 msgr2=0x7fdc900b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95f18700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc901577d0 0x7fdc900b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95f18700 1 -- 172.21.15.60:0/3080735557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc880094f0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95717700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc901577d0 0x7fdc900b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc95f18700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 0x7fdc900d0950 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000c840 tx=0x7fdc80001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80012630 con 0x7fdc9015b0d0 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc800127b0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc900b0cb0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80012b70 con 0x7fdc9015b0d0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.760+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc900b14b0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.761+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9004c3c0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.761+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc80003030 con 0x7fdc9015b0d0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.762+0000 7fdc8d7fa700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdc7c066f30 0x7fdc7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.762+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc80084550 con 0x7fdc9015b0d0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.762+0000 7fdc95717700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdc7c066f30 0x7fdc7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.762+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=135}) v3 -- 0x7fdc7c06ea50 con 0x7fdc9015b0d0 2023-10-08T16:11:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.762+0000 7fdc95717700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdc7c066f30 0x7fdc7c0693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdc900b38b0 tx=0x7fdc88017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:37.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.766+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc800517c0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.960+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdc9015bd10 con 0x7fdc9015b0d0 2023-10-08T16:11:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.961+0000 7fdc8d7fa700 1 -- 172.21.15.60:0/3080735557 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fdc80054de0 con 0x7fdc9015b0d0 2023-10-08T16:11:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 134, 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:28.349932+0000", 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "134", 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.015 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.037 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.038 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:38.039 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:38.041 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:38.042 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:38.043 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:38.044 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:38.045 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdc7c066f30 msgr2=0x7fdc7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdc7c066f30 0x7fdc7c0693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdc900b38b0 tx=0x7fdc88017000 comp rx=0 tx=0).stop 2023-10-08T16:11:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 msgr2=0x7fdc900d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 0x7fdc900d0950 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000c840 tx=0x7fdc80001670 comp rx=0 tx=0).stop 2023-10-08T16:11:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 shutdown_connections 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdc7c066f30 0x7fdc7c0693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9015b0d0 0x7fdc900d0950 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc901577d0 0x7fdc900b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 --2- 172.21.15.60:0/3080735557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc90157ba0 0x7fdc900d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 >> 172.21.15.60:0/3080735557 conn(0x7fdc90068ce0 msgr2=0x7fdc901568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 shutdown_connections 2023-10-08T16:11:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:37.963+0000 7fdc9797b700 1 -- 172.21.15.60:0/3080735557 wait complete. 2023-10-08T16:11:38.049 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:11:43.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.184+0000 7f119e391700 1 Processor -- start 2023-10-08T16:11:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.184+0000 7f119e391700 1 -- start start 2023-10-08T16:11:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f119e391700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f11980b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f119e391700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815db80 con 0x7f119815a1e0 2023-10-08T16:11:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f119e391700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815de60 con 0x7f11980cde50 2023-10-08T16:11:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f119e391700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119815e800 con 0x7f1198159e10 2023-10-08T16:11:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f11977fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f119815a1e0 0x7f11980cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48248/0 (socket says 172.21.15.60:48248) 2023-10-08T16:11:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f11977fe700 1 -- 172.21.15.60:0/853300870 learned_addr learned my addr 172.21.15.60:0/853300870 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1197fff700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f11980b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683985201 0 0) 0x7f119815db80 con 0x7f119815a1e0 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1184003570 con 0x7f119815a1e0 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466930769 0 0) 0x7f1184003570 con 0x7f119815a1e0 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 msgr2=0x7f11980b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f11980b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 >> v1:172.21.15.144:6789/0 conn(0x7f11980cde50 legacy=0x7f11980cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119815e140 con 0x7f119815a1e0 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.185+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f1180001490 con 0x7f119815a1e0 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 >> v1:172.21.15.60:6789/0 conn(0x7f119815a1e0 legacy=0x7f11980cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f1184003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1184004010 0x7f1184004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1184004d50 0x7f11840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815e800 con 0x7f1184004010 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118400bbf0 con 0x7f1184004d50 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118400bdb0 con 0x7f1198159e10 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1184004010 0x7f1184004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1197fff700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f1184003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f119c92e700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1184004d50 0x7f11840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 -- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 msgr2=0x7f1184003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f1184003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 -- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1184004d50 msgr2=0x7f11840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1184004d50 0x7f11840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 -- 172.21.15.60:0/853300870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184003570 con 0x7f1184004010 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1197fff700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1198159e10 0x7f1184003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f11977fe700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1184004010 0x7f1184004810 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f11980b6690 tx=0x7f1180001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6fd8fd6860cf6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000cc30 con 0x7f1184004010 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000cdb0 con 0x7f1184004010 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.186+0000 7f1196ffd700 1 -- 172.21.15.60:0/853300870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180004b40 con 0x7f1184004010 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119e391700 1 -- 172.21.15.60:0/853300870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1184004010 msgr2=0x7f1184004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119e391700 1 --2- 172.21.15.60:0/853300870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1184004010 0x7f1184004810 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f11980b6690 tx=0x7f1180001e70 comp rx=0 tx=0).stop 2023-10-08T16:11:43.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119c92e700 1 -- 172.21.15.60:0/853300870 reap_dead start 2023-10-08T16:11:43.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119e391700 1 -- 172.21.15.60:0/853300870 shutdown_connections 2023-10-08T16:11:43.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119e391700 1 -- 172.21.15.60:0/853300870 >> 172.21.15.60:0/853300870 conn(0x7f1198067660 msgr2=0x7f1198067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:43.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119e391700 1 -- 172.21.15.60:0/853300870 shutdown_connections 2023-10-08T16:11:43.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.187+0000 7f119e391700 1 -- 172.21.15.60:0/853300870 wait complete. 2023-10-08T16:11:43.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.188+0000 7f119e391700 1 Processor -- start 2023-10-08T16:11:43.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.188+0000 7f119e391700 1 -- start start 2023-10-08T16:11:43.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119e391700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004010 0x7f119816a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119e391700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 0x7f11980cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119e391700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11981590a0 0x7f11980c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119e391700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980c8b60 con 0x7f11980c8410 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119e391700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980c9bc0 con 0x7f11981590a0 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119e391700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980c5910 con 0x7f1184004010 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f11977fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 0x7f11980cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f11977fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 0x7f11980cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39288/0 (socket says 172.21.15.60:39288) 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f11977fe700 1 -- 172.21.15.60:0/2158659730 learned_addr learned my addr 172.21.15.60:0/2158659730 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f1197fff700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004010 0x7f119816a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.189+0000 7f119c92e700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11981590a0 0x7f11980c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f11977fe700 1 -- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004010 msgr2=0x7f119816a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f11977fe700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004010 0x7f119816a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f11977fe700 1 -- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11981590a0 msgr2=0x7f11980c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f11977fe700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11981590a0 0x7f11980c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f11977fe700 1 -- 172.21.15.60:0/2158659730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980c8880 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f119c92e700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11981590a0 0x7f11980c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f11977fe700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 0x7f11980cad30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1180001eb0 tx=0x7f1180015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180023070 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180007170 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11980c52c0 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180007510 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.190+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11980cb270 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.191+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980c5120 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.191+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f118001f420 con 0x7f11980c8410 2023-10-08T16:11:43.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.192+0000 7f118ffff700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.192+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1180085d10 con 0x7f11980c8410 2023-10-08T16:11:43.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.192+0000 7f1197fff700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.192+0000 7f1197fff700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1178066f30 0x7f11780693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1188006f00 tx=0x7f1188008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:43.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.196+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11980c5120 con 0x7f11980c8410 2023-10-08T16:11:43.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.392+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f11980c5120 con 0x7f11980c8410 2023-10-08T16:11:43.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.393+0000 7f118ffff700 1 -- 172.21.15.60:0/2158659730 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f11980c5120 con 0x7f11980c8410 2023-10-08T16:11:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:43.393 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 135, 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:38.352002+0000", 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "135", 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:43.437 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.438 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:43.440 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:43.443 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.444 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:43.445 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.446 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.448 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:43.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.451 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:43.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:43.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.458 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.458 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:43.460 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.461 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.462 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:43.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.467 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.468 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.473 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:43.474 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.475 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.477 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.478 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.479 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.480 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.482 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:43.483 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:43.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:43.485 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:43.485 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:43.485 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:43.485 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:43.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.485 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:43.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1178066f30 msgr2=0x7f11780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1178066f30 0x7f11780693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1188006f00 tx=0x7f1188008040 comp rx=0 tx=0).stop 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 msgr2=0x7f11980cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 0x7f11980cad30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1180001eb0 tx=0x7f1180015000 comp rx=0 tx=0).stop 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 shutdown_connections 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004010 0x7f119816a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11981590a0 0x7f11980c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 --2- 172.21.15.60:0/2158659730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11980c8410 0x7f11980cad30 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 >> 172.21.15.60:0/2158659730 conn(0x7f1198067660 msgr2=0x7f11980d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 shutdown_connections 2023-10-08T16:11:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.395+0000 7f119e391700 1 -- 172.21.15.60:0/2158659730 wait complete. 2023-10-08T16:11:43.488 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T16:11:43.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:11:43.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.607+0000 7f46c9602700 1 Processor -- start 2023-10-08T16:11:43.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.607+0000 7f46c9602700 1 -- start start 2023-10-08T16:11:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c9602700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46c415af20 0x7f46c415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c9602700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46c40cad70 0x7f46c40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c9602700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40c8af0 con 0x7f46c40c77e0 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c9602700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c406ebc0 con 0x7f46c415af20 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c9602700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c4157f50 con 0x7f46c40cad70 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46c415af20 0x7f46c415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c27fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f46c40c77e0 0x7f46c40c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48260/0 (socket says 172.21.15.60:48260) 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.608+0000 7f46c27fc700 1 -- 172.21.15.60:0/3704645008 learned_addr learned my addr 172.21.15.60:0/3704645008 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c37fe700 1 --2- 172.21.15.60:0/3704645008 >> v2:172.21.15.144:3300/0 conn(0x7f46c40cad70 0x7f46c40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c1ffb700 1 -- 172.21.15.60:0/3704645008 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970880804 0 0) 0x7f46c40c8af0 con 0x7f46c40c77e0 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c1ffb700 1 -- 172.21.15.60:0/3704645008 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ac003570 con 0x7f46c40c77e0 2023-10-08T16:11:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c2ffd700 1 -- 172.21.15.60:0/3704645008 >> v2:172.21.15.144:3300/0 conn(0x7f46c40cad70 msgr2=0x7f46c40cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c2ffd700 1 --2- 172.21.15.60:0/3704645008 >> v2:172.21.15.144:3300/0 conn(0x7f46c40cad70 0x7f46c40cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c2ffd700 1 -- 172.21.15.60:0/3704645008 >> v1:172.21.15.60:6789/0 conn(0x7f46c40c77e0 legacy=0x7f46c40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c2ffd700 1 -- 172.21.15.60:0/3704645008 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40c9690 con 0x7f46c415af20 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c2ffd700 1 --2- 172.21.15.60:0/3704645008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c415a540 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f46c4063d60 tx=0x7f46b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76296bb3da17ff7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c1ffb700 1 -- 172.21.15.60:0/3704645008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011630 con 0x7f46c415af20 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c1ffb700 1 -- 172.21.15.60:0/3704645008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b40117b0 con 0x7f46c415af20 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.609+0000 7f46c1ffb700 1 -- 172.21.15.60:0/3704645008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011b70 con 0x7f46c415af20 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 -- 172.21.15.60:0/3704645008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 msgr2=0x7f46c415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 --2- 172.21.15.60:0/3704645008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c415a540 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f46c4063d60 tx=0x7f46b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 -- 172.21.15.60:0/3704645008 shutdown_connections 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 --2- 172.21.15.60:0/3704645008 >> v2:172.21.15.144:3300/0 conn(0x7f46c40cad70 0x7f46c40cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 --2- 172.21.15.60:0/3704645008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c415a540 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 -- 172.21.15.60:0/3704645008 >> 172.21.15.60:0/3704645008 conn(0x7f46c40cd240 msgr2=0x7f46c40cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 -- 172.21.15.60:0/3704645008 shutdown_connections 2023-10-08T16:11:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.610+0000 7f46c9602700 1 -- 172.21.15.60:0/3704645008 wait complete. 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.611+0000 7f46c9602700 1 Processor -- start 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.611+0000 7f46c9602700 1 -- start start 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c40c77e0 0x7f46c40aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c40cad70 0x7f46c40c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c4097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40c6960 con 0x7f46c415af20 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4099ea0 con 0x7f46c40c77e0 2023-10-08T16:11:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40c5ce0 con 0x7f46c40cad70 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c4097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c4097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39292/0 (socket says 172.21.15.60:39292) 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 -- 172.21.15.60:0/664832889 learned_addr learned my addr 172.21.15.60:0/664832889 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c27fc700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c40cad70 0x7f46c40c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c2ffd700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c40c77e0 0x7f46c40aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 -- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c40cad70 msgr2=0x7f46c40c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c40cad70 0x7f46c40c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 -- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c40c77e0 msgr2=0x7f46c40aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c40c77e0 0x7f46c40aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 -- 172.21.15.60:0/664832889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009420 con 0x7f46c415af20 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c37fe700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c4097a00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009e90 tx=0x7f46bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00cb70 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc00f040 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40c5fc0 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.612+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc014480 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.613+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c40c6580 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.613+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c40c6bd0 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.615+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46bc014830 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.615+0000 7f46aaffd700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46b0066f30 0x7f46b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.615+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46bc0859c0 con 0x7f46c415af20 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.615+0000 7f46c2ffd700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46b0066f30 0x7f46b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.616+0000 7f46c2ffd700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46b0066f30 0x7f46b00693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f46c4063d60 tx=0x7f46b4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.619+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46bc052cb0 con 0x7f46c415af20 2023-10-08T16:11:43.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.812+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f46c40c7ee0 con 0x7f46c415af20 2023-10-08T16:11:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.813+0000 7f46aaffd700 1 -- 172.21.15.60:0/664832889 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f46bc018090 con 0x7f46c415af20 2023-10-08T16:11:43.813 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:43.813 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 135, 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:11:38.352002+0000", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:11:43.814 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 17, 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:11:43.815 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:43.816 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:11:43.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:43.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:43.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:43.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:43.821 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.441833+0000", 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:43.823 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:43.824 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:43.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:43.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:11:43.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:11:43.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:11:43.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:43.826 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:43.827 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:43.828 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:43.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:43.829 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:43.829 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:43.829 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:43.829 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:43.829 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:43.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:43.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:43.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:43.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:43.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:43.830 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:43.831 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:43.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:43.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.831 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:43.831 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:43.831 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:11:43.832 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:11:12.936737+0000", 2023-10-08T16:11:43.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:11:43.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:11:43.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "135", 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:11:43.836 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:11:43.837 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:11:43.838 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:11:43.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.845 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.846 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:11:43.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.853 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.858 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.860 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:11:43.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:11:43.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:11:43.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.866 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.873 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:11:43.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:11:43.878 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:11:43.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.885 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:11:43.886 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:11:43.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:11:43.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:11:43.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:11:43.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:11:43.895 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.896 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.897 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:11:43.899 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:11:43.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:11:43.902 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:11:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46b0066f30 msgr2=0x7f46b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46b0066f30 0x7f46b00693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f46c4063d60 tx=0x7f46b4017000 comp rx=0 tx=0).stop 2023-10-08T16:11:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 msgr2=0x7f46c4097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c4097a00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009e90 tx=0x7f46bc00b040 comp rx=0 tx=0).stop 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 shutdown_connections 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f46b0066f30 0x7f46b00693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c415af20 0x7f46c4097a00 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c40c77e0 0x7f46c40aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 --2- 172.21.15.60:0/664832889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c40cad70 0x7f46c40c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 >> 172.21.15.60:0/664832889 conn(0x7f46c40cd240 msgr2=0x7f46c415a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 shutdown_connections 2023-10-08T16:11:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:43.815+0000 7f46c9602700 1 -- 172.21.15.60:0/664832889 wait complete. 2023-10-08T16:11:43.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:44.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.024+0000 7f00fa0a8700 1 Processor -- start 2023-10-08T16:11:44.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.024+0000 7f00fa0a8700 1 -- start start 2023-10-08T16:11:44.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00fa0a8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 0x7f00f40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00fa0a8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00f40cde50 0x7f00f40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00fa0a8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f415db80 con 0x7f00f415a1e0 2023-10-08T16:11:44.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00fa0a8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f415e800 con 0x7f00f40cde50 2023-10-08T16:11:44.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00fa0a8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415de60 con 0x7f00f4159e10 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f00f415a1e0 0x7f00f40cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48270/0 (socket says 172.21.15.60:48270) 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f2ffd700 1 -- 172.21.15.60:0/2066191500 learned_addr learned my addr 172.21.15.60:0/2066191500 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f37fe700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 0x7f00f40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964189596 0 0) 0x7f00f415db80 con 0x7f00f415a1e0 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f3fff700 1 --2- 172.21.15.60:0/2066191500 >> v2:172.21.15.144:3300/0 conn(0x7f00f40cde50 0x7f00f40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00dc003570 con 0x7f00f415a1e0 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21801972 0 0) 0x7f00dc003570 con 0x7f00f415a1e0 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 msgr2=0x7f00f40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 0x7f00f40b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 >> v2:172.21.15.144:3300/0 conn(0x7f00f40cde50 msgr2=0x7f00f40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 --2- 172.21.15.60:0/2066191500 >> v2:172.21.15.144:3300/0 conn(0x7f00f40cde50 0x7f00f40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f415e140 con 0x7f00f415a1e0 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.025+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f00e8001490 con 0x7f00f415a1e0 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 >> v1:172.21.15.60:6789/0 conn(0x7f00f415a1e0 legacy=0x7f00f40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc003a60 0x7f00dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00dc004810 0x7f00dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 0x7f00dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415e800 con 0x7f00dc004810 2023-10-08T16:11:44.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415de60 con 0x7f00dc003a60 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00ba60 con 0x7f00f4159e10 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00dc004810 0x7f00dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f37fe700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc003a60 0x7f00dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f3fff700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 0x7f00dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 -- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 msgr2=0x7f00dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00f4159e10 0x7f00dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 -- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc003a60 msgr2=0x7f00dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc003a60 0x7f00dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 -- 172.21.15.60:0/2066191500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc003570 con 0x7f00dc004810 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f2ffd700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00dc004810 0x7f00dc004c80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c390 tx=0x7f00e8007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421aa7b6bf87e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800cc20 con 0x7f00dc004810 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800cda0 con 0x7f00dc004810 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.026+0000 7f00f27fc700 1 -- 172.21.15.60:0/2066191500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8004b40 con 0x7f00dc004810 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2066191500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00dc004810 msgr2=0x7f00dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2066191500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00dc004810 0x7f00dc004c80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c390 tx=0x7f00e8007940 comp rx=0 tx=0).stop 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00f3fff700 1 -- 172.21.15.60:0/2066191500 reap_dead start 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2066191500 shutdown_connections 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2066191500 >> 172.21.15.60:0/2066191500 conn(0x7f00f4067660 msgr2=0x7f00f4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2066191500 shutdown_connections 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.027+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2066191500 wait complete. 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.028+0000 7f00fa0a8700 1 Processor -- start 2023-10-08T16:11:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.028+0000 7f00fa0a8700 1 -- start start 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00dc004810 0x7f00f416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00f40caf00 0x7f00f41578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 0x7f00f40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40cb370 con 0x7f00f40c7d50 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f416d760 con 0x7f00f40caf00 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f416a610 con 0x7f00dc004810 2023-10-08T16:11:44.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 0x7f00f40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 0x7f00f40c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39300/0 (socket says 172.21.15.60:39300) 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 -- 172.21.15.60:0/2948194121 learned_addr learned my addr 172.21.15.60:0/2948194121 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f37fe700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00dc004810 0x7f00f416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f2ffd700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00f40caf00 0x7f00f41578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 -- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00dc004810 msgr2=0x7f00f416a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00dc004810 0x7f00f416a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 -- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00f40caf00 msgr2=0x7f00f41578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00f40caf00 0x7f00f41578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 -- 172.21.15.60:0/2948194121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f416a8f0 con 0x7f00f40c7d50 2023-10-08T16:11:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00f3fff700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 0x7f00f40c81c0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f00f40ce250 tx=0x7f00ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00e040 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00f040 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.029+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f416abd0 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.030+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00fe20 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.030+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f4157de0 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.031+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f404c3c0 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.031+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00ec015640 con 0x7f00f40c7d50 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.031+0000 7f00db7fe700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00e0066f30 0x7f00e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:44.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.032+0000 7f00f37fe700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00e0066f30 0x7f00e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:44.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.032+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00ec084de0 con 0x7f00f40c7d50 2023-10-08T16:11:44.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.032+0000 7f00f37fe700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00e0066f30 0x7f00e00693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00e4006dc0 tx=0x7f00e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:44.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.036+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00ec052050 con 0x7f00f40c7d50 2023-10-08T16:11:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.273+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00f416d8a0 con 0x7f00f40c7d50 2023-10-08T16:11:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.274+0000 7f00db7fe700 1 -- 172.21.15.60:0/2948194121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f00ec055670 con 0x7f00f40c7d50 2023-10-08T16:11:44.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:44.275 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00e0066f30 msgr2=0x7f00e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00e0066f30 0x7f00e00693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00e4006dc0 tx=0x7f00e4008040 comp rx=0 tx=0).stop 2023-10-08T16:11:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 msgr2=0x7f00f40c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 0x7f00f40c81c0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f00f40ce250 tx=0x7f00ec00b040 comp rx=0 tx=0).stop 2023-10-08T16:11:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 shutdown_connections 2023-10-08T16:11:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f00e0066f30 0x7f00e00693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00dc004810 0x7f00f416a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00f40c7d50 0x7f00f40c81c0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 --2- 172.21.15.60:0/2948194121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00f40caf00 0x7f00f41578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 >> 172.21.15.60:0/2948194121 conn(0x7f00f4067660 msgr2=0x7f00f415a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 shutdown_connections 2023-10-08T16:11:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:44.276+0000 7f00fa0a8700 1 -- 172.21.15.60:0/2948194121 wait complete. 2023-10-08T16:11:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:44.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-08T16:11:44.438 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":7140,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.841629743999999,"mdsmap_epoch":68,"osdmap_epoch":135,"osdmap_epoch_barrier":134,"uptime":34.919614768000002} 2023-10-08T16:11:44.438 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 7140, "mdsmap_epoch": 68, "osdmap_epoch": 135, "osdmap_epoch_barrier": 134, "rank_uptime": 29.841629744, "state": "up:active", "uptime": 34.919614768, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:11:44.438 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:11:44.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:44.439 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-08T16:11:44.724 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:11:44.724 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:11:44.724 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.267941 s, 196 MB/s 2023-10-08T16:11:44.725 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:11:44.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:11:44.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:11:44.800 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:11:44.801 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:11:44.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:44.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:11:44.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:11:44.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:44.875 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:11:44.890 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:11:44.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:11:44.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:11:44.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:11:44.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:11:44.932 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:11:44.986 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.104+0000 7fd1b2af3700 1 Processor -- start 2023-10-08T16:11:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.104+0000 7fd1b2af3700 1 -- start start 2023-10-08T16:11:45.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b2af3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1ac0b0e50 0x7fd1ac0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b2af3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b1220 0x7fd1ac06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b2af3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac15de60 con 0x7fd1ac06dad0 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b2af3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac15e140 con 0x7fd1ac0b0e50 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b2af3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15e420 con 0x7fd1ac0b1220 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b088f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1ac0b0e50 0x7fd1ac0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.105+0000 7fd1b1090700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd1ac06dad0 0x7fd1ac0cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48276/0 (socket says 172.21.15.60:48276) 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1b1090700 1 -- 172.21.15.60:0/725602062 learned_addr learned my addr 172.21.15.60:0/725602062 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1abfff700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b1220 0x7fd1ac06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1b088f700 1 -- 172.21.15.60:0/725602062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b1220 msgr2=0x7fd1ac06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1b088f700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b1220 0x7fd1ac06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1b088f700 1 -- 172.21.15.60:0/725602062 >> v1:172.21.15.60:6789/0 conn(0x7fd1ac06dad0 legacy=0x7fd1ac0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1b088f700 1 -- 172.21.15.60:0/725602062 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac15e700 con 0x7fd1ac0b0e50 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1ab7fe700 1 -- 172.21.15.60:0/725602062 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131300264 0 0) 0x7fd1ac15de60 con 0x7fd1ac06dad0 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1abfff700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b1220 0x7fd1ac06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:45.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1b088f700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b0e50 0x7fd1ac0c9180 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e90 tx=0x7fd1a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12db5e3cb4a2c9a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1ab7fe700 1 -- 172.21.15.60:0/725602062 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400e070 con 0x7fd1ac0b0e50 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1ab7fe700 1 -- 172.21.15.60:0/725602062 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400bbf0 con 0x7fd1ac0b0e50 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.106+0000 7fd1ab7fe700 1 -- 172.21.15.60:0/725602062 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4012430 con 0x7fd1ac0b0e50 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 -- 172.21.15.60:0/725602062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b0e50 msgr2=0x7fd1ac0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b0e50 0x7fd1ac0c9180 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e90 tx=0x7fd1a4009780 comp rx=0 tx=0).stop 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 -- 172.21.15.60:0/725602062 shutdown_connections 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b0e50 0x7fd1ac0c9180 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/725602062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b1220 0x7fd1ac06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 -- 172.21.15.60:0/725602062 >> 172.21.15.60:0/725602062 conn(0x7fd1ac069870 msgr2=0x7fd1ac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 -- 172.21.15.60:0/725602062 shutdown_connections 2023-10-08T16:11:45.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.107+0000 7fd1b2af3700 1 -- 172.21.15.60:0/725602062 wait complete. 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.108+0000 7fd1b2af3700 1 Processor -- start 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.108+0000 7fd1b2af3700 1 -- start start 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b2af3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1ac06dad0 0x7fd1ac15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b2af3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b0e50 0x7fd1ac0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b2af3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 0x7fd1ac0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b2af3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15d2a0 con 0x7fd1ac0b1220 2023-10-08T16:11:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b2af3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac16b780 con 0x7fd1ac06dad0 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b2af3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac16ba60 con 0x7fd1ac0b0e50 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 0x7fd1ac0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 0x7fd1ac0cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39314/0 (socket says 172.21.15.60:39314) 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 -- 172.21.15.60:0/615978313 learned_addr learned my addr 172.21.15.60:0/615978313 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b088f700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1ac06dad0 0x7fd1ac15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1abfff700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b0e50 0x7fd1ac0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 -- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b0e50 msgr2=0x7fd1ac0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b0e50 0x7fd1ac0ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 -- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1ac06dad0 msgr2=0x7fd1ac15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1ac06dad0 0x7fd1ac15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 -- 172.21.15.60:0/615978313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009a20 con 0x7fd1ac0b1220 2023-10-08T16:11:45.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.109+0000 7fd1b1090700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 0x7fd1ac0cad10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00c590 tx=0x7fd19c007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.110+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c005b30 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.110+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac16bd40 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.110+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac0c6a90 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.110+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c0070d0 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.110+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c005ea0 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.110+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac16c260 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.111+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd19c0074d0 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.111+0000 7fd1a8ff9700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd198066f30 0x7fd1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.111+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd19c0839c0 con 0x7fd1ac0b1220 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.111+0000 7fd1b088f700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd198066f30 0x7fd1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.112+0000 7fd1b088f700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd198066f30 0x7fd1980693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e90 tx=0x7fd1a4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.116+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1ac16c260 con 0x7fd1ac0b1220 2023-10-08T16:11:45.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.353+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1ac16c260 con 0x7fd1ac0b1220 2023-10-08T16:11:45.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.354+0000 7fd1a8ff9700 1 -- 172.21.15.60:0/615978313 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd1ac16c260 con 0x7fd1ac0b1220 2023-10-08T16:11:45.354 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:45.354 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:45.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd198066f30 msgr2=0x7fd1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd198066f30 0x7fd1980693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e90 tx=0x7fd1a4019000 comp rx=0 tx=0).stop 2023-10-08T16:11:45.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 msgr2=0x7fd1ac0cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 0x7fd1ac0cad10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00c590 tx=0x7fd19c007cd0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 shutdown_connections 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd198066f30 0x7fd1980693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ac0b1220 0x7fd1ac0cad10 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1ac06dad0 0x7fd1ac15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 --2- 172.21.15.60:0/615978313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1ac0b0e50 0x7fd1ac0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 >> 172.21.15.60:0/615978313 conn(0x7fd1ac069870 msgr2=0x7fd1ac0c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 shutdown_connections 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.356+0000 7fd1b2af3700 1 -- 172.21.15.60:0/615978313 wait complete. 2023-10-08T16:11:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:45.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:45.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.487+0000 7efeef260700 1 Processor -- start 2023-10-08T16:11:45.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.487+0000 7efeef260700 1 -- start start 2023-10-08T16:11:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeef260700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeef260700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efee815a620 0x7efee815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeef260700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee815cbb0 con 0x7efee815d580 2023-10-08T16:11:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeef260700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee815bfa0 con 0x7efee815a620 2023-10-08T16:11:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeef260700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee815c280 con 0x7efee8157870 2023-10-08T16:11:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeecffc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efee7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efee815a620 0x7efee815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeecffc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:50376/0 (socket says 172.21.15.60:50376) 2023-10-08T16:11:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efeecffc700 1 -- 172.21.15.60:0/1037081376 learned_addr learned my addr 172.21.15.60:0/1037081376 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efee7fff700 1 -- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 msgr2=0x7efee815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efee7fff700 1 --2- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efee7fff700 1 -- 172.21.15.60:0/1037081376 >> v1:172.21.15.144:6789/0 conn(0x7efee815d580 legacy=0x7efee8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efee7fff700 1 -- 172.21.15.60:0/1037081376 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee815c560 con 0x7efee815a620 2023-10-08T16:11:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.488+0000 7efee77fe700 1 -- 172.21.15.60:0/1037081376 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926437749 0 0) 0x7efee815cbb0 con 0x7efee815d580 2023-10-08T16:11:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efee7fff700 1 --2- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815a620 0x7efee815d040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098e0 tx=0x7efedc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8659a6d2b682b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efee77fe700 1 -- 172.21.15.60:0/1037081376 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00b640 con 0x7efee815a620 2023-10-08T16:11:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efee77fe700 1 -- 172.21.15.60:0/1037081376 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc00b7a0 con 0x7efee815a620 2023-10-08T16:11:45.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efee77fe700 1 -- 172.21.15.60:0/1037081376 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00bb40 con 0x7efee815a620 2023-10-08T16:11:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 -- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815a620 msgr2=0x7efee815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 --2- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815a620 0x7efee815d040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098e0 tx=0x7efedc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 -- 172.21.15.60:0/1037081376 shutdown_connections 2023-10-08T16:11:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 --2- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 --2- 172.21.15.60:0/1037081376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815a620 0x7efee815d040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 -- 172.21.15.60:0/1037081376 >> 172.21.15.60:0/1037081376 conn(0x7efee8068ce0 msgr2=0x7efee80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 -- 172.21.15.60:0/1037081376 shutdown_connections 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.489+0000 7efeef260700 1 -- 172.21.15.60:0/1037081376 wait complete. 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.490+0000 7efeef260700 1 Processor -- start 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 -- start start 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 0x7efee816e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815d580 0x7efee814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80b32c0 con 0x7efee815a620 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee816eca0 con 0x7efee815d580 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.491+0000 7efeef260700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee814e9f0 con 0x7efee8157870 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 0x7efee816e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 0x7efee816e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39316/0 (socket says 172.21.15.60:39316) 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efeecffc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 -- 172.21.15.60:0/1549015319 learned_addr learned my addr 172.21.15.60:0/1549015319 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efeed7fd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815d580 0x7efee814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 -- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 msgr2=0x7efee80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 -- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815d580 msgr2=0x7efee814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815d580 0x7efee814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 -- 172.21.15.60:0/1549015319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc009420 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efeed7fd700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815d580 0x7efee814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee7fff700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 0x7efee816e760 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efee806b530 tx=0x7efedc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00bb20 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc000c90 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee814ecd0 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc011630 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.492+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee814f290 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.493+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee804c3c0 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.494+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efedc0119a0 con 0x7efee815a620 2023-10-08T16:11:45.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.494+0000 7efee4ff9700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.494+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efedc085880 con 0x7efee815a620 2023-10-08T16:11:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.494+0000 7efeecffc700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.495+0000 7efeecffc700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efee000f570 tx=0x7efee000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.498+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efedc052af0 con 0x7efee815a620 2023-10-08T16:11:45.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.697+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efee815c840 con 0x7efee815a620 2023-10-08T16:11:45.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.698+0000 7efee4ff9700 1 -- 172.21.15.60:0/1549015319 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+15372 (secure 0 0 0) 0x7efedc056110 con 0x7efee815a620 2023-10-08T16:11:45.698 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:45.698 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":135,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:38.352002+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:11:12.441833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:11:12.936737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:45.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 msgr2=0x7efed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efee000f570 tx=0x7efee000b040 comp rx=0 tx=0).stop 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 msgr2=0x7efee816e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 0x7efee816e760 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efee806b530 tx=0x7efedc017000 comp rx=0 tx=0).stop 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 shutdown_connections 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efee8157870 0x7efee80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efee815d580 0x7efee814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 --2- 172.21.15.60:0/1549015319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee815a620 0x7efee816e760 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 >> 172.21.15.60:0/1549015319 conn(0x7efee8068ce0 msgr2=0x7efee81596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 shutdown_connections 2023-10-08T16:11:45.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.700+0000 7efeef260700 1 -- 172.21.15.60:0/1549015319 wait complete. 2023-10-08T16:11:45.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:11:12.441833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:11:12.936737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:11:45.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:11:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.834+0000 7f6ba9d5d700 1 Processor -- start 2023-10-08T16:11:45.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.834+0000 7f6ba9d5d700 1 -- start start 2023-10-08T16:11:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba9d5d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6ba4164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba9d5d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40b4d70 con 0x7f6ba40cce30 2023-10-08T16:11:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba9d5d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba415b3b0 con 0x7f6ba40b6580 2023-10-08T16:11:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba9d5d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40cd8d0 con 0x7f6ba406aa00 2023-10-08T16:11:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba8d5b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6ba40cce30 0x7f6ba415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48286/0 (socket says 172.21.15.60:48286) 2023-10-08T16:11:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/3428498327 learned_addr learned my addr 172.21.15.60:0/3428498327 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba955c700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6ba4164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616437182 0 0) 0x7f6ba40b4d70 con 0x7f6ba40cce30 2023-10-08T16:11:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.835+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b94003570 con 0x7f6ba40cce30 2023-10-08T16:11:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966364017 0 0) 0x7f6b94003570 con 0x7f6ba40cce30 2023-10-08T16:11:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 msgr2=0x7f6ba4164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6ba4164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 >> v1:172.21.15.144:6789/0 conn(0x7f6ba40b6580 legacy=0x7f6ba406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40b4440 con 0x7f6ba40cce30 2023-10-08T16:11:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f6b98001470 con 0x7f6ba40cce30 2023-10-08T16:11:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 >> v1:172.21.15.60:6789/0 conn(0x7f6ba40cce30 legacy=0x7f6ba415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6b94003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b94003fd0 0x7f6b94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b94004d50 0x7f6b940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40cd8d0 con 0x7f6b94003fd0 2023-10-08T16:11:45.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9400bb40 con 0x7f6b94004d50 2023-10-08T16:11:45.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9400bd00 con 0x7f6ba406aa00 2023-10-08T16:11:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6b94003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba3fff700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b94003fd0 0x7f6b94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba955c700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b94004d50 0x7f6b940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b94004d50 msgr2=0x7f6b940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:45.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b94004d50 0x7f6b940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/3428498327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b94003fd0 msgr2=0x7f6b94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:45.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b94003fd0 0x7f6b94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/3428498327 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94003570 con 0x7f6ba406aa00 2023-10-08T16:11:45.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba3fff700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b94003fd0 0x7f6b94004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:11:45.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.836+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6b94003a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c390 tx=0x7f6ba40ce820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d159234b20d6fbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800cc60 con 0x7f6ba406aa00 2023-10-08T16:11:45.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800cde0 con 0x7f6ba406aa00 2023-10-08T16:11:45.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba37fe700 1 -- 172.21.15.60:0/3428498327 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005b70 con 0x7f6ba406aa00 2023-10-08T16:11:45.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 msgr2=0x7f6b94003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/3428498327 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba406aa00 0x7f6b94003a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c390 tx=0x7f6ba40ce820 comp rx=0 tx=0).stop 2023-10-08T16:11:45.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba955c700 1 -- 172.21.15.60:0/3428498327 reap_dead start 2023-10-08T16:11:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/3428498327 shutdown_connections 2023-10-08T16:11:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/3428498327 >> 172.21.15.60:0/3428498327 conn(0x7f6ba4068cb0 msgr2=0x7f6ba40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/3428498327 shutdown_connections 2023-10-08T16:11:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.837+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/3428498327 wait complete. 2023-10-08T16:11:45.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.838+0000 7f6ba9d5d700 1 Processor -- start 2023-10-08T16:11:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.838+0000 7f6ba9d5d700 1 -- start start 2023-10-08T16:11:45.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba9d5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 0x7f6ba414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba9d5d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba41522b0 0x7f6ba415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba9d5d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba4152720 0x7f6ba415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba9d5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4153250 con 0x7f6ba406aa00 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba9d5d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414ec00 con 0x7f6ba41522b0 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba9d5d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba416a180 con 0x7f6ba4152720 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba8d5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 0x7f6ba414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba8d5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 0x7f6ba414e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39344/0 (socket says 172.21.15.60:39344) 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/1040102468 learned_addr learned my addr 172.21.15.60:0/1040102468 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba3fff700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba41522b0 0x7f6ba415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba955c700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba4152720 0x7f6ba415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba4152720 msgr2=0x7f6ba415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.839+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba4152720 0x7f6ba415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba41522b0 msgr2=0x7f6ba415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba41522b0 0x7f6ba415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba8d5b700 1 -- 172.21.15.60:0/1040102468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4152c90 con 0x7f6ba406aa00 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba3fff700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba41522b0 0x7f6ba415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba955c700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba4152720 0x7f6ba415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba8d5b700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 0x7f6ba414e6c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c980 tx=0x7f6b98015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800cc60 con 0x7f6ba406aa00 2023-10-08T16:11:45.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800c9b0 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba4152f70 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98007530 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.840+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba4153ec0 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.841+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba41540b0 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.841+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b98019030 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.842+0000 7f6ba0ff9700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b88066f30 0x7f6b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.842+0000 7f6ba3fff700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b88066f30 0x7f6b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.842+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b98086080 con 0x7f6ba406aa00 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.842+0000 7f6ba3fff700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b88066f30 0x7f6b880693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6b90007ba0 tx=0x7f6b90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:45.846+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ba41540b0 con 0x7f6ba406aa00 2023-10-08T16:11:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.037+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ba4169c70 con 0x7f6ba406aa00 2023-10-08T16:11:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.038+0000 7f6ba0ff9700 1 -- 172.21.15.60:0/1040102468 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ba4169c70 con 0x7f6ba406aa00 2023-10-08T16:11:46.039 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:11:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b88066f30 msgr2=0x7f6b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b88066f30 0x7f6b880693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6b90007ba0 tx=0x7f6b90009040 comp rx=0 tx=0).stop 2023-10-08T16:11:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 msgr2=0x7f6ba414e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 0x7f6ba414e6c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c980 tx=0x7f6b98015000 comp rx=0 tx=0).stop 2023-10-08T16:11:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 shutdown_connections 2023-10-08T16:11:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6b88066f30 0x7f6b880693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ba4152720 0x7f6ba415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ba406aa00 0x7f6ba414e6c0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 --2- 172.21.15.60:0/1040102468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba41522b0 0x7f6ba415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 >> 172.21.15.60:0/1040102468 conn(0x7f6ba4068cb0 msgr2=0x7f6ba40d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 shutdown_connections 2023-10-08T16:11:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.040+0000 7f6ba9d5d700 1 -- 172.21.15.60:0/1040102468 wait complete. 2023-10-08T16:11:46.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:11:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.175+0000 7f422a441700 1 Processor -- start 2023-10-08T16:11:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.175+0000 7f422a441700 1 -- start start 2023-10-08T16:11:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f422a441700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42240b6580 0x7f422406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f422a441700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422406ac90 con 0x7f422406a830 2023-10-08T16:11:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f422a441700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240b4d70 con 0x7f42240cce30 2023-10-08T16:11:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f422a441700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422415b3b0 con 0x7f42240b6580 2023-10-08T16:11:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4228c3e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42240b6580 0x7f422406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4229c40700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f422406a830 0x7f42240b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48298/0 (socket says 172.21.15.60:48298) 2023-10-08T16:11:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4229c40700 1 -- 172.21.15.60:0/422145515 learned_addr learned my addr 172.21.15.60:0/422145515 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4228c3e700 1 -- 172.21.15.60:0/422145515 >> v1:172.21.15.144:6789/0 conn(0x7f42240cce30 legacy=0x7f422415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4228c3e700 1 -- 172.21.15.60:0/422145515 >> v1:172.21.15.60:6789/0 conn(0x7f422406a830 legacy=0x7f42240b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4223fff700 1 -- 172.21.15.60:0/422145515 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160441454 0 0) 0x7f4214001490 con 0x7f422406a830 2023-10-08T16:11:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.176+0000 7f4228c3e700 1 -- 172.21.15.60:0/422145515 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240cd8d0 con 0x7f42240b6580 2023-10-08T16:11:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f4228c3e700 1 --2- 172.21.15.60:0/422145515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240b6580 0x7f422406a2f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f42180098e0 tx=0x7f42180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb349f8aaaf4313 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f4223fff700 1 -- 172.21.15.60:0/422145515 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218009e80 con 0x7f42240b6580 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f4223fff700 1 -- 172.21.15.60:0/422145515 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800b860 con 0x7f42240b6580 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f4223fff700 1 -- 172.21.15.60:0/422145515 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800bbe0 con 0x7f42240b6580 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 -- 172.21.15.60:0/422145515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240b6580 msgr2=0x7f422406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 --2- 172.21.15.60:0/422145515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240b6580 0x7f422406a2f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f42180098e0 tx=0x7f42180091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 -- 172.21.15.60:0/422145515 shutdown_connections 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 --2- 172.21.15.60:0/422145515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240b6580 0x7f422406a2f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 -- 172.21.15.60:0/422145515 >> 172.21.15.60:0/422145515 conn(0x7f4224068cb0 msgr2=0x7f42240690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 -- 172.21.15.60:0/422145515 shutdown_connections 2023-10-08T16:11:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.177+0000 7f422a441700 1 -- 172.21.15.60:0/422145515 wait complete. 2023-10-08T16:11:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 Processor -- start 2023-10-08T16:11:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 -- start start 2023-10-08T16:11:46.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422406a830 0x7f42240b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42240b6580 0x7f422414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 0x7f4224152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422414c7f0 con 0x7f42240cce30 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224159760 con 0x7f422406a830 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.179+0000 7f422a441700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b1ec0 con 0x7f42240b6580 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 0x7f4224152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 0x7f4224152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39364/0 (socket says 172.21.15.60:39364) 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 -- 172.21.15.60:0/2307074623 learned_addr learned my addr 172.21.15.60:0/2307074623 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4228c3e700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42240b6580 0x7f422414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f422943f700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422406a830 0x7f42240b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 -- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42240b6580 msgr2=0x7f422414c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42240b6580 0x7f422414c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 -- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422406a830 msgr2=0x7f42240b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422406a830 0x7f42240b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 -- 172.21.15.60:0/2307074623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009420 con 0x7f42240cce30 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f4229c40700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 0x7f4224152140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f421400cc90 tx=0x7f4214001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214004bb0 con 0x7f42240cce30 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214004d10 con 0x7f42240cce30 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4224152680 con 0x7f42240cce30 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400ab00 con 0x7f42240cce30 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.180+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240b2720 con 0x7f42240cce30 2023-10-08T16:11:46.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.181+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42240b2080 con 0x7f42240cce30 2023-10-08T16:11:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.182+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42140070f0 con 0x7f42240cce30 2023-10-08T16:11:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.182+0000 7f42217fa700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4210066f30 0x7f42100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.182+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4214084140 con 0x7f42240cce30 2023-10-08T16:11:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.182+0000 7f422943f700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4210066f30 0x7f42100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.183+0000 7f422943f700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4210066f30 0x7f42100693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f421c0039e0 tx=0x7f421c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.186+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42240b2080 con 0x7f42240cce30 2023-10-08T16:11:46.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.377+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f422406ac90 con 0x7f42240cce30 2023-10-08T16:11:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.379+0000 7f42217fa700 1 -- 172.21.15.60:0/2307074623 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4214018020 con 0x7f42240cce30 2023-10-08T16:11:46.379 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4210066f30 msgr2=0x7f42100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4210066f30 0x7f42100693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f421c0039e0 tx=0x7f421c007ec0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 msgr2=0x7f4224152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 0x7f4224152140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f421400cc90 tx=0x7f4214001a50 comp rx=0 tx=0).stop 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 shutdown_connections 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4210066f30 0x7f42100693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42240cce30 0x7f4224152140 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422406a830 0x7f42240b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 --2- 172.21.15.60:0/2307074623 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42240b6580 0x7f422414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 >> 172.21.15.60:0/2307074623 conn(0x7f4224068cb0 msgr2=0x7f4224069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 shutdown_connections 2023-10-08T16:11:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.381+0000 7f422a441700 1 -- 172.21.15.60:0/2307074623 wait complete. 2023-10-08T16:11:46.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:11:46.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.515+0000 7fd2536dc700 1 Processor -- start 2023-10-08T16:11:46.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.515+0000 7fd2536dc700 1 -- start start 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd2536dc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd24c159e60 0x7fd24c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd2536dc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd24c15a230 0x7fd24c0690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd2536dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c0695f0 0x7fd24c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd2536dc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c0d1cf0 con 0x7fd24c15a230 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd2536dc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c069a70 con 0x7fd24c159e60 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd2536dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c15ea90 con 0x7fd24c0695f0 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd250c77700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd24c15a230 0x7fd24c0690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd250c77700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd24c15a230 0x7fd24c0690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39368/0 (socket says 172.21.15.60:39368) 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.516+0000 7fd250c77700 1 -- 172.21.15.60:0/601390048 learned_addr learned my addr 172.21.15.60:0/601390048 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd251478700 1 --2- 172.21.15.60:0/601390048 >> v2:172.21.15.144:3300/0 conn(0x7fd24c159e60 0x7fd24c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd251c79700 1 --2- 172.21.15.60:0/601390048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c0695f0 0x7fd24c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd250c77700 1 -- 172.21.15.60:0/601390048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c0695f0 msgr2=0x7fd24c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd250c77700 1 --2- 172.21.15.60:0/601390048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c0695f0 0x7fd24c0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd250c77700 1 -- 172.21.15.60:0/601390048 >> v2:172.21.15.144:3300/0 conn(0x7fd24c159e60 msgr2=0x7fd24c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd250c77700 1 --2- 172.21.15.60:0/601390048 >> v2:172.21.15.144:3300/0 conn(0x7fd24c159e60 0x7fd24c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd250c77700 1 -- 172.21.15.60:0/601390048 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0b3100 con 0x7fd24c15a230 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd251478700 1 --2- 172.21.15.60:0/601390048 >> v2:172.21.15.144:3300/0 conn(0x7fd24c159e60 0x7fd24c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:46.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd250c77700 1 --2- 172.21.15.60:0/601390048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c15a230 0x7fd24c0690b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0cdf30 tx=0x7fd240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f949ed3ee5aa76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd24bfff700 1 -- 172.21.15.60:0/601390048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000b820 con 0x7fd24c15a230 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd24bfff700 1 -- 172.21.15.60:0/601390048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24000b980 con 0x7fd24c15a230 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd24bfff700 1 -- 172.21.15.60:0/601390048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000bd20 con 0x7fd24c15a230 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 -- 172.21.15.60:0/601390048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c15a230 msgr2=0x7fd24c0690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 --2- 172.21.15.60:0/601390048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c15a230 0x7fd24c0690b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0cdf30 tx=0x7fd240009250 comp rx=0 tx=0).stop 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 -- 172.21.15.60:0/601390048 shutdown_connections 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 --2- 172.21.15.60:0/601390048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c0695f0 0x7fd24c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 --2- 172.21.15.60:0/601390048 >> v2:172.21.15.144:3300/0 conn(0x7fd24c159e60 0x7fd24c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 --2- 172.21.15.60:0/601390048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c15a230 0x7fd24c0690b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.517+0000 7fd2536dc700 1 -- 172.21.15.60:0/601390048 >> 172.21.15.60:0/601390048 conn(0x7fd24c070700 msgr2=0x7fd24c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:46.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.518+0000 7fd2536dc700 1 -- 172.21.15.60:0/601390048 shutdown_connections 2023-10-08T16:11:46.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.518+0000 7fd2536dc700 1 -- 172.21.15.60:0/601390048 wait complete. 2023-10-08T16:11:46.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 Processor -- start 2023-10-08T16:11:46.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 -- start start 2023-10-08T16:11:46.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 0x7fd24c14d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c159e60 0x7fd24c15b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c15a230 0x7fd24c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c15e490 con 0x7fd24c0695f0 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c9d50 con 0x7fd24c15a230 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.519+0000 7fd2536dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c9770 con 0x7fd24c159e60 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 0x7fd24c14d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 0x7fd24c14d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39376/0 (socket says 172.21.15.60:39376) 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 -- 172.21.15.60:0/3114483873 learned_addr learned my addr 172.21.15.60:0/3114483873 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251c79700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c15a230 0x7fd24c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd250c77700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c159e60 0x7fd24c15b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 -- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c159e60 msgr2=0x7fd24c15b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c159e60 0x7fd24c15b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 -- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c15a230 msgr2=0x7fd24c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c15a230 0x7fd24c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 -- 172.21.15.60:0/3114483873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400094f0 con 0x7fd24c0695f0 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251c79700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c15a230 0x7fd24c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd250c77700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c159e60 0x7fd24c15b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd251478700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 0x7fd24c14d4b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fd24400c860 tx=0x7fd244008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244011600 con 0x7fd24c0695f0 2023-10-08T16:11:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244011760 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c15b690 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244011b00 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.520+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c16a320 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.521+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c04c3c0 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.522+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd24400a3e0 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.522+0000 7fd2497fa700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd238066f30 0x7fd2380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.522+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd244084650 con 0x7fd24c0695f0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.522+0000 7fd250c77700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd238066f30 0x7fd2380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.523+0000 7fd250c77700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd238066f30 0x7fd2380693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0cdf30 tx=0x7fd240017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.527+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2440518c0 con 0x7fd24c0695f0 2023-10-08T16:11:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.723+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd24c0cb590 con 0x7fd24c0695f0 2023-10-08T16:11:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.723+0000 7fd2497fa700 1 -- 172.21.15.60:0/3114483873 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd244054ee0 con 0x7fd24c0695f0 2023-10-08T16:11:46.723 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd238066f30 msgr2=0x7fd2380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd238066f30 0x7fd2380693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0cdf30 tx=0x7fd240017000 comp rx=0 tx=0).stop 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 msgr2=0x7fd24c14d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 0x7fd24c14d4b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fd24400c860 tx=0x7fd244008040 comp rx=0 tx=0).stop 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 shutdown_connections 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd238066f30 0x7fd2380693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c15a230 0x7fd24c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c0695f0 0x7fd24c14d4b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 --2- 172.21.15.60:0/3114483873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd24c159e60 0x7fd24c15b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 >> 172.21.15.60:0/3114483873 conn(0x7fd24c070700 msgr2=0x7fd24c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:46.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 shutdown_connections 2023-10-08T16:11:46.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.725+0000 7fd2536dc700 1 -- 172.21.15.60:0/3114483873 wait complete. 2023-10-08T16:11:46.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:46.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.855+0000 7f9734ae6700 1 Processor -- start 2023-10-08T16:11:46.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.855+0000 7f9734ae6700 1 -- start start 2023-10-08T16:11:46.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f9734ae6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300abae0 0x7f97300c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f9734ae6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f97300abeb0 0x7f97300c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f9734ae6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97300c8400 0x7f97300c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f9734ae6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300c9cb0 con 0x7f97300c8400 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f9734ae6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300c90a0 con 0x7f97300abeb0 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f9734ae6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300c9380 con 0x7f97300abae0 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f972ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97300c8400 0x7f97300c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f972ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97300c8400 0x7f97300c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39382/0 (socket says 172.21.15.60:39382) 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f972ed9d700 1 -- 172.21.15.60:0/4068080833 learned_addr learned my addr 172.21.15.60:0/4068080833 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.856+0000 7f972dd9b700 1 --2- 172.21.15.60:0/4068080833 >> v2:172.21.15.144:3300/0 conn(0x7f97300abeb0 0x7f97300c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972e59c700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300abae0 0x7f97300c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972ed9d700 1 -- 172.21.15.60:0/4068080833 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300abae0 msgr2=0x7f97300c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972ed9d700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300abae0 0x7f97300c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972ed9d700 1 -- 172.21.15.60:0/4068080833 >> v2:172.21.15.144:3300/0 conn(0x7f97300abeb0 msgr2=0x7f97300c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972ed9d700 1 --2- 172.21.15.60:0/4068080833 >> v2:172.21.15.144:3300/0 conn(0x7f97300abeb0 0x7f97300c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972ed9d700 1 -- 172.21.15.60:0/4068080833 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300c9660 con 0x7f97300c8400 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972e59c700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300abae0 0x7f97300c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972ed9d700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300c8400 0x7f97300c8860 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f973006cd90 tx=0x7f972000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3da6c98a2f6b51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972d59a700 1 -- 172.21.15.60:0/4068080833 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720010070 con 0x7f97300c8400 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972d59a700 1 -- 172.21.15.60:0/4068080833 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972000de90 con 0x7f97300c8400 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f972d59a700 1 -- 172.21.15.60:0/4068080833 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972000b320 con 0x7f97300c8400 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f9734ae6700 1 -- 172.21.15.60:0/4068080833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300c8400 msgr2=0x7f97300c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.857+0000 7f9734ae6700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300c8400 0x7f97300c8860 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f973006cd90 tx=0x7f972000ba50 comp rx=0 tx=0).stop 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 -- 172.21.15.60:0/4068080833 shutdown_connections 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300c8400 0x7f97300c8860 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 --2- 172.21.15.60:0/4068080833 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300abae0 0x7f97300c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 --2- 172.21.15.60:0/4068080833 >> v2:172.21.15.144:3300/0 conn(0x7f97300abeb0 0x7f97300c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 -- 172.21.15.60:0/4068080833 >> 172.21.15.60:0/4068080833 conn(0x7f9730067660 msgr2=0x7f9730067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:46.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 -- 172.21.15.60:0/4068080833 shutdown_connections 2023-10-08T16:11:46.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.858+0000 7f9734ae6700 1 -- 172.21.15.60:0/4068080833 wait complete. 2023-10-08T16:11:46.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 Processor -- start 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 -- start start 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 0x7f9730158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97300abeb0 0x7f97300cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300c8400 0x7f97300aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300c03e0 con 0x7f97300abae0 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300ca4e0 con 0x7f97300abeb0 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.859+0000 7f9734ae6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300ca780 con 0x7f97300c8400 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 0x7f9730158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 0x7f9730158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39386/0 (socket says 172.21.15.60:39386) 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 -- 172.21.15.60:0/955026799 learned_addr learned my addr 172.21.15.60:0/955026799 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972dd9b700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97300abeb0 0x7f97300cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972ed9d700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300c8400 0x7f97300aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 -- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300c8400 msgr2=0x7f97300aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300c8400 0x7f97300aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 -- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97300abeb0 msgr2=0x7f97300cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97300abeb0 0x7f97300cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 -- 172.21.15.60:0/955026799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972000bcf0 con 0x7f97300abae0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f972e59c700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 0x7f9730158ac0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f972800c830 tx=0x7f9728008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728011600 con 0x7f97300abae0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728011760 con 0x7f97300abae0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97300caa60 con 0x7f97300abae0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728011b20 con 0x7f97300abae0 2023-10-08T16:11:46.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.860+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300ccfe0 con 0x7f97300abae0 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.861+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97300cb070 con 0x7f97300abae0 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.862+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f972800a3f0 con 0x7f97300abae0 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.862+0000 7f97267fc700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9710066f30 0x7f97100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.862+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97280845c0 con 0x7f97300abae0 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.862+0000 7f972dd9b700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9710066f30 0x7f97100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.862+0000 7f972dd9b700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9710066f30 0x7f97100693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9730159200 tx=0x7f9718008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:46.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:46.866+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9728051830 con 0x7f97300abae0 2023-10-08T16:11:47.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.104+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9730159000 con 0x7f97300abae0 2023-10-08T16:11:47.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.104+0000 7f97267fc700 1 -- 172.21.15.60:0/955026799 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f9728054e50 con 0x7f97300abae0 2023-10-08T16:11:47.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:47.105 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:47.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9710066f30 msgr2=0x7f97100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9710066f30 0x7f97100693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9730159200 tx=0x7f9718008040 comp rx=0 tx=0).stop 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 msgr2=0x7f9730158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 0x7f9730158ac0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f972800c830 tx=0x7f9728008040 comp rx=0 tx=0).stop 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 shutdown_connections 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9710066f30 0x7f97100693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97300c8400 0x7f97300aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97300abae0 0x7f9730158ac0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 --2- 172.21.15.60:0/955026799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97300abeb0 0x7f97300cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 >> 172.21.15.60:0/955026799 conn(0x7f9730067660 msgr2=0x7f97300ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 shutdown_connections 2023-10-08T16:11:47.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.106+0000 7f9734ae6700 1 -- 172.21.15.60:0/955026799 wait complete. 2023-10-08T16:11:47.108 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:47.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:47.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.237+0000 7f5039a7e700 1 Processor -- start 2023-10-08T16:11:47.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.237+0000 7f5039a7e700 1 -- start start 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5039a7e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5034159e10 0x7f50340b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5039a7e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50340cde50 0x7f50340b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5039a7e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415db80 con 0x7f503415a1e0 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5039a7e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503415e800 con 0x7f5034159e10 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5039a7e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503415de60 con 0x7f50340cde50 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50337fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5034159e10 0x7f50340b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5032ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f503415a1e0 0x7f50340cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48308/0 (socket says 172.21.15.60:48308) 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5032ffd700 1 -- 172.21.15.60:0/1567859812 learned_addr learned my addr 172.21.15.60:0/1567859812 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f5033fff700 1 --2- 172.21.15.60:0/1567859812 >> v2:172.21.15.144:3300/0 conn(0x7f50340cde50 0x7f50340b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50337fe700 1 -- 172.21.15.60:0/1567859812 >> v2:172.21.15.144:3300/0 conn(0x7f50340cde50 msgr2=0x7f50340b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:47.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50337fe700 1 --2- 172.21.15.60:0/1567859812 >> v2:172.21.15.144:3300/0 conn(0x7f50340cde50 0x7f50340b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50337fe700 1 -- 172.21.15.60:0/1567859812 >> v1:172.21.15.60:6789/0 conn(0x7f503415a1e0 legacy=0x7f50340cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50337fe700 1 -- 172.21.15.60:0/1567859812 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503415e140 con 0x7f5034159e10 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50327fc700 1 -- 172.21.15.60:0/1567859812 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614903701 0 0) 0x7f503415db80 con 0x7f503415a1e0 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50337fe700 1 --2- 172.21.15.60:0/1567859812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5034159e10 0x7f50340b2d20 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f50340685b0 tx=0x7f50240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d673502eff60a70c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.238+0000 7f50327fc700 1 -- 172.21.15.60:0/1567859812 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502400b6b0 con 0x7f5034159e10 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f50327fc700 1 -- 172.21.15.60:0/1567859812 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502400b810 con 0x7f5034159e10 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f50327fc700 1 -- 172.21.15.60:0/1567859812 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502400bbb0 con 0x7f5034159e10 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 -- 172.21.15.60:0/1567859812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5034159e10 msgr2=0x7f50340b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1567859812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5034159e10 0x7f50340b2d20 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f50340685b0 tx=0x7f50240091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 -- 172.21.15.60:0/1567859812 shutdown_connections 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1567859812 >> v2:172.21.15.144:3300/0 conn(0x7f50340cde50 0x7f50340b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1567859812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5034159e10 0x7f50340b2d20 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 -- 172.21.15.60:0/1567859812 >> 172.21.15.60:0/1567859812 conn(0x7f5034067660 msgr2=0x7f5034067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 -- 172.21.15.60:0/1567859812 shutdown_connections 2023-10-08T16:11:47.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.239+0000 7f5039a7e700 1 -- 172.21.15.60:0/1567859812 wait complete. 2023-10-08T16:11:47.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.240+0000 7f5039a7e700 1 Processor -- start 2023-10-08T16:11:47.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.240+0000 7f5039a7e700 1 -- start start 2023-10-08T16:11:47.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5039a7e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 0x7f50340c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5039a7e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5034159e10 0x7f5034149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5039a7e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f503415a1e0 0x7f50340c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5039a7e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c7d50 con 0x7f50340cde50 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5039a7e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340ca440 con 0x7f5034159e10 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5039a7e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c7fa0 con 0x7f503415a1e0 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f50337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 0x7f50340c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f50337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 0x7f50340c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39394/0 (socket says 172.21.15.60:39394) 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f50337fe700 1 -- 172.21.15.60:0/1866748038 learned_addr learned my addr 172.21.15.60:0/1866748038 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5032ffd700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5034159e10 0x7f5034149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.241+0000 7f5033fff700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f503415a1e0 0x7f50340c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f50337fe700 1 -- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f503415a1e0 msgr2=0x7f50340c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f50337fe700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f503415a1e0 0x7f50340c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f50337fe700 1 -- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5034159e10 msgr2=0x7f5034149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f50337fe700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5034159e10 0x7f5034149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f50337fe700 1 -- 172.21.15.60:0/1866748038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024009420 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f50337fe700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 0x7f50340c8a80 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f50240091e0 tx=0x7f5024017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502400b980 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502400bae0 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340c8280 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024011670 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.242+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503414a520 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.243+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340c87a0 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.243+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5024011aa0 con 0x7f50340cde50 2023-10-08T16:11:47.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.244+0000 7f501b7fe700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5020066f30 0x7f50200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.244+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5024085de0 con 0x7f50340cde50 2023-10-08T16:11:47.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.244+0000 7f5032ffd700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5020066f30 0x7f50200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.244+0000 7f5032ffd700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5020066f30 0x7f50200693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5034158f10 tx=0x7f5028007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.248+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50340c87a0 con 0x7f50340cde50 2023-10-08T16:11:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.443+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50340c87a0 con 0x7f50340cde50 2023-10-08T16:11:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.443+0000 7f501b7fe700 1 -- 172.21.15.60:0/1866748038 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f50340c87a0 con 0x7f50340cde50 2023-10-08T16:11:47.444 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:47.444 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":135,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:38.352002+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:11:12.441833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:11:12.936737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:47.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5020066f30 msgr2=0x7f50200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5020066f30 0x7f50200693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5034158f10 tx=0x7f5028007f50 comp rx=0 tx=0).stop 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 msgr2=0x7f50340c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 0x7f50340c8a80 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f50240091e0 tx=0x7f5024017000 comp rx=0 tx=0).stop 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 shutdown_connections 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5020066f30 0x7f50200693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f503415a1e0 0x7f50340c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50340cde50 0x7f50340c8a80 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 --2- 172.21.15.60:0/1866748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5034159e10 0x7f5034149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 >> 172.21.15.60:0/1866748038 conn(0x7f5034067660 msgr2=0x7f5034159180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 shutdown_connections 2023-10-08T16:11:47.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.446+0000 7f5039a7e700 1 -- 172.21.15.60:0/1866748038 wait complete. 2023-10-08T16:11:47.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:11:47.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:47.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.577+0000 7fc74c670700 1 Processor -- start 2023-10-08T16:11:47.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.577+0000 7fc74c670700 1 -- start start 2023-10-08T16:11:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.578+0000 7fc74c670700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc744067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.578+0000 7fc74c670700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7440cc660 con 0x7fc74415e770 2023-10-08T16:11:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.578+0000 7fc74c670700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7440ccf00 con 0x7fc744159e30 2023-10-08T16:11:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.578+0000 7fc74c670700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc744068ec0 con 0x7fc74415e2d0 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.578+0000 7fc74ac0d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc74415e770 0x7fc744067ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48322/0 (socket says 172.21.15.60:48322) 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.578+0000 7fc74ac0d700 1 -- 172.21.15.60:0/2225571746 learned_addr learned my addr 172.21.15.60:0/2225571746 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc749c0b700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc744067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866460557 0 0) 0x7fc7440cc660 con 0x7fc74415e770 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72c003570 con 0x7fc74415e770 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 587105380 0 0) 0x7fc72c003570 con 0x7fc74415e770 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 msgr2=0x7fc744067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc744067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 >> v1:172.21.15.144:6789/0 conn(0x7fc744159e30 legacy=0x7fc74415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440cc8b0 con 0x7fc74415e770 2023-10-08T16:11:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fc734001470 con 0x7fc74415e770 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 >> v1:172.21.15.60:6789/0 conn(0x7fc74415e770 legacy=0x7fc744067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc72c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc72c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744068ec0 con 0x7fc72c003a90 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c00bb60 con 0x7fc72c004810 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c00bd20 con 0x7fc74415e2d0 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74a40c700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc72c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc749c0b700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74ac0d700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc72c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74a40c700 1 -- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 msgr2=0x7fc72c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74a40c700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc72c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74a40c700 1 -- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc72c004810 msgr2=0x7fc72c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74a40c700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74a40c700 1 -- 172.21.15.60:0/2225571746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c003570 con 0x7fc72c003a90 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.579+0000 7fc74ac0d700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74415e2d0 0x7fc72c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74a40c700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc72c003ea0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc73c001fc0 tx=0x7fc73c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4762482bed59b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c001950 con 0x7fc72c003a90 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00c8b0 con 0x7fc72c003a90 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74940a700 1 -- 172.21.15.60:0/2225571746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00cc50 con 0x7fc72c003a90 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74c670700 1 -- 172.21.15.60:0/2225571746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 msgr2=0x7fc72c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74c670700 1 --2- 172.21.15.60:0/2225571746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc72c003ea0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc73c001fc0 tx=0x7fc73c001640 comp rx=0 tx=0).stop 2023-10-08T16:11:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74ac0d700 1 -- 172.21.15.60:0/2225571746 reap_dead start 2023-10-08T16:11:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74c670700 1 -- 172.21.15.60:0/2225571746 shutdown_connections 2023-10-08T16:11:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74c670700 1 -- 172.21.15.60:0/2225571746 >> 172.21.15.60:0/2225571746 conn(0x7fc74406a310 msgr2=0x7fc7440cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74c670700 1 -- 172.21.15.60:0/2225571746 shutdown_connections 2023-10-08T16:11:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.580+0000 7fc74c670700 1 -- 172.21.15.60:0/2225571746 wait complete. 2023-10-08T16:11:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.581+0000 7fc74c670700 1 Processor -- start 2023-10-08T16:11:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 -- start start 2023-10-08T16:11:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc744148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c7cb0 0x7fc7441464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74414b870 0x7fc74416d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744146a10 con 0x7fc72c003a90 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440c8120 con 0x7fc7440c7cb0 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74c670700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc744146c00 con 0x7fc74414b870 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74a40c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc744148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74a40c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc744148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39420/0 (socket says 172.21.15.60:39420) 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74a40c700 1 -- 172.21.15.60:0/4016680957 learned_addr learned my addr 172.21.15.60:0/4016680957 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc749c0b700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c7cb0 0x7fc7441464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.582+0000 7fc74ac0d700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74414b870 0x7fc74416d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74a40c700 1 -- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74414b870 msgr2=0x7fc74416d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74a40c700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74414b870 0x7fc74416d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74a40c700 1 -- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c7cb0 msgr2=0x7fc7441464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74a40c700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c7cb0 0x7fc7441464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74a40c700 1 -- 172.21.15.60:0/4016680957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744146ee0 con 0x7fc72c003a90 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74a40c700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc744148fc0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc73c012fc0 tx=0x7fc73c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00ca20 con 0x7fc72c003a90 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00cbc0 con 0x7fc72c003a90 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c01f660 con 0x7fc72c003a90 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7441471c0 con 0x7fc72c003a90 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.583+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744147780 con 0x7fc72c003a90 2023-10-08T16:11:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.584+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74404c3c0 con 0x7fc72c003a90 2023-10-08T16:11:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.584+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc73c01f9d0 con 0x7fc72c003a90 2023-10-08T16:11:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.585+0000 7fc7427fc700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc730066f30 0x7fc7300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.585+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc73c0864d0 con 0x7fc72c003a90 2023-10-08T16:11:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.585+0000 7fc749c0b700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc730066f30 0x7fc7300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.585+0000 7fc749c0b700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc730066f30 0x7fc7300693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc738006dc0 tx=0x7fc738008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.589+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc73c053740 con 0x7fc72c003a90 2023-10-08T16:11:47.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.826+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7440b18e0 con 0x7fc72c003a90 2023-10-08T16:11:47.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.826+0000 7fc7427fc700 1 -- 172.21.15.60:0/4016680957 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fc73c056d60 con 0x7fc72c003a90 2023-10-08T16:11:47.827 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:47.827 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc730066f30 msgr2=0x7fc7300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc730066f30 0x7fc7300693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc738006dc0 tx=0x7fc738008040 comp rx=0 tx=0).stop 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 msgr2=0x7fc744148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc744148fc0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc73c012fc0 tx=0x7fc73c015000 comp rx=0 tx=0).stop 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 shutdown_connections 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc730066f30 0x7fc7300693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74414b870 0x7fc74416d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc72c003a90 0x7fc744148fc0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 --2- 172.21.15.60:0/4016680957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c7cb0 0x7fc7441464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 >> 172.21.15.60:0/4016680957 conn(0x7fc74406a310 msgr2=0x7fc74406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:47.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 shutdown_connections 2023-10-08T16:11:47.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.828+0000 7fc74c670700 1 -- 172.21.15.60:0/4016680957 wait complete. 2023-10-08T16:11:47.830 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:47.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:47.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.959+0000 7f4c75db8700 1 Processor -- start 2023-10-08T16:11:47.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.959+0000 7f4c75db8700 1 -- start start 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c75db8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c70159cf0 0x7f4c7015e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c75db8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c7015a0c0 0x7f4c700ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c75db8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c700ce1a0 0x7f4c700ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c75db8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c700cca20 con 0x7f4c700ce1a0 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c75db8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7015ea40 con 0x7f4c7015a0c0 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c75db8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70067660 con 0x7f4c70159cf0 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c700ce1a0 0x7f4c700ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c700ce1a0 0x7f4c700ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39428/0 (socket says 172.21.15.60:39428) 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 -- 172.21.15.60:0/3059662612 learned_addr learned my addr 172.21.15.60:0/3059662612 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6f7fe700 1 --2- 172.21.15.60:0/3059662612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c70159cf0 0x7f4c7015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6effd700 1 --2- 172.21.15.60:0/3059662612 >> v2:172.21.15.144:3300/0 conn(0x7f4c7015a0c0 0x7f4c700ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 -- 172.21.15.60:0/3059662612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c70159cf0 msgr2=0x7f4c7015e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 --2- 172.21.15.60:0/3059662612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c70159cf0 0x7f4c7015e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 -- 172.21.15.60:0/3059662612 >> v2:172.21.15.144:3300/0 conn(0x7f4c7015a0c0 msgr2=0x7f4c700ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 --2- 172.21.15.60:0/3059662612 >> v2:172.21.15.144:3300/0 conn(0x7f4c7015a0c0 0x7f4c700ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 -- 172.21.15.60:0/3059662612 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c70067f00 con 0x7f4c700ce1a0 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.960+0000 7f4c6ffff700 1 --2- 172.21.15.60:0/3059662612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c700ce1a0 0x7f4c700ceff0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006efc0 tx=0x7f4c68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd7735fec553dcd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c6e7fc700 1 -- 172.21.15.60:0/3059662612 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800e070 con 0x7f4c700ce1a0 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c6e7fc700 1 -- 172.21.15.60:0/3059662612 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6800ba50 con 0x7f4c700ce1a0 2023-10-08T16:11:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c6e7fc700 1 -- 172.21.15.60:0/3059662612 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680092e0 con 0x7f4c700ce1a0 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 -- 172.21.15.60:0/3059662612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c700ce1a0 msgr2=0x7f4c700ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 --2- 172.21.15.60:0/3059662612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c700ce1a0 0x7f4c700ceff0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006efc0 tx=0x7f4c68009840 comp rx=0 tx=0).stop 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 -- 172.21.15.60:0/3059662612 shutdown_connections 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 --2- 172.21.15.60:0/3059662612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c700ce1a0 0x7f4c700ceff0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 --2- 172.21.15.60:0/3059662612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c70159cf0 0x7f4c7015e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 --2- 172.21.15.60:0/3059662612 >> v2:172.21.15.144:3300/0 conn(0x7f4c7015a0c0 0x7f4c700ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 -- 172.21.15.60:0/3059662612 >> 172.21.15.60:0/3059662612 conn(0x7f4c7006c6e0 msgr2=0x7f4c70069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 -- 172.21.15.60:0/3059662612 shutdown_connections 2023-10-08T16:11:47.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.961+0000 7f4c75db8700 1 -- 172.21.15.60:0/3059662612 wait complete. 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.962+0000 7f4c75db8700 1 Processor -- start 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.962+0000 7f4c75db8700 1 -- start start 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c75db8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c700ce1a0 0x7f4c701521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c75db8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 0x7f4c700b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c75db8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c7015a0c0 0x7f4c700c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c75db8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70152000 con 0x7f4c70159cf0 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c75db8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700c6670 con 0x7f4c700ce1a0 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c75db8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700c68e0 con 0x7f4c7015a0c0 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 0x7f4c700b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 0x7f4c700b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39440/0 (socket says 172.21.15.60:39440) 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6effd700 1 -- 172.21.15.60:0/889653317 learned_addr learned my addr 172.21.15.60:0/889653317 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6f7fe700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c700ce1a0 0x7f4c701521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6ffff700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c7015a0c0 0x7f4c700c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6effd700 1 -- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c7015a0c0 msgr2=0x7f4c700c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6effd700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c7015a0c0 0x7f4c700c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.963+0000 7f4c6effd700 1 -- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c700ce1a0 msgr2=0x7f4c701521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c6effd700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c700ce1a0 0x7f4c701521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c6effd700 1 -- 172.21.15.60:0/889653317 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009ae0 con 0x7f4c70159cf0 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c6effd700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 0x7f4c700b1100 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400d860 tx=0x7f4c64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64012630 con 0x7f4c70159cf0 2023-10-08T16:11:47.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64012790 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c700c6bc0 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64012b50 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.964+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c700c6100 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.965+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7004c3c0 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.965+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c6401d400 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.966+0000 7f4c577fe700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4c5c066f30 0x7f4c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.966+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c64084940 con 0x7f4c70159cf0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.966+0000 7f4c6f7fe700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4c5c066f30 0x7f4c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:47.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.966+0000 7f4c6f7fe700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4c5c066f30 0x7f4c5c0693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006fd0 tx=0x7f4c60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:47.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:47.970+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c64051bb0 con 0x7f4c70159cf0 2023-10-08T16:11:48.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.206+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c700ce730 con 0x7f4c70159cf0 2023-10-08T16:11:48.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.206+0000 7f4c577fe700 1 -- 172.21.15.60:0/889653317 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4c640551d0 con 0x7f4c70159cf0 2023-10-08T16:11:48.207 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:48.207 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:11:13.973264+0000","modified":"2023-10-08T16:11:17.599185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3605425710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3605425710},{"type":"v1","addr":"172.21.15.144:6835","nonce":3605425710}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:11:48.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4c5c066f30 msgr2=0x7f4c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4c5c066f30 0x7f4c5c0693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006fd0 tx=0x7f4c60008040 comp rx=0 tx=0).stop 2023-10-08T16:11:48.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 msgr2=0x7f4c700b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 0x7f4c700b1100 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400d860 tx=0x7f4c64008040 comp rx=0 tx=0).stop 2023-10-08T16:11:48.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 shutdown_connections 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4c5c066f30 0x7f4c5c0693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c7015a0c0 0x7f4c700c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c700ce1a0 0x7f4c701521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 --2- 172.21.15.60:0/889653317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c70159cf0 0x7f4c700b1100 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.208+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 >> 172.21.15.60:0/889653317 conn(0x7f4c7006c6e0 msgr2=0x7f4c700c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.209+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 shutdown_connections 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.209+0000 7f4c75db8700 1 -- 172.21.15.60:0/889653317 wait complete. 2023-10-08T16:11:48.210 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 68 2023-10-08T16:11:48.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:11:48.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.341+0000 7f49aa5c8700 1 Processor -- start 2023-10-08T16:11:48.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.341+0000 7f49aa5c8700 1 -- start start 2023-10-08T16:11:48.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49aa5c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157c40 0x7f49a4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49aa5c8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a415cbb0 con 0x7f49a4157870 2023-10-08T16:11:48.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49aa5c8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a415bfa0 con 0x7f49a415a620 2023-10-08T16:11:48.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49aa5c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a415bdb0 con 0x7f49a4157c40 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f49a4157870 0x7f49a415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48338/0 (socket says 172.21.15.60:48338) 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a3fff700 1 -- 172.21.15.60:0/640815993 learned_addr learned my addr 172.21.15.60:0/640815993 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a8b65700 1 --2- 172.21.15.60:0/640815993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157c40 0x7f49a4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875283192 0 0) 0x7f49a415cbb0 con 0x7f49a4157870 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c003570 con 0x7f49a4157870 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331802785 0 0) 0x7f49a415bfa0 con 0x7f49a415a620 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a415cbb0 con 0x7f49a415a620 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a8b65700 1 -- 172.21.15.60:0/640815993 >> v1:172.21.15.144:6789/0 conn(0x7f49a415a620 legacy=0x7f49a415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a8b65700 1 -- 172.21.15.60:0/640815993 >> v1:172.21.15.60:6789/0 conn(0x7f49a4157870 legacy=0x7f49a415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a8b65700 1 -- 172.21.15.60:0/640815993 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a415c280 con 0x7f49a4157c40 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.342+0000 7f49a8b65700 1 --2- 172.21.15.60:0/640815993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157c40 0x7f49a4158110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f499c009e90 tx=0x7f499c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ce3bf3244c6932 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c00e070 con 0x7f49a4157c40 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c00bb80 con 0x7f49a4157c40 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49a2ffd700 1 -- 172.21.15.60:0/640815993 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c012430 con 0x7f49a4157c40 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 -- 172.21.15.60:0/640815993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157c40 msgr2=0x7f49a4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/640815993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157c40 0x7f49a4158110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f499c009e90 tx=0x7f499c009780 comp rx=0 tx=0).stop 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 -- 172.21.15.60:0/640815993 shutdown_connections 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/640815993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157c40 0x7f49a4158110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 -- 172.21.15.60:0/640815993 >> 172.21.15.60:0/640815993 conn(0x7f49a4068ce0 msgr2=0x7f49a40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 -- 172.21.15.60:0/640815993 shutdown_connections 2023-10-08T16:11:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.343+0000 7f49aa5c8700 1 -- 172.21.15.60:0/640815993 wait complete. 2023-10-08T16:11:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.344+0000 7f49aa5c8700 1 Processor -- start 2023-10-08T16:11:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.344+0000 7f49aa5c8700 1 -- start start 2023-10-08T16:11:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49aa5c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157870 0x7f49a4155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49aa5c8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a4157c40 0x7f49a415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49aa5c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 0x7f49a415f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49aa5c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a415e510 con 0x7f49a415a620 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49aa5c8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40aaa70 con 0x7f49a4157c40 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49aa5c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a415fcc0 con 0x7f49a4157870 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49a8b65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 0x7f49a415f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49a8b65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 0x7f49a415f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39450/0 (socket says 172.21.15.60:39450) 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49a8b65700 1 -- 172.21.15.60:0/2320288540 learned_addr learned my addr 172.21.15.60:0/2320288540 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49a3fff700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157870 0x7f49a4155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.345+0000 7f49a37fe700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a4157c40 0x7f49a415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49a8b65700 1 -- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157870 msgr2=0x7f49a4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49a8b65700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157870 0x7f49a4155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49a8b65700 1 -- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a4157c40 msgr2=0x7f49a415f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49a8b65700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a4157c40 0x7f49a415f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49a8b65700 1 -- 172.21.15.60:0/2320288540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009a20 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49a8b65700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 0x7f49a415f620 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f499c013000 tx=0x7f499c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c01b420 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c01b5a0 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a415ffa0 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c01b960 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.346+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a4160560 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.347+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a40aa8b0 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.347+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f499c01bd50 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.348+0000 7f498bfff700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4990066f30 0x7f49900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.348+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f499c0861c0 con 0x7f49a415a620 2023-10-08T16:11:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.348+0000 7f49a3fff700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4990066f30 0x7f49900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.348+0000 7f49a3fff700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4990066f30 0x7f49900693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4994007fd0 tx=0x7f4994009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.352+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49a40aa8b0 con 0x7f49a415a620 2023-10-08T16:11:48.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.548+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49a40aa8b0 con 0x7f49a415a620 2023-10-08T16:11:48.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.549+0000 7f498bfff700 1 -- 172.21.15.60:0/2320288540 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+15391 (secure 0 0 0) 0x7f49a40aa8b0 con 0x7f49a415a620 2023-10-08T16:11:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:48.550 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":136,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:11:48.353726+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:11:12.441833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:11:12.936737+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:11:48.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.551+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4990066f30 msgr2=0x7f49900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4990066f30 0x7f49900693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4994007fd0 tx=0x7f4994009040 comp rx=0 tx=0).stop 2023-10-08T16:11:48.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 msgr2=0x7f49a415f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 0x7f49a415f620 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f499c013000 tx=0x7f499c019000 comp rx=0 tx=0).stop 2023-10-08T16:11:48.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 shutdown_connections 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4990066f30 0x7f49900693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49a4157870 0x7f49a4155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49a415a620 0x7f49a415f620 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 --2- 172.21.15.60:0/2320288540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a4157c40 0x7f49a415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 >> 172.21.15.60:0/2320288540 conn(0x7f49a4068ce0 msgr2=0x7f49a40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 shutdown_connections 2023-10-08T16:11:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.552+0000 7f49aa5c8700 1 -- 172.21.15.60:0/2320288540 wait complete. 2023-10-08T16:11:48.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:11:48.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.684+0000 7f1fe31af700 1 Processor -- start 2023-10-08T16:11:48.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.684+0000 7f1fe31af700 1 -- start start 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.684+0000 7f1fe31af700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fdc15a2b0 0x7f1fdc0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe31af700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0c5d80 con 0x7f1fdc0cfe20 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe31af700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0c6060 con 0x7f1fdc0d1c30 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe31af700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc068470 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe0f4b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fdc15a2b0 0x7f1fdc0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe174c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fdc0cfe20 0x7f1fdc0c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48348/0 (socket says 172.21.15.60:48348) 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe174c700 1 -- 172.21.15.60:0/1292687905 learned_addr learned my addr 172.21.15.60:0/1292687905 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe0f4b700 1 -- 172.21.15.60:0/1292687905 >> v1:172.21.15.144:6789/0 conn(0x7f1fdc0d1c30 legacy=0x7f1fdc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe0f4b700 1 -- 172.21.15.60:0/1292687905 >> v1:172.21.15.60:6789/0 conn(0x7f1fdc0cfe20 legacy=0x7f1fdc0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe0f4b700 1 -- 172.21.15.60:0/1292687905 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0c6340 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/1292687905 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298096911 0 0) 0x7f1fdc0c5d80 con 0x7f1fdc0cfe20 2023-10-08T16:11:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fe0f4b700 1 --2- 172.21.15.60:0/1292687905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc0b3da0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40098d0 tx=0x7f1fc4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c4dd1d7011d55d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/1292687905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4009e70 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/1292687905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4005c10 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.685+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/1292687905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400b650 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 -- 172.21.15.60:0/1292687905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 msgr2=0x7f1fdc0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 --2- 172.21.15.60:0/1292687905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc0b3da0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40098d0 tx=0x7f1fc4009120 comp rx=0 tx=0).stop 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 -- 172.21.15.60:0/1292687905 shutdown_connections 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 --2- 172.21.15.60:0/1292687905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc0b3da0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 -- 172.21.15.60:0/1292687905 >> 172.21.15.60:0/1292687905 conn(0x7f1fdc067e40 msgr2=0x7f1fdc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 -- 172.21.15.60:0/1292687905 shutdown_connections 2023-10-08T16:11:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.686+0000 7f1fe31af700 1 -- 172.21.15.60:0/1292687905 wait complete. 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.687+0000 7f1fe31af700 1 Processor -- start 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.687+0000 7f1fe31af700 1 -- start start 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe31af700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fdc0cfe20 0x7f1fdc16afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe31af700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fdc0d1c30 0x7f1fdc155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe31af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc16d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe31af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc16ab50 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe31af700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0c8f20 con 0x7f1fdc0d1c30 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe31af700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc16a540 con 0x7f1fdc0cfe20 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc16d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc16d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39468/0 (socket says 172.21.15.60:39468) 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 -- 172.21.15.60:0/808899104 learned_addr learned my addr 172.21.15.60:0/808899104 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fdc0d1c30 0x7f1fdc155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe0f4b700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fdc0cfe20 0x7f1fdc16afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 -- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fdc0cfe20 msgr2=0x7f1fdc16afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fdc0cfe20 0x7f1fdc16afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 -- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fdc0d1c30 msgr2=0x7f1fdc155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fdc0d1c30 0x7f1fdc155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.688+0000 7f1fe174c700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc40093c0 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fe0f4b700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fdc0cfe20 0x7f1fdc16afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fdc0d1c30 0x7f1fdc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fe174c700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc16d9b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400cbc0 tx=0x7f1fd4001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400a940 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400aaa0 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc16e570 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400ae60 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.689+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc16e850 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.690+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc04c3c0 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.690+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fd4007300 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.691+0000 7f1fd8ff9700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fbc066f30 0x7f1fbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.691+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd40849b0 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.691+0000 7f1fe0f4b700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fbc066f30 0x7f1fbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.691+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=137}) v3 -- 0x7f1fbc06ea50 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.691+0000 7f1fe0f4b700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fbc066f30 0x7f1fbc0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009390 tx=0x7f1fc4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.695+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fd4051c00 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.934+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1fdc064a00 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.935 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:11:48.935+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:11:48.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.936+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(137..137 src has 1..137) v4 ==== 366+0+0 (secure 0 0 0) 0x7f1fd40558c0 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.936+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f1fbc06f340 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.939+0000 7f1fd8ff9700 1 -- 172.21.15.60:0/808899104 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1fd4055220 con 0x7f1fdc15a2b0 2023-10-08T16:11:48.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.941+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fbc066f30 msgr2=0x7f1fbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.941+0000 7f1fe31af700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fbc066f30 0x7f1fbc0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009390 tx=0x7f1fc4016000 comp rx=0 tx=0).stop 2023-10-08T16:11:48.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 msgr2=0x7f1fdc16d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:48.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc16d9b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400cbc0 tx=0x7f1fd4001980 comp rx=0 tx=0).stop 2023-10-08T16:11:48.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 shutdown_connections 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fbc066f30 0x7f1fbc0693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fdc0cfe20 0x7f1fdc16afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc15a2b0 0x7f1fdc16d9b0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 --2- 172.21.15.60:0/808899104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fdc0d1c30 0x7f1fdc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 >> 172.21.15.60:0/808899104 conn(0x7f1fdc067e40 msgr2=0x7f1fdc158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 shutdown_connections 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:48.942+0000 7f1fe31af700 1 -- 172.21.15.60:0/808899104 wait complete. 2023-10-08T16:11:48.943 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:11:48.945 INFO:tasks.ceph.mds.d.smithi144.stderr: -7458> 2023-10-08T16:11:19.887+0000 7f82f67c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:11:48.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:11:48.974 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:11:49.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.076+0000 7f30d3342700 1 Processor -- start 2023-10-08T16:11:49.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.076+0000 7f30d3342700 1 -- start start 2023-10-08T16:11:49.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d3342700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30cc0b4860 0x7f30cc0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:49.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d3342700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0b14f0 con 0x7f30cc0b3570 2023-10-08T16:11:49.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d3342700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0b17d0 con 0x7f30cc0b4c30 2023-10-08T16:11:49.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d3342700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0b1ab0 con 0x7f30cc0b4860 2023-10-08T16:11:49.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d10de700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30cc0b4860 0x7f30cc0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:49.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d18df700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f30cc0b3570 0x7f30cc0cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48352/0 (socket says 172.21.15.60:48352) 2023-10-08T16:11:49.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d18df700 1 -- 172.21.15.60:0/2945894651 learned_addr learned my addr 172.21.15.60:0/2945894651 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d10de700 1 -- 172.21.15.60:0/2945894651 >> v1:172.21.15.144:6789/0 conn(0x7f30cc0b4c30 legacy=0x7f30cc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d10de700 1 -- 172.21.15.60:0/2945894651 >> v1:172.21.15.60:6789/0 conn(0x7f30cc0b3570 legacy=0x7f30cc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d10de700 1 -- 172.21.15.60:0/2945894651 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0b1d90 con 0x7f30cc0b4860 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30cbfff700 1 -- 172.21.15.60:0/2945894651 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538916049 0 0) 0x7f30cc0b14f0 con 0x7f30cc0b3570 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30d10de700 1 --2- 172.21.15.60:0/2945894651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b4860 0x7f30cc0b6700 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009eb0 tx=0x7f30c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55be2f4d1b2f71ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.077+0000 7f30cbfff700 1 -- 172.21.15.60:0/2945894651 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c400e070 con 0x7f30cc0b4860 2023-10-08T16:11:49.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30cbfff700 1 -- 172.21.15.60:0/2945894651 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c400bcc0 con 0x7f30cc0b4860 2023-10-08T16:11:49.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30cbfff700 1 -- 172.21.15.60:0/2945894651 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4012680 con 0x7f30cc0b4860 2023-10-08T16:11:49.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 -- 172.21.15.60:0/2945894651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b4860 msgr2=0x7f30cc0b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 --2- 172.21.15.60:0/2945894651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b4860 0x7f30cc0b6700 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009eb0 tx=0x7f30c4009780 comp rx=0 tx=0).stop 2023-10-08T16:11:49.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 -- 172.21.15.60:0/2945894651 shutdown_connections 2023-10-08T16:11:49.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 --2- 172.21.15.60:0/2945894651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b4860 0x7f30cc0b6700 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 -- 172.21.15.60:0/2945894651 >> 172.21.15.60:0/2945894651 conn(0x7f30cc09a0f0 msgr2=0x7f30cc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:49.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 -- 172.21.15.60:0/2945894651 shutdown_connections 2023-10-08T16:11:49.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.078+0000 7f30d3342700 1 -- 172.21.15.60:0/2945894651 wait complete. 2023-10-08T16:11:49.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.079+0000 7f30d3342700 1 Processor -- start 2023-10-08T16:11:49.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.079+0000 7f30d3342700 1 -- start start 2023-10-08T16:11:49.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d3342700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 0x7f30cc1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:49.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d3342700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30cc0b4860 0x7f30cc0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:49.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d3342700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30cc0b4c30 0x7f30cc09b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:49.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d3342700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc16b720 con 0x7f30cc0b3570 2023-10-08T16:11:49.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d3342700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc148800 con 0x7f30cc0b4860 2023-10-08T16:11:49.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d3342700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0ac930 con 0x7f30cc0b4c30 2023-10-08T16:11:49.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d10de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 0x7f30cc1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:49.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d10de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 0x7f30cc1482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39488/0 (socket says 172.21.15.60:39488) 2023-10-08T16:11:49.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d10de700 1 -- 172.21.15.60:0/1554677163 learned_addr learned my addr 172.21.15.60:0/1554677163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:49.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d18df700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30cc0b4c30 0x7f30cc09b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d10de700 1 -- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30cc0b4c30 msgr2=0x7f30cc09b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.080+0000 7f30d08dd700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30cc0b4860 0x7f30cc0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d10de700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30cc0b4c30 0x7f30cc09b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d10de700 1 -- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30cc0b4860 msgr2=0x7f30cc0acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d10de700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30cc0b4860 0x7f30cc0acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d10de700 1 -- 172.21.15.60:0/1554677163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009a20 con 0x7f30cc0b3570 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d18df700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30cc0b4c30 0x7f30cc09b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d10de700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 0x7f30cc1482c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f30c400b6c0 tx=0x7f30c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4012e20 con 0x7f30cc0b3570 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c401b630 con 0x7f30cc0b3570 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc0ac000 con 0x7f30cc0b3570 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c401b9f0 con 0x7f30cc0b3570 2023-10-08T16:11:49.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.081+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc0ac5c0 con 0x7f30cc0b3570 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.082+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0acc10 con 0x7f30cc0b3570 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.082+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30c401c400 con 0x7f30cc0b3570 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.083+0000 7f30c97fa700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f30b8066f30 0x7f30b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.083+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f30c40865a0 con 0x7f30cc0b3570 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.083+0000 7f30d08dd700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f30b8066f30 0x7f30b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.083+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f30b806eaf0 con 0x7f30cc0b3570 2023-10-08T16:11:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.083+0000 7f30d08dd700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f30b8066f30 0x7f30b80693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f30c00016f0 tx=0x7f30c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:49.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.087+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30c4053720 con 0x7f30cc0b3570 2023-10-08T16:11:49.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.326+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f30cc04c3c0 con 0x7f30cc0b3570 2023-10-08T16:11:49.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.939+0000 7f30c97fa700 1 -- 172.21.15.60:0/1554677163 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f30c402a070 con 0x7f30cc0b3570 2023-10-08T16:11:49.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f30b8066f30 msgr2=0x7f30b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f30b8066f30 0x7f30b80693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f30c00016f0 tx=0x7f30c0009040 comp rx=0 tx=0).stop 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 msgr2=0x7f30cc1482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 0x7f30cc1482c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f30c400b6c0 tx=0x7f30c4017000 comp rx=0 tx=0).stop 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 shutdown_connections 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f30b8066f30 0x7f30b80693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30cc0b4c30 0x7f30cc09b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0b3570 0x7f30cc1482c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 --2- 172.21.15.60:0/1554677163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30cc0b4860 0x7f30cc0acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:49.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 >> 172.21.15.60:0/1554677163 conn(0x7f30cc09a0f0 msgr2=0x7f30cc15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:49.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 shutdown_connections 2023-10-08T16:11:49.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:49.942+0000 7f30d3342700 1 -- 172.21.15.60:0/1554677163 wait complete. 2023-10-08T16:11:49.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:11:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.081+0000 7f42ba917700 1 Processor -- start 2023-10-08T16:11:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.081+0000 7f42ba917700 1 -- start start 2023-10-08T16:11:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42ba917700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42b4067c80 0x7f42b41573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42ba917700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b415e720 con 0x7f42b41578f0 2023-10-08T16:11:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42ba917700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b415b2f0 con 0x7f42b40678b0 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42ba917700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b415db10 con 0x7f42b4067c80 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42b4067c80 0x7f42b41573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b8eb4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f42b41578f0 0x7f42b40af6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48368/0 (socket says 172.21.15.60:48368) 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b8eb4700 1 -- 172.21.15.60:0/2984365747 learned_addr learned my addr 172.21.15.60:0/2984365747 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b37fe700 1 -- 172.21.15.60:0/2984365747 >> v1:172.21.15.144:6789/0 conn(0x7f42b40678b0 legacy=0x7f42b40cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b37fe700 1 -- 172.21.15.60:0/2984365747 >> v1:172.21.15.60:6789/0 conn(0x7f42b41578f0 legacy=0x7f42b40af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b37fe700 1 -- 172.21.15.60:0/2984365747 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b415ddf0 con 0x7f42b4067c80 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b37fe700 1 --2- 172.21.15.60:0/2984365747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b4067c80 0x7f42b41573b0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f42a80098e0 tx=0x7f42a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38a02f0c5699624 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b2ffd700 1 -- 172.21.15.60:0/2984365747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8009e80 con 0x7f42b4067c80 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.082+0000 7f42b2ffd700 1 -- 172.21.15.60:0/2984365747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800b820 con 0x7f42b4067c80 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42b2ffd700 1 -- 172.21.15.60:0/2984365747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a800bba0 con 0x7f42b4067c80 2023-10-08T16:11:50.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 -- 172.21.15.60:0/2984365747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b4067c80 msgr2=0x7f42b41573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:50.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 --2- 172.21.15.60:0/2984365747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b4067c80 0x7f42b41573b0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f42a80098e0 tx=0x7f42a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 -- 172.21.15.60:0/2984365747 shutdown_connections 2023-10-08T16:11:50.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 --2- 172.21.15.60:0/2984365747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b4067c80 0x7f42b41573b0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 -- 172.21.15.60:0/2984365747 >> 172.21.15.60:0/2984365747 conn(0x7f42b40d0dc0 msgr2=0x7f42b40d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:50.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 -- 172.21.15.60:0/2984365747 shutdown_connections 2023-10-08T16:11:50.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.083+0000 7f42ba917700 1 -- 172.21.15.60:0/2984365747 wait complete. 2023-10-08T16:11:50.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.084+0000 7f42ba917700 1 Processor -- start 2023-10-08T16:11:50.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.084+0000 7f42ba917700 1 -- start start 2023-10-08T16:11:50.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42ba917700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b40678b0 0x7f42b4145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:50.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42ba917700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b4067c80 0x7f42b415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:50.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42ba917700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 0x7f42b4154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42ba917700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4153460 con 0x7f42b41578f0 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42ba917700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4145d70 con 0x7f42b40678b0 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42ba917700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4152870 con 0x7f42b4067c80 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 0x7f42b4154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 0x7f42b4154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39510/0 (socket says 172.21.15.60:39510) 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 -- 172.21.15.60:0/2788604964 learned_addr learned my addr 172.21.15.60:0/2788604964 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b3fff700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b40678b0 0x7f42b4145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b37fe700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b4067c80 0x7f42b415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 -- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b4067c80 msgr2=0x7f42b415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b4067c80 0x7f42b415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 -- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b40678b0 msgr2=0x7f42b4145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b40678b0 0x7f42b4145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b8eb4700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8009420 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.085+0000 7f42b3fff700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b40678b0 0x7f42b4145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.086+0000 7f42b8eb4700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 0x7f42b4154cc0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00cbf0 tx=0x7f42ac0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.086+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00a980 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.086+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00aae0 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.086+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b4152b30 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.086+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00ae60 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.086+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b41530f0 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.087+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b41535d0 con 0x7f42b41578f0 2023-10-08T16:11:50.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.087+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42ac007300 con 0x7f42b41578f0 2023-10-08T16:11:50.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.088+0000 7f429bfff700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:50.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.088+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f42ac084900 con 0x7f42b41578f0 2023-10-08T16:11:50.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.088+0000 7f42b3fff700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:50.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.088+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f42a006eaf0 con 0x7f42b41578f0 2023-10-08T16:11:50.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.088+0000 7f42b3fff700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f42a0066f30 0x7f42a00693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f42a4007fd0 tx=0x7f42a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:50.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.092+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42ac051ba0 con 0x7f42b41578f0 2023-10-08T16:11:50.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.282+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42b404c3c0 con 0x7f42b41578f0 2023-10-08T16:11:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.939+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(138..138 src has 1..138) v4 ==== 346+0+0 (secure 0 0 0) 0x7f42ac055f60 con 0x7f42b41578f0 2023-10-08T16:11:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.939+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f42a006cf20 con 0x7f42b41578f0 2023-10-08T16:11:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.941+0000 7f429bfff700 1 -- 172.21.15.60:0/2788604964 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) v1 ==== 181+0+0 (secure 0 0 0) 0x7f42ac0551c0 con 0x7f42b41578f0 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f42a0066f30 msgr2=0x7f42a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f42a0066f30 0x7f42a00693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f42a4007fd0 tx=0x7f42a4009040 comp rx=0 tx=0).stop 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 msgr2=0x7f42b4154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 0x7f42b4154cc0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00cbf0 tx=0x7f42ac0019c0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 shutdown_connections 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b41578f0 0x7f42b4154cc0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b40678b0 0x7f42b4145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 --2- 172.21.15.60:0/2788604964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b4067c80 0x7f42b415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 >> 172.21.15.60:0/2788604964 conn(0x7f42b40d0dc0 msgr2=0x7f42b40c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 shutdown_connections 2023-10-08T16:11:50.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:50.951+0000 7f42ba917700 1 -- 172.21.15.60:0/2788604964 wait complete. 2023-10-08T16:11:50.953 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:11:50.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:11:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.090+0000 7f135981e700 1 Processor -- start 2023-10-08T16:11:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.090+0000 7f135981e700 1 -- start start 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.090+0000 7f135981e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1354159f00 0x7f13540ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f135981e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13540c9b00 0x7f13540cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f135981e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540abc00 con 0x7f135415a2d0 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f135981e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540af530 con 0x7f13540c9b00 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f135981e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540c72f0 con 0x7f1354159f00 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13540c9b00 0x7f13540cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13540c9b00 0x7f13540cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39524/0 (socket says 172.21.15.60:39524) 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 -- 172.21.15.60:0/2241185620 learned_addr learned my addr 172.21.15.60:0/2241185620 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f1352ffd700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1354159f00 0x7f13540ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 -- 172.21.15.60:0/2241185620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1354159f00 msgr2=0x7f13540ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1354159f00 0x7f13540ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 -- 172.21.15.60:0/2241185620 >> v1:172.21.15.144:6789/0 conn(0x7f135415a2d0 legacy=0x7f135415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 -- 172.21.15.60:0/2241185620 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540c6fc0 con 0x7f13540c9b00 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f1352ffd700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1354159f00 0x7f13540ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f13527fc700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13540c9b00 0x7f13540cb990 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f133c0099b0 tx=0x7f133c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8748983cc0e54d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f1351ffb700 1 -- 172.21.15.60:0/2241185620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00b860 con 0x7f13540c9b00 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f1351ffb700 1 -- 172.21.15.60:0/2241185620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00b9c0 con 0x7f13540c9b00 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.091+0000 7f1351ffb700 1 -- 172.21.15.60:0/2241185620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00bd60 con 0x7f13540c9b00 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 -- 172.21.15.60:0/2241185620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13540c9b00 msgr2=0x7f13540cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13540c9b00 0x7f13540cb990 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f133c0099b0 tx=0x7f133c009250 comp rx=0 tx=0).stop 2023-10-08T16:11:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 -- 172.21.15.60:0/2241185620 shutdown_connections 2023-10-08T16:11:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1354159f00 0x7f13540ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 --2- 172.21.15.60:0/2241185620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13540c9b00 0x7f13540cb990 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 -- 172.21.15.60:0/2241185620 >> 172.21.15.60:0/2241185620 conn(0x7f13540cd450 msgr2=0x7f13540c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 -- 172.21.15.60:0/2241185620 shutdown_connections 2023-10-08T16:11:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.092+0000 7f135981e700 1 -- 172.21.15.60:0/2241185620 wait complete. 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.093+0000 7f135981e700 1 Processor -- start 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.093+0000 7f135981e700 1 -- start start 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f135981e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13540c9b00 0x7f1354154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f135981e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 0x7f13541530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f135981e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f135415a2d0 0x7f13540add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f135981e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354169a40 con 0x7f1354159f00 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f135981e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135416a8a0 con 0x7f13540c9b00 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f135981e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1354157890 con 0x7f135415a2d0 2023-10-08T16:11:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 0x7f13541530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 0x7f13541530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39532/0 (socket says 172.21.15.60:39532) 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 -- 172.21.15.60:0/2359389277 learned_addr learned my addr 172.21.15.60:0/2359389277 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f1352ffd700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13540c9b00 0x7f1354154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13537fe700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f135415a2d0 0x7f13540add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 -- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f135415a2d0 msgr2=0x7f13540add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f135415a2d0 0x7f13540add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 -- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13540c9b00 msgr2=0x7f1354154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13540c9b00 0x7f1354154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f13527fc700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0094f0 con 0x7f1354159f00 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.094+0000 7f1352ffd700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13540c9b00 0x7f1354154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.095+0000 7f13527fc700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 0x7f13541530c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f133c009290 tx=0x7f133c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:51.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.095+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c01ad80 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.095+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c010470 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.095+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1354169c90 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.095+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c010830 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.095+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135416a250 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.096+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13540c8fb0 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.096+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f133c022070 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.097+0000 7f134affd700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1334066f30 0x7f13340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.097+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f133c014070 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.097+0000 7f1352ffd700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1334066f30 0x7f13340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.097+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f133406ddb0 con 0x7f1354159f00 2023-10-08T16:11:51.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.097+0000 7f1352ffd700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1334066f30 0x7f13340693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f13440076e0 tx=0x7f13440098f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:51.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.101+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f133c029020 con 0x7f1354159f00 2023-10-08T16:11:51.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.293+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f13540c85e0 con 0x7f1354159f00 2023-10-08T16:11:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.941+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(139..139 src has 1..139) v4 ==== 338+0+0 (secure 0 0 0) 0x7f133c058520 con 0x7f1354159f00 2023-10-08T16:11:51.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.941+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f133406cb40 con 0x7f1354159f00 2023-10-08T16:11:51.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.944+0000 7f134affd700 1 -- 172.21.15.60:0/2359389277 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) v1 ==== 169+0+0 (secure 0 0 0) 0x7f133c054860 con 0x7f1354159f00 2023-10-08T16:11:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.952+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1334066f30 msgr2=0x7f13340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.952+0000 7f135981e700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1334066f30 0x7f13340693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f13440076e0 tx=0x7f13440098f0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.952+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 msgr2=0x7f13541530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:51.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.952+0000 7f135981e700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 0x7f13541530c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f133c009290 tx=0x7f133c019000 comp rx=0 tx=0).stop 2023-10-08T16:11:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 shutdown_connections 2023-10-08T16:11:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1334066f30 0x7f13340693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f135415a2d0 0x7f13540add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13540c9b00 0x7f1354154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 --2- 172.21.15.60:0/2359389277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1354159f00 0x7f13541530c0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:51.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 >> 172.21.15.60:0/2359389277 conn(0x7f13540cd450 msgr2=0x7f13540cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:51.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 shutdown_connections 2023-10-08T16:11:51.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:51.953+0000 7f135981e700 1 -- 172.21.15.60:0/2359389277 wait complete. 2023-10-08T16:11:51.955 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:11:51.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:11:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.092+0000 7f7c59d16700 1 Processor -- start 2023-10-08T16:11:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c59d16700 1 -- start start 2023-10-08T16:11:52.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c59d16700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c54159e60 0x7f7c5415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c59d16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5415a230 0x7f7c540690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c59d16700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5415ea90 con 0x7f7c540695f0 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c59d16700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540d1cf0 con 0x7f7c54159e60 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c59d16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54069a70 con 0x7f7c5415a230 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c537fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c54159e60 0x7f7c5415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.093+0000 7f7c53fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7c540695f0 0x7f7c540af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48370/0 (socket says 172.21.15.60:48370) 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c53fff700 1 -- 172.21.15.60:0/2038911550 learned_addr learned my addr 172.21.15.60:0/2038911550 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c52ffd700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5415a230 0x7f7c540690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c537fe700 1 -- 172.21.15.60:0/2038911550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5415a230 msgr2=0x7f7c540690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c537fe700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5415a230 0x7f7c540690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c537fe700 1 -- 172.21.15.60:0/2038911550 >> v1:172.21.15.60:6789/0 conn(0x7f7c540695f0 legacy=0x7f7c540af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c527fc700 1 -- 172.21.15.60:0/2038911550 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159703739 0 0) 0x7f7c5415ea90 con 0x7f7c540695f0 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c537fe700 1 -- 172.21.15.60:0/2038911550 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540b3100 con 0x7f7c54159e60 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c52ffd700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5415a230 0x7f7c540690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c537fe700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c54159e60 0x7f7c5415e550 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7c440098e0 tx=0x7f7c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624a3bb86608ea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c527fc700 1 -- 172.21.15.60:0/2038911550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44009e80 con 0x7f7c54159e60 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c527fc700 1 -- 172.21.15.60:0/2038911550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400b860 con 0x7f7c54159e60 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.094+0000 7f7c527fc700 1 -- 172.21.15.60:0/2038911550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400bbe0 con 0x7f7c54159e60 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 -- 172.21.15.60:0/2038911550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c54159e60 msgr2=0x7f7c5415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c54159e60 0x7f7c5415e550 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7c440098e0 tx=0x7f7c440091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 -- 172.21.15.60:0/2038911550 shutdown_connections 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c54159e60 0x7f7c5415e550 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2038911550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c5415a230 0x7f7c540690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 -- 172.21.15.60:0/2038911550 >> 172.21.15.60:0/2038911550 conn(0x7f7c54070700 msgr2=0x7f7c54070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 -- 172.21.15.60:0/2038911550 shutdown_connections 2023-10-08T16:11:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.095+0000 7f7c59d16700 1 -- 172.21.15.60:0/2038911550 wait complete. 2023-10-08T16:11:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.096+0000 7f7c59d16700 1 Processor -- start 2023-10-08T16:11:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.096+0000 7f7c59d16700 1 -- start start 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c59d16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 0x7f7c540c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c59d16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c54159e60 0x7f7c5415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c59d16700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5415a230 0x7f7c5414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c59d16700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c7e40 con 0x7f7c540695f0 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c59d16700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c8120 con 0x7f7c5415a230 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c59d16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c8400 con 0x7f7c54159e60 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 0x7f7c540c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 0x7f7c540c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39554/0 (socket says 172.21.15.60:39554) 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 -- 172.21.15.60:0/2925995032 learned_addr learned my addr 172.21.15.60:0/2925995032 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c52ffd700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c54159e60 0x7f7c5415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c53fff700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5415a230 0x7f7c5414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 -- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c54159e60 msgr2=0x7f7c5415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c54159e60 0x7f7c5415c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 -- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5415a230 msgr2=0x7f7c5414bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5415a230 0x7f7c5414bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 -- 172.21.15.60:0/2925995032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44009420 con 0x7f7c540695f0 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.097+0000 7f7c537fe700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 0x7f7c540c5650 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7c54069e20 tx=0x7f7c44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.098+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011420 con 0x7f7c540695f0 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.098+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440115a0 con 0x7f7c540695f0 2023-10-08T16:11:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.098+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540c86e0 con 0x7f7c540695f0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.098+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011960 con 0x7f7c540695f0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.098+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540c5b90 con 0x7f7c540695f0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.098+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540c8be0 con 0x7f7c540695f0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.099+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c440253f0 con 0x7f7c540695f0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.099+0000 7f7c3b7fe700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c40066f30 0x7f7c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.099+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7c44085dd0 con 0x7f7c540695f0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.099+0000 7f7c52ffd700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c40066f30 0x7f7c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.100+0000 7f7c52ffd700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c40066f30 0x7f7c400693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7c540d0850 tx=0x7f7c48006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.104+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c44053340 con 0x7f7c540695f0 2023-10-08T16:11:52.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.297+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7c5404c3c0 con 0x7f7c540695f0 2023-10-08T16:11:52.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.301+0000 7f7c3b7fe700 1 -- 172.21.15.60:0/2925995032 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7c44056960 con 0x7f7c540695f0 2023-10-08T16:11:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c40066f30 msgr2=0x7f7c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c40066f30 0x7f7c400693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7c540d0850 tx=0x7f7c48006f90 comp rx=0 tx=0).stop 2023-10-08T16:11:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 msgr2=0x7f7c540c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 0x7f7c540c5650 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7c54069e20 tx=0x7f7c44017000 comp rx=0 tx=0).stop 2023-10-08T16:11:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 shutdown_connections 2023-10-08T16:11:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7c40066f30 0x7f7c400693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c5415a230 0x7f7c5414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c540695f0 0x7f7c540c5650 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 --2- 172.21.15.60:0/2925995032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c54159e60 0x7f7c5415c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 >> 172.21.15.60:0/2925995032 conn(0x7f7c54070700 msgr2=0x7f7c540cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 shutdown_connections 2023-10-08T16:11:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.303+0000 7f7c59d16700 1 -- 172.21.15.60:0/2925995032 wait complete. 2023-10-08T16:11:52.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-08T16:11:52.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.434+0000 7f71c5e2d700 1 Processor -- start 2023-10-08T16:11:52.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.434+0000 7f71c5e2d700 1 -- start start 2023-10-08T16:11:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71c5e2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 0x7f71c00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71c5e2d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c00c5d80 con 0x7f71c00cfe20 2023-10-08T16:11:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71c5e2d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c00c6060 con 0x7f71c00d1c30 2023-10-08T16:11:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71c5e2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0068470 con 0x7f71c015a2b0 2023-10-08T16:11:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71bffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f71c00cfe20 0x7f71c00c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38456/0 (socket says 172.21.15.60:38456) 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71bffff700 1 -- 172.21.15.60:0/451392746 learned_addr learned my addr 172.21.15.60:0/451392746 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668655586 0 0) 0x7f71c00c5d80 con 0x7f71c00cfe20 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71bf7fe700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 0x7f71c00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.435+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a8003570 con 0x7f71c00cfe20 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338223241 0 0) 0x7f71a8003570 con 0x7f71c00cfe20 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 msgr2=0x7f71c00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 0x7f71c00b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 >> v1:172.21.15.144:6789/0 conn(0x7f71c00d1c30 legacy=0x7f71c00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c00c6340 con 0x7f71c00cfe20 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f71b80017f0 con 0x7f71c00cfe20 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 >> v1:172.21.15.60:6789/0 conn(0x7f71c00cfe20 legacy=0x7f71c00c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71a8003a90 0x7f71a8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 0x7f71a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0068470 con 0x7f71a8004810 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a800bb10 con 0x7f71a8003a90 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a800bcd0 con 0x7f71c015a2b0 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71beffd700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71bf7fe700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71a8003a90 0x7f71a8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71bffff700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 0x7f71a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71beffd700 1 -- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 msgr2=0x7f71a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71beffd700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015a2b0 0x7f71a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71beffd700 1 -- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71a8003a90 msgr2=0x7f71a8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71beffd700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71a8003a90 0x7f71a8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.436+0000 7f71beffd700 1 -- 172.21.15.60:0/451392746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8003570 con 0x7f71a8004810 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71beffd700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71a8004c80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f71b4001970 tx=0x7f71b4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dc46e861f6d346 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400c5d0 con 0x7f71a8004810 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400c750 con 0x7f71a8004810 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71be7fc700 1 -- 172.21.15.60:0/451392746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400cb10 con 0x7f71a8004810 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71c5e2d700 1 -- 172.21.15.60:0/451392746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 msgr2=0x7f71a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/451392746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71a8004c80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f71b4001970 tx=0x7f71b4007d10 comp rx=0 tx=0).stop 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71bffff700 1 -- 172.21.15.60:0/451392746 reap_dead start 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71c5e2d700 1 -- 172.21.15.60:0/451392746 shutdown_connections 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71c5e2d700 1 -- 172.21.15.60:0/451392746 >> 172.21.15.60:0/451392746 conn(0x7f71c0067e40 msgr2=0x7f71c00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71c5e2d700 1 -- 172.21.15.60:0/451392746 shutdown_connections 2023-10-08T16:11:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.437+0000 7f71c5e2d700 1 -- 172.21.15.60:0/451392746 wait complete. 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.438+0000 7f71c5e2d700 1 Processor -- start 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 -- start start 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71c00b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c015a680 0x7f71c0157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015b050 0x7f71c015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c015f840 con 0x7f71a8004810 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c015b9c0 con 0x7f71c015a680 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71c5e2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00b5510 con 0x7f71c015b050 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71bf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71c00b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71bf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71c00b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58698/0 (socket says 172.21.15.60:58698) 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71bf7fe700 1 -- 172.21.15.60:0/1073321320 learned_addr learned my addr 172.21.15.60:0/1073321320 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:52.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71beffd700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c015a680 0x7f71c0157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.439+0000 7f71bffff700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015b050 0x7f71c015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71bf7fe700 1 -- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015b050 msgr2=0x7f71c015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71bf7fe700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015b050 0x7f71c015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71bf7fe700 1 -- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c015a680 msgr2=0x7f71c0157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71bf7fe700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c015a680 0x7f71c0157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71bf7fe700 1 -- 172.21.15.60:0/1073321320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c00b6ab0 con 0x7f71a8004810 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71bf7fe700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71c00b4fd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f71b0011b60 tx=0x7f71b0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0005c10 con 0x7f71a8004810 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b0005d70 con 0x7f71a8004810 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000f980 con 0x7f71a8004810 2023-10-08T16:11:52.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c00b6d90 con 0x7f71a8004810 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.440+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c016a480 con 0x7f71a8004810 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.441+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c015fb20 con 0x7f71a8004810 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.441+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71b0006050 con 0x7f71a8004810 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.442+0000 7f71a77fe700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.442+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f71b0084980 con 0x7f71a8004810 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.442+0000 7f71beffd700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.442+0000 7f71beffd700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71ac066f30 0x7f71ac0693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f71c015afe0 tx=0x7f71b4015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:52.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.446+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71b0051ef0 con 0x7f71a8004810 2023-10-08T16:11:52.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:52.717+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f71c004c3c0 con 0x7f71a8004810 2023-10-08T16:11:53.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.408+0000 7f71a77fe700 1 -- 172.21.15.60:0/1073321320 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v357) v1 ==== 140+0+0 (secure 0 0 0) 0x7f71b00210d0 con 0x7f71a8004810 2023-10-08T16:11:53.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71ac066f30 msgr2=0x7f71ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:53.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71ac066f30 0x7f71ac0693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f71c015afe0 tx=0x7f71b4015000 comp rx=0 tx=0).stop 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 msgr2=0x7f71c00b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71c00b4fd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f71b0011b60 tx=0x7f71b0009120 comp rx=0 tx=0).stop 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 shutdown_connections 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71c015b050 0x7f71c015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a8004810 0x7f71c00b4fd0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 --2- 172.21.15.60:0/1073321320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c015a680 0x7f71c0157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 >> 172.21.15.60:0/1073321320 conn(0x7f71c0067e40 msgr2=0x7f71c0069730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 shutdown_connections 2023-10-08T16:11:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.411+0000 7f71c5e2d700 1 -- 172.21.15.60:0/1073321320 wait complete. 2023-10-08T16:11:53.425 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-08T16:11:53.425 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-08T16:11:53.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-08T16:11:53.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.547+0000 7f144a13b700 1 Processor -- start 2023-10-08T16:11:53.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.547+0000 7f144a13b700 1 -- start start 2023-10-08T16:11:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f144a13b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1444159e10 0x7f14440b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f144a13b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14440cde50 0x7f14440b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f144a13b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144415db80 con 0x7f144415a1e0 2023-10-08T16:11:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f144a13b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144415e800 con 0x7f1444159e10 2023-10-08T16:11:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f144a13b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144415de60 con 0x7f14440cde50 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f14437fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1444159e10 0x7f14440b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f1442ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f144415a1e0 0x7f14440cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38462/0 (socket says 172.21.15.60:38462) 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f1442ffd700 1 -- 172.21.15.60:0/3933787102 learned_addr learned my addr 172.21.15.60:0/3933787102 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f1443fff700 1 --2- 172.21.15.60:0/3933787102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14440cde50 0x7f14440b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.548+0000 7f14437fe700 1 -- 172.21.15.60:0/3933787102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14440cde50 msgr2=0x7f14440b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14437fe700 1 --2- 172.21.15.60:0/3933787102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14440cde50 0x7f14440b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14437fe700 1 -- 172.21.15.60:0/3933787102 >> v1:172.21.15.60:6789/0 conn(0x7f144415a1e0 legacy=0x7f14440cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14437fe700 1 -- 172.21.15.60:0/3933787102 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144415e140 con 0x7f1444159e10 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14427fc700 1 -- 172.21.15.60:0/3933787102 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594374479 0 0) 0x7f144415db80 con 0x7f144415a1e0 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14437fe700 1 --2- 172.21.15.60:0/3933787102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1444159e10 0x7f14440b2d20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f14340098e0 tx=0x7f14340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a643fafe59193f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:53.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14427fc700 1 -- 172.21.15.60:0/3933787102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143400b640 con 0x7f1444159e10 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14427fc700 1 -- 172.21.15.60:0/3933787102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143400b7a0 con 0x7f1444159e10 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f14427fc700 1 -- 172.21.15.60:0/3933787102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143400bb40 con 0x7f1444159e10 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 -- 172.21.15.60:0/3933787102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1444159e10 msgr2=0x7f14440b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 --2- 172.21.15.60:0/3933787102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1444159e10 0x7f14440b2d20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f14340098e0 tx=0x7f14340091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 -- 172.21.15.60:0/3933787102 shutdown_connections 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 --2- 172.21.15.60:0/3933787102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14440cde50 0x7f14440b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 --2- 172.21.15.60:0/3933787102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1444159e10 0x7f14440b2d20 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 -- 172.21.15.60:0/3933787102 >> 172.21.15.60:0/3933787102 conn(0x7f1444067660 msgr2=0x7f1444067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.549+0000 7f144a13b700 1 -- 172.21.15.60:0/3933787102 shutdown_connections 2023-10-08T16:11:53.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.550+0000 7f144a13b700 1 -- 172.21.15.60:0/3933787102 wait complete. 2023-10-08T16:11:53.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.551+0000 7f144a13b700 1 Processor -- start 2023-10-08T16:11:53.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.551+0000 7f144a13b700 1 -- start start 2023-10-08T16:11:53.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14440cde50 0x7f1444157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:53.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1444159e10 0x7f14440b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:53.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 0x7f14440b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144416a730 con 0x7f144415a1e0 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c8bf0 con 0x7f14440cde50 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144416a0e0 con 0x7f1444159e10 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 0x7f14440b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 0x7f14440b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58720/0 (socket says 172.21.15.60:58720) 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 -- 172.21.15.60:0/305297863 learned_addr learned my addr 172.21.15.60:0/305297863 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f14437fe700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14440cde50 0x7f1444157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1442ffd700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1444159e10 0x7f14440b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 -- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1444159e10 msgr2=0x7f14440b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1444159e10 0x7f14440b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 -- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14440cde50 msgr2=0x7f1444157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14440cde50 0x7f1444157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 -- 172.21.15.60:0/305297863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434009420 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f1443fff700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 0x7f14440b5490 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ef0 tx=0x7f143c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00cb70 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c00f040 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144416a3c0 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c014480 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.552+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144416abc0 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.553+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144404c3c0 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.554+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f143c014830 con 0x7f144415a1e0 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.554+0000 7f142b7fe700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1430066f30 0x7f14300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.554+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f143c084f80 con 0x7f144415a1e0 2023-10-08T16:11:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.554+0000 7f14437fe700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1430066f30 0x7f14300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.555+0000 7f14437fe700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1430066f30 0x7f14300693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f14340093f0 tx=0x7f1434017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.559+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f143c0b65a0 con 0x7f144415a1e0 2023-10-08T16:11:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:53.832+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f144415e420 con 0x7f144415a1e0 2023-10-08T16:11:54.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.414+0000 7f142b7fe700 1 -- 172.21.15.60:0/305297863 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v358) v1 ==== 135+0+0 (secure 0 0 0) 0x7f143c0180c0 con 0x7f144415a1e0 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1430066f30 msgr2=0x7f14300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1430066f30 0x7f14300693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f14340093f0 tx=0x7f1434017000 comp rx=0 tx=0).stop 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 msgr2=0x7f14440b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 0x7f14440b5490 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ef0 tx=0x7f143c00b040 comp rx=0 tx=0).stop 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 shutdown_connections 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1430066f30 0x7f14300693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144415a1e0 0x7f14440b5490 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14440cde50 0x7f1444157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 --2- 172.21.15.60:0/305297863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1444159e10 0x7f14440b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 >> 172.21.15.60:0/305297863 conn(0x7f1444067660 msgr2=0x7f144415a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:54.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 shutdown_connections 2023-10-08T16:11:54.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.416+0000 7f144a13b700 1 -- 172.21.15.60:0/305297863 wait complete. 2023-10-08T16:11:54.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:11:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.555+0000 7fcc3d308700 1 Processor -- start 2023-10-08T16:11:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.555+0000 7fcc3d308700 1 -- start start 2023-10-08T16:11:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc3d308700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b3570 0x7fcc3815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc3d308700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc380b4c30 0x7fcc380b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc3d308700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc380b14f0 con 0x7fcc380b4860 2023-10-08T16:11:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc3d308700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc380b17d0 con 0x7fcc380b4c30 2023-10-08T16:11:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc3d308700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380b1ab0 con 0x7fcc380b3570 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc377fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc380b4c30 0x7fcc380b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc36ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcc380b4860 0x7fcc38159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38470/0 (socket says 172.21.15.60:38470) 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc36ffd700 1 -- 172.21.15.60:0/2099296640 learned_addr learned my addr 172.21.15.60:0/2099296640 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc367fc700 1 --2- 172.21.15.60:0/2099296640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b3570 0x7fcc3815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc377fe700 1 -- 172.21.15.60:0/2099296640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b3570 msgr2=0x7fcc3815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc377fe700 1 --2- 172.21.15.60:0/2099296640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b3570 0x7fcc3815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc377fe700 1 -- 172.21.15.60:0/2099296640 >> v1:172.21.15.60:6789/0 conn(0x7fcc380b4860 legacy=0x7fcc38159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc377fe700 1 -- 172.21.15.60:0/2099296640 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380b1d90 con 0x7fcc380b4c30 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc35ffb700 1 -- 172.21.15.60:0/2099296640 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196529559 0 0) 0x7fcc380b14f0 con 0x7fcc380b4860 2023-10-08T16:11:54.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc377fe700 1 --2- 172.21.15.60:0/2099296640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4c30 0x7fcc380b6700 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009e60 tx=0x7fcc28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d5706c1c47b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.556+0000 7fcc35ffb700 1 -- 172.21.15.60:0/2099296640 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800e070 con 0x7fcc380b4c30 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc35ffb700 1 -- 172.21.15.60:0/2099296640 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800bcc0 con 0x7fcc380b4c30 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc35ffb700 1 -- 172.21.15.60:0/2099296640 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28012680 con 0x7fcc380b4c30 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 -- 172.21.15.60:0/2099296640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4c30 msgr2=0x7fcc380b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 --2- 172.21.15.60:0/2099296640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4c30 0x7fcc380b6700 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009e60 tx=0x7fcc28009780 comp rx=0 tx=0).stop 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 -- 172.21.15.60:0/2099296640 shutdown_connections 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 --2- 172.21.15.60:0/2099296640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4c30 0x7fcc380b6700 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 --2- 172.21.15.60:0/2099296640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b3570 0x7fcc3815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 -- 172.21.15.60:0/2099296640 >> 172.21.15.60:0/2099296640 conn(0x7fcc3809a0f0 msgr2=0x7fcc38067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 -- 172.21.15.60:0/2099296640 shutdown_connections 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.557+0000 7fcc3d308700 1 -- 172.21.15.60:0/2099296640 wait complete. 2023-10-08T16:11:54.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.558+0000 7fcc3d308700 1 Processor -- start 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.558+0000 7fcc3d308700 1 -- start start 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc3d308700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc380b3570 0x7fcc3814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc3d308700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 0x7fcc38151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc3d308700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b4c30 0x7fcc3815fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc3d308700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815f960 con 0x7fcc380b4860 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc3d308700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815ed50 con 0x7fcc380b3570 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc3d308700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815f030 con 0x7fcc380b4c30 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 0x7fcc38151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 0x7fcc38151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58752/0 (socket says 172.21.15.60:58752) 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 -- 172.21.15.60:0/158434407 learned_addr learned my addr 172.21.15.60:0/158434407 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:54.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc36ffd700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc380b3570 0x7fcc3814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc377fe700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b4c30 0x7fcc3815fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 -- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b4c30 msgr2=0x7fcc3815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b4c30 0x7fcc3815fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 -- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc380b3570 msgr2=0x7fcc3814f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc380b3570 0x7fcc3814f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc367fc700 1 -- 172.21.15.60:0/158434407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28009a20 con 0x7fcc380b4860 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.559+0000 7fcc377fe700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b4c30 0x7fcc3815fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.560+0000 7fcc367fc700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 0x7fcc38151490 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d890 tx=0x7fcc20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:54.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.560+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000b600 con 0x7fcc380b4860 2023-10-08T16:11:54.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.560+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000b760 con 0x7fcc380b4860 2023-10-08T16:11:54.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.560+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3815f310 con 0x7fcc380b4860 2023-10-08T16:11:54.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.560+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000bae0 con 0x7fcc380b4860 2023-10-08T16:11:54.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.560+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3814fa30 con 0x7fcc380b4860 2023-10-08T16:11:54.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.561+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3815fad0 con 0x7fcc380b4860 2023-10-08T16:11:54.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.561+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc2001e460 con 0x7fcc380b4860 2023-10-08T16:11:54.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.562+0000 7fcc2effd700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.562+0000 7fcc36ffd700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.562+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcc200848e0 con 0x7fcc380b4860 2023-10-08T16:11:54.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.562+0000 7fcc36ffd700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc18066f30 0x7fcc180693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc30001360 tx=0x7fcc30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:54.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.566+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc20051e50 con 0x7fcc380b4860 2023-10-08T16:11:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.759+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcc3804c3c0 con 0x7fcc380b4860 2023-10-08T16:11:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.764+0000 7fcc2effd700 1 -- 172.21.15.60:0/158434407 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc20055470 con 0x7fcc380b4860 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc18066f30 msgr2=0x7fcc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc18066f30 0x7fcc180693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc30001360 tx=0x7fcc30009040 comp rx=0 tx=0).stop 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 msgr2=0x7fcc38151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 0x7fcc38151490 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d890 tx=0x7fcc20008040 comp rx=0 tx=0).stop 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 shutdown_connections 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc380b4c30 0x7fcc3815fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc380b3570 0x7fcc3814f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 --2- 172.21.15.60:0/158434407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc380b4860 0x7fcc38151490 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 >> 172.21.15.60:0/158434407 conn(0x7fcc3809a0f0 msgr2=0x7fcc3815b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:54.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 shutdown_connections 2023-10-08T16:11:54.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.766+0000 7fcc3d308700 1 -- 172.21.15.60:0/158434407 wait complete. 2023-10-08T16:11:54.778 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:11:54.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:11:54.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:11:54.866 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:11:54.866 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:11:54.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:11:54.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.984+0000 7f6c69538700 1 Processor -- start 2023-10-08T16:11:54.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.985+0000 7f6c69538700 1 -- start start 2023-10-08T16:11:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.985+0000 7f6c69538700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c64159cf0 0x7f6c6415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.985+0000 7f6c69538700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c6415a0c0 0x7f6c640ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.985+0000 7f6c69538700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c640cca20 con 0x7f6c640ce1a0 2023-10-08T16:11:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.985+0000 7f6c69538700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6415ea40 con 0x7f6c64159cf0 2023-10-08T16:11:54.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.985+0000 7f6c69538700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c64067660 con 0x7f6c6415a0c0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c62ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c64159cf0 0x7f6c6415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c637fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6c640ce1a0 0x7f6c640cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38484/0 (socket says 172.21.15.60:38484) 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c637fe700 1 -- 172.21.15.60:0/989622805 learned_addr learned my addr 172.21.15.60:0/989622805 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c627fc700 1 --2- 172.21.15.60:0/989622805 >> v2:172.21.15.144:3300/0 conn(0x7f6c6415a0c0 0x7f6c640ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c61ffb700 1 -- 172.21.15.60:0/989622805 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827665759 0 0) 0x7f6c640cca20 con 0x7f6c640ce1a0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c61ffb700 1 -- 172.21.15.60:0/989622805 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c50003570 con 0x7f6c640ce1a0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c62ffd700 1 -- 172.21.15.60:0/989622805 >> v2:172.21.15.144:3300/0 conn(0x7f6c6415a0c0 msgr2=0x7f6c640ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c62ffd700 1 --2- 172.21.15.60:0/989622805 >> v2:172.21.15.144:3300/0 conn(0x7f6c6415a0c0 0x7f6c640ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c62ffd700 1 -- 172.21.15.60:0/989622805 >> v1:172.21.15.60:6789/0 conn(0x7f6c640ce1a0 legacy=0x7f6c640cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c62ffd700 1 -- 172.21.15.60:0/989622805 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64067f00 con 0x7f6c64159cf0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c62ffd700 1 --2- 172.21.15.60:0/989622805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c64159cf0 0x7f6c6415e500 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6c6406a870 tx=0x7f6c4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1a0744db40211a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:54.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c61ffb700 1 -- 172.21.15.60:0/989622805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c011630 con 0x7f6c64159cf0 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c61ffb700 1 -- 172.21.15.60:0/989622805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c011790 con 0x7f6c64159cf0 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.986+0000 7f6c61ffb700 1 -- 172.21.15.60:0/989622805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c011b30 con 0x7f6c64159cf0 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 -- 172.21.15.60:0/989622805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c64159cf0 msgr2=0x7f6c6415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 --2- 172.21.15.60:0/989622805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c64159cf0 0x7f6c6415e500 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6c6406a870 tx=0x7f6c4c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 -- 172.21.15.60:0/989622805 shutdown_connections 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 --2- 172.21.15.60:0/989622805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c64159cf0 0x7f6c6415e500 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 --2- 172.21.15.60:0/989622805 >> v2:172.21.15.144:3300/0 conn(0x7f6c6415a0c0 0x7f6c640ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 -- 172.21.15.60:0/989622805 >> 172.21.15.60:0/989622805 conn(0x7f6c6406c6e0 msgr2=0x7f6c64069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 -- 172.21.15.60:0/989622805 shutdown_connections 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.987+0000 7f6c69538700 1 -- 172.21.15.60:0/989622805 wait complete. 2023-10-08T16:11:54.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.988+0000 7f6c69538700 1 Processor -- start 2023-10-08T16:11:54.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.988+0000 7f6c69538700 1 -- start start 2023-10-08T16:11:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c69538700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c640ce1a0 0x7f6c640b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c69538700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c64159cf0 0x7f6c640ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c69538700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 0x7f6c640c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c69538700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640abcc0 con 0x7f6c6415a0c0 2023-10-08T16:11:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c69538700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640acb00 con 0x7f6c64159cf0 2023-10-08T16:11:54.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c69538700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640abef0 con 0x7f6c640ce1a0 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 0x7f6c640c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 0x7f6c640c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58768/0 (socket says 172.21.15.60:58768) 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 -- 172.21.15.60:0/1862994300 learned_addr learned my addr 172.21.15.60:0/1862994300 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c627fc700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c64159cf0 0x7f6c640ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c62ffd700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c640ce1a0 0x7f6c640b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 -- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c640ce1a0 msgr2=0x7f6c640b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c640ce1a0 0x7f6c640b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 -- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c64159cf0 msgr2=0x7f6c640ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c64159cf0 0x7f6c640ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:54.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.989+0000 7f6c637fe700 1 -- 172.21.15.60:0/1862994300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009420 con 0x7f6c6415a0c0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.990+0000 7f6c637fe700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 0x7f6c640c6820 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c001460 tx=0x7f6c5c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.990+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00ce80 con 0x7f6c6415a0c0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.990+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c00ac00 con 0x7f6c6415a0c0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.990+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640ac1d0 con 0x7f6c6415a0c0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.990+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0070f0 con 0x7f6c6415a0c0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.990+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c640ac790 con 0x7f6c6415a0c0 2023-10-08T16:11:54.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.991+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c640acc90 con 0x7f6c6415a0c0 2023-10-08T16:11:54.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.991+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c5c007520 con 0x7f6c6415a0c0 2023-10-08T16:11:54.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.991+0000 7f6c5affd700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6c44066f30 0x7f6c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:54.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.992+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6c5c084850 con 0x7f6c6415a0c0 2023-10-08T16:11:54.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.992+0000 7f6c62ffd700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6c44066f30 0x7f6c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:54.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.992+0000 7f6c62ffd700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6c44066f30 0x7f6c440693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0093f0 tx=0x7f6c4c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:54.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:54.996+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c5c051db0 con 0x7f6c6415a0c0 2023-10-08T16:11:55.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.230+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c6404c3c0 con 0x7f6c6415a0c0 2023-10-08T16:11:55.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.231+0000 7f6c5affd700 1 -- 172.21.15.60:0/1862994300 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f6c5c0553d0 con 0x7f6c6415a0c0 2023-10-08T16:11:55.232 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:11:55.232 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/2318843602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2318843602},{"type":"v1","addr":"172.21.15.144:6834","nonce":2318843602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4113268328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4113268328},{"type":"v1","addr":"172.21.15.144:6835","nonce":4113268328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1239233443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1239233443},{"type":"v1","addr":"172.21.15.60:6836","nonce":1239233443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3324658936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3324658936},{"type":"v1","addr":"172.21.15.60:6837","nonce":3324658936}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-10-08T16:11:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6c44066f30 msgr2=0x7f6c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6c44066f30 0x7f6c440693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0093f0 tx=0x7f6c4c017000 comp rx=0 tx=0).stop 2023-10-08T16:11:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 msgr2=0x7f6c640c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 0x7f6c640c6820 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c001460 tx=0x7f6c5c001ae0 comp rx=0 tx=0).stop 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 shutdown_connections 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6c44066f30 0x7f6c440693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c640ce1a0 0x7f6c640b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6415a0c0 0x7f6c640c6820 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 --2- 172.21.15.60:0/1862994300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c64159cf0 0x7f6c640ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 >> 172.21.15.60:0/1862994300 conn(0x7f6c6406c6e0 msgr2=0x7f6c640c9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 shutdown_connections 2023-10-08T16:11:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:11:55.233+0000 7f6c69538700 1 -- 172.21.15.60:0/1862994300 wait complete. 2023-10-08T16:11:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2023-10-08T16:11:55.246 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:11:55.246 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:11:55.246 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:11:55.246 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:55.246 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:11:55.247 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:11:55.247 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:11:55.247 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:55.247 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:11:55.247 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:11:55.247 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:11:55.247 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:55.248 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:11:55.248 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:11:55.248 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:11:55.248 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:11:55.255 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:11:55.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:11:55.256 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:11:55.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:11:55.262 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:11:55.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:11:55.297 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:11:55.297 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:55.298 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:11:55.298 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:55.304 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:11:55.304 DEBUG:teuthology.parallel:result is None 2023-10-08T16:11:55.371 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:11:55.371 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:11:55.385 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:11:56.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-08T16:12:01.262 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:12:01.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:12:01.265 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:12:01.541 DEBUG:teuthology.parallel:result is None 2023-10-08T16:12:01.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:12:01.542 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:12:01.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.675+0000 7fcd35540700 1 Processor -- start 2023-10-08T16:12:01.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.675+0000 7fcd35540700 1 -- start start 2023-10-08T16:12:01.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd35540700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd30152010 0x7fcd3015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:01.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd35540700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd300cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:01.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd35540700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3006c010 con 0x7fcd301523e0 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd35540700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3006bd10 con 0x7fcd30152010 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd35540700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3015c060 con 0x7fcd30158e50 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd2effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd30152010 0x7fcd3015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd2effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd30152010 0x7fcd3015b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58786/0 (socket says 172.21.15.60:58786) 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd2effd700 1 -- 172.21.15.60:0/4075416591 learned_addr learned my addr 172.21.15.60:0/4075416591 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.676+0000 7fcd2f7fe700 1 --2- 172.21.15.60:0/4075416591 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd300cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2effd700 1 -- 172.21.15.60:0/4075416591 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 msgr2=0x7fcd300cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2effd700 1 --2- 172.21.15.60:0/4075416591 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd300cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2effd700 1 -- 172.21.15.60:0/4075416591 >> v1:172.21.15.144:6789/0 conn(0x7fcd301523e0 legacy=0x7fcd3006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2effd700 1 -- 172.21.15.60:0/4075416591 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3015c340 con 0x7fcd30152010 2023-10-08T16:12:01.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2effd700 1 --2- 172.21.15.60:0/4075416591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd3015b810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcd280099b0 tx=0x7fcd28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82d076587d3544 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2dffb700 1 -- 172.21.15.60:0/4075416591 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28009ea0 con 0x7fcd30152010 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2dffb700 1 -- 172.21.15.60:0/4075416591 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2800b860 con 0x7fcd30152010 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd2dffb700 1 -- 172.21.15.60:0/4075416591 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800bc00 con 0x7fcd30152010 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd35540700 1 -- 172.21.15.60:0/4075416591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 msgr2=0x7fcd3015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd35540700 1 --2- 172.21.15.60:0/4075416591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd3015b810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcd280099b0 tx=0x7fcd28009250 comp rx=0 tx=0).stop 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd35540700 1 -- 172.21.15.60:0/4075416591 shutdown_connections 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd35540700 1 --2- 172.21.15.60:0/4075416591 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd300cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.677+0000 7fcd35540700 1 --2- 172.21.15.60:0/4075416591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd3015b810 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.678+0000 7fcd35540700 1 -- 172.21.15.60:0/4075416591 >> 172.21.15.60:0/4075416591 conn(0x7fcd30069870 msgr2=0x7fcd30069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.678+0000 7fcd35540700 1 -- 172.21.15.60:0/4075416591 shutdown_connections 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.678+0000 7fcd35540700 1 -- 172.21.15.60:0/4075416591 wait complete. 2023-10-08T16:12:01.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.679+0000 7fcd35540700 1 Processor -- start 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.679+0000 7fcd35540700 1 -- start start 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd35540700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd30156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd35540700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd301523e0 0x7fcd30067930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd35540700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd30145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd35540700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300b46e0 con 0x7fcd30152010 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd35540700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300683f0 con 0x7fcd301523e0 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd35540700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300686d0 con 0x7fcd30158e50 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd30156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd30156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58794/0 (socket says 172.21.15.60:58794) 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 -- 172.21.15.60:0/2693535241 learned_addr learned my addr 172.21.15.60:0/2693535241 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:01.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2e7fc700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd301523e0 0x7fcd30067930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2f7fe700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd30145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 -- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 msgr2=0x7fcd30145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd30145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 -- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd301523e0 msgr2=0x7fcd30067930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd301523e0 0x7fcd30067930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 -- 172.21.15.60:0/2693535241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280094f0 con 0x7fcd30152010 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd2effd700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd30156dd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcd300c59e0 tx=0x7fcd28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28000d10 con 0x7fcd30152010 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.680+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2800bbe0 con 0x7fcd30152010 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.681+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd300689b0 con 0x7fcd30152010 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.681+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28011670 con 0x7fcd30152010 2023-10-08T16:12:01.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.681+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd30068f70 con 0x7fcd30152010 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.681+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3004c3c0 con 0x7fcd30152010 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.682+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd28011aa0 con 0x7fcd30152010 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.682+0000 7fcd26ffd700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd10066f30 0x7fcd100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.683+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcd28085ae0 con 0x7fcd30152010 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.683+0000 7fcd2e7fc700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd10066f30 0x7fcd100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.683+0000 7fcd2e7fc700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd10066f30 0x7fcd100693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b0940 tx=0x7fcd18007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.687+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd28052fb0 con 0x7fcd30152010 2023-10-08T16:12:01.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:01.897+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd3006d1b0 con 0x7fcd30152010 2023-10-08T16:12:02.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.445+0000 7fcd26ffd700 1 -- 172.21.15.60:0/2693535241 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v144) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd28015080 con 0x7fcd30152010 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd10066f30 msgr2=0x7fcd100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd10066f30 0x7fcd100693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b0940 tx=0x7fcd18007ec0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 msgr2=0x7fcd30156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd30156dd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcd300c59e0 tx=0x7fcd28017000 comp rx=0 tx=0).stop 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 shutdown_connections 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd10066f30 0x7fcd100693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd30158e50 0x7fcd30145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd30152010 0x7fcd30156dd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 --2- 172.21.15.60:0/2693535241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd301523e0 0x7fcd30067930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 >> 172.21.15.60:0/2693535241 conn(0x7fcd30069870 msgr2=0x7fcd301513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:02.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 shutdown_connections 2023-10-08T16:12:02.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.447+0000 7fcd35540700 1 -- 172.21.15.60:0/2693535241 wait complete. 2023-10-08T16:12:02.449 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:12:02.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:12:02.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.584+0000 7fa14d36c700 1 Processor -- start 2023-10-08T16:12:02.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.584+0000 7fa14d36c700 1 -- start start 2023-10-08T16:12:02.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa14d36c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa148159cf0 0x7fa14815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa14d36c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa14815a0c0 0x7fa1480ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa14d36c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa1480ce1a0 0x7fa1480ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa14d36c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480cca20 con 0x7fa14815a0c0 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa14d36c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14815ea40 con 0x7fa1480ce1a0 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa14d36c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa148067660 con 0x7fa148159cf0 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa14815a0c0 0x7fa1480ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa14815a0c0 0x7fa1480ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45876/0 (socket says 172.21.15.60:45876) 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 -- 172.21.15.60:0/1471060399 learned_addr learned my addr 172.21.15.60:0/1471060399 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa146ffd700 1 --2- 172.21.15.60:0/1471060399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa148159cf0 0x7fa14815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1477fe700 1 --2- 172.21.15.60:0/1471060399 >> v2:172.21.15.144:3300/0 conn(0x7fa1480ce1a0 0x7fa1480ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 -- 172.21.15.60:0/1471060399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa148159cf0 msgr2=0x7fa14815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 --2- 172.21.15.60:0/1471060399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa148159cf0 0x7fa14815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 -- 172.21.15.60:0/1471060399 >> v2:172.21.15.144:3300/0 conn(0x7fa1480ce1a0 msgr2=0x7fa1480ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 --2- 172.21.15.60:0/1471060399 >> v2:172.21.15.144:3300/0 conn(0x7fa1480ce1a0 0x7fa1480ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 -- 172.21.15.60:0/1471060399 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148067f00 con 0x7fa14815a0c0 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1477fe700 1 --2- 172.21.15.60:0/1471060399 >> v2:172.21.15.144:3300/0 conn(0x7fa1480ce1a0 0x7fa1480ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa1467fc700 1 --2- 172.21.15.60:0/1471060399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480ceab0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa148071760 tx=0x7fa130009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f1352193ed07e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.585+0000 7fa145ffb700 1 -- 172.21.15.60:0/1471060399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130009e70 con 0x7fa14815a0c0 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa145ffb700 1 -- 172.21.15.60:0/1471060399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13000b860 con 0x7fa14815a0c0 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa145ffb700 1 -- 172.21.15.60:0/1471060399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13000bc00 con 0x7fa14815a0c0 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 -- 172.21.15.60:0/1471060399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 msgr2=0x7fa1480ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 --2- 172.21.15.60:0/1471060399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480ceab0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa148071760 tx=0x7fa130009250 comp rx=0 tx=0).stop 2023-10-08T16:12:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 -- 172.21.15.60:0/1471060399 shutdown_connections 2023-10-08T16:12:02.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 --2- 172.21.15.60:0/1471060399 >> v2:172.21.15.144:3300/0 conn(0x7fa1480ce1a0 0x7fa1480ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 --2- 172.21.15.60:0/1471060399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa148159cf0 0x7fa14815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 --2- 172.21.15.60:0/1471060399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480ceab0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 -- 172.21.15.60:0/1471060399 >> 172.21.15.60:0/1471060399 conn(0x7fa14806c6e0 msgr2=0x7fa148069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:02.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 -- 172.21.15.60:0/1471060399 shutdown_connections 2023-10-08T16:12:02.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.586+0000 7fa14d36c700 1 -- 172.21.15.60:0/1471060399 wait complete. 2023-10-08T16:12:02.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.587+0000 7fa14d36c700 1 Processor -- start 2023-10-08T16:12:02.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.587+0000 7fa14d36c700 1 -- start start 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa14d36c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1480ce1a0 0x7fa1481515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa14d36c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa148159cf0 0x7fa14814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa14d36c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa14d36c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148151ae0 con 0x7fa14815a0c0 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa14d36c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148151110 con 0x7fa148159cf0 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa14d36c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa148150500 con 0x7fa1480ce1a0 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45880/0 (socket says 172.21.15.60:45880) 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 -- 172.21.15.60:0/951529808 learned_addr learned my addr 172.21.15.60:0/951529808 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa146ffd700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1480ce1a0 0x7fa1481515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1467fc700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa148159cf0 0x7fa14814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 -- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1480ce1a0 msgr2=0x7fa1481515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1480ce1a0 0x7fa1481515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 -- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa148159cf0 msgr2=0x7fa14814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa148159cf0 0x7fa14814f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.588+0000 7fa1477fe700 1 -- 172.21.15.60:0/951529808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300094f0 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.589+0000 7fa1477fe700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480b2cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa13800e870 tx=0x7fa138008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.589+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800c430 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.589+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13800c590 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.589+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1481507e0 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.589+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800c910 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.589+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa148150da0 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.590+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1481512a0 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.590+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa13800cd40 con 0x7fa14815a0c0 2023-10-08T16:12:02.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.591+0000 7fa13effd700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa128066f60 0x7fa128069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:02.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.591+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa138083fb0 con 0x7fa14815a0c0 2023-10-08T16:12:02.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.591+0000 7fa146ffd700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa128066f60 0x7fa128069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:02.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.591+0000 7fa146ffd700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa128066f60 0x7fa128069410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa1400076c0 tx=0x7fa14000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:02.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.595+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa138051570 con 0x7fa14815a0c0 2023-10-08T16:12:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.867+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa14804c3c0 con 0x7fa14815a0c0 2023-10-08T16:12:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.868+0000 7fa13effd700 1 -- 172.21.15.60:0/951529808 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa138054b90 con 0x7fa14815a0c0 2023-10-08T16:12:02.868 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:12:02.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:12:02.873 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:12:02.876 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:12:02.878 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.879 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:12:02.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:12:02.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:12:02.882 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:12:02.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:12:02.886 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:02.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:12:02.888 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:12:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa128066f60 msgr2=0x7fa128069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa128066f60 0x7fa128069410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa1400076c0 tx=0x7fa14000b040 comp rx=0 tx=0).stop 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 msgr2=0x7fa1480b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480b2cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa13800e870 tx=0x7fa138008040 comp rx=0 tx=0).stop 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 shutdown_connections 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa128066f60 0x7fa128069410 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1480ce1a0 0x7fa1481515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa14815a0c0 0x7fa1480b2cc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 --2- 172.21.15.60:0/951529808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa148159cf0 0x7fa14814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:02.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 >> 172.21.15.60:0/951529808 conn(0x7fa14806c6e0 msgr2=0x7fa1480c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:02.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 shutdown_connections 2023-10-08T16:12:02.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:02.870+0000 7fa14d36c700 1 -- 172.21.15.60:0/951529808 wait complete. 2023-10-08T16:12:02.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:12:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.010+0000 7f3725d10700 1 Processor -- start 2023-10-08T16:12:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.010+0000 7f3725d10700 1 -- start start 2023-10-08T16:12:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f3725d10700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37200abae0 0x7f37200c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f3725d10700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 0x7f37200c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f3725d10700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200c9cb0 con 0x7f37200c8400 2023-10-08T16:12:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f3725d10700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37200c90a0 con 0x7f37200abae0 2023-10-08T16:12:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f3725d10700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37200c9380 con 0x7f37200abeb0 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 0x7f37200c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371f7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37200abae0 0x7f37200c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 0x7f37200c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:33676/0 (socket says 172.21.15.60:33676) 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371effd700 1 -- 172.21.15.60:0/3489946049 learned_addr learned my addr 172.21.15.60:0/3489946049 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371f7fe700 1 -- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 msgr2=0x7f37200c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371f7fe700 1 --2- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 0x7f37200c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371f7fe700 1 -- 172.21.15.60:0/3489946049 >> v1:172.21.15.144:6789/0 conn(0x7f37200c8400 legacy=0x7f37200c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371f7fe700 1 -- 172.21.15.60:0/3489946049 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200c9660 con 0x7f37200abae0 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.011+0000 7f371effd700 1 --2- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 0x7f37200c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f371f7fe700 1 --2- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200c6eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f37100098e0 tx=0x7f37100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639caedcf8c7514e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f371e7fc700 1 -- 172.21.15.60:0/3489946049 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000b640 con 0x7f37200abae0 2023-10-08T16:12:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f371e7fc700 1 -- 172.21.15.60:0/3489946049 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371000b7a0 con 0x7f37200abae0 2023-10-08T16:12:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f371e7fc700 1 -- 172.21.15.60:0/3489946049 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000bb40 con 0x7f37200abae0 2023-10-08T16:12:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f3725d10700 1 -- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 msgr2=0x7f37200c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f3725d10700 1 --2- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200c6eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f37100098e0 tx=0x7f37100091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f3725d10700 1 -- 172.21.15.60:0/3489946049 shutdown_connections 2023-10-08T16:12:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f3725d10700 1 --2- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200c6eb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f3725d10700 1 --2- 172.21.15.60:0/3489946049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200abeb0 0x7f37200c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.012+0000 7f3725d10700 1 -- 172.21.15.60:0/3489946049 >> 172.21.15.60:0/3489946049 conn(0x7f3720067660 msgr2=0x7f3720067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.013+0000 7f3725d10700 1 -- 172.21.15.60:0/3489946049 shutdown_connections 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.013+0000 7f3725d10700 1 -- 172.21.15.60:0/3489946049 wait complete. 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.014+0000 7f3725d10700 1 Processor -- start 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.014+0000 7f3725d10700 1 -- start start 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.014+0000 7f3725d10700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 0x7f37200cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200c8400 0x7f37201587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200a9a90 con 0x7f37200abeb0 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200a9d70 con 0x7f37200abae0 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37200aa050 con 0x7f37200c8400 2023-10-08T16:12:03.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 0x7f37200cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 0x7f37200cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45892/0 (socket says 172.21.15.60:45892) 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 -- 172.21.15.60:0/2763204960 learned_addr learned my addr 172.21.15.60:0/2763204960 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371ffff700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200c8400 0x7f37201587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 -- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200c8400 msgr2=0x7f37201587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200c8400 0x7f37201587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 -- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 msgr2=0x7f37200a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 -- 172.21.15.60:0/2763204960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140094f0 con 0x7f37200abeb0 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f371effd700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 0x7f37200cae90 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f3714009f10 tx=0x7f3714009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400c850 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400c9b0 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3710009420 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400cd30 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.015+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37200aa690 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.016+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372004c3c0 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.017+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3714011660 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.017+0000 7f37077fe700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f370c066f30 0x7f370c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.017+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f37140861a0 con 0x7f37200abeb0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.017+0000 7f371f7fe700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f370c066f30 0x7f370c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.018+0000 7f371f7fe700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f370c066f30 0x7f370c0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37100091e0 tx=0x7f3710017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.022+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3714053760 con 0x7f37200abeb0 2023-10-08T16:12:03.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.215+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37200c3920 con 0x7f37200abeb0 2023-10-08T16:12:03.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.216+0000 7f37077fe700 1 -- 172.21.15.60:0/2763204960 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f3714056d80 con 0x7f37200abeb0 2023-10-08T16:12:03.216 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:03.216 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":144,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:12:02.436784+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:12:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f370c066f30 msgr2=0x7f370c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f370c066f30 0x7f370c0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37100091e0 tx=0x7f3710017000 comp rx=0 tx=0).stop 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 msgr2=0x7f37200cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 0x7f37200cae90 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f3714009f10 tx=0x7f3714009250 comp rx=0 tx=0).stop 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 shutdown_connections 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f370c066f30 0x7f370c0693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37200c8400 0x7f37201587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200abae0 0x7f37200a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 --2- 172.21.15.60:0/2763204960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37200abeb0 0x7f37200cae90 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 >> 172.21.15.60:0/2763204960 conn(0x7f3720067660 msgr2=0x7f37200c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 shutdown_connections 2023-10-08T16:12:03.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.218+0000 7f3725d10700 1 -- 172.21.15.60:0/2763204960 wait complete. 2023-10-08T16:12:03.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:12:03.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:12:03.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-08T16:12:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.352+0000 7fbc5079e700 1 Processor -- start 2023-10-08T16:12:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.352+0000 7fbc5079e700 1 -- start start 2023-10-08T16:12:03.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc5079e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 0x7fbc4815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc5079e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc480c9390 0x7fbc4815a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc5079e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480cae70 con 0x7fbc480678b0 2023-10-08T16:12:03.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc5079e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc480cb150 con 0x7fbc480c9390 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc5079e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480cb430 con 0x7fbc480cbf10 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc4e53a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbc480678b0 0x7fbc4815db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42908/0 (socket says 172.21.15.60:42908) 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.353+0000 7fbc4e53a700 1 -- 172.21.15.60:0/4232664710 learned_addr learned my addr 172.21.15.60:0/4232664710 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4dd39700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 0x7fbc4815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4ed3b700 1 --2- 172.21.15.60:0/4232664710 >> v2:172.21.15.144:3300/0 conn(0x7fbc480c9390 0x7fbc4815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854994906 0 0) 0x7fbc480cae70 con 0x7fbc480678b0 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc30003570 con 0x7fbc480678b0 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3590637331 0 0) 0x7fbc30003570 con 0x7fbc480678b0 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 msgr2=0x7fbc4815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 0x7fbc4815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 >> v2:172.21.15.144:3300/0 conn(0x7fbc480c9390 msgr2=0x7fbc4815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 --2- 172.21.15.60:0/4232664710 >> v2:172.21.15.144:3300/0 conn(0x7fbc480c9390 0x7fbc4815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480cb710 con 0x7fbc480678b0 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fbc40001470 con 0x7fbc480678b0 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 >> v1:172.21.15.60:6789/0 conn(0x7fbc480678b0 legacy=0x7fbc4815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30003a60 0x7fbc30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc30004810 0x7fbc30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 0x7fbc300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480cb150 con 0x7fbc30004810 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480cb430 con 0x7fbc30003a60 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3000ba60 con 0x7fbc480cbf10 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4dd39700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc30004810 0x7fbc30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4e53a700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30003a60 0x7fbc30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4ed3b700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 0x7fbc300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4dd39700 1 -- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 msgr2=0x7fbc300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.354+0000 7fbc4dd39700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480cbf10 0x7fbc300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4dd39700 1 -- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30003a60 msgr2=0x7fbc30003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4dd39700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30003a60 0x7fbc30003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4dd39700 1 -- 172.21.15.60:0/4232664710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30003570 con 0x7fbc30004810 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4dd39700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc30004810 0x7fbc30004c80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009c30 tx=0x7fbc3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473827475255ff2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00e710 con 0x7fbc30004810 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c00e870 con 0x7fbc30004810 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4d538700 1 -- 172.21.15.60:0/4232664710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00ec30 con 0x7fbc30004810 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc5079e700 1 -- 172.21.15.60:0/4232664710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc30004810 msgr2=0x7fbc30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc5079e700 1 --2- 172.21.15.60:0/4232664710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc30004810 0x7fbc30004c80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009c30 tx=0x7fbc3c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc4ed3b700 1 -- 172.21.15.60:0/4232664710 reap_dead start 2023-10-08T16:12:03.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc5079e700 1 -- 172.21.15.60:0/4232664710 shutdown_connections 2023-10-08T16:12:03.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc5079e700 1 -- 172.21.15.60:0/4232664710 >> 172.21.15.60:0/4232664710 conn(0x7fbc48069870 msgr2=0x7fbc48069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:03.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc5079e700 1 -- 172.21.15.60:0/4232664710 shutdown_connections 2023-10-08T16:12:03.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.355+0000 7fbc5079e700 1 -- 172.21.15.60:0/4232664710 wait complete. 2023-10-08T16:12:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 Processor -- start 2023-10-08T16:12:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 -- start start 2023-10-08T16:12:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30004810 0x7fbc480c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480c5cb0 0x7fbc4814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 0x7fbc4814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480c6250 con 0x7fbc4814e9f0 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814f710 con 0x7fbc30004810 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.357+0000 7fbc5079e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814f9f0 con 0x7fbc480c5cb0 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 0x7fbc4814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 0x7fbc4814ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45912/0 (socket says 172.21.15.60:45912) 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 -- 172.21.15.60:0/3503487146 learned_addr learned my addr 172.21.15.60:0/3503487146 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4e53a700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30004810 0x7fbc480c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4dd39700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480c5cb0 0x7fbc4814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 -- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480c5cb0 msgr2=0x7fbc4814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480c5cb0 0x7fbc4814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 -- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30004810 msgr2=0x7fbc480c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30004810 0x7fbc480c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 -- 172.21.15.60:0/3503487146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4814fcd0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc4ed3b700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 0x7fbc4814ee60 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fbc480b4c00 tx=0x7fbc3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800e070 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38011b80 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38016470 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc480c8b90 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.358+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4815d4f0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.359+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4814f560 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.360+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc380168a0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.360+0000 7fbc467fc700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc34066f30 0x7fbc340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.360+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbc38084bf0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.360+0000 7fbc4e53a700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc34066f30 0x7fbc340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.360+0000 7fbc4e53a700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc34066f30 0x7fbc340693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbc40001200 tx=0x7fbc40007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.364+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc380521b0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:03.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:03.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.555+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc4804c3c0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.556+0000 7fbc467fc700 1 -- 172.21.15.60:0/3503487146 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc380557d0 con 0x7fbc4814e9f0 2023-10-08T16:12:03.556 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:12:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.557+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc34066f30 msgr2=0x7fbc340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.557+0000 7fbc5079e700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc34066f30 0x7fbc340693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbc40001200 tx=0x7fbc40007040 comp rx=0 tx=0).stop 2023-10-08T16:12:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.557+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 msgr2=0x7fbc4814ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.557+0000 7fbc5079e700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 0x7fbc4814ee60 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fbc480b4c00 tx=0x7fbc3800b040 comp rx=0 tx=0).stop 2023-10-08T16:12:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.557+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 shutdown_connections 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbc34066f30 0x7fbc340693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4814e9f0 0x7fbc4814ee60 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc30004810 0x7fbc480c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 --2- 172.21.15.60:0/3503487146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc480c5cb0 0x7fbc4814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 >> 172.21.15.60:0/3503487146 conn(0x7fbc48069870 msgr2=0x7fbc480b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 shutdown_connections 2023-10-08T16:12:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.558+0000 7fbc5079e700 1 -- 172.21.15.60:0/3503487146 wait complete. 2023-10-08T16:12:03.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:12:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.688+0000 7fe2dfa2f700 1 Processor -- start 2023-10-08T16:12:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.689+0000 7fe2dfa2f700 1 -- start start 2023-10-08T16:12:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.689+0000 7fe2dfa2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 0x7fe2d815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.689+0000 7fe2dfa2f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe2d8157c40 0x7fe2d8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.689+0000 7fe2dfa2f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d815cbb0 con 0x7fe2d815a620 2023-10-08T16:12:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.689+0000 7fe2dfa2f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d815bfa0 con 0x7fe2d8157c40 2023-10-08T16:12:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.689+0000 7fe2dfa2f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d815c280 con 0x7fe2d8157870 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2dcfca700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe2d815a620 0x7fe2d815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42914/0 (socket says 172.21.15.60:42914) 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2dcfca700 1 -- 172.21.15.60:0/853213562 learned_addr learned my addr 172.21.15.60:0/853213562 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/853213562 >> v2:172.21.15.144:3300/0 conn(0x7fe2d8157c40 0x7fe2d8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2dd7cb700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 0x7fe2d815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325887531 0 0) 0x7fe2d815cbb0 con 0x7fe2d815a620 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c0003570 con 0x7fe2d815a620 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678196710 0 0) 0x7fe2c0003570 con 0x7fe2d815a620 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 msgr2=0x7fe2d815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 0x7fe2d815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 >> v2:172.21.15.144:3300/0 conn(0x7fe2d8157c40 msgr2=0x7fe2d8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 --2- 172.21.15.60:0/853213562 >> v2:172.21.15.144:3300/0 conn(0x7fe2d8157c40 0x7fe2d8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d815c560 con 0x7fe2d815a620 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fe2cc001470 con 0x7fe2d815a620 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 >> v1:172.21.15.60:6789/0 conn(0x7fe2d815a620 legacy=0x7fe2d815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2c0003a60 0x7fe2c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 0x7fe2c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c0004d50 0x7fe2c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d815bfa0 con 0x7fe2c0004d50 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d815c280 con 0x7fe2c0003a60 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c000ba60 con 0x7fe2d8157870 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c0004d50 0x7fe2c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2dd7cb700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2c0003a60 0x7fe2c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.690+0000 7fe2dcfca700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 0x7fe2c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 msgr2=0x7fe2c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d8157870 0x7fe2c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2c0003a60 msgr2=0x7fe2c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2c0003a60 0x7fe2c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/853213562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0003570 con 0x7fe2c0004d50 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c0004d50 0x7fe2c00051c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009c00 tx=0x7fe2d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74baf41a68f5df24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000e6b0 con 0x7fe2c0004d50 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000e810 con 0x7fe2c0004d50 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2d7fff700 1 -- 172.21.15.60:0/853213562 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000ebd0 con 0x7fe2c0004d50 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/853213562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c0004d50 msgr2=0x7fe2c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/853213562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c0004d50 0x7fe2c00051c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009c00 tx=0x7fe2d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.691+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/853213562 reap_dead start 2023-10-08T16:12:03.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.692+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/853213562 shutdown_connections 2023-10-08T16:12:03.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.692+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/853213562 >> 172.21.15.60:0/853213562 conn(0x7fe2d8068ce0 msgr2=0x7fe2d80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:03.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.692+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/853213562 shutdown_connections 2023-10-08T16:12:03.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.692+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/853213562 wait complete. 2023-10-08T16:12:03.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.693+0000 7fe2dfa2f700 1 Processor -- start 2023-10-08T16:12:03.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.693+0000 7fe2dfa2f700 1 -- start start 2023-10-08T16:12:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d813f710 0x7fe2d80b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d8151e10 0x7fe2d81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 0x7fe2d8153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d814eb20 con 0x7fe2d813fae0 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d814ee00 con 0x7fe2d8151e10 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8153f70 con 0x7fe2d813f710 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 0x7fe2d8153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 0x7fe2d8153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45936/0 (socket says 172.21.15.60:45936) 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/3760318723 learned_addr learned my addr 172.21.15.60:0/3760318723 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dd7cb700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d813f710 0x7fe2d80b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dcfca700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d8151e10 0x7fe2d81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d813f710 msgr2=0x7fe2d80b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d813f710 0x7fe2d80b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d8151e10 msgr2=0x7fe2d81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d8151e10 0x7fe2d81534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 -- 172.21.15.60:0/3760318723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80b2c20 con 0x7fe2d813fae0 2023-10-08T16:12:03.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dcfca700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d8151e10 0x7fe2d81534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dd7cb700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d813f710 0x7fe2d80b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2ddfcc700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 0x7fe2d8153a30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000e4b0 tx=0x7fe2d001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0022070 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000eb90 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80b2f00 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.694+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000e6b0 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.695+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80b27f0 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.695+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d80b29e0 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.696+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2d001c970 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.696+0000 7fe2d57fa700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2c4066f30 0x7fe2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.697+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe2d0000e40 con 0x7fe2d813fae0 2023-10-08T16:12:03.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.697+0000 7fe2dd7cb700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2c4066f30 0x7fe2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.697+0000 7fe2dd7cb700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2c4066f30 0x7fe2c40693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009fd0 tx=0x7fe2c800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.701+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d80b29e0 con 0x7fe2d813fae0 2023-10-08T16:12:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.896+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe2d80b29e0 con 0x7fe2d813fae0 2023-10-08T16:12:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.896+0000 7fe2d57fa700 1 -- 172.21.15.60:0/3760318723 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v144) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe2d80b29e0 con 0x7fe2d813fae0 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:12:03.897 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2c4066f30 msgr2=0x7fe2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2c4066f30 0x7fe2c40693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009fd0 tx=0x7fe2c800b040 comp rx=0 tx=0).stop 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 msgr2=0x7fe2d8153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 0x7fe2d8153a30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000e4b0 tx=0x7fe2d001a000 comp rx=0 tx=0).stop 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 shutdown_connections 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe2c4066f30 0x7fe2c40693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2d813f710 0x7fe2d80b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d813fae0 0x7fe2d8153a30 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 --2- 172.21.15.60:0/3760318723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d8151e10 0x7fe2d81534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 >> 172.21.15.60:0/3760318723 conn(0x7fe2d8068ce0 msgr2=0x7fe2d80d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:03.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 shutdown_connections 2023-10-08T16:12:03.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:03.898+0000 7fe2dfa2f700 1 -- 172.21.15.60:0/3760318723 wait complete. 2023-10-08T16:12:03.911 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:12:03.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:12:04.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.034+0000 7f0cae07c700 1 Processor -- start 2023-10-08T16:12:04.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.034+0000 7f0cae07c700 1 -- start start 2023-10-08T16:12:04.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.034+0000 7f0cae07c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ca80b11f0 0x7f0ca80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.034+0000 7f0cae07c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80b0d60 con 0x7f0ca8159e50 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.034+0000 7f0cae07c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80b3540 con 0x7f0ca8068cb0 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.034+0000 7f0cae07c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80d15b0 con 0x7f0ca80b11f0 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0ca8159e50 0x7f0ca80b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42928/0 (socket says 172.21.15.60:42928) 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca77fe700 1 -- 172.21.15.60:0/1583532693 learned_addr learned my addr 172.21.15.60:0/1583532693 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca6ffd700 1 --2- 172.21.15.60:0/1583532693 >> v2:172.21.15.144:3300/0 conn(0x7f0ca80b11f0 0x7f0ca80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca67fc700 1 -- 172.21.15.60:0/1583532693 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447910311 0 0) 0x7f0ca80b0d60 con 0x7f0ca8159e50 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca67fc700 1 -- 172.21.15.60:0/1583532693 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c90003570 con 0x7f0ca8159e50 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca6ffd700 1 -- 172.21.15.60:0/1583532693 >> v1:172.21.15.144:6789/0 conn(0x7f0ca8068cb0 legacy=0x7f0ca80690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca67fc700 1 -- 172.21.15.60:0/1583532693 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403095139 0 0) 0x7f0ca80b3540 con 0x7f0ca8068cb0 2023-10-08T16:12:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca6ffd700 1 -- 172.21.15.60:0/1583532693 >> v1:172.21.15.60:6789/0 conn(0x7f0ca8159e50 legacy=0x7f0ca80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca6ffd700 1 -- 172.21.15.60:0/1583532693 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80d1890 con 0x7f0ca80b11f0 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.035+0000 7f0ca6ffd700 1 --2- 172.21.15.60:0/1583532693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca80b11f0 0x7f0ca80b1660 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0098e0 tx=0x7f0c9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a99546b068781a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0ca67fc700 1 -- 172.21.15.60:0/1583532693 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98001470 con 0x7f0ca80b11f0 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0ca67fc700 1 -- 172.21.15.60:0/1583532693 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c011420 con 0x7f0ca80b11f0 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0ca67fc700 1 -- 172.21.15.60:0/1583532693 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0117c0 con 0x7f0ca80b11f0 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 -- 172.21.15.60:0/1583532693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca80b11f0 msgr2=0x7f0ca80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 --2- 172.21.15.60:0/1583532693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca80b11f0 0x7f0ca80b1660 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0098e0 tx=0x7f0c9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 -- 172.21.15.60:0/1583532693 shutdown_connections 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 --2- 172.21.15.60:0/1583532693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca80b11f0 0x7f0ca80b1660 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 -- 172.21.15.60:0/1583532693 >> 172.21.15.60:0/1583532693 conn(0x7f0ca8068130 msgr2=0x7f0ca80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:04.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 -- 172.21.15.60:0/1583532693 shutdown_connections 2023-10-08T16:12:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.036+0000 7f0cae07c700 1 -- 172.21.15.60:0/1583532693 wait complete. 2023-10-08T16:12:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.037+0000 7f0cae07c700 1 Processor -- start 2023-10-08T16:12:04.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.037+0000 7f0cae07c700 1 -- start start 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0cae07c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 0x7f0ca8158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0cae07c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ca80b11f0 0x7f0ca80cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0cae07c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8159e50 0x7f0ca80cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0cae07c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80cc490 con 0x7f0ca8068cb0 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0cae07c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80cb880 con 0x7f0ca8159e50 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0cae07c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80cbb60 con 0x7f0ca80b11f0 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 0x7f0ca8158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 0x7f0ca8158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45938/0 (socket says 172.21.15.60:45938) 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0ca77fe700 1 -- 172.21.15.60:0/3161293532 learned_addr learned my addr 172.21.15.60:0/3161293532 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0ca6ffd700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ca80b11f0 0x7f0ca80cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.038+0000 7f0ca7fff700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8159e50 0x7f0ca80cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca77fe700 1 -- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ca80b11f0 msgr2=0x7f0ca80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca77fe700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ca80b11f0 0x7f0ca80cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca77fe700 1 -- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8159e50 msgr2=0x7f0ca80cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca77fe700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8159e50 0x7f0ca80cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca77fe700 1 -- 172.21.15.60:0/3161293532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c009420 con 0x7f0ca8068cb0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca7fff700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8159e50 0x7f0ca80cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0ca77fe700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 0x7f0ca8158850 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0c980015a0 tx=0x7f0c98001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98007360 con 0x7f0ca8068cb0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980074e0 con 0x7f0ca8068cb0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80cbe40 con 0x7f0ca8068cb0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98004830 con 0x7f0ca8068cb0 2023-10-08T16:12:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.039+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca80cc920 con 0x7f0ca8068cb0 2023-10-08T16:12:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.040+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80cc770 con 0x7f0ca8068cb0 2023-10-08T16:12:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.040+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c98004bc0 con 0x7f0ca8068cb0 2023-10-08T16:12:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.041+0000 7f0c8f7fe700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c94066f30 0x7f0c940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.041+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0c98083a10 con 0x7f0ca8068cb0 2023-10-08T16:12:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.041+0000 7f0ca6ffd700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c94066f30 0x7f0c940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.041+0000 7f0ca6ffd700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c94066f30 0x7f0c940693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0030c0 tx=0x7f0c9c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.045+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c98051050 con 0x7f0ca8068cb0 2023-10-08T16:12:04.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.239+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0ca804c3c0 con 0x7f0ca8068cb0 2023-10-08T16:12:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.450+0000 7f0c8f7fe700 1 -- 172.21.15.60:0/3161293532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v145) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c98054670 con 0x7f0ca8068cb0 2023-10-08T16:12:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c94066f30 msgr2=0x7f0c940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c94066f30 0x7f0c940693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0030c0 tx=0x7f0c9c017000 comp rx=0 tx=0).stop 2023-10-08T16:12:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 msgr2=0x7f0ca8158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 0x7f0ca8158850 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0c980015a0 tx=0x7f0c98001bf0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 shutdown_connections 2023-10-08T16:12:04.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0c94066f30 0x7f0c940693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8159e50 0x7f0ca80cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ca8068cb0 0x7f0ca8158850 secure :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0c980015a0 tx=0x7f0c98001bf0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 --2- 172.21.15.60:0/3161293532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ca80b11f0 0x7f0ca80cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 >> 172.21.15.60:0/3161293532 conn(0x7f0ca8068130 msgr2=0x7f0ca8158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 shutdown_connections 2023-10-08T16:12:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.454+0000 7f0cae07c700 1 -- 172.21.15.60:0/3161293532 wait complete. 2023-10-08T16:12:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:12:04.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:12:04.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.593+0000 7f262884f700 1 Processor -- start 2023-10-08T16:12:04.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.593+0000 7f262884f700 1 -- start start 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f262884f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26240cea30 0x7f26240aa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f262884f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240cf820 con 0x7f26240b0b10 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f262884f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240cef80 con 0x7f2624159bf0 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f262884f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26240cf260 con 0x7f26240cea30 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f2622ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f26240b0b10 0x7f26240b3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42944/0 (socket says 172.21.15.60:42944) 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f2622ffd700 1 -- 172.21.15.60:0/86125232 learned_addr learned my addr 172.21.15.60:0/86125232 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f2623fff700 1 --2- 172.21.15.60:0/86125232 >> v2:172.21.15.144:3300/0 conn(0x7f26240cea30 0x7f26240aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137687538 0 0) 0x7f26240cf820 con 0x7f26240b0b10 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.594+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c003570 con 0x7f26240b0b10 2023-10-08T16:12:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093828138 0 0) 0x7f26240cef80 con 0x7f2624159bf0 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26240cf820 con 0x7f2624159bf0 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909855527 0 0) 0x7f260c003570 con 0x7f26240b0b10 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 >> v2:172.21.15.144:3300/0 conn(0x7f26240cea30 msgr2=0x7f26240aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 --2- 172.21.15.60:0/86125232 >> v2:172.21.15.144:3300/0 conn(0x7f26240cea30 0x7f26240aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 >> v1:172.21.15.144:6789/0 conn(0x7f2624159bf0 legacy=0x7f26240b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240cf540 con 0x7f26240b0b10 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f2618001470 con 0x7f26240b0b10 2023-10-08T16:12:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 >> v1:172.21.15.60:6789/0 conn(0x7f26240b0b10 legacy=0x7f26240b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c003bf0 0x7f260c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c004810 0x7f260c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c0051c0 0x7f260c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240cf260 con 0x7f260c004810 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00c0b0 con 0x7f260c0051c0 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00c270 con 0x7f260c003bf0 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c004810 0x7f260c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26237fe700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c003bf0 0x7f260c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2623fff700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c0051c0 0x7f260c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 -- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c003bf0 msgr2=0x7f260c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f260c003bf0 0x7f260c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 -- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c0051c0 msgr2=0x7f260c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c0051c0 0x7f260c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2623fff700 1 -- 172.21.15.60:0/86125232 reap_dead start 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 -- 172.21.15.60:0/86125232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c003570 con 0x7f260c004810 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f2622ffd700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c004810 0x7f260c004c80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f261800c2d0 tx=0x7f2618001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a96fbe8128e3ea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.595+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800cb60 con 0x7f260c004810 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800cce0 con 0x7f260c004810 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f26227fc700 1 -- 172.21.15.60:0/86125232 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618005b70 con 0x7f260c004810 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 -- 172.21.15.60:0/86125232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c004810 msgr2=0x7f260c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c004810 0x7f260c004c80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f261800c2d0 tx=0x7f2618001e10 comp rx=0 tx=0).stop 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 -- 172.21.15.60:0/86125232 shutdown_connections 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 --2- 172.21.15.60:0/86125232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f260c004810 0x7f260c004c80 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 -- 172.21.15.60:0/86125232 >> 172.21.15.60:0/86125232 conn(0x7f262406c6f0 msgr2=0x7f2624069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:04.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 -- 172.21.15.60:0/86125232 shutdown_connections 2023-10-08T16:12:04.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.596+0000 7f262884f700 1 -- 172.21.15.60:0/86125232 wait complete. 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.597+0000 7f262884f700 1 Processor -- start 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.597+0000 7f262884f700 1 -- start start 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f262884f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c004810 0x7f262415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f262884f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 0x7f262415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f262884f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f262415ede0 0x7f262415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f262884f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262415cab0 con 0x7f262415b9e0 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f262884f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624156aa0 con 0x7f260c004810 2023-10-08T16:12:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f262884f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262415c210 con 0x7f262415ede0 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 0x7f262415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 0x7f262415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45970/0 (socket says 172.21.15.60:45970) 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 -- 172.21.15.60:0/3923879882 learned_addr learned my addr 172.21.15.60:0/3923879882 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2623fff700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f262415ede0 0x7f262415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 -- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f262415ede0 msgr2=0x7f262415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f262415ede0 0x7f262415f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 -- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c004810 msgr2=0x7f262415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c004810 0x7f262415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.598+0000 7f2622ffd700 1 -- 172.21.15.60:0/3923879882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262415c4f0 con 0x7f262415b9e0 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.599+0000 7f2622ffd700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 0x7f262415e8a0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2618001e50 tx=0x7f2618015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.599+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618001b30 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.599+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618001060 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.599+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618007320 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.599+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262415c7d0 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.599+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262415be50 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.600+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262416aeb0 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.600+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26180076d0 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.601+0000 7f260b7fe700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2610066f30 0x7f26100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.601+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f26180854b0 con 0x7f262415b9e0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.601+0000 7f26237fe700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2610066f30 0x7f26100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.601+0000 7f26237fe700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2610066f30 0x7f26100693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2614000c00 tx=0x7f2614007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.605+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26180529b0 con 0x7f262415b9e0 2023-10-08T16:12:04.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:04.801+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f262416ab50 con 0x7f262415b9e0 2023-10-08T16:12:05.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.454+0000 7f260b7fe700 1 -- 172.21.15.60:0/3923879882 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v146) v1 ==== 170+0+0 (secure 0 0 0) 0x7f262416ab50 con 0x7f262415b9e0 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.461+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2610066f30 msgr2=0x7f26100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.461+0000 7f262884f700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2610066f30 0x7f26100693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2614000c00 tx=0x7f2614007d30 comp rx=0 tx=0).stop 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.461+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 msgr2=0x7f262415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.461+0000 7f262884f700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 0x7f262415e8a0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2618001e50 tx=0x7f2618015000 comp rx=0 tx=0).stop 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.462+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 shutdown_connections 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.462+0000 7f262884f700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2610066f30 0x7f26100693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.462+0000 7f262884f700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f262415ede0 0x7f262415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.462+0000 7f262884f700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f260c004810 0x7f262415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.462+0000 7f262884f700 1 --2- 172.21.15.60:0/3923879882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f262415b9e0 0x7f262415e8a0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.462+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 >> 172.21.15.60:0/3923879882 conn(0x7f262406c6f0 msgr2=0x7f26240ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:05.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.463+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 shutdown_connections 2023-10-08T16:12:05.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.465+0000 7f262884f700 1 -- 172.21.15.60:0/3923879882 wait complete. 2023-10-08T16:12:05.469 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:12:05.482 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:12:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 Processor -- start 2023-10-08T16:12:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 -- start start 2023-10-08T16:12:05.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2fec0697c0 0x7f2fec15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2fec15a230 0x7f2fec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec15ea90 con 0x7f2fec159e60 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0d1cf0 con 0x7f2fec15a230 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.609+0000 7f2ff2298700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0b3100 con 0x7f2fec0697c0 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2fec15a230 0x7f2fec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2fec15a230 0x7f2fec0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45972/0 (socket says 172.21.15.60:45972) 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 -- 172.21.15.60:0/2212342532 learned_addr learned my addr 172.21.15.60:0/2212342532 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2feb7fe700 1 --2- 172.21.15.60:0/2212342532 >> v2:172.21.15.144:3300/0 conn(0x7f2fec0697c0 0x7f2fec15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 -- 172.21.15.60:0/2212342532 >> v2:172.21.15.144:3300/0 conn(0x7f2fec0697c0 msgr2=0x7f2fec15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 --2- 172.21.15.60:0/2212342532 >> v2:172.21.15.144:3300/0 conn(0x7f2fec0697c0 0x7f2fec15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 -- 172.21.15.60:0/2212342532 >> v1:172.21.15.144:6789/0 conn(0x7f2fec159e60 legacy=0x7f2fec0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 -- 172.21.15.60:0/2212342532 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0d10e0 con 0x7f2fec15a230 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2ff0835700 1 --2- 172.21.15.60:0/2212342532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec15a230 0x7f2fec0af730 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0b3860 tx=0x7f2fe4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9218b87ee1c5c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2feaffd700 1 -- 172.21.15.60:0/2212342532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400e070 con 0x7f2fec15a230 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2feaffd700 1 -- 172.21.15.60:0/2212342532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe400ba50 con 0x7f2fec15a230 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.610+0000 7f2feaffd700 1 -- 172.21.15.60:0/2212342532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40092e0 con 0x7f2fec15a230 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 -- 172.21.15.60:0/2212342532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec15a230 msgr2=0x7f2fec0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 --2- 172.21.15.60:0/2212342532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec15a230 0x7f2fec0af730 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0b3860 tx=0x7f2fe4009840 comp rx=0 tx=0).stop 2023-10-08T16:12:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 -- 172.21.15.60:0/2212342532 shutdown_connections 2023-10-08T16:12:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 --2- 172.21.15.60:0/2212342532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec15a230 0x7f2fec0af730 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 --2- 172.21.15.60:0/2212342532 >> v2:172.21.15.144:3300/0 conn(0x7f2fec0697c0 0x7f2fec15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 -- 172.21.15.60:0/2212342532 >> 172.21.15.60:0/2212342532 conn(0x7f2fec070700 msgr2=0x7f2fec070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 -- 172.21.15.60:0/2212342532 shutdown_connections 2023-10-08T16:12:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.611+0000 7f2ff2298700 1 -- 172.21.15.60:0/2212342532 wait complete. 2023-10-08T16:12:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.612+0000 7f2ff2298700 1 Processor -- start 2023-10-08T16:12:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.612+0000 7f2ff2298700 1 -- start start 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff2298700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 0x7f2fec0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff2298700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fec159e60 0x7f2fec14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff2298700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fec15a230 0x7f2fec0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff2298700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0ca8d0 con 0x7f2fec0697c0 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff2298700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0ca5a0 con 0x7f2fec159e60 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff2298700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0cb2a0 con 0x7f2fec15a230 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 0x7f2fec0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 0x7f2fec0cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45974/0 (socket says 172.21.15.60:45974) 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 -- 172.21.15.60:0/352195211 learned_addr learned my addr 172.21.15.60:0/352195211 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2feb7fe700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fec159e60 0x7f2fec14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2ff0835700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fec15a230 0x7f2fec0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 -- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fec15a230 msgr2=0x7f2fec0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fec15a230 0x7f2fec0c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 -- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fec159e60 msgr2=0x7f2fec14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fec159e60 0x7f2fec14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 -- 172.21.15.60:0/352195211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009ae0 con 0x7f2fec0697c0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.613+0000 7f2febfff700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 0x7f2fec0cad60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c590 tx=0x7f2fdc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.614+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc011590 con 0x7f2fec0697c0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.614+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc011710 con 0x7f2fec0697c0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.614+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec0c7eb0 con 0x7f2fec0697c0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.614+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc011ad0 con 0x7f2fec0697c0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.614+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec14d6c0 con 0x7f2fec0697c0 2023-10-08T16:12:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.615+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec0cabb0 con 0x7f2fec0697c0 2023-10-08T16:12:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.615+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fdc01b3b0 con 0x7f2fec0697c0 2023-10-08T16:12:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.615+0000 7f2fd3fff700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.616+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2fdc0839a0 con 0x7f2fec0697c0 2023-10-08T16:12:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.616+0000 7f2feb7fe700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.616+0000 7f2feb7fe700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fd8066f30 0x7f2fd80693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fec15cfb0 tx=0x7f2fe0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.620+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fdc050c70 con 0x7f2fec0697c0 2023-10-08T16:12:05.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:05.857+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2fec04c3c0 con 0x7f2fec0697c0 2023-10-08T16:12:06.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.487+0000 7f2fd3fff700 1 -- 172.21.15.60:0/352195211 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2fdc017070 con 0x7f2fec0697c0 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.491+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fd8066f30 msgr2=0x7f2fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.491+0000 7f2ff2298700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fd8066f30 0x7f2fd80693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fec15cfb0 tx=0x7f2fe0008040 comp rx=0 tx=0).stop 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.491+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 msgr2=0x7f2fec0cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.491+0000 7f2ff2298700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 0x7f2fec0cad60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c590 tx=0x7f2fdc00c8a0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.492+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 shutdown_connections 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.492+0000 7f2ff2298700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.492+0000 7f2ff2298700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fec15a230 0x7f2fec0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.492+0000 7f2ff2298700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec0697c0 0x7f2fec0cad60 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.492+0000 7f2ff2298700 1 --2- 172.21.15.60:0/352195211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fec159e60 0x7f2fec14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.492+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 >> 172.21.15.60:0/352195211 conn(0x7f2fec070700 msgr2=0x7f2fec0b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:06.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.494+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 shutdown_connections 2023-10-08T16:12:06.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.494+0000 7f2ff2298700 1 -- 172.21.15.60:0/352195211 wait complete. 2023-10-08T16:12:06.495 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 18 and data pool 19 2023-10-08T16:12:06.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:12:06.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.630+0000 7fe4877a9700 1 Processor -- start 2023-10-08T16:12:06.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.631+0000 7fe4877a9700 1 -- start start 2023-10-08T16:12:06.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.631+0000 7fe4877a9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe480159e10 0x7fe4800b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.631+0000 7fe4877a9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe48015a1e0 0x7fe4800b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.631+0000 7fe4877a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48015db80 con 0x7fe4800b1610 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.631+0000 7fe4877a9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48015e800 con 0x7fe48015a1e0 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.631+0000 7fe4877a9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48015de60 con 0x7fe480159e10 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe48015a1e0 0x7fe4800b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe48015a1e0 0x7fe4800b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45990/0 (socket says 172.21.15.60:45990) 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 -- 172.21.15.60:0/3336855937 learned_addr learned my addr 172.21.15.60:0/3336855937 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 -- 172.21.15.60:0/3336855937 >> v2:172.21.15.144:3300/0 conn(0x7fe480159e10 msgr2=0x7fe4800b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe485545700 1 --2- 172.21.15.60:0/3336855937 >> v2:172.21.15.144:3300/0 conn(0x7fe480159e10 0x7fe4800b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 --2- 172.21.15.60:0/3336855937 >> v2:172.21.15.144:3300/0 conn(0x7fe480159e10 0x7fe4800b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 -- 172.21.15.60:0/3336855937 >> v1:172.21.15.144:6789/0 conn(0x7fe4800b1610 legacy=0x7fe4800cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:06.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 -- 172.21.15.60:0/3336855937 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48015e140 con 0x7fe48015a1e0 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe485545700 1 --2- 172.21.15.60:0/3336855937 >> v2:172.21.15.144:3300/0 conn(0x7fe480159e10 0x7fe4800b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe484d44700 1 --2- 172.21.15.60:0/3336855937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe4800b3260 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe480068a60 tx=0x7fe474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3e31e7098556ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe47ffff700 1 -- 172.21.15.60:0/3336855937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400b820 con 0x7fe48015a1e0 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe47ffff700 1 -- 172.21.15.60:0/3336855937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47400b980 con 0x7fe48015a1e0 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.632+0000 7fe47ffff700 1 -- 172.21.15.60:0/3336855937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400bd20 con 0x7fe48015a1e0 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 -- 172.21.15.60:0/3336855937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 msgr2=0x7fe4800b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 --2- 172.21.15.60:0/3336855937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe4800b3260 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe480068a60 tx=0x7fe474009250 comp rx=0 tx=0).stop 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 -- 172.21.15.60:0/3336855937 shutdown_connections 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 --2- 172.21.15.60:0/3336855937 >> v2:172.21.15.144:3300/0 conn(0x7fe480159e10 0x7fe4800b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 --2- 172.21.15.60:0/3336855937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe4800b3260 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 -- 172.21.15.60:0/3336855937 >> 172.21.15.60:0/3336855937 conn(0x7fe480067660 msgr2=0x7fe480067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 -- 172.21.15.60:0/3336855937 shutdown_connections 2023-10-08T16:12:06.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.633+0000 7fe4877a9700 1 -- 172.21.15.60:0/3336855937 wait complete. 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.634+0000 7fe4877a9700 1 Processor -- start 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.634+0000 7fe4877a9700 1 -- start start 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe4877a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4800b1610 0x7fe4800cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe4877a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe480159e10 0x7fe480157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe4877a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe48015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe4877a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800d0750 con 0x7fe48015a1e0 2023-10-08T16:12:06.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe4877a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800cfb40 con 0x7fe4800b1610 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe4877a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800cfe20 con 0x7fe480159e10 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe48015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe48015c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46000/0 (socket says 172.21.15.60:46000) 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 -- 172.21.15.60:0/2278941145 learned_addr learned my addr 172.21.15.60:0/2278941145 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485545700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4800b1610 0x7fe4800cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe484d44700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe480159e10 0x7fe480157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 -- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe480159e10 msgr2=0x7fe480157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe480159e10 0x7fe480157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 -- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4800b1610 msgr2=0x7fe4800cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4800b1610 0x7fe4800cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 -- 172.21.15.60:0/2278941145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740094f0 con 0x7fe48015a1e0 2023-10-08T16:12:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.635+0000 7fe485d46700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe48015c7a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c930 tx=0x7fe4780026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.636+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800ce70 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.636+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800a7e0 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.636+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4800d0100 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.636+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800aba0 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.636+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4800cf770 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.637+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4800d08c0 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.637+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe478012420 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.637+0000 7fe47d7fa700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.638+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe478084910 con 0x7fe48015a1e0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.638+0000 7fe485545700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.638+0000 7fe485545700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe47000ac00 tx=0x7fe470006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:06.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.642+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4780556c0 con 0x7fe48015a1e0 2023-10-08T16:12:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.836+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4800d0ae0 con 0x7fe48015a1e0 2023-10-08T16:12:06.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.837+0000 7fe47d7fa700 1 -- 172.21.15.60:0/2278941145 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fe47806be60 con 0x7fe48015a1e0 2023-10-08T16:12:06.837 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:06.837 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":147,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:12:05.858213+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:12:04.269763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T16:12:04.831880+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:12:06.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 msgr2=0x7fe46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe47000ac00 tx=0x7fe470006f90 comp rx=0 tx=0).stop 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 msgr2=0x7fe48015c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe48015c7a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c930 tx=0x7fe4780026e0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 shutdown_connections 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe48015a1e0 0x7fe48015c7a0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4800b1610 0x7fe4800cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 --2- 172.21.15.60:0/2278941145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe480159e10 0x7fe480157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 >> 172.21.15.60:0/2278941145 conn(0x7fe480067660 msgr2=0x7fe4800cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 shutdown_connections 2023-10-08T16:12:06.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.839+0000 7fe4877a9700 1 -- 172.21.15.60:0/2278941145 wait complete. 2023-10-08T16:12:06.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:12:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.970+0000 7f729a7aa700 1 Processor -- start 2023-10-08T16:12:06.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.970+0000 7f729a7aa700 1 -- start start 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f729a7aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f729415e620 0x7f729415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f729a7aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 0x7f72940b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f729a7aa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72940b0e90 con 0x7f729415a8b0 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f729a7aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729415e190 con 0x7f729415e620 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f729a7aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940b23a0 con 0x7f72940b04f0 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7293fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f729415a8b0 0x7f72940b18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42952/0 (socket says 172.21.15.60:42952) 2023-10-08T16:12:06.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7293fff700 1 -- 172.21.15.60:0/3257531513 learned_addr learned my addr 172.21.15.60:0/3257531513 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824308191 0 0) 0x7f7288001110 con 0x7f729415a8b0 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f72937fe700 1 --2- 172.21.15.60:0/3257531513 >> v2:172.21.15.144:3300/0 conn(0x7f729415e620 0x7f729415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7298d47700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 0x7f72940b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f727c003570 con 0x7f729415a8b0 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138425122 0 0) 0x7f727c003570 con 0x7f729415a8b0 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 msgr2=0x7f72940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 0x7f72940b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 >> v2:172.21.15.144:3300/0 conn(0x7f729415e620 msgr2=0x7f729415ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 --2- 172.21.15.60:0/3257531513 >> v2:172.21.15.144:3300/0 conn(0x7f729415e620 0x7f729415ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940b20c0 con 0x7f729415a8b0 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f7288001600 con 0x7f729415a8b0 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.971+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 >> v1:172.21.15.60:6789/0 conn(0x7f729415a8b0 legacy=0x7f72940b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a60 0x7f727c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 0x7f727c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c004d50 0x7f727c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729415e190 con 0x7f727c004d50 2023-10-08T16:12:06.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940b23a0 con 0x7f727c003a60 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c00ba60 con 0x7f72940b04f0 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7293fff700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a60 0x7f727c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c004d50 0x7f727c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f72937fe700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 0x7f727c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 -- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 msgr2=0x7f727c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72940b04f0 0x7f727c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 -- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a60 msgr2=0x7f727c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a60 0x7f727c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 -- 172.21.15.60:0/3257531513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c003570 con 0x7f727c004d50 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7298d47700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c004d50 0x7f727c0051c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f728c00e210 tx=0x7f728c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb8abada13f81b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00ea60 con 0x7f727c004d50 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c00f040 con 0x7f727c004d50 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.972+0000 7f7292ffd700 1 -- 172.21.15.60:0/3257531513 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00ee10 con 0x7f727c004d50 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f729a7aa700 1 -- 172.21.15.60:0/3257531513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c004d50 msgr2=0x7f727c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f729a7aa700 1 --2- 172.21.15.60:0/3257531513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c004d50 0x7f727c0051c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f728c00e210 tx=0x7f728c00b040 comp rx=0 tx=0).stop 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f7298d47700 1 -- 172.21.15.60:0/3257531513 reap_dead start 2023-10-08T16:12:06.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f729a7aa700 1 -- 172.21.15.60:0/3257531513 shutdown_connections 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f729a7aa700 1 -- 172.21.15.60:0/3257531513 >> 172.21.15.60:0/3257531513 conn(0x7f729406c700 msgr2=0x7f7294069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f729a7aa700 1 -- 172.21.15.60:0/3257531513 shutdown_connections 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.973+0000 7f729a7aa700 1 -- 172.21.15.60:0/3257531513 wait complete. 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.974+0000 7f729a7aa700 1 Processor -- start 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.974+0000 7f729a7aa700 1 -- start start 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f729a7aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f727c004d50 0x7f72940adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f729a7aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 0x7f72940cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f729a7aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72940af1f0 0x7f729416bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f729a7aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940ce4f0 con 0x7f72941576e0 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f729a7aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940ae150 con 0x7f72940af1f0 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f729a7aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940ae430 con 0x7f727c004d50 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 0x7f72940cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 0x7f72940cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46030/0 (socket says 172.21.15.60:46030) 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 -- 172.21.15.60:0/178166981 learned_addr learned my addr 172.21.15.60:0/178166981 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f7293fff700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f727c004d50 0x7f72940adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f7298d47700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72940af1f0 0x7f729416bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 -- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f727c004d50 msgr2=0x7f72940adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f727c004d50 0x7f72940adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 -- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72940af1f0 msgr2=0x7f729416bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72940af1f0 0x7f729416bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 -- 172.21.15.60:0/178166981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940ae710 con 0x7f72941576e0 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f7298d47700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72940af1f0 0x7f729416bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.975+0000 7f72937fe700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 0x7f72940cdfb0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f7284006ac0 tx=0x7f72840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.976+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400f940 con 0x7f72941576e0 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.976+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728400faa0 con 0x7f72941576e0 2023-10-08T16:12:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.976+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72940ae9f0 con 0x7f72941576e0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.976+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400fe20 con 0x7f72941576e0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.976+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72940af690 con 0x7f72941576e0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.977+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72940aef10 con 0x7f72941576e0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.977+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7284014650 con 0x7f72941576e0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.977+0000 7f727bfff700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7280066f30 0x7f72800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.977+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7284018030 con 0x7f72941576e0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.978+0000 7f7293fff700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7280066f30 0x7f72800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:06.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.978+0000 7f7293fff700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7280066f30 0x7f72800693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7288007fd0 tx=0x7f7288007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:06.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:06.982+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72940aef10 con 0x7f72941576e0 2023-10-08T16:12:07.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.174+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72940aef10 con 0x7f72941576e0 2023-10-08T16:12:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.175+0000 7f727bfff700 1 -- 172.21.15.60:0/178166981 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f72940aef10 con 0x7f72941576e0 2023-10-08T16:12:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:07.175 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":147,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:12:05.858213+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:12:04.269763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T16:12:04.831880+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7280066f30 msgr2=0x7f72800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7280066f30 0x7f72800693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7288007fd0 tx=0x7f7288007a80 comp rx=0 tx=0).stop 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 msgr2=0x7f72940cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 0x7f72940cdfb0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f7284006ac0 tx=0x7f72840091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 shutdown_connections 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7280066f30 0x7f72800693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f727c004d50 0x7f72940adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72940af1f0 0x7f729416bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 --2- 172.21.15.60:0/178166981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72941576e0 0x7f72940cdfb0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 >> 172.21.15.60:0/178166981 conn(0x7f729406c700 msgr2=0x7f7294068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:07.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 shutdown_connections 2023-10-08T16:12:07.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.177+0000 7f729a7aa700 1 -- 172.21.15.60:0/178166981 wait complete. 2023-10-08T16:12:07.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:12:07.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.311+0000 7f9cf06ca700 1 Processor -- start 2023-10-08T16:12:07.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.311+0000 7f9cf06ca700 1 -- start start 2023-10-08T16:12:07.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.312+0000 7f9cf06ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80cd300 0x7f9ce815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.312+0000 7f9cf06ca700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce81513f0 con 0x7f9ce80d1470 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.312+0000 7f9cf06ca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce815db20 con 0x7f9ce80b6760 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.312+0000 7f9cf06ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce815e7a0 con 0x7f9ce80cd300 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.312+0000 7f9ceec67700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9ce80d1470 0x7f9ce80cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42960/0 (socket says 172.21.15.60:42960) 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.312+0000 7f9ceec67700 1 -- 172.21.15.60:0/145630639 learned_addr learned my addr 172.21.15.60:0/145630639 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9cee466700 1 --2- 172.21.15.60:0/145630639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80cd300 0x7f9ce815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775237453 0 0) 0x7f9ce81513f0 con 0x7f9ce80d1470 2023-10-08T16:12:07.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd0003570 con 0x7f9ce80d1470 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804547373 0 0) 0x7f9ce815db20 con 0x7f9ce80b6760 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce81513f0 con 0x7f9ce80b6760 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510855365 0 0) 0x7f9cd0003570 con 0x7f9ce80d1470 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9cee466700 1 -- 172.21.15.60:0/145630639 >> v1:172.21.15.144:6789/0 conn(0x7f9ce80b6760 legacy=0x7f9ce80d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9cee466700 1 -- 172.21.15.60:0/145630639 >> v1:172.21.15.60:6789/0 conn(0x7f9ce80d1470 legacy=0x7f9ce80cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9cee466700 1 -- 172.21.15.60:0/145630639 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce815de00 con 0x7f9ce80cd300 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9cee466700 1 --2- 172.21.15.60:0/145630639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80cd300 0x7f9ce815afb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009910 tx=0x7f9ce00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222c83c7284d92e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.313+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8001810 con 0x7f9ce80cd300 2023-10-08T16:12:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0011420 con 0x7f9ce80cd300 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9ced464700 1 -- 172.21.15.60:0/145630639 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00117c0 con 0x7f9ce80cd300 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 -- 172.21.15.60:0/145630639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80cd300 msgr2=0x7f9ce815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/145630639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80cd300 0x7f9ce815afb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009910 tx=0x7f9ce00091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 -- 172.21.15.60:0/145630639 shutdown_connections 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/145630639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80cd300 0x7f9ce815afb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 -- 172.21.15.60:0/145630639 >> 172.21.15.60:0/145630639 conn(0x7f9ce8068d90 msgr2=0x7f9ce8069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 -- 172.21.15.60:0/145630639 shutdown_connections 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.314+0000 7f9cf06ca700 1 -- 172.21.15.60:0/145630639 wait complete. 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.315+0000 7f9cf06ca700 1 Processor -- start 2023-10-08T16:12:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.315+0000 7f9cf06ca700 1 -- start start 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cf06ca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce80b6760 0x7f9ce8147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cf06ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 0x7f9ce815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cf06ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80d1470 0x7f9ce815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cf06ca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce816ad50 con 0x7f9ce80cd300 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cf06ca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce816e720 con 0x7f9ce80b6760 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cf06ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce816a700 con 0x7f9ce80d1470 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 0x7f9ce815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 0x7f9ce815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46032/0 (socket says 172.21.15.60:46032) 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 -- 172.21.15.60:0/2464147828 learned_addr learned my addr 172.21.15.60:0/2464147828 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cee466700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce80b6760 0x7f9ce8147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9ceec67700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80d1470 0x7f9ce815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 -- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80d1470 msgr2=0x7f9ce815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80d1470 0x7f9ce815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 -- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce80b6760 msgr2=0x7f9ce8147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce80b6760 0x7f9ce8147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.316+0000 7f9cedc65700 1 -- 172.21.15.60:0/2464147828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009420 con 0x7f9ce80cd300 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.317+0000 7f9cedc65700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 0x7f9ce815c510 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c790 tx=0x7f9cdc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.317+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc010510 con 0x7f9ce80cd300 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.317+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc010670 con 0x7f9ce80cd300 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.317+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce816a9e0 con 0x7f9ce80cd300 2023-10-08T16:12:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.317+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc010a10 con 0x7f9ce80cd300 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.317+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce816a350 con 0x7f9ce80cd300 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.318+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce816af00 con 0x7f9ce80cd300 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.318+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cdc01b3b0 con 0x7f9ce80cd300 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.319+0000 7f9ce67fc700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9cd4066f30 0x7f9cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.319+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9cdc083d90 con 0x7f9ce80cd300 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.319+0000 7f9cee466700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9cd4066f30 0x7f9cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.319+0000 7f9cee466700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9cd4066f30 0x7f9cd40693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00030c0 tx=0x7f9ce0016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.323+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ce816af00 con 0x7f9ce80cd300 2023-10-08T16:12:07.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:07.561+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ce804c3c0 con 0x7f9ce80cd300 2023-10-08T16:12:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.495+0000 7f9ce67fc700 1 -- 172.21.15.60:0/2464147828 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9cdc017020 con 0x7f9ce80cd300 2023-10-08T16:12:08.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9cd4066f30 msgr2=0x7f9cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9cd4066f30 0x7f9cd40693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00030c0 tx=0x7f9ce0016000 comp rx=0 tx=0).stop 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 msgr2=0x7f9ce815c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 0x7f9ce815c510 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c790 tx=0x7f9cdc007e10 comp rx=0 tx=0).stop 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 shutdown_connections 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9cd4066f30 0x7f9cd40693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce80d1470 0x7f9ce815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce80b6760 0x7f9ce8147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 --2- 172.21.15.60:0/2464147828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ce80cd300 0x7f9ce815c510 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 >> 172.21.15.60:0/2464147828 conn(0x7f9ce8068d90 msgr2=0x7f9ce8148a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 shutdown_connections 2023-10-08T16:12:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.498+0000 7f9cf06ca700 1 -- 172.21.15.60:0/2464147828 wait complete. 2023-10-08T16:12:08.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:12:08.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.665+0000 7f0414e63700 1 Processor -- start 2023-10-08T16:12:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.665+0000 7f0414e63700 1 -- start start 2023-10-08T16:12:08.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.666+0000 7f0414e63700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 0x7f041015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.666+0000 7f0414e63700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04100cbf10 0x7f041015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.666+0000 7f0414e63700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04100cae70 con 0x7f04100c9390 2023-10-08T16:12:08.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.666+0000 7f0414e63700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04100cb150 con 0x7f04100cbf10 2023-10-08T16:12:08.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.666+0000 7f0414e63700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100cb430 con 0x7f04100678b0 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f04100c9390 0x7f041006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42964/0 (socket says 172.21.15.60:42964) 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040ed9d700 1 -- 172.21.15.60:0/3524016425 learned_addr learned my addr 172.21.15.60:0/3524016425 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040e59c700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 0x7f041015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040dd9b700 1 --2- 172.21.15.60:0/3524016425 >> v2:172.21.15.144:3300/0 conn(0x7f04100cbf10 0x7f041015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397307888 0 0) 0x7f04100cae70 con 0x7f04100c9390 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc003570 con 0x7f04100c9390 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828217274 0 0) 0x7f03fc003570 con 0x7f04100c9390 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 msgr2=0x7f041015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 0x7f041015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 >> v2:172.21.15.144:3300/0 conn(0x7f04100cbf10 msgr2=0x7f041015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 --2- 172.21.15.60:0/3524016425 >> v2:172.21.15.144:3300/0 conn(0x7f04100cbf10 0x7f041015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100cb710 con 0x7f04100c9390 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f0408001470 con 0x7f04100c9390 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 >> v1:172.21.15.60:6789/0 conn(0x7f04100c9390 legacy=0x7f041006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 0x7f03fc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc003fe0 0x7f03fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03fc004d50 0x7f03fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100cb150 con 0x7f03fc004d50 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100cb430 con 0x7f03fc003fe0 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc00ba90 con 0x7f04100678b0 2023-10-08T16:12:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040ed9d700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03fc004d50 0x7f03fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040e59c700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 0x7f03fc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.667+0000 7f040dd9b700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc003fe0 0x7f03fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040ed9d700 1 -- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 msgr2=0x7f03fc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040ed9d700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04100678b0 0x7f03fc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040ed9d700 1 -- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc003fe0 msgr2=0x7f03fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040ed9d700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc003fe0 0x7f03fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040ed9d700 1 -- 172.21.15.60:0/3524016425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc003570 con 0x7f03fc004d50 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040ed9d700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03fc004d50 0x7f03fc0051c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f040800c3c0 tx=0x7f0408001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f0ba937b11c01f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800cc30 con 0x7f03fc004d50 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040800cdb0 con 0x7f03fc004d50 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f040d59a700 1 -- 172.21.15.60:0/3524016425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408005b70 con 0x7f03fc004d50 2023-10-08T16:12:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.668+0000 7f0414e63700 1 -- 172.21.15.60:0/3524016425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03fc004d50 msgr2=0x7f03fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.669+0000 7f0414e63700 1 --2- 172.21.15.60:0/3524016425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03fc004d50 0x7f03fc0051c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f040800c3c0 tx=0x7f0408001e90 comp rx=0 tx=0).stop 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.669+0000 7f040ed9d700 1 -- 172.21.15.60:0/3524016425 reap_dead start 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.669+0000 7f0414e63700 1 -- 172.21.15.60:0/3524016425 shutdown_connections 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.669+0000 7f0414e63700 1 -- 172.21.15.60:0/3524016425 >> 172.21.15.60:0/3524016425 conn(0x7f0410069870 msgr2=0x7f0410069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.669+0000 7f0414e63700 1 -- 172.21.15.60:0/3524016425 shutdown_connections 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.669+0000 7f0414e63700 1 -- 172.21.15.60:0/3524016425 wait complete. 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.670+0000 7f0414e63700 1 Processor -- start 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.670+0000 7f0414e63700 1 -- start start 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.670+0000 7f0414e63700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc004d50 0x7f041015e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.670+0000 7f0414e63700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041015e6a0 0x7f041006c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f0414e63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 0x7f041006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f0414e63700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100c6960 con 0x7f04100c6df0 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f0414e63700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100c5d50 con 0x7f03fc004d50 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f0414e63700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100c6030 con 0x7f041015e6a0 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 0x7f041006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 0x7f041006c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46052/0 (socket says 172.21.15.60:46052) 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 -- 172.21.15.60:0/2502785420 learned_addr learned my addr 172.21.15.60:0/2502785420 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040e59c700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc004d50 0x7f041015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040dd9b700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041015e6a0 0x7f041006c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 -- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041015e6a0 msgr2=0x7f041006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041015e6a0 0x7f041006c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 -- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc004d50 msgr2=0x7f041015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc004d50 0x7f041015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 -- 172.21.15.60:0/2502785420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100c6310 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f040ed9d700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 0x7f041006c5f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0408000c00 tx=0x7f0408015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800cc30 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0408001430 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04100c65f0 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408001bb0 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.671+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041015ede0 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.672+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04100c6ad0 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.673+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0408019030 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.673+0000 7f04067fc700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f03f0066f30 0x7f03f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.674+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0408084d00 con 0x7f04100c6df0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.674+0000 7f040e59c700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f03f0066f30 0x7f03f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.674+0000 7f040e59c700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f03f0066f30 0x7f03f00693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f04000094d0 tx=0x7f040000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:08.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.678+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0408051f70 con 0x7f04100c6df0 2023-10-08T16:12:08.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:08.918+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f041004c3c0 con 0x7f04100c6df0 2023-10-08T16:12:09.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.500+0000 7f04067fc700 1 -- 172.21.15.60:0/2502785420 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v77) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0408055590 con 0x7f04100c6df0 2023-10-08T16:12:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f03f0066f30 msgr2=0x7f03f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f03f0066f30 0x7f03f00693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f04000094d0 tx=0x7f040000b040 comp rx=0 tx=0).stop 2023-10-08T16:12:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 msgr2=0x7f041006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 0x7f041006c5f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0408000c00 tx=0x7f0408015000 comp rx=0 tx=0).stop 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 shutdown_connections 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f03f0066f30 0x7f03f00693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04100c6df0 0x7f041006c5f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03fc004d50 0x7f041015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 --2- 172.21.15.60:0/2502785420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041015e6a0 0x7f041006c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 >> 172.21.15.60:0/2502785420 conn(0x7f0410069870 msgr2=0x7f04100b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 shutdown_connections 2023-10-08T16:12:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.503+0000 7f0414e63700 1 -- 172.21.15.60:0/2502785420 wait complete. 2023-10-08T16:12:09.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:12:09.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.749+0000 7fb45bd2c700 1 Processor -- start 2023-10-08T16:12:09.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.750+0000 7fb45bd2c700 1 -- start start 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.750+0000 7fb45bd2c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45415a2b0 0x7fb4540b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.750+0000 7fb45bd2c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb4540d1c30 0x7fb4540cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.750+0000 7fb45bd2c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540c5d80 con 0x7fb45415a680 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.750+0000 7fb45bd2c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb454068470 con 0x7fb4540d1c30 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.750+0000 7fb45bd2c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540c6060 con 0x7fb45415a2b0 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb4592c7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb4540d1c30 0x7fb4540cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb459ac8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45415a2b0 0x7fb4540b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb45a2c9700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb45415a680 0x7fb4540c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:44626/0 (socket says 172.21.15.60:44626) 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb45a2c9700 1 -- 172.21.15.60:0/484486945 learned_addr learned my addr 172.21.15.60:0/484486945 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb4592c7700 1 -- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45415a2b0 msgr2=0x7fb4540b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:09.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb4592c7700 1 --2- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45415a2b0 0x7fb4540b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb4592c7700 1 -- 172.21.15.60:0/484486945 >> v1:172.21.15.144:6789/0 conn(0x7fb45415a680 legacy=0x7fb4540c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb4592c7700 1 -- 172.21.15.60:0/484486945 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540c6340 con 0x7fb4540d1c30 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb458ac6700 1 -- 172.21.15.60:0/484486945 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708638137 0 0) 0x7fb4540c5d80 con 0x7fb45415a680 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb459ac8700 1 --2- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45415a2b0 0x7fb4540b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.751+0000 7fb4592c7700 1 --2- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4540d1c30 0x7fb4540cf710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098e0 tx=0x7fb4480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795638f5b2141dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb458ac6700 1 -- 172.21.15.60:0/484486945 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800b640 con 0x7fb4540d1c30 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb458ac6700 1 -- 172.21.15.60:0/484486945 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800b7a0 con 0x7fb4540d1c30 2023-10-08T16:12:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb458ac6700 1 -- 172.21.15.60:0/484486945 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800bb40 con 0x7fb4540d1c30 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 -- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4540d1c30 msgr2=0x7fb4540cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4540d1c30 0x7fb4540cf710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098e0 tx=0x7fb4480091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 -- 172.21.15.60:0/484486945 shutdown_connections 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45415a2b0 0x7fb4540b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/484486945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4540d1c30 0x7fb4540cf710 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 -- 172.21.15.60:0/484486945 >> 172.21.15.60:0/484486945 conn(0x7fb454067e40 msgr2=0x7fb4540d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 -- 172.21.15.60:0/484486945 shutdown_connections 2023-10-08T16:12:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.752+0000 7fb45bd2c700 1 -- 172.21.15.60:0/484486945 wait complete. 2023-10-08T16:12:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.753+0000 7fb45bd2c700 1 Processor -- start 2023-10-08T16:12:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.753+0000 7fb45bd2c700 1 -- start start 2023-10-08T16:12:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45bd2c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4540d1c30 0x7fb45414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45bd2c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45415a2b0 0x7fb4540c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45bd2c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 0x7fb4540ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45bd2c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b51a0 con 0x7fb45415a680 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45bd2c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45415b6b0 con 0x7fb45415a2b0 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45bd2c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45414f2b0 con 0x7fb4540d1c30 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 0x7fb4540ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 0x7fb4540ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46060/0 (socket says 172.21.15.60:46060) 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 -- 172.21.15.60:0/854667852 learned_addr learned my addr 172.21.15.60:0/854667852 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb459ac8700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4540d1c30 0x7fb45414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb4592c7700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45415a2b0 0x7fb4540c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 -- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4540d1c30 msgr2=0x7fb45414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4540d1c30 0x7fb45414ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 -- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45415a2b0 msgr2=0x7fb4540c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45415a2b0 0x7fb4540c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.754+0000 7fb45a2c9700 1 -- 172.21.15.60:0/854667852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0093c0 con 0x7fb45415a680 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.755+0000 7fb45a2c9700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 0x7fb4540ca4b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb44400cbf0 tx=0x7fb4440019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.755+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400a9c0 con 0x7fb45415a680 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.755+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400ab20 con 0x7fb45415a680 2023-10-08T16:12:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.755+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb448009420 con 0x7fb45415a680 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.755+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4440070f0 con 0x7fb45415a680 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.755+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4540cabe0 con 0x7fb45415a680 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.756+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45404c3c0 con 0x7fb45415a680 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.756+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb444007520 con 0x7fb45415a680 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.757+0000 7fb451ffb700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb440066f30 0x7fb4400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.757+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb444084aa0 con 0x7fb45415a680 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.757+0000 7fb459ac8700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb440066f30 0x7fb4400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.757+0000 7fb459ac8700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb440066f30 0x7fb4400693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009390 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.761+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb444051c70 con 0x7fb45415a680 2023-10-08T16:12:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.997+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4540b52e0 con 0x7fb45415a680 2023-10-08T16:12:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.997+0000 7fb451ffb700 1 -- 172.21.15.60:0/854667852 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb444055290 con 0x7fb45415a680 2023-10-08T16:12:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:10.089 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:12:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb440066f30 msgr2=0x7fb4400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb440066f30 0x7fb4400693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009390 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2023-10-08T16:12:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 msgr2=0x7fb4540ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 0x7fb4540ca4b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb44400cbf0 tx=0x7fb4440019b0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 shutdown_connections 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb440066f30 0x7fb4400693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb4540d1c30 0x7fb45414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb45415a680 0x7fb4540ca4b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 --2- 172.21.15.60:0/854667852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45415a2b0 0x7fb4540c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 >> 172.21.15.60:0/854667852 conn(0x7fb454067e40 msgr2=0x7fb454069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 shutdown_connections 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:09.999+0000 7fb45bd2c700 1 -- 172.21.15.60:0/854667852 wait complete. 2023-10-08T16:12:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:12:10.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:12:10.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.210+0000 7f0ea4071700 1 Processor -- start 2023-10-08T16:12:10.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.210+0000 7f0ea4071700 1 -- start start 2023-10-08T16:12:10.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea4071700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c157ba0 0x7f0e9c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:10.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea4071700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e9c15b0d0 0x7f0e9c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:10.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea4071700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c15c360 con 0x7f0e9c1577d0 2023-10-08T16:12:10.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea4071700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c15b790 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea4071700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c15d800 con 0x7f0e9c157ba0 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea260e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e9c15b0d0 0x7f0e9c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea1e0d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0e9c1577d0 0x7f0e9c0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42974/0 (socket says 172.21.15.60:42974) 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.211+0000 7f0ea1e0d700 1 -- 172.21.15.60:0/3150110023 learned_addr learned my addr 172.21.15.60:0/3150110023 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea160c700 1 --2- 172.21.15.60:0/3150110023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c157ba0 0x7f0e9c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea0e0b700 1 -- 172.21.15.60:0/3150110023 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641519760 0 0) 0x7f0e9c15c360 con 0x7f0e9c1577d0 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea0e0b700 1 -- 172.21.15.60:0/3150110023 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e84003570 con 0x7f0e9c1577d0 2023-10-08T16:12:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea260e700 1 -- 172.21.15.60:0/3150110023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c157ba0 msgr2=0x7f0e9c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea260e700 1 --2- 172.21.15.60:0/3150110023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c157ba0 0x7f0e9c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea260e700 1 -- 172.21.15.60:0/3150110023 >> v1:172.21.15.60:6789/0 conn(0x7f0e9c1577d0 legacy=0x7f0e9c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea260e700 1 -- 172.21.15.60:0/3150110023 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c15ba30 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea260e700 1 --2- 172.21.15.60:0/3150110023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c06aa60 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f0e940098e0 tx=0x7f0e940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f3d607f302b301 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea0e0b700 1 -- 172.21.15.60:0/3150110023 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400b640 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea0e0b700 1 -- 172.21.15.60:0/3150110023 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400b7a0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.212+0000 7f0ea0e0b700 1 -- 172.21.15.60:0/3150110023 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400bb40 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 -- 172.21.15.60:0/3150110023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 msgr2=0x7f0e9c06aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3150110023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c06aa60 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f0e940098e0 tx=0x7f0e940091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 -- 172.21.15.60:0/3150110023 shutdown_connections 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3150110023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c06aa60 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3150110023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c157ba0 0x7f0e9c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 -- 172.21.15.60:0/3150110023 >> 172.21.15.60:0/3150110023 conn(0x7f0e9c068ce0 msgr2=0x7f0e9c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 -- 172.21.15.60:0/3150110023 shutdown_connections 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.213+0000 7f0ea4071700 1 -- 172.21.15.60:0/3150110023 wait complete. 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 Processor -- start 2023-10-08T16:12:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 -- start start 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c1577d0 0x7f0e9c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e9c157ba0 0x7f0e9c152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c16b2b0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c16a730 con 0x7f0e9c157ba0 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.214+0000 7f0ea4071700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c16aa10 con 0x7f0e9c1577d0 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c14ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46078/0 (socket says 172.21.15.60:46078) 2023-10-08T16:12:10.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 -- 172.21.15.60:0/3986367985 learned_addr learned my addr 172.21.15.60:0/3986367985 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:10.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea1e0d700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c1577d0 0x7f0e9c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:10.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea160c700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e9c157ba0 0x7f0e9c152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:10.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 -- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c1577d0 msgr2=0x7f0e9c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c1577d0 0x7f0e9c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 -- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e9c157ba0 msgr2=0x7f0e9c152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e9c157ba0 0x7f0e9c152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 -- 172.21.15.60:0/3986367985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94009420 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea1e0d700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c1577d0 0x7f0e9c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea260e700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c14ec30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0e940093f0 tx=0x7f0e94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9401be00 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94011630 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c16acf0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.215+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940119f0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.216+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c15f4c0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.216+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c04c3c0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.217+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e940253f0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.217+0000 7f0e99ffb700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.218+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e940860e0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.218+0000 7f0ea1e0d700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.218+0000 7f0ea1e0d700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e88066f30 0x7f0e880693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005c50 tx=0x7f0e8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.222+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e940532b0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.416+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e9c15bd10 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.417+0000 7f0e99ffb700 1 -- 172.21.15.60:0/3986367985 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f0e940568d0 con 0x7f0e9c15b0d0 2023-10-08T16:12:10.417 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:10.417 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":148,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:12:07.468027+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:12:04.269763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T16:12:04.831880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:12:10.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.418+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e88066f30 msgr2=0x7f0e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.418+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e88066f30 0x7f0e880693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005c50 tx=0x7f0e8c009040 comp rx=0 tx=0).stop 2023-10-08T16:12:10.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 msgr2=0x7f0e9c14ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c14ec30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0e940093f0 tx=0x7f0e94017000 comp rx=0 tx=0).stop 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 shutdown_connections 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e9c1577d0 0x7f0e9c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e9c15b0d0 0x7f0e9c14ec30 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 --2- 172.21.15.60:0/3986367985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e9c157ba0 0x7f0e9c152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 >> 172.21.15.60:0/3986367985 conn(0x7f0e9c068ce0 msgr2=0x7f0e9c158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 shutdown_connections 2023-10-08T16:12:10.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.419+0000 7f0ea4071700 1 -- 172.21.15.60:0/3986367985 wait complete. 2023-10-08T16:12:10.431 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:12:10.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:12:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 Processor -- start 2023-10-08T16:12:11.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 -- start start 2023-10-08T16:12:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18c0157870 0x7f18c015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18c0157c40 0x7f18c0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c015cbb0 con 0x7f18c015a620 2023-10-08T16:12:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c015bfa0 con 0x7f18c0157c40 2023-10-08T16:12:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.663+0000 7f18c590c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c015c280 con 0x7f18c0157870 2023-10-08T16:12:11.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18c0157c40 0x7f18c0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18c0157c40 0x7f18c0158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46084/0 (socket says 172.21.15.60:46084) 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 -- 172.21.15.60:0/3483967102 learned_addr learned my addr 172.21.15.60:0/3483967102 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18beffd700 1 --2- 172.21.15.60:0/3483967102 >> v2:172.21.15.144:3300/0 conn(0x7f18c0157870 0x7f18c015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 -- 172.21.15.60:0/3483967102 >> v2:172.21.15.144:3300/0 conn(0x7f18c0157870 msgr2=0x7f18c015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 --2- 172.21.15.60:0/3483967102 >> v2:172.21.15.144:3300/0 conn(0x7f18c0157870 0x7f18c015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 -- 172.21.15.60:0/3483967102 >> v1:172.21.15.144:6789/0 conn(0x7f18c015a620 legacy=0x7f18c015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 -- 172.21.15.60:0/3483967102 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c015c560 con 0x7f18c0157c40 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bf7fe700 1 --2- 172.21.15.60:0/3483967102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157c40 0x7f18c0158110 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f18c0069d80 tx=0x7f18b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11795412a318186c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bdffb700 1 -- 172.21.15.60:0/3483967102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000e070 con 0x7f18c0157c40 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bdffb700 1 -- 172.21.15.60:0/3483967102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b000ba50 con 0x7f18c0157c40 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.664+0000 7f18bdffb700 1 -- 172.21.15.60:0/3483967102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00092e0 con 0x7f18c0157c40 2023-10-08T16:12:11.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 -- 172.21.15.60:0/3483967102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157c40 msgr2=0x7f18c0158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 --2- 172.21.15.60:0/3483967102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157c40 0x7f18c0158110 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f18c0069d80 tx=0x7f18b0009840 comp rx=0 tx=0).stop 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 -- 172.21.15.60:0/3483967102 shutdown_connections 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 --2- 172.21.15.60:0/3483967102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157c40 0x7f18c0158110 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 --2- 172.21.15.60:0/3483967102 >> v2:172.21.15.144:3300/0 conn(0x7f18c0157870 0x7f18c015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 -- 172.21.15.60:0/3483967102 >> 172.21.15.60:0/3483967102 conn(0x7f18c0068ce0 msgr2=0x7f18c00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 -- 172.21.15.60:0/3483967102 shutdown_connections 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.665+0000 7f18c590c700 1 -- 172.21.15.60:0/3483967102 wait complete. 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.666+0000 7f18c590c700 1 Processor -- start 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.666+0000 7f18c590c700 1 -- start start 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18c590c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 0x7f18c014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:11.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18c590c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18c0157c40 0x7f18c013f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18c590c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c015a620 0x7f18c0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18c590c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0150610 con 0x7f18c0157870 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18c590c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c013fe60 con 0x7f18c015a620 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18c590c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c014ee70 con 0x7f18c0157c40 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 0x7f18c014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 0x7f18c014e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46092/0 (socket says 172.21.15.60:46092) 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 -- 172.21.15.60:0/1242885399 learned_addr learned my addr 172.21.15.60:0/1242885399 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18bf7fe700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c015a620 0x7f18c0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18be7fc700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18c0157c40 0x7f18c013f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 -- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18c0157c40 msgr2=0x7f18c013f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18c0157c40 0x7f18c013f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 -- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c015a620 msgr2=0x7f18c0150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:11.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c015a620 0x7f18c0150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 -- 172.21.15.60:0/1242885399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0009ae0 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18bf7fe700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c015a620 0x7f18c0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.667+0000 7f18beffd700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 0x7f18c014e7e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f18b800d890 tx=0x7f18b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.668+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800b600 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.668+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b800b760 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.668+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c014fcb0 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.668+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800bae0 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.668+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c014ff50 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.669+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c004c3c0 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.669+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18b801e460 con 0x7f18c0157870 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.670+0000 7f18b6ffd700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18a0066f30 0x7f18a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:11.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.670+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18b8084be0 con 0x7f18c0157870 2023-10-08T16:12:11.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.670+0000 7f18be7fc700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18a0066f30 0x7f18a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:11.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.670+0000 7f18be7fc700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18a0066f30 0x7f18a00693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f18c014e6a0 tx=0x7f18a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:11.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.674+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b8051e50 con 0x7f18c0157870 2023-10-08T16:12:11.653 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-10-08T16:12:10.769+0000 7f3fe9eea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:12:11.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.864+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18c015c840 con 0x7f18a0066f30 2023-10-08T16:12:11.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.872+0000 7f18b6ffd700 1 -- 172.21.15.60:0/1242885399 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282214 (secure 0 0 0) 0x7f18c015c840 con 0x7f18a0066f30 2023-10-08T16:12:11.657 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:11.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18a0066f30 msgr2=0x7f18a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:11.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18a0066f30 0x7f18a00693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f18c014e6a0 tx=0x7f18a8009040 comp rx=0 tx=0).stop 2023-10-08T16:12:11.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 msgr2=0x7f18c014e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:11.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 0x7f18c014e7e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f18b800d890 tx=0x7f18b8008040 comp rx=0 tx=0).stop 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 shutdown_connections 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18a0066f30 0x7f18a00693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c015a620 0x7f18c0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18c0157870 0x7f18c014e7e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 --2- 172.21.15.60:0/1242885399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18c0157c40 0x7f18c013f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 >> 172.21.15.60:0/1242885399 conn(0x7f18c0068ce0 msgr2=0x7f18c00b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 shutdown_connections 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:10.875+0000 7f18c590c700 1 -- 172.21.15.60:0/1242885399 wait complete. 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:12:11.660 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2023-10-08T16:12:09.651212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555071,"statfs":{"total":1600000000,"available":1592392849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.201372"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459068+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:07.404839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457526+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:36.571760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.466270+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:23:52.925602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459723+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:19.108889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.462078+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:58.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.462000+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:46.645232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.462936+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:05.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.467124+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:05.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.466679+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:46.645232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458153+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:48.308454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460322+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:03.129121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458335+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:50.263772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459561+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:43.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458201+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:00.658425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460271+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:05.405182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457757+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:05.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.462379+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:58.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459171+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:30.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459538+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:08.545848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460386+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:31.025030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.461301+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:56.201542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458902+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:38.228784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.466733+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:58.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459173+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:23.423974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457688+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:45.866164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457362+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:46.645232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460947+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:34.621422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.461511+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:24.018606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459241+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:09.674999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458615+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:30.380008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460933+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:33.095042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457300+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:33.095042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458106+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:12.455965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.463462+0000","last_change":"2023-10-08T16:12:05.463462+0000","last_active":"2023-10-08T16:12:05.463462+0000","last_peered":"2023-10-08T16:12:05.463462+0000","last_clean":"2023-10-08T16:12:05.463462+0000","last_became_active":"2023-10-08T16:12:05.463212+0000","last_became_peered":"2023-10-08T16:12:05.463212+0000","last_unstale":"2023-10-08T16:12:05.463462+0000","last_undegraded":"2023-10-08T16:12:05.463462+0000","last_fullsized":"2023-10-08T16:12:05.463462+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:47.303791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460618+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:04.839565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.467110+0000","last_change":"2023-10-08T16:12:05.467110+0000","last_active":"2023-10-08T16:12:05.467110+0000","last_peered":"2023-10-08T16:12:05.467110+0000","last_clean":"2023-10-08T16:12:05.467110+0000","last_became_active":"2023-10-08T16:12:05.466856+0000","last_became_peered":"2023-10-08T16:12:05.466856+0000","last_unstale":"2023-10-08T16:12:05.467110+0000","last_undegraded":"2023-10-08T16:12:05.467110+0000","last_fullsized":"2023-10-08T16:12:05.467110+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:14.093393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460387+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:04.839565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.465617+0000","last_change":"2023-10-08T16:12:05.465617+0000","last_active":"2023-10-08T16:12:05.465617+0000","last_peered":"2023-10-08T16:12:05.465617+0000","last_clean":"2023-10-08T16:12:05.465617+0000","last_became_active":"2023-10-08T16:12:05.465389+0000","last_became_peered":"2023-10-08T16:12:05.465389+0000","last_unstale":"2023-10-08T16:12:05.465617+0000","last_undegraded":"2023-10-08T16:12:05.465617+0000","last_fullsized":"2023-10-08T16:12:05.465617+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:36.823584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460702+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:23:52.925602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.465929+0000","last_change":"2023-10-08T16:12:05.465929+0000","last_active":"2023-10-08T16:12:05.465929+0000","last_peered":"2023-10-08T16:12:05.465929+0000","last_clean":"2023-10-08T16:12:05.465929+0000","last_became_active":"2023-10-08T16:12:05.465661+0000","last_became_peered":"2023-10-08T16:12:05.465661+0000","last_unstale":"2023-10-08T16:12:05.465929+0000","last_undegraded":"2023-10-08T16:12:05.465929+0000","last_fullsized":"2023-10-08T16:12:05.465929+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:23.013942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458764+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:44.055765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.464740+0000","last_change":"2023-10-08T16:12:05.464740+0000","last_active":"2023-10-08T16:12:05.464740+0000","last_peered":"2023-10-08T16:12:05.464740+0000","last_clean":"2023-10-08T16:12:05.464740+0000","last_became_active":"2023-10-08T16:12:05.463920+0000","last_became_peered":"2023-10-08T16:12:05.463920+0000","last_unstale":"2023-10-08T16:12:05.464740+0000","last_undegraded":"2023-10-08T16:12:05.464740+0000","last_fullsized":"2023-10-08T16:12:05.464740+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:54.205235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.456905+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:23:52.925602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.466544+0000","last_change":"2023-10-08T16:12:05.466544+0000","last_active":"2023-10-08T16:12:05.466544+0000","last_peered":"2023-10-08T16:12:05.466544+0000","last_clean":"2023-10-08T16:12:05.466544+0000","last_became_active":"2023-10-08T16:12:05.464114+0000","last_became_peered":"2023-10-08T16:12:05.464114+0000","last_unstale":"2023-10-08T16:12:05.466544+0000","last_undegraded":"2023-10-08T16:12:05.466544+0000","last_fullsized":"2023-10-08T16:12:05.466544+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:32.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459155+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:24.658535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.464071+0000","last_change":"2023-10-08T16:12:05.464071+0000","last_active":"2023-10-08T16:12:05.464071+0000","last_peered":"2023-10-08T16:12:05.464071+0000","last_clean":"2023-10-08T16:12:05.464071+0000","last_became_active":"2023-10-08T16:12:05.463775+0000","last_became_peered":"2023-10-08T16:12:05.463775+0000","last_unstale":"2023-10-08T16:12:05.464071+0000","last_undegraded":"2023-10-08T16:12:05.464071+0000","last_fullsized":"2023-10-08T16:12:05.464071+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:49.259109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457758+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:21.930655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.470001+0000","last_change":"2023-10-08T16:12:05.470001+0000","last_active":"2023-10-08T16:12:05.470001+0000","last_peered":"2023-10-08T16:12:05.470001+0000","last_clean":"2023-10-08T16:12:05.470001+0000","last_became_active":"2023-10-08T16:12:05.469788+0000","last_became_peered":"2023-10-08T16:12:05.469788+0000","last_unstale":"2023-10-08T16:12:05.470001+0000","last_undegraded":"2023-10-08T16:12:05.470001+0000","last_fullsized":"2023-10-08T16:12:05.470001+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.962615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460533+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:33.716568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.464667+0000","last_change":"2023-10-08T16:12:05.464667+0000","last_active":"2023-10-08T16:12:05.464667+0000","last_peered":"2023-10-08T16:12:05.464667+0000","last_clean":"2023-10-08T16:12:05.464667+0000","last_became_active":"2023-10-08T16:12:05.464282+0000","last_became_peered":"2023-10-08T16:12:05.464282+0000","last_unstale":"2023-10-08T16:12:05.464667+0000","last_undegraded":"2023-10-08T16:12:05.464667+0000","last_fullsized":"2023-10-08T16:12:05.464667+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:50.368676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.462080+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:55.209899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.468245+0000","last_change":"2023-10-08T16:12:05.468245+0000","last_active":"2023-10-08T16:12:05.468245+0000","last_peered":"2023-10-08T16:12:05.468245+0000","last_clean":"2023-10-08T16:12:05.468245+0000","last_became_active":"2023-10-08T16:12:05.467604+0000","last_became_peered":"2023-10-08T16:12:05.467604+0000","last_unstale":"2023-10-08T16:12:05.468245+0000","last_undegraded":"2023-10-08T16:12:05.468245+0000","last_fullsized":"2023-10-08T16:12:05.468245+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:03.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460097+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:03.923141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.468130+0000","last_change":"2023-10-08T16:12:05.468130+0000","last_active":"2023-10-08T16:12:05.468130+0000","last_peered":"2023-10-08T16:12:05.468130+0000","last_clean":"2023-10-08T16:12:05.468130+0000","last_became_active":"2023-10-08T16:12:05.467679+0000","last_became_peered":"2023-10-08T16:12:05.467679+0000","last_unstale":"2023-10-08T16:12:05.468130+0000","last_undegraded":"2023-10-08T16:12:05.468130+0000","last_fullsized":"2023-10-08T16:12:05.468130+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:58.164507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.461425+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:46.645232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.469459+0000","last_change":"2023-10-08T16:12:05.469459+0000","last_active":"2023-10-08T16:12:05.469459+0000","last_peered":"2023-10-08T16:12:05.469459+0000","last_clean":"2023-10-08T16:12:05.469459+0000","last_became_active":"2023-10-08T16:12:05.469236+0000","last_became_peered":"2023-10-08T16:12:05.469236+0000","last_unstale":"2023-10-08T16:12:05.469459+0000","last_undegraded":"2023-10-08T16:12:05.469459+0000","last_fullsized":"2023-10-08T16:12:05.469459+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457668+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:20.241782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.463875+0000","last_change":"2023-10-08T16:12:05.463875+0000","last_active":"2023-10-08T16:12:05.463875+0000","last_peered":"2023-10-08T16:12:05.463875+0000","last_clean":"2023-10-08T16:12:05.463875+0000","last_became_active":"2023-10-08T16:12:05.463270+0000","last_became_peered":"2023-10-08T16:12:05.463270+0000","last_unstale":"2023-10-08T16:12:05.463875+0000","last_undegraded":"2023-10-08T16:12:05.463875+0000","last_fullsized":"2023-10-08T16:12:05.463875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:23.175869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457245+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:20:05.569830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.464893+0000","last_change":"2023-10-08T16:12:05.464893+0000","last_active":"2023-10-08T16:12:05.464893+0000","last_peered":"2023-10-08T16:12:05.464893+0000","last_clean":"2023-10-08T16:12:05.464893+0000","last_became_active":"2023-10-08T16:12:05.464239+0000","last_became_peered":"2023-10-08T16:12:05.464239+0000","last_unstale":"2023-10-08T16:12:05.464893+0000","last_undegraded":"2023-10-08T16:12:05.464893+0000","last_fullsized":"2023-10-08T16:12:05.464893+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:09.968166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.458768+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:04.883903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.470754+0000","last_change":"2023-10-08T16:12:05.470754+0000","last_active":"2023-10-08T16:12:05.470754+0000","last_peered":"2023-10-08T16:12:05.470754+0000","last_clean":"2023-10-08T16:12:05.470754+0000","last_became_active":"2023-10-08T16:12:05.469992+0000","last_became_peered":"2023-10-08T16:12:05.469992+0000","last_unstale":"2023-10-08T16:12:05.470754+0000","last_undegraded":"2023-10-08T16:12:05.470754+0000","last_fullsized":"2023-10-08T16:12:05.470754+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:47.303791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459526+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:03.923141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.462124+0000","last_change":"2023-10-08T16:12:05.462124+0000","last_active":"2023-10-08T16:12:05.462124+0000","last_peered":"2023-10-08T16:12:05.462124+0000","last_clean":"2023-10-08T16:12:05.462124+0000","last_became_active":"2023-10-08T16:12:05.461879+0000","last_became_peered":"2023-10-08T16:12:05.461879+0000","last_unstale":"2023-10-08T16:12:05.462124+0000","last_undegraded":"2023-10-08T16:12:05.462124+0000","last_fullsized":"2023-10-08T16:12:05.462124+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:29.481782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.461568+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.967279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.469006+0000","last_change":"2023-10-08T16:12:05.469006+0000","last_active":"2023-10-08T16:12:05.469006+0000","last_peered":"2023-10-08T16:12:05.469006+0000","last_clean":"2023-10-08T16:12:05.469006+0000","last_became_active":"2023-10-08T16:12:05.468785+0000","last_became_peered":"2023-10-08T16:12:05.468785+0000","last_unstale":"2023-10-08T16:12:05.469006+0000","last_undegraded":"2023-10-08T16:12:05.469006+0000","last_fullsized":"2023-10-08T16:12:05.469006+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:36.252475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.465512+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:20.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.462609+0000","last_change":"2023-10-08T16:12:05.462609+0000","last_active":"2023-10-08T16:12:05.462609+0000","last_peered":"2023-10-08T16:12:05.462609+0000","last_clean":"2023-10-08T16:12:05.462609+0000","last_became_active":"2023-10-08T16:12:05.462350+0000","last_became_peered":"2023-10-08T16:12:05.462350+0000","last_unstale":"2023-10-08T16:12:05.462609+0000","last_undegraded":"2023-10-08T16:12:05.462609+0000","last_fullsized":"2023-10-08T16:12:05.462609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:45.856479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459155+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:50.263772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.465073+0000","last_change":"2023-10-08T16:12:05.465073+0000","last_active":"2023-10-08T16:12:05.465073+0000","last_peered":"2023-10-08T16:12:05.465073+0000","last_clean":"2023-10-08T16:12:05.465073+0000","last_became_active":"2023-10-08T16:12:05.464842+0000","last_became_peered":"2023-10-08T16:12:05.464842+0000","last_unstale":"2023-10-08T16:12:05.465073+0000","last_undegraded":"2023-10-08T16:12:05.465073+0000","last_fullsized":"2023-10-08T16:12:05.465073+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:04.400519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457261+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:41:17.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.463965+0000","last_change":"2023-10-08T16:12:05.463965+0000","last_active":"2023-10-08T16:12:05.463965+0000","last_peered":"2023-10-08T16:12:05.463965+0000","last_clean":"2023-10-08T16:12:05.463965+0000","last_became_active":"2023-10-08T16:12:05.463740+0000","last_became_peered":"2023-10-08T16:12:05.463740+0000","last_unstale":"2023-10-08T16:12:05.463965+0000","last_undegraded":"2023-10-08T16:12:05.463965+0000","last_fullsized":"2023-10-08T16:12:05.463965+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:30.255570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.456928+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:04.839565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.469473+0000","last_change":"2023-10-08T16:12:05.469473+0000","last_active":"2023-10-08T16:12:05.469473+0000","last_peered":"2023-10-08T16:12:05.469473+0000","last_clean":"2023-10-08T16:12:05.469473+0000","last_became_active":"2023-10-08T16:12:05.469215+0000","last_became_peered":"2023-10-08T16:12:05.469215+0000","last_unstale":"2023-10-08T16:12:05.469473+0000","last_undegraded":"2023-10-08T16:12:05.469473+0000","last_fullsized":"2023-10-08T16:12:05.469473+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:23.653871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457627+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:17.349831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.460953+0000","last_change":"2023-10-08T16:12:05.460953+0000","last_active":"2023-10-08T16:12:05.460953+0000","last_peered":"2023-10-08T16:12:05.460953+0000","last_clean":"2023-10-08T16:12:05.460953+0000","last_became_active":"2023-10-08T16:12:05.460662+0000","last_became_peered":"2023-10-08T16:12:05.460662+0000","last_unstale":"2023-10-08T16:12:05.460953+0000","last_undegraded":"2023-10-08T16:12:05.460953+0000","last_fullsized":"2023-10-08T16:12:05.460953+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:23:51.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.460031+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:24.658535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.468972+0000","last_change":"2023-10-08T16:12:05.468972+0000","last_active":"2023-10-08T16:12:05.468972+0000","last_peered":"2023-10-08T16:12:05.468972+0000","last_clean":"2023-10-08T16:12:05.468972+0000","last_became_active":"2023-10-08T16:12:05.468736+0000","last_became_peered":"2023-10-08T16:12:05.468736+0000","last_unstale":"2023-10-08T16:12:05.468972+0000","last_undegraded":"2023-10-08T16:12:05.468972+0000","last_fullsized":"2023-10-08T16:12:05.468972+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:34.217176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.456432+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:24.658535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.461530+0000","last_change":"2023-10-08T16:12:05.461530+0000","last_active":"2023-10-08T16:12:05.461530+0000","last_peered":"2023-10-08T16:12:05.461530+0000","last_clean":"2023-10-08T16:12:05.461530+0000","last_became_active":"2023-10-08T16:12:05.461275+0000","last_became_peered":"2023-10-08T16:12:05.461275+0000","last_unstale":"2023-10-08T16:12:05.461530+0000","last_undegraded":"2023-10-08T16:12:05.461530+0000","last_fullsized":"2023-10-08T16:12:05.461530+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:35.446768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457221+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:10.030344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.465346+0000","last_change":"2023-10-08T16:12:05.465346+0000","last_active":"2023-10-08T16:12:05.465346+0000","last_peered":"2023-10-08T16:12:05.465346+0000","last_clean":"2023-10-08T16:12:05.465346+0000","last_became_active":"2023-10-08T16:12:05.465079+0000","last_became_peered":"2023-10-08T16:12:05.465079+0000","last_unstale":"2023-10-08T16:12:05.465346+0000","last_undegraded":"2023-10-08T16:12:05.465346+0000","last_fullsized":"2023-10-08T16:12:05.465346+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457318+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:38.333601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.468565+0000","last_change":"2023-10-08T16:12:05.468565+0000","last_active":"2023-10-08T16:12:05.468565+0000","last_peered":"2023-10-08T16:12:05.468565+0000","last_clean":"2023-10-08T16:12:05.468565+0000","last_became_active":"2023-10-08T16:12:05.468341+0000","last_became_peered":"2023-10-08T16:12:05.468341+0000","last_unstale":"2023-10-08T16:12:05.468565+0000","last_undegraded":"2023-10-08T16:12:05.468565+0000","last_fullsized":"2023-10-08T16:12:05.468565+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:28.445752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.456432+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:03.923141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.463964+0000","last_change":"2023-10-08T16:12:05.463964+0000","last_active":"2023-10-08T16:12:05.463964+0000","last_peered":"2023-10-08T16:12:05.463964+0000","last_clean":"2023-10-08T16:12:05.463964+0000","last_became_active":"2023-10-08T16:12:05.463742+0000","last_became_peered":"2023-10-08T16:12:05.463742+0000","last_unstale":"2023-10-08T16:12:05.463964+0000","last_undegraded":"2023-10-08T16:12:05.463964+0000","last_fullsized":"2023-10-08T16:12:05.463964+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:46.071582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459724+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:04.883903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.459931+0000","last_change":"2023-10-08T16:12:05.459931+0000","last_active":"2023-10-08T16:12:05.459931+0000","last_peered":"2023-10-08T16:12:05.459931+0000","last_clean":"2023-10-08T16:12:05.459931+0000","last_became_active":"2023-10-08T16:12:05.459689+0000","last_became_peered":"2023-10-08T16:12:05.459689+0000","last_unstale":"2023-10-08T16:12:05.459931+0000","last_undegraded":"2023-10-08T16:12:05.459931+0000","last_fullsized":"2023-10-08T16:12:05.459931+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:40.793975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.461701+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:10.972829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.465951+0000","last_change":"2023-10-08T16:12:05.465951+0000","last_active":"2023-10-08T16:12:05.465951+0000","last_peered":"2023-10-08T16:12:05.465951+0000","last_clean":"2023-10-08T16:12:05.465951+0000","last_became_active":"2023-10-08T16:12:05.465515+0000","last_became_peered":"2023-10-08T16:12:05.465515+0000","last_unstale":"2023-10-08T16:12:05.465951+0000","last_undegraded":"2023-10-08T16:12:05.465951+0000","last_fullsized":"2023-10-08T16:12:05.465951+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:44.861501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.457724+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:58.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.469234+0000","last_change":"2023-10-08T16:12:05.469234+0000","last_active":"2023-10-08T16:12:05.469234+0000","last_peered":"2023-10-08T16:12:05.469234+0000","last_clean":"2023-10-08T16:12:05.469234+0000","last_became_active":"2023-10-08T16:12:05.468862+0000","last_became_peered":"2023-10-08T16:12:05.468862+0000","last_unstale":"2023-10-08T16:12:05.469234+0000","last_undegraded":"2023-10-08T16:12:05.469234+0000","last_fullsized":"2023-10-08T16:12:05.469234+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:02.918477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.456761+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:58.618820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.466176+0000","last_change":"2023-10-08T16:12:05.466176+0000","last_active":"2023-10-08T16:12:05.466176+0000","last_peered":"2023-10-08T16:12:05.466176+0000","last_clean":"2023-10-08T16:12:05.466176+0000","last_became_active":"2023-10-08T16:12:05.465922+0000","last_became_peered":"2023-10-08T16:12:05.465922+0000","last_unstale":"2023-10-08T16:12:05.466176+0000","last_undegraded":"2023-10-08T16:12:05.466176+0000","last_fullsized":"2023-10-08T16:12:05.466176+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:12:05.449521+0000","last_change":"2023-10-08T16:12:05.459665+0000","last_active":"2023-10-08T16:12:05.449521+0000","last_peered":"2023-10-08T16:12:05.449521+0000","last_clean":"2023-10-08T16:12:05.449521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:12:05.449521+0000","last_undegraded":"2023-10-08T16:12:05.449521+0000","last_fullsized":"2023-10-08T16:12:05.449521+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:50.263772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-08T16:12:05.464262+0000","last_change":"2023-10-08T16:12:05.464262+0000","last_active":"2023-10-08T16:12:05.464262+0000","last_peered":"2023-10-08T16:12:05.464262+0000","last_clean":"2023-10-08T16:12:05.464262+0000","last_became_active":"2023-10-08T16:12:05.463994+0000","last_became_peered":"2023-10-08T16:12:05.463994+0000","last_unstale":"2023-10-08T16:12:05.464262+0000","last_undegraded":"2023-10-08T16:12:05.464262+0000","last_fullsized":"2023-10-08T16:12:05.464262+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:20.925992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":278,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-08T16:12:04.453462+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:12:04.453462+0000","last_peered":"2023-10-08T16:12:04.453462+0000","last_clean":"2023-10-08T16:12:04.453462+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:12:04.453462+0000","last_undegraded":"2023-10-08T16:12:04.453462+0000","last_fullsized":"2023-10-08T16:12:04.453462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1360,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193952,"statfs":{"total":200000000,"available":198607113,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.83499999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.72599999999999998,"15min":0.83099999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64400000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84999999999999998,"5min":1.756,"15min":1.756},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57499999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.82899999999999996,"5min":1.79,"15min":1.79},"last":0.61099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.81000000000000005,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83299999999999996,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":0.61899999999999999,"15min":0.52300000000000002},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":11.891,"5min":11.891,"15min":11.891},"last":0.626},{"interface":"front","average":{"1min":1.153,"5min":0.66400000000000003,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.33200000000000002},"max":{"1min":11.907999999999999,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.252,"15min":1.252},"last":0.502}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":1.135,"15min":1.135},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":0.67000000000000004,"5min":1.169,"15min":1.169},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.68100000000000005,"5min":3.738,"15min":3.738},"last":0.439},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.66200000000000003,"5min":1.103,"15min":1.103},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.56000000000000005},"min":{"1min":0.52100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.51700000000000002},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.29799999999999999},"max":{"1min":0.752,"5min":3.516,"15min":3.516},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71699999999999997,"5min":1.502,"15min":1.502},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.436},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.66600000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.313},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.313,"15min":0.313},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71199999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67100000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45300000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48599999999999999},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.71299999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73699999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36099999999999999,"15min":0.46700000000000003},"min":{"1min":0.23300000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.59899999999999998,"15min":3.593},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.45000000000000001},"min":{"1min":0.28799999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63600000000000001,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.622,"5min":0.622,"15min":3.6259999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40999999999999998,"15min":0.439},"min":{"1min":0.26800000000000002,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.80400000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63,"15min":0.70199999999999996},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0620000000000001,"15min":3.5630000000000002},"last":0.62},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":1.2969999999999999,"15min":1.7030000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.71899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.94099999999999995,"15min":3.532},"last":0.54100000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.375,"5min":0.375,"15min":0.36399999999999999},"max":{"1min":0.83499999999999996,"5min":1.341,"15min":1.6699999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64000000000000001,"15min":0.72399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":3.4929999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91600000000000004,"5min":1.0740000000000001,"15min":1.095},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.5429999999999999,"15min":1.6279999999999999},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193946,"statfs":{"total":200000000,"available":198600850,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.373},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42499999999999999,"5min":1.571,"15min":1.571},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.46999999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.50900000000000001,"5min":3.044,"15min":3.044},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41499999999999998,"15min":0.38400000000000001},"min":{"1min":0.28199999999999997,"5min":0.24399999999999999,"15min":0.20899999999999999},"max":{"1min":0.54500000000000004,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.59199999999999997,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.40999999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.496,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.47399999999999998,"15min":0.436},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.28999999999999998},"max":{"1min":0.63800000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.433}]},{"osd":4,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.70299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":1.401,"15min":1.401},"last":0.72899999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74299999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80500000000000005,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64000000000000001,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.42199999999999999,"15min":0.41499999999999998},"max":{"1min":0.76200000000000001,"5min":3.665,"15min":3.665},"last":0.58399999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84999999999999998,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82799999999999996,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.185},"max":{"1min":0.40000000000000002,"5min":0.56899999999999995,"15min":0.65500000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.23899999999999999},"max":{"1min":0.51000000000000001,"5min":0.63600000000000001,"15min":2.7109999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35799999999999998,"15min":0.34899999999999998},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.55400000000000005,"5min":0.67100000000000004,"15min":0.746},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.52200000000000002,"5min":0.68899999999999995,"15min":0.70299999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26000000000000001},"max":{"1min":0.53600000000000003,"5min":0.74099999999999999,"15min":1.3260000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.46100000000000002,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.54800000000000004,"5min":0.74299999999999999,"15min":1.2549999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77300000000000002,"5min":0.93500000000000005,"15min":2.8980000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.627}]},{"osd":5,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61799999999999999,"15min":0.59699999999999998},"min":{"1min":0.45400000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.99299999999999999,"15min":2.9319999999999999},"last":0.504}]},{"osd":6,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63300000000000001,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":1.091,"15min":1.091},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.38600000000000001},"max":{"1min":0.81799999999999995,"5min":1.042,"15min":3.0030000000000001},"last":0.44},{"interface":"front","average":{"1min":0.624,"5min":0.65600000000000003,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.78600000000000003,"5min":1.073,"15min":1.073},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.318},"min":{"1min":0.20999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.371,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.67800000000000005},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.54800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41699999999999998,"15min":0.39500000000000002},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.628},"last":0.622}]},{"osd":4,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60499999999999998,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.41799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84699999999999998,"5min":0.999,"15min":0.999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.495,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83999999999999997,"5min":1.026,"15min":1.026},"last":0.80000000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84899999999999998,"5min":0.85399999999999998,"15min":0.94399999999999995},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.47599999999999998,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.83199999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.83199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28899999999999998},"max":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":1.141},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":1.149},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60299999999999998,"15min":0.55600000000000005},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.77000000000000002,"5min":7.4749999999999996,"15min":7.4749999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.57799999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.77500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.70199999999999996,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":14.6,"15min":14.6},"last":0.60599999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.624,"15min":0.56799999999999995},"min":{"1min":0.34799999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.752,"5min":7.556,"15min":7.556},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77300000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.5},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.45200000000000001,"15min":0.47199999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.754,"15min":0.754},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64800000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67700000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197481,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63900000000000001,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76700000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.41399999999999998},"max":{"1min":0.77700000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55100000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.755,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.373,"15min":0.315},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.439}]},{"osd":4,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.28999999999999998,"15min":0.25600000000000001},"max":{"1min":0.64900000000000002,"5min":0.77000000000000002,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.73999999999999999,"15min":0.77700000000000002},"last":0.56999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.502,"15min":0.49099999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.73999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.71199999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.64100000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.58499999999999996}]}]}],"pool_statfs":[]}} 2023-10-08T16:12:12.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:12:12.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.264+0000 7f4fbdf4c700 1 Processor -- start 2023-10-08T16:12:12.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.264+0000 7f4fbdf4c700 1 -- start start 2023-10-08T16:12:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbdf4c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4fb80cd6e0 0x7f4fb80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbdf4c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb815cbd0 0x7f4fb815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:12.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbdf4c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb80cb7c0 con 0x7f4fb80cdab0 2023-10-08T16:12:12.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbdf4c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb815e850 con 0x7f4fb80cd6e0 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbdf4c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80cd030 con 0x7f4fb815cbd0 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbd74b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb815cbd0 0x7f4fb815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fbcf4a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4fb80cd6e0 0x7f4fb80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fb7fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4fb80cdab0 0x7f4fb815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:44642/0 (socket says 172.21.15.60:44642) 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.265+0000 7f4fb7fff700 1 -- 172.21.15.60:0/3829750900 learned_addr learned my addr 172.21.15.60:0/3829750900 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3829750900 >> v2:172.21.15.144:3300/0 conn(0x7f4fb80cd6e0 msgr2=0x7f4fb80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fbd74b700 1 --2- 172.21.15.60:0/3829750900 >> v2:172.21.15.144:3300/0 conn(0x7f4fb80cd6e0 0x7f4fb80cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3829750900 >> v1:172.21.15.144:6789/0 conn(0x7f4fb80cdab0 legacy=0x7f4fb815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3829750900 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb815e290 con 0x7f4fb815cbd0 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fbcf4a700 1 --2- 172.21.15.60:0/3829750900 >> v2:172.21.15.144:3300/0 conn(0x7f4fb80cd6e0 0x7f4fb80cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:12:12.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fbd74b700 1 --2- 172.21.15.60:0/3829750900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb815cbd0 0x7f4fb815d020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009e60 tx=0x7f4fb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b47240a8a028aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fb77fe700 1 -- 172.21.15.60:0/3829750900 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000e070 con 0x7f4fb815cbd0 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fb77fe700 1 -- 172.21.15.60:0/3829750900 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb000bb60 con 0x7f4fb815cbd0 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.266+0000 7f4fb77fe700 1 -- 172.21.15.60:0/3829750900 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0012430 con 0x7f4fb815cbd0 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3829750900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb815cbd0 msgr2=0x7f4fb815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3829750900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb815cbd0 0x7f4fb815d020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009e60 tx=0x7f4fb0009780 comp rx=0 tx=0).stop 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3829750900 shutdown_connections 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3829750900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb815cbd0 0x7f4fb815d020 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3829750900 >> v2:172.21.15.144:3300/0 conn(0x7f4fb80cd6e0 0x7f4fb80cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3829750900 >> 172.21.15.60:0/3829750900 conn(0x7f4fb8067660 msgr2=0x7f4fb8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3829750900 shutdown_connections 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.267+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3829750900 wait complete. 2023-10-08T16:12:12.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.268+0000 7f4fbdf4c700 1 Processor -- start 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.268+0000 7f4fbdf4c700 1 -- start start 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbdf4c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80cd6e0 0x7f4fb814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbdf4c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb80cdab0 0x7f4fb80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbdf4c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 0x7f4fb80b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbdf4c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb814ce30 con 0x7f4fb815cbd0 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbdf4c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80b4a40 con 0x7f4fb80cd6e0 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbdf4c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80b4d20 con 0x7f4fb80cdab0 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 0x7f4fb80b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 0x7f4fb80b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46102/0 (socket says 172.21.15.60:46102) 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3075156261 learned_addr learned my addr 172.21.15.60:0/3075156261 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbcf4a700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80cd6e0 0x7f4fb814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:12.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fb7fff700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb80cdab0 0x7f4fb80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb80cdab0 msgr2=0x7f4fb80b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb80cdab0 0x7f4fb80b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80cd6e0 msgr2=0x7f4fb814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80cd6e0 0x7f4fb814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 -- 172.21.15.60:0/3075156261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009420 con 0x7f4fb815cbd0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.269+0000 7f4fbd74b700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 0x7f4fb80b6020 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80ccdd0 tx=0x7f4fb0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.270+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0012ea0 con 0x7f4fb815cbd0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.270+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0027470 con 0x7f4fb815cbd0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.270+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0009a20 con 0x7f4fb815cbd0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.270+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0027850 con 0x7f4fb815cbd0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.270+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb80b52e0 con 0x7f4fb815cbd0 2023-10-08T16:12:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.271+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb8089280 con 0x7f4fb815cbd0 2023-10-08T16:12:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.271+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fb0024070 con 0x7f4fb815cbd0 2023-10-08T16:12:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.272+0000 7f4fb4ff9700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4fa4066f30 0x7f4fa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.272+0000 7f4fbcf4a700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4fa4066f30 0x7f4fa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.272+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fb0086fe0 con 0x7f4fb815cbd0 2023-10-08T16:12:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.272+0000 7f4fbcf4a700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4fa4066f30 0x7f4fa40693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80c7870 tx=0x7f4fa80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:12.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.276+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fb0054250 con 0x7f4fb815cbd0 2023-10-08T16:12:12.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.463+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fb815e570 con 0x7f4fa4066f30 2023-10-08T16:12:12.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.471+0000 7f4fb4ff9700 1 -- 172.21.15.60:0/3075156261 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285235 (secure 0 0 0) 0x7f4fb815e570 con 0x7f4fa4066f30 2023-10-08T16:12:12.530 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4fa4066f30 msgr2=0x7f4fa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4fa4066f30 0x7f4fa40693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80c7870 tx=0x7f4fa80091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 msgr2=0x7f4fb80b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 0x7f4fb80b6020 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80ccdd0 tx=0x7f4fb0019000 comp rx=0 tx=0).stop 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 shutdown_connections 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4fa4066f30 0x7f4fa40693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fb815cbd0 0x7f4fb80b6020 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80cd6e0 0x7f4fb814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 --2- 172.21.15.60:0/3075156261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb80cdab0 0x7f4fb80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.474+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 >> 172.21.15.60:0/3075156261 conn(0x7f4fb8067660 msgr2=0x7f4fb81576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.475+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 shutdown_connections 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:12.475+0000 7f4fbdf4c700 1 -- 172.21.15.60:0/3075156261 wait complete. 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:12:12.533 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-10-08T16:12:11.651570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7578,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554921,"statfs":{"total":1600000000,"available":1592239988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.199104"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480033+0000","last_change":"2023-10-08T16:12:06.479840+0000","last_active":"2023-10-08T16:12:06.480033+0000","last_peered":"2023-10-08T16:12:06.480033+0000","last_clean":"2023-10-08T16:12:06.480033+0000","last_became_active":"2023-10-08T16:12:06.479568+0000","last_became_peered":"2023-10-08T16:12:06.479568+0000","last_unstale":"2023-10-08T16:12:06.480033+0000","last_undegraded":"2023-10-08T16:12:06.480033+0000","last_fullsized":"2023-10-08T16:12:06.480033+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:30.486445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478522+0000","last_change":"2023-10-08T16:12:06.478455+0000","last_active":"2023-10-08T16:12:06.478522+0000","last_peered":"2023-10-08T16:12:06.478522+0000","last_clean":"2023-10-08T16:12:06.478522+0000","last_became_active":"2023-10-08T16:12:06.478204+0000","last_became_peered":"2023-10-08T16:12:06.478204+0000","last_unstale":"2023-10-08T16:12:06.478522+0000","last_undegraded":"2023-10-08T16:12:06.478522+0000","last_fullsized":"2023-10-08T16:12:06.478522+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:46.645232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.483788+0000","last_change":"2023-10-08T16:12:06.483325+0000","last_active":"2023-10-08T16:12:06.483788+0000","last_peered":"2023-10-08T16:12:06.483788+0000","last_clean":"2023-10-08T16:12:06.483788+0000","last_became_active":"2023-10-08T16:12:06.482525+0000","last_became_peered":"2023-10-08T16:12:06.482525+0000","last_unstale":"2023-10-08T16:12:06.483788+0000","last_undegraded":"2023-10-08T16:12:06.483788+0000","last_fullsized":"2023-10-08T16:12:06.483788+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:35.873166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.483609+0000","last_change":"2023-10-08T16:12:06.483557+0000","last_active":"2023-10-08T16:12:06.483609+0000","last_peered":"2023-10-08T16:12:06.483609+0000","last_clean":"2023-10-08T16:12:06.483609+0000","last_became_active":"2023-10-08T16:12:06.483344+0000","last_became_peered":"2023-10-08T16:12:06.483344+0000","last_unstale":"2023-10-08T16:12:06.483609+0000","last_undegraded":"2023-10-08T16:12:06.483609+0000","last_fullsized":"2023-10-08T16:12:06.483609+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:56.811499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480256+0000","last_change":"2023-10-08T16:12:06.479751+0000","last_active":"2023-10-08T16:12:06.480256+0000","last_peered":"2023-10-08T16:12:06.480256+0000","last_clean":"2023-10-08T16:12:06.480256+0000","last_became_active":"2023-10-08T16:12:06.479543+0000","last_became_peered":"2023-10-08T16:12:06.479543+0000","last_unstale":"2023-10-08T16:12:06.480256+0000","last_undegraded":"2023-10-08T16:12:06.480256+0000","last_fullsized":"2023-10-08T16:12:06.480256+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:31.025030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480080+0000","last_change":"2023-10-08T16:12:06.479804+0000","last_active":"2023-10-08T16:12:06.480080+0000","last_peered":"2023-10-08T16:12:06.480080+0000","last_clean":"2023-10-08T16:12:06.480080+0000","last_became_active":"2023-10-08T16:12:06.479559+0000","last_became_peered":"2023-10-08T16:12:06.479559+0000","last_unstale":"2023-10-08T16:12:06.480080+0000","last_undegraded":"2023-10-08T16:12:06.480080+0000","last_fullsized":"2023-10-08T16:12:06.480080+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:31.025030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481825+0000","last_change":"2023-10-08T16:12:06.480344+0000","last_active":"2023-10-08T16:12:06.481825+0000","last_peered":"2023-10-08T16:12:06.481825+0000","last_clean":"2023-10-08T16:12:06.481825+0000","last_became_active":"2023-10-08T16:12:06.479413+0000","last_became_peered":"2023-10-08T16:12:06.479413+0000","last_unstale":"2023-10-08T16:12:06.481825+0000","last_undegraded":"2023-10-08T16:12:06.481825+0000","last_fullsized":"2023-10-08T16:12:06.481825+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:35.873166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.483810+0000","last_change":"2023-10-08T16:12:06.483466+0000","last_active":"2023-10-08T16:12:06.483810+0000","last_peered":"2023-10-08T16:12:06.483810+0000","last_clean":"2023-10-08T16:12:06.483810+0000","last_became_active":"2023-10-08T16:12:06.482824+0000","last_became_peered":"2023-10-08T16:12:06.482824+0000","last_unstale":"2023-10-08T16:12:06.483810+0000","last_undegraded":"2023-10-08T16:12:06.483810+0000","last_fullsized":"2023-10-08T16:12:06.483810+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:01.573543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481029+0000","last_change":"2023-10-08T16:12:06.480887+0000","last_active":"2023-10-08T16:12:06.481029+0000","last_peered":"2023-10-08T16:12:06.481029+0000","last_clean":"2023-10-08T16:12:06.481029+0000","last_became_active":"2023-10-08T16:12:06.480639+0000","last_became_peered":"2023-10-08T16:12:06.480639+0000","last_unstale":"2023-10-08T16:12:06.481029+0000","last_undegraded":"2023-10-08T16:12:06.481029+0000","last_fullsized":"2023-10-08T16:12:06.481029+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:31.025030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480258+0000","last_change":"2023-10-08T16:12:06.479886+0000","last_active":"2023-10-08T16:12:06.480258+0000","last_peered":"2023-10-08T16:12:06.480258+0000","last_clean":"2023-10-08T16:12:06.480258+0000","last_became_active":"2023-10-08T16:12:06.479317+0000","last_became_peered":"2023-10-08T16:12:06.479317+0000","last_unstale":"2023-10-08T16:12:06.480258+0000","last_undegraded":"2023-10-08T16:12:06.480258+0000","last_fullsized":"2023-10-08T16:12:06.480258+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:56.201542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.476474+0000","last_change":"2023-10-08T16:12:06.474429+0000","last_active":"2023-10-08T16:12:06.476474+0000","last_peered":"2023-10-08T16:12:06.476474+0000","last_clean":"2023-10-08T16:12:06.476474+0000","last_became_active":"2023-10-08T16:12:06.474035+0000","last_became_peered":"2023-10-08T16:12:06.474035+0000","last_unstale":"2023-10-08T16:12:06.476474+0000","last_undegraded":"2023-10-08T16:12:06.476474+0000","last_fullsized":"2023-10-08T16:12:06.476474+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:04.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481723+0000","last_change":"2023-10-08T16:12:06.481392+0000","last_active":"2023-10-08T16:12:06.481723+0000","last_peered":"2023-10-08T16:12:06.481723+0000","last_clean":"2023-10-08T16:12:06.481723+0000","last_became_active":"2023-10-08T16:12:06.480856+0000","last_became_peered":"2023-10-08T16:12:06.480856+0000","last_unstale":"2023-10-08T16:12:06.481723+0000","last_undegraded":"2023-10-08T16:12:06.481723+0000","last_fullsized":"2023-10-08T16:12:06.481723+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:33.095042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.484486+0000","last_change":"2023-10-08T16:12:06.484419+0000","last_active":"2023-10-08T16:12:06.484486+0000","last_peered":"2023-10-08T16:12:06.484486+0000","last_clean":"2023-10-08T16:12:06.484486+0000","last_became_active":"2023-10-08T16:12:06.484035+0000","last_became_peered":"2023-10-08T16:12:06.484035+0000","last_unstale":"2023-10-08T16:12:06.484486+0000","last_undegraded":"2023-10-08T16:12:06.484486+0000","last_fullsized":"2023-10-08T16:12:06.484486+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:15.098056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.475805+0000","last_change":"2023-10-08T16:12:06.475690+0000","last_active":"2023-10-08T16:12:06.475805+0000","last_peered":"2023-10-08T16:12:06.475805+0000","last_clean":"2023-10-08T16:12:06.475805+0000","last_became_active":"2023-10-08T16:12:06.475441+0000","last_became_peered":"2023-10-08T16:12:06.475441+0000","last_unstale":"2023-10-08T16:12:06.475805+0000","last_undegraded":"2023-10-08T16:12:06.475805+0000","last_fullsized":"2023-10-08T16:12:06.475805+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:04.883903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481804+0000","last_change":"2023-10-08T16:12:06.481467+0000","last_active":"2023-10-08T16:12:06.481804+0000","last_peered":"2023-10-08T16:12:06.481804+0000","last_clean":"2023-10-08T16:12:06.481804+0000","last_became_active":"2023-10-08T16:12:06.481103+0000","last_became_peered":"2023-10-08T16:12:06.481103+0000","last_unstale":"2023-10-08T16:12:06.481804+0000","last_undegraded":"2023-10-08T16:12:06.481804+0000","last_fullsized":"2023-10-08T16:12:06.481804+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:10.972829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481263+0000","last_change":"2023-10-08T16:12:06.481192+0000","last_active":"2023-10-08T16:12:06.481263+0000","last_peered":"2023-10-08T16:12:06.481263+0000","last_clean":"2023-10-08T16:12:06.481263+0000","last_became_active":"2023-10-08T16:12:06.480296+0000","last_became_peered":"2023-10-08T16:12:06.480296+0000","last_unstale":"2023-10-08T16:12:06.481263+0000","last_undegraded":"2023-10-08T16:12:06.481263+0000","last_fullsized":"2023-10-08T16:12:06.481263+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:12.626271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.486112+0000","last_change":"2023-10-08T16:12:06.485778+0000","last_active":"2023-10-08T16:12:06.486112+0000","last_peered":"2023-10-08T16:12:06.486112+0000","last_clean":"2023-10-08T16:12:06.486112+0000","last_became_active":"2023-10-08T16:12:06.485018+0000","last_became_peered":"2023-10-08T16:12:06.485018+0000","last_unstale":"2023-10-08T16:12:06.486112+0000","last_undegraded":"2023-10-08T16:12:06.486112+0000","last_fullsized":"2023-10-08T16:12:06.486112+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:44.055765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482885+0000","last_change":"2023-10-08T16:12:06.482788+0000","last_active":"2023-10-08T16:12:06.482885+0000","last_peered":"2023-10-08T16:12:06.482885+0000","last_clean":"2023-10-08T16:12:06.482885+0000","last_became_active":"2023-10-08T16:12:06.482530+0000","last_became_peered":"2023-10-08T16:12:06.482530+0000","last_unstale":"2023-10-08T16:12:06.482885+0000","last_undegraded":"2023-10-08T16:12:06.482885+0000","last_fullsized":"2023-10-08T16:12:06.482885+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:39.742210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478211+0000","last_change":"2023-10-08T16:12:06.478123+0000","last_active":"2023-10-08T16:12:06.478211+0000","last_peered":"2023-10-08T16:12:06.478211+0000","last_clean":"2023-10-08T16:12:06.478211+0000","last_became_active":"2023-10-08T16:12:06.477887+0000","last_became_peered":"2023-10-08T16:12:06.477887+0000","last_unstale":"2023-10-08T16:12:06.478211+0000","last_undegraded":"2023-10-08T16:12:06.478211+0000","last_fullsized":"2023-10-08T16:12:06.478211+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:04.335351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480619+0000","last_change":"2023-10-08T16:12:06.480544+0000","last_active":"2023-10-08T16:12:06.480619+0000","last_peered":"2023-10-08T16:12:06.480619+0000","last_clean":"2023-10-08T16:12:06.480619+0000","last_became_active":"2023-10-08T16:12:06.480338+0000","last_became_peered":"2023-10-08T16:12:06.480338+0000","last_unstale":"2023-10-08T16:12:06.480619+0000","last_undegraded":"2023-10-08T16:12:06.480619+0000","last_fullsized":"2023-10-08T16:12:06.480619+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:35.873166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480780+0000","last_change":"2023-10-08T16:12:06.480720+0000","last_active":"2023-10-08T16:12:06.480780+0000","last_peered":"2023-10-08T16:12:06.480780+0000","last_clean":"2023-10-08T16:12:06.480780+0000","last_became_active":"2023-10-08T16:12:06.480477+0000","last_became_peered":"2023-10-08T16:12:06.480477+0000","last_unstale":"2023-10-08T16:12:06.480780+0000","last_undegraded":"2023-10-08T16:12:06.480780+0000","last_fullsized":"2023-10-08T16:12:06.480780+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:44.055765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.472024+0000","last_change":"2023-10-08T16:12:06.471950+0000","last_active":"2023-10-08T16:12:06.472024+0000","last_peered":"2023-10-08T16:12:06.472024+0000","last_clean":"2023-10-08T16:12:06.472024+0000","last_became_active":"2023-10-08T16:12:06.471709+0000","last_became_peered":"2023-10-08T16:12:06.471709+0000","last_unstale":"2023-10-08T16:12:06.472024+0000","last_undegraded":"2023-10-08T16:12:06.472024+0000","last_fullsized":"2023-10-08T16:12:06.472024+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:33.552786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.484909+0000","last_change":"2023-10-08T16:12:06.484539+0000","last_active":"2023-10-08T16:12:06.484909+0000","last_peered":"2023-10-08T16:12:06.484909+0000","last_clean":"2023-10-08T16:12:06.484909+0000","last_became_active":"2023-10-08T16:12:06.484074+0000","last_became_peered":"2023-10-08T16:12:06.484074+0000","last_unstale":"2023-10-08T16:12:06.484909+0000","last_undegraded":"2023-10-08T16:12:06.484909+0000","last_fullsized":"2023-10-08T16:12:06.484909+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:20.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.477114+0000","last_change":"2023-10-08T16:12:06.476393+0000","last_active":"2023-10-08T16:12:06.477114+0000","last_peered":"2023-10-08T16:12:06.477114+0000","last_clean":"2023-10-08T16:12:06.477114+0000","last_became_active":"2023-10-08T16:12:06.476146+0000","last_became_peered":"2023-10-08T16:12:06.476146+0000","last_unstale":"2023-10-08T16:12:06.477114+0000","last_undegraded":"2023-10-08T16:12:06.477114+0000","last_fullsized":"2023-10-08T16:12:06.477114+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:48.999484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480240+0000","last_change":"2023-10-08T16:12:06.479741+0000","last_active":"2023-10-08T16:12:06.480240+0000","last_peered":"2023-10-08T16:12:06.480240+0000","last_clean":"2023-10-08T16:12:06.480240+0000","last_became_active":"2023-10-08T16:12:06.479098+0000","last_became_peered":"2023-10-08T16:12:06.479098+0000","last_unstale":"2023-10-08T16:12:06.480240+0000","last_undegraded":"2023-10-08T16:12:06.480240+0000","last_fullsized":"2023-10-08T16:12:06.480240+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:23:52.925602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481357+0000","last_change":"2023-10-08T16:12:06.481299+0000","last_active":"2023-10-08T16:12:06.481357+0000","last_peered":"2023-10-08T16:12:06.481357+0000","last_clean":"2023-10-08T16:12:06.481357+0000","last_became_active":"2023-10-08T16:12:06.480978+0000","last_became_peered":"2023-10-08T16:12:06.480978+0000","last_unstale":"2023-10-08T16:12:06.481357+0000","last_undegraded":"2023-10-08T16:12:06.481357+0000","last_fullsized":"2023-10-08T16:12:06.481357+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:12.222284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481822+0000","last_change":"2023-10-08T16:12:06.481116+0000","last_active":"2023-10-08T16:12:06.481822+0000","last_peered":"2023-10-08T16:12:06.481822+0000","last_clean":"2023-10-08T16:12:06.481822+0000","last_became_active":"2023-10-08T16:12:06.479173+0000","last_became_peered":"2023-10-08T16:12:06.479173+0000","last_unstale":"2023-10-08T16:12:06.481822+0000","last_undegraded":"2023-10-08T16:12:06.481822+0000","last_fullsized":"2023-10-08T16:12:06.481822+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:51.373340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.479173+0000","last_change":"2023-10-08T16:12:06.479106+0000","last_active":"2023-10-08T16:12:06.479173+0000","last_peered":"2023-10-08T16:12:06.479173+0000","last_clean":"2023-10-08T16:12:06.479173+0000","last_became_active":"2023-10-08T16:12:06.478832+0000","last_became_peered":"2023-10-08T16:12:06.478832+0000","last_unstale":"2023-10-08T16:12:06.479173+0000","last_undegraded":"2023-10-08T16:12:06.479173+0000","last_fullsized":"2023-10-08T16:12:06.479173+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:58.618820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.479363+0000","last_change":"2023-10-08T16:12:06.479289+0000","last_active":"2023-10-08T16:12:06.479363+0000","last_peered":"2023-10-08T16:12:06.479363+0000","last_clean":"2023-10-08T16:12:06.479363+0000","last_became_active":"2023-10-08T16:12:06.479021+0000","last_became_peered":"2023-10-08T16:12:06.479021+0000","last_unstale":"2023-10-08T16:12:06.479363+0000","last_undegraded":"2023-10-08T16:12:06.479363+0000","last_fullsized":"2023-10-08T16:12:06.479363+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:55.209899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.477685+0000","last_change":"2023-10-08T16:12:06.477608+0000","last_active":"2023-10-08T16:12:06.477685+0000","last_peered":"2023-10-08T16:12:06.477685+0000","last_clean":"2023-10-08T16:12:06.477685+0000","last_became_active":"2023-10-08T16:12:06.477275+0000","last_became_peered":"2023-10-08T16:12:06.477275+0000","last_unstale":"2023-10-08T16:12:06.477685+0000","last_undegraded":"2023-10-08T16:12:06.477685+0000","last_fullsized":"2023-10-08T16:12:06.477685+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:22.967279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482099+0000","last_change":"2023-10-08T16:12:06.481715+0000","last_active":"2023-10-08T16:12:06.482099+0000","last_peered":"2023-10-08T16:12:06.482099+0000","last_clean":"2023-10-08T16:12:06.482099+0000","last_became_active":"2023-10-08T16:12:06.481139+0000","last_became_peered":"2023-10-08T16:12:06.481139+0000","last_unstale":"2023-10-08T16:12:06.482099+0000","last_undegraded":"2023-10-08T16:12:06.482099+0000","last_fullsized":"2023-10-08T16:12:06.482099+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:12.455965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481843+0000","last_change":"2023-10-08T16:12:06.480511+0000","last_active":"2023-10-08T16:12:06.481843+0000","last_peered":"2023-10-08T16:12:06.481843+0000","last_clean":"2023-10-08T16:12:06.481843+0000","last_became_active":"2023-10-08T16:12:06.479738+0000","last_became_peered":"2023-10-08T16:12:06.479738+0000","last_unstale":"2023-10-08T16:12:06.481843+0000","last_undegraded":"2023-10-08T16:12:06.481843+0000","last_fullsized":"2023-10-08T16:12:06.481843+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:01.573543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481672+0000","last_change":"2023-10-08T16:12:06.481525+0000","last_active":"2023-10-08T16:12:06.481672+0000","last_peered":"2023-10-08T16:12:06.481672+0000","last_clean":"2023-10-08T16:12:06.481672+0000","last_became_active":"2023-10-08T16:12:06.481289+0000","last_became_peered":"2023-10-08T16:12:06.481289+0000","last_unstale":"2023-10-08T16:12:06.481672+0000","last_undegraded":"2023-10-08T16:12:06.481672+0000","last_fullsized":"2023-10-08T16:12:06.481672+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:01.573543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"147'4","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.492935+0000","last_change":"2023-10-08T16:12:05.463462+0000","last_active":"2023-10-08T16:12:06.492935+0000","last_peered":"2023-10-08T16:12:06.492935+0000","last_clean":"2023-10-08T16:12:06.492935+0000","last_became_active":"2023-10-08T16:12:05.463212+0000","last_became_peered":"2023-10-08T16:12:05.463212+0000","last_unstale":"2023-10-08T16:12:06.492935+0000","last_undegraded":"2023-10-08T16:12:06.492935+0000","last_fullsized":"2023-10-08T16:12:06.492935+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:47.303791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.483829+0000","last_change":"2023-10-08T16:12:06.483595+0000","last_active":"2023-10-08T16:12:06.483829+0000","last_peered":"2023-10-08T16:12:06.483829+0000","last_clean":"2023-10-08T16:12:06.483829+0000","last_became_active":"2023-10-08T16:12:06.483108+0000","last_became_peered":"2023-10-08T16:12:06.483108+0000","last_unstale":"2023-10-08T16:12:06.483829+0000","last_undegraded":"2023-10-08T16:12:06.483829+0000","last_fullsized":"2023-10-08T16:12:06.483829+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:44.055765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"147'1","reported_seq":11,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.494707+0000","last_change":"2023-10-08T16:12:05.467110+0000","last_active":"2023-10-08T16:12:06.494707+0000","last_peered":"2023-10-08T16:12:06.494707+0000","last_clean":"2023-10-08T16:12:06.494707+0000","last_became_active":"2023-10-08T16:12:05.466856+0000","last_became_peered":"2023-10-08T16:12:05.466856+0000","last_unstale":"2023-10-08T16:12:06.494707+0000","last_undegraded":"2023-10-08T16:12:06.494707+0000","last_fullsized":"2023-10-08T16:12:06.494707+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:14.093393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478453+0000","last_change":"2023-10-08T16:12:06.478203+0000","last_active":"2023-10-08T16:12:06.478453+0000","last_peered":"2023-10-08T16:12:06.478453+0000","last_clean":"2023-10-08T16:12:06.478453+0000","last_became_active":"2023-10-08T16:12:06.477944+0000","last_became_peered":"2023-10-08T16:12:06.477944+0000","last_unstale":"2023-10-08T16:12:06.478453+0000","last_undegraded":"2023-10-08T16:12:06.478453+0000","last_fullsized":"2023-10-08T16:12:06.478453+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:30.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"147'2","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.493644+0000","last_change":"2023-10-08T16:12:05.465617+0000","last_active":"2023-10-08T16:12:06.493644+0000","last_peered":"2023-10-08T16:12:06.493644+0000","last_clean":"2023-10-08T16:12:06.493644+0000","last_became_active":"2023-10-08T16:12:05.465389+0000","last_became_peered":"2023-10-08T16:12:05.465389+0000","last_unstale":"2023-10-08T16:12:06.493644+0000","last_undegraded":"2023-10-08T16:12:06.493644+0000","last_fullsized":"2023-10-08T16:12:06.493644+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:36.823584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.476818+0000","last_change":"2023-10-08T16:12:06.476555+0000","last_active":"2023-10-08T16:12:06.476818+0000","last_peered":"2023-10-08T16:12:06.476818+0000","last_clean":"2023-10-08T16:12:06.476818+0000","last_became_active":"2023-10-08T16:12:06.476307+0000","last_became_peered":"2023-10-08T16:12:06.476307+0000","last_unstale":"2023-10-08T16:12:06.476818+0000","last_undegraded":"2023-10-08T16:12:06.476818+0000","last_fullsized":"2023-10-08T16:12:06.476818+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:01.573543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"147'2","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.493902+0000","last_change":"2023-10-08T16:12:05.465929+0000","last_active":"2023-10-08T16:12:06.493902+0000","last_peered":"2023-10-08T16:12:06.493902+0000","last_clean":"2023-10-08T16:12:06.493902+0000","last_became_active":"2023-10-08T16:12:05.465661+0000","last_became_peered":"2023-10-08T16:12:05.465661+0000","last_unstale":"2023-10-08T16:12:06.493902+0000","last_undegraded":"2023-10-08T16:12:06.493902+0000","last_fullsized":"2023-10-08T16:12:06.493902+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:23.013942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.485286+0000","last_change":"2023-10-08T16:12:06.485213+0000","last_active":"2023-10-08T16:12:06.485286+0000","last_peered":"2023-10-08T16:12:06.485286+0000","last_clean":"2023-10-08T16:12:06.485286+0000","last_became_active":"2023-10-08T16:12:06.485024+0000","last_became_peered":"2023-10-08T16:12:06.485024+0000","last_unstale":"2023-10-08T16:12:06.485286+0000","last_undegraded":"2023-10-08T16:12:06.485286+0000","last_fullsized":"2023-10-08T16:12:06.485286+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:25.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"147'1","reported_seq":11,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.493562+0000","last_change":"2023-10-08T16:12:05.464740+0000","last_active":"2023-10-08T16:12:06.493562+0000","last_peered":"2023-10-08T16:12:06.493562+0000","last_clean":"2023-10-08T16:12:06.493562+0000","last_became_active":"2023-10-08T16:12:05.463920+0000","last_became_peered":"2023-10-08T16:12:05.463920+0000","last_unstale":"2023-10-08T16:12:06.493562+0000","last_undegraded":"2023-10-08T16:12:06.493562+0000","last_fullsized":"2023-10-08T16:12:06.493562+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:54.205235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481859+0000","last_change":"2023-10-08T16:12:06.480965+0000","last_active":"2023-10-08T16:12:06.481859+0000","last_peered":"2023-10-08T16:12:06.481859+0000","last_clean":"2023-10-08T16:12:06.481859+0000","last_became_active":"2023-10-08T16:12:06.480734+0000","last_became_peered":"2023-10-08T16:12:06.480734+0000","last_unstale":"2023-10-08T16:12:06.481859+0000","last_undegraded":"2023-10-08T16:12:06.481859+0000","last_fullsized":"2023-10-08T16:12:06.481859+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:12.455965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"147'1","reported_seq":11,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.493631+0000","last_change":"2023-10-08T16:12:05.466544+0000","last_active":"2023-10-08T16:12:06.493631+0000","last_peered":"2023-10-08T16:12:06.493631+0000","last_clean":"2023-10-08T16:12:06.493631+0000","last_became_active":"2023-10-08T16:12:05.464114+0000","last_became_peered":"2023-10-08T16:12:05.464114+0000","last_unstale":"2023-10-08T16:12:06.493631+0000","last_undegraded":"2023-10-08T16:12:06.493631+0000","last_fullsized":"2023-10-08T16:12:06.493631+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:32.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.479562+0000","last_change":"2023-10-08T16:12:06.479217+0000","last_active":"2023-10-08T16:12:06.479562+0000","last_peered":"2023-10-08T16:12:06.479562+0000","last_clean":"2023-10-08T16:12:06.479562+0000","last_became_active":"2023-10-08T16:12:06.478591+0000","last_became_peered":"2023-10-08T16:12:06.478591+0000","last_unstale":"2023-10-08T16:12:06.479562+0000","last_undegraded":"2023-10-08T16:12:06.479562+0000","last_fullsized":"2023-10-08T16:12:06.479562+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:12.455965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.473799+0000","last_change":"2023-10-08T16:12:05.464071+0000","last_active":"2023-10-08T16:12:06.473799+0000","last_peered":"2023-10-08T16:12:06.473799+0000","last_clean":"2023-10-08T16:12:06.473799+0000","last_became_active":"2023-10-08T16:12:05.463775+0000","last_became_peered":"2023-10-08T16:12:05.463775+0000","last_unstale":"2023-10-08T16:12:06.473799+0000","last_undegraded":"2023-10-08T16:12:06.473799+0000","last_fullsized":"2023-10-08T16:12:06.473799+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:49.259109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482243+0000","last_change":"2023-10-08T16:12:06.482164+0000","last_active":"2023-10-08T16:12:06.482243+0000","last_peered":"2023-10-08T16:12:06.482243+0000","last_clean":"2023-10-08T16:12:06.482243+0000","last_became_active":"2023-10-08T16:12:06.481928+0000","last_became_peered":"2023-10-08T16:12:06.481928+0000","last_unstale":"2023-10-08T16:12:06.482243+0000","last_undegraded":"2023-10-08T16:12:06.482243+0000","last_fullsized":"2023-10-08T16:12:06.482243+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:46.861142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.470164+0000","last_change":"2023-10-08T16:12:05.470001+0000","last_active":"2023-10-08T16:12:06.470164+0000","last_peered":"2023-10-08T16:12:06.470164+0000","last_clean":"2023-10-08T16:12:06.470164+0000","last_became_active":"2023-10-08T16:12:05.469788+0000","last_became_peered":"2023-10-08T16:12:05.469788+0000","last_unstale":"2023-10-08T16:12:06.470164+0000","last_undegraded":"2023-10-08T16:12:06.470164+0000","last_fullsized":"2023-10-08T16:12:06.470164+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:21.962615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481844+0000","last_change":"2023-10-08T16:12:06.481725+0000","last_active":"2023-10-08T16:12:06.481844+0000","last_peered":"2023-10-08T16:12:06.481844+0000","last_clean":"2023-10-08T16:12:06.481844+0000","last_became_active":"2023-10-08T16:12:06.480832+0000","last_became_peered":"2023-10-08T16:12:06.480832+0000","last_unstale":"2023-10-08T16:12:06.481844+0000","last_undegraded":"2023-10-08T16:12:06.481844+0000","last_fullsized":"2023-10-08T16:12:06.481844+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:31.260233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.471371+0000","last_change":"2023-10-08T16:12:05.464667+0000","last_active":"2023-10-08T16:12:06.471371+0000","last_peered":"2023-10-08T16:12:06.471371+0000","last_clean":"2023-10-08T16:12:06.471371+0000","last_became_active":"2023-10-08T16:12:05.464282+0000","last_became_peered":"2023-10-08T16:12:05.464282+0000","last_unstale":"2023-10-08T16:12:06.471371+0000","last_undegraded":"2023-10-08T16:12:06.471371+0000","last_fullsized":"2023-10-08T16:12:06.471371+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:50.368676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478546+0000","last_change":"2023-10-08T16:12:06.478182+0000","last_active":"2023-10-08T16:12:06.478546+0000","last_peered":"2023-10-08T16:12:06.478546+0000","last_clean":"2023-10-08T16:12:06.478546+0000","last_became_active":"2023-10-08T16:12:06.477969+0000","last_became_peered":"2023-10-08T16:12:06.477969+0000","last_unstale":"2023-10-08T16:12:06.478546+0000","last_undegraded":"2023-10-08T16:12:06.478546+0000","last_fullsized":"2023-10-08T16:12:06.478546+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:24.406323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.472968+0000","last_change":"2023-10-08T16:12:05.468245+0000","last_active":"2023-10-08T16:12:06.472968+0000","last_peered":"2023-10-08T16:12:06.472968+0000","last_clean":"2023-10-08T16:12:06.472968+0000","last_became_active":"2023-10-08T16:12:05.467604+0000","last_became_peered":"2023-10-08T16:12:05.467604+0000","last_unstale":"2023-10-08T16:12:06.472968+0000","last_undegraded":"2023-10-08T16:12:06.472968+0000","last_fullsized":"2023-10-08T16:12:06.472968+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:03.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482253+0000","last_change":"2023-10-08T16:12:06.482181+0000","last_active":"2023-10-08T16:12:06.482253+0000","last_peered":"2023-10-08T16:12:06.482253+0000","last_clean":"2023-10-08T16:12:06.482253+0000","last_became_active":"2023-10-08T16:12:06.481866+0000","last_became_peered":"2023-10-08T16:12:06.481866+0000","last_unstale":"2023-10-08T16:12:06.482253+0000","last_undegraded":"2023-10-08T16:12:06.482253+0000","last_fullsized":"2023-10-08T16:12:06.482253+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:25.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"147'3","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.495228+0000","last_change":"2023-10-08T16:12:05.468130+0000","last_active":"2023-10-08T16:12:06.495228+0000","last_peered":"2023-10-08T16:12:06.495228+0000","last_clean":"2023-10-08T16:12:06.495228+0000","last_became_active":"2023-10-08T16:12:05.467679+0000","last_became_peered":"2023-10-08T16:12:05.467679+0000","last_unstale":"2023-10-08T16:12:06.495228+0000","last_undegraded":"2023-10-08T16:12:06.495228+0000","last_fullsized":"2023-10-08T16:12:06.495228+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:58.164507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.484903+0000","last_change":"2023-10-08T16:12:06.484838+0000","last_active":"2023-10-08T16:12:06.484903+0000","last_peered":"2023-10-08T16:12:06.484903+0000","last_clean":"2023-10-08T16:12:06.484903+0000","last_became_active":"2023-10-08T16:12:06.484586+0000","last_became_peered":"2023-10-08T16:12:06.484586+0000","last_unstale":"2023-10-08T16:12:06.484903+0000","last_undegraded":"2023-10-08T16:12:06.484903+0000","last_fullsized":"2023-10-08T16:12:06.484903+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:12.222284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"147'6","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.495555+0000","last_change":"2023-10-08T16:12:05.469459+0000","last_active":"2023-10-08T16:12:06.495555+0000","last_peered":"2023-10-08T16:12:06.495555+0000","last_clean":"2023-10-08T16:12:06.495555+0000","last_became_active":"2023-10-08T16:12:05.469236+0000","last_became_peered":"2023-10-08T16:12:05.469236+0000","last_unstale":"2023-10-08T16:12:06.495555+0000","last_undegraded":"2023-10-08T16:12:06.495555+0000","last_fullsized":"2023-10-08T16:12:06.495555+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480239+0000","last_change":"2023-10-08T16:12:06.480170+0000","last_active":"2023-10-08T16:12:06.480239+0000","last_peered":"2023-10-08T16:12:06.480239+0000","last_clean":"2023-10-08T16:12:06.480239+0000","last_became_active":"2023-10-08T16:12:06.479926+0000","last_became_peered":"2023-10-08T16:12:06.479926+0000","last_unstale":"2023-10-08T16:12:06.480239+0000","last_undegraded":"2023-10-08T16:12:06.480239+0000","last_fullsized":"2023-10-08T16:12:06.480239+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:00:29.949340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.472929+0000","last_change":"2023-10-08T16:12:05.463875+0000","last_active":"2023-10-08T16:12:06.472929+0000","last_peered":"2023-10-08T16:12:06.472929+0000","last_clean":"2023-10-08T16:12:06.472929+0000","last_became_active":"2023-10-08T16:12:05.463270+0000","last_became_peered":"2023-10-08T16:12:05.463270+0000","last_unstale":"2023-10-08T16:12:06.472929+0000","last_undegraded":"2023-10-08T16:12:06.472929+0000","last_fullsized":"2023-10-08T16:12:06.472929+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:23.175869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.483196+0000","last_change":"2023-10-08T16:12:06.483124+0000","last_active":"2023-10-08T16:12:06.483196+0000","last_peered":"2023-10-08T16:12:06.483196+0000","last_clean":"2023-10-08T16:12:06.483196+0000","last_became_active":"2023-10-08T16:12:06.482868+0000","last_became_peered":"2023-10-08T16:12:06.482868+0000","last_unstale":"2023-10-08T16:12:06.483196+0000","last_undegraded":"2023-10-08T16:12:06.483196+0000","last_fullsized":"2023-10-08T16:12:06.483196+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:58.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.469462+0000","last_change":"2023-10-08T16:12:05.464893+0000","last_active":"2023-10-08T16:12:06.469462+0000","last_peered":"2023-10-08T16:12:06.469462+0000","last_clean":"2023-10-08T16:12:06.469462+0000","last_became_active":"2023-10-08T16:12:05.464239+0000","last_became_peered":"2023-10-08T16:12:05.464239+0000","last_unstale":"2023-10-08T16:12:06.469462+0000","last_undegraded":"2023-10-08T16:12:06.469462+0000","last_fullsized":"2023-10-08T16:12:06.469462+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:09.968166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481740+0000","last_change":"2023-10-08T16:12:06.481538+0000","last_active":"2023-10-08T16:12:06.481740+0000","last_peered":"2023-10-08T16:12:06.481740+0000","last_clean":"2023-10-08T16:12:06.481740+0000","last_became_active":"2023-10-08T16:12:06.481157+0000","last_became_peered":"2023-10-08T16:12:06.481157+0000","last_unstale":"2023-10-08T16:12:06.481740+0000","last_undegraded":"2023-10-08T16:12:06.481740+0000","last_fullsized":"2023-10-08T16:12:06.481740+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:56.201542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"147'8","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.496115+0000","last_change":"2023-10-08T16:12:05.470754+0000","last_active":"2023-10-08T16:12:06.496115+0000","last_peered":"2023-10-08T16:12:06.496115+0000","last_clean":"2023-10-08T16:12:06.496115+0000","last_became_active":"2023-10-08T16:12:05.469992+0000","last_became_peered":"2023-10-08T16:12:05.469992+0000","last_unstale":"2023-10-08T16:12:06.496115+0000","last_undegraded":"2023-10-08T16:12:06.496115+0000","last_fullsized":"2023-10-08T16:12:06.496115+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:47.303791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.479580+0000","last_change":"2023-10-08T16:12:06.479352+0000","last_active":"2023-10-08T16:12:06.479580+0000","last_peered":"2023-10-08T16:12:06.479580+0000","last_clean":"2023-10-08T16:12:06.479580+0000","last_became_active":"2023-10-08T16:12:06.478928+0000","last_became_peered":"2023-10-08T16:12:06.478928+0000","last_unstale":"2023-10-08T16:12:06.479580+0000","last_undegraded":"2023-10-08T16:12:06.479580+0000","last_fullsized":"2023-10-08T16:12:06.479580+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:30.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"147'1","reported_seq":11,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.494407+0000","last_change":"2023-10-08T16:12:05.462124+0000","last_active":"2023-10-08T16:12:06.494407+0000","last_peered":"2023-10-08T16:12:06.494407+0000","last_clean":"2023-10-08T16:12:06.494407+0000","last_became_active":"2023-10-08T16:12:05.461879+0000","last_became_peered":"2023-10-08T16:12:05.461879+0000","last_unstale":"2023-10-08T16:12:06.494407+0000","last_undegraded":"2023-10-08T16:12:06.494407+0000","last_fullsized":"2023-10-08T16:12:06.494407+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:29.481782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481031+0000","last_change":"2023-10-08T16:12:06.480268+0000","last_active":"2023-10-08T16:12:06.481031+0000","last_peered":"2023-10-08T16:12:06.481031+0000","last_clean":"2023-10-08T16:12:06.481031+0000","last_became_active":"2023-10-08T16:12:06.479908+0000","last_became_peered":"2023-10-08T16:12:06.479908+0000","last_unstale":"2023-10-08T16:12:06.481031+0000","last_undegraded":"2023-10-08T16:12:06.481031+0000","last_fullsized":"2023-10-08T16:12:06.481031+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:29.450416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"147'2","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.494617+0000","last_change":"2023-10-08T16:12:05.469006+0000","last_active":"2023-10-08T16:12:06.494617+0000","last_peered":"2023-10-08T16:12:06.494617+0000","last_clean":"2023-10-08T16:12:06.494617+0000","last_became_active":"2023-10-08T16:12:05.468785+0000","last_became_peered":"2023-10-08T16:12:05.468785+0000","last_unstale":"2023-10-08T16:12:06.494617+0000","last_undegraded":"2023-10-08T16:12:06.494617+0000","last_fullsized":"2023-10-08T16:12:06.494617+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:36.252475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478293+0000","last_change":"2023-10-08T16:12:06.477876+0000","last_active":"2023-10-08T16:12:06.478293+0000","last_peered":"2023-10-08T16:12:06.478293+0000","last_clean":"2023-10-08T16:12:06.478293+0000","last_became_active":"2023-10-08T16:12:06.477539+0000","last_became_peered":"2023-10-08T16:12:06.477539+0000","last_unstale":"2023-10-08T16:12:06.478293+0000","last_undegraded":"2023-10-08T16:12:06.478293+0000","last_fullsized":"2023-10-08T16:12:06.478293+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:12.342613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"147'1","reported_seq":11,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.494365+0000","last_change":"2023-10-08T16:12:05.462609+0000","last_active":"2023-10-08T16:12:06.494365+0000","last_peered":"2023-10-08T16:12:06.494365+0000","last_clean":"2023-10-08T16:12:06.494365+0000","last_became_active":"2023-10-08T16:12:05.462350+0000","last_became_peered":"2023-10-08T16:12:05.462350+0000","last_unstale":"2023-10-08T16:12:06.494365+0000","last_undegraded":"2023-10-08T16:12:06.494365+0000","last_fullsized":"2023-10-08T16:12:06.494365+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:45.856479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.477251+0000","last_change":"2023-10-08T16:12:06.477038+0000","last_active":"2023-10-08T16:12:06.477251+0000","last_peered":"2023-10-08T16:12:06.477251+0000","last_clean":"2023-10-08T16:12:06.477251+0000","last_became_active":"2023-10-08T16:12:06.476806+0000","last_became_peered":"2023-10-08T16:12:06.476806+0000","last_unstale":"2023-10-08T16:12:06.477251+0000","last_undegraded":"2023-10-08T16:12:06.477251+0000","last_fullsized":"2023-10-08T16:12:06.477251+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:04.839565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.471011+0000","last_change":"2023-10-08T16:12:05.465073+0000","last_active":"2023-10-08T16:12:06.471011+0000","last_peered":"2023-10-08T16:12:06.471011+0000","last_clean":"2023-10-08T16:12:06.471011+0000","last_became_active":"2023-10-08T16:12:05.464842+0000","last_became_peered":"2023-10-08T16:12:05.464842+0000","last_unstale":"2023-10-08T16:12:06.471011+0000","last_undegraded":"2023-10-08T16:12:06.471011+0000","last_fullsized":"2023-10-08T16:12:06.471011+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:04.400519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482633+0000","last_change":"2023-10-08T16:12:06.482300+0000","last_active":"2023-10-08T16:12:06.482633+0000","last_peered":"2023-10-08T16:12:06.482633+0000","last_clean":"2023-10-08T16:12:06.482633+0000","last_became_active":"2023-10-08T16:12:06.481918+0000","last_became_peered":"2023-10-08T16:12:06.481918+0000","last_unstale":"2023-10-08T16:12:06.482633+0000","last_undegraded":"2023-10-08T16:12:06.482633+0000","last_fullsized":"2023-10-08T16:12:06.482633+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:08:59.169171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"147'2","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.494556+0000","last_change":"2023-10-08T16:12:05.463965+0000","last_active":"2023-10-08T16:12:06.494556+0000","last_peered":"2023-10-08T16:12:06.494556+0000","last_clean":"2023-10-08T16:12:06.494556+0000","last_became_active":"2023-10-08T16:12:05.463740+0000","last_became_peered":"2023-10-08T16:12:05.463740+0000","last_unstale":"2023-10-08T16:12:06.494556+0000","last_undegraded":"2023-10-08T16:12:06.494556+0000","last_fullsized":"2023-10-08T16:12:06.494556+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:30.255570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.485011+0000","last_change":"2023-10-08T16:12:06.484880+0000","last_active":"2023-10-08T16:12:06.485011+0000","last_peered":"2023-10-08T16:12:06.485011+0000","last_clean":"2023-10-08T16:12:06.485011+0000","last_became_active":"2023-10-08T16:12:06.484659+0000","last_became_peered":"2023-10-08T16:12:06.484659+0000","last_unstale":"2023-10-08T16:12:06.485011+0000","last_undegraded":"2023-10-08T16:12:06.485011+0000","last_fullsized":"2023-10-08T16:12:06.485011+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:20.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.475228+0000","last_change":"2023-10-08T16:12:05.469473+0000","last_active":"2023-10-08T16:12:06.475228+0000","last_peered":"2023-10-08T16:12:06.475228+0000","last_clean":"2023-10-08T16:12:06.475228+0000","last_became_active":"2023-10-08T16:12:05.469215+0000","last_became_peered":"2023-10-08T16:12:05.469215+0000","last_unstale":"2023-10-08T16:12:06.475228+0000","last_undegraded":"2023-10-08T16:12:06.475228+0000","last_fullsized":"2023-10-08T16:12:06.475228+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:23.653871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.471676+0000","last_change":"2023-10-08T16:12:06.471629+0000","last_active":"2023-10-08T16:12:06.471676+0000","last_peered":"2023-10-08T16:12:06.471676+0000","last_clean":"2023-10-08T16:12:06.471676+0000","last_became_active":"2023-10-08T16:12:06.471434+0000","last_became_peered":"2023-10-08T16:12:06.471434+0000","last_unstale":"2023-10-08T16:12:06.471676+0000","last_undegraded":"2023-10-08T16:12:06.471676+0000","last_fullsized":"2023-10-08T16:12:06.471676+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:33.095042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.475516+0000","last_change":"2023-10-08T16:12:05.460953+0000","last_active":"2023-10-08T16:12:06.475516+0000","last_peered":"2023-10-08T16:12:06.475516+0000","last_clean":"2023-10-08T16:12:06.475516+0000","last_became_active":"2023-10-08T16:12:05.460662+0000","last_became_peered":"2023-10-08T16:12:05.460662+0000","last_unstale":"2023-10-08T16:12:06.475516+0000","last_undegraded":"2023-10-08T16:12:06.475516+0000","last_fullsized":"2023-10-08T16:12:06.475516+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:23:51.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.480238+0000","last_change":"2023-10-08T16:12:06.479310+0000","last_active":"2023-10-08T16:12:06.480238+0000","last_peered":"2023-10-08T16:12:06.480238+0000","last_clean":"2023-10-08T16:12:06.480238+0000","last_became_active":"2023-10-08T16:12:06.479029+0000","last_became_peered":"2023-10-08T16:12:06.479029+0000","last_unstale":"2023-10-08T16:12:06.480238+0000","last_undegraded":"2023-10-08T16:12:06.480238+0000","last_fullsized":"2023-10-08T16:12:06.480238+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:35.873166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.470864+0000","last_change":"2023-10-08T16:12:05.468972+0000","last_active":"2023-10-08T16:12:06.470864+0000","last_peered":"2023-10-08T16:12:06.470864+0000","last_clean":"2023-10-08T16:12:06.470864+0000","last_became_active":"2023-10-08T16:12:05.468736+0000","last_became_peered":"2023-10-08T16:12:05.468736+0000","last_unstale":"2023-10-08T16:12:06.470864+0000","last_undegraded":"2023-10-08T16:12:06.470864+0000","last_fullsized":"2023-10-08T16:12:06.470864+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:34.217176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.483378+0000","last_change":"2023-10-08T16:12:06.483283+0000","last_active":"2023-10-08T16:12:06.483378+0000","last_peered":"2023-10-08T16:12:06.483378+0000","last_clean":"2023-10-08T16:12:06.483378+0000","last_became_active":"2023-10-08T16:12:06.483093+0000","last_became_peered":"2023-10-08T16:12:06.483093+0000","last_unstale":"2023-10-08T16:12:06.483378+0000","last_undegraded":"2023-10-08T16:12:06.483378+0000","last_fullsized":"2023-10-08T16:12:06.483378+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:56.201542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"147'2","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.495473+0000","last_change":"2023-10-08T16:12:05.461530+0000","last_active":"2023-10-08T16:12:06.495473+0000","last_peered":"2023-10-08T16:12:06.495473+0000","last_clean":"2023-10-08T16:12:06.495473+0000","last_became_active":"2023-10-08T16:12:05.461275+0000","last_became_peered":"2023-10-08T16:12:05.461275+0000","last_unstale":"2023-10-08T16:12:06.495473+0000","last_undegraded":"2023-10-08T16:12:06.495473+0000","last_fullsized":"2023-10-08T16:12:06.495473+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:35.446768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.479852+0000","last_change":"2023-10-08T16:12:06.479684+0000","last_active":"2023-10-08T16:12:06.479852+0000","last_peered":"2023-10-08T16:12:06.479852+0000","last_clean":"2023-10-08T16:12:06.479852+0000","last_became_active":"2023-10-08T16:12:06.478814+0000","last_became_peered":"2023-10-08T16:12:06.478814+0000","last_unstale":"2023-10-08T16:12:06.479852+0000","last_undegraded":"2023-10-08T16:12:06.479852+0000","last_fullsized":"2023-10-08T16:12:06.479852+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:24.018606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"148'1","reported_seq":11,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-08T16:12:07.693673+0000","last_change":"2023-10-08T16:12:05.465346+0000","last_active":"2023-10-08T16:12:07.693673+0000","last_peered":"2023-10-08T16:12:07.693673+0000","last_clean":"2023-10-08T16:12:07.693673+0000","last_became_active":"2023-10-08T16:12:05.465079+0000","last_became_peered":"2023-10-08T16:12:05.465079+0000","last_unstale":"2023-10-08T16:12:07.693673+0000","last_undegraded":"2023-10-08T16:12:07.693673+0000","last_fullsized":"2023-10-08T16:12:07.693673+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.479678+0000","last_change":"2023-10-08T16:12:06.479624+0000","last_active":"2023-10-08T16:12:06.479678+0000","last_peered":"2023-10-08T16:12:06.479678+0000","last_clean":"2023-10-08T16:12:06.479678+0000","last_became_active":"2023-10-08T16:12:06.478920+0000","last_became_peered":"2023-10-08T16:12:06.478920+0000","last_unstale":"2023-10-08T16:12:06.479678+0000","last_undegraded":"2023-10-08T16:12:06.479678+0000","last_fullsized":"2023-10-08T16:12:06.479678+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:03.923141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.469883+0000","last_change":"2023-10-08T16:12:05.468565+0000","last_active":"2023-10-08T16:12:06.469883+0000","last_peered":"2023-10-08T16:12:06.469883+0000","last_clean":"2023-10-08T16:12:06.469883+0000","last_became_active":"2023-10-08T16:12:05.468341+0000","last_became_peered":"2023-10-08T16:12:05.468341+0000","last_unstale":"2023-10-08T16:12:06.469883+0000","last_undegraded":"2023-10-08T16:12:06.469883+0000","last_fullsized":"2023-10-08T16:12:06.469883+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:28.445752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.481874+0000","last_change":"2023-10-08T16:12:06.481545+0000","last_active":"2023-10-08T16:12:06.481874+0000","last_peered":"2023-10-08T16:12:06.481874+0000","last_clean":"2023-10-08T16:12:06.481874+0000","last_became_active":"2023-10-08T16:12:06.481327+0000","last_became_peered":"2023-10-08T16:12:06.481327+0000","last_unstale":"2023-10-08T16:12:06.481874+0000","last_undegraded":"2023-10-08T16:12:06.481874+0000","last_fullsized":"2023-10-08T16:12:06.481874+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:30.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.471134+0000","last_change":"2023-10-08T16:12:05.463964+0000","last_active":"2023-10-08T16:12:06.471134+0000","last_peered":"2023-10-08T16:12:06.471134+0000","last_clean":"2023-10-08T16:12:06.471134+0000","last_became_active":"2023-10-08T16:12:05.463742+0000","last_became_peered":"2023-10-08T16:12:05.463742+0000","last_unstale":"2023-10-08T16:12:06.471134+0000","last_undegraded":"2023-10-08T16:12:06.471134+0000","last_fullsized":"2023-10-08T16:12:06.471134+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:46.071582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482853+0000","last_change":"2023-10-08T16:12:06.482624+0000","last_active":"2023-10-08T16:12:06.482853+0000","last_peered":"2023-10-08T16:12:06.482853+0000","last_clean":"2023-10-08T16:12:06.482853+0000","last_became_active":"2023-10-08T16:12:06.482401+0000","last_became_peered":"2023-10-08T16:12:06.482401+0000","last_unstale":"2023-10-08T16:12:06.482853+0000","last_undegraded":"2023-10-08T16:12:06.482853+0000","last_fullsized":"2023-10-08T16:12:06.482853+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:20.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.469827+0000","last_change":"2023-10-08T16:12:05.459931+0000","last_active":"2023-10-08T16:12:06.469827+0000","last_peered":"2023-10-08T16:12:06.469827+0000","last_clean":"2023-10-08T16:12:06.469827+0000","last_became_active":"2023-10-08T16:12:05.459689+0000","last_became_peered":"2023-10-08T16:12:05.459689+0000","last_unstale":"2023-10-08T16:12:06.469827+0000","last_undegraded":"2023-10-08T16:12:06.469827+0000","last_fullsized":"2023-10-08T16:12:06.469827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:40.793975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478505+0000","last_change":"2023-10-08T16:12:06.475537+0000","last_active":"2023-10-08T16:12:06.478505+0000","last_peered":"2023-10-08T16:12:06.478505+0000","last_clean":"2023-10-08T16:12:06.478505+0000","last_became_active":"2023-10-08T16:12:06.475330+0000","last_became_peered":"2023-10-08T16:12:06.475330+0000","last_unstale":"2023-10-08T16:12:06.478505+0000","last_undegraded":"2023-10-08T16:12:06.478505+0000","last_fullsized":"2023-10-08T16:12:06.478505+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:41.798639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.476074+0000","last_change":"2023-10-08T16:12:05.465951+0000","last_active":"2023-10-08T16:12:06.476074+0000","last_peered":"2023-10-08T16:12:06.476074+0000","last_clean":"2023-10-08T16:12:06.476074+0000","last_became_active":"2023-10-08T16:12:05.465515+0000","last_became_peered":"2023-10-08T16:12:05.465515+0000","last_unstale":"2023-10-08T16:12:06.476074+0000","last_undegraded":"2023-10-08T16:12:06.476074+0000","last_fullsized":"2023-10-08T16:12:06.476074+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:05:44.861501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.478311+0000","last_change":"2023-10-08T16:12:06.478212+0000","last_active":"2023-10-08T16:12:06.478311+0000","last_peered":"2023-10-08T16:12:06.478311+0000","last_clean":"2023-10-08T16:12:06.478311+0000","last_became_active":"2023-10-08T16:12:06.477940+0000","last_became_peered":"2023-10-08T16:12:06.477940+0000","last_unstale":"2023-10-08T16:12:06.478311+0000","last_undegraded":"2023-10-08T16:12:06.478311+0000","last_fullsized":"2023-10-08T16:12:06.478311+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:18.743738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.474191+0000","last_change":"2023-10-08T16:12:05.469234+0000","last_active":"2023-10-08T16:12:06.474191+0000","last_peered":"2023-10-08T16:12:06.474191+0000","last_clean":"2023-10-08T16:12:06.474191+0000","last_became_active":"2023-10-08T16:12:05.468862+0000","last_became_peered":"2023-10-08T16:12:05.468862+0000","last_unstale":"2023-10-08T16:12:06.474191+0000","last_undegraded":"2023-10-08T16:12:06.474191+0000","last_fullsized":"2023-10-08T16:12:06.474191+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:02.918477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.476430+0000","last_change":"2023-10-08T16:12:06.476319+0000","last_active":"2023-10-08T16:12:06.476430+0000","last_peered":"2023-10-08T16:12:06.476430+0000","last_clean":"2023-10-08T16:12:06.476430+0000","last_became_active":"2023-10-08T16:12:06.476076+0000","last_became_peered":"2023-10-08T16:12:06.476076+0000","last_unstale":"2023-10-08T16:12:06.476430+0000","last_undegraded":"2023-10-08T16:12:06.476430+0000","last_fullsized":"2023-10-08T16:12:06.476430+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:24.658535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.470933+0000","last_change":"2023-10-08T16:12:05.466176+0000","last_active":"2023-10-08T16:12:06.470933+0000","last_peered":"2023-10-08T16:12:06.470933+0000","last_clean":"2023-10-08T16:12:06.470933+0000","last_became_active":"2023-10-08T16:12:05.465922+0000","last_became_peered":"2023-10-08T16:12:05.465922+0000","last_unstale":"2023-10-08T16:12:06.470933+0000","last_undegraded":"2023-10-08T16:12:06.470933+0000","last_fullsized":"2023-10-08T16:12:06.470933+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:15.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.482116+0000","last_change":"2023-10-08T16:12:06.481890+0000","last_active":"2023-10-08T16:12:06.482116+0000","last_peered":"2023-10-08T16:12:06.482116+0000","last_clean":"2023-10-08T16:12:06.482116+0000","last_became_active":"2023-10-08T16:12:06.481467+0000","last_became_peered":"2023-10-08T16:12:06.481467+0000","last_unstale":"2023-10-08T16:12:06.482116+0000","last_undegraded":"2023-10-08T16:12:06.482116+0000","last_fullsized":"2023-10-08T16:12:06.482116+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:05.449521+0000","last_clean_scrub_stamp":"2023-10-08T16:12:05.449521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:05.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"147'2","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.491810+0000","last_change":"2023-10-08T16:12:05.464262+0000","last_active":"2023-10-08T16:12:06.491810+0000","last_peered":"2023-10-08T16:12:06.491810+0000","last_clean":"2023-10-08T16:12:06.491810+0000","last_became_active":"2023-10-08T16:12:05.463994+0000","last_became_peered":"2023-10-08T16:12:05.463994+0000","last_unstale":"2023-10-08T16:12:06.491810+0000","last_undegraded":"2023-10-08T16:12:06.491810+0000","last_fullsized":"2023-10-08T16:12:06.491810+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:12:04.444857+0000","last_clean_scrub_stamp":"2023-10-08T16:12:04.444857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:20.925992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":280,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-08T16:12:06.473966+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:12:06.473966+0000","last_peered":"2023-10-08T16:12:06.473966+0000","last_clean":"2023-10-08T16:12:06.473966+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:12:06.473966+0000","last_undegraded":"2023-10-08T16:12:06.473966+0000","last_fullsized":"2023-10-08T16:12:06.473966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1381,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193931,"statfs":{"total":200000000,"available":198585653,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.83499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40100000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.72599999999999998,"15min":0.83099999999999996},"last":0.443},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.35899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64400000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84999999999999998,"5min":1.756,"15min":1.756},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57499999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.82899999999999996,"5min":1.79,"15min":1.79},"last":0.42399999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.81000000000000005,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83299999999999996,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.498}]},{"osd":5,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":0.61899999999999999,"15min":0.52300000000000002},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":11.891,"5min":11.891,"15min":11.891},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.153,"5min":0.66400000000000003,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.33200000000000002},"max":{"1min":11.907999999999999,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75600000000000001,"5min":1.252,"15min":1.252},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":804,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199176631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":1.135,"15min":1.135},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":0.67000000000000004,"5min":1.169,"15min":1.169},"last":0.66900000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.68100000000000005,"5min":3.738,"15min":3.738},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.74199999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.66200000000000003,"5min":1.103,"15min":1.103},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.56000000000000005},"min":{"1min":0.52100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.51700000000000002},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.29799999999999999},"max":{"1min":0.752,"5min":3.516,"15min":3.516},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71699999999999997,"5min":1.502,"15min":1.502},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.436},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.66600000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.313,"15min":0.313},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.379}]},{"osd":5,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71199999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67100000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.40200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48599999999999999},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.71299999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.437},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73699999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178167,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35899999999999999,"15min":0.45600000000000002},"min":{"1min":0.185,"5min":0.182,"15min":0.182},"max":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":3.593},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42399999999999999,"15min":0.44700000000000001},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":0.61599999999999999,"5min":0.68100000000000005,"15min":0.76000000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36799999999999999,"15min":0.44900000000000001},"min":{"1min":0.25,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.622,"15min":3.6259999999999999},"last":0.371},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59099999999999997,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41399999999999998,"15min":0.437},"min":{"1min":0.309,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.80400000000000005},"last":0.437},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":0.68300000000000005,"15min":1.1100000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.69199999999999995},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.82499999999999996,"5min":1.0620000000000001,"15min":3.5630000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.626},"min":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":0.80700000000000005,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61299999999999999,"15min":0.70599999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93000000000000005,"5min":0.94099999999999995,"15min":3.532},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":0.90700000000000003,"15min":1.6699999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63500000000000001,"15min":0.71399999999999997},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.88500000000000001,"5min":1.012,"15min":3.4929999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.629},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77600000000000002,"5min":1.0740000000000001,"15min":1.095},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.93899999999999995,"5min":1.0289999999999999,"15min":1.6279999999999999},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1379,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193933,"statfs":{"total":200000000,"available":198587799,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.373},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42499999999999999,"5min":1.571,"15min":1.571},"last":0.316},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.46999999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.50900000000000001,"5min":3.044,"15min":3.044},"last":0.32700000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41499999999999998,"15min":0.38400000000000001},"min":{"1min":0.28199999999999997,"5min":0.24399999999999999,"15min":0.20899999999999999},"max":{"1min":0.54500000000000004,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.249},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.30099999999999999,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.59199999999999997,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36799999999999999,"15min":0.375},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.496,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.47399999999999998,"15min":0.436},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.28999999999999998},"max":{"1min":0.63800000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.70299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":1.401,"15min":1.401},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74299999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80500000000000005,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64000000000000001,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.42199999999999999,"15min":0.41499999999999998},"max":{"1min":0.76200000000000001,"5min":3.665,"15min":3.665},"last":0.47299999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63500000000000001,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84999999999999998,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82799999999999996,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.48299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177579,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.185},"max":{"1min":0.40000000000000002,"5min":0.56899999999999995,"15min":0.65500000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.23899999999999999},"max":{"1min":0.51000000000000001,"5min":0.63600000000000001,"15min":2.7109999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35799999999999998,"15min":0.34899999999999998},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.55400000000000005,"5min":0.67100000000000004,"15min":0.746},"last":0.318},{"interface":"front","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.52200000000000002,"5min":0.68899999999999995,"15min":0.70299999999999996},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26000000000000001},"max":{"1min":0.53600000000000003,"5min":0.74099999999999999,"15min":1.3260000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.46100000000000002,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.54800000000000004,"5min":0.74299999999999999,"15min":1.2549999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77300000000000002,"5min":0.93500000000000005,"15min":2.8980000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80700000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61799999999999999,"15min":0.59699999999999998},"min":{"1min":0.45400000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.99299999999999999,"15min":2.9319999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63300000000000001,"15min":0.60299999999999998},"min":{"1min":0.48799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":1.091,"15min":1.091},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 16:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.38600000000000001},"max":{"1min":0.81799999999999995,"5min":1.042,"15min":3.0030000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.65600000000000003,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.78600000000000003,"5min":1.073,"15min":1.073},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.318},"min":{"1min":0.20999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.372},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.371,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40400000000000003,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.67800000000000005},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.36799999999999999},"min":{"1min":0.25800000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.54800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41699999999999998,"15min":0.39500000000000002},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.628},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60499999999999998,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.41799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84699999999999998,"5min":0.999,"15min":0.999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.495,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83999999999999997,"5min":1.026,"15min":1.026},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84899999999999998,"5min":0.85399999999999998,"15min":0.94399999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.47599999999999998,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.83199999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178097,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.28899999999999998},"max":{"1min":0.73299999999999998,"5min":0.82999999999999996,"15min":1.141},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":1.149},"last":0.64100000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.55800000000000005},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.89700000000000002,"15min":7.4749999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":3.8730000000000002},"last":0.40200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.60299999999999998},"min":{"1min":0.439,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.71099999999999997,"5min":0.875,"15min":14.6},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":7.556},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.39200000000000002,"15min":0.36599999999999999},"max":{"1min":0.76500000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.378,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68000000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.47099999999999997},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.623,"5min":0.754,"15min":0.754},"last":0.56899999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.73999999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.49399999999999999},"min":{"1min":0.35499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.38300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81299999999999994,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41799999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63900000000000001,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.31},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":0.81200000000000006},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76700000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.41399999999999998},"max":{"1min":0.77700000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.755,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.373,"15min":0.315},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.28999999999999998,"15min":0.25600000000000001},"max":{"1min":0.64900000000000002,"5min":0.77000000000000002,"15min":0.80600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.73999999999999999,"15min":0.77700000000000002},"last":0.32900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.502,"15min":0.49099999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.73999999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.439},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.71199999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.376}]}]}],"pool_statfs":[]}} 2023-10-08T16:12:12.918 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:12:12.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:12:13.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.047+0000 7f5ee8ae7700 1 Processor -- start 2023-10-08T16:12:13.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.048+0000 7f5ee8ae7700 1 -- start start 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.048+0000 7f5ee8ae7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5ee40b3570 0x7f5ee415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.048+0000 7f5ee8ae7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5ee40b4c30 0x7f5ee40b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.048+0000 7f5ee8ae7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee40b14f0 con 0x7f5ee40b4860 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.048+0000 7f5ee8ae7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40b17d0 con 0x7f5ee40b3570 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.048+0000 7f5ee8ae7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40b1ab0 con 0x7f5ee40b4c30 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee1d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5ee40b3570 0x7f5ee415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee259c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5ee40b4860 0x7f5ee4159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53240/0 (socket says 172.21.15.60:53240) 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee259c700 1 -- 172.21.15.60:0/1663499258 learned_addr learned my addr 172.21.15.60:0/1663499258 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee2d9d700 1 --2- 172.21.15.60:0/1663499258 >> v2:172.21.15.144:3300/0 conn(0x7f5ee40b4c30 0x7f5ee40b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/1663499258 >> v2:172.21.15.144:3300/0 conn(0x7f5ee40b4c30 msgr2=0x7f5ee40b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee1d9b700 1 --2- 172.21.15.60:0/1663499258 >> v2:172.21.15.144:3300/0 conn(0x7f5ee40b4c30 0x7f5ee40b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/1663499258 >> v1:172.21.15.60:6789/0 conn(0x7f5ee40b4860 legacy=0x7f5ee4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/1663499258 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee40b1d90 con 0x7f5ee40b3570 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee159a700 1 -- 172.21.15.60:0/1663499258 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56364724 0 0) 0x7f5ee40b14f0 con 0x7f5ee40b4860 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee1d9b700 1 --2- 172.21.15.60:0/1663499258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b3570 0x7f5ee415a1a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5ee408a070 tx=0x7f5ecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5203c6d3a3d70e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee159a700 1 -- 172.21.15.60:0/1663499258 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00b690 con 0x7f5ee40b3570 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee159a700 1 -- 172.21.15.60:0/1663499258 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00b7f0 con 0x7f5ee40b3570 2023-10-08T16:12:13.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.049+0000 7f5ee159a700 1 -- 172.21.15.60:0/1663499258 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00bb90 con 0x7f5ee40b3570 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/1663499258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b3570 msgr2=0x7f5ee415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/1663499258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b3570 0x7f5ee415a1a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5ee408a070 tx=0x7f5ecc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/1663499258 shutdown_connections 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/1663499258 >> v2:172.21.15.144:3300/0 conn(0x7f5ee40b4c30 0x7f5ee40b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/1663499258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b3570 0x7f5ee415a1a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/1663499258 >> 172.21.15.60:0/1663499258 conn(0x7f5ee409a0f0 msgr2=0x7f5ee4067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/1663499258 shutdown_connections 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.050+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/1663499258 wait complete. 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.051+0000 7f5ee8ae7700 1 Processor -- start 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.051+0000 7f5ee8ae7700 1 -- start start 2023-10-08T16:12:13.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee8ae7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee40b3570 0x7f5ee41565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee8ae7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 0x7f5ee415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee8ae7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5ee40b4c30 0x7f5ee415f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee8ae7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee409d070 con 0x7f5ee40b4860 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee8ae7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40ae720 con 0x7f5ee40b3570 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee8ae7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40aea00 con 0x7f5ee40b4c30 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 0x7f5ee415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 0x7f5ee415f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53836/0 (socket says 172.21.15.60:53836) 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/3222578734 learned_addr learned my addr 172.21.15.60:0/3222578734 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee259c700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee40b3570 0x7f5ee41565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee2d9d700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5ee40b4c30 0x7f5ee415f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5ee40b4c30 msgr2=0x7f5ee415f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5ee40b4c30 0x7f5ee415f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee40b3570 msgr2=0x7f5ee41565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee40b3570 0x7f5ee41565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 -- 172.21.15.60:0/3222578734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc009420 con 0x7f5ee40b4860 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.052+0000 7f5ee1d9b700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 0x7f5ee415f0c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4068cd0 tx=0x7f5ecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.053+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc000d10 con 0x7f5ee40b4860 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.053+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00b960 con 0x7f5ee40b4860 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.053+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee40aece0 con 0x7f5ee40b4860 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.053+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc025420 con 0x7f5ee40b4860 2023-10-08T16:12:13.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.053+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee4156b10 con 0x7f5ee40b4860 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.053+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee409ced0 con 0x7f5ee40b4860 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.054+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ecc023070 con 0x7f5ee40b4860 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.054+0000 7f5eda7fc700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5ec4066f30 0x7f5ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.054+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ecc085a10 con 0x7f5ee40b4860 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.054+0000 7f5ee259c700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5ec4066f30 0x7f5ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.055+0000 7f5ee259c700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5ec4066f30 0x7f5ec40693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5edc001360 tx=0x7f5edc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:13.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.059+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee409ced0 con 0x7f5ee40b4860 2023-10-08T16:12:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.333+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5ee409d270 con 0x7f5ee40b4860 2023-10-08T16:12:13.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.337+0000 7f5eda7fc700 1 -- 172.21.15.60:0/3222578734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5ee409d270 con 0x7f5ee40b4860 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5ec4066f30 msgr2=0x7f5ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5ec4066f30 0x7f5ec40693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5edc001360 tx=0x7f5edc009040 comp rx=0 tx=0).stop 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 msgr2=0x7f5ee415f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 0x7f5ee415f0c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4068cd0 tx=0x7f5ecc017000 comp rx=0 tx=0).stop 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 shutdown_connections 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5ec4066f30 0x7f5ec40693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5ee40b4c30 0x7f5ee415f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee40b3570 0x7f5ee41565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 --2- 172.21.15.60:0/3222578734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee40b4860 0x7f5ee415f0c0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 >> 172.21.15.60:0/3222578734 conn(0x7f5ee409a0f0 msgr2=0x7f5ee415b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:13.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 shutdown_connections 2023-10-08T16:12:13.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.339+0000 7f5ee8ae7700 1 -- 172.21.15.60:0/3222578734 wait complete. 2023-10-08T16:12:13.364 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:12:13.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:12:13.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.484+0000 7f022cbda700 1 Processor -- start 2023-10-08T16:12:13.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.484+0000 7f022cbda700 1 -- start start 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022cbda700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 0x7f02280b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022cbda700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02280cde50 0x7f02280b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022cbda700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022815db80 con 0x7f022815a1e0 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022cbda700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022815e800 con 0x7f02280cde50 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022cbda700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022815de60 con 0x7f0228159e10 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 0x7f02280b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f0226d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02280cde50 0x7f02280b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f0225d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f022815a1e0 0x7f02280cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:54702/0 (socket says 172.21.15.60:54702) 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 0x7f02280b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:37926/0 (socket says 172.21.15.60:37926) 2023-10-08T16:12:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f0225d9b700 1 -- 172.21.15.60:0/3538677800 learned_addr learned my addr 172.21.15.60:0/3538677800 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 -- 172.21.15.60:0/3538677800 >> v2:172.21.15.144:3300/0 conn(0x7f02280cde50 msgr2=0x7f02280b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 --2- 172.21.15.60:0/3538677800 >> v2:172.21.15.144:3300/0 conn(0x7f02280cde50 0x7f02280b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 -- 172.21.15.60:0/3538677800 >> v1:172.21.15.144:6789/0 conn(0x7f022815a1e0 legacy=0x7f02280cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 -- 172.21.15.60:0/3538677800 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022815e140 con 0x7f0228159e10 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f0226d9d700 1 --2- 172.21.15.60:0/3538677800 >> v2:172.21.15.144:3300/0 conn(0x7f02280cde50 0x7f02280b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.485+0000 7f022659c700 1 --2- 172.21.15.60:0/3538677800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 0x7f02280b2d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02180098e0 tx=0x7f02180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed390dc2c4b23b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022559a700 1 -- 172.21.15.60:0/3538677800 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800b640 con 0x7f0228159e10 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022559a700 1 -- 172.21.15.60:0/3538677800 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800b7a0 con 0x7f0228159e10 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022559a700 1 -- 172.21.15.60:0/3538677800 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800bb40 con 0x7f0228159e10 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 -- 172.21.15.60:0/3538677800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 msgr2=0x7f02280b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 --2- 172.21.15.60:0/3538677800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 0x7f02280b2d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02180098e0 tx=0x7f02180091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 -- 172.21.15.60:0/3538677800 shutdown_connections 2023-10-08T16:12:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 --2- 172.21.15.60:0/3538677800 >> v2:172.21.15.144:3300/0 conn(0x7f02280cde50 0x7f02280b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 --2- 172.21.15.60:0/3538677800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0228159e10 0x7f02280b2d20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 -- 172.21.15.60:0/3538677800 >> 172.21.15.60:0/3538677800 conn(0x7f0228067660 msgr2=0x7f0228067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 -- 172.21.15.60:0/3538677800 shutdown_connections 2023-10-08T16:12:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.486+0000 7f022cbda700 1 -- 172.21.15.60:0/3538677800 wait complete. 2023-10-08T16:12:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.487+0000 7f022cbda700 1 Processor -- start 2023-10-08T16:12:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.487+0000 7f022cbda700 1 -- start start 2023-10-08T16:12:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022cbda700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02280cde50 0x7f0228158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022cbda700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0228159e10 0x7f022816b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022cbda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 0x7f02280c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022cbda700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022816bf10 con 0x7f022815a1e0 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022cbda700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022815cdd0 con 0x7f0228159e10 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022cbda700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02280c4760 con 0x7f02280cde50 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f0226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 0x7f02280c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f0226d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 0x7f02280c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53852/0 (socket says 172.21.15.60:53852) 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f0226d9d700 1 -- 172.21.15.60:0/2509482335 learned_addr learned my addr 172.21.15.60:0/2509482335 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f022659c700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02280cde50 0x7f0228158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.488+0000 7f0225d9b700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0228159e10 0x7f022816b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f0226d9d700 1 -- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02280cde50 msgr2=0x7f0228158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f0226d9d700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02280cde50 0x7f0228158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f0226d9d700 1 -- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0228159e10 msgr2=0x7f022816b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f0226d9d700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0228159e10 0x7f022816b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f0226d9d700 1 -- 172.21.15.60:0/2509482335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220009a20 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f0226d9d700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 0x7f02280c6ca0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0220009f60 tx=0x7f022000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000ccd0 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022000f040 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0218009420 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200146d0 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.489+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02280c4d20 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.490+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022804c3c0 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.490+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0220014a40 con 0x7f022815a1e0 2023-10-08T16:12:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.491+0000 7f021e7fc700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.491+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0220085340 con 0x7f022815a1e0 2023-10-08T16:12:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.491+0000 7f022659c700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.491+0000 7f022659c700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0208066f30 0x7f02080693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f02180093f0 tx=0x7f0218017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.495+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02200525b0 con 0x7f022815a1e0 2023-10-08T16:12:13.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.735+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f022815e420 con 0x7f022815a1e0 2023-10-08T16:12:13.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.735+0000 7f021e7fc700 1 -- 172.21.15.60:0/2509482335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0220055bd0 con 0x7f022815a1e0 2023-10-08T16:12:13.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:13.736 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:12:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.737+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0208066f30 msgr2=0x7f02080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.737+0000 7f022cbda700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0208066f30 0x7f02080693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f02180093f0 tx=0x7f0218017000 comp rx=0 tx=0).stop 2023-10-08T16:12:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 msgr2=0x7f02280c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 0x7f02280c6ca0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0220009f60 tx=0x7f022000b040 comp rx=0 tx=0).stop 2023-10-08T16:12:13.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 shutdown_connections 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02280cde50 0x7f0228158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022815a1e0 0x7f02280c6ca0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 --2- 172.21.15.60:0/2509482335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0228159e10 0x7f022816b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 >> 172.21.15.60:0/2509482335 conn(0x7f0228067660 msgr2=0x7f02280cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 shutdown_connections 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:13.738+0000 7f022cbda700 1 -- 172.21.15.60:0/2509482335 wait complete. 2023-10-08T16:12:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:12:14.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:12:05.858523+0000', 'modified': '2023-10-08T16:12:09.494819+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7509}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7509': {'gid': 7509, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6837/2817981705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6835', 'nonce': 2817981705}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2817981705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:12:14.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:12:14.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:12:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.276+0000 7f798b1e5700 1 Processor -- start 2023-10-08T16:12:14.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.276+0000 7f798b1e5700 1 -- start start 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f798b1e5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7984159e10 0x7f79840b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f798b1e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f79840cde50 0x7f79840b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f798b1e5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798415db80 con 0x7f798415a1e0 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f798b1e5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798415e800 con 0x7f7984159e10 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f798b1e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798415de60 con 0x7f79840cde50 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f7988f81700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7984159e10 0x7f79840b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f7988f81700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7984159e10 0x7f79840b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53868/0 (socket says 172.21.15.60:53868) 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.277+0000 7f7988f81700 1 -- 172.21.15.60:0/4240548970 learned_addr learned my addr 172.21.15.60:0/4240548970 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f7989782700 1 --2- 172.21.15.60:0/4240548970 >> v2:172.21.15.144:3300/0 conn(0x7f79840cde50 0x7f79840b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f7988f81700 1 -- 172.21.15.60:0/4240548970 >> v2:172.21.15.144:3300/0 conn(0x7f79840cde50 msgr2=0x7f79840b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f7988f81700 1 --2- 172.21.15.60:0/4240548970 >> v2:172.21.15.144:3300/0 conn(0x7f79840cde50 0x7f79840b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f7988f81700 1 -- 172.21.15.60:0/4240548970 >> v1:172.21.15.144:6789/0 conn(0x7f798415a1e0 legacy=0x7f79840cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f7988f81700 1 -- 172.21.15.60:0/4240548970 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798415e140 con 0x7f7984159e10 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f7988f81700 1 --2- 172.21.15.60:0/4240548970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7984159e10 0x7f79840b2d20 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f79840685b0 tx=0x7f797c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4d94fc95ad0678 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f79837fe700 1 -- 172.21.15.60:0/4240548970 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c00b860 con 0x7f7984159e10 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f79837fe700 1 -- 172.21.15.60:0/4240548970 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c00b9c0 con 0x7f7984159e10 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.278+0000 7f79837fe700 1 -- 172.21.15.60:0/4240548970 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c00bd60 con 0x7f7984159e10 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 -- 172.21.15.60:0/4240548970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7984159e10 msgr2=0x7f79840b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 --2- 172.21.15.60:0/4240548970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7984159e10 0x7f79840b2d20 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f79840685b0 tx=0x7f797c009250 comp rx=0 tx=0).stop 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 -- 172.21.15.60:0/4240548970 shutdown_connections 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 --2- 172.21.15.60:0/4240548970 >> v2:172.21.15.144:3300/0 conn(0x7f79840cde50 0x7f79840b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 --2- 172.21.15.60:0/4240548970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7984159e10 0x7f79840b2d20 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 -- 172.21.15.60:0/4240548970 >> 172.21.15.60:0/4240548970 conn(0x7f7984067660 msgr2=0x7f7984067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 -- 172.21.15.60:0/4240548970 shutdown_connections 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.279+0000 7f798b1e5700 1 -- 172.21.15.60:0/4240548970 wait complete. 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.280+0000 7f798b1e5700 1 Processor -- start 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.280+0000 7f798b1e5700 1 -- start start 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 0x7f79840c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7984159e10 0x7f7984169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f798415a1e0 0x7f798414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840c6770 con 0x7f79840cde50 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798416d9e0 con 0x7f7984159e10 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798416dcc0 con 0x7f798415a1e0 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 0x7f79840c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 0x7f79840c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53874/0 (socket says 172.21.15.60:53874) 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 -- 172.21.15.60:0/3684703375 learned_addr learned my addr 172.21.15.60:0/3684703375 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7983fff700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7984159e10 0x7f7984169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7989782700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f798415a1e0 0x7f798414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 -- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f798415a1e0 msgr2=0x7f798414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f798415a1e0 0x7f798414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 -- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7984159e10 msgr2=0x7f7984169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7984159e10 0x7f7984169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 -- 172.21.15.60:0/3684703375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0094f0 con 0x7f79840cde50 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7989782700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f798415a1e0 0x7f798414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7988f81700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 0x7f79840c5fc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f797c009290 tx=0x7f797c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7980ff9700 1 -- 172.21.15.60:0/3684703375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c024430 con 0x7f79840cde50 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7980ff9700 1 -- 172.21.15.60:0/3684703375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c024590 con 0x7f79840cde50 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f7980ff9700 1 -- 172.21.15.60:0/3684703375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c024950 con 0x7f79840cde50 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.281+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798416dfa0 con 0x7f79840cde50 2023-10-08T16:12:14.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.282+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840c6500 con 0x7f79840cde50 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.283+0000 7f7980ff9700 1 -- 172.21.15.60:0/3684703375 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f797c01a420 con 0x7f79840cde50 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.283+0000 7f7980ff9700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.283+0000 7f7980ff9700 1 -- 172.21.15.60:0/3684703375 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f797c086260 con 0x7f79840cde50 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.284+0000 7f7983fff700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.284+0000 7f7983fff700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7964066f30 0x7f79640693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f798415c350 tx=0x7f7974009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.285+0000 7f79944ddb80 1 Processor -- start 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.285+0000 7f79944ddb80 1 -- start start 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94cabe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cd4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94ca7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f79944ddb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94c02a70 con 0x557e94cd4f60 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94c00270 con 0x557e94caba50 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e94bfc060 con 0x557e94cf5d00 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94ca7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94ca7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53888/0 (socket says 172.21.15.60:53888) 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 -- 172.21.15.60:0/29198274 learned_addr learned my addr 172.21.15.60:0/29198274 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7988f81700 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94cabe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7983fff700 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cd4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 -- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 msgr2=0x557e94cd4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cd4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 -- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 msgr2=0x557e94cabe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94cabe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.286+0000 7f7989782700 1 -- 172.21.15.60:0/29198274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e94a96270 con 0x557e94cd4f60 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f7989782700 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94ca7cf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f796c009a80 tx=0x7f796c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6833f85bb71e5014 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f7979ffb700 1 -- 172.21.15.60:0/29198274 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00e660 con 0x557e94cd4f60 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f7979ffb700 1 -- 172.21.15.60:0/29198274 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c00e7c0 con 0x557e94cd4f60 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f7979ffb700 1 -- 172.21.15.60:0/29198274 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00eb60 con 0x557e94cd4f60 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 -- 172.21.15.60:0/29198274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 msgr2=0x557e94ca7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94ca7cf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f796c009a80 tx=0x7f796c008040 comp rx=0 tx=0).stop 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 -- 172.21.15.60:0/29198274 shutdown_connections 2023-10-08T16:12:14.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94ca7cf0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94cabe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 --2- 172.21.15.60:0/29198274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cd4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 -- 172.21.15.60:0/29198274 >> 172.21.15.60:0/29198274 conn(0x557e94cad370 msgr2=0x557e94cad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 -- 172.21.15.60:0/29198274 shutdown_connections 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.287+0000 7f79944ddb80 1 -- 172.21.15.60:0/29198274 wait complete. 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.288+0000 7f79944ddb80 1 -- start start 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.288+0000 7f79944ddb80 1 Processor -- start 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94d01fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94cdae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94ba7890 con 0x557e94cd4f60 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94bc2ea0 con 0x557e94caba50 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e94a7ee30 con 0x557e94cf5d00 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f79944ddb80 10 client.0 _ll_register_callbacks cb 0x557e94c6f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94cdae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94cdae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53898/0 (socket says 172.21.15.60:53898) 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 -- 172.21.15.60:0/1406246065 learned_addr learned my addr 172.21.15.60:0/1406246065 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7989782700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7988f81700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94d01fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 -- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 msgr2=0x557e94cdb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 -- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 msgr2=0x557e94d01fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94d01fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.289+0000 7f7983fff700 1 -- 172.21.15.60:0/1406246065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0096d0 con 0x557e94cd4f60 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7983fff700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94cdae80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f7974007fd0 tx=0x7f7974013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366f206d99b82349 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7962ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7962ffd700 1 -- 172.21.15.60:0/1406246065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974003460 con 0x557e94cd4f60 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7962ffd700 1 -- 172.21.15.60:0/1406246065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7974014d80 con 0x557e94cd4f60 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e94ca0b70 con 0x557e94cd4f60 2023-10-08T16:12:14.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7962ffd700 1 -- 172.21.15.60:0/1406246065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7974021600 con 0x557e94cd4f60 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 10 client.7632 fetch_fsmap learned FSMap version 77 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x557e94a38fe0 con 0x557e94cd4f60 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7962ffd700 1 -- 172.21.15.60:0/1406246065 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557e94ca0b70 con 0x557e94cd4f60 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7962ffd700 1 -- 172.21.15.60:0/1406246065 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7974020070 con 0x557e94cd4f60 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 10 client.7632 fetch_fsmap finished waiting for FSMap version 77 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 10 client.7632 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 20 client.7632 populate_metadata read hostname 'smithi060' 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94cea350 0x557e94ceb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 4 client.7632 mds_command: new command op to 7509 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 --> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e94c7daa0 con 0x557e94cea350 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.290+0000 7f7988f81700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94cea350 0x557e94ceb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f7962ffd700 10 client.7632 ms_handle_connect on v2:172.21.15.60:6835/2817981705 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f7988f81700 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94cea350 0x557e94ceb970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d186dcb295d1ee server_cookie=28ea4a9737e581ea in_seq=0 out_seq=0 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f7962ffd700 1 -- 172.21.15.60:0/1406246065 <== mds.0 v2:172.21.15.60:6835/2817981705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557e94c7daa0 con 0x557e94cea350 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f7962ffd700 10 client.7632 handle_command_reply: tid=0 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f79944ddb80 1 client.7632 shutdown 2023-10-08T16:12:14.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 msgr2=0x557e94cdae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.291+0000 7f79944ddb80 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94cdae80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f7974007fd0 tx=0x7f7974013000 comp rx=0 tx=0).stop 2023-10-08T16:12:14.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 shutdown_connections 2023-10-08T16:12:14.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94cea350 0x557e94ceb970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94caba50 0x557e94d01fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f7962ffd700 0 client.7632 ms_handle_reset on v2:172.21.15.60:6835/2817981705 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 --2- 172.21.15.60:0/1406246065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94cd4f60 0x557e94cdae80 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 >> 172.21.15.60:0/1406246065 conn(0x557e94cad370 msgr2=0x557e94ca88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 shutdown_connections 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 1 -- 172.21.15.60:0/1406246065 wait complete. 2023-10-08T16:12:14.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.292+0000 7f79944ddb80 20 client.7632 trim_cache size 0 max 16384 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 Processor -- start 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 -- start start 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ca7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94d0b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94d0bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94ca65a0 con 0x557e94caba50 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94c84410 con 0x557e94cd4f60 2023-10-08T16:12:14.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.309+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e94caf5c0 con 0x557e94cf5d00 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ca7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ca7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53900/0 (socket says 172.21.15.60:53900) 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 -- 172.21.15.60:0/2688211513 learned_addr learned my addr 172.21.15.60:0/2688211513 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7989782700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94d0bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7983fff700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94d0b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 -- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 msgr2=0x557e94d0bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94d0bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 -- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 msgr2=0x557e94d0b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94d0b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 -- 172.21.15.60:0/2688211513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e94bca780 con 0x557e94caba50 2023-10-08T16:12:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7983fff700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94d0b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7989782700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94d0bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f7988f81700 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ca7d70 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f797c084770 tx=0x7f797c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d24bae438415319 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f797a7fc700 1 -- 172.21.15.60:0/2688211513 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c082070 con 0x557e94caba50 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f797a7fc700 1 -- 172.21.15.60:0/2688211513 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0860c0 con 0x557e94caba50 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.310+0000 7f797a7fc700 1 -- 172.21.15.60:0/2688211513 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c05a3c0 con 0x557e94caba50 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 -- 172.21.15.60:0/2688211513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 msgr2=0x557e94ca7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ca7d70 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f797c084770 tx=0x7f797c008040 comp rx=0 tx=0).stop 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 -- 172.21.15.60:0/2688211513 shutdown_connections 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94d0bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ca7d70 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2688211513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94d0b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 -- 172.21.15.60:0/2688211513 >> 172.21.15.60:0/2688211513 conn(0x557e94cad370 msgr2=0x557e94ca44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 -- 172.21.15.60:0/2688211513 shutdown_connections 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 -- 172.21.15.60:0/2688211513 wait complete. 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.311+0000 7f79944ddb80 1 -- start start 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 Processor -- start 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ce8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94ce8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94d59f60 con 0x557e94caba50 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e94d59470 con 0x557e94cd4f60 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.312+0000 7f79944ddb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e94d52b40 con 0x557e94cf5d00 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f79944ddb80 10 client.0 _ll_register_callbacks cb 0x557e94c6f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:12:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ce8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ce8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53910/0 (socket says 172.21.15.60:53910) 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 -- 172.21.15.60:0/2307864011 learned_addr learned my addr 172.21.15.60:0/2307864011 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7983fff700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94ce8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7989782700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 -- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 msgr2=0x557e94cdad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 -- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 msgr2=0x557e94ce8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94ce8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 -- 172.21.15.60:0/2307864011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840c6500 con 0x557e94caba50 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7988f81700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ce8560 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f797c053670 tx=0x7f797c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe948ab199f2676 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7962ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:12:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7962ffd700 1 -- 172.21.15.60:0/2307864011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c082040 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7962ffd700 1 -- 172.21.15.60:0/2307864011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f797c05a3c0 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e94b9ee00 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7962ffd700 1 -- 172.21.15.60:0/2307864011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f797c0842c0 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f79944ddb80 10 client.7638 fetch_fsmap learned FSMap version 77 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x557e94bb1470 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.313+0000 7f7962ffd700 1 -- 172.21.15.60:0/2307864011 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557e94b9ee00 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f7962ffd700 1 -- 172.21.15.60:0/2307864011 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f797c068020 con 0x557e94caba50 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 10 client.7638 fetch_fsmap finished waiting for FSMap version 77 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 10 client.7638 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 20 client.7638 populate_metadata read hostname 'smithi060' 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94d01570 0x557e94cdb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 4 client.7638 mds_command: new command op to 7509 tid=0[{"prefix": "status"}] 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 --> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e94b9eb20 con 0x557e94d01570 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f7983fff700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94d01570 0x557e94cdb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f7962ffd700 10 client.7638 ms_handle_connect on v2:172.21.15.60:6835/2817981705 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f7983fff700 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94d01570 0x557e94cdb2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3198b91d7d1d9b3 server_cookie=ff30e5224966bb5f in_seq=0 out_seq=0 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f7962ffd700 1 -- 172.21.15.60:0/2307864011 <== mds.0 v2:172.21.15.60:6835/2817981705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x557e94b9eb20 con 0x557e94d01570 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f7962ffd700 10 client.7638 handle_command_reply: tid=0 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 1 client.7638 shutdown 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 msgr2=0x557e94ce8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.314+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ce8560 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f797c053670 tx=0x7f797c01b000 comp rx=0 tx=0).stop 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 shutdown_connections 2023-10-08T16:12:14.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x557e94cf5d00 0x557e94cdad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:6835/2817981705,v1:172.21.15.60:6837/2817981705] conn(0x557e94d01570 0x557e94cdb2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e94caba50 0x557e94ce8560 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f7962ffd700 0 client.7638 ms_handle_reset on v2:172.21.15.60:6835/2817981705 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 --2- 172.21.15.60:0/2307864011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e94cd4f60 0x557e94ce8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 >> 172.21.15.60:0/2307864011 conn(0x557e94cad370 msgr2=0x557e94ca7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 shutdown_connections 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 1 -- 172.21.15.60:0/2307864011 wait complete. 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f79944ddb80 20 client.7638 trim_cache size 0 max 16384 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:12:14.414 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 7509, 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 7.8296628000000004, 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 77, 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 148, 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 148, 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 18.941398246999999 2023-10-08T16:12:14.415 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7964066f30 msgr2=0x7f79640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7964066f30 0x7f79640693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f798415c350 tx=0x7f7974009040 comp rx=0 tx=0).stop 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 msgr2=0x7f79840c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 0x7f79840c5fc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f797c009290 tx=0x7f797c017000 comp rx=0 tx=0).stop 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 shutdown_connections 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f798415a1e0 0x7f798414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79840cde50 0x7f79840c5fc0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 --2- 172.21.15.60:0/3684703375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7984159e10 0x7f7984169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 >> 172.21.15.60:0/3684703375 conn(0x7f7984067660 msgr2=0x7f7984159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 shutdown_connections 2023-10-08T16:12:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.315+0000 7f798b1e5700 1 -- 172.21.15.60:0/3684703375 wait complete. 2023-10-08T16:12:14.448 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:12:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.571+0000 7f9039ad6700 1 Processor -- start 2023-10-08T16:12:14.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.572+0000 7f9039ad6700 1 -- start start 2023-10-08T16:12:14.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.572+0000 7f9039ad6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f903415a620 0x7f903415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.572+0000 7f9039ad6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903415cbb0 con 0x7f9034157870 2023-10-08T16:12:14.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.572+0000 7f9039ad6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903415bfa0 con 0x7f903415d580 2023-10-08T16:12:14.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.572+0000 7f9039ad6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903415bdb0 con 0x7f903415a620 2023-10-08T16:12:14.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f9032ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f903415a620 0x7f903415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f90337fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9034157870 0x7f903415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53250/0 (socket says 172.21.15.60:53250) 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f90337fe700 1 -- 172.21.15.60:0/1501814427 learned_addr learned my addr 172.21.15.60:0/1501814427 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f9032ffd700 1 -- 172.21.15.60:0/1501814427 >> v1:172.21.15.144:6789/0 conn(0x7f903415d580 legacy=0x7f9034158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f9032ffd700 1 -- 172.21.15.60:0/1501814427 >> v1:172.21.15.60:6789/0 conn(0x7f9034157870 legacy=0x7f903415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f9032ffd700 1 -- 172.21.15.60:0/1501814427 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903415c280 con 0x7f903415a620 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f90327fc700 1 -- 172.21.15.60:0/1501814427 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684975084 0 0) 0x7f903415cbb0 con 0x7f9034157870 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f9032ffd700 1 --2- 172.21.15.60:0/1501814427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415a620 0x7f903415d040 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f90280098e0 tx=0x7f90280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd691fdb0bb45e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f90327fc700 1 -- 172.21.15.60:0/1501814427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028009e80 con 0x7f903415a620 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f90327fc700 1 -- 172.21.15.60:0/1501814427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902800b820 con 0x7f903415a620 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.573+0000 7f90327fc700 1 -- 172.21.15.60:0/1501814427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800bba0 con 0x7f903415a620 2023-10-08T16:12:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 -- 172.21.15.60:0/1501814427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415a620 msgr2=0x7f903415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 --2- 172.21.15.60:0/1501814427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415a620 0x7f903415d040 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f90280098e0 tx=0x7f90280091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 -- 172.21.15.60:0/1501814427 shutdown_connections 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 --2- 172.21.15.60:0/1501814427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415a620 0x7f903415d040 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 -- 172.21.15.60:0/1501814427 >> 172.21.15.60:0/1501814427 conn(0x7f9034068ce0 msgr2=0x7f90340690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 -- 172.21.15.60:0/1501814427 shutdown_connections 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.574+0000 7f9039ad6700 1 -- 172.21.15.60:0/1501814427 wait complete. 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.575+0000 7f9039ad6700 1 Processor -- start 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.575+0000 7f9039ad6700 1 -- start start 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9034157870 0x7f90340d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f903415a620 0x7f9034153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 0x7f90341535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903416bd80 con 0x7f903415d580 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903416b170 con 0x7f903415a620 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903416b450 con 0x7f9034157870 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 0x7f90341535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 0x7f90341535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53932/0 (socket says 172.21.15.60:53932) 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 -- 172.21.15.60:0/3032267745 learned_addr learned my addr 172.21.15.60:0/3032267745 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9032ffd700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f903415a620 0x7f9034153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f90337fe700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9034157870 0x7f90340d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 -- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9034157870 msgr2=0x7f90340d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9034157870 0x7f90340d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 -- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f903415a620 msgr2=0x7f9034153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f903415a620 0x7f9034153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 -- 172.21.15.60:0/3032267745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028009420 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f90337fe700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9034157870 0x7f90340d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9033fff700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 0x7f90341535d0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f902c00bb60 tx=0x7f902c0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00c8c0 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00ca60 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00ce20 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.576+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903416b730 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.577+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903416ae60 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.577+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903404c3c0 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.578+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f902c014620 con 0x7f903415d580 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.578+0000 7f901b7fe700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9020066f30 0x7f90200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.579+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f902c0844c0 con 0x7f903415d580 2023-10-08T16:12:14.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.579+0000 7f90337fe700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9020066f30 0x7f90200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:14.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.579+0000 7f90337fe700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9020066f30 0x7f90200693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f90240011e0 tx=0x7f9024009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:14.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.583+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f902c051730 con 0x7f903415d580 2023-10-08T16:12:14.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.825+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f903415c560 con 0x7f903415d580 2023-10-08T16:12:14.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.826+0000 7f901b7fe700 1 -- 172.21.15.60:0/3032267745 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) v1 ==== 53+0+73 (secure 0 0 0) 0x7f902c054d50 con 0x7f903415d580 2023-10-08T16:12:14.908 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:12:14.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9020066f30 msgr2=0x7f90200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9020066f30 0x7f90200693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f90240011e0 tx=0x7f9024009040 comp rx=0 tx=0).stop 2023-10-08T16:12:14.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 msgr2=0x7f90341535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:14.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 0x7f90341535d0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f902c00bb60 tx=0x7f902c0097f0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 shutdown_connections 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9020066f30 0x7f90200693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9034157870 0x7f90340d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f903415d580 0x7f90341535d0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 --2- 172.21.15.60:0/3032267745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f903415a620 0x7f9034153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 >> 172.21.15.60:0/3032267745 conn(0x7f9034068ce0 msgr2=0x7f903415e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 shutdown_connections 2023-10-08T16:12:14.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:14.828+0000 7f9039ad6700 1 -- 172.21.15.60:0/3032267745 wait complete. 2023-10-08T16:12:14.910 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:12:14.910 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:12:14.911 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:12:14.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:14.911 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:12:14.927 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:12:14.933 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:12:14.933 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:12:14.933 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.933 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:12:14.934 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42006sec preferred_lft 42006sec 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:12:14.935 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:14.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:14.936 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:12:14.991 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:12:15.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:15.065 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:12:15.121 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:12:15.218 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:12:15.218 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:12:15.218 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:12:15.218 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:12:15.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:15.219 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:12:15.219 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:12:15.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:12:15.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:12:15.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:12:15.219 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:12:15.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:15.367 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:12:15.382 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:12:15.382 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:12:15.382 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:12:15.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:15.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:12:15.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:12:15.520 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:12:15.535 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:12:15.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:12:15.535 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:12:15.590 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:12:15.648 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:12:15.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:15.690 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:15.690 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:12:15.709 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:15.709 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:12:15.709 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:12:15.709 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:12:15.709 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:12:15.710 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:12:15.710 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:12:15.710 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:12:15.730 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:15.730 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:12:15.730 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:12:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:12:15.733 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:12:15.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:15.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:12:15.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:12:15.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.956+0000 7f6a2c056700 1 Processor -- start 2023-10-08T16:12:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.957+0000 7f6a2c056700 1 -- start start 2023-10-08T16:12:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.957+0000 7f6a2c056700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a241577d0 0x7f6a240cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.957+0000 7f6a2c056700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2415c360 con 0x7f6a2406ac30 2023-10-08T16:12:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.957+0000 7f6a2c056700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2415b790 con 0x7f6a24157ba0 2023-10-08T16:12:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.957+0000 7f6a2c056700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2415ba30 con 0x7f6a241577d0 2023-10-08T16:12:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a2a5f3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a2406ac30 0x7f6a2415c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53252/0 (socket says 172.21.15.60:53252) 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a2a5f3700 1 -- 172.21.15.60:0/324834255 learned_addr learned my addr 172.21.15.60:0/324834255 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a29df2700 1 --2- 172.21.15.60:0/324834255 >> v2:172.21.15.144:3300/0 conn(0x7f6a241577d0 0x7f6a240cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627475162 0 0) 0x7f6a2415c360 con 0x7f6a2406ac30 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c003570 con 0x7f6a2406ac30 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651238108 0 0) 0x7f6a0c003570 con 0x7f6a2406ac30 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 >> v2:172.21.15.144:3300/0 conn(0x7f6a241577d0 msgr2=0x7f6a240cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 --2- 172.21.15.60:0/324834255 >> v2:172.21.15.144:3300/0 conn(0x7f6a241577d0 0x7f6a240cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 >> v1:172.21.15.144:6789/0 conn(0x7f6a24157ba0 legacy=0x7f6a2406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2415bd10 con 0x7f6a2406ac30 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f6a140017f0 con 0x7f6a2406ac30 2023-10-08T16:12:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 >> v1:172.21.15.60:6789/0 conn(0x7f6a2406ac30 legacy=0x7f6a2415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c003a60 0x7f6a0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0c004810 0x7f6a0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a0c0051c0 0x7f6a0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2415ba30 con 0x7f6a0c0051c0 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00c160 con 0x7f6a0c003a60 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00c320 con 0x7f6a0c004810 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a29df2700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c003a60 0x7f6a0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.958+0000 7f6a2a5f3700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a0c0051c0 0x7f6a0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a295f1700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0c004810 0x7f6a0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 -- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0c004810 msgr2=0x7f6a0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0c004810 0x7f6a0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:15.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 -- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c003a60 msgr2=0x7f6a0c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:12:15.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c003a60 0x7f6a0c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:15.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 -- 172.21.15.60:0/324834255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c003570 con 0x7f6a0c0051c0 2023-10-08T16:12:15.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 -- 172.21.15.60:0/324834255 reap_dead start 2023-10-08T16:12:15.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a2a5f3700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a0c0051c0 0x7f6a0c00ba60 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6a2406b030 tx=0x7f6a140021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13db7ac60d452541 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:15.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a140070d0 con 0x7f6a0c0051c0 2023-10-08T16:12:16.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14007250 con 0x7f6a0c0051c0 2023-10-08T16:12:16.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.959+0000 7f6a28df0700 1 -- 172.21.15.60:0/324834255 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14007610 con 0x7f6a0c0051c0 2023-10-08T16:12:16.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 -- 172.21.15.60:0/324834255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a0c0051c0 msgr2=0x7f6a0c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:16.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a0c0051c0 0x7f6a0c00ba60 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6a2406b030 tx=0x7f6a140021d0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 -- 172.21.15.60:0/324834255 shutdown_connections 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 --2- 172.21.15.60:0/324834255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a0c0051c0 0x7f6a0c00ba60 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 -- 172.21.15.60:0/324834255 >> 172.21.15.60:0/324834255 conn(0x7f6a24068ce0 msgr2=0x7f6a240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 -- 172.21.15.60:0/324834255 shutdown_connections 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.960+0000 7f6a2c056700 1 -- 172.21.15.60:0/324834255 wait complete. 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.961+0000 7f6a2c056700 1 Processor -- start 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.961+0000 7f6a2c056700 1 -- start start 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.961+0000 7f6a2c056700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c0051c0 0x7f6a240b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.961+0000 7f6a2c056700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 0x7f6a2415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2c056700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a2414b8d0 0x7f6a2416d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:16.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2c056700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2414fc10 con 0x7f6a240b2a90 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2c056700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2414f640 con 0x7f6a0c0051c0 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2c056700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240b2fe0 con 0x7f6a2414b8d0 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 0x7f6a2415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 0x7f6a2415c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53944/0 (socket says 172.21.15.60:53944) 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 -- 172.21.15.60:0/1561684539 learned_addr learned my addr 172.21.15.60:0/1561684539 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a29df2700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c0051c0 0x7f6a240b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2a5f3700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a2414b8d0 0x7f6a2416d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 -- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a2414b8d0 msgr2=0x7f6a2416d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a2414b8d0 0x7f6a2416d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 -- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c0051c0 msgr2=0x7f6a240b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:16.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c0051c0 0x7f6a240b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 -- 172.21.15.60:0/1561684539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240b32c0 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2a5f3700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a2414b8d0 0x7f6a2416d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a295f1700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 0x7f6a2415c640 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800e560 tx=0x7f6a18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18012500 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18010040 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a180128b0 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.962+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2414f8a0 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.963+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2416ded0 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.963+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2414fd80 con 0x7f6a240b2a90 2023-10-08T16:12:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.964+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a18012c20 con 0x7f6a240b2a90 2023-10-08T16:12:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.964+0000 7f6a21ffb700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6a10066f60 0x7f6a10069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.964+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a18083f90 con 0x7f6a240b2a90 2023-10-08T16:12:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.964+0000 7f6a29df2700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6a10066f60 0x7f6a10069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.965+0000 7f6a29df2700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6a10066f60 0x7f6a10069410 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006f00 tx=0x7f6a1c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:15.969+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a18051200 con 0x7f6a240b2a90 2023-10-08T16:12:16.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.208+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a2404c3c0 con 0x7f6a240b2a90 2023-10-08T16:12:16.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.209+0000 7f6a21ffb700 1 -- 172.21.15.60:0/1561684539 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a18012ed0 con 0x7f6a240b2a90 2023-10-08T16:12:16.313 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:12:16.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6a10066f60 msgr2=0x7f6a10069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6a10066f60 0x7f6a10069410 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006f00 tx=0x7f6a1c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 msgr2=0x7f6a2415c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 0x7f6a2415c640 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800e560 tx=0x7f6a18009040 comp rx=0 tx=0).stop 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 shutdown_connections 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6a10066f60 0x7f6a10069410 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a2414b8d0 0x7f6a2416d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c0051c0 0x7f6a240b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 --2- 172.21.15.60:0/1561684539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a240b2a90 0x7f6a2415c640 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 >> 172.21.15.60:0/1561684539 conn(0x7f6a24068ce0 msgr2=0x7f6a2414d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 shutdown_connections 2023-10-08T16:12:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:16.211+0000 7f6a2c056700 1 -- 172.21.15.60:0/1561684539 wait complete. 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:12:16.316 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:12:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:16.317 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:12:16.335 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:12:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:12:16.407 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42007sec preferred_lft 42007sec 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:12:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:12:16.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:16.410 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:12:16.437 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:12:16.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:16.469 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:12:16.532 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:12:16.602 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:12:16.603 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:12:16.603 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:12:16.603 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:12:16.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:16.603 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:12:16.603 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:12:16.603 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:12:16.603 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:12:16.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:12:16.604 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:12:16.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:16.670 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:12:16.685 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:12:16.685 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:12:16.685 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:12:16.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:16.686 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:12:16.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:12:16.750 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:12:16.805 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:12:16.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:12:16.805 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:12:16.859 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:12:16.869 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:12:16.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:16.938 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:16.939 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:12:16.957 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:16.957 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:12:16.958 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:12:16.958 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:12:16.958 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:12:16.958 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:12:16.958 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:12:16.958 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:12:16.979 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:12:17.061 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:12:17.061 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:12:17.061 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:12:17.061 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:12:17.061 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:12:17.061 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:12:17.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:12:17.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:12:17.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:12:17.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:12:17.063 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:12:17.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:12:17.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:12:17.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:12:17.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.300+0000 7f6a14aef700 1 Processor -- start 2023-10-08T16:12:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.300+0000 7f6a14aef700 1 -- start start 2023-10-08T16:12:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a14aef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a100cba20 0x7f6a1015d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a14aef700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1015ddf0 con 0x7f6a10159e80 2023-10-08T16:12:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a14aef700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100cf2d0 con 0x7f6a100af990 2023-10-08T16:12:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a14aef700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a100cf060 con 0x7f6a100cba20 2023-10-08T16:12:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a0effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a100cba20 0x7f6a1015d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a0effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a100cba20 0x7f6a1015d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53946/0 (socket says 172.21.15.60:53946) 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a0effd700 1 -- 172.21.15.60:0/3142846997 learned_addr learned my addr 172.21.15.60:0/3142846997 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.301+0000 7f6a0ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a10159e80 0x7f6a100cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53262/0 (socket says 172.21.15.60:53262) 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0effd700 1 -- 172.21.15.60:0/3142846997 >> v1:172.21.15.144:6789/0 conn(0x7f6a100af990 legacy=0x7f6a10159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0effd700 1 -- 172.21.15.60:0/3142846997 >> v1:172.21.15.60:6789/0 conn(0x7f6a10159e80 legacy=0x7f6a100cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0effd700 1 -- 172.21.15.60:0/3142846997 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1015e020 con 0x7f6a100cba20 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0effd700 1 --2- 172.21.15.60:0/3142846997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100cba20 0x7f6a1015d8b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce800c59377f7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0e7fc700 1 -- 172.21.15.60:0/3142846997 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400b860 con 0x7f6a100cba20 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0e7fc700 1 -- 172.21.15.60:0/3142846997 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400b9c0 con 0x7f6a100cba20 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a0e7fc700 1 -- 172.21.15.60:0/3142846997 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400bd60 con 0x7f6a100cba20 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a14aef700 1 -- 172.21.15.60:0/3142846997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100cba20 msgr2=0x7f6a1015d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3142846997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100cba20 0x7f6a1015d8b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04009250 comp rx=0 tx=0).stop 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a14aef700 1 -- 172.21.15.60:0/3142846997 shutdown_connections 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3142846997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100cba20 0x7f6a1015d8b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.302+0000 7f6a14aef700 1 -- 172.21.15.60:0/3142846997 >> 172.21.15.60:0/3142846997 conn(0x7f6a10068bf0 msgr2=0x7f6a10068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.303+0000 7f6a14aef700 1 -- 172.21.15.60:0/3142846997 shutdown_connections 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.303+0000 7f6a14aef700 1 -- 172.21.15.60:0/3142846997 wait complete. 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.304+0000 7f6a14aef700 1 Processor -- start 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.304+0000 7f6a14aef700 1 -- start start 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 0x7f6a10156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100cba20 0x7f6a1015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a10159e80 0x7f6a1015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1015b050 con 0x7f6a100af990 2023-10-08T16:12:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1015a440 con 0x7f6a100cba20 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1015a720 con 0x7f6a10159e80 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 0x7f6a10156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 0x7f6a10156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53958/0 (socket says 172.21.15.60:53958) 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 -- 172.21.15.60:0/3244980219 learned_addr learned my addr 172.21.15.60:0/3244980219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0effd700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100cba20 0x7f6a1015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0ffff700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a10159e80 0x7f6a1015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 -- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a10159e80 msgr2=0x7f6a1015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a10159e80 0x7f6a1015c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 -- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100cba20 msgr2=0x7f6a1015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100cba20 0x7f6a1015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 -- 172.21.15.60:0/3244980219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040094f0 con 0x7f6a100af990 2023-10-08T16:12:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a0f7fe700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 0x7f6a10156050 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c590 tx=0x7f6a0000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00011590 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00011710 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00011ad0 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1015aa00 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.305+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a10156590 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.306+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a10089500 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.307+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a0001b3b0 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.307+0000 7f69f77fe700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f69fc066f30 0x7f69fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.307+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a000839a0 con 0x7f6a100af990 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.307+0000 7f6a0effd700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f69fc066f30 0x7f69fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.308+0000 7f6a0effd700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f69fc066f30 0x7f69fc0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.312+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a00050c10 con 0x7f6a100af990 2023-10-08T16:12:17.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.548+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a1004bb80 con 0x7f6a100af990 2023-10-08T16:12:17.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.548+0000 7f69f77fe700 1 -- 172.21.15.60:0/3244980219 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6a00017070 con 0x7f6a100af990 2023-10-08T16:12:17.550 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:12:17.550 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f69fc066f30 msgr2=0x7f69fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f69fc066f30 0x7f69fc0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6a040099b0 tx=0x7f6a04017000 comp rx=0 tx=0).stop 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 msgr2=0x7f6a10156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 0x7f6a10156050 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c590 tx=0x7f6a0000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 shutdown_connections 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f69fc066f30 0x7f69fc0693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a10159e80 0x7f6a1015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a100af990 0x7f6a10156050 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.550+0000 7f6a14aef700 1 --2- 172.21.15.60:0/3244980219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100cba20 0x7f6a1015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.551+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 >> 172.21.15.60:0/3244980219 conn(0x7f6a10068bf0 msgr2=0x7f6a100cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.551+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 shutdown_connections 2023-10-08T16:12:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.551+0000 7f6a14aef700 1 -- 172.21.15.60:0/3244980219 wait complete. 2023-10-08T16:12:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:12:17.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-08T16:12:17.712 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":7509,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.216893786,"mdsmap_epoch":77,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":22.328632748} 2023-10-08T16:12:17.722 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 7509, "mdsmap_epoch": 77, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 11.216893786, "state": "up:active", "uptime": 22.328632748, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:12:17.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-08T16:12:17.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.844+0000 7f31c3b61700 1 Processor -- start 2023-10-08T16:12:17.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.844+0000 7f31c3b61700 1 -- start start 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.844+0000 7f31c3b61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0693c0 0x7f31bc0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c3b61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc0b0d60 con 0x7f31bc0b11f0 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c3b61700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc0b3540 con 0x7f31bc159e50 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c3b61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0d15b0 con 0x7f31bc0693c0 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c10fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31bc0b11f0 0x7f31bc068cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53270/0 (socket says 172.21.15.60:53270) 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c10fc700 1 -- 172.21.15.60:0/1812286874 learned_addr learned my addr 172.21.15.60:0/1812286874 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c20fe700 1 --2- 172.21.15.60:0/1812286874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0693c0 0x7f31bc0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814863774 0 0) 0x7f31bc0b3540 con 0x7f31bc159e50 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a4003570 con 0x7f31bc159e50 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184178738 0 0) 0x7f31bc0b0d60 con 0x7f31bc0b11f0 2023-10-08T16:12:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31bc0b3540 con 0x7f31bc0b11f0 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c20fe700 1 -- 172.21.15.60:0/1812286874 >> v1:172.21.15.144:6789/0 conn(0x7f31bc159e50 legacy=0x7f31bc0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c20fe700 1 -- 172.21.15.60:0/1812286874 >> v1:172.21.15.60:6789/0 conn(0x7f31bc0b11f0 legacy=0x7f31bc068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c20fe700 1 -- 172.21.15.60:0/1812286874 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc0d1890 con 0x7f31bc0693c0 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c20fe700 1 --2- 172.21.15.60:0/1812286874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0693c0 0x7f31bc0b1660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009e90 tx=0x7f31ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c7c37d50c98a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.845+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00e070 con 0x7f31bc0693c0 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00bb80 con 0x7f31bc0693c0 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c08fb700 1 -- 172.21.15.60:0/1812286874 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac012430 con 0x7f31bc0693c0 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 -- 172.21.15.60:0/1812286874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0693c0 msgr2=0x7f31bc0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 --2- 172.21.15.60:0/1812286874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0693c0 0x7f31bc0b1660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009e90 tx=0x7f31ac009780 comp rx=0 tx=0).stop 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 -- 172.21.15.60:0/1812286874 shutdown_connections 2023-10-08T16:12:18.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 --2- 172.21.15.60:0/1812286874 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0693c0 0x7f31bc0b1660 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 -- 172.21.15.60:0/1812286874 >> 172.21.15.60:0/1812286874 conn(0x7f31bc068130 msgr2=0x7f31bc0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 -- 172.21.15.60:0/1812286874 shutdown_connections 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.846+0000 7f31c3b61700 1 -- 172.21.15.60:0/1812286874 wait complete. 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.847+0000 7f31c3b61700 1 Processor -- start 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.847+0000 7f31c3b61700 1 -- start start 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c3b61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 0x7f31bc153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c3b61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0b11f0 0x7f31bc0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c3b61700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc159e50 0x7f31bc156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:18.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c3b61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1563e0 con 0x7f31bc0693c0 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c3b61700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc156930 con 0x7f31bc159e50 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c3b61700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1540f0 con 0x7f31bc0b11f0 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 0x7f31bc153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 0x7f31bc153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53964/0 (socket says 172.21.15.60:53964) 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 -- 172.21.15.60:0/3004064196 learned_addr learned my addr 172.21.15.60:0/3004064196 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c10fc700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0b11f0 0x7f31bc0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c20fe700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc159e50 0x7f31bc156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 -- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0b11f0 msgr2=0x7f31bc0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0b11f0 0x7f31bc0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 -- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc159e50 msgr2=0x7f31bc156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc159e50 0x7f31bc156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.848+0000 7f31c18fd700 1 -- 172.21.15.60:0/3004064196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009a20 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.849+0000 7f31c18fd700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 0x7f31bc153bb0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f31b400c790 tx=0x7f31b4007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.849+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011680 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.849+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40117e0 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.849+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0c82c0 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.849+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011b60 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.849+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc155d20 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.850+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc04c3c0 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.850+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31b401c460 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.851+0000 7f31b9ffb700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31a8066f30 0x7f31a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.851+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31b40846d0 con 0x7f31bc0693c0 2023-10-08T16:12:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.851+0000 7f31c10fc700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31a8066f30 0x7f31a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:12:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.851+0000 7f31c10fc700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31a8066f30 0x7f31a80693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0c9900 tx=0x7f31b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:12:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:17.855+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31b4051940 con 0x7f31bc0693c0 2023-10-08T16:12:18.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.048+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f31bc156c10 con 0x7f31bc0693c0 2023-10-08T16:12:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.537+0000 7f31b9ffb700 1 -- 172.21.15.60:0/3004064196 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v149) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31b4054f60 con 0x7f31bc0693c0 2023-10-08T16:12:18.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31a8066f30 msgr2=0x7f31a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31a8066f30 0x7f31a80693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0c9900 tx=0x7f31b0009040 comp rx=0 tx=0).stop 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 msgr2=0x7f31bc153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 0x7f31bc153bb0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f31b400c790 tx=0x7f31b4007e30 comp rx=0 tx=0).stop 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 shutdown_connections 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31a8066f30 0x7f31a80693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc159e50 0x7f31bc156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31bc0693c0 0x7f31bc153bb0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 --2- 172.21.15.60:0/3004064196 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31bc0b11f0 0x7f31bc0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 >> 172.21.15.60:0/3004064196 conn(0x7f31bc068130 msgr2=0x7f31bc0b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 shutdown_connections 2023-10-08T16:12:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:12:18.539+0000 7f31c3b61700 1 -- 172.21.15.60:0/3004064196 wait complete. 2023-10-08T16:12:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-08T16:12:18.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:12:18.688 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:12:18.688 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:12:18.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-08T16:12:18.815 INFO:teuthology.orchestra.run.smithi060.stdout:{"mon_tick_interval":"5"} 2023-10-08T16:12:18.815 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-08T16:12:18.815 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> import time 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> import datetime 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> # Write some buffered data through before going full, all should be well 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> print("writing some data through which we expect to succeed") 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> bytes = 0 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-08T16:12:18.816 DEBUG:teuthology.orchestra.run.smithi060:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> # buffered IO, the error should always only appear from fsync and not 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> # from write 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> full = False 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> for n in range(0, int(32 * 0.9)): 2023-10-08T16:12:18.817 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> print("done writing {0} bytes".format(bytes)) 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> # OK, now we should sneak in under the full condition 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> # due to the time it takes the OSDs to report to the 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> # mons, and get a successful fsync on our full-making data 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> # buffered write, add more dirty data to the buffer 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> print("starting buffered write") 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:12:18.818 DEBUG:teuthology.orchestra.run.smithi060:> for n in range(0, int(32 * 0.2)): 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(15.0) 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> except OSError: 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> pass; 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> # Wait long enough for a background flush that should fail 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(30) 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.819 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> # ...and check that the failed background flush is reflected in fclose 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> os.close(f) 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> except OSError: 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> print("close() returned an error as expected") 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("close() failed to raise error") 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> # The kernel cephfs client does not raise errors on fclose 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> os.close(f) 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-08T16:12:18.820 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:12:33.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:33.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:03.525 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:03.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:33.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:33.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:03.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:03.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:writing some data through which we expect to succeed 2023-10-08T16:14:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-08T16:14:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-08T16:14:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-08T16:14:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-08T16:14:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-08T16:14:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-08T16:14:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:done writing 29884416 bytes 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:successfully fsync'ed prior to getting full state reported 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:starting buffered write 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:14:20.525 INFO:teuthology.orchestra.run.smithi060.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-08T16:14:20.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:14:20.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:14:20.692 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:14:20.736 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:14:20.737 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:14:20.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:14:20.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:14:20.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:14:20.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:20.780 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:14:20.837 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:14:20.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:14:20.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:14:20.878 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:14:20.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:20.879 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:14:20.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:21.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.058+0000 7f35653f9700 1 Processor -- start 2023-10-08T16:14:21.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.058+0000 7f35653f9700 1 -- start start 2023-10-08T16:14:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f35653f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35600cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f35653f9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35600b3430 0x7f35600cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f35653f9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356015db80 con 0x7f3560159e10 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f35653f9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356015e800 con 0x7f35600b3430 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f35653f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356015de60 con 0x7f356015a1e0 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35600b3430 0x7f35600cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35600b3430 0x7f35600cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52908/0 (socket says 172.21.15.60:52908) 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 -- 172.21.15.60:0/261995918 learned_addr learned my addr 172.21.15.60:0/261995918 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355e7fc700 1 --2- 172.21.15.60:0/261995918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35600cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 -- 172.21.15.60:0/261995918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 msgr2=0x7f35600cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 --2- 172.21.15.60:0/261995918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35600cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 -- 172.21.15.60:0/261995918 >> v1:172.21.15.144:6789/0 conn(0x7f3560159e10 legacy=0x7f35600b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 -- 172.21.15.60:0/261995918 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356015e140 con 0x7f35600b3430 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355f7fe700 1 --2- 172.21.15.60:0/261995918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35600b3430 0x7f35600cdc80 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f35500099b0 tx=0x7f3550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06016188718a4df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.059+0000 7f355dffb700 1 -- 172.21.15.60:0/261995918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000b860 con 0x7f35600b3430 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f355dffb700 1 -- 172.21.15.60:0/261995918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000b9c0 con 0x7f35600b3430 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f355dffb700 1 -- 172.21.15.60:0/261995918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000bd60 con 0x7f35600b3430 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 -- 172.21.15.60:0/261995918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35600b3430 msgr2=0x7f35600cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 --2- 172.21.15.60:0/261995918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35600b3430 0x7f35600cdc80 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f35500099b0 tx=0x7f3550009250 comp rx=0 tx=0).stop 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 -- 172.21.15.60:0/261995918 shutdown_connections 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 --2- 172.21.15.60:0/261995918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35600b3430 0x7f35600cdc80 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 --2- 172.21.15.60:0/261995918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35600cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 -- 172.21.15.60:0/261995918 >> 172.21.15.60:0/261995918 conn(0x7f3560067660 msgr2=0x7f3560067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 -- 172.21.15.60:0/261995918 shutdown_connections 2023-10-08T16:14:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.060+0000 7f35653f9700 1 -- 172.21.15.60:0/261995918 wait complete. 2023-10-08T16:14:21.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.061+0000 7f35653f9700 1 Processor -- start 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.061+0000 7f35653f9700 1 -- start start 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f35653f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600b3430 0x7f35600c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f35653f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 0x7f356015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f35653f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35601578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f35653f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600c6af0 con 0x7f3560159e10 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f35653f9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600c5ee0 con 0x7f35600b3430 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f35653f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600c61c0 con 0x7f356015a1e0 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f355e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 0x7f356015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f355e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 0x7f356015d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52916/0 (socket says 172.21.15.60:52916) 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f355e7fc700 1 -- 172.21.15.60:0/3827436559 learned_addr learned my addr 172.21.15.60:0/3827436559 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f355f7fe700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35601578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.062+0000 7f355effd700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600b3430 0x7f35600c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f355e7fc700 1 -- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 msgr2=0x7f35601578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f355e7fc700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35601578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f355e7fc700 1 -- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600b3430 msgr2=0x7f35600c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f355e7fc700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600b3430 0x7f35600c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f355e7fc700 1 -- 172.21.15.60:0/3827436559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500094f0 con 0x7f3560159e10 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f355e7fc700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 0x7f356015d450 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f354800d860 tx=0x7f3548008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35480125f0 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548012750 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600c64a0 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548012b10 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.063+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3560152780 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.064+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35600c6c60 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.064+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f354801e460 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.065+0000 7f3556ffd700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.065+0000 7f355effd700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.065+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3548084af0 con 0x7f3560159e10 2023-10-08T16:14:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.065+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f354006eb10 con 0x7f3560159e10 2023-10-08T16:14:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.065+0000 7f355effd700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3540066f30 0x7f35400693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3558007fd0 tx=0x7f35580016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.069+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35480557b0 con 0x7f3560159e10 2023-10-08T16:14:21.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.304+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356004c3c0 con 0x7f3560159e10 2023-10-08T16:14:21.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.305+0000 7f3556ffd700 1 -- 172.21.15.60:0/3827436559 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3548055340 con 0x7f3560159e10 2023-10-08T16:14:21.306 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:21.306 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:14:21.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3540066f30 msgr2=0x7f35400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3540066f30 0x7f35400693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3558007fd0 tx=0x7f35580016f0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 msgr2=0x7f356015d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 0x7f356015d450 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f354800d860 tx=0x7f3548008040 comp rx=0 tx=0).stop 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 shutdown_connections 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f356015a1e0 0x7f35601578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600b3430 0x7f35600c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 --2- 172.21.15.60:0/3827436559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3560159e10 0x7f356015d450 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 >> 172.21.15.60:0/3827436559 conn(0x7f3560067660 msgr2=0x7f356015a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 shutdown_connections 2023-10-08T16:14:21.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.307+0000 7f35653f9700 1 -- 172.21.15.60:0/3827436559 wait complete. 2023-10-08T16:14:21.310 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:14:21.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.438+0000 7f878c553700 1 Processor -- start 2023-10-08T16:14:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.438+0000 7f878c553700 1 -- start start 2023-10-08T16:14:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f878c553700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8784158e50 0x7f87840cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f878c553700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878406c010 con 0x7f87841523e0 2023-10-08T16:14:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f878c553700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878406bd10 con 0x7f8784152010 2023-10-08T16:14:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f878c553700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878415c060 con 0x7f8784158e50 2023-10-08T16:14:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f878aaf0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8784158e50 0x7f87840cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f8789aee700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f87841523e0 0x7f878406c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53168/0 (socket says 172.21.15.60:53168) 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.439+0000 7f8789aee700 1 -- 172.21.15.60:0/2881478663 learned_addr learned my addr 172.21.15.60:0/2881478663 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f878aaf0700 1 -- 172.21.15.60:0/2881478663 >> v1:172.21.15.144:6789/0 conn(0x7f8784152010 legacy=0x7f878415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f878aaf0700 1 -- 172.21.15.60:0/2881478663 >> v1:172.21.15.60:6789/0 conn(0x7f87841523e0 legacy=0x7f878406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f878aaf0700 1 -- 172.21.15.60:0/2881478663 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878415c340 con 0x7f8784158e50 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f87892ed700 1 -- 172.21.15.60:0/2881478663 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165795193 0 0) 0x7f878406bd10 con 0x7f8784152010 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f878aaf0700 1 --2- 172.21.15.60:0/2881478663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8784158e50 0x7f87840cb750 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f87740098e0 tx=0x7f87740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd78af3c06ad1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f87892ed700 1 -- 172.21.15.60:0/2881478663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774009e80 con 0x7f8784158e50 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f87892ed700 1 -- 172.21.15.60:0/2881478663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400b760 con 0x7f8784158e50 2023-10-08T16:14:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f87892ed700 1 -- 172.21.15.60:0/2881478663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400bae0 con 0x7f8784158e50 2023-10-08T16:14:21.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f878c553700 1 -- 172.21.15.60:0/2881478663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8784158e50 msgr2=0x7f87840cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.440+0000 7f878c553700 1 --2- 172.21.15.60:0/2881478663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8784158e50 0x7f87840cb750 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f87740098e0 tx=0x7f87740091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.441+0000 7f878c553700 1 -- 172.21.15.60:0/2881478663 shutdown_connections 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.441+0000 7f878c553700 1 --2- 172.21.15.60:0/2881478663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8784158e50 0x7f87840cb750 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.441+0000 7f878c553700 1 -- 172.21.15.60:0/2881478663 >> 172.21.15.60:0/2881478663 conn(0x7f8784069870 msgr2=0x7f8784069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.441+0000 7f878c553700 1 -- 172.21.15.60:0/2881478663 shutdown_connections 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.441+0000 7f878c553700 1 -- 172.21.15.60:0/2881478663 wait complete. 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 Processor -- start 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 -- start start 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8784152010 0x7f8784150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 0x7f878414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8784158e50 0x7f878414f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878415c880 con 0x7f87841523e0 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87840c6aa0 con 0x7f8784152010 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.442+0000 7f878c553700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87840c6d80 con 0x7f8784158e50 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 0x7f878414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 0x7f878414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52938/0 (socket says 172.21.15.60:52938) 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 -- 172.21.15.60:0/4043897417 learned_addr learned my addr 172.21.15.60:0/4043897417 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f878a2ef700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8784152010 0x7f8784150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f878aaf0700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8784158e50 0x7f878414f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 -- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8784158e50 msgr2=0x7f878414f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8784158e50 0x7f878414f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 -- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8784152010 msgr2=0x7f8784150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8784152010 0x7f8784150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 -- 172.21.15.60:0/4043897417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009420 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f8789aee700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 0x7f878414f190 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f877800c760 tx=0x7f8778007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778005b30 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778005c90 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87840c7060 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778007340 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.443+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87841507c0 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.444+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878415c9f0 con 0x7f87841523e0 2023-10-08T16:14:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.445+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f877801b400 con 0x7f87841523e0 2023-10-08T16:14:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.445+0000 7f87827fc700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8770066f30 0x7f87700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.445+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8778083fb0 con 0x7f87841523e0 2023-10-08T16:14:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.445+0000 7f878a2ef700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8770066f30 0x7f87700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.445+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f877006eb10 con 0x7f87841523e0 2023-10-08T16:14:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.445+0000 7f878a2ef700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8770066f30 0x7f87700693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f877c001560 tx=0x7f877c0016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.449+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87780512a0 con 0x7f87841523e0 2023-10-08T16:14:21.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.653+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f878404c3c0 con 0x7f87841523e0 2023-10-08T16:14:21.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.653+0000 7f87827fc700 1 -- 172.21.15.60:0/4043897417 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f87780548c0 con 0x7f87841523e0 2023-10-08T16:14:21.655 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:21.655 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":152,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:13:43.378567+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:12:04.269763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T16:12:04.831880+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.12","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.655+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8770066f30 msgr2=0x7f87700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.655+0000 7f878c553700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8770066f30 0x7f87700693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f877c001560 tx=0x7f877c0016f0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.655+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 msgr2=0x7f878414f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 0x7f878414f190 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f877800c760 tx=0x7f8778007ef0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 shutdown_connections 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8770066f30 0x7f87700693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8784158e50 0x7f878414f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8784152010 0x7f8784150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 --2- 172.21.15.60:0/4043897417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87841523e0 0x7f878414f190 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 >> 172.21.15.60:0/4043897417 conn(0x7f8784069870 msgr2=0x7f878406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 shutdown_connections 2023-10-08T16:14:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.656+0000 7f878c553700 1 -- 172.21.15.60:0/4043897417 wait complete. 2023-10-08T16:14:21.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:12:04.269763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:12:04.831880+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:14:21.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:14:21.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.790+0000 7fbaab486700 1 Processor -- start 2023-10-08T16:14:21.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.790+0000 7fbaab486700 1 -- start start 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.791+0000 7fbaab486700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbaa40adc80 0x7fbaa40b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.791+0000 7fbaab486700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40b0460 0x7fbaa40b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.791+0000 7fbaab486700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40b1850 con 0x7fbaa40ce9e0 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.791+0000 7fbaab486700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40cf550 con 0x7fbaa40adc80 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.791+0000 7fbaab486700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40b20f0 con 0x7fbaa40b0460 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbaa40adc80 0x7fbaa40b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbaa40adc80 0x7fbaa40b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52954/0 (socket says 172.21.15.60:52954) 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 -- 172.21.15.60:0/395849671 learned_addr learned my addr 172.21.15.60:0/395849671 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaa9c83700 1 --2- 172.21.15.60:0/395849671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40b0460 0x7fbaa40b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 -- 172.21.15.60:0/395849671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40b0460 msgr2=0x7fbaa40b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 --2- 172.21.15.60:0/395849671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40b0460 0x7fbaa40b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 -- 172.21.15.60:0/395849671 >> v1:172.21.15.144:6789/0 conn(0x7fbaa40ce9e0 legacy=0x7fbaa40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 -- 172.21.15.60:0/395849671 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40b0e10 con 0x7fbaa40adc80 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaaa484700 1 --2- 172.21.15.60:0/395849671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40adc80 0x7fbaa40b2580 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0099b0 tx=0x7fba9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4afdee019f87b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaa9482700 1 -- 172.21.15.60:0/395849671 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c009ea0 con 0x7fbaa40adc80 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaa9482700 1 -- 172.21.15.60:0/395849671 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c00b860 con 0x7fbaa40adc80 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.792+0000 7fbaa9482700 1 -- 172.21.15.60:0/395849671 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00bc00 con 0x7fbaa40adc80 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 -- 172.21.15.60:0/395849671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40adc80 msgr2=0x7fbaa40b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 --2- 172.21.15.60:0/395849671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40adc80 0x7fbaa40b2580 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0099b0 tx=0x7fba9c009250 comp rx=0 tx=0).stop 2023-10-08T16:14:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 -- 172.21.15.60:0/395849671 shutdown_connections 2023-10-08T16:14:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 --2- 172.21.15.60:0/395849671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40adc80 0x7fbaa40b2580 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 --2- 172.21.15.60:0/395849671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40b0460 0x7fbaa40b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 -- 172.21.15.60:0/395849671 >> 172.21.15.60:0/395849671 conn(0x7fbaa406c700 msgr2=0x7fbaa4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 -- 172.21.15.60:0/395849671 shutdown_connections 2023-10-08T16:14:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.793+0000 7fbaab486700 1 -- 172.21.15.60:0/395849671 wait complete. 2023-10-08T16:14:21.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.794+0000 7fbaab486700 1 Processor -- start 2023-10-08T16:14:21.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.794+0000 7fbaab486700 1 -- start start 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa40adc80 0x7fbaa4147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 0x7fbaa40cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40ce9e0 0x7fbaa40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41477a0 con 0x7fbaa40b0460 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4148170 con 0x7fbaa40adc80 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4146b90 con 0x7fbaa40ce9e0 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 0x7fbaa40cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 0x7fbaa40cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52964/0 (socket says 172.21.15.60:52964) 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 -- 172.21.15.60:0/4000059961 learned_addr learned my addr 172.21.15.60:0/4000059961 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaaa484700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa40adc80 0x7fbaa4147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaaac85700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40ce9e0 0x7fbaa40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 -- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40ce9e0 msgr2=0x7fbaa40cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40ce9e0 0x7fbaa40cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 -- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa40adc80 msgr2=0x7fbaa4147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa40adc80 0x7fbaa4147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 -- 172.21.15.60:0/4000059961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0094f0 con 0x7fbaa40b0460 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa9c83700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 0x7fbaa40cae20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fba9800ec80 tx=0x7fba980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800c850 con 0x7fbaa40b0460 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800c9b0 con 0x7fbaa40b0460 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800cd50 con 0x7fbaa40b0460 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.795+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4146e70 con 0x7fbaa40b0460 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.796+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa4147430 con 0x7fbaa40b0460 2023-10-08T16:14:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.796+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa404c3c0 con 0x7fbaa40b0460 2023-10-08T16:14:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.797+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba98013680 con 0x7fbaa40b0460 2023-10-08T16:14:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.797+0000 7fbaa27fc700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba90066f30 0x7fba900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.797+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fba98084830 con 0x7fbaa40b0460 2023-10-08T16:14:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.797+0000 7fbaaa484700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba90066f30 0x7fba900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.797+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fba9006eb10 con 0x7fbaa40b0460 2023-10-08T16:14:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.798+0000 7fbaaa484700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba90066f30 0x7fba900693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0099b0 tx=0x7fba9c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.802+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba980519c0 con 0x7fbaa40b0460 2023-10-08T16:14:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.991+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbaa40cf750 con 0x7fbaa40b0460 2023-10-08T16:14:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.992+0000 7fbaa27fc700 1 -- 172.21.15.60:0/4000059961 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba98054fe0 con 0x7fbaa40b0460 2023-10-08T16:14:21.994 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:14:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba90066f30 msgr2=0x7fba900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba90066f30 0x7fba900693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0099b0 tx=0x7fba9c017000 comp rx=0 tx=0).stop 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 msgr2=0x7fbaa40cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 0x7fbaa40cae20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fba9800ec80 tx=0x7fba980091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 shutdown_connections 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba90066f30 0x7fba900693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa40ce9e0 0x7fbaa40cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa40adc80 0x7fbaa4147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 --2- 172.21.15.60:0/4000059961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaa40b0460 0x7fbaa40cae20 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 >> 172.21.15.60:0/4000059961 conn(0x7fbaa406c700 msgr2=0x7fbaa40afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 shutdown_connections 2023-10-08T16:14:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:21.994+0000 7fbaab486700 1 -- 172.21.15.60:0/4000059961 wait complete. 2023-10-08T16:14:22.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:14:22.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.128+0000 7f28a84f9700 1 Processor -- start 2023-10-08T16:14:22.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.128+0000 7f28a84f9700 1 -- start start 2023-10-08T16:14:22.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a84f9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28a0159ec0 0x7f28a00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a84f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a006acb0 0x7f28a00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a84f9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b0790 con 0x7f28a015a290 2023-10-08T16:14:22.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a84f9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00ce1f0 con 0x7f28a0159ec0 2023-10-08T16:14:22.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a84f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b0b20 con 0x7f28a006acb0 2023-10-08T16:14:22.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28a0159ec0 0x7f28a00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28a0159ec0 0x7f28a00af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52976/0 (socket says 172.21.15.60:52976) 2023-10-08T16:14:22.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 -- 172.21.15.60:0/1849139022 learned_addr learned my addr 172.21.15.60:0/1849139022 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:22.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6a96700 1 --2- 172.21.15.60:0/1849139022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a006acb0 0x7f28a00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 -- 172.21.15.60:0/1849139022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a006acb0 msgr2=0x7f28a00afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:22.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 --2- 172.21.15.60:0/1849139022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a006acb0 0x7f28a00afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 -- 172.21.15.60:0/1849139022 >> v1:172.21.15.144:6789/0 conn(0x7f28a015a290 legacy=0x7f28a006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 -- 172.21.15.60:0/1849139022 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00b04b0 con 0x7f28a0159ec0 2023-10-08T16:14:22.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a6295700 1 --2- 172.21.15.60:0/1849139022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159ec0 0x7f28a00af940 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f28980099b0 tx=0x7f2898009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605bfb31ec229be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a5293700 1 -- 172.21.15.60:0/1849139022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289800b860 con 0x7f28a0159ec0 2023-10-08T16:14:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a5293700 1 -- 172.21.15.60:0/1849139022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289800b9c0 con 0x7f28a0159ec0 2023-10-08T16:14:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.129+0000 7f28a5293700 1 -- 172.21.15.60:0/1849139022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289800bd60 con 0x7f28a0159ec0 2023-10-08T16:14:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 -- 172.21.15.60:0/1849139022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159ec0 msgr2=0x7f28a00af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 --2- 172.21.15.60:0/1849139022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159ec0 0x7f28a00af940 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f28980099b0 tx=0x7f2898009250 comp rx=0 tx=0).stop 2023-10-08T16:14:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 -- 172.21.15.60:0/1849139022 shutdown_connections 2023-10-08T16:14:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 --2- 172.21.15.60:0/1849139022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a006acb0 0x7f28a00afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 --2- 172.21.15.60:0/1849139022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159ec0 0x7f28a00af940 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 -- 172.21.15.60:0/1849139022 >> 172.21.15.60:0/1849139022 conn(0x7f28a00d1880 msgr2=0x7f28a00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:22.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 -- 172.21.15.60:0/1849139022 shutdown_connections 2023-10-08T16:14:22.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.130+0000 7f28a84f9700 1 -- 172.21.15.60:0/1849139022 wait complete. 2023-10-08T16:14:22.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.131+0000 7f28a84f9700 1 Processor -- start 2023-10-08T16:14:22.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.131+0000 7f28a84f9700 1 -- start start 2023-10-08T16:14:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a84f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 0x7f28a00afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a84f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a0159ec0 0x7f28a00c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a84f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a015a290 0x7f28a00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a84f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01561d0 con 0x7f28a006acb0 2023-10-08T16:14:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a84f9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0156790 con 0x7f28a015a290 2023-10-08T16:14:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a84f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00ca4b0 con 0x7f28a0159ec0 2023-10-08T16:14:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 0x7f28a00afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 0x7f28a00afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52992/0 (socket says 172.21.15.60:52992) 2023-10-08T16:14:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 -- 172.21.15.60:0/2555634599 learned_addr learned my addr 172.21.15.60:0/2555634599 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6a96700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a015a290 0x7f28a00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a5a94700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a0159ec0 0x7f28a00c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 -- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a0159ec0 msgr2=0x7f28a00c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a0159ec0 0x7f28a00c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 -- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a015a290 msgr2=0x7f28a00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a015a290 0x7f28a00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6295700 1 -- 172.21.15.60:0/2555634599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980094f0 con 0x7f28a006acb0 2023-10-08T16:14:22.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a6a96700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a015a290 0x7f28a00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:22.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.132+0000 7f28a5a94700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a0159ec0 0x7f28a00c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:22.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.133+0000 7f28a6295700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 0x7f28a00afd70 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2898006fd0 tx=0x7f2898017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.133+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898024440 con 0x7f28a006acb0 2023-10-08T16:14:22.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.133+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980245a0 con 0x7f28a006acb0 2023-10-08T16:14:22.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.133+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a00ca790 con 0x7f28a006acb0 2023-10-08T16:14:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.133+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898024940 con 0x7f28a006acb0 2023-10-08T16:14:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.133+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0155a80 con 0x7f28a006acb0 2023-10-08T16:14:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.134+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a004c3c0 con 0x7f28a006acb0 2023-10-08T16:14:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.134+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f289801a420 con 0x7f28a006acb0 2023-10-08T16:14:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.135+0000 7f289e7fc700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f288c066f30 0x7f288c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.135+0000 7f28a5a94700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f288c066f30 0x7f288c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.135+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f28980863a0 con 0x7f28a006acb0 2023-10-08T16:14:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.135+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f288c06eb10 con 0x7f28a006acb0 2023-10-08T16:14:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.135+0000 7f28a5a94700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f288c066f30 0x7f288c0693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f28940017a0 tx=0x7f2894009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.139+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2898053650 con 0x7f28a006acb0 2023-10-08T16:14:22.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.333+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28a00ceab0 con 0x7f28a006acb0 2023-10-08T16:14:22.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.333+0000 7f289e7fc700 1 -- 172.21.15.60:0/2555634599 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28980150a0 con 0x7f28a006acb0 2023-10-08T16:14:22.335 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:14:22.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f288c066f30 msgr2=0x7f288c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f288c066f30 0x7f288c0693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f28940017a0 tx=0x7f2894009040 comp rx=0 tx=0).stop 2023-10-08T16:14:22.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 msgr2=0x7f28a00afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 0x7f28a00afd70 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2898006fd0 tx=0x7f2898017000 comp rx=0 tx=0).stop 2023-10-08T16:14:22.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 shutdown_connections 2023-10-08T16:14:22.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f288c066f30 0x7f288c0693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28a015a290 0x7f28a00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a006acb0 0x7f28a00afd70 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 --2- 172.21.15.60:0/2555634599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28a0159ec0 0x7f28a00c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 >> 172.21.15.60:0/2555634599 conn(0x7f28a00d1880 msgr2=0x7f28a00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:22.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.335+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 shutdown_connections 2023-10-08T16:14:22.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.336+0000 7f28a84f9700 1 -- 172.21.15.60:0/2555634599 wait complete. 2023-10-08T16:14:22.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:14:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.470+0000 7f000c65a700 1 Processor -- start 2023-10-08T16:14:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.470+0000 7f000c65a700 1 -- start start 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f000c65a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 0x7f000415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f000c65a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00040b4c30 0x7f00040b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f000c65a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040b14f0 con 0x7f00040b4860 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f000c65a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040b17d0 con 0x7f00040b4c30 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f000c65a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b1ab0 con 0x7f00040b3570 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 0x7f000415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f000abf7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00040b4c30 0x7f00040b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 0x7f000415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:44848/0 (socket says 172.21.15.60:44848) 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 -- 172.21.15.60:0/3869918080 learned_addr learned my addr 172.21.15.60:0/3869918080 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 -- 172.21.15.60:0/3869918080 >> v2:172.21.15.144:3300/0 conn(0x7f00040b4c30 msgr2=0x7f00040b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 --2- 172.21.15.60:0/3869918080 >> v2:172.21.15.144:3300/0 conn(0x7f00040b4c30 0x7f00040b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 -- 172.21.15.60:0/3869918080 >> v1:172.21.15.144:6789/0 conn(0x7f00040b4860 legacy=0x7f0004159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 -- 172.21.15.60:0/3869918080 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040b1d90 con 0x7f00040b3570 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.471+0000 7f0009bf5700 1 --2- 172.21.15.60:0/3869918080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 0x7f000415a1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efff40099b0 tx=0x7efff4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac96ed8f1f3c4ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f00093f4700 1 -- 172.21.15.60:0/3869918080 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4009ea0 con 0x7f00040b3570 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f00093f4700 1 -- 172.21.15.60:0/3869918080 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400b8f0 con 0x7f00040b3570 2023-10-08T16:14:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f00093f4700 1 -- 172.21.15.60:0/3869918080 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400bc90 con 0x7f00040b3570 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 -- 172.21.15.60:0/3869918080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 msgr2=0x7f000415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 --2- 172.21.15.60:0/3869918080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 0x7f000415a1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efff40099b0 tx=0x7efff4009250 comp rx=0 tx=0).stop 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 -- 172.21.15.60:0/3869918080 shutdown_connections 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 --2- 172.21.15.60:0/3869918080 >> v2:172.21.15.144:3300/0 conn(0x7f00040b4c30 0x7f00040b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 --2- 172.21.15.60:0/3869918080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b3570 0x7f000415a1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 -- 172.21.15.60:0/3869918080 >> 172.21.15.60:0/3869918080 conn(0x7f000409a0f0 msgr2=0x7f0004067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 -- 172.21.15.60:0/3869918080 shutdown_connections 2023-10-08T16:14:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.472+0000 7f000c65a700 1 -- 172.21.15.60:0/3869918080 wait complete. 2023-10-08T16:14:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.473+0000 7f000c65a700 1 Processor -- start 2023-10-08T16:14:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.473+0000 7f000c65a700 1 -- start start 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000c65a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00040b3570 0x7f000416aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000c65a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b4860 0x7f000409ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000c65a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 0x7f00040aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000c65a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000409bc70 con 0x7f00040b4c30 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000c65a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000409d630 con 0x7f00040b3570 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000c65a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000416af60 con 0x7f00040b4860 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000abf7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 0x7f00040aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000abf7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 0x7f00040aa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51234/0 (socket says 172.21.15.60:51234) 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.474+0000 7f000abf7700 1 -- 172.21.15.60:0/495785649 learned_addr learned my addr 172.21.15.60:0/495785649 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f0009bf5700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b4860 0x7f000409ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000a3f6700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00040b3570 0x7f000416aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000abf7700 1 -- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b4860 msgr2=0x7f000409ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000abf7700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b4860 0x7f000409ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000abf7700 1 -- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00040b3570 msgr2=0x7f000416aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000abf7700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00040b3570 0x7f000416aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000abf7700 1 -- 172.21.15.60:0/495785649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40094f0 con 0x7f00040b4c30 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000a3f6700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00040b3570 0x7f000416aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000abf7700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 0x7f00040aa0c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7efffc009e20 tx=0x7efffc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00cbc0 con 0x7f00040b4c30 2023-10-08T16:14:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00f040 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000409b050 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc014480 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.475+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000409b890 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.476+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000404c3c0 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.477+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efffc014830 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.477+0000 7efffa7fc700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.477+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7efffc084ee0 con 0x7f00040b4c30 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.477+0000 7f000a3f6700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.477+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7effe806eb10 con 0x7f00040b4c30 2023-10-08T16:14:22.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.478+0000 7f000a3f6700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0004158e00 tx=0x7f0000009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.483+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efffc052110 con 0x7f00040b4c30 2023-10-08T16:14:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.674+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00040b2070 con 0x7f00040b4c30 2023-10-08T16:14:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.675+0000 7efffa7fc700 1 -- 172.21.15.60:0/495785649 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+11 (secure 0 0 0) 0x7efffc018070 con 0x7f00040b4c30 2023-10-08T16:14:22.676 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:14:22.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 msgr2=0x7effe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0004158e00 tx=0x7f0000009040 comp rx=0 tx=0).stop 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 msgr2=0x7f00040aa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 0x7f00040aa0c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7efffc009e20 tx=0x7efffc00b040 comp rx=0 tx=0).stop 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 shutdown_connections 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7effe8066f30 0x7effe80693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00040b4c30 0x7f00040aa0c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00040b3570 0x7f000416aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 --2- 172.21.15.60:0/495785649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00040b4860 0x7f000409ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 >> 172.21.15.60:0/495785649 conn(0x7f000409a0f0 msgr2=0x7f000415b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 shutdown_connections 2023-10-08T16:14:22.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.677+0000 7f000c65a700 1 -- 172.21.15.60:0/495785649 wait complete. 2023-10-08T16:14:22.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.807+0000 7fddf4090700 1 Processor -- start 2023-10-08T16:14:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.808+0000 7fddf4090700 1 -- start start 2023-10-08T16:14:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.808+0000 7fddf4090700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddec0b0890 0x7fddec0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.808+0000 7fddf4090700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec067d70 0x7fddec159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.808+0000 7fddf4090700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0cb370 con 0x7fddec0cbd40 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.808+0000 7fddf4090700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec0b0c60 con 0x7fddec0b0890 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.808+0000 7fddf4090700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec06a1e0 con 0x7fddec067d70 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf1e2c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddec0b0890 0x7fddec0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf162b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fddec0cbd40 0x7fddec067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53958/0 (socket says 172.21.15.60:53958) 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf162b700 1 -- 172.21.15.60:0/1441335786 learned_addr learned my addr 172.21.15.60:0/1441335786 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf262d700 1 --2- 172.21.15.60:0/1441335786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec067d70 0x7fddec159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf1e2c700 1 -- 172.21.15.60:0/1441335786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec067d70 msgr2=0x7fddec159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf1e2c700 1 --2- 172.21.15.60:0/1441335786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec067d70 0x7fddec159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf1e2c700 1 -- 172.21.15.60:0/1441335786 >> v1:172.21.15.60:6789/0 conn(0x7fddec0cbd40 legacy=0x7fddec067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf0e2a700 1 -- 172.21.15.60:0/1441335786 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273572707 0 0) 0x7fddec0cb370 con 0x7fddec0cbd40 2023-10-08T16:14:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf1e2c700 1 -- 172.21.15.60:0/1441335786 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec06cb80 con 0x7fddec0b0890 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf1e2c700 1 --2- 172.21.15.60:0/1441335786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0b0890 0x7fddec0cb800 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e60 tx=0x7fdddc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cf700f8a50a6c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf0e2a700 1 -- 172.21.15.60:0/1441335786 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00e070 con 0x7fddec0b0890 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf0e2a700 1 -- 172.21.15.60:0/1441335786 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc00bb60 con 0x7fddec0b0890 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.809+0000 7fddf0e2a700 1 -- 172.21.15.60:0/1441335786 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc012430 con 0x7fddec0b0890 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 -- 172.21.15.60:0/1441335786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0b0890 msgr2=0x7fddec0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 --2- 172.21.15.60:0/1441335786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0b0890 0x7fddec0cb800 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e60 tx=0x7fdddc009780 comp rx=0 tx=0).stop 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 -- 172.21.15.60:0/1441335786 shutdown_connections 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 --2- 172.21.15.60:0/1441335786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec067d70 0x7fddec159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 --2- 172.21.15.60:0/1441335786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0b0890 0x7fddec0cb800 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 -- 172.21.15.60:0/1441335786 >> 172.21.15.60:0/1441335786 conn(0x7fddec06fe50 msgr2=0x7fddec069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 -- 172.21.15.60:0/1441335786 shutdown_connections 2023-10-08T16:14:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.810+0000 7fddf4090700 1 -- 172.21.15.60:0/1441335786 wait complete. 2023-10-08T16:14:22.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.811+0000 7fddf4090700 1 Processor -- start 2023-10-08T16:14:22.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.811+0000 7fddf4090700 1 -- start start 2023-10-08T16:14:22.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf4090700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec067d70 0x7fddec15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf4090700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0b0890 0x7fddec0ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf4090700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 0x7fddec0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf4090700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0b4360 con 0x7fddec0cbd40 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf4090700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0c8330 con 0x7fddec067d70 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf4090700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0c7720 con 0x7fddec0b0890 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 0x7fddec0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 0x7fddec0acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51248/0 (socket says 172.21.15.60:51248) 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 -- 172.21.15.60:0/367893074 learned_addr learned my addr 172.21.15.60:0/367893074 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf1e2c700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec067d70 0x7fddec15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf162b700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0b0890 0x7fddec0ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 -- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0b0890 msgr2=0x7fddec0ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0b0890 0x7fddec0ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 -- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec067d70 msgr2=0x7fddec15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:22.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec067d70 0x7fddec15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 -- 172.21.15.60:0/367893074 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009a20 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.812+0000 7fddf262d700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 0x7fddec0acd30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdde400e8d0 tx=0x7fdde40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.813+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4013680 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.813+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde40137e0 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.813+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec0c7a00 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.813+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4013ba0 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.813+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec0c7fc0 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.814+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec04c3c0 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.814+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdde40123d0 con 0x7fddec0cbd40 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.815+0000 7fdde9ffb700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddd8066f30 0x7fddd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.815+0000 7fddf1e2c700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddd8066f30 0x7fddd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.815+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdde40849f0 con 0x7fddec0cbd40 2023-10-08T16:14:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.815+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fddd806eb10 con 0x7fddec0cbd40 2023-10-08T16:14:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.815+0000 7fddf1e2c700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddd8066f30 0x7fddd80693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0097c0 tx=0x7fdddc019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:22.819+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdde4017060 con 0x7fddec0cbd40 2023-10-08T16:14:23.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.058+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddec06cdc0 con 0x7fddec0cbd40 2023-10-08T16:14:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.058+0000 7fdde9ffb700 1 -- 172.21.15.60:0/367893074 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fdde4021030 con 0x7fddec0cbd40 2023-10-08T16:14:23.060 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:23.060 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:14:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.060+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddd8066f30 msgr2=0x7fddd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddd8066f30 0x7fddd80693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0097c0 tx=0x7fdddc019000 comp rx=0 tx=0).stop 2023-10-08T16:14:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 msgr2=0x7fddec0acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 0x7fddec0acd30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdde400e8d0 tx=0x7fdde40091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 shutdown_connections 2023-10-08T16:14:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddd8066f30 0x7fddd80693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddec0cbd40 0x7fddec0acd30 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddec067d70 0x7fddec15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 --2- 172.21.15.60:0/367893074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddec0b0890 0x7fddec0ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 >> 172.21.15.60:0/367893074 conn(0x7fddec06fe50 msgr2=0x7fddec15c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 shutdown_connections 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.061+0000 7fddf4090700 1 -- 172.21.15.60:0/367893074 wait complete. 2023-10-08T16:14:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:14:23.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.192+0000 7fddd93e9700 1 Processor -- start 2023-10-08T16:14:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.192+0000 7fddd93e9700 1 -- start start 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd93e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddd4155710 0x7fddd4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd93e9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd4155ae0 0x7fddd406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd93e9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4159370 con 0x7fddd406d610 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd93e9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40ce8f0 con 0x7fddd4155710 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd93e9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40ce330 con 0x7fddd4155ae0 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddd4155710 0x7fddd4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd27fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fddd406d610 0x7fddd40cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53960/0 (socket says 172.21.15.60:53960) 2023-10-08T16:14:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd27fc700 1 -- 172.21.15.60:0/3444989980 learned_addr learned my addr 172.21.15.60:0/3444989980 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd37fe700 1 --2- 172.21.15.60:0/3444989980 >> v2:172.21.15.144:3300/0 conn(0x7fddd4155ae0 0x7fddd406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd2ffd700 1 -- 172.21.15.60:0/3444989980 >> v2:172.21.15.144:3300/0 conn(0x7fddd4155ae0 msgr2=0x7fddd406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd2ffd700 1 --2- 172.21.15.60:0/3444989980 >> v2:172.21.15.144:3300/0 conn(0x7fddd4155ae0 0x7fddd406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd2ffd700 1 -- 172.21.15.60:0/3444989980 >> v1:172.21.15.60:6789/0 conn(0x7fddd406d610 legacy=0x7fddd40cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd2ffd700 1 -- 172.21.15.60:0/3444989980 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40ce610 con 0x7fddd4155710 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.193+0000 7fddd1ffb700 1 -- 172.21.15.60:0/3444989980 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771814477 0 0) 0x7fddd4159370 con 0x7fddd406d610 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd2ffd700 1 --2- 172.21.15.60:0/3444989980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4155710 0x7fddd4158e30 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fddd40cfcf0 tx=0x7fddcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4e292819ab0fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd1ffb700 1 -- 172.21.15.60:0/3444989980 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011630 con 0x7fddd4155710 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd1ffb700 1 -- 172.21.15.60:0/3444989980 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc011790 con 0x7fddd4155710 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd1ffb700 1 -- 172.21.15.60:0/3444989980 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011b30 con 0x7fddd4155710 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 -- 172.21.15.60:0/3444989980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4155710 msgr2=0x7fddd4158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 --2- 172.21.15.60:0/3444989980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4155710 0x7fddd4158e30 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fddd40cfcf0 tx=0x7fddcc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 -- 172.21.15.60:0/3444989980 shutdown_connections 2023-10-08T16:14:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 --2- 172.21.15.60:0/3444989980 >> v2:172.21.15.144:3300/0 conn(0x7fddd4155ae0 0x7fddd406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 --2- 172.21.15.60:0/3444989980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4155710 0x7fddd4158e30 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 -- 172.21.15.60:0/3444989980 >> 172.21.15.60:0/3444989980 conn(0x7fddd4069870 msgr2=0x7fddd4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 -- 172.21.15.60:0/3444989980 shutdown_connections 2023-10-08T16:14:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.194+0000 7fddd93e9700 1 -- 172.21.15.60:0/3444989980 wait complete. 2023-10-08T16:14:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 Processor -- start 2023-10-08T16:14:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 -- start start 2023-10-08T16:14:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 0x7fddd4148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd4155710 0x7fddd40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd4155ae0 0x7fddd40c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40c8cf0 con 0x7fddd406d610 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4148d90 con 0x7fddd4155ae0 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.196+0000 7fddd93e9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40c8730 con 0x7fddd4155710 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 0x7fddd4148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 0x7fddd4148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51272/0 (socket says 172.21.15.60:51272) 2023-10-08T16:14:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 -- 172.21.15.60:0/1662452531 learned_addr learned my addr 172.21.15.60:0/1662452531 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd27fc700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd4155710 0x7fddd40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd37fe700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd4155ae0 0x7fddd40c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 -- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd4155710 msgr2=0x7fddd40c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd4155710 0x7fddd40c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 -- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd4155ae0 msgr2=0x7fddd40c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd4155ae0 0x7fddd40c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 -- 172.21.15.60:0/1662452531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009420 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd37fe700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd4155ae0 0x7fddd40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd2ffd700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 0x7fddd4148130 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fddd4159500 tx=0x7fddcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011900 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc011a60 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40c8a10 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc025640 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.197+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40b1d00 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.198+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd406e8c0 con 0x7fddd406d610 2023-10-08T16:14:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.199+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddcc025a70 con 0x7fddd406d610 2023-10-08T16:14:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.199+0000 7fddcaffd700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddb4066f30 0x7fddb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.199+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fddcc085cb0 con 0x7fddd406d610 2023-10-08T16:14:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.199+0000 7fddd27fc700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddb4066f30 0x7fddb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.199+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fddb406eb10 con 0x7fddd406d610 2023-10-08T16:14:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.200+0000 7fddd27fc700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddb4066f30 0x7fddb40693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b1720 tx=0x7fddbc007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.203+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddcc015060 con 0x7fddd406d610 2023-10-08T16:14:23.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.395+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddd404bb80 con 0x7fddd406d610 2023-10-08T16:14:23.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.396+0000 7fddcaffd700 1 -- 172.21.15.60:0/1662452531 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15488 (secure 0 0 0) 0x7fddcc052ee0 con 0x7fddd406d610 2023-10-08T16:14:23.398 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:23.398 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":152,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:13:43.378567+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:12:04.269763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T16:12:04.831880+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.12","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddb4066f30 msgr2=0x7fddb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddb4066f30 0x7fddb40693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b1720 tx=0x7fddbc007f50 comp rx=0 tx=0).stop 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 msgr2=0x7fddd4148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 0x7fddd4148130 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fddd4159500 tx=0x7fddcc017000 comp rx=0 tx=0).stop 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 shutdown_connections 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fddb4066f30 0x7fddb40693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd4155ae0 0x7fddd40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd406d610 0x7fddd4148130 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 --2- 172.21.15.60:0/1662452531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd4155710 0x7fddd40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 >> 172.21.15.60:0/1662452531 conn(0x7fddd4069870 msgr2=0x7fddd40cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:23.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 shutdown_connections 2023-10-08T16:14:23.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.398+0000 7fddd93e9700 1 -- 172.21.15.60:0/1662452531 wait complete. 2023-10-08T16:14:23.412 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:14:23.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.530+0000 7fcd789e6700 1 Processor -- start 2023-10-08T16:14:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.530+0000 7fcd789e6700 1 -- start start 2023-10-08T16:14:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd789e6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd74159e10 0x7fcd740b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd789e6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7415db80 con 0x7fcd740cde50 2023-10-08T16:14:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd789e6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7415de60 con 0x7fcd7415a1e0 2023-10-08T16:14:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd789e6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7415e800 con 0x7fcd74159e10 2023-10-08T16:14:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd72d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcd740cde50 0x7fcd740cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53970/0 (socket says 172.21.15.60:53970) 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd72d9d700 1 -- 172.21.15.60:0/2562097423 learned_addr learned my addr 172.21.15.60:0/2562097423 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd7259c700 1 --2- 172.21.15.60:0/2562097423 >> v2:172.21.15.144:3300/0 conn(0x7fcd74159e10 0x7fcd740b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650332821 0 0) 0x7fcd7415db80 con 0x7fcd740cde50 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c003570 con 0x7fcd740cde50 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216117931 0 0) 0x7fcd7415de60 con 0x7fcd7415a1e0 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.531+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd7415db80 con 0x7fcd7415a1e0 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2107735344 0 0) 0x7fcd5c003570 con 0x7fcd740cde50 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7259c700 1 -- 172.21.15.60:0/2562097423 >> v1:172.21.15.144:6789/0 conn(0x7fcd7415a1e0 legacy=0x7fcd740cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7259c700 1 -- 172.21.15.60:0/2562097423 >> v1:172.21.15.60:6789/0 conn(0x7fcd740cde50 legacy=0x7fcd740cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7259c700 1 -- 172.21.15.60:0/2562097423 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7415e140 con 0x7fcd74159e10 2023-10-08T16:14:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7259c700 1 --2- 172.21.15.60:0/2562097423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd74159e10 0x7fcd740b2d20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009e60 tx=0x7fcd6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b10c885e9ae4a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00e070 con 0x7fcd74159e10 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00b7a0 con 0x7fcd74159e10 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd7159a700 1 -- 172.21.15.60:0/2562097423 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64001470 con 0x7fcd74159e10 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd789e6700 1 -- 172.21.15.60:0/2562097423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd74159e10 msgr2=0x7fcd740b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd789e6700 1 --2- 172.21.15.60:0/2562097423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd74159e10 0x7fcd740b2d20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009e60 tx=0x7fcd6c009780 comp rx=0 tx=0).stop 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd789e6700 1 -- 172.21.15.60:0/2562097423 shutdown_connections 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd789e6700 1 --2- 172.21.15.60:0/2562097423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd74159e10 0x7fcd740b2d20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.532+0000 7fcd789e6700 1 -- 172.21.15.60:0/2562097423 >> 172.21.15.60:0/2562097423 conn(0x7fcd74067660 msgr2=0x7fcd74067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.533+0000 7fcd789e6700 1 -- 172.21.15.60:0/2562097423 shutdown_connections 2023-10-08T16:14:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.533+0000 7fcd789e6700 1 -- 172.21.15.60:0/2562097423 wait complete. 2023-10-08T16:14:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 Processor -- start 2023-10-08T16:14:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 -- start start 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd740cde50 0x7fcd74150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 0x7fcd7415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7415a1e0 0x7fcd7415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740c5110 con 0x7fcd74159e10 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740d1720 con 0x7fcd740cde50 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd789e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740caf50 con 0x7fcd7415a1e0 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.534+0000 7fcd71d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 0x7fcd7415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 0x7fcd7415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51274/0 (socket says 172.21.15.60:51274) 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 -- 172.21.15.60:0/1050808411 learned_addr learned my addr 172.21.15.60:0/1050808411 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd7259c700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd740cde50 0x7fcd74150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd72d9d700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7415a1e0 0x7fcd7415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 -- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7415a1e0 msgr2=0x7fcd7415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7415a1e0 0x7fcd7415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 -- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd740cde50 msgr2=0x7fcd74150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd740cde50 0x7fcd74150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 -- 172.21.15.60:0/1050808411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009a20 con 0x7fcd74159e10 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd7259c700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd740cde50 0x7fcd74150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd72d9d700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7415a1e0 0x7fcd7415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd71d9b700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 0x7fcd7415c3c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800c5c0 tx=0x7fcd68007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68010510 con 0x7fcd74159e10 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68010690 con 0x7fcd74159e10 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd74151090 con 0x7fcd74159e10 2023-10-08T16:14:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68010a50 con 0x7fcd74159e10 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.535+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd740c55b0 con 0x7fcd74159e10 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.536+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7404c3c0 con 0x7fcd74159e10 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.537+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd6801b3b0 con 0x7fcd74159e10 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.537+0000 7fcd627fc700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd54066f30 0x7fcd540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.537+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcd68083b70 con 0x7fcd74159e10 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.537+0000 7fcd7259c700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd54066f30 0x7fcd540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.537+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fcd5406eb10 con 0x7fcd74159e10 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.537+0000 7fcd7259c700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd54066f30 0x7fcd540693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0099f0 tx=0x7fcd6c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.541+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd68017030 con 0x7fcd74159e10 2023-10-08T16:14:23.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.782+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd74151090 con 0x7fcd74159e10 2023-10-08T16:14:23.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.782+0000 7fcd627fc700 1 -- 172.21.15.60:0/1050808411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fcd74151090 con 0x7fcd74159e10 2023-10-08T16:14:23.784 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:23.784 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd54066f30 msgr2=0x7fcd540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd54066f30 0x7fcd540693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0099f0 tx=0x7fcd6c017000 comp rx=0 tx=0).stop 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 msgr2=0x7fcd7415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 0x7fcd7415c3c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800c5c0 tx=0x7fcd68007de0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 shutdown_connections 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcd54066f30 0x7fcd540693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7415a1e0 0x7fcd7415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd740cde50 0x7fcd74150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 --2- 172.21.15.60:0/1050808411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd74159e10 0x7fcd7415c3c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 >> 172.21.15.60:0/1050808411 conn(0x7fcd74067660 msgr2=0x7fcd7415a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:23.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 shutdown_connections 2023-10-08T16:14:23.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.784+0000 7fcd789e6700 1 -- 172.21.15.60:0/1050808411 wait complete. 2023-10-08T16:14:23.787 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:14:23.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.914+0000 7fe681272700 1 Processor -- start 2023-10-08T16:14:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.914+0000 7fe681272700 1 -- start start 2023-10-08T16:14:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe681272700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe67c067d70 0x7fe67c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe681272700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c0cb370 con 0x7fe67c06c630 2023-10-08T16:14:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe681272700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c0b0c60 con 0x7fe67c0b0890 2023-10-08T16:14:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe681272700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c06a1e0 con 0x7fe67c067d70 2023-10-08T16:14:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe67a7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe67c06c630 0x7fe67c067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53982/0 (socket says 172.21.15.60:53982) 2023-10-08T16:14:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe67a7fc700 1 -- 172.21.15.60:0/73640808 learned_addr learned my addr 172.21.15.60:0/73640808 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe67b7fe700 1 --2- 172.21.15.60:0/73640808 >> v2:172.21.15.144:3300/0 conn(0x7fe67c067d70 0x7fe67c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.915+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665501556 0 0) 0x7fe67c0cb370 con 0x7fe67c06c630 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe668003570 con 0x7fe67c06c630 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3614687978 0 0) 0x7fe668003570 con 0x7fe67c06c630 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 >> v2:172.21.15.144:3300/0 conn(0x7fe67c067d70 msgr2=0x7fe67c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 --2- 172.21.15.60:0/73640808 >> v2:172.21.15.144:3300/0 conn(0x7fe67c067d70 0x7fe67c15a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 >> v1:172.21.15.144:6789/0 conn(0x7fe67c0b0890 legacy=0x7fe67c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c06cb80 con 0x7fe67c06c630 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fe664001470 con 0x7fe67c06c630 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 >> v1:172.21.15.60:6789/0 conn(0x7fe67c06c630 legacy=0x7fe67c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe668003a60 0x7fe668003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668004810 0x7fe668004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6680051c0 0x7fe66800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c06a1e0 con 0x7fe668003a60 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66800c0d0 con 0x7fe6680051c0 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66800c290 con 0x7fe668004810 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe668003a60 0x7fe668003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67a7fc700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668004810 0x7fe668004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67b7fe700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6680051c0 0x7fe66800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 -- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668004810 msgr2=0x7fe668004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668004810 0x7fe668004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 -- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6680051c0 msgr2=0x7fe66800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6680051c0 0x7fe66800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 -- 172.21.15.60:0/73640808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668003570 con 0x7fe668003a60 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67b7fe700 1 -- 172.21.15.60:0/73640808 reap_dead start 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.916+0000 7fe67affd700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe668003a60 0x7fe668003e70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe6740018b0 tx=0x7fe674007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3bae8e49968000 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674012420 con 0x7fe668003a60 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6740125a0 con 0x7fe668003a60 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe679ffb700 1 -- 172.21.15.60:0/73640808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674012960 con 0x7fe668003a60 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 -- 172.21.15.60:0/73640808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe668003a60 msgr2=0x7fe668003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe668003a60 0x7fe668003e70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe6740018b0 tx=0x7fe674007d30 comp rx=0 tx=0).stop 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 -- 172.21.15.60:0/73640808 shutdown_connections 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 --2- 172.21.15.60:0/73640808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe668003a60 0x7fe668003e70 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 -- 172.21.15.60:0/73640808 >> 172.21.15.60:0/73640808 conn(0x7fe67c06fe50 msgr2=0x7fe67c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 -- 172.21.15.60:0/73640808 shutdown_connections 2023-10-08T16:14:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.917+0000 7fe681272700 1 -- 172.21.15.60:0/73640808 wait complete. 2023-10-08T16:14:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.918+0000 7fe681272700 1 Processor -- start 2023-10-08T16:14:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.918+0000 7fe681272700 1 -- start start 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe681272700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668003a60 0x7fe67c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe681272700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 0x7fe67c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe681272700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c0c4f10 0x7fe67c068170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe681272700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0b20c0 con 0x7fe67c15a430 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe681272700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0c53b0 con 0x7fe67c0c4f10 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe681272700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0b1a70 con 0x7fe668003a60 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe67a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 0x7fe67c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe67a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 0x7fe67c0c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51294/0 (socket says 172.21.15.60:51294) 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe67a7fc700 1 -- 172.21.15.60:0/3602438128 learned_addr learned my addr 172.21.15.60:0/3602438128 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe67affd700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668003a60 0x7fe67c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.919+0000 7fe67b7fe700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c0c4f10 0x7fe67c068170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe67a7fc700 1 -- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668003a60 msgr2=0x7fe67c0b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe67a7fc700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668003a60 0x7fe67c0b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe67a7fc700 1 -- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c0c4f10 msgr2=0x7fe67c068170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe67a7fc700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c0c4f10 0x7fe67c068170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe67a7fc700 1 -- 172.21.15.60:0/3602438128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c0b1d50 con 0x7fe67c15a430 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe67a7fc700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 0x7fe67c0c49d0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe66400eb90 tx=0x7fe67c0cb2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664005e70 con 0x7fe67c15a430 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400c760 con 0x7fe67c15a430 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67c15a8a0 con 0x7fe67c15a430 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400cb20 con 0x7fe67c15a430 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.920+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c0686b0 con 0x7fe67c15a430 2023-10-08T16:14:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.921+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67c0b18d0 con 0x7fe67c15a430 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.921+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe66401d460 con 0x7fe67c15a430 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.922+0000 7fe672ffd700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe65c066f30 0x7fe65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.922+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe6640844c0 con 0x7fe67c15a430 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.922+0000 7fe67affd700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe65c066f30 0x7fe65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.922+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7fe65c06eb10 con 0x7fe67c15a430 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.922+0000 7fe67affd700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe65c066f30 0x7fe65c0693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe67c16da40 tx=0x7fe674015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:23.926+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe67c0b18d0 con 0x7fe67c15a430 2023-10-08T16:14:24.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.163+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe67c0b18d0 con 0x7fe67c15a430 2023-10-08T16:14:24.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.164+0000 7fe672ffd700 1 -- 172.21.15.60:0/3602438128 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe67c0b18d0 con 0x7fe67c15a430 2023-10-08T16:14:24.165 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:24.165 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:12:05.858523+0000","modified":"2023-10-08T16:12:09.494819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7509":{"gid":7509,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/2817981705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2817981705},{"type":"v1","addr":"172.21.15.60:6837","nonce":2817981705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T16:14:24.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe65c066f30 msgr2=0x7fe65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe65c066f30 0x7fe65c0693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe67c16da40 tx=0x7fe674015000 comp rx=0 tx=0).stop 2023-10-08T16:14:24.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 msgr2=0x7fe67c0c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 0x7fe67c0c49d0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe66400eb90 tx=0x7fe67c0cb2e0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 shutdown_connections 2023-10-08T16:14:24.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe65c066f30 0x7fe65c0693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe668003a60 0x7fe67c0b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c0c4f10 0x7fe67c068170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 --2- 172.21.15.60:0/3602438128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe67c15a430 0x7fe67c0c49d0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 >> 172.21.15.60:0/3602438128 conn(0x7fe67c06fe50 msgr2=0x7fe67c067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 shutdown_connections 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.166+0000 7fe681272700 1 -- 172.21.15.60:0/3602438128 wait complete. 2023-10-08T16:14:24.168 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2023-10-08T16:14:24.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.296+0000 7ff8b49c6700 1 Processor -- start 2023-10-08T16:14:24.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.296+0000 7ff8b49c6700 1 -- start start 2023-10-08T16:14:24.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8b49c6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff8b0157870 0x7ff8b015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8b49c6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8b015a620 0x7ff8b015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8b49c6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b015cbb0 con 0x7ff8b015d580 2023-10-08T16:14:24.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8b49c6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b015bfa0 con 0x7ff8b0157870 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8b49c6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b015c280 con 0x7ff8b015a620 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8ae59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff8b0157870 0x7ff8b015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.297+0000 7ff8aed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff8b015d580 0x7ff8b0158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53990/0 (socket says 172.21.15.60:53990) 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8aed9d700 1 -- 172.21.15.60:0/3874971250 learned_addr learned my addr 172.21.15.60:0/3874971250 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8add9b700 1 --2- 172.21.15.60:0/3874971250 >> v2:172.21.15.144:3300/0 conn(0x7ff8b015a620 0x7ff8b015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ae59c700 1 -- 172.21.15.60:0/3874971250 >> v2:172.21.15.144:3300/0 conn(0x7ff8b015a620 msgr2=0x7ff8b015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:24.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ae59c700 1 --2- 172.21.15.60:0/3874971250 >> v2:172.21.15.144:3300/0 conn(0x7ff8b015a620 0x7ff8b015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ae59c700 1 -- 172.21.15.60:0/3874971250 >> v1:172.21.15.60:6789/0 conn(0x7ff8b015d580 legacy=0x7ff8b0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ad59a700 1 -- 172.21.15.60:0/3874971250 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096720431 0 0) 0x7ff8b015cbb0 con 0x7ff8b015d580 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ae59c700 1 -- 172.21.15.60:0/3874971250 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b015c560 con 0x7ff8b0157870 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8add9b700 1 --2- 172.21.15.60:0/3874971250 >> v2:172.21.15.144:3300/0 conn(0x7ff8b015a620 0x7ff8b015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ae59c700 1 --2- 172.21.15.60:0/3874971250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b0157870 0x7ff8b015b6a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7ff8b015cb20 tx=0x7ff8a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a3eb86f8e8d2e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ad59a700 1 -- 172.21.15.60:0/3874971250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800b6b0 con 0x7ff8b0157870 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ad59a700 1 -- 172.21.15.60:0/3874971250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a800b810 con 0x7ff8b0157870 2023-10-08T16:14:24.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.298+0000 7ff8ad59a700 1 -- 172.21.15.60:0/3874971250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800bbb0 con 0x7ff8b0157870 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3874971250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b0157870 msgr2=0x7ff8b015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3874971250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b0157870 0x7ff8b015b6a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7ff8b015cb20 tx=0x7ff8a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3874971250 shutdown_connections 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3874971250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b0157870 0x7ff8b015b6a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3874971250 >> v2:172.21.15.144:3300/0 conn(0x7ff8b015a620 0x7ff8b015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3874971250 >> 172.21.15.60:0/3874971250 conn(0x7ff8b0068ce0 msgr2=0x7ff8b00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3874971250 shutdown_connections 2023-10-08T16:14:24.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.299+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3874971250 wait complete. 2023-10-08T16:14:24.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.300+0000 7ff8b49c6700 1 Processor -- start 2023-10-08T16:14:24.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.300+0000 7ff8b49c6700 1 -- start start 2023-10-08T16:14:24.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b0157870 0x7ff8b0153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b015a620 0x7ff8b00d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 0x7ff8b0154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00b1600 con 0x7ff8b015d580 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00b09f0 con 0x7ff8b015a620 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00b0cd0 con 0x7ff8b0157870 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 0x7ff8b0154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 0x7ff8b0154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51298/0 (socket says 172.21.15.60:51298) 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 -- 172.21.15.60:0/3309448627 learned_addr learned my addr 172.21.15.60:0/3309448627 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8ae59c700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b0157870 0x7ff8b0153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8add9b700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b015a620 0x7ff8b00d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 -- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b0157870 msgr2=0x7ff8b0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b0157870 0x7ff8b0153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 -- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b015a620 msgr2=0x7ff8b00d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b015a620 0x7ff8b00d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 -- 172.21.15.60:0/3309448627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009420 con 0x7ff8b015d580 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8add9b700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b015a620 0x7ff8b00d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:24.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8aed9d700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 0x7ff8b0154ab0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000cbc0 tx=0x7ff8a0001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000a940 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a000aaa0 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b00b0fb0 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000ae60 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.301+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b00b0610 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.302+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b00b17b0 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.303+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8a0007300 con 0x7ff8b015d580 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.303+0000 7ff8a67fc700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.303+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff8a0084900 con 0x7ff8b015d580 2023-10-08T16:14:24.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.303+0000 7ff8ae59c700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.303+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7ff89006eb10 con 0x7ff8b015d580 2023-10-08T16:14:24.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.304+0000 7ff8ae59c700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80093f0 tx=0x7ff8a8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:24.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.307+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8b00b17b0 con 0x7ff8b015d580 2023-10-08T16:14:24.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.503+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8b004c3c0 con 0x7ff8b015d580 2023-10-08T16:14:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.504+0000 7ff8a67fc700 1 -- 172.21.15.60:0/3309448627 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+15488 (secure 0 0 0) 0x7ff8a0051bb0 con 0x7ff8b015d580 2023-10-08T16:14:24.505 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:24.506 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":152,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:13:43.378567+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:12:04.269763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T16:12:04.831880+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.12","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff890066f30 msgr2=0x7ff8900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80093f0 tx=0x7ff8a8017000 comp rx=0 tx=0).stop 2023-10-08T16:14:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 msgr2=0x7ff8b0154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 0x7ff8b0154ab0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000cbc0 tx=0x7ff8a0001980 comp rx=0 tx=0).stop 2023-10-08T16:14:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 shutdown_connections 2023-10-08T16:14:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8b0157870 0x7ff8b0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b015d580 0x7ff8b0154ab0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 --2- 172.21.15.60:0/3309448627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8b015a620 0x7ff8b00d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 >> 172.21.15.60:0/3309448627 conn(0x7ff8b0068ce0 msgr2=0x7ff8b01568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 shutdown_connections 2023-10-08T16:14:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.506+0000 7ff8b49c6700 1 -- 172.21.15.60:0/3309448627 wait complete. 2023-10-08T16:14:24.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:14:24.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.639+0000 7ff5ceb29700 1 Processor -- start 2023-10-08T16:14:24.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.639+0000 7ff5ceb29700 1 -- start start 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5ceb29700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5c80d15c0 0x7ff5c80cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5ceb29700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5c815e600 0x7ff5c80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5ceb29700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c815d8d0 con 0x7ff5c80d0160 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5ceb29700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c815e170 con 0x7ff5c80d15c0 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5ceb29700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c80afe60 con 0x7ff5c815e600 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5cd326700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5c80d15c0 0x7ff5c80cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5cdb27700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff5c80d0160 0x7ff5c80af750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53998/0 (socket says 172.21.15.60:53998) 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5cdb27700 1 -- 172.21.15.60:0/3354275884 learned_addr learned my addr 172.21.15.60:0/3354275884 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5ce328700 1 --2- 172.21.15.60:0/3354275884 >> v2:172.21.15.144:3300/0 conn(0x7ff5c815e600 0x7ff5c80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5cd326700 1 -- 172.21.15.60:0/3354275884 >> v2:172.21.15.144:3300/0 conn(0x7ff5c815e600 msgr2=0x7ff5c80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5cd326700 1 --2- 172.21.15.60:0/3354275884 >> v2:172.21.15.144:3300/0 conn(0x7ff5c815e600 0x7ff5c80cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.640+0000 7ff5cd326700 1 -- 172.21.15.60:0/3354275884 >> v1:172.21.15.60:6789/0 conn(0x7ff5c80d0160 legacy=0x7ff5c80af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5cd326700 1 -- 172.21.15.60:0/3354275884 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80b00c0 con 0x7ff5c80d15c0 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ccb25700 1 -- 172.21.15.60:0/3354275884 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875978967 0 0) 0x7ff5c815d8d0 con 0x7ff5c80d0160 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ce328700 1 --2- 172.21.15.60:0/3354275884 >> v2:172.21.15.144:3300/0 conn(0x7ff5c815e600 0x7ff5c80cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5cd326700 1 --2- 172.21.15.60:0/3354275884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d15c0 0x7ff5c80cba00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80ce710 tx=0x7ff5bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2be8b670c871eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ccb25700 1 -- 172.21.15.60:0/3354275884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00b6b0 con 0x7ff5c80d15c0 2023-10-08T16:14:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ccb25700 1 -- 172.21.15.60:0/3354275884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00b810 con 0x7ff5c80d15c0 2023-10-08T16:14:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ccb25700 1 -- 172.21.15.60:0/3354275884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00bbb0 con 0x7ff5c80d15c0 2023-10-08T16:14:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3354275884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d15c0 msgr2=0x7ff5c80cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3354275884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d15c0 0x7ff5c80cba00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80ce710 tx=0x7ff5bc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3354275884 shutdown_connections 2023-10-08T16:14:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3354275884 >> v2:172.21.15.144:3300/0 conn(0x7ff5c815e600 0x7ff5c80cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3354275884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d15c0 0x7ff5c80cba00 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3354275884 >> 172.21.15.60:0/3354275884 conn(0x7ff5c80695d0 msgr2=0x7ff5c80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3354275884 shutdown_connections 2023-10-08T16:14:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.641+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3354275884 wait complete. 2023-10-08T16:14:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.642+0000 7ff5ceb29700 1 Processor -- start 2023-10-08T16:14:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 -- start start 2023-10-08T16:14:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 0x7ff5c8153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5c80d15c0 0x7ff5c8153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5c815e600 0x7ff5c816a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80b3ba0 con 0x7ff5c80d0160 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8154480 con 0x7ff5c815e600 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5ceb29700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8154760 con 0x7ff5c80d15c0 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5cdb27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 0x7ff5c8153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5cdb27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 0x7ff5c8153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51310/0 (socket says 172.21.15.60:51310) 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.643+0000 7ff5cdb27700 1 -- 172.21.15.60:0/3153449700 learned_addr learned my addr 172.21.15.60:0/3153449700 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5ce328700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5c815e600 0x7ff5c816a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cd326700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5c80d15c0 0x7ff5c8153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cdb27700 1 -- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5c80d15c0 msgr2=0x7ff5c8153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cdb27700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5c80d15c0 0x7ff5c8153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cdb27700 1 -- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5c815e600 msgr2=0x7ff5c816a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cdb27700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5c815e600 0x7ff5c816a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cdb27700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc009420 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cd326700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5c80d15c0 0x7ff5c8153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5cdb27700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 0x7ff5c8153690 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000cc70 tx=0x7ff5c0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000a940 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000aaa0 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c8154a40 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000ae20 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.644+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c80cae90 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.645+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c804bb80 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.646+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5c0007300 con 0x7ff5c80d0160 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.646+0000 7ff5c5ffb700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5b4066f30 0x7ff5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.646+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff5c00849d0 con 0x7ff5c80d0160 2023-10-08T16:14:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.646+0000 7ff5cd326700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5b4066f30 0x7ff5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.646+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7ff5b406eb10 con 0x7ff5c80d0160 2023-10-08T16:14:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.647+0000 7ff5cd326700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5b4066f30 0x7ff5b40693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80ce710 tx=0x7ff5bc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.651+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5c0051be0 con 0x7ff5c80d0160 2023-10-08T16:14:24.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.888+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff5c80ce4f0 con 0x7ff5c80d0160 2023-10-08T16:14:24.890 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:14:24.889+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:14:24.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.890+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(153..153 src has 1..153) v4 ==== 366+0+0 (secure 0 0 0) 0x7ff5c00558a0 con 0x7ff5c80d0160 2023-10-08T16:14:24.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.890+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7ff5b406f460 con 0x7ff5c80d0160 2023-10-08T16:14:24.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.893+0000 7ff5c5ffb700 1 -- 172.21.15.60:0/3153449700 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff5c0055200 con 0x7ff5c80d0160 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.895+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5b4066f30 msgr2=0x7ff5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.895+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5b4066f30 0x7ff5b40693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80ce710 tx=0x7ff5bc017000 comp rx=0 tx=0).stop 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.895+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 msgr2=0x7ff5c8153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.895+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 0x7ff5c8153690 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000cc70 tx=0x7ff5c0001a30 comp rx=0 tx=0).stop 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 shutdown_connections 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff5b4066f30 0x7ff5b40693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5c815e600 0x7ff5c816a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c80d0160 0x7ff5c8153690 secure :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000cc70 tx=0x7ff5c0001a30 comp rx=0 tx=0).stop 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 --2- 172.21.15.60:0/3153449700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5c80d15c0 0x7ff5c8153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:24.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 >> 172.21.15.60:0/3153449700 conn(0x7ff5c80695d0 msgr2=0x7ff5c80cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:24.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 shutdown_connections 2023-10-08T16:14:24.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:24.896+0000 7ff5ceb29700 1 -- 172.21.15.60:0/3153449700 wait complete. 2023-10-08T16:14:24.898 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:14:24.898 INFO:tasks.ceph.mds.a.smithi060.stderr: -8978> 2023-10-08T16:12:10.769+0000 7f3fe9eea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:14:24.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:14:24.928 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:14:25.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.030+0000 7f451d655700 1 Processor -- start 2023-10-08T16:14:25.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.030+0000 7f451d655700 1 -- start start 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f451d655700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45180b6580 0x7f451806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f451d655700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451806ac90 con 0x7f451806a830 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f451d655700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45180b4d70 con 0x7f45180cce30 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f451d655700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451815b3b0 con 0x7f45180b6580 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f451ce54700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f451806a830 0x7f45180b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54004/0 (socket says 172.21.15.60:54004) 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f451ce54700 1 -- 172.21.15.60:0/866208621 learned_addr learned my addr 172.21.15.60:0/866208621 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f45177fe700 1 --2- 172.21.15.60:0/866208621 >> v2:172.21.15.144:3300/0 conn(0x7f45180b6580 0x7f451806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f4516ffd700 1 -- 172.21.15.60:0/866208621 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103637017 0 0) 0x7f4510001490 con 0x7f451806a830 2023-10-08T16:14:25.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.031+0000 7f4516ffd700 1 -- 172.21.15.60:0/866208621 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4500003570 con 0x7f451806a830 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f4516ffd700 1 -- 172.21.15.60:0/866208621 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333534369 0 0) 0x7f4500003570 con 0x7f451806a830 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f45177fe700 1 -- 172.21.15.60:0/866208621 >> v1:172.21.15.144:6789/0 conn(0x7f45180cce30 legacy=0x7f451815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f45177fe700 1 -- 172.21.15.60:0/866208621 >> v1:172.21.15.60:6789/0 conn(0x7f451806a830 legacy=0x7f45180b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f45177fe700 1 -- 172.21.15.60:0/866208621 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45180cd8d0 con 0x7f45180b6580 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f45177fe700 1 --2- 172.21.15.60:0/866208621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180b6580 0x7f451806a2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f45080098e0 tx=0x7f45080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cfdd24c04035c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f4516ffd700 1 -- 172.21.15.60:0/866208621 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510001980 con 0x7f45180b6580 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f4516ffd700 1 -- 172.21.15.60:0/866208621 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508011420 con 0x7f45180b6580 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f4516ffd700 1 -- 172.21.15.60:0/866208621 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080117c0 con 0x7f45180b6580 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f451d655700 1 -- 172.21.15.60:0/866208621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180b6580 msgr2=0x7f451806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.032+0000 7f451d655700 1 --2- 172.21.15.60:0/866208621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180b6580 0x7f451806a2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f45080098e0 tx=0x7f45080091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.033+0000 7f451d655700 1 -- 172.21.15.60:0/866208621 shutdown_connections 2023-10-08T16:14:25.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.033+0000 7f451d655700 1 --2- 172.21.15.60:0/866208621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180b6580 0x7f451806a2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.033+0000 7f451d655700 1 -- 172.21.15.60:0/866208621 >> 172.21.15.60:0/866208621 conn(0x7f4518068cb0 msgr2=0x7f45180690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:25.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.033+0000 7f451d655700 1 -- 172.21.15.60:0/866208621 shutdown_connections 2023-10-08T16:14:25.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.033+0000 7f451d655700 1 -- 172.21.15.60:0/866208621 wait complete. 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.034+0000 7f451d655700 1 Processor -- start 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.034+0000 7f451d655700 1 -- start start 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.034+0000 7f451d655700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 0x7f451814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.034+0000 7f451d655700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45180b6580 0x7f4518154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451d655700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180cce30 0x7f4518151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451d655700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45181512e0 con 0x7f451806a830 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451d655700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45181553c0 con 0x7f45180cce30 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451d655700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45181556a0 con 0x7f45180b6580 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 0x7f451814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 0x7f451814f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51326/0 (socket says 172.21.15.60:51326) 2023-10-08T16:14:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 -- 172.21.15.60:0/4014899299 learned_addr learned my addr 172.21.15.60:0/4014899299 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451ce54700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180cce30 0x7f4518151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f45177fe700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45180b6580 0x7f4518154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 -- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45180b6580 msgr2=0x7f4518154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45180b6580 0x7f4518154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 -- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180cce30 msgr2=0x7f4518151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180cce30 0x7f4518151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 -- 172.21.15.60:0/4014899299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508009420 con 0x7f451806a830 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f4517fff700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 0x7f451814f2f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c4e0 tx=0x7f450c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c011590 con 0x7f451806a830 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c011710 con 0x7f451806a830 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4518155980 con 0x7f451806a830 2023-10-08T16:14:25.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c011ad0 con 0x7f451806a830 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.035+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451814f830 con 0x7f451806a830 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.036+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4518151770 con 0x7f451806a830 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.037+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f450c01b3b0 con 0x7f451806a830 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.037+0000 7f44fffff700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.037+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f450c083a30 con 0x7f451806a830 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.037+0000 7f45177fe700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.037+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f450406ebb0 con 0x7f451806a830 2023-10-08T16:14:25.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.038+0000 7f45177fe700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f45080091e0 tx=0x7f4508016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:25.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.042+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f450c017070 con 0x7f451806a830 2023-10-08T16:14:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.277+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4518155bc0 con 0x7f451806a830 2023-10-08T16:14:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.893+0000 7f44fffff700 1 -- 172.21.15.60:0/4014899299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4518151770 con 0x7f451806a830 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4504066f30 msgr2=0x7f45040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f45080091e0 tx=0x7f4508016000 comp rx=0 tx=0).stop 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 msgr2=0x7f451814f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 0x7f451814f2f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c4e0 tx=0x7f450c00c7f0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 shutdown_connections 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45180cce30 0x7f4518151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f451806a830 0x7f451814f2f0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 --2- 172.21.15.60:0/4014899299 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45180b6580 0x7f4518154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.895+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 >> 172.21.15.60:0/4014899299 conn(0x7f4518068cb0 msgr2=0x7f45181581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.896+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 shutdown_connections 2023-10-08T16:14:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:25.896+0000 7f451d655700 1 -- 172.21.15.60:0/4014899299 wait complete. 2023-10-08T16:14:25.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:14:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.073+0000 7fee49ef7700 1 Processor -- start 2023-10-08T16:14:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.073+0000 7fee49ef7700 1 -- start start 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee49ef7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee44159e50 0x7fee440b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee49ef7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee440b3370 0x7fee440b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee49ef7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee440b0d60 con 0x7fee440b1730 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee49ef7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee440d15b0 con 0x7fee440b3370 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee49ef7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440d1890 con 0x7fee44159e50 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee440b3370 0x7fee440b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee440b3370 0x7fee440b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51342/0 (socket says 172.21.15.60:51342) 2023-10-08T16:14:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 -- 172.21.15.60:0/2537153245 learned_addr learned my addr 172.21.15.60:0/2537153245 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee437fe700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee44159e50 0x7fee440b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 -- 172.21.15.60:0/2537153245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee44159e50 msgr2=0x7fee440b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee44159e50 0x7fee440b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 -- 172.21.15.60:0/2537153245 >> v1:172.21.15.144:6789/0 conn(0x7fee440b1730 legacy=0x7fee44068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee42ffd700 1 -- 172.21.15.60:0/2537153245 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440b09f0 con 0x7fee440b3370 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.074+0000 7fee437fe700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee44159e50 0x7fee440b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee42ffd700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee440b11f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fee380099b0 tx=0x7fee38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a338b53f332655d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee427fc700 1 -- 172.21.15.60:0/2537153245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800b860 con 0x7fee440b3370 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee427fc700 1 -- 172.21.15.60:0/2537153245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3800b9c0 con 0x7fee440b3370 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee427fc700 1 -- 172.21.15.60:0/2537153245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800bd60 con 0x7fee440b3370 2023-10-08T16:14:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 -- 172.21.15.60:0/2537153245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 msgr2=0x7fee440b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee440b11f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fee380099b0 tx=0x7fee38009250 comp rx=0 tx=0).stop 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 -- 172.21.15.60:0/2537153245 shutdown_connections 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee44159e50 0x7fee440b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 --2- 172.21.15.60:0/2537153245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee440b11f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 -- 172.21.15.60:0/2537153245 >> 172.21.15.60:0/2537153245 conn(0x7fee44068130 msgr2=0x7fee440d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 -- 172.21.15.60:0/2537153245 shutdown_connections 2023-10-08T16:14:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.075+0000 7fee49ef7700 1 -- 172.21.15.60:0/2537153245 wait complete. 2023-10-08T16:14:26.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 Processor -- start 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 -- start start 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee440b1730 0x7fee4416afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee4416b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee44159e50 0x7fee440a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440a9740 con 0x7fee440b3370 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440a99c0 con 0x7fee44159e50 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee49ef7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440a9ca0 con 0x7fee440b1730 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee42ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee4416b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee42ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee4416b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51348/0 (socket says 172.21.15.60:51348) 2023-10-08T16:14:26.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.077+0000 7fee42ffd700 1 -- 172.21.15.60:0/121792230 learned_addr learned my addr 172.21.15.60:0/121792230 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee437fe700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee440b1730 0x7fee4416afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee43fff700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee44159e50 0x7fee440a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee42ffd700 1 -- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee440b1730 msgr2=0x7fee4416afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee42ffd700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee440b1730 0x7fee4416afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee42ffd700 1 -- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee44159e50 msgr2=0x7fee440a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee42ffd700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee44159e50 0x7fee440a9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee42ffd700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380094f0 con 0x7fee440b3370 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee42ffd700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee4416b560 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fee38009290 tx=0x7fee38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38011e40 con 0x7fee440b3370 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38024440 con 0x7fee440b3370 2023-10-08T16:14:26.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee440a9f80 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38024800 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.078+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee440aa260 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.079+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee440a7970 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.080+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee3801a420 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.080+0000 7fee2b7fe700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee30066f30 0x7fee300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.080+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fee380864a0 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.080+0000 7fee437fe700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee30066f30 0x7fee300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.080+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fee3006ebb0 con 0x7fee440b3370 2023-10-08T16:14:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.081+0000 7fee437fe700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee30066f30 0x7fee300693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee34006fd0 tx=0x7fee34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.085+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee440a7970 con 0x7fee440b3370 2023-10-08T16:14:26.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.278+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee440a7970 con 0x7fee440b3370 2023-10-08T16:14:26.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.893+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(154..154 src has 1..154) v4 ==== 288+0+0 (secure 0 0 0) 0x7fee38057ac0 con 0x7fee440b3370 2023-10-08T16:14:26.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.893+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7fee3006cfe0 con 0x7fee440b3370 2023-10-08T16:14:26.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.895+0000 7fee2b7fe700 1 -- 172.21.15.60:0/121792230 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) v1 ==== 181+0+0 (secure 0 0 0) 0x7fee440a7970 con 0x7fee440b3370 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee30066f30 msgr2=0x7fee300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee30066f30 0x7fee300693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee34006fd0 tx=0x7fee34008040 comp rx=0 tx=0).stop 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 msgr2=0x7fee4416b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee4416b560 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fee38009290 tx=0x7fee38017000 comp rx=0 tx=0).stop 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 shutdown_connections 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fee30066f30 0x7fee300693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee440b1730 0x7fee4416afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee44159e50 0x7fee440a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 --2- 172.21.15.60:0/121792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee440b3370 0x7fee4416b560 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 >> 172.21.15.60:0/121792230 conn(0x7fee44068130 msgr2=0x7fee440c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.900+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 shutdown_connections 2023-10-08T16:14:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:26.901+0000 7fee49ef7700 1 -- 172.21.15.60:0/121792230 wait complete. 2023-10-08T16:14:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:14:26.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:14:27.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 Processor -- start 2023-10-08T16:14:27.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 -- start start 2023-10-08T16:14:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8468156de0 0x7f84680cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f846806e320 0x7f84680cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846806f4f0 con 0x7f8468156a10 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84680c9880 con 0x7f846806e320 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.041+0000 7f846e50d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846806e8e0 con 0x7f8468156de0 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f846806e320 0x7f84680cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f8467fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8468156a10 0x7f846815b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54016/0 (socket says 172.21.15.60:54016) 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f846806e320 0x7f84680cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51350/0 (socket says 172.21.15.60:51350) 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f8467fff700 1 -- 172.21.15.60:0/1676164963 learned_addr learned my addr 172.21.15.60:0/1676164963 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f84677fe700 1 --2- 172.21.15.60:0/1676164963 >> v2:172.21.15.144:3300/0 conn(0x7f8468156de0 0x7f84680cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 -- 172.21.15.60:0/1676164963 >> v2:172.21.15.144:3300/0 conn(0x7f8468156de0 msgr2=0x7f84680cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 --2- 172.21.15.60:0/1676164963 >> v2:172.21.15.144:3300/0 conn(0x7f8468156de0 0x7f84680cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 -- 172.21.15.60:0/1676164963 >> v1:172.21.15.60:6789/0 conn(0x7f8468156a10 legacy=0x7f846815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 -- 172.21.15.60:0/1676164963 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846806ebc0 con 0x7f846806e320 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f8466ffd700 1 -- 172.21.15.60:0/1676164963 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697281545 0 0) 0x7f846806f4f0 con 0x7f8468156a10 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f846caaa700 1 --2- 172.21.15.60:0/1676164963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f846806e320 0x7f84680cc650 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f84680cdb00 tx=0x7f8460009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf699703bcfb8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f8466ffd700 1 -- 172.21.15.60:0/1676164963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000e070 con 0x7f846806e320 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f8466ffd700 1 -- 172.21.15.60:0/1676164963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000bc30 con 0x7f846806e320 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.042+0000 7f8466ffd700 1 -- 172.21.15.60:0/1676164963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460012430 con 0x7f846806e320 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 -- 172.21.15.60:0/1676164963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f846806e320 msgr2=0x7f84680cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 --2- 172.21.15.60:0/1676164963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f846806e320 0x7f84680cc650 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f84680cdb00 tx=0x7f8460009780 comp rx=0 tx=0).stop 2023-10-08T16:14:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 -- 172.21.15.60:0/1676164963 shutdown_connections 2023-10-08T16:14:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 --2- 172.21.15.60:0/1676164963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f846806e320 0x7f84680cc650 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 --2- 172.21.15.60:0/1676164963 >> v2:172.21.15.144:3300/0 conn(0x7f8468156de0 0x7f84680cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 -- 172.21.15.60:0/1676164963 >> 172.21.15.60:0/1676164963 conn(0x7f84680ce5c0 msgr2=0x7f84680ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 -- 172.21.15.60:0/1676164963 shutdown_connections 2023-10-08T16:14:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.043+0000 7f846e50d700 1 -- 172.21.15.60:0/1676164963 wait complete. 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.044+0000 7f846e50d700 1 Processor -- start 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.044+0000 7f846e50d700 1 -- start start 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846e50d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f846806e320 0x7f846814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846e50d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8468156a10 0x7f84680c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846e50d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 0x7f846814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846e50d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c6d70 con 0x7f8468156de0 2023-10-08T16:14:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846e50d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c6160 con 0x7f8468156a10 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846e50d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c6440 con 0x7f846806e320 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 0x7f846814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 0x7f846814cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51356/0 (socket says 172.21.15.60:51356) 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 -- 172.21.15.60:0/1685610018 learned_addr learned my addr 172.21.15.60:0/1685610018 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f84677fe700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8468156a10 0x7f84680c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f8467fff700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f846806e320 0x7f846814f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 -- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f846806e320 msgr2=0x7f846814f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f846806e320 0x7f846814f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 -- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8468156a10 msgr2=0x7f84680c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8468156a10 0x7f84680c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.045+0000 7f846caaa700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8460009a20 con 0x7f8468156de0 2023-10-08T16:14:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.046+0000 7f846caaa700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 0x7f846814cf20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f846806dc10 tx=0x7f8460019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.046+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460012e10 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.046+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846001d630 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.046+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846001d9d0 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.046+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680c6720 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.046+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846814fb50 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.047+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84680c6f20 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.047+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8460024070 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.047+0000 7f844ffff700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.047+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f8460086c10 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.048+0000 7f8467fff700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.048+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7f845406ddb0 con 0x7f8468156de0 2023-10-08T16:14:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.048+0000 7f8467fff700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8454066f30 0x7f84540693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8458007160 tx=0x7f8458007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:27.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.052+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84680c6f20 con 0x7f8468156de0 2023-10-08T16:14:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.244+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f846804c3c0 con 0x7f8468156de0 2023-10-08T16:14:27.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.895+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(155..155 src has 1..155) v4 ==== 322+0+0 (secure 0 0 0) 0x7f8460057c60 con 0x7f8468156de0 2023-10-08T16:14:27.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.895+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f845406cb40 con 0x7f8468156de0 2023-10-08T16:14:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.897+0000 7f844ffff700 1 -- 172.21.15.60:0/1685610018 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) v1 ==== 169+0+0 (secure 0 0 0) 0x7f846002c020 con 0x7f8468156de0 2023-10-08T16:14:27.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.907+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8454066f30 msgr2=0x7f84540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:27.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.907+0000 7f846e50d700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8454066f30 0x7f84540693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8458007160 tx=0x7f8458007f50 comp rx=0 tx=0).stop 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.907+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 msgr2=0x7f846814cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.907+0000 7f846e50d700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 0x7f846814cf20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f846806dc10 tx=0x7f8460019000 comp rx=0 tx=0).stop 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 shutdown_connections 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f846806e320 0x7f846814f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8468156de0 0x7f846814cf20 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 --2- 172.21.15.60:0/1685610018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8468156a10 0x7f84680c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 >> 172.21.15.60:0/1685610018 conn(0x7f84680ce5c0 msgr2=0x7f84680c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 shutdown_connections 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:27.908+0000 7f846e50d700 1 -- 172.21.15.60:0/1685610018 wait complete. 2023-10-08T16:14:27.911 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:14:27.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:14:28.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.043+0000 7fd74046c700 1 Processor -- start 2023-10-08T16:14:28.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.043+0000 7fd74046c700 1 -- start start 2023-10-08T16:14:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd74046c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd73815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd74046c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd73815a230 0x7fd7380690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd74046c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73815ea90 con 0x7fd7380695f0 2023-10-08T16:14:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd74046c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380d1cf0 con 0x7fd73815a230 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd74046c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738069a90 con 0x7fd738159e60 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd73da07700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd73815a230 0x7fd7380690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd73da07700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd73815a230 0x7fd7380690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51370/0 (socket says 172.21.15.60:51370) 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.044+0000 7fd73da07700 1 -- 172.21.15.60:0/2913491973 learned_addr learned my addr 172.21.15.60:0/2913491973 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73e208700 1 --2- 172.21.15.60:0/2913491973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd73815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73da07700 1 -- 172.21.15.60:0/2913491973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 msgr2=0x7fd73815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73da07700 1 --2- 172.21.15.60:0/2913491973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd73815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73da07700 1 -- 172.21.15.60:0/2913491973 >> v1:172.21.15.144:6789/0 conn(0x7fd7380695f0 legacy=0x7fd7380af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73da07700 1 -- 172.21.15.60:0/2913491973 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b3100 con 0x7fd73815a230 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73da07700 1 --2- 172.21.15.60:0/2913491973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7380690b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0099b0 tx=0x7fd72c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f45acfab1b1cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73d206700 1 -- 172.21.15.60:0/2913491973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c009ea0 con 0x7fd73815a230 2023-10-08T16:14:28.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73d206700 1 -- 172.21.15.60:0/2913491973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c00b860 con 0x7fd73815a230 2023-10-08T16:14:28.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.045+0000 7fd73d206700 1 -- 172.21.15.60:0/2913491973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c00bc00 con 0x7fd73815a230 2023-10-08T16:14:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 -- 172.21.15.60:0/2913491973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 msgr2=0x7fd7380690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 --2- 172.21.15.60:0/2913491973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7380690b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0099b0 tx=0x7fd72c009250 comp rx=0 tx=0).stop 2023-10-08T16:14:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 -- 172.21.15.60:0/2913491973 shutdown_connections 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 --2- 172.21.15.60:0/2913491973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd73815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 --2- 172.21.15.60:0/2913491973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7380690b0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 -- 172.21.15.60:0/2913491973 >> 172.21.15.60:0/2913491973 conn(0x7fd738070700 msgr2=0x7fd738070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 -- 172.21.15.60:0/2913491973 shutdown_connections 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.046+0000 7fd74046c700 1 -- 172.21.15.60:0/2913491973 wait complete. 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.047+0000 7fd74046c700 1 Processor -- start 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.047+0000 7fd74046c700 1 -- start start 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7380695f0 0x7fd7380c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd7380cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7381567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380cb310 con 0x7fd73815a230 2023-10-08T16:14:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73815af70 con 0x7fd7380695f0 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738156d20 con 0x7fd738159e60 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7381567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7381567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51382/0 (socket says 172.21.15.60:51382) 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 -- 172.21.15.60:0/1941420106 learned_addr learned my addr 172.21.15.60:0/1941420106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73da07700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd7380cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73e208700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7380695f0 0x7fd7380c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 -- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 msgr2=0x7fd7380cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd7380cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 -- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7380695f0 msgr2=0x7fd7380c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7380695f0 0x7fd7380c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 -- 172.21.15.60:0/1941420106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0094f0 con 0x7fd73815a230 2023-10-08T16:14:28.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd73ea09700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7381567e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fd72800c840 tx=0x7fd728001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728012630 con 0x7fd73815a230 2023-10-08T16:14:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd728012790 con 0x7fd73815a230 2023-10-08T16:14:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7380c6f80 con 0x7fd73815a230 2023-10-08T16:14:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728012b50 con 0x7fd73815a230 2023-10-08T16:14:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.048+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73815a920 con 0x7fd73815a230 2023-10-08T16:14:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.049+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73804c3c0 con 0x7fd73815a230 2023-10-08T16:14:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.050+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd728003030 con 0x7fd73815a230 2023-10-08T16:14:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.050+0000 7fd7367fc700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.050+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd728084020 con 0x7fd73815a230 2023-10-08T16:14:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.050+0000 7fd73e208700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.051+0000 7fd73e208700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd724066f30 0x7fd7240693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd730009db0 tx=0x7fd7300091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:28.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.055+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd728051590 con 0x7fd73815a230 2023-10-08T16:14:28.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.248+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd7380cd320 con 0x7fd73815a230 2023-10-08T16:14:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.252+0000 7fd7367fc700 1 -- 172.21.15.60:0/1941420106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd728054bb0 con 0x7fd73815a230 2023-10-08T16:14:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd724066f30 msgr2=0x7fd7240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd724066f30 0x7fd7240693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd730009db0 tx=0x7fd7300091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 msgr2=0x7fd7381567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7381567e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fd72800c840 tx=0x7fd728001670 comp rx=0 tx=0).stop 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 shutdown_connections 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd73815a230 0x7fd7381567e0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7380695f0 0x7fd7380c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 --2- 172.21.15.60:0/1941420106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd738159e60 0x7fd7380cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 >> 172.21.15.60:0/1941420106 conn(0x7fd738070700 msgr2=0x7fd738067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 shutdown_connections 2023-10-08T16:14:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.254+0000 7fd74046c700 1 -- 172.21.15.60:0/1941420106 wait complete. 2023-10-08T16:14:28.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-08T16:14:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 Processor -- start 2023-10-08T16:14:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 -- start start 2023-10-08T16:14:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad201523e0 0x7fad2006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20158e50 0x7fad200cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2006c010 con 0x7fad20152010 2023-10-08T16:14:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2006bd10 con 0x7fad201523e0 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.385+0000 7fad2694b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2015c060 con 0x7fad20158e50 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad201523e0 0x7fad2006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad201523e0 0x7fad2006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51398/0 (socket says 172.21.15.60:51398) 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 -- 172.21.15.60:0/2563518626 learned_addr learned my addr 172.21.15.60:0/2563518626 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad24ee8700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20158e50 0x7fad200cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 -- 172.21.15.60:0/2563518626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20158e50 msgr2=0x7fad200cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20158e50 0x7fad200cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 -- 172.21.15.60:0/2563518626 >> v1:172.21.15.144:6789/0 conn(0x7fad20152010 legacy=0x7fad2015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 -- 172.21.15.60:0/2563518626 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2015c340 con 0x7fad201523e0 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad24ee8700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20158e50 0x7fad200cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1f7fe700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad201523e0 0x7fad2006c4a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fad080099b0 tx=0x7fad08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db92b4da0af746bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1effd700 1 -- 172.21.15.60:0/2563518626 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800b860 con 0x7fad201523e0 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1effd700 1 -- 172.21.15.60:0/2563518626 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800b9c0 con 0x7fad201523e0 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.386+0000 7fad1effd700 1 -- 172.21.15.60:0/2563518626 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800bd60 con 0x7fad201523e0 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 -- 172.21.15.60:0/2563518626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad201523e0 msgr2=0x7fad2006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad201523e0 0x7fad2006c4a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fad080099b0 tx=0x7fad08009250 comp rx=0 tx=0).stop 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 -- 172.21.15.60:0/2563518626 shutdown_connections 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20158e50 0x7fad200cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 --2- 172.21.15.60:0/2563518626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad201523e0 0x7fad2006c4a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 -- 172.21.15.60:0/2563518626 >> 172.21.15.60:0/2563518626 conn(0x7fad20069870 msgr2=0x7fad20069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 -- 172.21.15.60:0/2563518626 shutdown_connections 2023-10-08T16:14:28.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.387+0000 7fad2694b700 1 -- 172.21.15.60:0/2563518626 wait complete. 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.388+0000 7fad2694b700 1 Processor -- start 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.388+0000 7fad2694b700 1 -- start start 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad2694b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20152010 0x7fad2014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad2694b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad201523e0 0x7fad20068f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad2694b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 0x7fad20150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad2694b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2015b0c0 con 0x7fad20158e50 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad2694b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200c5bf0 con 0x7fad201523e0 2023-10-08T16:14:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad2694b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200c5e90 con 0x7fad20152010 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 0x7fad20150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 0x7fad20150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51412/0 (socket says 172.21.15.60:51412) 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 -- 172.21.15.60:0/779805782 learned_addr learned my addr 172.21.15.60:0/779805782 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad1f7fe700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad201523e0 0x7fad20068f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad1ffff700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20152010 0x7fad2014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 -- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20152010 msgr2=0x7fad2014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20152010 0x7fad2014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 -- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad201523e0 msgr2=0x7fad20068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad201523e0 0x7fad20068f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.389+0000 7fad24ee8700 1 -- 172.21.15.60:0/779805782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080094f0 con 0x7fad20158e50 2023-10-08T16:14:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.390+0000 7fad24ee8700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 0x7fad20150ff0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fad1800d180 tx=0x7fad18009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.390+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800dcc0 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.390+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800f040 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.390+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad200c6170 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.390+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18015690 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.390+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad200c6730 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.391+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2004c3c0 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.391+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad1801e3b0 con 0x7fad20158e50 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.392+0000 7fad17fff700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.392+0000 7fad1ffff700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.392+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fad180846f0 con 0x7fad20158e50 2023-10-08T16:14:28.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.392+0000 7fad1ffff700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fad00066f30 0x7fad000693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad10003950 tx=0x7fad10007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:28.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.396+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad18051c60 con 0x7fad20158e50 2023-10-08T16:14:28.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:28.670+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fad2006d1b0 con 0x7fad20158e50 2023-10-08T16:14:29.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.487+0000 7fad17fff700 1 -- 172.21.15.60:0/779805782 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v452) v1 ==== 132+0+0 (secure 0 0 0) 0x7fad18055280 con 0x7fad20158e50 2023-10-08T16:14:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fad00066f30 msgr2=0x7fad000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fad00066f30 0x7fad000693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad10003950 tx=0x7fad10007ec0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 msgr2=0x7fad20150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:29.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 0x7fad20150ff0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fad1800d180 tx=0x7fad18009a50 comp rx=0 tx=0).stop 2023-10-08T16:14:29.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 shutdown_connections 2023-10-08T16:14:29.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad20152010 0x7fad2014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad20158e50 0x7fad20150ff0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 --2- 172.21.15.60:0/779805782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad201523e0 0x7fad20068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 >> 172.21.15.60:0/779805782 conn(0x7fad20069870 msgr2=0x7fad2006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 shutdown_connections 2023-10-08T16:14:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.490+0000 7fad2694b700 1 -- 172.21.15.60:0/779805782 wait complete. 2023-10-08T16:14:29.507 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-08T16:14:29.507 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-08T16:14:29.507 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-08T16:14:29.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-08T16:14:29.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.632+0000 7ff48c106700 1 Processor -- start 2023-10-08T16:14:29.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.632+0000 7ff48c106700 1 -- start start 2023-10-08T16:14:29.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48c106700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff484157870 0x7ff48415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:29.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48c106700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff484157c40 0x7ff484158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48c106700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48415cbb0 con 0x7ff48415a620 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48c106700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48415bfa0 con 0x7ff484157c40 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48c106700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48415c280 con 0x7ff484157870 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff484157c40 0x7ff484158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff484157c40 0x7ff484158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51416/0 (socket says 172.21.15.60:51416) 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 -- 172.21.15.60:0/4290706028 learned_addr learned my addr 172.21.15.60:0/4290706028 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff489ea2700 1 --2- 172.21.15.60:0/4290706028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff484157870 0x7ff48415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 -- 172.21.15.60:0/4290706028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff484157870 msgr2=0x7ff48415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 --2- 172.21.15.60:0/4290706028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff484157870 0x7ff48415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 -- 172.21.15.60:0/4290706028 >> v1:172.21.15.144:6789/0 conn(0x7ff48415a620 legacy=0x7ff48415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 -- 172.21.15.60:0/4290706028 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48415c560 con 0x7ff484157c40 2023-10-08T16:14:29.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.633+0000 7ff48a6a3700 1 --2- 172.21.15.60:0/4290706028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157c40 0x7ff484158110 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009f20 tx=0x7ff47c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425eae22227b0681 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff488ea0700 1 -- 172.21.15.60:0/4290706028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00e070 con 0x7ff484157c40 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff488ea0700 1 -- 172.21.15.60:0/4290706028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ba80 con 0x7ff484157c40 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff488ea0700 1 -- 172.21.15.60:0/4290706028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c0092e0 con 0x7ff484157c40 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 -- 172.21.15.60:0/4290706028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157c40 msgr2=0x7ff484158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 --2- 172.21.15.60:0/4290706028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157c40 0x7ff484158110 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009f20 tx=0x7ff47c009840 comp rx=0 tx=0).stop 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 -- 172.21.15.60:0/4290706028 shutdown_connections 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 --2- 172.21.15.60:0/4290706028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157c40 0x7ff484158110 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 --2- 172.21.15.60:0/4290706028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff484157870 0x7ff48415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 -- 172.21.15.60:0/4290706028 >> 172.21.15.60:0/4290706028 conn(0x7ff484068ce0 msgr2=0x7ff4840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 -- 172.21.15.60:0/4290706028 shutdown_connections 2023-10-08T16:14:29.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.634+0000 7ff48c106700 1 -- 172.21.15.60:0/4290706028 wait complete. 2023-10-08T16:14:29.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.635+0000 7ff48c106700 1 Processor -- start 2023-10-08T16:14:29.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.635+0000 7ff48c106700 1 -- start start 2023-10-08T16:14:29.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48c106700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 0x7ff4840b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48c106700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff484157c40 0x7ff48413f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48c106700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48415a620 0x7ff484150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48c106700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840b1bd0 con 0x7ff484157870 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48c106700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840b1dc0 con 0x7ff484157c40 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48c106700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840b20a0 con 0x7ff48415a620 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 0x7ff4840b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 0x7ff4840b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51426/0 (socket says 172.21.15.60:51426) 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 -- 172.21.15.60:0/3669383782 learned_addr learned my addr 172.21.15.60:0/3669383782 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48a6a3700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48415a620 0x7ff484150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff4896a1700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff484157c40 0x7ff48413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 -- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48415a620 msgr2=0x7ff484150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48415a620 0x7ff484150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 -- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff484157c40 msgr2=0x7ff48413f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff484157c40 0x7ff48413f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff489ea2700 1 -- 172.21.15.60:0/3669383782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009ae0 con 0x7ff484157870 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff48a6a3700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48415a620 0x7ff484150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.636+0000 7ff4896a1700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff484157c40 0x7ff48413f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.637+0000 7ff489ea2700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 0x7ff4840b1690 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ff48000d890 tx=0x7ff480008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.637+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000b600 con 0x7ff484157870 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.637+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000b760 con 0x7ff484157870 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.637+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4840b2380 con 0x7ff484157870 2023-10-08T16:14:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.637+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000bae0 con 0x7ff484157870 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.637+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4840b2940 con 0x7ff484157870 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.638+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4840b2b60 con 0x7ff484157870 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.638+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff48001e460 con 0x7ff484157870 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.639+0000 7ff479ffb700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.639+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff4800848e0 con 0x7ff484157870 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.639+0000 7ff4896a1700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:29.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.639+0000 7ff4896a1700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff468066f30 0x7ff4680693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff4841587f0 tx=0x7ff474009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:29.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.643+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff480051e50 con 0x7ff484157870 2023-10-08T16:14:29.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:29.916+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7ff48404c3c0 con 0x7ff484157870 2023-10-08T16:14:30.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.491+0000 7ff479ffb700 1 -- 172.21.15.60:0/3669383782 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v453) v1 ==== 134+0+0 (secure 0 0 0) 0x7ff480055470 con 0x7ff484157870 2023-10-08T16:14:30.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff468066f30 msgr2=0x7ff4680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff468066f30 0x7ff4680693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff4841587f0 tx=0x7ff474009040 comp rx=0 tx=0).stop 2023-10-08T16:14:30.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 msgr2=0x7ff4840b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 0x7ff4840b1690 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ff48000d890 tx=0x7ff480008040 comp rx=0 tx=0).stop 2023-10-08T16:14:30.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 shutdown_connections 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48415a620 0x7ff484150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff484157870 0x7ff4840b1690 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 --2- 172.21.15.60:0/3669383782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff484157c40 0x7ff48413f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 >> 172.21.15.60:0/3669383782 conn(0x7ff484068ce0 msgr2=0x7ff4840d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 shutdown_connections 2023-10-08T16:14:30.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.494+0000 7ff48c106700 1 -- 172.21.15.60:0/3669383782 wait complete. 2023-10-08T16:14:30.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:14:30.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.633+0000 7f35a74e0700 1 Processor -- start 2023-10-08T16:14:30.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.633+0000 7f35a74e0700 1 -- start start 2023-10-08T16:14:30.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a74e0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 0x7f35a00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a74e0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35a015a290 0x7f35a00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a74e0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00b0790 con 0x7f35a006a5a0 2023-10-08T16:14:30.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a74e0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00ce1f0 con 0x7f35a015a290 2023-10-08T16:14:30.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a74e0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b0b20 con 0x7f35a0159ec0 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a5a7d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f35a006a5a0 0x7f35a015db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54030/0 (socket says 172.21.15.60:54030) 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.634+0000 7f35a5a7d700 1 -- 172.21.15.60:0/3656122115 learned_addr learned my addr 172.21.15.60:0/3656122115 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a4a7b700 1 --2- 172.21.15.60:0/3656122115 >> v2:172.21.15.144:3300/0 conn(0x7f35a015a290 0x7f35a00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a527c700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 0x7f35a00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443894943 0 0) 0x7f35a00b0790 con 0x7f35a006a5a0 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003570 con 0x7f35a006a5a0 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2748709993 0 0) 0x7f3588003570 con 0x7f35a006a5a0 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 msgr2=0x7f35a00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 0x7f35a00af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 >> v2:172.21.15.144:3300/0 conn(0x7f35a015a290 msgr2=0x7f35a00afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 --2- 172.21.15.60:0/3656122115 >> v2:172.21.15.144:3300/0 conn(0x7f35a015a290 0x7f35a00afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00b04b0 con 0x7f35a006a5a0 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f35900017f0 con 0x7f35a006a5a0 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 >> v1:172.21.15.60:6789/0 conn(0x7f35a006a5a0 legacy=0x7f35a015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3588003a60 0x7f3588003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 0x7f3588004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3588004d50 0x7f35880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ce1f0 con 0x7f3588004d50 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b0b20 con 0x7f3588003a60 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358800ba60 con 0x7f35a0159ec0 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a5a7d700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3588004d50 0x7f35880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a527c700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3588003a60 0x7f3588003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a4a7b700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 0x7f3588004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a5a7d700 1 -- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 msgr2=0x7f3588004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a5a7d700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0159ec0 0x7f3588004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a5a7d700 1 -- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3588003a60 msgr2=0x7f3588003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a5a7d700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3588003a60 0x7f3588003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.635+0000 7f35a5a7d700 1 -- 172.21.15.60:0/3656122115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3588003570 con 0x7f3588004d50 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a5a7d700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3588004d50 0x7f35880051c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f359000a970 tx=0x7f3590002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1926baca1a014 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900070d0 con 0x7f3588004d50 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590007230 con 0x7f3588004d50 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f359ffff700 1 -- 172.21.15.60:0/3656122115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900075f0 con 0x7f3588004d50 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a74e0700 1 -- 172.21.15.60:0/3656122115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3588004d50 msgr2=0x7f35880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a74e0700 1 --2- 172.21.15.60:0/3656122115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3588004d50 0x7f35880051c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f359000a970 tx=0x7f3590002210 comp rx=0 tx=0).stop 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a5a7d700 1 -- 172.21.15.60:0/3656122115 reap_dead start 2023-10-08T16:14:30.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a74e0700 1 -- 172.21.15.60:0/3656122115 shutdown_connections 2023-10-08T16:14:30.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a74e0700 1 -- 172.21.15.60:0/3656122115 >> 172.21.15.60:0/3656122115 conn(0x7f35a00d1880 msgr2=0x7f35a00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:30.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a74e0700 1 -- 172.21.15.60:0/3656122115 shutdown_connections 2023-10-08T16:14:30.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.636+0000 7f35a74e0700 1 -- 172.21.15.60:0/3656122115 wait complete. 2023-10-08T16:14:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 Processor -- start 2023-10-08T16:14:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 -- start start 2023-10-08T16:14:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 0x7f35a01582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0153540 0x7f35a00b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35a00b2e70 0x7f35a0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00c7e60 con 0x7f35a0152d50 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b32d0 con 0x7f35a00b2e70 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.638+0000 7f35a74e0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a016a640 con 0x7f35a0153540 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 0x7f35a01582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 0x7f35a01582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51446/0 (socket says 172.21.15.60:51446) 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 -- 172.21.15.60:0/1286935789 learned_addr learned my addr 172.21.15.60:0/1286935789 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a5a7d700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35a00b2e70 0x7f35a0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a4a7b700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0153540 0x7f35a00b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 -- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0153540 msgr2=0x7f35a00b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0153540 0x7f35a00b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 -- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35a00b2e70 msgr2=0x7f35a0156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35a00b2e70 0x7f35a0156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 -- 172.21.15.60:0/1286935789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0158bc0 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a5a7d700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35a00b2e70 0x7f35a0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a4a7b700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0153540 0x7f35a00b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a527c700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 0x7f35a01582c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f3598006ac0 tx=0x7f35980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800f9b0 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800fb10 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0169ff0 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800fe90 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.639+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0169d00 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.640+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a004c3c0 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.641+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3598014650 con 0x7f35a0152d50 2023-10-08T16:14:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.641+0000 7f359d7fa700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.641+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3598018030 con 0x7f35a0152d50 2023-10-08T16:14:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.641+0000 7f35a4a7b700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.642+0000 7f35a4a7b700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f358c066f30 0x7f358c0693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f35a0158fe0 tx=0x7f3594008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.645+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3598052240 con 0x7f35a0152d50 2023-10-08T16:14:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.837+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35a00ceab0 con 0x7f35a0152d50 2023-10-08T16:14:30.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.841+0000 7f359d7fa700 1 -- 172.21.15.60:0/1286935789 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35980220c0 con 0x7f35a0152d50 2023-10-08T16:14:30.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f358c066f30 msgr2=0x7f358c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f358c066f30 0x7f358c0693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f35a0158fe0 tx=0x7f3594008040 comp rx=0 tx=0).stop 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 msgr2=0x7f35a01582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 0x7f35a01582c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f3598006ac0 tx=0x7f35980091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 shutdown_connections 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35a00b2e70 0x7f35a0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0152d50 0x7f35a01582c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 --2- 172.21.15.60:0/1286935789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35a0153540 0x7f35a00b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 >> 172.21.15.60:0/1286935789 conn(0x7f35a00d1880 msgr2=0x7f35a00b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:30.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 shutdown_connections 2023-10-08T16:14:30.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:30.843+0000 7f35a74e0700 1 -- 172.21.15.60:0/1286935789 wait complete. 2023-10-08T16:14:30.856 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:14:30.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:14:30.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:14:30.938 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:14:30.938 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:14:30.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:31.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.055+0000 7fe84880c700 1 Processor -- start 2023-10-08T16:14:31.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.056+0000 7fe84880c700 1 -- start start 2023-10-08T16:14:31.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.056+0000 7fe84880c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe844067d70 0x7fe84415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.056+0000 7fe84880c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440cb370 con 0x7fe84406c630 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.056+0000 7fe84880c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440b0c60 con 0x7fe8440b0890 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.056+0000 7fe84880c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84406a1e0 con 0x7fe844067d70 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe842d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe844067d70 0x7fe84415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe841d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe84406c630 0x7fe844067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54044/0 (socket says 172.21.15.60:54044) 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe841d9b700 1 -- 172.21.15.60:0/45943052 learned_addr learned my addr 172.21.15.60:0/45943052 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe842d9d700 1 -- 172.21.15.60:0/45943052 >> v1:172.21.15.144:6789/0 conn(0x7fe8440b0890 legacy=0x7fe8440cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe842d9d700 1 -- 172.21.15.60:0/45943052 >> v1:172.21.15.60:6789/0 conn(0x7fe84406c630 legacy=0x7fe844067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe84159a700 1 -- 172.21.15.60:0/45943052 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651344844 0 0) 0x7fe8440cb370 con 0x7fe84406c630 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe842d9d700 1 -- 172.21.15.60:0/45943052 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84406cb80 con 0x7fe844067d70 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe842d9d700 1 --2- 172.21.15.60:0/45943052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe844067d70 0x7fe84415a7a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb26495350a0337 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:31.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe84159a700 1 -- 172.21.15.60:0/45943052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00e070 con 0x7fe844067d70 2023-10-08T16:14:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe84159a700 1 -- 172.21.15.60:0/45943052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00bc30 con 0x7fe844067d70 2023-10-08T16:14:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.057+0000 7fe84159a700 1 -- 172.21.15.60:0/45943052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c012430 con 0x7fe844067d70 2023-10-08T16:14:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 -- 172.21.15.60:0/45943052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe844067d70 msgr2=0x7fe84415a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 --2- 172.21.15.60:0/45943052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe844067d70 0x7fe84415a7a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).stop 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 -- 172.21.15.60:0/45943052 shutdown_connections 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 --2- 172.21.15.60:0/45943052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe844067d70 0x7fe84415a7a0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 -- 172.21.15.60:0/45943052 >> 172.21.15.60:0/45943052 conn(0x7fe84406fe50 msgr2=0x7fe844069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 -- 172.21.15.60:0/45943052 shutdown_connections 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.058+0000 7fe84880c700 1 -- 172.21.15.60:0/45943052 wait complete. 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.059+0000 7fe84880c700 1 Processor -- start 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.059+0000 7fe84880c700 1 -- start start 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe844067d70 0x7fe8440c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 0x7fe8440ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8440b0890 0x7fe84414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440ad960 con 0x7fe84406c630 2023-10-08T16:14:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440cd010 con 0x7fe844067d70 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414d550 con 0x7fe8440b0890 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 0x7fe8440ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 0x7fe8440ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51464/0 (socket says 172.21.15.60:51464) 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 -- 172.21.15.60:0/1784680364 learned_addr learned my addr 172.21.15.60:0/1784680364 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84259c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe844067d70 0x7fe8440c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe842d9d700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8440b0890 0x7fe84414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 -- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8440b0890 msgr2=0x7fe84414d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8440b0890 0x7fe84414d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 -- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe844067d70 msgr2=0x7fe8440c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe844067d70 0x7fe8440c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 -- 172.21.15.60:0/1784680364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009a20 con 0x7fe84406c630 2023-10-08T16:14:31.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe841d9b700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 0x7fe8440ad420 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00c840 tx=0x7fe82c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c005c00 con 0x7fe84406c630 2023-10-08T16:14:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c005d60 con 0x7fe84406c630 2023-10-08T16:14:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8440cd570 con 0x7fe84406c630 2023-10-08T16:14:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.060+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0072e0 con 0x7fe84406c630 2023-10-08T16:14:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.061+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8440c3230 con 0x7fe84406c630 2023-10-08T16:14:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.061+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8440c3450 con 0x7fe84406c630 2023-10-08T16:14:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.062+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe82c007690 con 0x7fe84406c630 2023-10-08T16:14:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.062+0000 7fe83a7fc700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe824066f30 0x7fe8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.062+0000 7fe84259c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe824066f30 0x7fe8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.062+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe82c083650 con 0x7fe84406c630 2023-10-08T16:14:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.063+0000 7fe84259c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe824066f30 0x7fe8240693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe834000c00 tx=0x7fe834009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.067+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe82c04b5a0 con 0x7fe84406c630 2023-10-08T16:14:31.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.306+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8440cd700 con 0x7fe84406c630 2023-10-08T16:14:31.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.307+0000 7fe83a7fc700 1 -- 172.21.15.60:0/1784680364 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fe82c017090 con 0x7fe84406c630 2023-10-08T16:14:31.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:31.308 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6155,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/466935747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":466935747},{"type":"v1","addr":"172.21.15.144:6833","nonce":466935747}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6161,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/978134378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":978134378},{"type":"v1","addr":"172.21.15.144:6835","nonce":978134378}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2856270525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2856270525},{"type":"v1","addr":"172.21.15.60:6836","nonce":2856270525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7755,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/163678468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":163678468},{"type":"v1","addr":"172.21.15.60:6837","nonce":163678468}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-10-08T16:14:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe824066f30 msgr2=0x7fe8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe824066f30 0x7fe8240693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe834000c00 tx=0x7fe834009040 comp rx=0 tx=0).stop 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 msgr2=0x7fe8440ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 0x7fe8440ad420 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00c840 tx=0x7fe82c007db0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 shutdown_connections 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe824066f30 0x7fe8240693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8440b0890 0x7fe84414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe844067d70 0x7fe8440c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 --2- 172.21.15.60:0/1784680364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe84406c630 0x7fe8440ad420 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 >> 172.21.15.60:0/1784680364 conn(0x7fe84406fe50 msgr2=0x7fe84415e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 shutdown_connections 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.309+0000 7fe84880c700 1 -- 172.21.15.60:0/1784680364 wait complete. 2023-10-08T16:14:31.311 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 79 2023-10-08T16:14:31.322 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:14:31.323 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:14:31.323 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:14:31.323 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:14:31.323 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:14:31.323 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:14:31.323 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:14:31.324 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:14:31.324 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:14:31.324 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:14:31.324 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:14:31.324 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:14:31.324 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:14:31.324 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:14:31.325 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:14:31.325 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:14:31.332 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:14:31.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:14:31.333 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:14:31.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:14:31.335 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:14:31.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:14:31.336 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:14:31.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:14:31.374 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:14:31.374 DEBUG:teuthology.parallel:result is None 2023-10-08T16:14:31.375 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:14:31.375 DEBUG:teuthology.parallel:result is None 2023-10-08T16:14:31.377 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:14:31.377 DEBUG:teuthology.parallel:result is None 2023-10-08T16:14:31.378 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:14:31.378 DEBUG:teuthology.parallel:result is None 2023-10-08T16:14:31.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:14:31.450 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:14:31.450 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:14:31.457 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:14:31.457 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:14:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.505+0000 7f7ab816e700 1 Processor -- start 2023-10-08T16:14:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.505+0000 7f7ab816e700 1 -- start start 2023-10-08T16:14:31.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab816e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ab0152010 0x7f7ab015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab816e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab01523e0 0x7f7ab006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab816e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab006c010 con 0x7f7ab0158e50 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab816e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab006bd10 con 0x7f7ab0152010 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab816e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab015c060 con 0x7f7ab01523e0 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5f0a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ab0152010 0x7f7ab015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab670b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7ab0158e50 0x7f7ab00cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54056/0 (socket says 172.21.15.60:54056) 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab670b700 1 -- 172.21.15.60:0/116513310 learned_addr learned my addr 172.21.15.60:0/116513310 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5709700 1 --2- 172.21.15.60:0/116513310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab01523e0 0x7f7ab006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5f0a700 1 -- 172.21.15.60:0/116513310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab01523e0 msgr2=0x7f7ab006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:31.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5f0a700 1 --2- 172.21.15.60:0/116513310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab01523e0 0x7f7ab006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5f0a700 1 -- 172.21.15.60:0/116513310 >> v1:172.21.15.60:6789/0 conn(0x7f7ab0158e50 legacy=0x7f7ab00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5f0a700 1 -- 172.21.15.60:0/116513310 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab015c340 con 0x7f7ab0152010 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab4f08700 1 -- 172.21.15.60:0/116513310 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820022078 0 0) 0x7f7ab006c010 con 0x7f7ab0158e50 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab5f0a700 1 --2- 172.21.15.60:0/116513310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0152010 0x7f7ab015b810 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0098e0 tx=0x7f7aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cdc198798bb6fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab4f08700 1 -- 172.21.15.60:0/116513310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00b640 con 0x7f7ab0152010 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab4f08700 1 -- 172.21.15.60:0/116513310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00b7a0 con 0x7f7ab0152010 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.506+0000 7f7ab4f08700 1 -- 172.21.15.60:0/116513310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00bb40 con 0x7f7ab0152010 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 -- 172.21.15.60:0/116513310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0152010 msgr2=0x7f7ab015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 --2- 172.21.15.60:0/116513310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0152010 0x7f7ab015b810 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0098e0 tx=0x7f7aac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 -- 172.21.15.60:0/116513310 shutdown_connections 2023-10-08T16:14:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 --2- 172.21.15.60:0/116513310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0152010 0x7f7ab015b810 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 --2- 172.21.15.60:0/116513310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab01523e0 0x7f7ab006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 -- 172.21.15.60:0/116513310 >> 172.21.15.60:0/116513310 conn(0x7f7ab0069870 msgr2=0x7f7ab0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:31.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 -- 172.21.15.60:0/116513310 shutdown_connections 2023-10-08T16:14:31.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.507+0000 7f7ab816e700 1 -- 172.21.15.60:0/116513310 wait complete. 2023-10-08T16:14:31.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.508+0000 7f7ab816e700 1 Processor -- start 2023-10-08T16:14:31.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.508+0000 7f7ab816e700 1 -- start start 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab816e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab0152010 0x7f7ab00c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab816e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab01523e0 0x7f7ab0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab816e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 0x7f7ab006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab816e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0153bd0 con 0x7f7ab0158e50 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab816e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0152d60 con 0x7f7ab01523e0 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab816e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0152fc0 con 0x7f7ab0152010 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 0x7f7ab006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 0x7f7ab006c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51514/0 (socket says 172.21.15.60:51514) 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 -- 172.21.15.60:0/3455146270 learned_addr learned my addr 172.21.15.60:0/3455146270 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab5f0a700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab0152010 0x7f7ab00c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab5709700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab01523e0 0x7f7ab0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 -- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab0152010 msgr2=0x7f7ab00c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab0152010 0x7f7ab00c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 -- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab01523e0 msgr2=0x7f7ab0152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab01523e0 0x7f7ab0152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 -- 172.21.15.60:0/3455146270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac009420 con 0x7f7ab0158e50 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.509+0000 7f7ab670b700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 0x7f7ab006c6f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800cbf0 tx=0x7f7aa80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.510+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800a9c0 con 0x7f7ab0158e50 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.510+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa800ab20 con 0x7f7ab0158e50 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab01532a0 con 0x7f7ab0158e50 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.510+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80070f0 con 0x7f7ab0158e50 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab0153860 con 0x7f7ab0158e50 2023-10-08T16:14:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.511+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab004c3c0 con 0x7f7ab0158e50 2023-10-08T16:14:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.511+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aa8007520 con 0x7f7ab0158e50 2023-10-08T16:14:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.512+0000 7f7aa5ffb700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a94066f30 0x7f7a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.512+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7aa8084630 con 0x7f7ab0158e50 2023-10-08T16:14:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.512+0000 7f7ab5f0a700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a94066f30 0x7f7a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.512+0000 7f7ab5f0a700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a94066f30 0x7f7a940693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0093f0 tx=0x7f7aac017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.516+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7aa8051c20 con 0x7f7ab0158e50 2023-10-08T16:14:31.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:31.724+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7ab015c7d0 con 0x7f7ab0158e50 2023-10-08T16:14:32.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.507+0000 7f7aa5ffb700 1 -- 172.21.15.60:0/3455146270 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7aa8055240 con 0x7f7ab0158e50 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a94066f30 msgr2=0x7f7a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a94066f30 0x7f7a940693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0093f0 tx=0x7f7aac017000 comp rx=0 tx=0).stop 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 msgr2=0x7f7ab006c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 0x7f7ab006c6f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800cbf0 tx=0x7f7aa80019b0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 shutdown_connections 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7a94066f30 0x7f7a940693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab0152010 0x7f7ab00c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab0158e50 0x7f7ab006c6f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 --2- 172.21.15.60:0/3455146270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab01523e0 0x7f7ab0152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 >> 172.21.15.60:0/3455146270 conn(0x7f7ab0069870 msgr2=0x7f7ab00b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 shutdown_connections 2023-10-08T16:14:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.510+0000 7f7ab816e700 1 -- 172.21.15.60:0/3455146270 wait complete. 2023-10-08T16:14:32.513 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:14:32.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:14:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.652+0000 7fed4e721700 1 Processor -- start 2023-10-08T16:14:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.652+0000 7fed4e721700 1 -- start start 2023-10-08T16:14:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4e721700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed480cdab0 0x7fed4815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4e721700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed4815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4e721700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480cb7c0 con 0x7fed480cd6e0 2023-10-08T16:14:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4e721700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4815e850 con 0x7fed480cdab0 2023-10-08T16:14:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4e721700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480cc360 con 0x7fed4815dda0 2023-10-08T16:14:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4d71f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fed480cd6e0 0x7fed480cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50796/0 (socket says 172.21.15.60:50796) 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4d71f700 1 -- 172.21.15.60:0/968034279 learned_addr learned my addr 172.21.15.60:0/968034279 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4df20700 1 --2- 172.21.15.60:0/968034279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed4815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed4cf1e700 1 --2- 172.21.15.60:0/968034279 >> v2:172.21.15.144:3300/0 conn(0x7fed480cdab0 0x7fed4815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed47fff700 1 -- 172.21.15.60:0/968034279 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920765655 0 0) 0x7fed480cb7c0 con 0x7fed480cd6e0 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.653+0000 7fed47fff700 1 -- 172.21.15.60:0/968034279 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed30003570 con 0x7fed480cd6e0 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4df20700 1 -- 172.21.15.60:0/968034279 >> v2:172.21.15.144:3300/0 conn(0x7fed480cdab0 msgr2=0x7fed4815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4df20700 1 --2- 172.21.15.60:0/968034279 >> v2:172.21.15.144:3300/0 conn(0x7fed480cdab0 0x7fed4815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4df20700 1 -- 172.21.15.60:0/968034279 >> v1:172.21.15.60:6789/0 conn(0x7fed480cd6e0 legacy=0x7fed480cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed47fff700 1 -- 172.21.15.60:0/968034279 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4218794373 0 0) 0x7fed30003570 con 0x7fed480cd6e0 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4df20700 1 -- 172.21.15.60:0/968034279 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4815e290 con 0x7fed4815dda0 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4cf1e700 1 --2- 172.21.15.60:0/968034279 >> v2:172.21.15.144:3300/0 conn(0x7fed480cdab0 0x7fed4815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4df20700 1 --2- 172.21.15.60:0/968034279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed4815cbd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed40009e60 tx=0x7fed40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5b6ba864881dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed47fff700 1 -- 172.21.15.60:0/968034279 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000e070 con 0x7fed4815dda0 2023-10-08T16:14:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed47fff700 1 -- 172.21.15.60:0/968034279 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4000b7a0 con 0x7fed4815dda0 2023-10-08T16:14:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed47fff700 1 -- 172.21.15.60:0/968034279 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38001470 con 0x7fed4815dda0 2023-10-08T16:14:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4e721700 1 -- 172.21.15.60:0/968034279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 msgr2=0x7fed4815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4e721700 1 --2- 172.21.15.60:0/968034279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed4815cbd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed40009e60 tx=0x7fed40009780 comp rx=0 tx=0).stop 2023-10-08T16:14:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4e721700 1 -- 172.21.15.60:0/968034279 shutdown_connections 2023-10-08T16:14:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4e721700 1 --2- 172.21.15.60:0/968034279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed4815cbd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4e721700 1 --2- 172.21.15.60:0/968034279 >> v2:172.21.15.144:3300/0 conn(0x7fed480cdab0 0x7fed4815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.654+0000 7fed4e721700 1 -- 172.21.15.60:0/968034279 >> 172.21.15.60:0/968034279 conn(0x7fed48067660 msgr2=0x7fed48067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.655+0000 7fed4e721700 1 -- 172.21.15.60:0/968034279 shutdown_connections 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.655+0000 7fed4e721700 1 -- 172.21.15.60:0/968034279 wait complete. 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.656+0000 7fed4e721700 1 Processor -- start 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.656+0000 7fed4e721700 1 -- start start 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed480cd6e0 0x7fed4814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 0x7fed48155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed48155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c9450 con 0x7fed480cdab0 2023-10-08T16:14:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480b3dd0 con 0x7fed480cd6e0 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480b4de0 con 0x7fed4815dda0 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4cf1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 0x7fed48155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4cf1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 0x7fed48155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45412/0 (socket says 172.21.15.60:45412) 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed480cd6e0 0x7fed4814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4cf1e700 1 -- 172.21.15.60:0/1602022275 learned_addr learned my addr 172.21.15.60:0/1602022275 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4df20700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed48155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 -- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 msgr2=0x7fed48155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed48155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 -- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 msgr2=0x7fed48155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 0x7fed48155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 -- 172.21.15.60:0/1602022275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c009420 con 0x7fed480cd6e0 2023-10-08T16:14:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4cf1e700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 0x7fed48155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4d71f700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed480cd6e0 0x7fed4814ca60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed38001ed0 tx=0x7fed38001a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38007360 con 0x7fed480cd6e0 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380074e0 con 0x7fed480cd6e0 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed40009a20 con 0x7fed480cd6e0 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.657+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38004830 con 0x7fed480cd6e0 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.658+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed480c8e90 con 0x7fed480cd6e0 2023-10-08T16:14:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.658+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed480b4bb0 con 0x7fed480cd6e0 2023-10-08T16:14:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.659+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed38004ba0 con 0x7fed480cd6e0 2023-10-08T16:14:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.659+0000 7fed457fa700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.659+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fed38083840 con 0x7fed480cd6e0 2023-10-08T16:14:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.659+0000 7fed4cf1e700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.660+0000 7fed4cf1e700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed481567c0 tx=0x7fed3c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:32.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.665+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed38054910 con 0x7fed480cd6e0 2023-10-08T16:14:32.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.934+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fed4804bb80 con 0x7fed480cd6e0 2023-10-08T16:14:32.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.936+0000 7fed457fa700 1 -- 172.21.15.60:0/1602022275 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fed38018070 con 0x7fed480cd6e0 2023-10-08T16:14:32.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:32.936 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:14:32.938 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:14:32.941 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:14:32.944 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.946 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:14:32.948 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:14:32.950 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:14:32.951 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:14:32.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fed34066f30 msgr2=0x7fed340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed481567c0 tx=0x7fed3c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed480cd6e0 msgr2=0x7fed4814ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed480cd6e0 0x7fed4814ca60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed38001ed0 tx=0x7fed38001a00 comp rx=0 tx=0).stop 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 shutdown_connections 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed4815dda0 0x7fed48155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed480cd6e0 0x7fed4814ca60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 --2- 172.21.15.60:0/1602022275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed480cdab0 0x7fed48155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 >> 172.21.15.60:0/1602022275 conn(0x7fed48067660 msgr2=0x7fed4815d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 shutdown_connections 2023-10-08T16:14:32.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:32.938+0000 7fed4e721700 1 -- 172.21.15.60:0/1602022275 wait complete. 2023-10-08T16:14:32.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:33.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.072+0000 7fa1bb42e700 1 Processor -- start 2023-10-08T16:14:33.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.072+0000 7fa1bb42e700 1 -- start start 2023-10-08T16:14:33.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1bb42e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa1b4067d70 0x7fa1b415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1bb42e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b40cb370 con 0x7fa1b40b0890 2023-10-08T16:14:33.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1bb42e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b40b0c60 con 0x7fa1b406c630 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1bb42e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b406a1e0 con 0x7fa1b4067d70 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1b91ca700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa1b40b0890 0x7fa1b40cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50798/0 (socket says 172.21.15.60:50798) 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1b91ca700 1 -- 172.21.15.60:0/2770012495 learned_addr learned my addr 172.21.15.60:0/2770012495 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1b99cb700 1 --2- 172.21.15.60:0/2770012495 >> v2:172.21.15.144:3300/0 conn(0x7fa1b4067d70 0x7fa1b415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643251796 0 0) 0x7fa1b40cb370 con 0x7fa1b40b0890 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.073+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a0003570 con 0x7fa1b40b0890 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310598264 0 0) 0x7fa1a0003570 con 0x7fa1b40b0890 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 >> v2:172.21.15.144:3300/0 conn(0x7fa1b4067d70 msgr2=0x7fa1b415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 --2- 172.21.15.60:0/2770012495 >> v2:172.21.15.144:3300/0 conn(0x7fa1b4067d70 0x7fa1b415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 >> v1:172.21.15.144:6789/0 conn(0x7fa1b406c630 legacy=0x7fa1b4067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b406cb80 con 0x7fa1b40b0890 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fa1b0001470 con 0x7fa1b40b0890 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 >> v1:172.21.15.60:6789/0 conn(0x7fa1b40b0890 legacy=0x7fa1b40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0003a60 0x7fa1a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0004810 0x7fa1a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a00051c0 0x7fa1a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b406a1e0 con 0x7fa1a0003a60 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a000c050 con 0x7fa1a00051c0 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a000c210 con 0x7fa1a0004810 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b99cb700 1 --2- 172.21.15.60:0/2770012495 >> v2:172.21.15.144:3300/0 conn(0x7fa1b4067d70 0x7fa1b415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0003a60 0x7fa1a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b89c9700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0004810 0x7fa1a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b99cb700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a00051c0 0x7fa1a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b91ca700 1 -- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0004810 msgr2=0x7fa1a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0004810 0x7fa1a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b91ca700 1 -- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a00051c0 msgr2=0x7fa1a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a00051c0 0x7fa1a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b99cb700 1 -- 172.21.15.60:0/2770012495 reap_dead start 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.074+0000 7fa1b91ca700 1 -- 172.21.15.60:0/2770012495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0003570 con 0x7fa1a0003a60 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0003a60 0x7fa1a0003e30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c390 tx=0x7fa1b40cb2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371f5f737cea6dba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000cbe0 con 0x7fa1a0003a60 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b000cd40 con 0x7fa1a0003a60 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1abfff700 1 -- 172.21.15.60:0/2770012495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0005b70 con 0x7fa1a0003a60 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 -- 172.21.15.60:0/2770012495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0003a60 msgr2=0x7fa1a0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0003a60 0x7fa1a0003e30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c390 tx=0x7fa1b40cb2e0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 -- 172.21.15.60:0/2770012495 shutdown_connections 2023-10-08T16:14:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/2770012495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0003a60 0x7fa1a0003e30 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 -- 172.21.15.60:0/2770012495 >> 172.21.15.60:0/2770012495 conn(0x7fa1b406fe50 msgr2=0x7fa1b4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 -- 172.21.15.60:0/2770012495 shutdown_connections 2023-10-08T16:14:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.075+0000 7fa1bb42e700 1 -- 172.21.15.60:0/2770012495 wait complete. 2023-10-08T16:14:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 Processor -- start 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 -- start start 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0003a60 0x7fa1b40c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1b40b4290 0x7fa1b40c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 0x7fa1b415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c6e00 con 0x7fa1b415a220 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40b4700 con 0x7fa1b40b4290 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.077+0000 7fa1bb42e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c61f0 con 0x7fa1a0003a60 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 0x7fa1b415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 0x7fa1b415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45420/0 (socket says 172.21.15.60:45420) 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 -- 172.21.15.60:0/456747535 learned_addr learned my addr 172.21.15.60:0/456747535 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b89c9700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1b40b4290 0x7fa1b40c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0003a60 0x7fa1b40c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 -- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0003a60 msgr2=0x7fa1b40c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0003a60 0x7fa1b40c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 -- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1b40b4290 msgr2=0x7fa1b40c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1b40b4290 0x7fa1b40c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 -- 172.21.15.60:0/456747535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40c64d0 con 0x7fa1b415a220 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1b99cb700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 0x7fa1b415b210 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa1b406ee20 tx=0x7fa1ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00e040 con 0x7fa1b415a220 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac00f040 con 0x7fa1b415a220 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b40c67b0 con 0x7fa1b415a220 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00fe40 con 0x7fa1b415a220 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.078+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b40c77d0 con 0x7fa1b415a220 2023-10-08T16:14:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.079+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b40c6f70 con 0x7fa1b415a220 2023-10-08T16:14:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.080+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1ac015640 con 0x7fa1b415a220 2023-10-08T16:14:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.080+0000 7fa1a97fa700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa198066f30 0x7fa1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.080+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa1ac0849b0 con 0x7fa1b415a220 2023-10-08T16:14:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.080+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa198066f30 0x7fa1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.081+0000 7fa1b91ca700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa198066f30 0x7fa1980693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0007d10 tx=0x7fa1b0015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.085+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1ac051f70 con 0x7fa1b415a220 2023-10-08T16:14:33.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.281+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b404c3c0 con 0x7fa1b415a220 2023-10-08T16:14:33.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.282+0000 7fa1a97fa700 1 -- 172.21.15.60:0/456747535 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+12145 (secure 0 0 0) 0x7fa1ac055590 con 0x7fa1b415a220 2023-10-08T16:14:33.283 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:33.283 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":160,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:14:32.504782+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa198066f30 msgr2=0x7fa1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa198066f30 0x7fa1980693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0007d10 tx=0x7fa1b0015000 comp rx=0 tx=0).stop 2023-10-08T16:14:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 msgr2=0x7fa1b415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 0x7fa1b415b210 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa1b406ee20 tx=0x7fa1ac00b040 comp rx=0 tx=0).stop 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 shutdown_connections 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa198066f30 0x7fa1980693e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1a0003a60 0x7fa1b40c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1b415a220 0x7fa1b415b210 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 --2- 172.21.15.60:0/456747535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1b40b4290 0x7fa1b40c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 >> 172.21.15.60:0/456747535 conn(0x7fa1b406fe50 msgr2=0x7fa1b40cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 shutdown_connections 2023-10-08T16:14:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.284+0000 7fa1bb42e700 1 -- 172.21.15.60:0/456747535 wait complete. 2023-10-08T16:14:33.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:14:33.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:14:33.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.431+0000 7f93f740d700 1 Processor -- start 2023-10-08T16:14:33.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.431+0000 7f93f740d700 1 -- start start 2023-10-08T16:14:33.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f740d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f93f00b3570 0x7f93f015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f740d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00b14f0 con 0x7f93f00b4c30 2023-10-08T16:14:33.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f740d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00b17d0 con 0x7f93f00b4860 2023-10-08T16:14:33.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f740d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00b1ab0 con 0x7f93f00b3570 2023-10-08T16:14:33.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f59aa700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f93f00b4c30 0x7f93f00cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50808/0 (socket says 172.21.15.60:50808) 2023-10-08T16:14:33.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f59aa700 1 -- 172.21.15.60:0/1802144483 learned_addr learned my addr 172.21.15.60:0/1802144483 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.432+0000 7f93f49a8700 1 --2- 172.21.15.60:0/1802144483 >> v2:172.21.15.144:3300/0 conn(0x7f93f00b3570 0x7f93f015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917873809 0 0) 0x7f93f00b14f0 con 0x7f93f00b4c30 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d8003570 con 0x7f93f00b4c30 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232918925 0 0) 0x7f93f00b17d0 con 0x7f93f00b4860 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f00b14f0 con 0x7f93f00b4860 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93f49a8700 1 -- 172.21.15.60:0/1802144483 >> v1:172.21.15.144:6789/0 conn(0x7f93f00b4860 legacy=0x7f93f0159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93f49a8700 1 -- 172.21.15.60:0/1802144483 >> v1:172.21.15.60:6789/0 conn(0x7f93f00b4c30 legacy=0x7f93f00cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93f49a8700 1 -- 172.21.15.60:0/1802144483 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00b1d90 con 0x7f93f00b3570 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93f49a8700 1 --2- 172.21.15.60:0/1802144483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b3570 0x7f93f015a1a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f93e40098e0 tx=0x7f93e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955fe7ab41481ed7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4011630 con 0x7f93f00b3570 2023-10-08T16:14:33.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e4011790 con 0x7f93f00b3570 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.433+0000 7f93effff700 1 -- 172.21.15.60:0/1802144483 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4011b30 con 0x7f93f00b3570 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 -- 172.21.15.60:0/1802144483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b3570 msgr2=0x7f93f015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 --2- 172.21.15.60:0/1802144483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b3570 0x7f93f015a1a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f93e40098e0 tx=0x7f93e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 -- 172.21.15.60:0/1802144483 shutdown_connections 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 --2- 172.21.15.60:0/1802144483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b3570 0x7f93f015a1a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 -- 172.21.15.60:0/1802144483 >> 172.21.15.60:0/1802144483 conn(0x7f93f009a0f0 msgr2=0x7f93f0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 -- 172.21.15.60:0/1802144483 shutdown_connections 2023-10-08T16:14:33.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.434+0000 7f93f740d700 1 -- 172.21.15.60:0/1802144483 wait complete. 2023-10-08T16:14:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.435+0000 7f93f740d700 1 Processor -- start 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.435+0000 7f93f740d700 1 -- start start 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f740d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 0x7f93f014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f740d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b4860 0x7f93f016de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f740d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93f00b4c30 0x7f93f016e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f740d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0145540 con 0x7f93f00b3570 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f740d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0144930 con 0x7f93f00b4860 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f740d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0144c10 con 0x7f93f00b4c30 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 0x7f93f014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 0x7f93f014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45432/0 (socket says 172.21.15.60:45432) 2023-10-08T16:14:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 -- 172.21.15.60:0/3119006581 learned_addr learned my addr 172.21.15.60:0/3119006581 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f59aa700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93f00b4c30 0x7f93f016e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f49a8700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b4860 0x7f93f016de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 -- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93f00b4c30 msgr2=0x7f93f016e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93f00b4c30 0x7f93f016e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 -- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b4860 msgr2=0x7f93f016de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b4860 0x7f93f016de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 -- 172.21.15.60:0/3119006581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4009420 con 0x7f93f00b3570 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.436+0000 7f93f51a9700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 0x7f93f014ff30 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f93e000cd80 tx=0x7f93e0002c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.437+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000aac0 con 0x7f93f00b3570 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.437+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000ac20 con 0x7f93f00b3570 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.437+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0012420 con 0x7f93f00b3570 2023-10-08T16:14:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.437+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f0144ef0 con 0x7f93f00b3570 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.437+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f0144500 con 0x7f93f00b3570 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.439+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f004c3c0 con 0x7f93f00b3570 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.439+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93e00127d0 con 0x7f93f00b3570 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.439+0000 7f93ed7fa700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f93dc066f30 0x7f93dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.439+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f93e0084920 con 0x7f93f00b3570 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.439+0000 7f93f49a8700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f93dc066f30 0x7f93dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.439+0000 7f93f49a8700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f93dc066f30 0x7f93dc0693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f93e40093f0 tx=0x7f93e4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.443+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93e0051f90 con 0x7f93f00b3570 2023-10-08T16:14:33.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.636+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93f00b66c0 con 0x7f93f00b3570 2023-10-08T16:14:33.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.636+0000 7f93ed7fa700 1 -- 172.21.15.60:0/3119006581 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93e00160a0 con 0x7f93f00b3570 2023-10-08T16:14:33.638 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f93dc066f30 msgr2=0x7f93dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f93dc066f30 0x7f93dc0693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f93e40093f0 tx=0x7f93e4017000 comp rx=0 tx=0).stop 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 msgr2=0x7f93f014ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 0x7f93f014ff30 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f93e000cd80 tx=0x7f93e0002c30 comp rx=0 tx=0).stop 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 shutdown_connections 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f93dc066f30 0x7f93dc0693e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93f00b4c30 0x7f93f016e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93f00b3570 0x7f93f014ff30 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 --2- 172.21.15.60:0/3119006581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93f00b4860 0x7f93f016de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 >> 172.21.15.60:0/3119006581 conn(0x7f93f009a0f0 msgr2=0x7f93f015c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:33.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 shutdown_connections 2023-10-08T16:14:33.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.638+0000 7f93f740d700 1 -- 172.21.15.60:0/3119006581 wait complete. 2023-10-08T16:14:33.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:14:33.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:33.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:33.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.771+0000 7f12da07f700 1 Processor -- start 2023-10-08T16:14:33.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.771+0000 7f12da07f700 1 -- start start 2023-10-08T16:14:33.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.772+0000 7f12da07f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.772+0000 7f12da07f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d415cbb0 con 0x7f12d4157870 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.772+0000 7f12da07f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d415bfa0 con 0x7f12d415d580 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.772+0000 7f12da07f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d415bdb0 con 0x7f12d415a620 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.772+0000 7f12d37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f12d4157870 0x7f12d415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50814/0 (socket says 172.21.15.60:50814) 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.772+0000 7f12d37fe700 1 -- 172.21.15.60:0/4136487062 learned_addr learned my addr 172.21.15.60:0/4136487062 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d2ffd700 1 --2- 172.21.15.60:0/4136487062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854806420 0 0) 0x7f12d415cbb0 con 0x7f12d4157870 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12bc003570 con 0x7f12d4157870 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005758892 0 0) 0x7f12d415bfa0 con 0x7f12d415d580 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d415cbb0 con 0x7f12d415d580 2023-10-08T16:14:33.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d2ffd700 1 -- 172.21.15.60:0/4136487062 >> v1:172.21.15.144:6789/0 conn(0x7f12d415d580 legacy=0x7f12d4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d2ffd700 1 -- 172.21.15.60:0/4136487062 >> v1:172.21.15.60:6789/0 conn(0x7f12d4157870 legacy=0x7f12d415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d2ffd700 1 -- 172.21.15.60:0/4136487062 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d415c280 con 0x7f12d415a620 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d2ffd700 1 --2- 172.21.15.60:0/4136487062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d415d040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009910 tx=0x7f12c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b64d84645d2a7abd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8011630 con 0x7f12d415a620 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8011790 con 0x7f12d415a620 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.773+0000 7f12d27fc700 1 -- 172.21.15.60:0/4136487062 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8011b10 con 0x7f12d415a620 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 -- 172.21.15.60:0/4136487062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 msgr2=0x7f12d415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 --2- 172.21.15.60:0/4136487062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d415d040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009910 tx=0x7f12c80091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 -- 172.21.15.60:0/4136487062 shutdown_connections 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 --2- 172.21.15.60:0/4136487062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d415d040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 -- 172.21.15.60:0/4136487062 >> 172.21.15.60:0/4136487062 conn(0x7f12d4068ce0 msgr2=0x7f12d40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:33.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 -- 172.21.15.60:0/4136487062 shutdown_connections 2023-10-08T16:14:33.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.774+0000 7f12da07f700 1 -- 172.21.15.60:0/4136487062 wait complete. 2023-10-08T16:14:33.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.775+0000 7f12da07f700 1 Processor -- start 2023-10-08T16:14:33.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.775+0000 7f12da07f700 1 -- start start 2023-10-08T16:14:33.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12da07f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12d4157870 0x7f12d41486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12da07f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12da07f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 0x7f12d4159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12da07f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4148c00 con 0x7f12d415d580 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12da07f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d415a340 con 0x7f12d4157870 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12da07f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d415a060 con 0x7f12d415a620 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 0x7f12d4159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 0x7f12d4159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45434/0 (socket says 172.21.15.60:45434) 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12d3fff700 1 -- 172.21.15.60:0/4185143114 learned_addr learned my addr 172.21.15.60:0/4185143114 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12d37fe700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12d4157870 0x7f12d41486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.776+0000 7f12d2ffd700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12d3fff700 1 -- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 msgr2=0x7f12d414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12d3fff700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d414a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12d3fff700 1 -- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12d4157870 msgr2=0x7f12d41486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12d3fff700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12d4157870 0x7f12d41486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12d3fff700 1 -- 172.21.15.60:0/4185143114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009420 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12d3fff700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 0x7f12d4159480 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c830 tx=0x7f12cc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc012630 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc012790 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc012b50 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d40b1c10 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.777+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d40b21d0 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.778+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d40b1a70 con 0x7f12d415d580 2023-10-08T16:14:33.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.779+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12cc01a3b0 con 0x7f12d415d580 2023-10-08T16:14:33.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.779+0000 7f12bb7fe700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12c0066f30 0x7f12c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:33.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.779+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f12cc083e40 con 0x7f12d415d580 2023-10-08T16:14:33.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.779+0000 7f12d37fe700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12c0066f30 0x7f12c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:33.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.780+0000 7f12d37fe700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12c0066f30 0x7f12c00693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f12c4007fd0 tx=0x7f12c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:33.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.784+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12d40b1a70 con 0x7f12d415d580 2023-10-08T16:14:33.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.979+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f12d41584d0 con 0x7f12d415d580 2023-10-08T16:14:33.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.980+0000 7f12bb7fe700 1 -- 172.21.15.60:0/4185143114 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v160) v1 ==== 84+0+65 (secure 0 0 0) 0x7f12d41584d0 con 0x7f12d415d580 2023-10-08T16:14:33.981 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:33.981 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:14:33.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:14:33.982 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:14:33.982 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:14:33.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:14:33.982 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12c0066f30 msgr2=0x7f12c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12c0066f30 0x7f12c00693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f12c4007fd0 tx=0x7f12c4009040 comp rx=0 tx=0).stop 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 msgr2=0x7f12d4159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 0x7f12d4159480 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c830 tx=0x7f12cc007f90 comp rx=0 tx=0).stop 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 shutdown_connections 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f12c0066f30 0x7f12c00693e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d415d580 0x7f12d4159480 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12d4157870 0x7f12d41486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 --2- 172.21.15.60:0/4185143114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12d415a620 0x7f12d414a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:33.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 >> 172.21.15.60:0/4185143114 conn(0x7f12d4068ce0 msgr2=0x7f12d40b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:33.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 shutdown_connections 2023-10-08T16:14:33.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:33.982+0000 7f12da07f700 1 -- 172.21.15.60:0/4185143114 wait complete. 2023-10-08T16:14:33.995 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:14:33.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:14:34.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.117+0000 7f0559435700 1 Processor -- start 2023-10-08T16:14:34.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.117+0000 7f0559435700 1 -- start start 2023-10-08T16:14:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0554068dd0 0x7f0554157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05540b0810 0x7f0554157c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0554069b10 con 0x7f05540cbd30 2023-10-08T16:14:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05541572b0 con 0x7f05540b0810 2023-10-08T16:14:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554069270 con 0x7f0554068dd0 2023-10-08T16:14:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05540b0810 0x7f0554157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05540b0810 0x7f0554157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45444/0 (socket says 172.21.15.60:45444) 2023-10-08T16:14:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 -- 172.21.15.60:0/2104624750 learned_addr learned my addr 172.21.15.60:0/2104624750 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f05537fe700 1 --2- 172.21.15.60:0/2104624750 >> v2:172.21.15.144:3300/0 conn(0x7f0554068dd0 0x7f0554157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 -- 172.21.15.60:0/2104624750 >> v2:172.21.15.144:3300/0 conn(0x7f0554068dd0 msgr2=0x7f0554157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 --2- 172.21.15.60:0/2104624750 >> v2:172.21.15.144:3300/0 conn(0x7f0554068dd0 0x7f0554157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 -- 172.21.15.60:0/2104624750 >> v1:172.21.15.144:6789/0 conn(0x7f05540cbd30 legacy=0x7f05540b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 -- 172.21.15.60:0/2104624750 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554069550 con 0x7f05540b0810 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0558c34700 1 --2- 172.21.15.60:0/2104624750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f0554157c80 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0554071210 tx=0x7f054c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27bb7ac46c3d62b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0552ffd700 1 -- 172.21.15.60:0/2104624750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c010070 con 0x7f05540b0810 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0552ffd700 1 -- 172.21.15.60:0/2104624750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00dde0 con 0x7f05540b0810 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0552ffd700 1 -- 172.21.15.60:0/2104624750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00b320 con 0x7f05540b0810 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- 172.21.15.60:0/2104624750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 msgr2=0x7f0554157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 --2- 172.21.15.60:0/2104624750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f0554157c80 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0554071210 tx=0x7f054c00ba50 comp rx=0 tx=0).stop 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- 172.21.15.60:0/2104624750 shutdown_connections 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 --2- 172.21.15.60:0/2104624750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f0554157c80 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 --2- 172.21.15.60:0/2104624750 >> v2:172.21.15.144:3300/0 conn(0x7f0554068dd0 0x7f0554157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- 172.21.15.60:0/2104624750 >> 172.21.15.60:0/2104624750 conn(0x7f0554067660 msgr2=0x7f0554067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- 172.21.15.60:0/2104624750 shutdown_connections 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.119+0000 7f0559435700 1 -- 172.21.15.60:0/2104624750 wait complete. 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.120+0000 7f0559435700 1 Processor -- start 2023-10-08T16:14:34.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 -- start start 2023-10-08T16:14:34.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0554068dd0 0x7f0554153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f05540a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05540cbd30 0x7f0554157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540aa540 con 0x7f05540b0810 2023-10-08T16:14:34.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540a8f90 con 0x7f0554068dd0 2023-10-08T16:14:34.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f0559435700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540a9270 con 0x7f05540cbd30 2023-10-08T16:14:34.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.122+0000 7f05537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f05540a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f05540a85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45446/0 (socket says 172.21.15.60:45446) 2023-10-08T16:14:34.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 -- 172.21.15.60:0/4265627699 learned_addr learned my addr 172.21.15.60:0/4265627699 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:34.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f0553fff700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0554068dd0 0x7f0554153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f0558c34700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05540cbd30 0x7f0554157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 -- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05540cbd30 msgr2=0x7f0554157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05540cbd30 0x7f0554157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 -- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0554068dd0 msgr2=0x7f0554153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0554068dd0 0x7f0554153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 -- 172.21.15.60:0/4265627699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c00bcf0 con 0x7f05540b0810 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f05537fe700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f05540a85b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e930 tx=0x7f053c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c013680 con 0x7f05540b0810 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c0137e0 con 0x7f05540b0810 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05540a9550 con 0x7f05540b0810 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c013b80 con 0x7f05540b0810 2023-10-08T16:14:34.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.123+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0554154460 con 0x7f05540b0810 2023-10-08T16:14:34.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.124+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055406c1a0 con 0x7f05540b0810 2023-10-08T16:14:34.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.124+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f053c00c3e0 con 0x7f05540b0810 2023-10-08T16:14:34.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.125+0000 7f054bfff700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0534066f30 0x7f05340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.125+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f053c0842d0 con 0x7f05540b0810 2023-10-08T16:14:34.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.125+0000 7f0553fff700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0534066f30 0x7f05340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.125+0000 7f0553fff700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0534066f30 0x7f05340693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0544003a80 tx=0x7f0544007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:34.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.129+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f053c051890 con 0x7f05540b0810 2023-10-08T16:14:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.320+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f05540aa680 con 0x7f05540b0810 2023-10-08T16:14:34.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.517+0000 7f054bfff700 1 -- 172.21.15.60:0/4265627699 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v161) v1 ==== 138+0+0 (secure 0 0 0) 0x7f053c054eb0 con 0x7f05540b0810 2023-10-08T16:14:34.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.520+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0534066f30 msgr2=0x7f05340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.520+0000 7f0559435700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0534066f30 0x7f05340693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0544003a80 tx=0x7f0544007ec0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.520+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 msgr2=0x7f05540a85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.520+0000 7f0559435700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f05540a85b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e930 tx=0x7f053c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 shutdown_connections 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0534066f30 0x7f05340693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05540cbd30 0x7f0554157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0554068dd0 0x7f0554153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 --2- 172.21.15.60:0/4265627699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05540b0810 0x7f05540a85b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 >> 172.21.15.60:0/4265627699 conn(0x7f0554067660 msgr2=0x7f05540ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.521+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 shutdown_connections 2023-10-08T16:14:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.522+0000 7f0559435700 1 -- 172.21.15.60:0/4265627699 wait complete. 2023-10-08T16:14:34.523 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:14:34.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:14:34.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.661+0000 7efefacd7700 1 Processor -- start 2023-10-08T16:14:34.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.661+0000 7efefacd7700 1 -- start start 2023-10-08T16:14:34.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efefacd7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efef40cbf10 0x7efef415e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efefacd7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef40cae70 con 0x7efef40678b0 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efefacd7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef40cb150 con 0x7efef40c9390 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efefacd7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40cb430 con 0x7efef40cbf10 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efef40cbf10 0x7efef415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef8a73700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efef40678b0 0x7efef415db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50826/0 (socket says 172.21.15.60:50826) 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef8a73700 1 -- 172.21.15.60:0/1001904581 learned_addr learned my addr 172.21.15.60:0/1001904581 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef3fff700 1 -- 172.21.15.60:0/1001904581 >> v1:172.21.15.144:6789/0 conn(0x7efef40c9390 legacy=0x7efef415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef3fff700 1 -- 172.21.15.60:0/1001904581 >> v1:172.21.15.60:6789/0 conn(0x7efef40678b0 legacy=0x7efef415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef3fff700 1 -- 172.21.15.60:0/1001904581 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40cb710 con 0x7efef40cbf10 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef37fe700 1 -- 172.21.15.60:0/1001904581 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682694426 0 0) 0x7efef40cae70 con 0x7efef40678b0 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef3fff700 1 --2- 172.21.15.60:0/1001904581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40cbf10 0x7efef415e290 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7efee40098e0 tx=0x7efee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f39b843901d0ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:34.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef37fe700 1 -- 172.21.15.60:0/1001904581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4009e80 con 0x7efef40cbf10 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef37fe700 1 -- 172.21.15.60:0/1001904581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400b860 con 0x7efef40cbf10 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.662+0000 7efef37fe700 1 -- 172.21.15.60:0/1001904581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400bbe0 con 0x7efef40cbf10 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 -- 172.21.15.60:0/1001904581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40cbf10 msgr2=0x7efef415e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 --2- 172.21.15.60:0/1001904581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40cbf10 0x7efef415e290 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7efee40098e0 tx=0x7efee40091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 -- 172.21.15.60:0/1001904581 shutdown_connections 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 --2- 172.21.15.60:0/1001904581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40cbf10 0x7efef415e290 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 -- 172.21.15.60:0/1001904581 >> 172.21.15.60:0/1001904581 conn(0x7efef4069870 msgr2=0x7efef4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 -- 172.21.15.60:0/1001904581 shutdown_connections 2023-10-08T16:14:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.663+0000 7efefacd7700 1 -- 172.21.15.60:0/1001904581 wait complete. 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.664+0000 7efefacd7700 1 Processor -- start 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.664+0000 7efefacd7700 1 -- start start 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efefacd7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 0x7efef416a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efefacd7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efef40c9390 0x7efef41550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efefacd7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efef40cbf10 0x7efef4155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efefacd7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40c7570 con 0x7efef40678b0 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efefacd7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40c8820 con 0x7efef40c9390 2023-10-08T16:14:34.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efefacd7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef40c7c10 con 0x7efef40cbf10 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 0x7efef416a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 0x7efef416a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45464/0 (socket says 172.21.15.60:45464) 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 -- 172.21.15.60:0/861366289 learned_addr learned my addr 172.21.15.60:0/861366289 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef3fff700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efef40c9390 0x7efef41550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef9274700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efef40cbf10 0x7efef4155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 -- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efef40cbf10 msgr2=0x7efef4155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efef40cbf10 0x7efef4155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 -- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efef40c9390 msgr2=0x7efef41550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efef40c9390 0x7efef41550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.665+0000 7efef8a73700 1 -- 172.21.15.60:0/861366289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4009420 con 0x7efef40678b0 2023-10-08T16:14:34.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.666+0000 7efef8a73700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 0x7efef416a060 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7efeec00ccc0 tx=0x7efeec001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.666+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00ab70 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.666+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec00acd0 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.666+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec007340 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.666+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef40c7ef0 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.666+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef40c84b0 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.667+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef40c8b00 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.667+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efeec007770 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.668+0000 7efef0ff9700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.668+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5223+0+0 (secure 0 0 0) 0x7efeec084800 con 0x7efef40678b0 2023-10-08T16:14:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.668+0000 7efef3fff700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:34.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.668+0000 7efef3fff700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efee40093f0 tx=0x7efee4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:34.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.672+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeec051cd0 con 0x7efef40678b0 2023-10-08T16:14:34.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:34.866+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efef404c3c0 con 0x7efef40678b0 2023-10-08T16:14:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.522+0000 7efef0ff9700 1 -- 172.21.15.60:0/861366289 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v162) v1 ==== 170+0+0 (secure 0 0 0) 0x7efeec0552f0 con 0x7efef40678b0 2023-10-08T16:14:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 msgr2=0x7efed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efee40093f0 tx=0x7efee4017000 comp rx=0 tx=0).stop 2023-10-08T16:14:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 msgr2=0x7efef416a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 0x7efef416a060 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7efeec00ccc0 tx=0x7efeec001a80 comp rx=0 tx=0).stop 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 shutdown_connections 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efed4066f30 0x7efed40693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efef40cbf10 0x7efef4155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efef40678b0 0x7efef416a060 secure :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7efeec00ccc0 tx=0x7efeec001a80 comp rx=0 tx=0).stop 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 --2- 172.21.15.60:0/861366289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efef40c9390 0x7efef41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 >> 172.21.15.60:0/861366289 conn(0x7efef4069870 msgr2=0x7efef406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:35.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.534+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 shutdown_connections 2023-10-08T16:14:35.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.535+0000 7efefacd7700 1 -- 172.21.15.60:0/861366289 wait complete. 2023-10-08T16:14:35.536 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:14:35.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:14:35.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.671+0000 7f78c5360700 1 Processor -- start 2023-10-08T16:14:35.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.671+0000 7f78c5360700 1 -- start start 2023-10-08T16:14:35.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.671+0000 7f78c5360700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 0x7f78c00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.671+0000 7f78c5360700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00d0640 con 0x7f78c00cdf20 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78c5360700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00cfa30 con 0x7f78c00d0ad0 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78c5360700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00cfd10 con 0x7f78c00cdb50 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bf7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f78c00cdf20 0x7f78c00b0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50838/0 (socket says 172.21.15.60:50838) 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bf7fe700 1 -- 172.21.15.60:0/2436622323 learned_addr learned my addr 172.21.15.60:0/2436622323 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757055023 0 0) 0x7f78c00d0640 con 0x7f78c00cdf20 2023-10-08T16:14:35.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ac003570 con 0x7f78c00cdf20 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78beffd700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 0x7f78c00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3783031768 0 0) 0x7f78ac003570 con 0x7f78c00cdf20 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 msgr2=0x7f78c00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 0x7f78c00cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 >> v1:172.21.15.144:6789/0 conn(0x7f78c00d0ad0 legacy=0x7f78c0159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00cfff0 con 0x7f78c00cdf20 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f78b00017f0 con 0x7f78c00cdf20 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 >> v1:172.21.15.60:6789/0 conn(0x7f78c00cdf20 legacy=0x7f78c00b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac003a90 0x7f78ac003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac004810 0x7f78ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 0x7f78ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00cfd10 con 0x7f78ac004810 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac00bb10 con 0x7f78ac003a90 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.672+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac00bcd0 con 0x7f78c00cdb50 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac004810 0x7f78ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78beffd700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac003a90 0x7f78ac003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78bf7fe700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 0x7f78ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 -- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 msgr2=0x7f78ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c00cdb50 0x7f78ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 -- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac003a90 msgr2=0x7f78ac003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac003a90 0x7f78ac003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 -- 172.21.15.60:0/2436622323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac003570 con 0x7f78ac004810 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78be7fc700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac004810 0x7f78ac004c80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f78a80019a0 tx=0x7f78a8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9439def4f5d43568 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800c5d0 con 0x7f78ac004810 2023-10-08T16:14:35.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800c750 con 0x7f78ac004810 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.673+0000 7f78bdffb700 1 -- 172.21.15.60:0/2436622323 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800cb10 con 0x7f78ac004810 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78c5360700 1 -- 172.21.15.60:0/2436622323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac004810 msgr2=0x7f78ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78c5360700 1 --2- 172.21.15.60:0/2436622323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac004810 0x7f78ac004c80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f78a80019a0 tx=0x7f78a8007d10 comp rx=0 tx=0).stop 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78bf7fe700 1 -- 172.21.15.60:0/2436622323 reap_dead start 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78c5360700 1 -- 172.21.15.60:0/2436622323 shutdown_connections 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78c5360700 1 -- 172.21.15.60:0/2436622323 >> 172.21.15.60:0/2436622323 conn(0x7f78c00d0fd0 msgr2=0x7f78c00d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78c5360700 1 -- 172.21.15.60:0/2436622323 shutdown_connections 2023-10-08T16:14:35.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.674+0000 7f78c5360700 1 -- 172.21.15.60:0/2436622323 wait complete. 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.675+0000 7f78c5360700 1 Processor -- start 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.675+0000 7f78c5360700 1 -- start start 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78ac004810 0x7f78c014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 0x7f78c015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c00b24a0 0x7f78c00b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00b2e50 con 0x7f78c00b5e10 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00c9760 con 0x7f78c00b24a0 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c015d050 con 0x7f78ac004810 2023-10-08T16:14:35.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 0x7f78c015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 0x7f78c015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45486/0 (socket says 172.21.15.60:45486) 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 -- 172.21.15.60:0/223221237 learned_addr learned my addr 172.21.15.60:0/223221237 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78bf7fe700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c00b24a0 0x7f78c00b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78beffd700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78ac004810 0x7f78c014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 -- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78ac004810 msgr2=0x7f78c014dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78ac004810 0x7f78c014dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 -- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c00b24a0 msgr2=0x7f78c00b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c00b24a0 0x7f78c00b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 -- 172.21.15.60:0/223221237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c015ba80 con 0x7f78c00b5e10 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78beffd700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78ac004810 0x7f78c014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78be7fc700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 0x7f78c015b3f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f78ac004770 tx=0x7f78a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:35.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8007af0 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800c5d0 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c00b2e50 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800cb10 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.676+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c015c040 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.677+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c00c98d0 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.678+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78a8019030 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.678+0000 7f78b6ffd700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.678+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f78a80858d0 con 0x7f78c00b5e10 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.678+0000 7f78beffd700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.679+0000 7f78beffd700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78b8006f00 tx=0x7f78b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:35.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.683+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78a8052c60 con 0x7f78c00b5e10 2023-10-08T16:14:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:35.920+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78c00c9550 con 0x7f78c00b5e10 2023-10-08T16:14:36.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.540+0000 7f78b6ffd700 1 -- 172.21.15.60:0/223221237 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7f78a80220c0 con 0x7f78c00b5e10 2023-10-08T16:14:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a0066f30 msgr2=0x7f78a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78b8006f00 tx=0x7f78b8008040 comp rx=0 tx=0).stop 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 msgr2=0x7f78c015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 0x7f78c015b3f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f78ac004770 tx=0x7f78a8015000 comp rx=0 tx=0).stop 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 shutdown_connections 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78ac004810 0x7f78c014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c00b24a0 0x7f78c00b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 --2- 172.21.15.60:0/223221237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c00b5e10 0x7f78c015b3f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 >> 172.21.15.60:0/223221237 conn(0x7f78c00d0fd0 msgr2=0x7f78c00b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 shutdown_connections 2023-10-08T16:14:36.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.545+0000 7f78c5360700 1 -- 172.21.15.60:0/223221237 wait complete. 2023-10-08T16:14:36.547 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 20 and data pool 21 2023-10-08T16:14:36.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:36.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.683+0000 7fc6833c8700 1 Processor -- start 2023-10-08T16:14:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc6833c8700 1 -- start start 2023-10-08T16:14:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc6833c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc6833c8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc67c15a1e0 0x7fc67c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc6833c8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c15db80 con 0x7fc67c0b1610 2023-10-08T16:14:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc6833c8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c15e800 con 0x7fc67c15a1e0 2023-10-08T16:14:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc6833c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c15de60 con 0x7fc67c159e10 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc680963700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc67c15a1e0 0x7fc67c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc681965700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc67c0b1610 0x7fc67c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50854/0 (socket says 172.21.15.60:50854) 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.684+0000 7fc681965700 1 -- 172.21.15.60:0/3830959237 learned_addr learned my addr 172.21.15.60:0/3830959237 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc681164700 1 --2- 172.21.15.60:0/3830959237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc680963700 1 -- 172.21.15.60:0/3830959237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 msgr2=0x7fc67c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc680963700 1 --2- 172.21.15.60:0/3830959237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc680963700 1 -- 172.21.15.60:0/3830959237 >> v1:172.21.15.60:6789/0 conn(0x7fc67c0b1610 legacy=0x7fc67c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc680963700 1 -- 172.21.15.60:0/3830959237 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c15e140 con 0x7fc67c15a1e0 2023-10-08T16:14:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc67bfff700 1 -- 172.21.15.60:0/3830959237 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322885427 0 0) 0x7fc67c15db80 con 0x7fc67c0b1610 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc680963700 1 --2- 172.21.15.60:0/3830959237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0b3260 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc6700098e0 tx=0x7fc6700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e4b5a1ff0ebbdc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc67bfff700 1 -- 172.21.15.60:0/3830959237 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000b640 con 0x7fc67c15a1e0 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc67bfff700 1 -- 172.21.15.60:0/3830959237 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67000b7a0 con 0x7fc67c15a1e0 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.685+0000 7fc67bfff700 1 -- 172.21.15.60:0/3830959237 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000bb40 con 0x7fc67c15a1e0 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 -- 172.21.15.60:0/3830959237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c15a1e0 msgr2=0x7fc67c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3830959237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0b3260 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc6700098e0 tx=0x7fc6700091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 -- 172.21.15.60:0/3830959237 shutdown_connections 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3830959237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3830959237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0b3260 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 -- 172.21.15.60:0/3830959237 >> 172.21.15.60:0/3830959237 conn(0x7fc67c067660 msgr2=0x7fc67c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 -- 172.21.15.60:0/3830959237 shutdown_connections 2023-10-08T16:14:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.686+0000 7fc6833c8700 1 -- 172.21.15.60:0/3830959237 wait complete. 2023-10-08T16:14:36.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.687+0000 7fc6833c8700 1 Processor -- start 2023-10-08T16:14:36.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.687+0000 7fc6833c8700 1 -- start start 2023-10-08T16:14:36.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6833c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 0x7fc67c14d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6833c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6833c8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6833c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0cf7f0 con 0x7fc67c0b1610 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6833c8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0c4a00 con 0x7fc67c15a1e0 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6833c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0cebe0 con 0x7fc67c159e10 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 0x7fc67c14d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 0x7fc67c14d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45508/0 (socket says 172.21.15.60:45508) 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 -- 172.21.15.60:0/3365111971 learned_addr learned my addr 172.21.15.60:0/3365111971 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 -- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 msgr2=0x7fc67c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc680963700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681965700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 -- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc67c15a1e0 msgr2=0x7fc67c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 -- 172.21.15.60:0/3365111971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc670009420 con 0x7fc67c0b1610 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc681164700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 0x7fc67c14d1a0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc67400ec80 tx=0x7fc6740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400c9d0 con 0x7fc67c0b1610 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.688+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400cb30 con 0x7fc67c0b1610 2023-10-08T16:14:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.689+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c0ceec0 con 0x7fc67c0b1610 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.689+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674013470 con 0x7fc67c0b1610 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.689+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c0cf480 con 0x7fc67c0b1610 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.690+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0cffa0 con 0x7fc67c0b1610 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.690+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc674013820 con 0x7fc67c0b1610 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.690+0000 7fc6797fa700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc668066f30 0x7fc6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.691+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6740848a0 con 0x7fc67c0b1610 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.691+0000 7fc680963700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc668066f30 0x7fc6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.691+0000 7fc680963700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc668066f30 0x7fc6680693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc67c159930 tx=0x7fc670017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:36.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.695+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc674051b10 con 0x7fc67c0b1610 2023-10-08T16:14:36.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.889+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc67c04c3c0 con 0x7fc67c0b1610 2023-10-08T16:14:36.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.890+0000 7fc6797fa700 1 -- 172.21.15.60:0/3365111971 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fc674055130 con 0x7fc67c0b1610 2023-10-08T16:14:36.890 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:36.890 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":163,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:14:35.921422+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:14:34.351205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T16:14:34.896986+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:36.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc668066f30 msgr2=0x7fc6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc668066f30 0x7fc6680693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc67c159930 tx=0x7fc670017000 comp rx=0 tx=0).stop 2023-10-08T16:14:36.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 msgr2=0x7fc67c14d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 0x7fc67c14d1a0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc67400ec80 tx=0x7fc6740091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 shutdown_connections 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc668066f30 0x7fc6680693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc67c15a1e0 0x7fc67c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc67c0b1610 0x7fc67c14d1a0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 --2- 172.21.15.60:0/3365111971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc67c159e10 0x7fc67c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 >> 172.21.15.60:0/3365111971 conn(0x7fc67c067660 msgr2=0x7fc67c0633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 shutdown_connections 2023-10-08T16:14:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:36.892+0000 7fc6833c8700 1 -- 172.21.15.60:0/3365111971 wait complete. 2023-10-08T16:14:36.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:37.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.023+0000 7fca28cbb700 1 Processor -- start 2023-10-08T16:14:37.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.023+0000 7fca28cbb700 1 -- start start 2023-10-08T16:14:37.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.024+0000 7fca28cbb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 0x7fca24070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.024+0000 7fca28cbb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 0x7fca24070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.024+0000 7fca28cbb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca24068a90 con 0x7fca2415c4f0 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.024+0000 7fca28cbb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca240ca330 con 0x7fca2415b340 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.024+0000 7fca28cbb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2415ca70 con 0x7fca240cb000 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 0x7fca24070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca2259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 0x7fca24070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 0x7fca24070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:51784/0 (socket says 172.21.15.60:51784) 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca2259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 0x7fca24070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:33704/0 (socket says 172.21.15.60:33704) 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 -- 172.21.15.60:0/1978146569 learned_addr learned my addr 172.21.15.60:0/1978146569 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca22d9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fca2415c4f0 0x7fca24067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:44206/0 (socket says 172.21.15.60:44206) 2023-10-08T16:14:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 -- 172.21.15.60:0/1978146569 >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 msgr2=0x7fca24070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 --2- 172.21.15.60:0/1978146569 >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 0x7fca24070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 -- 172.21.15.60:0/1978146569 >> v1:172.21.15.144:6789/0 conn(0x7fca2415c4f0 legacy=0x7fca24067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 -- 172.21.15.60:0/1978146569 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24068f20 con 0x7fca240cb000 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca2259c700 1 --2- 172.21.15.60:0/1978146569 >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 0x7fca24070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca21d9b700 1 --2- 172.21.15.60:0/1978146569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 0x7fca24070c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca180099b0 tx=0x7fca18009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6440ef8eb55cd9c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca2159a700 1 -- 172.21.15.60:0/1978146569 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18009ea0 con 0x7fca240cb000 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca2159a700 1 -- 172.21.15.60:0/1978146569 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1800b860 con 0x7fca240cb000 2023-10-08T16:14:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.025+0000 7fca2159a700 1 -- 172.21.15.60:0/1978146569 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800bc00 con 0x7fca240cb000 2023-10-08T16:14:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 -- 172.21.15.60:0/1978146569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 msgr2=0x7fca24070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 --2- 172.21.15.60:0/1978146569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 0x7fca24070c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca180099b0 tx=0x7fca18009250 comp rx=0 tx=0).stop 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 -- 172.21.15.60:0/1978146569 shutdown_connections 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 --2- 172.21.15.60:0/1978146569 >> v2:172.21.15.144:3300/0 conn(0x7fca2415b340 0x7fca24070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 --2- 172.21.15.60:0/1978146569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca240cb000 0x7fca24070c40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 -- 172.21.15.60:0/1978146569 >> 172.21.15.60:0/1978146569 conn(0x7fca240ca4f0 msgr2=0x7fca240ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 -- 172.21.15.60:0/1978146569 shutdown_connections 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.026+0000 7fca28cbb700 1 -- 172.21.15.60:0/1978146569 wait complete. 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.027+0000 7fca28cbb700 1 Processor -- start 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.027+0000 7fca28cbb700 1 -- start start 2023-10-08T16:14:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca28cbb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 0x7fca241537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca28cbb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca2415b340 0x7fca241685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca28cbb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2415c4f0 0x7fca24152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca28cbb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240b2af0 con 0x7fca240cb000 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca28cbb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca24169280 con 0x7fca2415c4f0 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca28cbb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240b1a50 con 0x7fca2415b340 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 0x7fca241537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 0x7fca241537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45516/0 (socket says 172.21.15.60:45516) 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 -- 172.21.15.60:0/2902170736 learned_addr learned my addr 172.21.15.60:0/2902170736 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca21d9b700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca2415b340 0x7fca241685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca22d9d700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2415c4f0 0x7fca24152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 -- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca2415b340 msgr2=0x7fca241685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca2415b340 0x7fca241685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 -- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2415c4f0 msgr2=0x7fca24152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2415c4f0 0x7fca24152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.028+0000 7fca2259c700 1 -- 172.21.15.60:0/2902170736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14009420 con 0x7fca240cb000 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.029+0000 7fca2259c700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 0x7fca241537c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fca1400ec80 tx=0x7fca140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.029+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1400c920 con 0x7fca240cb000 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.029+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1400ca80 con 0x7fca240cb000 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.029+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca180094f0 con 0x7fca240cb000 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.029+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1400ce00 con 0x7fca240cb000 2023-10-08T16:14:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.029+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca240b22f0 con 0x7fca240cb000 2023-10-08T16:14:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.030+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2404c3c0 con 0x7fca240cb000 2023-10-08T16:14:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.030+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca14013680 con 0x7fca240cb000 2023-10-08T16:14:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.031+0000 7fca127fc700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca04066f60 0x7fca04069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.031+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca14084890 con 0x7fca240cb000 2023-10-08T16:14:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.031+0000 7fca21d9b700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca04066f60 0x7fca04069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.031+0000 7fca21d9b700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca04066f60 0x7fca04069410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fca180099b0 tx=0x7fca18017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.035+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca14051b00 con 0x7fca240cb000 2023-10-08T16:14:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.228+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca2406b620 con 0x7fca240cb000 2023-10-08T16:14:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.229+0000 7fca127fc700 1 -- 172.21.15.60:0/2902170736 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fca14055120 con 0x7fca240cb000 2023-10-08T16:14:37.229 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:37.230 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":163,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:14:35.921422+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:14:34.351205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T16:14:34.896986+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca04066f60 msgr2=0x7fca04069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca04066f60 0x7fca04069410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fca180099b0 tx=0x7fca18017000 comp rx=0 tx=0).stop 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 msgr2=0x7fca241537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 0x7fca241537c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fca1400ec80 tx=0x7fca140091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 shutdown_connections 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fca04066f60 0x7fca04069410 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2415c4f0 0x7fca24152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca240cb000 0x7fca241537c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 --2- 172.21.15.60:0/2902170736 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca2415b340 0x7fca241685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 >> 172.21.15.60:0/2902170736 conn(0x7fca240ca4f0 msgr2=0x7fca2406e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 shutdown_connections 2023-10-08T16:14:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.231+0000 7fca28cbb700 1 -- 172.21.15.60:0/2902170736 wait complete. 2023-10-08T16:14:37.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:14:37.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.365+0000 7fc92f53d700 1 Processor -- start 2023-10-08T16:14:37.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.365+0000 7fc92f53d700 1 -- start start 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92f53d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9280cd850 0x7fc9280b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92f53d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92815e660 con 0x7fc9280cba70 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92f53d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92815da50 con 0x7fc9280cdc20 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92f53d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92815d870 con 0x7fc9280cd850 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92dd3a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc9280cba70 0x7fc928157250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50862/0 (socket says 172.21.15.60:50862) 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92dd3a700 1 -- 172.21.15.60:0/1318630175 learned_addr learned my addr 172.21.15.60:0/1318630175 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92e53b700 1 --2- 172.21.15.60:0/1318630175 >> v2:172.21.15.144:3300/0 conn(0x7fc9280cd850 0x7fc9280b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357547943 0 0) 0x7fc92815e660 con 0x7fc9280cba70 2023-10-08T16:14:37.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.366+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc910003570 con 0x7fc9280cba70 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595951034 0 0) 0x7fc910003570 con 0x7fc9280cba70 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 >> v2:172.21.15.144:3300/0 conn(0x7fc9280cd850 msgr2=0x7fc9280b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 --2- 172.21.15.60:0/1318630175 >> v2:172.21.15.144:3300/0 conn(0x7fc9280cd850 0x7fc9280b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 >> v1:172.21.15.144:6789/0 conn(0x7fc9280cdc20 legacy=0x7fc92815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92815dd30 con 0x7fc9280cba70 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fc91c001470 con 0x7fc9280cba70 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 >> v1:172.21.15.60:6789/0 conn(0x7fc9280cba70 legacy=0x7fc928157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc910003a60 0x7fc910003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc910004810 0x7fc910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100051c0 0x7fc91000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92815d870 con 0x7fc9100051c0 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91000c160 con 0x7fc910004810 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91000c320 con 0x7fc910003a60 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100051c0 0x7fc91000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92dd3a700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc910004810 0x7fc910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92e53b700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc910003a60 0x7fc910003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 -- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc910003a60 msgr2=0x7fc910003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc910003a60 0x7fc910003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 -- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc910004810 msgr2=0x7fc910004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc910004810 0x7fc910004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 -- 172.21.15.60:0/1318630175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910003570 con 0x7fc9100051c0 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 -- 172.21.15.60:0/1318630175 reap_dead start 2023-10-08T16:14:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.367+0000 7fc92ed3c700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100051c0 0x7fc91000ba60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc918001fc0 tx=0x7fc918001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84be9a57e83f429 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918001950 con 0x7fc9100051c0 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800c8b0 con 0x7fc9100051c0 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92d539700 1 -- 172.21.15.60:0/1318630175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800cc50 con 0x7fc9100051c0 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 -- 172.21.15.60:0/1318630175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100051c0 msgr2=0x7fc91000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100051c0 0x7fc91000ba60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc918001fc0 tx=0x7fc918001640 comp rx=0 tx=0).stop 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 -- 172.21.15.60:0/1318630175 shutdown_connections 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 --2- 172.21.15.60:0/1318630175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9100051c0 0x7fc91000ba60 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 -- 172.21.15.60:0/1318630175 >> 172.21.15.60:0/1318630175 conn(0x7fc928067660 msgr2=0x7fc928067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 -- 172.21.15.60:0/1318630175 shutdown_connections 2023-10-08T16:14:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.368+0000 7fc92f53d700 1 -- 172.21.15.60:0/1318630175 wait complete. 2023-10-08T16:14:37.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.369+0000 7fc92f53d700 1 Processor -- start 2023-10-08T16:14:37.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.369+0000 7fc92f53d700 1 -- start start 2023-10-08T16:14:37.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92f53d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9100051c0 0x7fc9280c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92f53d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 0x7fc9280ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92f53d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9280cbf50 0x7fc9280cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92f53d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280cc900 con 0x7fc928152120 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92f53d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280c8fd0 con 0x7fc9280cbf50 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92f53d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280cae30 con 0x7fc9100051c0 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92dd3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 0x7fc9280ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92dd3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 0x7fc9280ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45532/0 (socket says 172.21.15.60:45532) 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92dd3a700 1 -- 172.21.15.60:0/3609737113 learned_addr learned my addr 172.21.15.60:0/3609737113 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92e53b700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9100051c0 0x7fc9280c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.370+0000 7fc92ed3c700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9280cbf50 0x7fc9280cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92dd3a700 1 -- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9100051c0 msgr2=0x7fc9280c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92dd3a700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9100051c0 0x7fc9280c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92dd3a700 1 -- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9280cbf50 msgr2=0x7fc9280cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92dd3a700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9280cbf50 0x7fc9280cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92dd3a700 1 -- 172.21.15.60:0/3609737113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280c9460 con 0x7fc928152120 2023-10-08T16:14:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92ed3c700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9280cbf50 0x7fc9280cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92dd3a700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 0x7fc9280ca8f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0073c0 tx=0x7fc91c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c018030 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c00f6c0 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00faa0 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9280c83c0 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.371+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9280c8980 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.372+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9280c9180 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.372+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc91c01b070 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.373+0000 7fc9267fc700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc914066f30 0x7fc9140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.373+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc91c019070 con 0x7fc928152120 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.373+0000 7fc92e53b700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc914066f30 0x7fc9140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.373+0000 7fc92e53b700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc914066f30 0x7fc9140693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc9280cfb00 tx=0x7fc9200091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:37.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.377+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9280c9180 con 0x7fc928152120 2023-10-08T16:14:37.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:37.616+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9280c9140 con 0x7fc928152120 2023-10-08T16:14:38.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.557+0000 7fc9267fc700 1 -- 172.21.15.60:0/3609737113 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc91c051470 con 0x7fc928152120 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc914066f30 msgr2=0x7fc9140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc914066f30 0x7fc9140693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc9280cfb00 tx=0x7fc9200091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 msgr2=0x7fc9280ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 0x7fc9280ca8f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0073c0 tx=0x7fc91c001e50 comp rx=0 tx=0).stop 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 shutdown_connections 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc914066f30 0x7fc9140693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9100051c0 0x7fc9280c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9280cbf50 0x7fc9280cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 --2- 172.21.15.60:0/3609737113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc928152120 0x7fc9280ca8f0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 >> 172.21.15.60:0/3609737113 conn(0x7fc928067660 msgr2=0x7fc928159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:38.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 shutdown_connections 2023-10-08T16:14:38.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.560+0000 7fc92f53d700 1 -- 172.21.15.60:0/3609737113 wait complete. 2023-10-08T16:14:38.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:14:38.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.707+0000 7efe5958a700 1 Processor -- start 2023-10-08T16:14:38.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.707+0000 7efe5958a700 1 -- start start 2023-10-08T16:14:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.707+0000 7efe5958a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe540ca1d0 0x7efe5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.707+0000 7efe5958a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540cb200 con 0x7efe5406f320 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.707+0000 7efe5958a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540c9840 con 0x7efe540c9e00 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.707+0000 7efe5958a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5415e440 con 0x7efe540ca1d0 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe527fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe540ca1d0 0x7efe5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe537fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efe5406f320 0x7efe540cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50872/0 (socket says 172.21.15.60:50872) 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe537fe700 1 -- 172.21.15.60:0/995382073 learned_addr learned my addr 172.21.15.60:0/995382073 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe527fc700 1 -- 172.21.15.60:0/995382073 >> v1:172.21.15.144:6789/0 conn(0x7efe540c9e00 legacy=0x7efe5415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe527fc700 1 -- 172.21.15.60:0/995382073 >> v1:172.21.15.60:6789/0 conn(0x7efe5406f320 legacy=0x7efe540cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe527fc700 1 -- 172.21.15.60:0/995382073 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5415e720 con 0x7efe540ca1d0 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe51ffb700 1 -- 172.21.15.60:0/995382073 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977263128 0 0) 0x7efe540cb200 con 0x7efe5406f320 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe527fc700 1 --2- 172.21.15.60:0/995382073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe5406ede0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0098e0 tx=0x7efe3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2176ea95066ab3b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe51ffb700 1 -- 172.21.15.60:0/995382073 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c009e80 con 0x7efe540ca1d0 2023-10-08T16:14:38.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe51ffb700 1 -- 172.21.15.60:0/995382073 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c00b860 con 0x7efe540ca1d0 2023-10-08T16:14:38.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.708+0000 7efe51ffb700 1 -- 172.21.15.60:0/995382073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c00bbe0 con 0x7efe540ca1d0 2023-10-08T16:14:38.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 -- 172.21.15.60:0/995382073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 msgr2=0x7efe5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 --2- 172.21.15.60:0/995382073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe5406ede0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0098e0 tx=0x7efe3c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 -- 172.21.15.60:0/995382073 shutdown_connections 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 --2- 172.21.15.60:0/995382073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe5406ede0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 -- 172.21.15.60:0/995382073 >> 172.21.15.60:0/995382073 conn(0x7efe54067660 msgr2=0x7efe54067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 -- 172.21.15.60:0/995382073 shutdown_connections 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.709+0000 7efe5958a700 1 -- 172.21.15.60:0/995382073 wait complete. 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.710+0000 7efe5958a700 1 Processor -- start 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.710+0000 7efe5958a700 1 -- start start 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe5958a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe5406f320 0x7efe54157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe5958a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe540c9e00 0x7efe540afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe5958a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe540ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe5958a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe54158040 con 0x7efe540ca1d0 2023-10-08T16:14:38.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe5958a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe540ad2c0 con 0x7efe5406f320 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe5958a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe540ad5a0 con 0x7efe540c9e00 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe540ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe540ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45554/0 (socket says 172.21.15.60:45554) 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 -- 172.21.15.60:0/1427360536 learned_addr learned my addr 172.21.15.60:0/1427360536 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe52ffd700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe5406f320 0x7efe54157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe527fc700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe540c9e00 0x7efe540afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 -- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe540c9e00 msgr2=0x7efe540afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe540c9e00 0x7efe540afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 -- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe5406f320 msgr2=0x7efe54157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe5406f320 0x7efe54157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:38.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 -- 172.21.15.60:0/1427360536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c009420 con 0x7efe540ca1d0 2023-10-08T16:14:38.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.711+0000 7efe537fe700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe540ac8e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7efe4400c530 tx=0x7efe44007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:38.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.712+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44005b30 con 0x7efe540ca1d0 2023-10-08T16:14:38.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.712+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe44005c90 con 0x7efe540ca1d0 2023-10-08T16:14:38.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.712+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44007320 con 0x7efe540ca1d0 2023-10-08T16:14:38.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.712+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5415b380 con 0x7efe540ca1d0 2023-10-08T16:14:38.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.712+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5415b940 con 0x7efe540ca1d0 2023-10-08T16:14:38.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.713+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5415bb30 con 0x7efe540ca1d0 2023-10-08T16:14:38.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.713+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe4401b3b0 con 0x7efe540ca1d0 2023-10-08T16:14:38.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.713+0000 7efe4affd700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe34066f30 0x7efe340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:38.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.713+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe44083940 con 0x7efe540ca1d0 2023-10-08T16:14:38.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.714+0000 7efe52ffd700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe34066f30 0x7efe340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:38.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.714+0000 7efe52ffd700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe34066f30 0x7efe340693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7efe4c007fd0 tx=0x7efe4c0016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:38.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.718+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe44050b20 con 0x7efe540ca1d0 2023-10-08T16:14:38.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:38.953+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efe5406b5e0 con 0x7efe540ca1d0 2023-10-08T16:14:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.559+0000 7efe4affd700 1 -- 172.21.15.60:0/1427360536 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe44017020 con 0x7efe540ca1d0 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe34066f30 msgr2=0x7efe340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe34066f30 0x7efe340693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7efe4c007fd0 tx=0x7efe4c0016f0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 msgr2=0x7efe540ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe540ac8e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7efe4400c530 tx=0x7efe44007f90 comp rx=0 tx=0).stop 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 shutdown_connections 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe34066f30 0x7efe340693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe540ca1d0 0x7efe540ac8e0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe5406f320 0x7efe54157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 --2- 172.21.15.60:0/1427360536 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe540c9e00 0x7efe540afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 >> 172.21.15.60:0/1427360536 conn(0x7efe54067660 msgr2=0x7efe5415e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 shutdown_connections 2023-10-08T16:14:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.561+0000 7efe5958a700 1 -- 172.21.15.60:0/1427360536 wait complete. 2023-10-08T16:14:39.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 Processor -- start 2023-10-08T16:14:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 -- start start 2023-10-08T16:14:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18d815a1e0 0x7f18d80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18d80b3430 0x7f18d80cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d815db80 con 0x7f18d8159e10 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d815e800 con 0x7f18d80b3430 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.699+0000 7f18dded2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d815de60 con 0x7f18d815a1e0 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18d80b3430 0x7f18d80cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f18d8159e10 0x7f18d80b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50876/0 (socket says 172.21.15.60:50876) 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d77fe700 1 -- 172.21.15.60:0/3658756372 learned_addr learned my addr 172.21.15.60:0/3658756372 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d7fff700 1 -- 172.21.15.60:0/3658756372 >> v2:172.21.15.144:3300/0 conn(0x7f18d815a1e0 msgr2=0x7f18d80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d7fff700 1 --2- 172.21.15.60:0/3658756372 >> v2:172.21.15.144:3300/0 conn(0x7f18d815a1e0 0x7f18d80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d7fff700 1 -- 172.21.15.60:0/3658756372 >> v1:172.21.15.60:6789/0 conn(0x7f18d8159e10 legacy=0x7f18d80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d7fff700 1 -- 172.21.15.60:0/3658756372 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d815e140 con 0x7f18d80b3430 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d67fc700 1 -- 172.21.15.60:0/3658756372 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042654531 0 0) 0x7f18d815db80 con 0x7f18d8159e10 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d7fff700 1 --2- 172.21.15.60:0/3658756372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d80b3430 0x7f18d80cdc80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f18d8068580 tx=0x7f18d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaccff1445e2454 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d67fc700 1 -- 172.21.15.60:0/3658756372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000e070 con 0x7f18d80b3430 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d67fc700 1 -- 172.21.15.60:0/3658756372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000bc30 con 0x7f18d80b3430 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.700+0000 7f18d67fc700 1 -- 172.21.15.60:0/3658756372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0012430 con 0x7f18d80b3430 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 -- 172.21.15.60:0/3658756372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d80b3430 msgr2=0x7f18d80cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 --2- 172.21.15.60:0/3658756372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d80b3430 0x7f18d80cdc80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f18d8068580 tx=0x7f18d0009780 comp rx=0 tx=0).stop 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 -- 172.21.15.60:0/3658756372 shutdown_connections 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 --2- 172.21.15.60:0/3658756372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d80b3430 0x7f18d80cdc80 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 --2- 172.21.15.60:0/3658756372 >> v2:172.21.15.144:3300/0 conn(0x7f18d815a1e0 0x7f18d80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 -- 172.21.15.60:0/3658756372 >> 172.21.15.60:0/3658756372 conn(0x7f18d8067660 msgr2=0x7f18d8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 -- 172.21.15.60:0/3658756372 shutdown_connections 2023-10-08T16:14:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.701+0000 7f18dded2700 1 -- 172.21.15.60:0/3658756372 wait complete. 2023-10-08T16:14:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.702+0000 7f18dded2700 1 Processor -- start 2023-10-08T16:14:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.702+0000 7f18dded2700 1 -- start start 2023-10-08T16:14:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18dded2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d80b3430 0x7f18d80c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18dded2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 0x7f18d80ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18dded2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d815a1e0 0x7f18d80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18dded2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c5670 con 0x7f18d8159e10 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18dded2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c5950 con 0x7f18d815a1e0 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18dded2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c5c30 con 0x7f18d80b3430 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 0x7f18d80ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 0x7f18d80ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45572/0 (socket says 172.21.15.60:45572) 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 -- 172.21.15.60:0/29492082 learned_addr learned my addr 172.21.15.60:0/29492082 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d7fff700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d815a1e0 0x7f18d80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d77fe700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d80b3430 0x7f18d80c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 -- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d80b3430 msgr2=0x7f18d80c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d80b3430 0x7f18d80c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 -- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d815a1e0 msgr2=0x7f18d80ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d815a1e0 0x7f18d80ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 -- 172.21.15.60:0/29492082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009a20 con 0x7f18d8159e10 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d7fff700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d815a1e0 0x7f18d80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d77fe700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d80b3430 0x7f18d80c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.703+0000 7f18d6ffd700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 0x7f18d80ca1d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b5b0 tx=0x7f18c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.704+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800f510 con 0x7f18d8159e10 2023-10-08T16:14:39.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.704+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800f670 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.704+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d80c5f10 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.704+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800fa10 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.704+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d80cfc70 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.705+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d80cfef0 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.705+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18c801a400 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.705+0000 7f18cf7fe700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18b8066f30 0x7f18b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.706+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18c80840d0 con 0x7f18d8159e10 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.706+0000 7f18d77fe700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18b8066f30 0x7f18b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.706+0000 7f18d77fe700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18b8066f30 0x7f18b80693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f18c0007fd0 tx=0x7f18c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:39.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.710+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18c80513c0 con 0x7f18d8159e10 2023-10-08T16:14:39.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.948+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18d804c3c0 con 0x7f18d8159e10 2023-10-08T16:14:39.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.949+0000 7f18cf7fe700 1 -- 172.21.15.60:0/29492082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f18c80549e0 con 0x7f18d8159e10 2023-10-08T16:14:39.949 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:39.949 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:14:39.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18b8066f30 msgr2=0x7f18b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18b8066f30 0x7f18b80693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f18c0007fd0 tx=0x7f18c0009040 comp rx=0 tx=0).stop 2023-10-08T16:14:39.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 msgr2=0x7f18d80ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:39.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 0x7f18d80ca1d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b5b0 tx=0x7f18c80091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 shutdown_connections 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f18b8066f30 0x7f18b80693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d80b3430 0x7f18d80c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d815a1e0 0x7f18d80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 --2- 172.21.15.60:0/29492082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18d8159e10 0x7f18d80ca1d0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 >> 172.21.15.60:0/29492082 conn(0x7f18d8067660 msgr2=0x7f18d80cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 shutdown_connections 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:39.951+0000 7f18dded2700 1 -- 172.21.15.60:0/29492082 wait complete. 2023-10-08T16:14:39.952 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:14:39.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:14:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.081+0000 7f8f8d0a3700 1 Processor -- start 2023-10-08T16:14:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.082+0000 7f8f8d0a3700 1 -- start start 2023-10-08T16:14:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.082+0000 7f8f8d0a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f8815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.082+0000 7f8f8d0a3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f8815a620 0x7f8f8815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.082+0000 7f8f8d0a3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8815cbb0 con 0x7f8f8815d580 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.082+0000 7f8f8d0a3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8815bfa0 con 0x7f8f8815a620 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.082+0000 7f8f8d0a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815c280 con 0x7f8f88157870 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f8815a620 0x7f8f8815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f86d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f8815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8759e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8f8815d580 0x7f8f88158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:44232/0 (socket says 172.21.15.60:44232) 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8759e700 1 -- 172.21.15.60:0/3871347241 learned_addr learned my addr 172.21.15.60:0/3871347241 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8659c700 1 -- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 msgr2=0x7f8f8815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8659c700 1 --2- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f8815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8659c700 1 -- 172.21.15.60:0/3871347241 >> v1:172.21.15.144:6789/0 conn(0x7f8f8815d580 legacy=0x7f8f88158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f85d9b700 1 -- 172.21.15.60:0/3871347241 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560614427 0 0) 0x7f8f8815cbb0 con 0x7f8f8815d580 2023-10-08T16:14:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8659c700 1 -- 172.21.15.60:0/3871347241 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8815c560 con 0x7f8f8815a620 2023-10-08T16:14:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f8659c700 1 --2- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815a620 0x7f8f8815d040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8f700098e0 tx=0x7f8f700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d08d132e7d320d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f85d9b700 1 -- 172.21.15.60:0/3871347241 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000b640 con 0x7f8f8815a620 2023-10-08T16:14:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f85d9b700 1 -- 172.21.15.60:0/3871347241 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7000b7a0 con 0x7f8f8815a620 2023-10-08T16:14:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.083+0000 7f8f85d9b700 1 -- 172.21.15.60:0/3871347241 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000bb40 con 0x7f8f8815a620 2023-10-08T16:14:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815a620 msgr2=0x7f8f8815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815a620 0x7f8f8815d040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8f700098e0 tx=0x7f8f700091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/3871347241 shutdown_connections 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f8815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/3871347241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815a620 0x7f8f8815d040 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/3871347241 >> 172.21.15.60:0/3871347241 conn(0x7f8f88068ce0 msgr2=0x7f8f880690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/3871347241 shutdown_connections 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.084+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/3871347241 wait complete. 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.085+0000 7f8f8d0a3700 1 Processor -- start 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.085+0000 7f8f8d0a3700 1 -- start start 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8d0a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f880b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8d0a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 0x7f8f8816e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8d0a3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815d580 0x7f8f8814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8d0a3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880b32c0 con 0x7f8f8815a620 2023-10-08T16:14:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8d0a3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8816eca0 con 0x7f8f8815d580 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8d0a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8814e9f0 con 0x7f8f88157870 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 0x7f8f8816e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 0x7f8f8816e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45586/0 (socket says 172.21.15.60:45586) 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8659c700 1 -- 172.21.15.60:0/2882431288 learned_addr learned my addr 172.21.15.60:0/2882431288 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f86d9d700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f880b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8759e700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815d580 0x7f8f8814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8659c700 1 -- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 msgr2=0x7f8f880b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.086+0000 7f8f8659c700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f880b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f8659c700 1 -- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815d580 msgr2=0x7f8f8814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f8659c700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815d580 0x7f8f8814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f8659c700 1 -- 172.21.15.60:0/2882431288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70009420 con 0x7f8f8815a620 2023-10-08T16:14:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f8659c700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 0x7f8f8816e760 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8f8806b530 tx=0x7f8f70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000bb20 con 0x7f8f8815a620 2023-10-08T16:14:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f70000c90 con 0x7f8f8815a620 2023-10-08T16:14:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8814ecd0 con 0x7f8f8815a620 2023-10-08T16:14:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70011630 con 0x7f8f8815a620 2023-10-08T16:14:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.087+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8814f290 con 0x7f8f8815a620 2023-10-08T16:14:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.088+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8804c3c0 con 0x7f8f8815a620 2023-10-08T16:14:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.088+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f700119a0 con 0x7f8f8815a620 2023-10-08T16:14:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.089+0000 7f8f7effd700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f68066f30 0x7f8f680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.089+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f70085880 con 0x7f8f8815a620 2023-10-08T16:14:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.089+0000 7f8f86d9d700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f68066f30 0x7f8f680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.089+0000 7f8f86d9d700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f68066f30 0x7f8f680693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009db0 tx=0x7f8f780091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.093+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f70052af0 con 0x7f8f8815a620 2023-10-08T16:14:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.288+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f8815c840 con 0x7f8f8815a620 2023-10-08T16:14:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.289+0000 7f8f7effd700 1 -- 172.21.15.60:0/2882431288 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f8f70056110 con 0x7f8f8815a620 2023-10-08T16:14:40.289 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:40.289 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":164,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:14:37.522798+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:14:34.351205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T16:14:34.896986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:14:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f68066f30 msgr2=0x7f8f680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f68066f30 0x7f8f680693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009db0 tx=0x7f8f780091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 msgr2=0x7f8f8816e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 0x7f8f8816e760 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8f8806b530 tx=0x7f8f70017000 comp rx=0 tx=0).stop 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 shutdown_connections 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8f68066f30 0x7f8f680693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f88157870 0x7f8f880b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f8815d580 0x7f8f8814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 --2- 172.21.15.60:0/2882431288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8815a620 0x7f8f8816e760 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 >> 172.21.15.60:0/2882431288 conn(0x7f8f88068ce0 msgr2=0x7f8f881596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 shutdown_connections 2023-10-08T16:14:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.291+0000 7f8f8d0a3700 1 -- 172.21.15.60:0/2882431288 wait complete. 2023-10-08T16:14:40.304 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:14:40.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:14:40.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.422+0000 7fbe3759e700 1 Processor -- start 2023-10-08T16:14:40.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.422+0000 7fbe3759e700 1 -- start start 2023-10-08T16:14:40.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe380cdab0 0x7fbe3815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe3815dda0 0x7fbe3815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380cb7c0 con 0x7fbe380cd6e0 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3815e850 con 0x7fbe380cdab0 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe380cc360 con 0x7fbe3815dda0 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe35d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe380cdab0 0x7fbe3815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe380cd6e0 0x7fbe380cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50888/0 (socket says 172.21.15.60:50888) 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3659c700 1 -- 172.21.15.60:0/3798180086 learned_addr learned my addr 172.21.15.60:0/3798180086 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe36d9d700 1 --2- 172.21.15.60:0/3798180086 >> v2:172.21.15.144:3300/0 conn(0x7fbe3815dda0 0x7fbe3815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe35d9b700 1 -- 172.21.15.60:0/3798180086 >> v2:172.21.15.144:3300/0 conn(0x7fbe3815dda0 msgr2=0x7fbe3815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe35d9b700 1 --2- 172.21.15.60:0/3798180086 >> v2:172.21.15.144:3300/0 conn(0x7fbe3815dda0 0x7fbe3815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe35d9b700 1 -- 172.21.15.60:0/3798180086 >> v1:172.21.15.60:6789/0 conn(0x7fbe380cd6e0 legacy=0x7fbe380cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe3559a700 1 -- 172.21.15.60:0/3798180086 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740277029 0 0) 0x7fbe380cb7c0 con 0x7fbe380cd6e0 2023-10-08T16:14:40.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe35d9b700 1 -- 172.21.15.60:0/3798180086 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3815e290 con 0x7fbe380cdab0 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.423+0000 7fbe36d9d700 1 --2- 172.21.15.60:0/3798180086 >> v2:172.21.15.144:3300/0 conn(0x7fbe3815dda0 0x7fbe3815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe35d9b700 1 --2- 172.21.15.60:0/3798180086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815d860 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fbe380cb730 tx=0x7fbe200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54fe9a5add747b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3559a700 1 -- 172.21.15.60:0/3798180086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000b6b0 con 0x7fbe380cdab0 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3559a700 1 -- 172.21.15.60:0/3798180086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2000b810 con 0x7fbe380cdab0 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3559a700 1 -- 172.21.15.60:0/3798180086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000bbb0 con 0x7fbe380cdab0 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 -- 172.21.15.60:0/3798180086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 msgr2=0x7fbe3815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 --2- 172.21.15.60:0/3798180086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815d860 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fbe380cb730 tx=0x7fbe200091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 -- 172.21.15.60:0/3798180086 shutdown_connections 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 --2- 172.21.15.60:0/3798180086 >> v2:172.21.15.144:3300/0 conn(0x7fbe3815dda0 0x7fbe3815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 --2- 172.21.15.60:0/3798180086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815d860 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 -- 172.21.15.60:0/3798180086 >> 172.21.15.60:0/3798180086 conn(0x7fbe38067660 msgr2=0x7fbe38067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:40.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 -- 172.21.15.60:0/3798180086 shutdown_connections 2023-10-08T16:14:40.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.424+0000 7fbe3759e700 1 -- 172.21.15.60:0/3798180086 wait complete. 2023-10-08T16:14:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.425+0000 7fbe3759e700 1 Processor -- start 2023-10-08T16:14:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 -- start start 2023-10-08T16:14:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe380cd6e0 0x7fbe380c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815dda0 0x7fbe38155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38159260 con 0x7fbe380cdab0 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380c9640 con 0x7fbe3815dda0 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe3759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380c98e0 con 0x7fbe380cd6e0 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe35d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe35d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45604/0 (socket says 172.21.15.60:45604) 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.426+0000 7fbe35d9b700 1 -- 172.21.15.60:0/2941994726 learned_addr learned my addr 172.21.15.60:0/2941994726 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe3659c700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe380cd6e0 0x7fbe380c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe35d9b700 1 -- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe380cd6e0 msgr2=0x7fbe380c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe36d9d700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815dda0 0x7fbe38155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe35d9b700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe380cd6e0 0x7fbe380c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe35d9b700 1 -- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815dda0 msgr2=0x7fbe38155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe35d9b700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815dda0 0x7fbe38155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe35d9b700 1 -- 172.21.15.60:0/2941994726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe20009420 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe36d9d700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815dda0 0x7fbe38155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe3659c700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe380cd6e0 0x7fbe380c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe35d9b700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815b230 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fbe380c7b10 tx=0x7fbe20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000bb90 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20011420 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe380c9bc0 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200117a0 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.427+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3815b770 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.428+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38159030 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.428+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe20011b90 con 0x7fbe380cdab0 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.429+0000 7fbe2e7fc700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe18066f30 0x7fbe180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.429+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe20085f00 con 0x7fbe380cdab0 2023-10-08T16:14:40.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.429+0000 7fbe3659c700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe18066f30 0x7fbe180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.429+0000 7fbe3659c700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe18066f30 0x7fbe180693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800d270 tx=0x7fbe28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.433+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe38159030 con 0x7fbe380cdab0 2023-10-08T16:14:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.623+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe38159030 con 0x7fbe18066f30 2023-10-08T16:14:40.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.632+0000 7fbe2e7fc700 1 -- 172.21.15.60:0/2941994726 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282516 (secure 0 0 0) 0x7fbe38159030 con 0x7fbe18066f30 2023-10-08T16:14:40.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:40.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe18066f30 msgr2=0x7fbe180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe18066f30 0x7fbe180693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800d270 tx=0x7fbe28009040 comp rx=0 tx=0).stop 2023-10-08T16:14:40.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 msgr2=0x7fbe3815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815b230 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fbe380c7b10 tx=0x7fbe20017000 comp rx=0 tx=0).stop 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 shutdown_connections 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbe18066f30 0x7fbe180693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe380cd6e0 0x7fbe380c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815dda0 0x7fbe38155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 --2- 172.21.15.60:0/2941994726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe380cdab0 0x7fbe3815b230 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 >> 172.21.15.60:0/2941994726 conn(0x7fbe38067660 msgr2=0x7fbe380d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 shutdown_connections 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.635+0000 7fbe3759e700 1 -- 172.21.15.60:0/2941994726 wait complete. 2023-10-08T16:14:40.638 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:14:40.647 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-10-08T16:14:39.687255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8150,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554349,"statfs":{"total":1600000000,"available":1591654064,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170757"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.530130+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526993+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525079+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523722+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.532682+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:06.910192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529771+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528035+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.627855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524911+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:46.049493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526519+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529380+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:49.933447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529401+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533483+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:23.242328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533234+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:07.526916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523331+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:24.921512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529018+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:11.958180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525104+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:20.560757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533218+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:25.940038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524620+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525540+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:40.858585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526419+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528407+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523754+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522907+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529077+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:45.438879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526060+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529090+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526479+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526626+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:51.462321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525193+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:39.899943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523426+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526643+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526132+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528734+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531016+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:35.531016+0000","last_peered":"2023-10-08T16:14:35.531016+0000","last_clean":"2023-10-08T16:14:35.531016+0000","last_became_active":"2023-10-08T16:14:35.530283+0000","last_became_peered":"2023-10-08T16:14:35.530283+0000","last_unstale":"2023-10-08T16:14:35.531016+0000","last_undegraded":"2023-10-08T16:14:35.531016+0000","last_fullsized":"2023-10-08T16:14:35.531016+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526966+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528823+0000","last_change":"2023-10-08T16:14:35.528823+0000","last_active":"2023-10-08T16:14:35.528823+0000","last_peered":"2023-10-08T16:14:35.528823+0000","last_clean":"2023-10-08T16:14:35.528823+0000","last_became_active":"2023-10-08T16:14:35.528277+0000","last_became_peered":"2023-10-08T16:14:35.528277+0000","last_unstale":"2023-10-08T16:14:35.528823+0000","last_undegraded":"2023-10-08T16:14:35.528823+0000","last_fullsized":"2023-10-08T16:14:35.528823+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528800+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534635+0000","last_change":"2023-10-08T16:14:35.534635+0000","last_active":"2023-10-08T16:14:35.534635+0000","last_peered":"2023-10-08T16:14:35.534635+0000","last_clean":"2023-10-08T16:14:35.534635+0000","last_became_active":"2023-10-08T16:14:35.534355+0000","last_became_peered":"2023-10-08T16:14:35.534355+0000","last_unstale":"2023-10-08T16:14:35.534635+0000","last_undegraded":"2023-10-08T16:14:35.534635+0000","last_fullsized":"2023-10-08T16:14:35.534635+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:39.851266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528623+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.526756+0000","last_change":"2023-10-08T16:14:35.526756+0000","last_active":"2023-10-08T16:14:35.526756+0000","last_peered":"2023-10-08T16:14:35.526756+0000","last_clean":"2023-10-08T16:14:35.526756+0000","last_became_active":"2023-10-08T16:14:35.525963+0000","last_became_peered":"2023-10-08T16:14:35.525963+0000","last_unstale":"2023-10-08T16:14:35.526756+0000","last_undegraded":"2023-10-08T16:14:35.526756+0000","last_fullsized":"2023-10-08T16:14:35.526756+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:45.042175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526609+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.536224+0000","last_change":"2023-10-08T16:14:35.536224+0000","last_active":"2023-10-08T16:14:35.536224+0000","last_peered":"2023-10-08T16:14:35.536224+0000","last_clean":"2023-10-08T16:14:35.536224+0000","last_became_active":"2023-10-08T16:14:35.536000+0000","last_became_peered":"2023-10-08T16:14:35.536000+0000","last_unstale":"2023-10-08T16:14:35.536224+0000","last_undegraded":"2023-10-08T16:14:35.536224+0000","last_fullsized":"2023-10-08T16:14:35.536224+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:10.051744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522943+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534559+0000","last_change":"2023-10-08T16:14:35.534559+0000","last_active":"2023-10-08T16:14:35.534559+0000","last_peered":"2023-10-08T16:14:35.534559+0000","last_clean":"2023-10-08T16:14:35.534559+0000","last_became_active":"2023-10-08T16:14:35.533456+0000","last_became_peered":"2023-10-08T16:14:35.533456+0000","last_unstale":"2023-10-08T16:14:35.534559+0000","last_undegraded":"2023-10-08T16:14:35.534559+0000","last_fullsized":"2023-10-08T16:14:35.534559+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:27.315679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.527300+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533435+0000","last_change":"2023-10-08T16:14:35.533435+0000","last_active":"2023-10-08T16:14:35.533435+0000","last_peered":"2023-10-08T16:14:35.533435+0000","last_clean":"2023-10-08T16:14:35.533435+0000","last_became_active":"2023-10-08T16:14:35.533127+0000","last_became_peered":"2023-10-08T16:14:35.533127+0000","last_unstale":"2023-10-08T16:14:35.533435+0000","last_undegraded":"2023-10-08T16:14:35.533435+0000","last_fullsized":"2023-10-08T16:14:35.533435+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:41.119530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531699+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:58.523747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527658+0000","last_change":"2023-10-08T16:14:35.527658+0000","last_active":"2023-10-08T16:14:35.527658+0000","last_peered":"2023-10-08T16:14:35.527658+0000","last_clean":"2023-10-08T16:14:35.527658+0000","last_became_active":"2023-10-08T16:14:35.527387+0000","last_became_peered":"2023-10-08T16:14:35.527387+0000","last_unstale":"2023-10-08T16:14:35.527658+0000","last_undegraded":"2023-10-08T16:14:35.527658+0000","last_fullsized":"2023-10-08T16:14:35.527658+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:38.892625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534022+0000","last_change":"2023-10-08T16:14:35.534022+0000","last_active":"2023-10-08T16:14:35.534022+0000","last_peered":"2023-10-08T16:14:35.534022+0000","last_clean":"2023-10-08T16:14:35.534022+0000","last_became_active":"2023-10-08T16:14:35.533797+0000","last_became_peered":"2023-10-08T16:14:35.533797+0000","last_unstale":"2023-10-08T16:14:35.534022+0000","last_undegraded":"2023-10-08T16:14:35.534022+0000","last_fullsized":"2023-10-08T16:14:35.534022+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528030+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.535905+0000","last_change":"2023-10-08T16:14:35.535905+0000","last_active":"2023-10-08T16:14:35.535905+0000","last_peered":"2023-10-08T16:14:35.535905+0000","last_clean":"2023-10-08T16:14:35.535905+0000","last_became_active":"2023-10-08T16:14:35.534121+0000","last_became_peered":"2023-10-08T16:14:35.534121+0000","last_unstale":"2023-10-08T16:14:35.535905+0000","last_undegraded":"2023-10-08T16:14:35.535905+0000","last_fullsized":"2023-10-08T16:14:35.535905+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:34.367653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525175+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:28.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533438+0000","last_change":"2023-10-08T16:14:35.533438+0000","last_active":"2023-10-08T16:14:35.533438+0000","last_peered":"2023-10-08T16:14:35.533438+0000","last_clean":"2023-10-08T16:14:35.533438+0000","last_became_active":"2023-10-08T16:14:35.533222+0000","last_became_peered":"2023-10-08T16:14:35.533222+0000","last_unstale":"2023-10-08T16:14:35.533438+0000","last_undegraded":"2023-10-08T16:14:35.533438+0000","last_fullsized":"2023-10-08T16:14:35.533438+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:32.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526045+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532231+0000","last_change":"2023-10-08T16:14:35.532231+0000","last_active":"2023-10-08T16:14:35.532231+0000","last_peered":"2023-10-08T16:14:35.532231+0000","last_clean":"2023-10-08T16:14:35.532231+0000","last_became_active":"2023-10-08T16:14:35.531990+0000","last_became_peered":"2023-10-08T16:14:35.531990+0000","last_unstale":"2023-10-08T16:14:35.532231+0000","last_undegraded":"2023-10-08T16:14:35.532231+0000","last_fullsized":"2023-10-08T16:14:35.532231+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:18.361008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526932+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530131+0000","last_change":"2023-10-08T16:14:35.530131+0000","last_active":"2023-10-08T16:14:35.530131+0000","last_peered":"2023-10-08T16:14:35.530131+0000","last_clean":"2023-10-08T16:14:35.530131+0000","last_became_active":"2023-10-08T16:14:35.529575+0000","last_became_peered":"2023-10-08T16:14:35.529575+0000","last_unstale":"2023-10-08T16:14:35.530131+0000","last_undegraded":"2023-10-08T16:14:35.530131+0000","last_fullsized":"2023-10-08T16:14:35.530131+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:31.698903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531063+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:14.576667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531745+0000","last_change":"2023-10-08T16:14:35.531745+0000","last_active":"2023-10-08T16:14:35.531745+0000","last_peered":"2023-10-08T16:14:35.531745+0000","last_clean":"2023-10-08T16:14:35.531745+0000","last_became_active":"2023-10-08T16:14:35.531492+0000","last_became_peered":"2023-10-08T16:14:35.531492+0000","last_unstale":"2023-10-08T16:14:35.531745+0000","last_undegraded":"2023-10-08T16:14:35.531745+0000","last_fullsized":"2023-10-08T16:14:35.531745+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:31.338071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524906+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533894+0000","last_change":"2023-10-08T16:14:35.533894+0000","last_active":"2023-10-08T16:14:35.533894+0000","last_peered":"2023-10-08T16:14:35.533894+0000","last_clean":"2023-10-08T16:14:35.533894+0000","last_became_active":"2023-10-08T16:14:35.533668+0000","last_became_peered":"2023-10-08T16:14:35.533668+0000","last_unstale":"2023-10-08T16:14:35.533894+0000","last_undegraded":"2023-10-08T16:14:35.533894+0000","last_fullsized":"2023-10-08T16:14:35.533894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:09.063993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528118+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.529921+0000","last_change":"2023-10-08T16:14:35.529921+0000","last_active":"2023-10-08T16:14:35.529921+0000","last_peered":"2023-10-08T16:14:35.529921+0000","last_clean":"2023-10-08T16:14:35.529921+0000","last_became_active":"2023-10-08T16:14:35.529697+0000","last_became_peered":"2023-10-08T16:14:35.529697+0000","last_unstale":"2023-10-08T16:14:35.529921+0000","last_undegraded":"2023-10-08T16:14:35.529921+0000","last_fullsized":"2023-10-08T16:14:35.529921+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:19.553438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525578+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:32.485639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528558+0000","last_change":"2023-10-08T16:14:35.528558+0000","last_active":"2023-10-08T16:14:35.528558+0000","last_peered":"2023-10-08T16:14:35.528558+0000","last_clean":"2023-10-08T16:14:35.528558+0000","last_became_active":"2023-10-08T16:14:35.528259+0000","last_became_peered":"2023-10-08T16:14:35.528259+0000","last_unstale":"2023-10-08T16:14:35.528558+0000","last_undegraded":"2023-10-08T16:14:35.528558+0000","last_fullsized":"2023-10-08T16:14:35.528558+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524499+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532095+0000","last_change":"2023-10-08T16:14:35.532095+0000","last_active":"2023-10-08T16:14:35.532095+0000","last_peered":"2023-10-08T16:14:35.532095+0000","last_clean":"2023-10-08T16:14:35.532095+0000","last_became_active":"2023-10-08T16:14:35.531857+0000","last_became_peered":"2023-10-08T16:14:35.531857+0000","last_unstale":"2023-10-08T16:14:35.532095+0000","last_undegraded":"2023-10-08T16:14:35.532095+0000","last_fullsized":"2023-10-08T16:14:35.532095+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:41.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528438+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532912+0000","last_change":"2023-10-08T16:14:35.532912+0000","last_active":"2023-10-08T16:14:35.532912+0000","last_peered":"2023-10-08T16:14:35.532912+0000","last_clean":"2023-10-08T16:14:35.532912+0000","last_became_active":"2023-10-08T16:14:35.532682+0000","last_became_peered":"2023-10-08T16:14:35.532682+0000","last_unstale":"2023-10-08T16:14:35.532912+0000","last_undegraded":"2023-10-08T16:14:35.532912+0000","last_fullsized":"2023-10-08T16:14:35.532912+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522925+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:32.706222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.535396+0000","last_change":"2023-10-08T16:14:35.535396+0000","last_active":"2023-10-08T16:14:35.535396+0000","last_peered":"2023-10-08T16:14:35.535396+0000","last_clean":"2023-10-08T16:14:35.535396+0000","last_became_active":"2023-10-08T16:14:35.534500+0000","last_became_peered":"2023-10-08T16:14:35.534500+0000","last_unstale":"2023-10-08T16:14:35.535396+0000","last_undegraded":"2023-10-08T16:14:35.535396+0000","last_fullsized":"2023-10-08T16:14:35.535396+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:01.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526244+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:41.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.529219+0000","last_change":"2023-10-08T16:14:35.529219+0000","last_active":"2023-10-08T16:14:35.529219+0000","last_peered":"2023-10-08T16:14:35.529219+0000","last_clean":"2023-10-08T16:14:35.529219+0000","last_became_active":"2023-10-08T16:14:35.527917+0000","last_became_peered":"2023-10-08T16:14:35.527917+0000","last_unstale":"2023-10-08T16:14:35.529219+0000","last_undegraded":"2023-10-08T16:14:35.529219+0000","last_fullsized":"2023-10-08T16:14:35.529219+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523322+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530102+0000","last_change":"2023-10-08T16:14:35.530102+0000","last_active":"2023-10-08T16:14:35.530102+0000","last_peered":"2023-10-08T16:14:35.530102+0000","last_clean":"2023-10-08T16:14:35.530102+0000","last_became_active":"2023-10-08T16:14:35.529849+0000","last_became_peered":"2023-10-08T16:14:35.529849+0000","last_unstale":"2023-10-08T16:14:35.530102+0000","last_undegraded":"2023-10-08T16:14:35.530102+0000","last_fullsized":"2023-10-08T16:14:35.530102+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525570+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:55.696886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530286+0000","last_change":"2023-10-08T16:14:35.530286+0000","last_active":"2023-10-08T16:14:35.530286+0000","last_peered":"2023-10-08T16:14:35.530286+0000","last_clean":"2023-10-08T16:14:35.530286+0000","last_became_active":"2023-10-08T16:14:35.529911+0000","last_became_peered":"2023-10-08T16:14:35.529911+0000","last_unstale":"2023-10-08T16:14:35.530286+0000","last_undegraded":"2023-10-08T16:14:35.530286+0000","last_fullsized":"2023-10-08T16:14:35.530286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:56.162565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.530692+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534342+0000","last_change":"2023-10-08T16:14:35.534342+0000","last_active":"2023-10-08T16:14:35.534342+0000","last_peered":"2023-10-08T16:14:35.534342+0000","last_clean":"2023-10-08T16:14:35.534342+0000","last_became_active":"2023-10-08T16:14:35.530723+0000","last_became_peered":"2023-10-08T16:14:35.530723+0000","last_unstale":"2023-10-08T16:14:35.534342+0000","last_undegraded":"2023-10-08T16:14:35.534342+0000","last_fullsized":"2023-10-08T16:14:35.534342+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:23.750656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524096+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527491+0000","last_change":"2023-10-08T16:14:35.527491+0000","last_active":"2023-10-08T16:14:35.527491+0000","last_peered":"2023-10-08T16:14:35.527491+0000","last_clean":"2023-10-08T16:14:35.527491+0000","last_became_active":"2023-10-08T16:14:35.527217+0000","last_became_peered":"2023-10-08T16:14:35.527217+0000","last_unstale":"2023-10-08T16:14:35.527491+0000","last_undegraded":"2023-10-08T16:14:35.527491+0000","last_fullsized":"2023-10-08T16:14:35.527491+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:05.235391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525785+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531679+0000","last_change":"2023-10-08T16:14:35.531679+0000","last_active":"2023-10-08T16:14:35.531679+0000","last_peered":"2023-10-08T16:14:35.531679+0000","last_clean":"2023-10-08T16:14:35.531679+0000","last_became_active":"2023-10-08T16:14:35.531244+0000","last_became_peered":"2023-10-08T16:14:35.531244+0000","last_unstale":"2023-10-08T16:14:35.531679+0000","last_undegraded":"2023-10-08T16:14:35.531679+0000","last_fullsized":"2023-10-08T16:14:35.531679+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:24.286147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524840+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:40.797301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531624+0000","last_change":"2023-10-08T16:14:35.531624+0000","last_active":"2023-10-08T16:14:35.531624+0000","last_peered":"2023-10-08T16:14:35.531624+0000","last_clean":"2023-10-08T16:14:35.531624+0000","last_became_active":"2023-10-08T16:14:35.531392+0000","last_became_peered":"2023-10-08T16:14:35.531392+0000","last_unstale":"2023-10-08T16:14:35.531624+0000","last_undegraded":"2023-10-08T16:14:35.531624+0000","last_fullsized":"2023-10-08T16:14:35.531624+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:19.981981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525760+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:23.791476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534545+0000","last_change":"2023-10-08T16:14:35.534545+0000","last_active":"2023-10-08T16:14:35.534545+0000","last_peered":"2023-10-08T16:14:35.534545+0000","last_clean":"2023-10-08T16:14:35.534545+0000","last_became_active":"2023-10-08T16:14:35.534302+0000","last_became_peered":"2023-10-08T16:14:35.534302+0000","last_unstale":"2023-10-08T16:14:35.534545+0000","last_undegraded":"2023-10-08T16:14:35.534545+0000","last_fullsized":"2023-10-08T16:14:35.534545+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:52.491849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528719+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534486+0000","last_change":"2023-10-08T16:14:35.534486+0000","last_active":"2023-10-08T16:14:35.534486+0000","last_peered":"2023-10-08T16:14:35.534486+0000","last_clean":"2023-10-08T16:14:35.534486+0000","last_became_active":"2023-10-08T16:14:35.531018+0000","last_became_peered":"2023-10-08T16:14:35.531018+0000","last_unstale":"2023-10-08T16:14:35.534486+0000","last_undegraded":"2023-10-08T16:14:35.534486+0000","last_fullsized":"2023-10-08T16:14:35.534486+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528349+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531614+0000","last_change":"2023-10-08T16:14:35.531614+0000","last_active":"2023-10-08T16:14:35.531614+0000","last_peered":"2023-10-08T16:14:35.531614+0000","last_clean":"2023-10-08T16:14:35.531614+0000","last_became_active":"2023-10-08T16:14:35.530968+0000","last_became_peered":"2023-10-08T16:14:35.530968+0000","last_unstale":"2023-10-08T16:14:35.531614+0000","last_undegraded":"2023-10-08T16:14:35.531614+0000","last_fullsized":"2023-10-08T16:14:35.531614+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:30.086232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528655+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528975+0000","last_change":"2023-10-08T16:14:35.528975+0000","last_active":"2023-10-08T16:14:35.528975+0000","last_peered":"2023-10-08T16:14:35.528975+0000","last_clean":"2023-10-08T16:14:35.528975+0000","last_became_active":"2023-10-08T16:14:35.528591+0000","last_became_peered":"2023-10-08T16:14:35.528591+0000","last_unstale":"2023-10-08T16:14:35.528975+0000","last_undegraded":"2023-10-08T16:14:35.528975+0000","last_fullsized":"2023-10-08T16:14:35.528975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:23.914194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.527396+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:09.110420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527422+0000","last_change":"2023-10-08T16:14:35.527422+0000","last_active":"2023-10-08T16:14:35.527422+0000","last_peered":"2023-10-08T16:14:35.527422+0000","last_clean":"2023-10-08T16:14:35.527422+0000","last_became_active":"2023-10-08T16:14:35.527182+0000","last_became_peered":"2023-10-08T16:14:35.527182+0000","last_unstale":"2023-10-08T16:14:35.527422+0000","last_undegraded":"2023-10-08T16:14:35.527422+0000","last_fullsized":"2023-10-08T16:14:35.527422+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:36.820186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":293,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-08T16:14:34.519977+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:14:34.519977+0000","last_peered":"2023-10-08T16:14:34.519977+0000","last_clean":"2023-10-08T16:14:34.519977+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:14:34.519977+0000","last_undegraded":"2023-10-08T16:14:34.519977+0000","last_fullsized":"2023-10-08T16:14:34.519977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":1.756},"last":0.60499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":1.0089999999999999},"last":0.37},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48399999999999999,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60199999999999998,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61399999999999999,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.63200000000000001,"5min":11.891,"15min":11.891},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63300000000000001,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57599999999999996,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":1.252},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":1.135,"15min":1.135},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":1.169,"15min":1.169},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":3.738,"15min":3.738},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":1.103,"15min":1.103},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.69499999999999995,"5min":3.516,"15min":3.516},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":1.502,"15min":1.502},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.63,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.308},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.443}]},{"osd":5,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.92000000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59099999999999997,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.375}]},{"osd":7,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.60499999999999998,"15min":3.593},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.76000000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.378,"15min":0.438},"min":{"1min":0.255,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.36799999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.60499999999999998,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.68000000000000005},"min":{"1min":0.38300000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.87,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.50600000000000001,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":3.532},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.91600000000000004,"15min":1.095},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":1.571,"15min":1.571},"last":0.254},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.60399999999999998,"5min":3.044,"15min":3.044},"last":0.27600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58199999999999996,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.35299999999999998,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.318}]},{"osd":3,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.379,"15min":0.379},"min":{"1min":0.30499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.63100000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48199999999999998,"15min":0.44700000000000001},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.48199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.401,"15min":1.401},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.51400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.501}]},{"osd":6,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.53900000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":3.665,"15min":3.665},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.439},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.48099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40300000000000002,"15min":0.437},"min":{"1min":0.36599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.438},"min":{"1min":0.33400000000000002,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.71599999999999997,"15min":1.3260000000000001},"last":0.439},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.40699999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.95899999999999996,"15min":0.97499999999999998},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.0700000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.92200000000000004,"15min":2.9319999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.54600000000000004,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.091},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.97599999999999998,"15min":0.98599999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.83599999999999997,"5min":1.042,"15min":3.0030000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.81200000000000006,"5min":1.073,"15min":1.073},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34999999999999998,"15min":0.32700000000000001},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.63900000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.58399999999999996,"5min":0.65500000000000003,"15min":0.65900000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.40799999999999997,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.67800000000000005},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.38100000000000001},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.40699999999999997},"min":{"1min":0.35299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96899999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.026},"last":0.501}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.94999999999999996},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.66500000000000004,"5min":0.82999999999999996,"15min":1.141},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":1.149},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":7.4749999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.47199999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.65400000000000003,"5min":0.80400000000000005,"15min":3.8730000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.875,"15min":14.6},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":7.556},"last":0.496},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.754},"last":0.35799999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.77200000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.496},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76700000000000002,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.90400000000000003},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46000000000000002,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.70199999999999996,"15min":0.80600000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.68999999999999995,"15min":0.77700000000000002},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.73999999999999999,"15min":0.89400000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.59099999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.72499999999999998,"15min":0.77800000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.48099999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T16:14:40.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:14:40.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.806+0000 7fdf39ac5700 1 Processor -- start 2023-10-08T16:14:40.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.806+0000 7fdf39ac5700 1 -- start start 2023-10-08T16:14:40.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.806+0000 7fdf39ac5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdf34159cf0 0x7fdf3415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.806+0000 7fdf39ac5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf340cf1c0 0x7fdf34068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf39ac5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340cca20 con 0x7fdf3415a0c0 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf39ac5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3415ea40 con 0x7fdf34159cf0 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf39ac5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34067660 con 0x7fdf340cf1c0 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdf34159cf0 0x7fdf3415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdf34159cf0 0x7fdf3415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45610/0 (socket says 172.21.15.60:45610) 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 -- 172.21.15.60:0/483574980 learned_addr learned my addr 172.21.15.60:0/483574980 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf33fff700 1 --2- 172.21.15.60:0/483574980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf340cf1c0 0x7fdf34068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 -- 172.21.15.60:0/483574980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf340cf1c0 msgr2=0x7fdf34068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 --2- 172.21.15.60:0/483574980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf340cf1c0 0x7fdf34068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 -- 172.21.15.60:0/483574980 >> v1:172.21.15.144:6789/0 conn(0x7fdf3415a0c0 legacy=0x7fdf340ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 -- 172.21.15.60:0/483574980 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34067f00 con 0x7fdf34159cf0 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf337fe700 1 --2- 172.21.15.60:0/483574980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf3415e500 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fdf240099b0 tx=0x7fdf24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a1f5d7ad9efea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf327fc700 1 -- 172.21.15.60:0/483574980 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24009ea0 con 0x7fdf34159cf0 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf327fc700 1 -- 172.21.15.60:0/483574980 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400b860 con 0x7fdf34159cf0 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.807+0000 7fdf327fc700 1 -- 172.21.15.60:0/483574980 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400bc00 con 0x7fdf34159cf0 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 -- 172.21.15.60:0/483574980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 msgr2=0x7fdf3415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/483574980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf3415e500 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fdf240099b0 tx=0x7fdf24009250 comp rx=0 tx=0).stop 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 -- 172.21.15.60:0/483574980 shutdown_connections 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/483574980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf340cf1c0 0x7fdf34068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/483574980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf3415e500 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 -- 172.21.15.60:0/483574980 >> 172.21.15.60:0/483574980 conn(0x7fdf3406c6e0 msgr2=0x7fdf34069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:40.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 -- 172.21.15.60:0/483574980 shutdown_connections 2023-10-08T16:14:40.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.808+0000 7fdf39ac5700 1 -- 172.21.15.60:0/483574980 wait complete. 2023-10-08T16:14:40.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.809+0000 7fdf39ac5700 1 Processor -- start 2023-10-08T16:14:40.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.809+0000 7fdf39ac5700 1 -- start start 2023-10-08T16:14:40.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf39ac5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf340cf1c0 0x7fdf34154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf39ac5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf340ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf39ac5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3415a0c0 0x7fdf340ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf39ac5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34158530 con 0x7fdf34159cf0 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf39ac5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34157920 con 0x7fdf340cf1c0 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf39ac5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34157c00 con 0x7fdf3415a0c0 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf340ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf340ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45624/0 (socket says 172.21.15.60:45624) 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 -- 172.21.15.60:0/4273239582 learned_addr learned my addr 172.21.15.60:0/4273239582 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf33fff700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3415a0c0 0x7fdf340ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf337fe700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf340cf1c0 0x7fdf34154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 -- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3415a0c0 msgr2=0x7fdf340ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3415a0c0 0x7fdf340ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 -- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf340cf1c0 msgr2=0x7fdf34154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf340cf1c0 0x7fdf34154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.810+0000 7fdf32ffd700 1 -- 172.21.15.60:0/4273239582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240094f0 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.811+0000 7fdf32ffd700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf340ab410 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c4e0 tx=0x7fdf1c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.811+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c011590 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.811+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c011710 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.811+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c011ad0 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.811+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf34157ee0 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.811+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf34154ed0 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.812+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3404c3c0 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.812+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf1c01b3b0 con 0x7fdf34159cf0 2023-10-08T16:14:40.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.813+0000 7fdf2b7fe700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdf14066f30 0x7fdf140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:40.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.813+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf1c0838f0 con 0x7fdf34159cf0 2023-10-08T16:14:40.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.813+0000 7fdf337fe700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdf14066f30 0x7fdf140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:40.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.813+0000 7fdf337fe700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdf14066f30 0x7fdf140693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdf240099b0 tx=0x7fdf24017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:40.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:40.817+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf1c050b60 con 0x7fdf34159cf0 2023-10-08T16:14:41.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.005+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf340ce730 con 0x7fdf14066f30 2023-10-08T16:14:41.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.014+0000 7fdf2b7fe700 1 -- 172.21.15.60:0/4273239582 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282516 (secure 0 0 0) 0x7fdf340ce730 con 0x7fdf14066f30 2023-10-08T16:14:41.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:41.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdf14066f30 msgr2=0x7fdf140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdf14066f30 0x7fdf140693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdf240099b0 tx=0x7fdf24017000 comp rx=0 tx=0).stop 2023-10-08T16:14:41.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 msgr2=0x7fdf340ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf340ab410 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c4e0 tx=0x7fdf1c00c7f0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 shutdown_connections 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdf14066f30 0x7fdf140693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3415a0c0 0x7fdf340ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf340cf1c0 0x7fdf34154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 --2- 172.21.15.60:0/4273239582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf34159cf0 0x7fdf340ab410 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 >> 172.21.15.60:0/4273239582 conn(0x7fdf3406c6e0 msgr2=0x7fdf34068d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 shutdown_connections 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.017+0000 7fdf39ac5700 1 -- 172.21.15.60:0/4273239582 wait complete. 2023-10-08T16:14:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:14:41.029 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-10-08T16:14:39.687255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8150,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554349,"statfs":{"total":1600000000,"available":1591654064,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170757"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.530130+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526993+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525079+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523722+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.532682+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:06.910192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529771+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528035+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.627855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524911+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:46.049493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526519+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529380+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:49.933447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529401+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533483+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:23.242328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533234+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:07.526916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523331+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:24.921512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529018+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:11.958180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525104+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:20.560757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533218+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:25.940038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524620+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525540+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:40.858585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526419+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528407+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523754+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522907+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529077+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:45.438879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526060+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529090+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526479+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526626+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:51.462321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525193+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:39.899943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523426+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526643+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526132+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528734+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531016+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:35.531016+0000","last_peered":"2023-10-08T16:14:35.531016+0000","last_clean":"2023-10-08T16:14:35.531016+0000","last_became_active":"2023-10-08T16:14:35.530283+0000","last_became_peered":"2023-10-08T16:14:35.530283+0000","last_unstale":"2023-10-08T16:14:35.531016+0000","last_undegraded":"2023-10-08T16:14:35.531016+0000","last_fullsized":"2023-10-08T16:14:35.531016+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526966+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528823+0000","last_change":"2023-10-08T16:14:35.528823+0000","last_active":"2023-10-08T16:14:35.528823+0000","last_peered":"2023-10-08T16:14:35.528823+0000","last_clean":"2023-10-08T16:14:35.528823+0000","last_became_active":"2023-10-08T16:14:35.528277+0000","last_became_peered":"2023-10-08T16:14:35.528277+0000","last_unstale":"2023-10-08T16:14:35.528823+0000","last_undegraded":"2023-10-08T16:14:35.528823+0000","last_fullsized":"2023-10-08T16:14:35.528823+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528800+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534635+0000","last_change":"2023-10-08T16:14:35.534635+0000","last_active":"2023-10-08T16:14:35.534635+0000","last_peered":"2023-10-08T16:14:35.534635+0000","last_clean":"2023-10-08T16:14:35.534635+0000","last_became_active":"2023-10-08T16:14:35.534355+0000","last_became_peered":"2023-10-08T16:14:35.534355+0000","last_unstale":"2023-10-08T16:14:35.534635+0000","last_undegraded":"2023-10-08T16:14:35.534635+0000","last_fullsized":"2023-10-08T16:14:35.534635+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:39.851266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528623+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.526756+0000","last_change":"2023-10-08T16:14:35.526756+0000","last_active":"2023-10-08T16:14:35.526756+0000","last_peered":"2023-10-08T16:14:35.526756+0000","last_clean":"2023-10-08T16:14:35.526756+0000","last_became_active":"2023-10-08T16:14:35.525963+0000","last_became_peered":"2023-10-08T16:14:35.525963+0000","last_unstale":"2023-10-08T16:14:35.526756+0000","last_undegraded":"2023-10-08T16:14:35.526756+0000","last_fullsized":"2023-10-08T16:14:35.526756+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:45.042175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526609+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.536224+0000","last_change":"2023-10-08T16:14:35.536224+0000","last_active":"2023-10-08T16:14:35.536224+0000","last_peered":"2023-10-08T16:14:35.536224+0000","last_clean":"2023-10-08T16:14:35.536224+0000","last_became_active":"2023-10-08T16:14:35.536000+0000","last_became_peered":"2023-10-08T16:14:35.536000+0000","last_unstale":"2023-10-08T16:14:35.536224+0000","last_undegraded":"2023-10-08T16:14:35.536224+0000","last_fullsized":"2023-10-08T16:14:35.536224+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:10.051744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522943+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534559+0000","last_change":"2023-10-08T16:14:35.534559+0000","last_active":"2023-10-08T16:14:35.534559+0000","last_peered":"2023-10-08T16:14:35.534559+0000","last_clean":"2023-10-08T16:14:35.534559+0000","last_became_active":"2023-10-08T16:14:35.533456+0000","last_became_peered":"2023-10-08T16:14:35.533456+0000","last_unstale":"2023-10-08T16:14:35.534559+0000","last_undegraded":"2023-10-08T16:14:35.534559+0000","last_fullsized":"2023-10-08T16:14:35.534559+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:27.315679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.527300+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533435+0000","last_change":"2023-10-08T16:14:35.533435+0000","last_active":"2023-10-08T16:14:35.533435+0000","last_peered":"2023-10-08T16:14:35.533435+0000","last_clean":"2023-10-08T16:14:35.533435+0000","last_became_active":"2023-10-08T16:14:35.533127+0000","last_became_peered":"2023-10-08T16:14:35.533127+0000","last_unstale":"2023-10-08T16:14:35.533435+0000","last_undegraded":"2023-10-08T16:14:35.533435+0000","last_fullsized":"2023-10-08T16:14:35.533435+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:41.119530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531699+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:58.523747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527658+0000","last_change":"2023-10-08T16:14:35.527658+0000","last_active":"2023-10-08T16:14:35.527658+0000","last_peered":"2023-10-08T16:14:35.527658+0000","last_clean":"2023-10-08T16:14:35.527658+0000","last_became_active":"2023-10-08T16:14:35.527387+0000","last_became_peered":"2023-10-08T16:14:35.527387+0000","last_unstale":"2023-10-08T16:14:35.527658+0000","last_undegraded":"2023-10-08T16:14:35.527658+0000","last_fullsized":"2023-10-08T16:14:35.527658+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:38.892625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534022+0000","last_change":"2023-10-08T16:14:35.534022+0000","last_active":"2023-10-08T16:14:35.534022+0000","last_peered":"2023-10-08T16:14:35.534022+0000","last_clean":"2023-10-08T16:14:35.534022+0000","last_became_active":"2023-10-08T16:14:35.533797+0000","last_became_peered":"2023-10-08T16:14:35.533797+0000","last_unstale":"2023-10-08T16:14:35.534022+0000","last_undegraded":"2023-10-08T16:14:35.534022+0000","last_fullsized":"2023-10-08T16:14:35.534022+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528030+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.535905+0000","last_change":"2023-10-08T16:14:35.535905+0000","last_active":"2023-10-08T16:14:35.535905+0000","last_peered":"2023-10-08T16:14:35.535905+0000","last_clean":"2023-10-08T16:14:35.535905+0000","last_became_active":"2023-10-08T16:14:35.534121+0000","last_became_peered":"2023-10-08T16:14:35.534121+0000","last_unstale":"2023-10-08T16:14:35.535905+0000","last_undegraded":"2023-10-08T16:14:35.535905+0000","last_fullsized":"2023-10-08T16:14:35.535905+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:34.367653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525175+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:28.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533438+0000","last_change":"2023-10-08T16:14:35.533438+0000","last_active":"2023-10-08T16:14:35.533438+0000","last_peered":"2023-10-08T16:14:35.533438+0000","last_clean":"2023-10-08T16:14:35.533438+0000","last_became_active":"2023-10-08T16:14:35.533222+0000","last_became_peered":"2023-10-08T16:14:35.533222+0000","last_unstale":"2023-10-08T16:14:35.533438+0000","last_undegraded":"2023-10-08T16:14:35.533438+0000","last_fullsized":"2023-10-08T16:14:35.533438+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:32.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526045+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532231+0000","last_change":"2023-10-08T16:14:35.532231+0000","last_active":"2023-10-08T16:14:35.532231+0000","last_peered":"2023-10-08T16:14:35.532231+0000","last_clean":"2023-10-08T16:14:35.532231+0000","last_became_active":"2023-10-08T16:14:35.531990+0000","last_became_peered":"2023-10-08T16:14:35.531990+0000","last_unstale":"2023-10-08T16:14:35.532231+0000","last_undegraded":"2023-10-08T16:14:35.532231+0000","last_fullsized":"2023-10-08T16:14:35.532231+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:18.361008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526932+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530131+0000","last_change":"2023-10-08T16:14:35.530131+0000","last_active":"2023-10-08T16:14:35.530131+0000","last_peered":"2023-10-08T16:14:35.530131+0000","last_clean":"2023-10-08T16:14:35.530131+0000","last_became_active":"2023-10-08T16:14:35.529575+0000","last_became_peered":"2023-10-08T16:14:35.529575+0000","last_unstale":"2023-10-08T16:14:35.530131+0000","last_undegraded":"2023-10-08T16:14:35.530131+0000","last_fullsized":"2023-10-08T16:14:35.530131+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:31.698903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531063+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:14.576667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531745+0000","last_change":"2023-10-08T16:14:35.531745+0000","last_active":"2023-10-08T16:14:35.531745+0000","last_peered":"2023-10-08T16:14:35.531745+0000","last_clean":"2023-10-08T16:14:35.531745+0000","last_became_active":"2023-10-08T16:14:35.531492+0000","last_became_peered":"2023-10-08T16:14:35.531492+0000","last_unstale":"2023-10-08T16:14:35.531745+0000","last_undegraded":"2023-10-08T16:14:35.531745+0000","last_fullsized":"2023-10-08T16:14:35.531745+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:31.338071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524906+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533894+0000","last_change":"2023-10-08T16:14:35.533894+0000","last_active":"2023-10-08T16:14:35.533894+0000","last_peered":"2023-10-08T16:14:35.533894+0000","last_clean":"2023-10-08T16:14:35.533894+0000","last_became_active":"2023-10-08T16:14:35.533668+0000","last_became_peered":"2023-10-08T16:14:35.533668+0000","last_unstale":"2023-10-08T16:14:35.533894+0000","last_undegraded":"2023-10-08T16:14:35.533894+0000","last_fullsized":"2023-10-08T16:14:35.533894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:09.063993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528118+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.529921+0000","last_change":"2023-10-08T16:14:35.529921+0000","last_active":"2023-10-08T16:14:35.529921+0000","last_peered":"2023-10-08T16:14:35.529921+0000","last_clean":"2023-10-08T16:14:35.529921+0000","last_became_active":"2023-10-08T16:14:35.529697+0000","last_became_peered":"2023-10-08T16:14:35.529697+0000","last_unstale":"2023-10-08T16:14:35.529921+0000","last_undegraded":"2023-10-08T16:14:35.529921+0000","last_fullsized":"2023-10-08T16:14:35.529921+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:19.553438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525578+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:32.485639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528558+0000","last_change":"2023-10-08T16:14:35.528558+0000","last_active":"2023-10-08T16:14:35.528558+0000","last_peered":"2023-10-08T16:14:35.528558+0000","last_clean":"2023-10-08T16:14:35.528558+0000","last_became_active":"2023-10-08T16:14:35.528259+0000","last_became_peered":"2023-10-08T16:14:35.528259+0000","last_unstale":"2023-10-08T16:14:35.528558+0000","last_undegraded":"2023-10-08T16:14:35.528558+0000","last_fullsized":"2023-10-08T16:14:35.528558+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524499+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532095+0000","last_change":"2023-10-08T16:14:35.532095+0000","last_active":"2023-10-08T16:14:35.532095+0000","last_peered":"2023-10-08T16:14:35.532095+0000","last_clean":"2023-10-08T16:14:35.532095+0000","last_became_active":"2023-10-08T16:14:35.531857+0000","last_became_peered":"2023-10-08T16:14:35.531857+0000","last_unstale":"2023-10-08T16:14:35.532095+0000","last_undegraded":"2023-10-08T16:14:35.532095+0000","last_fullsized":"2023-10-08T16:14:35.532095+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:41.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528438+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532912+0000","last_change":"2023-10-08T16:14:35.532912+0000","last_active":"2023-10-08T16:14:35.532912+0000","last_peered":"2023-10-08T16:14:35.532912+0000","last_clean":"2023-10-08T16:14:35.532912+0000","last_became_active":"2023-10-08T16:14:35.532682+0000","last_became_peered":"2023-10-08T16:14:35.532682+0000","last_unstale":"2023-10-08T16:14:35.532912+0000","last_undegraded":"2023-10-08T16:14:35.532912+0000","last_fullsized":"2023-10-08T16:14:35.532912+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522925+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:32.706222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.535396+0000","last_change":"2023-10-08T16:14:35.535396+0000","last_active":"2023-10-08T16:14:35.535396+0000","last_peered":"2023-10-08T16:14:35.535396+0000","last_clean":"2023-10-08T16:14:35.535396+0000","last_became_active":"2023-10-08T16:14:35.534500+0000","last_became_peered":"2023-10-08T16:14:35.534500+0000","last_unstale":"2023-10-08T16:14:35.535396+0000","last_undegraded":"2023-10-08T16:14:35.535396+0000","last_fullsized":"2023-10-08T16:14:35.535396+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:01.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526244+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:41.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.529219+0000","last_change":"2023-10-08T16:14:35.529219+0000","last_active":"2023-10-08T16:14:35.529219+0000","last_peered":"2023-10-08T16:14:35.529219+0000","last_clean":"2023-10-08T16:14:35.529219+0000","last_became_active":"2023-10-08T16:14:35.527917+0000","last_became_peered":"2023-10-08T16:14:35.527917+0000","last_unstale":"2023-10-08T16:14:35.529219+0000","last_undegraded":"2023-10-08T16:14:35.529219+0000","last_fullsized":"2023-10-08T16:14:35.529219+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523322+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530102+0000","last_change":"2023-10-08T16:14:35.530102+0000","last_active":"2023-10-08T16:14:35.530102+0000","last_peered":"2023-10-08T16:14:35.530102+0000","last_clean":"2023-10-08T16:14:35.530102+0000","last_became_active":"2023-10-08T16:14:35.529849+0000","last_became_peered":"2023-10-08T16:14:35.529849+0000","last_unstale":"2023-10-08T16:14:35.530102+0000","last_undegraded":"2023-10-08T16:14:35.530102+0000","last_fullsized":"2023-10-08T16:14:35.530102+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525570+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:55.696886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530286+0000","last_change":"2023-10-08T16:14:35.530286+0000","last_active":"2023-10-08T16:14:35.530286+0000","last_peered":"2023-10-08T16:14:35.530286+0000","last_clean":"2023-10-08T16:14:35.530286+0000","last_became_active":"2023-10-08T16:14:35.529911+0000","last_became_peered":"2023-10-08T16:14:35.529911+0000","last_unstale":"2023-10-08T16:14:35.530286+0000","last_undegraded":"2023-10-08T16:14:35.530286+0000","last_fullsized":"2023-10-08T16:14:35.530286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:56.162565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.530692+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534342+0000","last_change":"2023-10-08T16:14:35.534342+0000","last_active":"2023-10-08T16:14:35.534342+0000","last_peered":"2023-10-08T16:14:35.534342+0000","last_clean":"2023-10-08T16:14:35.534342+0000","last_became_active":"2023-10-08T16:14:35.530723+0000","last_became_peered":"2023-10-08T16:14:35.530723+0000","last_unstale":"2023-10-08T16:14:35.534342+0000","last_undegraded":"2023-10-08T16:14:35.534342+0000","last_fullsized":"2023-10-08T16:14:35.534342+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:23.750656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524096+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527491+0000","last_change":"2023-10-08T16:14:35.527491+0000","last_active":"2023-10-08T16:14:35.527491+0000","last_peered":"2023-10-08T16:14:35.527491+0000","last_clean":"2023-10-08T16:14:35.527491+0000","last_became_active":"2023-10-08T16:14:35.527217+0000","last_became_peered":"2023-10-08T16:14:35.527217+0000","last_unstale":"2023-10-08T16:14:35.527491+0000","last_undegraded":"2023-10-08T16:14:35.527491+0000","last_fullsized":"2023-10-08T16:14:35.527491+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:05.235391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525785+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531679+0000","last_change":"2023-10-08T16:14:35.531679+0000","last_active":"2023-10-08T16:14:35.531679+0000","last_peered":"2023-10-08T16:14:35.531679+0000","last_clean":"2023-10-08T16:14:35.531679+0000","last_became_active":"2023-10-08T16:14:35.531244+0000","last_became_peered":"2023-10-08T16:14:35.531244+0000","last_unstale":"2023-10-08T16:14:35.531679+0000","last_undegraded":"2023-10-08T16:14:35.531679+0000","last_fullsized":"2023-10-08T16:14:35.531679+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:24.286147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524840+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:40.797301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531624+0000","last_change":"2023-10-08T16:14:35.531624+0000","last_active":"2023-10-08T16:14:35.531624+0000","last_peered":"2023-10-08T16:14:35.531624+0000","last_clean":"2023-10-08T16:14:35.531624+0000","last_became_active":"2023-10-08T16:14:35.531392+0000","last_became_peered":"2023-10-08T16:14:35.531392+0000","last_unstale":"2023-10-08T16:14:35.531624+0000","last_undegraded":"2023-10-08T16:14:35.531624+0000","last_fullsized":"2023-10-08T16:14:35.531624+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:19.981981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525760+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:23.791476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534545+0000","last_change":"2023-10-08T16:14:35.534545+0000","last_active":"2023-10-08T16:14:35.534545+0000","last_peered":"2023-10-08T16:14:35.534545+0000","last_clean":"2023-10-08T16:14:35.534545+0000","last_became_active":"2023-10-08T16:14:35.534302+0000","last_became_peered":"2023-10-08T16:14:35.534302+0000","last_unstale":"2023-10-08T16:14:35.534545+0000","last_undegraded":"2023-10-08T16:14:35.534545+0000","last_fullsized":"2023-10-08T16:14:35.534545+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:52.491849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528719+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534486+0000","last_change":"2023-10-08T16:14:35.534486+0000","last_active":"2023-10-08T16:14:35.534486+0000","last_peered":"2023-10-08T16:14:35.534486+0000","last_clean":"2023-10-08T16:14:35.534486+0000","last_became_active":"2023-10-08T16:14:35.531018+0000","last_became_peered":"2023-10-08T16:14:35.531018+0000","last_unstale":"2023-10-08T16:14:35.534486+0000","last_undegraded":"2023-10-08T16:14:35.534486+0000","last_fullsized":"2023-10-08T16:14:35.534486+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528349+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531614+0000","last_change":"2023-10-08T16:14:35.531614+0000","last_active":"2023-10-08T16:14:35.531614+0000","last_peered":"2023-10-08T16:14:35.531614+0000","last_clean":"2023-10-08T16:14:35.531614+0000","last_became_active":"2023-10-08T16:14:35.530968+0000","last_became_peered":"2023-10-08T16:14:35.530968+0000","last_unstale":"2023-10-08T16:14:35.531614+0000","last_undegraded":"2023-10-08T16:14:35.531614+0000","last_fullsized":"2023-10-08T16:14:35.531614+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:30.086232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528655+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528975+0000","last_change":"2023-10-08T16:14:35.528975+0000","last_active":"2023-10-08T16:14:35.528975+0000","last_peered":"2023-10-08T16:14:35.528975+0000","last_clean":"2023-10-08T16:14:35.528975+0000","last_became_active":"2023-10-08T16:14:35.528591+0000","last_became_peered":"2023-10-08T16:14:35.528591+0000","last_unstale":"2023-10-08T16:14:35.528975+0000","last_undegraded":"2023-10-08T16:14:35.528975+0000","last_fullsized":"2023-10-08T16:14:35.528975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:23.914194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.527396+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:09.110420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527422+0000","last_change":"2023-10-08T16:14:35.527422+0000","last_active":"2023-10-08T16:14:35.527422+0000","last_peered":"2023-10-08T16:14:35.527422+0000","last_clean":"2023-10-08T16:14:35.527422+0000","last_became_active":"2023-10-08T16:14:35.527182+0000","last_became_peered":"2023-10-08T16:14:35.527182+0000","last_unstale":"2023-10-08T16:14:35.527422+0000","last_undegraded":"2023-10-08T16:14:35.527422+0000","last_fullsized":"2023-10-08T16:14:35.527422+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:36.820186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":293,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-08T16:14:34.519977+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:14:34.519977+0000","last_peered":"2023-10-08T16:14:34.519977+0000","last_clean":"2023-10-08T16:14:34.519977+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:14:34.519977+0000","last_undegraded":"2023-10-08T16:14:34.519977+0000","last_fullsized":"2023-10-08T16:14:34.519977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":1.756},"last":0.60499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":1.0089999999999999},"last":0.37},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48399999999999999,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60199999999999998,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61399999999999999,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.63200000000000001,"5min":11.891,"15min":11.891},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63300000000000001,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57599999999999996,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":1.252},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":1.135,"15min":1.135},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":1.169,"15min":1.169},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":3.738,"15min":3.738},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":1.103,"15min":1.103},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.69499999999999995,"5min":3.516,"15min":3.516},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":1.502,"15min":1.502},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.63,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.308},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.443}]},{"osd":5,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.92000000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59099999999999997,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.375}]},{"osd":7,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.60499999999999998,"15min":3.593},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.76000000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.378,"15min":0.438},"min":{"1min":0.255,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.36799999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.60499999999999998,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.68000000000000005},"min":{"1min":0.38300000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.87,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.50600000000000001,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":3.532},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.91600000000000004,"15min":1.095},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":1.571,"15min":1.571},"last":0.254},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.60399999999999998,"5min":3.044,"15min":3.044},"last":0.27600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58199999999999996,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.35299999999999998,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.318}]},{"osd":3,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.379,"15min":0.379},"min":{"1min":0.30499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.63100000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48199999999999998,"15min":0.44700000000000001},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.48199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.401,"15min":1.401},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.51400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.501}]},{"osd":6,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.53900000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":3.665,"15min":3.665},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.439},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.48099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40300000000000002,"15min":0.437},"min":{"1min":0.36599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.438},"min":{"1min":0.33400000000000002,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.71599999999999997,"15min":1.3260000000000001},"last":0.439},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.40699999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.95899999999999996,"15min":0.97499999999999998},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.0700000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.92200000000000004,"15min":2.9319999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.54600000000000004,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.091},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.97599999999999998,"15min":0.98599999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.83599999999999997,"5min":1.042,"15min":3.0030000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.81200000000000006,"5min":1.073,"15min":1.073},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34999999999999998,"15min":0.32700000000000001},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.63900000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.58399999999999996,"5min":0.65500000000000003,"15min":0.65900000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.40799999999999997,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.67800000000000005},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.38100000000000001},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.40699999999999997},"min":{"1min":0.35299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96899999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.026},"last":0.501}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.94999999999999996},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.66500000000000004,"5min":0.82999999999999996,"15min":1.141},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":1.149},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":7.4749999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.47199999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.65400000000000003,"5min":0.80400000000000005,"15min":3.8730000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.875,"15min":14.6},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":7.556},"last":0.496},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.754},"last":0.35799999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.77200000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.496},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76700000000000002,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.90400000000000003},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46000000000000002,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.70199999999999996,"15min":0.80600000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.68999999999999995,"15min":0.77700000000000002},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.73999999999999999,"15min":0.89400000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.59099999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.72499999999999998,"15min":0.77800000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.48099999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T16:14:41.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:14:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 Processor -- start 2023-10-08T16:14:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 -- start start 2023-10-08T16:14:41.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08e8159e10 0x7f08e80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08e815a1e0 0x7f08e80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e815e800 con 0x7f08e8159e10 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e815db80 con 0x7f08e815a1e0 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.188+0000 7f08edc4d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e815de60 con 0x7f08e80b1610 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08e8159e10 0x7f08e80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08e8159e10 0x7f08e80b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45634/0 (socket says 172.21.15.60:45634) 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 -- 172.21.15.60:0/3976292740 learned_addr learned my addr 172.21.15.60:0/3976292740 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e6ffd700 1 --2- 172.21.15.60:0/3976292740 >> v2:172.21.15.144:3300/0 conn(0x7f08e815a1e0 0x7f08e80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e7fff700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 -- 172.21.15.60:0/3976292740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 msgr2=0x7f08e80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 -- 172.21.15.60:0/3976292740 >> v2:172.21.15.144:3300/0 conn(0x7f08e815a1e0 msgr2=0x7f08e80b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 --2- 172.21.15.60:0/3976292740 >> v2:172.21.15.144:3300/0 conn(0x7f08e815a1e0 0x7f08e80b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 -- 172.21.15.60:0/3976292740 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e815e140 con 0x7f08e8159e10 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e7fff700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e77fe700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e8159e10 0x7f08e80b2d20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f08e8068580 tx=0x7f08d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b89800f1247b35a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e67fc700 1 -- 172.21.15.60:0/3976292740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800e070 con 0x7f08e8159e10 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e67fc700 1 -- 172.21.15.60:0/3976292740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800ba20 con 0x7f08e8159e10 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.189+0000 7f08e67fc700 1 -- 172.21.15.60:0/3976292740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80092e0 con 0x7f08e8159e10 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 -- 172.21.15.60:0/3976292740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e8159e10 msgr2=0x7f08e80b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e8159e10 0x7f08e80b2d20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f08e8068580 tx=0x7f08d8009840 comp rx=0 tx=0).stop 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 -- 172.21.15.60:0/3976292740 shutdown_connections 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 --2- 172.21.15.60:0/3976292740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e8159e10 0x7f08e80b2d20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 --2- 172.21.15.60:0/3976292740 >> v2:172.21.15.144:3300/0 conn(0x7f08e815a1e0 0x7f08e80b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 -- 172.21.15.60:0/3976292740 >> 172.21.15.60:0/3976292740 conn(0x7f08e8067660 msgr2=0x7f08e8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 -- 172.21.15.60:0/3976292740 shutdown_connections 2023-10-08T16:14:41.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.190+0000 7f08edc4d700 1 -- 172.21.15.60:0/3976292740 wait complete. 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.191+0000 7f08edc4d700 1 Processor -- start 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.191+0000 7f08edc4d700 1 -- start start 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08edc4d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08edc4d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e8159e10 0x7f08e80d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08edc4d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 0x7f08e816d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08edc4d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80c9630 con 0x7f08e815a1e0 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08edc4d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80d1730 con 0x7f08e8159e10 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08edc4d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e816d670 con 0x7f08e80b1610 2023-10-08T16:14:41.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 0x7f08e816d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 0x7f08e816d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45650/0 (socket says 172.21.15.60:45650) 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 -- 172.21.15.60:0/1846377090 learned_addr learned my addr 172.21.15.60:0/1846377090 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e77fe700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 -- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 msgr2=0x7f08e80ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e6ffd700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e8159e10 0x7f08e80d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 -- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e8159e10 msgr2=0x7f08e80d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e8159e10 0x7f08e80d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e7fff700 1 -- 172.21.15.60:0/1846377090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009ae0 con 0x7f08e815a1e0 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.192+0000 7f08e6ffd700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e8159e10 0x7f08e80d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.193+0000 7f08e7fff700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 0x7f08e816d130 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f08e000e870 tx=0x7f08e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.193+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000c430 con 0x7f08e815a1e0 2023-10-08T16:14:41.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.193+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e000c590 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.193+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e80cef30 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.193+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000c910 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.193+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e80c8f70 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.194+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e80c9770 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.194+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08e000cd40 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.195+0000 7f08df7fe700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08c8066f30 0x7f08c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.195+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08e0084360 con 0x7f08e815a1e0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.195+0000 7f08e77fe700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08c8066f30 0x7f08c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.195+0000 7f08e77fe700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08c8066f30 0x7f08c80693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009ab0 tx=0x7f08d8018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.199+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08e80c9770 con 0x7f08e815a1e0 2023-10-08T16:14:41.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.387+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08e80c9770 con 0x7f08c8066f30 2023-10-08T16:14:41.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.395+0000 7f08df7fe700 1 -- 172.21.15.60:0/1846377090 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282516 (secure 0 0 0) 0x7f08e80c9770 con 0x7f08c8066f30 2023-10-08T16:14:41.398 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08c8066f30 msgr2=0x7f08c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08c8066f30 0x7f08c80693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009ab0 tx=0x7f08d8018000 comp rx=0 tx=0).stop 2023-10-08T16:14:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 msgr2=0x7f08e816d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 0x7f08e816d130 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f08e000e870 tx=0x7f08e0008040 comp rx=0 tx=0).stop 2023-10-08T16:14:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 shutdown_connections 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f08c8066f30 0x7f08c80693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08e80b1610 0x7f08e80ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08e815a1e0 0x7f08e816d130 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 --2- 172.21.15.60:0/1846377090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e8159e10 0x7f08e80d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.398+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 >> 172.21.15.60:0/1846377090 conn(0x7f08e8067660 msgr2=0x7f08e80c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.399+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 shutdown_connections 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.399+0000 7f08edc4d700 1 -- 172.21.15.60:0/1846377090 wait complete. 2023-10-08T16:14:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:14:41.411 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-10-08T16:14:39.687255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8150,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554349,"statfs":{"total":1600000000,"available":1591654064,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170757"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.530130+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526993+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525079+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523722+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.532682+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:06.910192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529771+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528035+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.627855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524911+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:46.049493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526519+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529380+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:49.933447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529401+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533483+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:23.242328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533234+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:07.526916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523331+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:24.921512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529018+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:11.958180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525104+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:20.560757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.533218+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:25.940038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524620+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525540+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:40.858585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526419+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528407+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523754+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522907+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529077+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:45.438879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526060+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.529090+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526479+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526626+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:51.462321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525193+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:39.899943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523426+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526643+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526132+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528734+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531016+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:35.531016+0000","last_peered":"2023-10-08T16:14:35.531016+0000","last_clean":"2023-10-08T16:14:35.531016+0000","last_became_active":"2023-10-08T16:14:35.530283+0000","last_became_peered":"2023-10-08T16:14:35.530283+0000","last_unstale":"2023-10-08T16:14:35.531016+0000","last_undegraded":"2023-10-08T16:14:35.531016+0000","last_fullsized":"2023-10-08T16:14:35.531016+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526966+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528823+0000","last_change":"2023-10-08T16:14:35.528823+0000","last_active":"2023-10-08T16:14:35.528823+0000","last_peered":"2023-10-08T16:14:35.528823+0000","last_clean":"2023-10-08T16:14:35.528823+0000","last_became_active":"2023-10-08T16:14:35.528277+0000","last_became_peered":"2023-10-08T16:14:35.528277+0000","last_unstale":"2023-10-08T16:14:35.528823+0000","last_undegraded":"2023-10-08T16:14:35.528823+0000","last_fullsized":"2023-10-08T16:14:35.528823+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528800+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534635+0000","last_change":"2023-10-08T16:14:35.534635+0000","last_active":"2023-10-08T16:14:35.534635+0000","last_peered":"2023-10-08T16:14:35.534635+0000","last_clean":"2023-10-08T16:14:35.534635+0000","last_became_active":"2023-10-08T16:14:35.534355+0000","last_became_peered":"2023-10-08T16:14:35.534355+0000","last_unstale":"2023-10-08T16:14:35.534635+0000","last_undegraded":"2023-10-08T16:14:35.534635+0000","last_fullsized":"2023-10-08T16:14:35.534635+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:39.851266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528623+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.526756+0000","last_change":"2023-10-08T16:14:35.526756+0000","last_active":"2023-10-08T16:14:35.526756+0000","last_peered":"2023-10-08T16:14:35.526756+0000","last_clean":"2023-10-08T16:14:35.526756+0000","last_became_active":"2023-10-08T16:14:35.525963+0000","last_became_peered":"2023-10-08T16:14:35.525963+0000","last_unstale":"2023-10-08T16:14:35.526756+0000","last_undegraded":"2023-10-08T16:14:35.526756+0000","last_fullsized":"2023-10-08T16:14:35.526756+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:45.042175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526609+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.536224+0000","last_change":"2023-10-08T16:14:35.536224+0000","last_active":"2023-10-08T16:14:35.536224+0000","last_peered":"2023-10-08T16:14:35.536224+0000","last_clean":"2023-10-08T16:14:35.536224+0000","last_became_active":"2023-10-08T16:14:35.536000+0000","last_became_peered":"2023-10-08T16:14:35.536000+0000","last_unstale":"2023-10-08T16:14:35.536224+0000","last_undegraded":"2023-10-08T16:14:35.536224+0000","last_fullsized":"2023-10-08T16:14:35.536224+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:10.051744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522943+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534559+0000","last_change":"2023-10-08T16:14:35.534559+0000","last_active":"2023-10-08T16:14:35.534559+0000","last_peered":"2023-10-08T16:14:35.534559+0000","last_clean":"2023-10-08T16:14:35.534559+0000","last_became_active":"2023-10-08T16:14:35.533456+0000","last_became_peered":"2023-10-08T16:14:35.533456+0000","last_unstale":"2023-10-08T16:14:35.534559+0000","last_undegraded":"2023-10-08T16:14:35.534559+0000","last_fullsized":"2023-10-08T16:14:35.534559+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:27.315679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.527300+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533435+0000","last_change":"2023-10-08T16:14:35.533435+0000","last_active":"2023-10-08T16:14:35.533435+0000","last_peered":"2023-10-08T16:14:35.533435+0000","last_clean":"2023-10-08T16:14:35.533435+0000","last_became_active":"2023-10-08T16:14:35.533127+0000","last_became_peered":"2023-10-08T16:14:35.533127+0000","last_unstale":"2023-10-08T16:14:35.533435+0000","last_undegraded":"2023-10-08T16:14:35.533435+0000","last_fullsized":"2023-10-08T16:14:35.533435+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:41.119530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531699+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:58.523747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527658+0000","last_change":"2023-10-08T16:14:35.527658+0000","last_active":"2023-10-08T16:14:35.527658+0000","last_peered":"2023-10-08T16:14:35.527658+0000","last_clean":"2023-10-08T16:14:35.527658+0000","last_became_active":"2023-10-08T16:14:35.527387+0000","last_became_peered":"2023-10-08T16:14:35.527387+0000","last_unstale":"2023-10-08T16:14:35.527658+0000","last_undegraded":"2023-10-08T16:14:35.527658+0000","last_fullsized":"2023-10-08T16:14:35.527658+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:38.892625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534022+0000","last_change":"2023-10-08T16:14:35.534022+0000","last_active":"2023-10-08T16:14:35.534022+0000","last_peered":"2023-10-08T16:14:35.534022+0000","last_clean":"2023-10-08T16:14:35.534022+0000","last_became_active":"2023-10-08T16:14:35.533797+0000","last_became_peered":"2023-10-08T16:14:35.533797+0000","last_unstale":"2023-10-08T16:14:35.534022+0000","last_undegraded":"2023-10-08T16:14:35.534022+0000","last_fullsized":"2023-10-08T16:14:35.534022+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528030+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.535905+0000","last_change":"2023-10-08T16:14:35.535905+0000","last_active":"2023-10-08T16:14:35.535905+0000","last_peered":"2023-10-08T16:14:35.535905+0000","last_clean":"2023-10-08T16:14:35.535905+0000","last_became_active":"2023-10-08T16:14:35.534121+0000","last_became_peered":"2023-10-08T16:14:35.534121+0000","last_unstale":"2023-10-08T16:14:35.535905+0000","last_undegraded":"2023-10-08T16:14:35.535905+0000","last_fullsized":"2023-10-08T16:14:35.535905+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:34.367653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525175+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:28.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533438+0000","last_change":"2023-10-08T16:14:35.533438+0000","last_active":"2023-10-08T16:14:35.533438+0000","last_peered":"2023-10-08T16:14:35.533438+0000","last_clean":"2023-10-08T16:14:35.533438+0000","last_became_active":"2023-10-08T16:14:35.533222+0000","last_became_peered":"2023-10-08T16:14:35.533222+0000","last_unstale":"2023-10-08T16:14:35.533438+0000","last_undegraded":"2023-10-08T16:14:35.533438+0000","last_fullsized":"2023-10-08T16:14:35.533438+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:32.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526045+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532231+0000","last_change":"2023-10-08T16:14:35.532231+0000","last_active":"2023-10-08T16:14:35.532231+0000","last_peered":"2023-10-08T16:14:35.532231+0000","last_clean":"2023-10-08T16:14:35.532231+0000","last_became_active":"2023-10-08T16:14:35.531990+0000","last_became_peered":"2023-10-08T16:14:35.531990+0000","last_unstale":"2023-10-08T16:14:35.532231+0000","last_undegraded":"2023-10-08T16:14:35.532231+0000","last_fullsized":"2023-10-08T16:14:35.532231+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:18.361008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526932+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530131+0000","last_change":"2023-10-08T16:14:35.530131+0000","last_active":"2023-10-08T16:14:35.530131+0000","last_peered":"2023-10-08T16:14:35.530131+0000","last_clean":"2023-10-08T16:14:35.530131+0000","last_became_active":"2023-10-08T16:14:35.529575+0000","last_became_peered":"2023-10-08T16:14:35.529575+0000","last_unstale":"2023-10-08T16:14:35.530131+0000","last_undegraded":"2023-10-08T16:14:35.530131+0000","last_fullsized":"2023-10-08T16:14:35.530131+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:31.698903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.531063+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:14.576667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531745+0000","last_change":"2023-10-08T16:14:35.531745+0000","last_active":"2023-10-08T16:14:35.531745+0000","last_peered":"2023-10-08T16:14:35.531745+0000","last_clean":"2023-10-08T16:14:35.531745+0000","last_became_active":"2023-10-08T16:14:35.531492+0000","last_became_peered":"2023-10-08T16:14:35.531492+0000","last_unstale":"2023-10-08T16:14:35.531745+0000","last_undegraded":"2023-10-08T16:14:35.531745+0000","last_fullsized":"2023-10-08T16:14:35.531745+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:31.338071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524906+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.533894+0000","last_change":"2023-10-08T16:14:35.533894+0000","last_active":"2023-10-08T16:14:35.533894+0000","last_peered":"2023-10-08T16:14:35.533894+0000","last_clean":"2023-10-08T16:14:35.533894+0000","last_became_active":"2023-10-08T16:14:35.533668+0000","last_became_peered":"2023-10-08T16:14:35.533668+0000","last_unstale":"2023-10-08T16:14:35.533894+0000","last_undegraded":"2023-10-08T16:14:35.533894+0000","last_fullsized":"2023-10-08T16:14:35.533894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:09.063993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528118+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.529921+0000","last_change":"2023-10-08T16:14:35.529921+0000","last_active":"2023-10-08T16:14:35.529921+0000","last_peered":"2023-10-08T16:14:35.529921+0000","last_clean":"2023-10-08T16:14:35.529921+0000","last_became_active":"2023-10-08T16:14:35.529697+0000","last_became_peered":"2023-10-08T16:14:35.529697+0000","last_unstale":"2023-10-08T16:14:35.529921+0000","last_undegraded":"2023-10-08T16:14:35.529921+0000","last_fullsized":"2023-10-08T16:14:35.529921+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:19.553438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525578+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:32.485639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528558+0000","last_change":"2023-10-08T16:14:35.528558+0000","last_active":"2023-10-08T16:14:35.528558+0000","last_peered":"2023-10-08T16:14:35.528558+0000","last_clean":"2023-10-08T16:14:35.528558+0000","last_became_active":"2023-10-08T16:14:35.528259+0000","last_became_peered":"2023-10-08T16:14:35.528259+0000","last_unstale":"2023-10-08T16:14:35.528558+0000","last_undegraded":"2023-10-08T16:14:35.528558+0000","last_fullsized":"2023-10-08T16:14:35.528558+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524499+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532095+0000","last_change":"2023-10-08T16:14:35.532095+0000","last_active":"2023-10-08T16:14:35.532095+0000","last_peered":"2023-10-08T16:14:35.532095+0000","last_clean":"2023-10-08T16:14:35.532095+0000","last_became_active":"2023-10-08T16:14:35.531857+0000","last_became_peered":"2023-10-08T16:14:35.531857+0000","last_unstale":"2023-10-08T16:14:35.532095+0000","last_undegraded":"2023-10-08T16:14:35.532095+0000","last_fullsized":"2023-10-08T16:14:35.532095+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:41.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528438+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.532912+0000","last_change":"2023-10-08T16:14:35.532912+0000","last_active":"2023-10-08T16:14:35.532912+0000","last_peered":"2023-10-08T16:14:35.532912+0000","last_clean":"2023-10-08T16:14:35.532912+0000","last_became_active":"2023-10-08T16:14:35.532682+0000","last_became_peered":"2023-10-08T16:14:35.532682+0000","last_unstale":"2023-10-08T16:14:35.532912+0000","last_undegraded":"2023-10-08T16:14:35.532912+0000","last_fullsized":"2023-10-08T16:14:35.532912+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.522925+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:32.706222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.535396+0000","last_change":"2023-10-08T16:14:35.535396+0000","last_active":"2023-10-08T16:14:35.535396+0000","last_peered":"2023-10-08T16:14:35.535396+0000","last_clean":"2023-10-08T16:14:35.535396+0000","last_became_active":"2023-10-08T16:14:35.534500+0000","last_became_peered":"2023-10-08T16:14:35.534500+0000","last_unstale":"2023-10-08T16:14:35.535396+0000","last_undegraded":"2023-10-08T16:14:35.535396+0000","last_fullsized":"2023-10-08T16:14:35.535396+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:01.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.526244+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:41.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.529219+0000","last_change":"2023-10-08T16:14:35.529219+0000","last_active":"2023-10-08T16:14:35.529219+0000","last_peered":"2023-10-08T16:14:35.529219+0000","last_clean":"2023-10-08T16:14:35.529219+0000","last_became_active":"2023-10-08T16:14:35.527917+0000","last_became_peered":"2023-10-08T16:14:35.527917+0000","last_unstale":"2023-10-08T16:14:35.529219+0000","last_undegraded":"2023-10-08T16:14:35.529219+0000","last_fullsized":"2023-10-08T16:14:35.529219+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.523322+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530102+0000","last_change":"2023-10-08T16:14:35.530102+0000","last_active":"2023-10-08T16:14:35.530102+0000","last_peered":"2023-10-08T16:14:35.530102+0000","last_clean":"2023-10-08T16:14:35.530102+0000","last_became_active":"2023-10-08T16:14:35.529849+0000","last_became_peered":"2023-10-08T16:14:35.529849+0000","last_unstale":"2023-10-08T16:14:35.530102+0000","last_undegraded":"2023-10-08T16:14:35.530102+0000","last_fullsized":"2023-10-08T16:14:35.530102+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525570+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:55.696886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.530286+0000","last_change":"2023-10-08T16:14:35.530286+0000","last_active":"2023-10-08T16:14:35.530286+0000","last_peered":"2023-10-08T16:14:35.530286+0000","last_clean":"2023-10-08T16:14:35.530286+0000","last_became_active":"2023-10-08T16:14:35.529911+0000","last_became_peered":"2023-10-08T16:14:35.529911+0000","last_unstale":"2023-10-08T16:14:35.530286+0000","last_undegraded":"2023-10-08T16:14:35.530286+0000","last_fullsized":"2023-10-08T16:14:35.530286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:56.162565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.530692+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534342+0000","last_change":"2023-10-08T16:14:35.534342+0000","last_active":"2023-10-08T16:14:35.534342+0000","last_peered":"2023-10-08T16:14:35.534342+0000","last_clean":"2023-10-08T16:14:35.534342+0000","last_became_active":"2023-10-08T16:14:35.530723+0000","last_became_peered":"2023-10-08T16:14:35.530723+0000","last_unstale":"2023-10-08T16:14:35.534342+0000","last_undegraded":"2023-10-08T16:14:35.534342+0000","last_fullsized":"2023-10-08T16:14:35.534342+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:23.750656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524096+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527491+0000","last_change":"2023-10-08T16:14:35.527491+0000","last_active":"2023-10-08T16:14:35.527491+0000","last_peered":"2023-10-08T16:14:35.527491+0000","last_clean":"2023-10-08T16:14:35.527491+0000","last_became_active":"2023-10-08T16:14:35.527217+0000","last_became_peered":"2023-10-08T16:14:35.527217+0000","last_unstale":"2023-10-08T16:14:35.527491+0000","last_undegraded":"2023-10-08T16:14:35.527491+0000","last_fullsized":"2023-10-08T16:14:35.527491+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:05.235391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525785+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531679+0000","last_change":"2023-10-08T16:14:35.531679+0000","last_active":"2023-10-08T16:14:35.531679+0000","last_peered":"2023-10-08T16:14:35.531679+0000","last_clean":"2023-10-08T16:14:35.531679+0000","last_became_active":"2023-10-08T16:14:35.531244+0000","last_became_peered":"2023-10-08T16:14:35.531244+0000","last_unstale":"2023-10-08T16:14:35.531679+0000","last_undegraded":"2023-10-08T16:14:35.531679+0000","last_fullsized":"2023-10-08T16:14:35.531679+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:24.286147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.524840+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:40.797301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531624+0000","last_change":"2023-10-08T16:14:35.531624+0000","last_active":"2023-10-08T16:14:35.531624+0000","last_peered":"2023-10-08T16:14:35.531624+0000","last_clean":"2023-10-08T16:14:35.531624+0000","last_became_active":"2023-10-08T16:14:35.531392+0000","last_became_peered":"2023-10-08T16:14:35.531392+0000","last_unstale":"2023-10-08T16:14:35.531624+0000","last_undegraded":"2023-10-08T16:14:35.531624+0000","last_fullsized":"2023-10-08T16:14:35.531624+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:19.981981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.525760+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:23.791476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534545+0000","last_change":"2023-10-08T16:14:35.534545+0000","last_active":"2023-10-08T16:14:35.534545+0000","last_peered":"2023-10-08T16:14:35.534545+0000","last_clean":"2023-10-08T16:14:35.534545+0000","last_became_active":"2023-10-08T16:14:35.534302+0000","last_became_peered":"2023-10-08T16:14:35.534302+0000","last_unstale":"2023-10-08T16:14:35.534545+0000","last_undegraded":"2023-10-08T16:14:35.534545+0000","last_fullsized":"2023-10-08T16:14:35.534545+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:52.491849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528719+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.534486+0000","last_change":"2023-10-08T16:14:35.534486+0000","last_active":"2023-10-08T16:14:35.534486+0000","last_peered":"2023-10-08T16:14:35.534486+0000","last_clean":"2023-10-08T16:14:35.534486+0000","last_became_active":"2023-10-08T16:14:35.531018+0000","last_became_peered":"2023-10-08T16:14:35.531018+0000","last_unstale":"2023-10-08T16:14:35.534486+0000","last_undegraded":"2023-10-08T16:14:35.534486+0000","last_fullsized":"2023-10-08T16:14:35.534486+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528349+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.531614+0000","last_change":"2023-10-08T16:14:35.531614+0000","last_active":"2023-10-08T16:14:35.531614+0000","last_peered":"2023-10-08T16:14:35.531614+0000","last_clean":"2023-10-08T16:14:35.531614+0000","last_became_active":"2023-10-08T16:14:35.530968+0000","last_became_peered":"2023-10-08T16:14:35.530968+0000","last_unstale":"2023-10-08T16:14:35.531614+0000","last_undegraded":"2023-10-08T16:14:35.531614+0000","last_fullsized":"2023-10-08T16:14:35.531614+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:30.086232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.528655+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.528975+0000","last_change":"2023-10-08T16:14:35.528975+0000","last_active":"2023-10-08T16:14:35.528975+0000","last_peered":"2023-10-08T16:14:35.528975+0000","last_clean":"2023-10-08T16:14:35.528975+0000","last_became_active":"2023-10-08T16:14:35.528591+0000","last_became_peered":"2023-10-08T16:14:35.528591+0000","last_unstale":"2023-10-08T16:14:35.528975+0000","last_undegraded":"2023-10-08T16:14:35.528975+0000","last_fullsized":"2023-10-08T16:14:35.528975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:23.914194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:14:35.516700+0000","last_change":"2023-10-08T16:14:35.527396+0000","last_active":"2023-10-08T16:14:35.516700+0000","last_peered":"2023-10-08T16:14:35.516700+0000","last_clean":"2023-10-08T16:14:35.516700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:14:35.516700+0000","last_undegraded":"2023-10-08T16:14:35.516700+0000","last_fullsized":"2023-10-08T16:14:35.516700+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:09.110420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-08T16:14:35.527422+0000","last_change":"2023-10-08T16:14:35.527422+0000","last_active":"2023-10-08T16:14:35.527422+0000","last_peered":"2023-10-08T16:14:35.527422+0000","last_clean":"2023-10-08T16:14:35.527422+0000","last_became_active":"2023-10-08T16:14:35.527182+0000","last_became_peered":"2023-10-08T16:14:35.527182+0000","last_unstale":"2023-10-08T16:14:35.527422+0000","last_undegraded":"2023-10-08T16:14:35.527422+0000","last_fullsized":"2023-10-08T16:14:35.527422+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:36.820186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":293,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-08T16:14:34.519977+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:14:34.519977+0000","last_peered":"2023-10-08T16:14:34.519977+0000","last_clean":"2023-10-08T16:14:34.519977+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:14:34.519977+0000","last_undegraded":"2023-10-08T16:14:34.519977+0000","last_fullsized":"2023-10-08T16:14:34.519977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":1.756},"last":0.60499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":1.0089999999999999},"last":0.37},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48399999999999999,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60199999999999998,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61399999999999999,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.63200000000000001,"5min":11.891,"15min":11.891},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63300000000000001,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57599999999999996,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":1.252},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":1.135,"15min":1.135},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":1.169,"15min":1.169},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":3.738,"15min":3.738},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":1.103,"15min":1.103},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.69499999999999995,"5min":3.516,"15min":3.516},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":1.502,"15min":1.502},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.63,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.308},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.443}]},{"osd":5,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.92000000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59099999999999997,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.375}]},{"osd":7,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.60499999999999998,"15min":3.593},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.76000000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.378,"15min":0.438},"min":{"1min":0.255,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.36799999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.60499999999999998,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.68000000000000005},"min":{"1min":0.38300000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.87,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.50600000000000001,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":3.532},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.91600000000000004,"15min":1.095},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":1.571,"15min":1.571},"last":0.254},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.60399999999999998,"5min":3.044,"15min":3.044},"last":0.27600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58199999999999996,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.35299999999999998,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.318}]},{"osd":3,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.379,"15min":0.379},"min":{"1min":0.30499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.63100000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48199999999999998,"15min":0.44700000000000001},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.48199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.401,"15min":1.401},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.51400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.501}]},{"osd":6,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.53900000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":3.665,"15min":3.665},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.439},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.48099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40300000000000002,"15min":0.437},"min":{"1min":0.36599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.438},"min":{"1min":0.33400000000000002,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.71599999999999997,"15min":1.3260000000000001},"last":0.439},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.40699999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.95899999999999996,"15min":0.97499999999999998},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.0700000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.92200000000000004,"15min":2.9319999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.54600000000000004,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.091},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.97599999999999998,"15min":0.98599999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.83599999999999997,"5min":1.042,"15min":3.0030000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.81200000000000006,"5min":1.073,"15min":1.073},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34999999999999998,"15min":0.32700000000000001},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.63900000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.58399999999999996,"5min":0.65500000000000003,"15min":0.65900000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.40799999999999997,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.67800000000000005},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.38100000000000001},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.40699999999999997},"min":{"1min":0.35299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96899999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.026},"last":0.501}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.94999999999999996},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.66500000000000004,"5min":0.82999999999999996,"15min":1.141},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":1.149},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":7.4749999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.47199999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.65400000000000003,"5min":0.80400000000000005,"15min":3.8730000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.875,"15min":14.6},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":7.556},"last":0.496},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.754},"last":0.35799999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.77200000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199104350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.496},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76700000000000002,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.90400000000000003},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46000000000000002,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.70199999999999996,"15min":0.80600000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.68999999999999995,"15min":0.77700000000000002},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.73999999999999999,"15min":0.89400000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.59099999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.72499999999999998,"15min":0.77800000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.48099999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3f is not active+clean 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.530130+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3e is not active+clean 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526993+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525079+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-10-08T16:14:41.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.523722+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.532682+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:11:06.910192+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3a is not active+clean 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.529771+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528035+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:28:30.627855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.38 is not active+clean 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.524911+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:48:46.049493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.37 is not active+clean 2023-10-08T16:14:41.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526519+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.529380+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:05:49.933447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.35 is not active+clean 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.529401+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.533483+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:58:23.242328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.533234+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:06:07.526916+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-10-08T16:14:41.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.523331+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:43:24.921512+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.529018+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:02:11.958180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525104+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:51:20.560757+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.533218+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:22:25.940038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.524620+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:14:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2d is not active+clean 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525540+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:08:40.858585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526419+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528407+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.523754+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.522907+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.529077+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:45.438879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526060+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.26 is not active+clean 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.529090+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526479+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.24 is not active+clean 2023-10-08T16:14:41.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526626+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:17:51.462321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.23 is not active+clean 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525193+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:07:39.899943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.523426+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:21:28.542760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.21 is not active+clean 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526643+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526132+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-10-08T16:14:41.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528734+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526966+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528800+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:19:19.368327+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528623+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526609+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.522943+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.527300+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.531699+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:53:58.523747+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-10-08T16:14:41.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.531016+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:15:40.097763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528030+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525175+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:08:28.322998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526045+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526932+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.531063+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:33:14.576667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.524906+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528118+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525578+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:05:32.485639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-10-08T16:14:41.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.524499+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:02:03.981499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528438+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:59:37.827504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.522925+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:01:32.706222+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.526244+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:51:41.386559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.523322+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:10:57.169884+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-10-08T16:14:41.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525570+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:20:55.696886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:14:41.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-10-08T16:14:41.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.530692+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:16:44.691153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-10-08T16:14:41.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.524096+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:12:01.750947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:14:41.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-10-08T16:14:41.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525785+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.524840+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:35:40.797301+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.525760+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:08:23.791476+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528719+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:58:22.610708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528349+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-10-08T16:14:41.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.528655+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:23:59.980362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:14:41.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-10-08T16:14:41.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:14:35.516700+0000', 'last_change': '2023-10-08T16:14:35.527396+0000', 'last_active': '2023-10-08T16:14:35.516700+0000', 'last_peered': '2023-10-08T16:14:35.516700+0000', 'last_clean': '2023-10-08T16:14:35.516700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:14:35.516700+0000', 'last_undegraded': '2023-10-08T16:14:35.516700+0000', 'last_fullsized': '2023-10-08T16:14:35.516700+0000', 'mapping_epoch': 162, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 162, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'last_clean_scrub_stamp': '2023-10-08T16:14:35.516700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:07:09.110420+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:14:41.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:14:41.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.570+0000 7f2d15a5a700 1 Processor -- start 2023-10-08T16:14:41.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.570+0000 7f2d15a5a700 1 -- start start 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d15a5a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100d1c30 0x7f2d100ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d15a5a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d1015a680 0x7f2d100cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d15a5a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d100c5d80 con 0x7f2d1015a2b0 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d15a5a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d10068470 con 0x7f2d1015a680 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d15a5a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c6060 con 0x7f2d100d1c30 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d0effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2d1015a2b0 0x7f2d100b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50894/0 (socket says 172.21.15.60:50894) 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d0effd700 1 -- 172.21.15.60:0/4029498649 learned_addr learned my addr 172.21.15.60:0/4029498649 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:41.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927497281 0 0) 0x7f2d100c5d80 con 0x7f2d1015a2b0 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/4029498649 >> v2:172.21.15.144:3300/0 conn(0x7f2d1015a680 0x7f2d100cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cfc003570 con 0x7f2d1015a2b0 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.571+0000 7f2d07fff700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100d1c30 0x7f2d100ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4146013662 0 0) 0x7f2cfc003570 con 0x7f2d1015a2b0 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100d1c30 msgr2=0x7f2d100ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100d1c30 0x7f2d100ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 >> v2:172.21.15.144:3300/0 conn(0x7f2d1015a680 msgr2=0x7f2d100cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 --2- 172.21.15.60:0/4029498649 >> v2:172.21.15.144:3300/0 conn(0x7f2d1015a680 0x7f2d100cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100c6340 con 0x7f2d1015a2b0 2023-10-08T16:14:41.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f2d000015f0 con 0x7f2d1015a2b0 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 >> v1:172.21.15.60:6789/0 conn(0x7f2d1015a2b0 legacy=0x7f2d100b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cfc003a60 0x7f2cfc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2cfc004810 0x7f2cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cfc0051c0 0x7f2cfc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10068470 con 0x7f2cfc0051c0 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c6060 con 0x7f2cfc003a60 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc00bfa0 con 0x7f2cfc004810 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d07fff700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100d1c30 0x7f2d100ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cfc0051c0 0x7f2cfc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0effd700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cfc003a60 0x7f2cfc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d07fff700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2cfc004810 0x7f2cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 -- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2cfc004810 msgr2=0x7f2cfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2cfc004810 0x7f2cfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 -- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cfc003a60 msgr2=0x7f2cfc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cfc003a60 0x7f2cfc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 -- 172.21.15.60:0/4029498649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc003570 con 0x7f2cfc0051c0 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cfc0051c0 0x7f2cfc00ba60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800e240 tx=0x7f2d0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de06b3799bd16e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800eaf0 con 0x7f2cfc0051c0 2023-10-08T16:14:41.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800f040 con 0x7f2cfc0051c0 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.572+0000 7f2d0e7fc700 1 -- 172.21.15.60:0/4029498649 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800eea0 con 0x7f2cfc0051c0 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d15a5a700 1 -- 172.21.15.60:0/4029498649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cfc0051c0 msgr2=0x7f2cfc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/4029498649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cfc0051c0 0x7f2cfc00ba60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800e240 tx=0x7f2d0800b040 comp rx=0 tx=0).stop 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d0f7fe700 1 -- 172.21.15.60:0/4029498649 reap_dead start 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d15a5a700 1 -- 172.21.15.60:0/4029498649 shutdown_connections 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d15a5a700 1 -- 172.21.15.60:0/4029498649 >> 172.21.15.60:0/4029498649 conn(0x7f2d10067e40 msgr2=0x7f2d100d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d15a5a700 1 -- 172.21.15.60:0/4029498649 shutdown_connections 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.573+0000 7f2d15a5a700 1 -- 172.21.15.60:0/4029498649 wait complete. 2023-10-08T16:14:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.574+0000 7f2d15a5a700 1 Processor -- start 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.574+0000 7f2d15a5a700 1 -- start start 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d15a5a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 0x7f2d1015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d15a5a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10155a30 0x7f2d100b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d15a5a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100b52b0 0x7f2d1016d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d15a5a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100b5730 con 0x7f2d10155660 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d15a5a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015b5a0 con 0x7f2d10155a30 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d15a5a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015d9c0 con 0x7f2d100b52b0 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 0x7f2d1015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 0x7f2d1015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45664/0 (socket says 172.21.15.60:45664) 2023-10-08T16:14:41.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 -- 172.21.15.60:0/1444953387 learned_addr learned my addr 172.21.15.60:0/1444953387 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100b52b0 0x7f2d1016d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d07fff700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10155a30 0x7f2d100b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 -- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100b52b0 msgr2=0x7f2d1016d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100b52b0 0x7f2d1016d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 -- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10155a30 msgr2=0x7f2d100b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10155a30 0x7f2d100b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 -- 172.21.15.60:0/1444953387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1015ac70 con 0x7f2d10155660 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d07fff700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10155a30 0x7f2d100b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0f7fe700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100b52b0 0x7f2d1016d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:41.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.575+0000 7f2d0effd700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 0x7f2d1015d020 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000e820 tx=0x7f2d00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.576+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000072e0 con 0x7f2d10155660 2023-10-08T16:14:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.576+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00010040 con 0x7f2d10155660 2023-10-08T16:14:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.576+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1015af50 con 0x7f2d10155660 2023-10-08T16:14:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.576+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000076b0 con 0x7f2d10155660 2023-10-08T16:14:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.576+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1015ba30 con 0x7f2d10155660 2023-10-08T16:14:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.577+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004c3c0 con 0x7f2d10155660 2023-10-08T16:14:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.577+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d00005a00 con 0x7f2d10155660 2023-10-08T16:14:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.578+0000 7f2d06ffd700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2cf0066f30 0x7f2cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.578+0000 7f2d07fff700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2cf0066f30 0x7f2cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.578+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d00084090 con 0x7f2d10155660 2023-10-08T16:14:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.578+0000 7f2d07fff700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2cf0066f30 0x7f2cf00693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d10155e20 tx=0x7f2cf8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.582+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d000513b0 con 0x7f2d10155660 2023-10-08T16:14:41.847 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-10-08T16:14:41.847+0000 7fe3340d0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:14:41.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.854+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2d10064a00 con 0x7f2d10155660 2023-10-08T16:14:41.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.855+0000 7f2d06ffd700 1 -- 172.21.15.60:0/1444953387 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7f2d000549d0 con 0x7f2d10155660 2023-10-08T16:14:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:41.855 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":598,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":164,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781088,"num_in_osds":8,"osd_in_since":1696781085,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":8345936,"bytes_avail":1591654064,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":85,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":7824}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-10-08T16:13:11.667149+0000","services":{}},"progress_events":{}} 2023-10-08T16:14:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.856+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2cf0066f30 msgr2=0x7f2cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.856+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2cf0066f30 0x7f2cf00693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d10155e20 tx=0x7f2cf8008040 comp rx=0 tx=0).stop 2023-10-08T16:14:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.856+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 msgr2=0x7f2d1015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.856+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 0x7f2d1015d020 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000e820 tx=0x7f2d00009040 comp rx=0 tx=0).stop 2023-10-08T16:14:41.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 shutdown_connections 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2cf0066f30 0x7f2cf00693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d100b52b0 0x7f2d1016d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d10155660 0x7f2d1015d020 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 --2- 172.21.15.60:0/1444953387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10155a30 0x7f2d100b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 >> 172.21.15.60:0/1444953387 conn(0x7f2d10067e40 msgr2=0x7f2d10069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 shutdown_connections 2023-10-08T16:14:41.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.857+0000 7f2d15a5a700 1 -- 172.21.15.60:0/1444953387 wait complete. 2023-10-08T16:14:41.869 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:14:41.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:14:41.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.988+0000 7f8f1359e700 1 Processor -- start 2023-10-08T16:14:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.988+0000 7f8f1359e700 1 -- start start 2023-10-08T16:14:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f140cd6e0 0x7f8f140cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1359e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f1415cbd0 0x7f8f1415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1359e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140cb7c0 con 0x7f8f140cdab0 2023-10-08T16:14:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1415e850 con 0x7f8f140cd6e0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1359e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140cd030 con 0x7f8f1415cbd0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f140cd6e0 0x7f8f140cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f140cd6e0 0x7f8f140cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45666/0 (socket says 172.21.15.60:45666) 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.989+0000 7f8f1259c700 1 -- 172.21.15.60:0/1584815367 learned_addr learned my addr 172.21.15.60:0/1584815367 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1259c700 1 -- 172.21.15.60:0/1584815367 >> v2:172.21.15.144:3300/0 conn(0x7f8f1415cbd0 msgr2=0x7f8f1415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1259c700 1 --2- 172.21.15.60:0/1584815367 >> v2:172.21.15.144:3300/0 conn(0x7f8f1415cbd0 0x7f8f1415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1259c700 1 -- 172.21.15.60:0/1584815367 >> v1:172.21.15.144:6789/0 conn(0x7f8f140cdab0 legacy=0x7f8f1415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1259c700 1 -- 172.21.15.60:0/1584815367 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1415e290 con 0x7f8f140cd6e0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1259c700 1 --2- 172.21.15.60:0/1584815367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cd6e0 0x7f8f140cbc50 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f8f140cb730 tx=0x7f8f04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3d28dde999c79e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1159a700 1 -- 172.21.15.60:0/1584815367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400b820 con 0x7f8f140cd6e0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1159a700 1 -- 172.21.15.60:0/1584815367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0400b980 con 0x7f8f140cd6e0 2023-10-08T16:14:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1159a700 1 -- 172.21.15.60:0/1584815367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400bd20 con 0x7f8f140cd6e0 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1359e700 1 -- 172.21.15.60:0/1584815367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cd6e0 msgr2=0x7f8f140cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.990+0000 7f8f1359e700 1 --2- 172.21.15.60:0/1584815367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cd6e0 0x7f8f140cbc50 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f8f140cb730 tx=0x7f8f04009250 comp rx=0 tx=0).stop 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.991+0000 7f8f1359e700 1 -- 172.21.15.60:0/1584815367 shutdown_connections 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.991+0000 7f8f1359e700 1 --2- 172.21.15.60:0/1584815367 >> v2:172.21.15.144:3300/0 conn(0x7f8f1415cbd0 0x7f8f1415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.991+0000 7f8f1359e700 1 --2- 172.21.15.60:0/1584815367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cd6e0 0x7f8f140cbc50 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.991+0000 7f8f1359e700 1 -- 172.21.15.60:0/1584815367 >> 172.21.15.60:0/1584815367 conn(0x7f8f14067660 msgr2=0x7f8f14067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.991+0000 7f8f1359e700 1 -- 172.21.15.60:0/1584815367 shutdown_connections 2023-10-08T16:14:41.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.991+0000 7f8f1359e700 1 -- 172.21.15.60:0/1584815367 wait complete. 2023-10-08T16:14:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 Processor -- start 2023-10-08T16:14:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 -- start start 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f140cd6e0 0x7f8f140b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 0x7f8f140c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f1415cbd0 0x7f8f1414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140b60e0 con 0x7f8f140cdab0 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140c9ee0 con 0x7f8f140cd6e0 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f1359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1414d2f0 con 0x7f8f1415cbd0 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.992+0000 7f8f11d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 0x7f8f140c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 0x7f8f140c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45682/0 (socket says 172.21.15.60:45682) 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 -- 172.21.15.60:0/2675913892 learned_addr learned my addr 172.21.15.60:0/2675913892 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f1259c700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f140cd6e0 0x7f8f140b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f12d9d700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f1415cbd0 0x7f8f1414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 -- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f1415cbd0 msgr2=0x7f8f1414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f1415cbd0 0x7f8f1414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 -- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f140cd6e0 msgr2=0x7f8f140b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f140cd6e0 0x7f8f140b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 -- 172.21.15.60:0/2675913892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040094f0 con 0x7f8f140cdab0 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f12d9d700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f1415cbd0 0x7f8f1414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f11d9b700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 0x7f8f140c99a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00b630 tx=0x7f8efc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00f510 con 0x7f8f140cdab0 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00f690 con 0x7f8f140cdab0 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f140b43e0 con 0x7f8f140cdab0 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00fa50 con 0x7f8f140cdab0 2023-10-08T16:14:41.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.993+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f140b4070 con 0x7f8f140cdab0 2023-10-08T16:14:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.994+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f140b4570 con 0x7f8f140cdab0 2023-10-08T16:14:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.995+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8efc01a400 con 0x7f8f140cdab0 2023-10-08T16:14:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.995+0000 7f8f0a7fc700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ef4066f30 0x7f8ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.995+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8efc084060 con 0x7f8f140cdab0 2023-10-08T16:14:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.995+0000 7f8f1259c700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ef4066f30 0x7f8ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:41.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.996+0000 7f8f1259c700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ef4066f30 0x7f8ef40693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8f140cb730 tx=0x7f8f04016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:41.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:41.999+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8efc051350 con 0x7f8f140cdab0 2023-10-08T16:14:42.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.190+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f1415e570 con 0x7f8ef4066f30 2023-10-08T16:14:42.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.199+0000 7f8f0a7fc700 1 -- 172.21.15.60:0/2675913892 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285498 (secure 0 0 0) 0x7f8f1415e570 con 0x7f8ef4066f30 2023-10-08T16:14:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:42.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ef4066f30 msgr2=0x7f8ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:42.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ef4066f30 0x7f8ef40693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8f140cb730 tx=0x7f8f04016000 comp rx=0 tx=0).stop 2023-10-08T16:14:42.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 msgr2=0x7f8f140c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 0x7f8f140c99a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00b630 tx=0x7f8efc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 shutdown_connections 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8ef4066f30 0x7f8ef40693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f1415cbd0 0x7f8f1414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f140cd6e0 0x7f8f140b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 --2- 172.21.15.60:0/2675913892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f140cdab0 0x7f8f140c99a0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 >> 172.21.15.60:0/2675913892 conn(0x7f8f14067660 msgr2=0x7f8f140cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 shutdown_connections 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:42.202+0000 7f8f1359e700 1 -- 172.21.15.60:0/2675913892 wait complete. 2023-10-08T16:14:42.205 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:14:42.214 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2023-10-08T16:14:41.687548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554194,"statfs":{"total":1600000000,"available":1591494940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.165978"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540689+0000","last_change":"2023-10-08T16:14:36.540610+0000","last_active":"2023-10-08T16:14:36.540689+0000","last_peered":"2023-10-08T16:14:36.540689+0000","last_clean":"2023-10-08T16:14:36.540689+0000","last_became_active":"2023-10-08T16:14:36.540316+0000","last_became_peered":"2023-10-08T16:14:36.540316+0000","last_unstale":"2023-10-08T16:14:36.540689+0000","last_undegraded":"2023-10-08T16:14:36.540689+0000","last_fullsized":"2023-10-08T16:14:36.540689+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534443+0000","last_change":"2023-10-08T16:14:36.534377+0000","last_active":"2023-10-08T16:14:36.534443+0000","last_peered":"2023-10-08T16:14:36.534443+0000","last_clean":"2023-10-08T16:14:36.534443+0000","last_became_active":"2023-10-08T16:14:36.534161+0000","last_became_peered":"2023-10-08T16:14:36.534161+0000","last_unstale":"2023-10-08T16:14:36.534443+0000","last_undegraded":"2023-10-08T16:14:36.534443+0000","last_fullsized":"2023-10-08T16:14:36.534443+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:51.926422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541240+0000","last_change":"2023-10-08T16:14:36.541158+0000","last_active":"2023-10-08T16:14:36.541240+0000","last_peered":"2023-10-08T16:14:36.541240+0000","last_clean":"2023-10-08T16:14:36.541240+0000","last_became_active":"2023-10-08T16:14:36.540395+0000","last_became_peered":"2023-10-08T16:14:36.540395+0000","last_unstale":"2023-10-08T16:14:36.541240+0000","last_undegraded":"2023-10-08T16:14:36.541240+0000","last_fullsized":"2023-10-08T16:14:36.541240+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534060+0000","last_change":"2023-10-08T16:14:36.533872+0000","last_active":"2023-10-08T16:14:36.534060+0000","last_peered":"2023-10-08T16:14:36.534060+0000","last_clean":"2023-10-08T16:14:36.534060+0000","last_became_active":"2023-10-08T16:14:36.533635+0000","last_became_peered":"2023-10-08T16:14:36.533635+0000","last_unstale":"2023-10-08T16:14:36.534060+0000","last_undegraded":"2023-10-08T16:14:36.534060+0000","last_fullsized":"2023-10-08T16:14:36.534060+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.542756+0000","last_change":"2023-10-08T16:14:36.542674+0000","last_active":"2023-10-08T16:14:36.542756+0000","last_peered":"2023-10-08T16:14:36.542756+0000","last_clean":"2023-10-08T16:14:36.542756+0000","last_became_active":"2023-10-08T16:14:36.542436+0000","last_became_peered":"2023-10-08T16:14:36.542436+0000","last_unstale":"2023-10-08T16:14:36.542756+0000","last_undegraded":"2023-10-08T16:14:36.542756+0000","last_fullsized":"2023-10-08T16:14:36.542756+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:52.264778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539685+0000","last_change":"2023-10-08T16:14:36.539629+0000","last_active":"2023-10-08T16:14:36.539685+0000","last_peered":"2023-10-08T16:14:36.539685+0000","last_clean":"2023-10-08T16:14:36.539685+0000","last_became_active":"2023-10-08T16:14:36.539226+0000","last_became_peered":"2023-10-08T16:14:36.539226+0000","last_unstale":"2023-10-08T16:14:36.539685+0000","last_undegraded":"2023-10-08T16:14:36.539685+0000","last_fullsized":"2023-10-08T16:14:36.539685+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535217+0000","last_change":"2023-10-08T16:14:36.535153+0000","last_active":"2023-10-08T16:14:36.535217+0000","last_peered":"2023-10-08T16:14:36.535217+0000","last_clean":"2023-10-08T16:14:36.535217+0000","last_became_active":"2023-10-08T16:14:36.534940+0000","last_became_peered":"2023-10-08T16:14:36.534940+0000","last_unstale":"2023-10-08T16:14:36.535217+0000","last_undegraded":"2023-10-08T16:14:36.535217+0000","last_fullsized":"2023-10-08T16:14:36.535217+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:54.534171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532171+0000","last_change":"2023-10-08T16:14:36.532107+0000","last_active":"2023-10-08T16:14:36.532171+0000","last_peered":"2023-10-08T16:14:36.532171+0000","last_clean":"2023-10-08T16:14:36.532171+0000","last_became_active":"2023-10-08T16:14:36.531856+0000","last_became_peered":"2023-10-08T16:14:36.531856+0000","last_unstale":"2023-10-08T16:14:36.532171+0000","last_undegraded":"2023-10-08T16:14:36.532171+0000","last_fullsized":"2023-10-08T16:14:36.532171+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:24.921512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533458+0000","last_change":"2023-10-08T16:14:36.533266+0000","last_active":"2023-10-08T16:14:36.533458+0000","last_peered":"2023-10-08T16:14:36.533458+0000","last_clean":"2023-10-08T16:14:36.533458+0000","last_became_active":"2023-10-08T16:14:36.533025+0000","last_became_peered":"2023-10-08T16:14:36.533025+0000","last_unstale":"2023-10-08T16:14:36.533458+0000","last_undegraded":"2023-10-08T16:14:36.533458+0000","last_fullsized":"2023-10-08T16:14:36.533458+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:11.958180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.548645+0000","last_change":"2023-10-08T16:14:36.548571+0000","last_active":"2023-10-08T16:14:36.548645+0000","last_peered":"2023-10-08T16:14:36.548645+0000","last_clean":"2023-10-08T16:14:36.548645+0000","last_became_active":"2023-10-08T16:14:36.548330+0000","last_became_peered":"2023-10-08T16:14:36.548330+0000","last_unstale":"2023-10-08T16:14:36.548645+0000","last_undegraded":"2023-10-08T16:14:36.548645+0000","last_fullsized":"2023-10-08T16:14:36.548645+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:56.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534752+0000","last_change":"2023-10-08T16:14:36.534682+0000","last_active":"2023-10-08T16:14:36.534752+0000","last_peered":"2023-10-08T16:14:36.534752+0000","last_clean":"2023-10-08T16:14:36.534752+0000","last_became_active":"2023-10-08T16:14:36.534233+0000","last_became_peered":"2023-10-08T16:14:36.534233+0000","last_unstale":"2023-10-08T16:14:36.534752+0000","last_undegraded":"2023-10-08T16:14:36.534752+0000","last_fullsized":"2023-10-08T16:14:36.534752+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543488+0000","last_change":"2023-10-08T16:14:36.543415+0000","last_active":"2023-10-08T16:14:36.543488+0000","last_peered":"2023-10-08T16:14:36.543488+0000","last_clean":"2023-10-08T16:14:36.543488+0000","last_became_active":"2023-10-08T16:14:36.540934+0000","last_became_peered":"2023-10-08T16:14:36.540934+0000","last_unstale":"2023-10-08T16:14:36.543488+0000","last_undegraded":"2023-10-08T16:14:36.543488+0000","last_fullsized":"2023-10-08T16:14:36.543488+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:31.281924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541628+0000","last_change":"2023-10-08T16:14:36.541013+0000","last_active":"2023-10-08T16:14:36.541628+0000","last_peered":"2023-10-08T16:14:36.541628+0000","last_clean":"2023-10-08T16:14:36.541628+0000","last_became_active":"2023-10-08T16:14:36.540478+0000","last_became_peered":"2023-10-08T16:14:36.540478+0000","last_unstale":"2023-10-08T16:14:36.541628+0000","last_undegraded":"2023-10-08T16:14:36.541628+0000","last_fullsized":"2023-10-08T16:14:36.541628+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:32:11.749887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543203+0000","last_change":"2023-10-08T16:14:36.543137+0000","last_active":"2023-10-08T16:14:36.543203+0000","last_peered":"2023-10-08T16:14:36.543203+0000","last_clean":"2023-10-08T16:14:36.543203+0000","last_became_active":"2023-10-08T16:14:36.542813+0000","last_became_peered":"2023-10-08T16:14:36.542813+0000","last_unstale":"2023-10-08T16:14:36.543203+0000","last_undegraded":"2023-10-08T16:14:36.543203+0000","last_fullsized":"2023-10-08T16:14:36.543203+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.544816+0000","last_change":"2023-10-08T16:14:36.544739+0000","last_active":"2023-10-08T16:14:36.544816+0000","last_peered":"2023-10-08T16:14:36.544816+0000","last_clean":"2023-10-08T16:14:36.544816+0000","last_became_active":"2023-10-08T16:14:36.543295+0000","last_became_peered":"2023-10-08T16:14:36.543295+0000","last_unstale":"2023-10-08T16:14:36.544816+0000","last_undegraded":"2023-10-08T16:14:36.544816+0000","last_fullsized":"2023-10-08T16:14:36.544816+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:51.926422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.531947+0000","last_change":"2023-10-08T16:14:36.531878+0000","last_active":"2023-10-08T16:14:36.531947+0000","last_peered":"2023-10-08T16:14:36.531947+0000","last_clean":"2023-10-08T16:14:36.531947+0000","last_became_active":"2023-10-08T16:14:36.531660+0000","last_became_peered":"2023-10-08T16:14:36.531660+0000","last_unstale":"2023-10-08T16:14:36.531947+0000","last_undegraded":"2023-10-08T16:14:36.531947+0000","last_fullsized":"2023-10-08T16:14:36.531947+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:07.526916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543815+0000","last_change":"2023-10-08T16:14:36.543573+0000","last_active":"2023-10-08T16:14:36.543815+0000","last_peered":"2023-10-08T16:14:36.543815+0000","last_clean":"2023-10-08T16:14:36.543815+0000","last_became_active":"2023-10-08T16:14:36.541180+0000","last_became_peered":"2023-10-08T16:14:36.541180+0000","last_unstale":"2023-10-08T16:14:36.543815+0000","last_undegraded":"2023-10-08T16:14:36.543815+0000","last_fullsized":"2023-10-08T16:14:36.543815+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:18.819178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541223+0000","last_change":"2023-10-08T16:14:36.540885+0000","last_active":"2023-10-08T16:14:36.541223+0000","last_peered":"2023-10-08T16:14:36.541223+0000","last_clean":"2023-10-08T16:14:36.541223+0000","last_became_active":"2023-10-08T16:14:36.540073+0000","last_became_peered":"2023-10-08T16:14:36.540073+0000","last_unstale":"2023-10-08T16:14:36.541223+0000","last_undegraded":"2023-10-08T16:14:36.541223+0000","last_fullsized":"2023-10-08T16:14:36.541223+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.528528+0000","last_change":"2023-10-08T16:14:36.528410+0000","last_active":"2023-10-08T16:14:36.528528+0000","last_peered":"2023-10-08T16:14:36.528528+0000","last_clean":"2023-10-08T16:14:36.528528+0000","last_became_active":"2023-10-08T16:14:36.528158+0000","last_became_peered":"2023-10-08T16:14:36.528158+0000","last_unstale":"2023-10-08T16:14:36.528528+0000","last_undegraded":"2023-10-08T16:14:36.528528+0000","last_fullsized":"2023-10-08T16:14:36.528528+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532360+0000","last_change":"2023-10-08T16:14:36.532255+0000","last_active":"2023-10-08T16:14:36.532360+0000","last_peered":"2023-10-08T16:14:36.532360+0000","last_clean":"2023-10-08T16:14:36.532360+0000","last_became_active":"2023-10-08T16:14:36.531724+0000","last_became_peered":"2023-10-08T16:14:36.531724+0000","last_unstale":"2023-10-08T16:14:36.532360+0000","last_undegraded":"2023-10-08T16:14:36.532360+0000","last_fullsized":"2023-10-08T16:14:36.532360+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:47.261566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543833+0000","last_change":"2023-10-08T16:14:36.543285+0000","last_active":"2023-10-08T16:14:36.543833+0000","last_peered":"2023-10-08T16:14:36.543833+0000","last_clean":"2023-10-08T16:14:36.543833+0000","last_became_active":"2023-10-08T16:14:36.542888+0000","last_became_peered":"2023-10-08T16:14:36.542888+0000","last_unstale":"2023-10-08T16:14:36.543833+0000","last_undegraded":"2023-10-08T16:14:36.543833+0000","last_fullsized":"2023-10-08T16:14:36.543833+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:12.709514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533246+0000","last_change":"2023-10-08T16:14:36.533175+0000","last_active":"2023-10-08T16:14:36.533246+0000","last_peered":"2023-10-08T16:14:36.533246+0000","last_clean":"2023-10-08T16:14:36.533246+0000","last_became_active":"2023-10-08T16:14:36.532815+0000","last_became_peered":"2023-10-08T16:14:36.532815+0000","last_unstale":"2023-10-08T16:14:36.533246+0000","last_undegraded":"2023-10-08T16:14:36.533246+0000","last_fullsized":"2023-10-08T16:14:36.533246+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538095+0000","last_change":"2023-10-08T16:14:36.537763+0000","last_active":"2023-10-08T16:14:36.538095+0000","last_peered":"2023-10-08T16:14:36.538095+0000","last_clean":"2023-10-08T16:14:36.538095+0000","last_became_active":"2023-10-08T16:14:36.537383+0000","last_became_peered":"2023-10-08T16:14:36.537383+0000","last_unstale":"2023-10-08T16:14:36.538095+0000","last_undegraded":"2023-10-08T16:14:36.538095+0000","last_fullsized":"2023-10-08T16:14:36.538095+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543135+0000","last_change":"2023-10-08T16:14:36.542607+0000","last_active":"2023-10-08T16:14:36.543135+0000","last_peered":"2023-10-08T16:14:36.543135+0000","last_clean":"2023-10-08T16:14:36.543135+0000","last_became_active":"2023-10-08T16:14:36.542077+0000","last_became_peered":"2023-10-08T16:14:36.542077+0000","last_unstale":"2023-10-08T16:14:36.543135+0000","last_undegraded":"2023-10-08T16:14:36.543135+0000","last_fullsized":"2023-10-08T16:14:36.543135+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:02.670806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532564+0000","last_change":"2023-10-08T16:14:36.532454+0000","last_active":"2023-10-08T16:14:36.532564+0000","last_peered":"2023-10-08T16:14:36.532564+0000","last_clean":"2023-10-08T16:14:36.532564+0000","last_became_active":"2023-10-08T16:14:36.531972+0000","last_became_peered":"2023-10-08T16:14:36.531972+0000","last_unstale":"2023-10-08T16:14:36.532564+0000","last_undegraded":"2023-10-08T16:14:36.532564+0000","last_fullsized":"2023-10-08T16:14:36.532564+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:06.910192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.529482+0000","last_change":"2023-10-08T16:14:36.529295+0000","last_active":"2023-10-08T16:14:36.529482+0000","last_peered":"2023-10-08T16:14:36.529482+0000","last_clean":"2023-10-08T16:14:36.529482+0000","last_became_active":"2023-10-08T16:14:36.528545+0000","last_became_peered":"2023-10-08T16:14:36.528545+0000","last_unstale":"2023-10-08T16:14:36.529482+0000","last_undegraded":"2023-10-08T16:14:36.529482+0000","last_fullsized":"2023-10-08T16:14:36.529482+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536943+0000","last_change":"2023-10-08T16:14:36.536877+0000","last_active":"2023-10-08T16:14:36.536943+0000","last_peered":"2023-10-08T16:14:36.536943+0000","last_clean":"2023-10-08T16:14:36.536943+0000","last_became_active":"2023-10-08T16:14:36.536282+0000","last_became_peered":"2023-10-08T16:14:36.536282+0000","last_unstale":"2023-10-08T16:14:36.536943+0000","last_undegraded":"2023-10-08T16:14:36.536943+0000","last_fullsized":"2023-10-08T16:14:36.536943+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:14.576667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540002+0000","last_change":"2023-10-08T16:14:36.539949+0000","last_active":"2023-10-08T16:14:36.540002+0000","last_peered":"2023-10-08T16:14:36.540002+0000","last_clean":"2023-10-08T16:14:36.540002+0000","last_became_active":"2023-10-08T16:14:36.539789+0000","last_became_peered":"2023-10-08T16:14:36.539789+0000","last_unstale":"2023-10-08T16:14:36.540002+0000","last_undegraded":"2023-10-08T16:14:36.540002+0000","last_fullsized":"2023-10-08T16:14:36.540002+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:51.320613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535418+0000","last_change":"2023-10-08T16:14:36.535347+0000","last_active":"2023-10-08T16:14:36.535418+0000","last_peered":"2023-10-08T16:14:36.535418+0000","last_clean":"2023-10-08T16:14:36.535418+0000","last_became_active":"2023-10-08T16:14:36.534994+0000","last_became_peered":"2023-10-08T16:14:36.534994+0000","last_unstale":"2023-10-08T16:14:36.535418+0000","last_undegraded":"2023-10-08T16:14:36.535418+0000","last_fullsized":"2023-10-08T16:14:36.535418+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:32.706222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536927+0000","last_change":"2023-10-08T16:14:36.535966+0000","last_active":"2023-10-08T16:14:36.536927+0000","last_peered":"2023-10-08T16:14:36.536927+0000","last_clean":"2023-10-08T16:14:36.536927+0000","last_became_active":"2023-10-08T16:14:36.535573+0000","last_became_peered":"2023-10-08T16:14:36.535573+0000","last_unstale":"2023-10-08T16:14:36.536927+0000","last_undegraded":"2023-10-08T16:14:36.536927+0000","last_fullsized":"2023-10-08T16:14:36.536927+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540014+0000","last_change":"2023-10-08T16:14:36.539508+0000","last_active":"2023-10-08T16:14:36.540014+0000","last_peered":"2023-10-08T16:14:36.540014+0000","last_clean":"2023-10-08T16:14:36.540014+0000","last_became_active":"2023-10-08T16:14:36.539224+0000","last_became_peered":"2023-10-08T16:14:36.539224+0000","last_unstale":"2023-10-08T16:14:36.540014+0000","last_undegraded":"2023-10-08T16:14:36.540014+0000","last_fullsized":"2023-10-08T16:14:36.540014+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:08.786869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533669+0000","last_change":"2023-10-08T16:14:36.533536+0000","last_active":"2023-10-08T16:14:36.533669+0000","last_peered":"2023-10-08T16:14:36.533669+0000","last_clean":"2023-10-08T16:14:36.533669+0000","last_became_active":"2023-10-08T16:14:36.532682+0000","last_became_peered":"2023-10-08T16:14:36.532682+0000","last_unstale":"2023-10-08T16:14:36.533669+0000","last_undegraded":"2023-10-08T16:14:36.533669+0000","last_fullsized":"2023-10-08T16:14:36.533669+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:52.264778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.542647+0000","last_change":"2023-10-08T16:14:36.542305+0000","last_active":"2023-10-08T16:14:36.542647+0000","last_peered":"2023-10-08T16:14:36.542647+0000","last_clean":"2023-10-08T16:14:36.542647+0000","last_became_active":"2023-10-08T16:14:36.540967+0000","last_became_peered":"2023-10-08T16:14:36.540967+0000","last_unstale":"2023-10-08T16:14:36.542647+0000","last_undegraded":"2023-10-08T16:14:36.542647+0000","last_fullsized":"2023-10-08T16:14:36.542647+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:33.592749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"163'4","reported_seq":14,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549305+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:36.549305+0000","last_peered":"2023-10-08T16:14:36.549305+0000","last_clean":"2023-10-08T16:14:36.549305+0000","last_became_active":"2023-10-08T16:14:35.530283+0000","last_became_peered":"2023-10-08T16:14:35.530283+0000","last_unstale":"2023-10-08T16:14:36.549305+0000","last_undegraded":"2023-10-08T16:14:36.549305+0000","last_fullsized":"2023-10-08T16:14:36.549305+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535162+0000","last_change":"2023-10-08T16:14:36.535094+0000","last_active":"2023-10-08T16:14:36.535162+0000","last_peered":"2023-10-08T16:14:36.535162+0000","last_clean":"2023-10-08T16:14:36.535162+0000","last_became_active":"2023-10-08T16:14:36.534865+0000","last_became_peered":"2023-10-08T16:14:36.534865+0000","last_unstale":"2023-10-08T16:14:36.535162+0000","last_undegraded":"2023-10-08T16:14:36.535162+0000","last_fullsized":"2023-10-08T16:14:36.535162+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:30.911479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546686+0000","last_change":"2023-10-08T16:14:35.528823+0000","last_active":"2023-10-08T16:14:36.546686+0000","last_peered":"2023-10-08T16:14:36.546686+0000","last_clean":"2023-10-08T16:14:36.546686+0000","last_became_active":"2023-10-08T16:14:35.528277+0000","last_became_peered":"2023-10-08T16:14:35.528277+0000","last_unstale":"2023-10-08T16:14:36.546686+0000","last_undegraded":"2023-10-08T16:14:36.546686+0000","last_fullsized":"2023-10-08T16:14:36.546686+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.530362+0000","last_change":"2023-10-08T16:14:36.529416+0000","last_active":"2023-10-08T16:14:36.530362+0000","last_peered":"2023-10-08T16:14:36.530362+0000","last_clean":"2023-10-08T16:14:36.530362+0000","last_became_active":"2023-10-08T16:14:36.529003+0000","last_became_peered":"2023-10-08T16:14:36.529003+0000","last_unstale":"2023-10-08T16:14:36.530362+0000","last_undegraded":"2023-10-08T16:14:36.530362+0000","last_fullsized":"2023-10-08T16:14:36.530362+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550467+0000","last_change":"2023-10-08T16:14:35.534635+0000","last_active":"2023-10-08T16:14:36.550467+0000","last_peered":"2023-10-08T16:14:36.550467+0000","last_clean":"2023-10-08T16:14:36.550467+0000","last_became_active":"2023-10-08T16:14:35.534355+0000","last_became_peered":"2023-10-08T16:14:35.534355+0000","last_unstale":"2023-10-08T16:14:36.550467+0000","last_undegraded":"2023-10-08T16:14:36.550467+0000","last_fullsized":"2023-10-08T16:14:36.550467+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:39.851266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.544412+0000","last_change":"2023-10-08T16:14:36.544348+0000","last_active":"2023-10-08T16:14:36.544412+0000","last_peered":"2023-10-08T16:14:36.544412+0000","last_clean":"2023-10-08T16:14:36.544412+0000","last_became_active":"2023-10-08T16:14:36.543057+0000","last_became_peered":"2023-10-08T16:14:36.543057+0000","last_unstale":"2023-10-08T16:14:36.544412+0000","last_undegraded":"2023-10-08T16:14:36.544412+0000","last_fullsized":"2023-10-08T16:14:36.544412+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:20.659457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549210+0000","last_change":"2023-10-08T16:14:35.526756+0000","last_active":"2023-10-08T16:14:36.549210+0000","last_peered":"2023-10-08T16:14:36.549210+0000","last_clean":"2023-10-08T16:14:36.549210+0000","last_became_active":"2023-10-08T16:14:35.525963+0000","last_became_peered":"2023-10-08T16:14:35.525963+0000","last_unstale":"2023-10-08T16:14:36.549210+0000","last_undegraded":"2023-10-08T16:14:36.549210+0000","last_fullsized":"2023-10-08T16:14:36.549210+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:45.042175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540023+0000","last_change":"2023-10-08T16:14:36.539954+0000","last_active":"2023-10-08T16:14:36.540023+0000","last_peered":"2023-10-08T16:14:36.540023+0000","last_clean":"2023-10-08T16:14:36.540023+0000","last_became_active":"2023-10-08T16:14:36.539789+0000","last_became_peered":"2023-10-08T16:14:36.539789+0000","last_unstale":"2023-10-08T16:14:36.540023+0000","last_undegraded":"2023-10-08T16:14:36.540023+0000","last_fullsized":"2023-10-08T16:14:36.540023+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:12.709514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.544582+0000","last_change":"2023-10-08T16:14:35.536224+0000","last_active":"2023-10-08T16:14:36.544582+0000","last_peered":"2023-10-08T16:14:36.544582+0000","last_clean":"2023-10-08T16:14:36.544582+0000","last_became_active":"2023-10-08T16:14:35.536000+0000","last_became_peered":"2023-10-08T16:14:35.536000+0000","last_unstale":"2023-10-08T16:14:36.544582+0000","last_undegraded":"2023-10-08T16:14:36.544582+0000","last_fullsized":"2023-10-08T16:14:36.544582+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:10.051744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535743+0000","last_change":"2023-10-08T16:14:36.535666+0000","last_active":"2023-10-08T16:14:36.535743+0000","last_peered":"2023-10-08T16:14:36.535743+0000","last_clean":"2023-10-08T16:14:36.535743+0000","last_became_active":"2023-10-08T16:14:36.535435+0000","last_became_peered":"2023-10-08T16:14:36.535435+0000","last_unstale":"2023-10-08T16:14:36.535743+0000","last_undegraded":"2023-10-08T16:14:36.535743+0000","last_fullsized":"2023-10-08T16:14:36.535743+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546272+0000","last_change":"2023-10-08T16:14:35.534559+0000","last_active":"2023-10-08T16:14:36.546272+0000","last_peered":"2023-10-08T16:14:36.546272+0000","last_clean":"2023-10-08T16:14:36.546272+0000","last_became_active":"2023-10-08T16:14:35.533456+0000","last_became_peered":"2023-10-08T16:14:35.533456+0000","last_unstale":"2023-10-08T16:14:36.546272+0000","last_undegraded":"2023-10-08T16:14:36.546272+0000","last_fullsized":"2023-10-08T16:14:36.546272+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:27.315679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532597+0000","last_change":"2023-10-08T16:14:36.532530+0000","last_active":"2023-10-08T16:14:36.532597+0000","last_peered":"2023-10-08T16:14:36.532597+0000","last_clean":"2023-10-08T16:14:36.532597+0000","last_became_active":"2023-10-08T16:14:36.532323+0000","last_became_peered":"2023-10-08T16:14:36.532323+0000","last_unstale":"2023-10-08T16:14:36.532597+0000","last_undegraded":"2023-10-08T16:14:36.532597+0000","last_fullsized":"2023-10-08T16:14:36.532597+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:49.933447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527485+0000","last_change":"2023-10-08T16:14:35.533435+0000","last_active":"2023-10-08T16:14:36.527485+0000","last_peered":"2023-10-08T16:14:36.527485+0000","last_clean":"2023-10-08T16:14:36.527485+0000","last_became_active":"2023-10-08T16:14:35.533127+0000","last_became_peered":"2023-10-08T16:14:35.533127+0000","last_unstale":"2023-10-08T16:14:36.527485+0000","last_undegraded":"2023-10-08T16:14:36.527485+0000","last_fullsized":"2023-10-08T16:14:36.527485+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:41.119530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.531963+0000","last_change":"2023-10-08T16:14:36.531863+0000","last_active":"2023-10-08T16:14:36.531963+0000","last_peered":"2023-10-08T16:14:36.531963+0000","last_clean":"2023-10-08T16:14:36.531963+0000","last_became_active":"2023-10-08T16:14:36.531590+0000","last_became_peered":"2023-10-08T16:14:36.531590+0000","last_unstale":"2023-10-08T16:14:36.531963+0000","last_undegraded":"2023-10-08T16:14:36.531963+0000","last_fullsized":"2023-10-08T16:14:36.531963+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:57.114558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527765+0000","last_change":"2023-10-08T16:14:35.527658+0000","last_active":"2023-10-08T16:14:36.527765+0000","last_peered":"2023-10-08T16:14:36.527765+0000","last_clean":"2023-10-08T16:14:36.527765+0000","last_became_active":"2023-10-08T16:14:35.527387+0000","last_became_peered":"2023-10-08T16:14:35.527387+0000","last_unstale":"2023-10-08T16:14:36.527765+0000","last_undegraded":"2023-10-08T16:14:36.527765+0000","last_fullsized":"2023-10-08T16:14:36.527765+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:38.892625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535430+0000","last_change":"2023-10-08T16:14:36.535261+0000","last_active":"2023-10-08T16:14:36.535430+0000","last_peered":"2023-10-08T16:14:36.535430+0000","last_clean":"2023-10-08T16:14:36.535430+0000","last_became_active":"2023-10-08T16:14:36.534901+0000","last_became_peered":"2023-10-08T16:14:36.534901+0000","last_unstale":"2023-10-08T16:14:36.535430+0000","last_undegraded":"2023-10-08T16:14:36.535430+0000","last_fullsized":"2023-10-08T16:14:36.535430+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:15.038742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527077+0000","last_change":"2023-10-08T16:14:35.534022+0000","last_active":"2023-10-08T16:14:36.527077+0000","last_peered":"2023-10-08T16:14:36.527077+0000","last_clean":"2023-10-08T16:14:36.527077+0000","last_became_active":"2023-10-08T16:14:35.533797+0000","last_became_peered":"2023-10-08T16:14:35.533797+0000","last_unstale":"2023-10-08T16:14:36.527077+0000","last_undegraded":"2023-10-08T16:14:36.527077+0000","last_fullsized":"2023-10-08T16:14:36.527077+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543328+0000","last_change":"2023-10-08T16:14:36.543127+0000","last_active":"2023-10-08T16:14:36.543328+0000","last_peered":"2023-10-08T16:14:36.543328+0000","last_clean":"2023-10-08T16:14:36.543328+0000","last_became_active":"2023-10-08T16:14:36.542368+0000","last_became_peered":"2023-10-08T16:14:36.542368+0000","last_unstale":"2023-10-08T16:14:36.543328+0000","last_undegraded":"2023-10-08T16:14:36.543328+0000","last_fullsized":"2023-10-08T16:14:36.543328+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:30.911479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536687+0000","last_change":"2023-10-08T16:14:35.535905+0000","last_active":"2023-10-08T16:14:36.536687+0000","last_peered":"2023-10-08T16:14:36.536687+0000","last_clean":"2023-10-08T16:14:36.536687+0000","last_became_active":"2023-10-08T16:14:35.534121+0000","last_became_peered":"2023-10-08T16:14:35.534121+0000","last_unstale":"2023-10-08T16:14:36.536687+0000","last_undegraded":"2023-10-08T16:14:36.536687+0000","last_fullsized":"2023-10-08T16:14:36.536687+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:34.367653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534616+0000","last_change":"2023-10-08T16:14:36.534553+0000","last_active":"2023-10-08T16:14:36.534616+0000","last_peered":"2023-10-08T16:14:36.534616+0000","last_clean":"2023-10-08T16:14:36.534616+0000","last_became_active":"2023-10-08T16:14:36.534324+0000","last_became_peered":"2023-10-08T16:14:36.534324+0000","last_unstale":"2023-10-08T16:14:36.534616+0000","last_undegraded":"2023-10-08T16:14:36.534616+0000","last_fullsized":"2023-10-08T16:14:36.534616+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:58.523747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"163'6","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550310+0000","last_change":"2023-10-08T16:14:35.533438+0000","last_active":"2023-10-08T16:14:36.550310+0000","last_peered":"2023-10-08T16:14:36.550310+0000","last_clean":"2023-10-08T16:14:36.550310+0000","last_became_active":"2023-10-08T16:14:35.533222+0000","last_became_peered":"2023-10-08T16:14:35.533222+0000","last_unstale":"2023-10-08T16:14:36.550310+0000","last_undegraded":"2023-10-08T16:14:36.550310+0000","last_fullsized":"2023-10-08T16:14:36.550310+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:32.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539243+0000","last_change":"2023-10-08T16:14:36.539181+0000","last_active":"2023-10-08T16:14:36.539243+0000","last_peered":"2023-10-08T16:14:36.539243+0000","last_clean":"2023-10-08T16:14:36.539243+0000","last_became_active":"2023-10-08T16:14:36.538951+0000","last_became_peered":"2023-10-08T16:14:36.538951+0000","last_unstale":"2023-10-08T16:14:36.539243+0000","last_undegraded":"2023-10-08T16:14:36.539243+0000","last_fullsized":"2023-10-08T16:14:36.539243+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549949+0000","last_change":"2023-10-08T16:14:35.532231+0000","last_active":"2023-10-08T16:14:36.549949+0000","last_peered":"2023-10-08T16:14:36.549949+0000","last_clean":"2023-10-08T16:14:36.549949+0000","last_became_active":"2023-10-08T16:14:35.531990+0000","last_became_peered":"2023-10-08T16:14:35.531990+0000","last_unstale":"2023-10-08T16:14:36.549949+0000","last_undegraded":"2023-10-08T16:14:36.549949+0000","last_fullsized":"2023-10-08T16:14:36.549949+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:18.361008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535252+0000","last_change":"2023-10-08T16:14:36.535153+0000","last_active":"2023-10-08T16:14:36.535252+0000","last_peered":"2023-10-08T16:14:36.535252+0000","last_clean":"2023-10-08T16:14:36.535252+0000","last_became_active":"2023-10-08T16:14:36.534916+0000","last_became_peered":"2023-10-08T16:14:36.534916+0000","last_unstale":"2023-10-08T16:14:36.535252+0000","last_undegraded":"2023-10-08T16:14:36.535252+0000","last_fullsized":"2023-10-08T16:14:36.535252+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:20.659457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534385+0000","last_change":"2023-10-08T16:14:35.530131+0000","last_active":"2023-10-08T16:14:36.534385+0000","last_peered":"2023-10-08T16:14:36.534385+0000","last_clean":"2023-10-08T16:14:36.534385+0000","last_became_active":"2023-10-08T16:14:35.529575+0000","last_became_peered":"2023-10-08T16:14:35.529575+0000","last_unstale":"2023-10-08T16:14:36.534385+0000","last_undegraded":"2023-10-08T16:14:36.534385+0000","last_fullsized":"2023-10-08T16:14:36.534385+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:31.698903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541612+0000","last_change":"2023-10-08T16:14:36.540870+0000","last_active":"2023-10-08T16:14:36.541612+0000","last_peered":"2023-10-08T16:14:36.541612+0000","last_clean":"2023-10-08T16:14:36.541612+0000","last_became_active":"2023-10-08T16:14:36.540181+0000","last_became_peered":"2023-10-08T16:14:36.540181+0000","last_unstale":"2023-10-08T16:14:36.541612+0000","last_undegraded":"2023-10-08T16:14:36.541612+0000","last_fullsized":"2023-10-08T16:14:36.541612+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:35.210868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.523932+0000","last_change":"2023-10-08T16:14:35.531745+0000","last_active":"2023-10-08T16:14:36.523932+0000","last_peered":"2023-10-08T16:14:36.523932+0000","last_clean":"2023-10-08T16:14:36.523932+0000","last_became_active":"2023-10-08T16:14:35.531492+0000","last_became_peered":"2023-10-08T16:14:35.531492+0000","last_unstale":"2023-10-08T16:14:36.523932+0000","last_undegraded":"2023-10-08T16:14:36.523932+0000","last_fullsized":"2023-10-08T16:14:36.523932+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:31.338071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536303+0000","last_change":"2023-10-08T16:14:36.536234+0000","last_active":"2023-10-08T16:14:36.536303+0000","last_peered":"2023-10-08T16:14:36.536303+0000","last_clean":"2023-10-08T16:14:36.536303+0000","last_became_active":"2023-10-08T16:14:36.535357+0000","last_became_peered":"2023-10-08T16:14:36.535357+0000","last_unstale":"2023-10-08T16:14:36.536303+0000","last_undegraded":"2023-10-08T16:14:36.536303+0000","last_fullsized":"2023-10-08T16:14:36.536303+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"163'8","reported_seq":18,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550089+0000","last_change":"2023-10-08T16:14:35.533894+0000","last_active":"2023-10-08T16:14:36.550089+0000","last_peered":"2023-10-08T16:14:36.550089+0000","last_clean":"2023-10-08T16:14:36.550089+0000","last_became_active":"2023-10-08T16:14:35.533668+0000","last_became_peered":"2023-10-08T16:14:35.533668+0000","last_unstale":"2023-10-08T16:14:36.550089+0000","last_undegraded":"2023-10-08T16:14:36.550089+0000","last_fullsized":"2023-10-08T16:14:36.550089+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:09.063993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546083+0000","last_change":"2023-10-08T16:14:36.545636+0000","last_active":"2023-10-08T16:14:36.546083+0000","last_peered":"2023-10-08T16:14:36.546083+0000","last_clean":"2023-10-08T16:14:36.546083+0000","last_became_active":"2023-10-08T16:14:36.545432+0000","last_became_peered":"2023-10-08T16:14:36.545432+0000","last_unstale":"2023-10-08T16:14:36.546083+0000","last_undegraded":"2023-10-08T16:14:36.546083+0000","last_fullsized":"2023-10-08T16:14:36.546083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:08.786869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546527+0000","last_change":"2023-10-08T16:14:35.529921+0000","last_active":"2023-10-08T16:14:36.546527+0000","last_peered":"2023-10-08T16:14:36.546527+0000","last_clean":"2023-10-08T16:14:36.546527+0000","last_became_active":"2023-10-08T16:14:35.529697+0000","last_became_peered":"2023-10-08T16:14:35.529697+0000","last_unstale":"2023-10-08T16:14:36.546527+0000","last_undegraded":"2023-10-08T16:14:36.546527+0000","last_fullsized":"2023-10-08T16:14:36.546527+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:19.553438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541827+0000","last_change":"2023-10-08T16:14:36.541776+0000","last_active":"2023-10-08T16:14:36.541827+0000","last_peered":"2023-10-08T16:14:36.541827+0000","last_clean":"2023-10-08T16:14:36.541827+0000","last_became_active":"2023-10-08T16:14:36.541543+0000","last_became_peered":"2023-10-08T16:14:36.541543+0000","last_unstale":"2023-10-08T16:14:36.541827+0000","last_undegraded":"2023-10-08T16:14:36.541827+0000","last_fullsized":"2023-10-08T16:14:36.541827+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:35.210868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546862+0000","last_change":"2023-10-08T16:14:35.528558+0000","last_active":"2023-10-08T16:14:36.546862+0000","last_peered":"2023-10-08T16:14:36.546862+0000","last_clean":"2023-10-08T16:14:36.546862+0000","last_became_active":"2023-10-08T16:14:35.528259+0000","last_became_peered":"2023-10-08T16:14:35.528259+0000","last_unstale":"2023-10-08T16:14:36.546862+0000","last_undegraded":"2023-10-08T16:14:36.546862+0000","last_fullsized":"2023-10-08T16:14:36.546862+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536519+0000","last_change":"2023-10-08T16:14:36.536389+0000","last_active":"2023-10-08T16:14:36.536519+0000","last_peered":"2023-10-08T16:14:36.536519+0000","last_clean":"2023-10-08T16:14:36.536519+0000","last_became_active":"2023-10-08T16:14:36.535687+0000","last_became_peered":"2023-10-08T16:14:36.535687+0000","last_unstale":"2023-10-08T16:14:36.536519+0000","last_undegraded":"2023-10-08T16:14:36.536519+0000","last_fullsized":"2023-10-08T16:14:36.536519+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.547060+0000","last_change":"2023-10-08T16:14:35.532095+0000","last_active":"2023-10-08T16:14:36.547060+0000","last_peered":"2023-10-08T16:14:36.547060+0000","last_clean":"2023-10-08T16:14:36.547060+0000","last_became_active":"2023-10-08T16:14:35.531857+0000","last_became_peered":"2023-10-08T16:14:35.531857+0000","last_unstale":"2023-10-08T16:14:36.547060+0000","last_undegraded":"2023-10-08T16:14:36.547060+0000","last_fullsized":"2023-10-08T16:14:36.547060+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:41.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539568+0000","last_change":"2023-10-08T16:14:36.539469+0000","last_active":"2023-10-08T16:14:36.539568+0000","last_peered":"2023-10-08T16:14:36.539568+0000","last_clean":"2023-10-08T16:14:36.539568+0000","last_became_active":"2023-10-08T16:14:36.538921+0000","last_became_peered":"2023-10-08T16:14:36.538921+0000","last_unstale":"2023-10-08T16:14:36.539568+0000","last_undegraded":"2023-10-08T16:14:36.539568+0000","last_fullsized":"2023-10-08T16:14:36.539568+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527975+0000","last_change":"2023-10-08T16:14:35.532912+0000","last_active":"2023-10-08T16:14:36.527975+0000","last_peered":"2023-10-08T16:14:36.527975+0000","last_clean":"2023-10-08T16:14:36.527975+0000","last_became_active":"2023-10-08T16:14:35.532682+0000","last_became_peered":"2023-10-08T16:14:35.532682+0000","last_unstale":"2023-10-08T16:14:36.527975+0000","last_undegraded":"2023-10-08T16:14:36.527975+0000","last_fullsized":"2023-10-08T16:14:36.527975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532191+0000","last_change":"2023-10-08T16:14:36.532113+0000","last_active":"2023-10-08T16:14:36.532191+0000","last_peered":"2023-10-08T16:14:36.532191+0000","last_clean":"2023-10-08T16:14:36.532191+0000","last_became_active":"2023-10-08T16:14:36.531848+0000","last_became_peered":"2023-10-08T16:14:36.531848+0000","last_unstale":"2023-10-08T16:14:36.532191+0000","last_undegraded":"2023-10-08T16:14:36.532191+0000","last_fullsized":"2023-10-08T16:14:36.532191+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546538+0000","last_change":"2023-10-08T16:14:35.535396+0000","last_active":"2023-10-08T16:14:36.546538+0000","last_peered":"2023-10-08T16:14:36.546538+0000","last_clean":"2023-10-08T16:14:36.546538+0000","last_became_active":"2023-10-08T16:14:35.534500+0000","last_became_peered":"2023-10-08T16:14:35.534500+0000","last_unstale":"2023-10-08T16:14:36.546538+0000","last_undegraded":"2023-10-08T16:14:36.546538+0000","last_fullsized":"2023-10-08T16:14:36.546538+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:01.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533766+0000","last_change":"2023-10-08T16:14:36.533676+0000","last_active":"2023-10-08T16:14:36.533766+0000","last_peered":"2023-10-08T16:14:36.533766+0000","last_clean":"2023-10-08T16:14:36.533766+0000","last_became_active":"2023-10-08T16:14:36.533334+0000","last_became_peered":"2023-10-08T16:14:36.533334+0000","last_unstale":"2023-10-08T16:14:36.533766+0000","last_undegraded":"2023-10-08T16:14:36.533766+0000","last_fullsized":"2023-10-08T16:14:36.533766+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:36.617228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538344+0000","last_change":"2023-10-08T16:14:35.529219+0000","last_active":"2023-10-08T16:14:36.538344+0000","last_peered":"2023-10-08T16:14:36.538344+0000","last_clean":"2023-10-08T16:14:36.538344+0000","last_became_active":"2023-10-08T16:14:35.527917+0000","last_became_peered":"2023-10-08T16:14:35.527917+0000","last_unstale":"2023-10-08T16:14:36.538344+0000","last_undegraded":"2023-10-08T16:14:36.538344+0000","last_fullsized":"2023-10-08T16:14:36.538344+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539898+0000","last_change":"2023-10-08T16:14:36.539333+0000","last_active":"2023-10-08T16:14:36.539898+0000","last_peered":"2023-10-08T16:14:36.539898+0000","last_clean":"2023-10-08T16:14:36.539898+0000","last_became_active":"2023-10-08T16:14:36.537951+0000","last_became_peered":"2023-10-08T16:14:36.537951+0000","last_unstale":"2023-10-08T16:14:36.539898+0000","last_undegraded":"2023-10-08T16:14:36.539898+0000","last_fullsized":"2023-10-08T16:14:36.539898+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539881+0000","last_change":"2023-10-08T16:14:35.530102+0000","last_active":"2023-10-08T16:14:36.539881+0000","last_peered":"2023-10-08T16:14:36.539881+0000","last_clean":"2023-10-08T16:14:36.539881+0000","last_became_active":"2023-10-08T16:14:35.529849+0000","last_became_peered":"2023-10-08T16:14:35.529849+0000","last_unstale":"2023-10-08T16:14:36.539881+0000","last_undegraded":"2023-10-08T16:14:36.539881+0000","last_fullsized":"2023-10-08T16:14:36.539881+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538081+0000","last_change":"2023-10-08T16:14:36.538015+0000","last_active":"2023-10-08T16:14:36.538081+0000","last_peered":"2023-10-08T16:14:36.538081+0000","last_clean":"2023-10-08T16:14:36.538081+0000","last_became_active":"2023-10-08T16:14:36.537777+0000","last_became_peered":"2023-10-08T16:14:36.537777+0000","last_unstale":"2023-10-08T16:14:36.538081+0000","last_undegraded":"2023-10-08T16:14:36.538081+0000","last_fullsized":"2023-10-08T16:14:36.538081+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:02.923751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534481+0000","last_change":"2023-10-08T16:14:35.530286+0000","last_active":"2023-10-08T16:14:36.534481+0000","last_peered":"2023-10-08T16:14:36.534481+0000","last_clean":"2023-10-08T16:14:36.534481+0000","last_became_active":"2023-10-08T16:14:35.529911+0000","last_became_peered":"2023-10-08T16:14:35.529911+0000","last_unstale":"2023-10-08T16:14:36.534481+0000","last_undegraded":"2023-10-08T16:14:36.534481+0000","last_fullsized":"2023-10-08T16:14:36.534481+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:56.162565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541596+0000","last_change":"2023-10-08T16:14:36.540701+0000","last_active":"2023-10-08T16:14:36.541596+0000","last_peered":"2023-10-08T16:14:36.541596+0000","last_clean":"2023-10-08T16:14:36.541596+0000","last_became_active":"2023-10-08T16:14:36.539830+0000","last_became_peered":"2023-10-08T16:14:36.539830+0000","last_unstale":"2023-10-08T16:14:36.541596+0000","last_undegraded":"2023-10-08T16:14:36.541596+0000","last_fullsized":"2023-10-08T16:14:36.541596+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:47.261566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549502+0000","last_change":"2023-10-08T16:14:35.534342+0000","last_active":"2023-10-08T16:14:36.549502+0000","last_peered":"2023-10-08T16:14:36.549502+0000","last_clean":"2023-10-08T16:14:36.549502+0000","last_became_active":"2023-10-08T16:14:35.530723+0000","last_became_peered":"2023-10-08T16:14:35.530723+0000","last_unstale":"2023-10-08T16:14:36.549502+0000","last_undegraded":"2023-10-08T16:14:36.549502+0000","last_fullsized":"2023-10-08T16:14:36.549502+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:23.750656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536671+0000","last_change":"2023-10-08T16:14:36.536605+0000","last_active":"2023-10-08T16:14:36.536671+0000","last_peered":"2023-10-08T16:14:36.536671+0000","last_clean":"2023-10-08T16:14:36.536671+0000","last_became_active":"2023-10-08T16:14:36.536007+0000","last_became_peered":"2023-10-08T16:14:36.536007+0000","last_unstale":"2023-10-08T16:14:36.536671+0000","last_undegraded":"2023-10-08T16:14:36.536671+0000","last_fullsized":"2023-10-08T16:14:36.536671+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.524342+0000","last_change":"2023-10-08T16:14:35.527491+0000","last_active":"2023-10-08T16:14:36.524342+0000","last_peered":"2023-10-08T16:14:36.524342+0000","last_clean":"2023-10-08T16:14:36.524342+0000","last_became_active":"2023-10-08T16:14:35.527217+0000","last_became_peered":"2023-10-08T16:14:35.527217+0000","last_unstale":"2023-10-08T16:14:36.524342+0000","last_undegraded":"2023-10-08T16:14:36.524342+0000","last_fullsized":"2023-10-08T16:14:36.524342+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:05.235391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.531227+0000","last_change":"2023-10-08T16:14:36.531163+0000","last_active":"2023-10-08T16:14:36.531227+0000","last_peered":"2023-10-08T16:14:36.531227+0000","last_clean":"2023-10-08T16:14:36.531227+0000","last_became_active":"2023-10-08T16:14:36.530944+0000","last_became_peered":"2023-10-08T16:14:36.530944+0000","last_unstale":"2023-10-08T16:14:36.531227+0000","last_undegraded":"2023-10-08T16:14:36.531227+0000","last_fullsized":"2023-10-08T16:14:36.531227+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:45.438879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.524646+0000","last_change":"2023-10-08T16:14:35.531679+0000","last_active":"2023-10-08T16:14:36.524646+0000","last_peered":"2023-10-08T16:14:36.524646+0000","last_clean":"2023-10-08T16:14:36.524646+0000","last_became_active":"2023-10-08T16:14:35.531244+0000","last_became_peered":"2023-10-08T16:14:35.531244+0000","last_unstale":"2023-10-08T16:14:36.524646+0000","last_undegraded":"2023-10-08T16:14:36.524646+0000","last_fullsized":"2023-10-08T16:14:36.524646+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:24.286147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.530390+0000","last_change":"2023-10-08T16:14:36.529722+0000","last_active":"2023-10-08T16:14:36.530390+0000","last_peered":"2023-10-08T16:14:36.530390+0000","last_clean":"2023-10-08T16:14:36.530390+0000","last_became_active":"2023-10-08T16:14:36.529070+0000","last_became_peered":"2023-10-08T16:14:36.529070+0000","last_unstale":"2023-10-08T16:14:36.530390+0000","last_undegraded":"2023-10-08T16:14:36.530390+0000","last_fullsized":"2023-10-08T16:14:36.530390+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:31.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.523981+0000","last_change":"2023-10-08T16:14:35.531624+0000","last_active":"2023-10-08T16:14:36.523981+0000","last_peered":"2023-10-08T16:14:36.523981+0000","last_clean":"2023-10-08T16:14:36.523981+0000","last_became_active":"2023-10-08T16:14:35.531392+0000","last_became_peered":"2023-10-08T16:14:35.531392+0000","last_unstale":"2023-10-08T16:14:36.523981+0000","last_undegraded":"2023-10-08T16:14:36.523981+0000","last_fullsized":"2023-10-08T16:14:36.523981+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:19.981981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533147+0000","last_change":"2023-10-08T16:14:36.532956+0000","last_active":"2023-10-08T16:14:36.533147+0000","last_peered":"2023-10-08T16:14:36.533147+0000","last_clean":"2023-10-08T16:14:36.533147+0000","last_became_active":"2023-10-08T16:14:36.532251+0000","last_became_peered":"2023-10-08T16:14:36.532251+0000","last_unstale":"2023-10-08T16:14:36.533147+0000","last_undegraded":"2023-10-08T16:14:36.533147+0000","last_fullsized":"2023-10-08T16:14:36.533147+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:55.904173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.530340+0000","last_change":"2023-10-08T16:14:35.534545+0000","last_active":"2023-10-08T16:14:36.530340+0000","last_peered":"2023-10-08T16:14:36.530340+0000","last_clean":"2023-10-08T16:14:36.530340+0000","last_became_active":"2023-10-08T16:14:35.534302+0000","last_became_peered":"2023-10-08T16:14:35.534302+0000","last_unstale":"2023-10-08T16:14:36.530340+0000","last_undegraded":"2023-10-08T16:14:36.530340+0000","last_fullsized":"2023-10-08T16:14:36.530340+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:52.491849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541577+0000","last_change":"2023-10-08T16:14:36.540446+0000","last_active":"2023-10-08T16:14:36.541577+0000","last_peered":"2023-10-08T16:14:36.541577+0000","last_clean":"2023-10-08T16:14:36.541577+0000","last_became_active":"2023-10-08T16:14:36.540205+0000","last_became_peered":"2023-10-08T16:14:36.540205+0000","last_unstale":"2023-10-08T16:14:36.541577+0000","last_undegraded":"2023-10-08T16:14:36.541577+0000","last_fullsized":"2023-10-08T16:14:36.541577+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:55.904173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536873+0000","last_change":"2023-10-08T16:14:35.534486+0000","last_active":"2023-10-08T16:14:36.536873+0000","last_peered":"2023-10-08T16:14:36.536873+0000","last_clean":"2023-10-08T16:14:36.536873+0000","last_became_active":"2023-10-08T16:14:35.531018+0000","last_became_peered":"2023-10-08T16:14:35.531018+0000","last_unstale":"2023-10-08T16:14:36.536873+0000","last_undegraded":"2023-10-08T16:14:36.536873+0000","last_fullsized":"2023-10-08T16:14:36.536873+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.542663+0000","last_change":"2023-10-08T16:14:36.542457+0000","last_active":"2023-10-08T16:14:36.542663+0000","last_peered":"2023-10-08T16:14:36.542663+0000","last_clean":"2023-10-08T16:14:36.542663+0000","last_became_active":"2023-10-08T16:14:36.541733+0000","last_became_peered":"2023-10-08T16:14:36.541733+0000","last_unstale":"2023-10-08T16:14:36.542663+0000","last_undegraded":"2023-10-08T16:14:36.542663+0000","last_fullsized":"2023-10-08T16:14:36.542663+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:53.499168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538022+0000","last_change":"2023-10-08T16:14:35.531614+0000","last_active":"2023-10-08T16:14:36.538022+0000","last_peered":"2023-10-08T16:14:36.538022+0000","last_clean":"2023-10-08T16:14:36.538022+0000","last_became_active":"2023-10-08T16:14:35.530968+0000","last_became_peered":"2023-10-08T16:14:35.530968+0000","last_unstale":"2023-10-08T16:14:36.538022+0000","last_undegraded":"2023-10-08T16:14:36.538022+0000","last_fullsized":"2023-10-08T16:14:36.538022+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:30.086232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533131+0000","last_change":"2023-10-08T16:14:36.533064+0000","last_active":"2023-10-08T16:14:36.533131+0000","last_peered":"2023-10-08T16:14:36.533131+0000","last_clean":"2023-10-08T16:14:36.533131+0000","last_became_active":"2023-10-08T16:14:36.532806+0000","last_became_peered":"2023-10-08T16:14:36.532806+0000","last_unstale":"2023-10-08T16:14:36.533131+0000","last_undegraded":"2023-10-08T16:14:36.533131+0000","last_fullsized":"2023-10-08T16:14:36.533131+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:08:44.370968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.526784+0000","last_change":"2023-10-08T16:14:35.528975+0000","last_active":"2023-10-08T16:14:36.526784+0000","last_peered":"2023-10-08T16:14:36.526784+0000","last_clean":"2023-10-08T16:14:36.526784+0000","last_became_active":"2023-10-08T16:14:35.528591+0000","last_became_peered":"2023-10-08T16:14:35.528591+0000","last_unstale":"2023-10-08T16:14:36.526784+0000","last_undegraded":"2023-10-08T16:14:36.526784+0000","last_fullsized":"2023-10-08T16:14:36.526784+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:23.914194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533344+0000","last_change":"2023-10-08T16:14:36.533076+0000","last_active":"2023-10-08T16:14:36.533344+0000","last_peered":"2023-10-08T16:14:36.533344+0000","last_clean":"2023-10-08T16:14:36.533344+0000","last_became_active":"2023-10-08T16:14:36.532855+0000","last_became_peered":"2023-10-08T16:14:36.532855+0000","last_unstale":"2023-10-08T16:14:36.533344+0000","last_undegraded":"2023-10-08T16:14:36.533344+0000","last_fullsized":"2023-10-08T16:14:36.533344+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:39.652090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"163'3","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550336+0000","last_change":"2023-10-08T16:14:35.527422+0000","last_active":"2023-10-08T16:14:36.550336+0000","last_peered":"2023-10-08T16:14:36.550336+0000","last_clean":"2023-10-08T16:14:36.550336+0000","last_became_active":"2023-10-08T16:14:35.527182+0000","last_became_peered":"2023-10-08T16:14:35.527182+0000","last_unstale":"2023-10-08T16:14:36.550336+0000","last_undegraded":"2023-10-08T16:14:36.550336+0000","last_fullsized":"2023-10-08T16:14:36.550336+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:36.820186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":295,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538439+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:14:36.538439+0000","last_peered":"2023-10-08T16:14:36.538439+0000","last_clean":"2023-10-08T16:14:36.538439+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:14:36.538439+0000","last_undegraded":"2023-10-08T16:14:36.538439+0000","last_fullsized":"2023-10-08T16:14:36.538439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193841,"statfs":{"total":200000000,"available":198494044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":1.756},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":1.0089999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.69799999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48399999999999999,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60199999999999998,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61399999999999999,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.63200000000000001,"5min":11.891,"15min":11.891},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63300000000000001,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57599999999999996,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":1.252},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":1.135,"15min":1.135},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":1.169,"15min":1.169},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":3.738,"15min":3.738},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.751}]},{"osd":2,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":1.103,"15min":1.103},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.69499999999999995,"5min":3.516,"15min":3.516},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":1.502,"15min":1.502},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.63,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.92000000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59099999999999997,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.46100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.60499999999999998,"15min":3.593},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.76000000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.378,"15min":0.438},"min":{"1min":0.255,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.436},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.42399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.36799999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.60499999999999998,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.68000000000000005},"min":{"1min":0.38300000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.87,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.50600000000000001,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":3.532},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.499},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.53400000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.91600000000000004,"15min":1.095},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193840,"statfs":{"total":200000000,"available":198493098,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":1.571,"15min":1.571},"last":0.224},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.60399999999999998,"5min":3.044,"15min":3.044},"last":0.28799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58199999999999996,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.308},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.35299999999999998,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.33500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.379,"15min":0.379},"min":{"1min":0.30499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.63100000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48199999999999998,"15min":0.44700000000000001},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.48199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.401,"15min":1.401},"last":0.57599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.51400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.53900000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":3.665,"15min":3.665},"last":0.44}]},{"osd":7,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":895,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40300000000000002,"15min":0.437},"min":{"1min":0.36599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.501}]},{"osd":1,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.746},"last":0.371},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.438},"min":{"1min":0.33400000000000002,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.71599999999999997,"15min":1.3260000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.40699999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.95899999999999996,"15min":0.97499999999999998},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.0700000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.92200000000000004,"15min":2.9319999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.54600000000000004,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.091},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.97599999999999998,"15min":0.98599999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.83599999999999997,"5min":1.042,"15min":3.0030000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.81200000000000006,"5min":1.073,"15min":1.073},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34999999999999998,"15min":0.32700000000000001},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.63900000000000001},"last":0.25900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.58399999999999996,"5min":0.65500000000000003,"15min":0.65900000000000003},"last":0.218},{"interface":"front","average":{"1min":0.442,"5min":0.40799999999999997,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.67800000000000005},"last":0.27600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.38100000000000001},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.40699999999999997},"min":{"1min":0.35299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.28799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96899999999999997},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.026},"last":0.54900000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94399999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.94999999999999996},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199085036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.66500000000000004,"5min":0.82999999999999996,"15min":1.141},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":1.149},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":7.4749999999999996},"last":0.625},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.47199999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.65400000000000003,"5min":0.80400000000000005,"15min":3.8730000000000002},"last":0.434}]},{"osd":2,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.875,"15min":14.6},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":7.556},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.754},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.77200000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199085014,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76700000000000002,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.502},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.90400000000000003},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46000000000000002,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.70199999999999996,"15min":0.80600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.68999999999999995,"15min":0.77700000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.73999999999999999,"15min":0.89400000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.59099999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.72499999999999998,"15min":0.77800000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.60299999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T16:14:45.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:14:45.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.354+0000 7fcbe82af700 1 Processor -- start 2023-10-08T16:14:45.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.354+0000 7fcbe82af700 1 -- start start 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.355+0000 7fcbe82af700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbe0152010 0x7fcbe015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.355+0000 7fcbe82af700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.355+0000 7fcbe82af700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe006c010 con 0x7fcbe01523e0 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.355+0000 7fcbe82af700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe006bd10 con 0x7fcbe0152010 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.355+0000 7fcbe82af700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe015c060 con 0x7fcbe0158e50 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe584a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcbe01523e0 0x7fcbe006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41602/0 (socket says 172.21.15.60:41602) 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe584a700 1 -- 172.21.15.60:0/3552419534 learned_addr learned my addr 172.21.15.60:0/3552419534 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe604b700 1 --2- 172.21.15.60:0/3552419534 >> v2:172.21.15.144:3300/0 conn(0x7fcbe0152010 0x7fcbe015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe684c700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe5049700 1 -- 172.21.15.60:0/3552419534 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762682941 0 0) 0x7fcbe006c010 con 0x7fcbe01523e0 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe5049700 1 -- 172.21.15.60:0/3552419534 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc8003570 con 0x7fcbe01523e0 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe604b700 1 -- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 msgr2=0x7fcbe00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe604b700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe604b700 1 -- 172.21.15.60:0/3552419534 >> v1:172.21.15.60:6789/0 conn(0x7fcbe01523e0 legacy=0x7fcbe006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe604b700 1 -- 172.21.15.60:0/3552419534 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe015c340 con 0x7fcbe0152010 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe684c700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe604b700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe015b810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80098e0 tx=0x7fcbd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e1ba7a2bac7f330 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.356+0000 7fcbe5049700 1 -- 172.21.15.60:0/3552419534 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8011630 con 0x7fcbe0152010 2023-10-08T16:14:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe5049700 1 -- 172.21.15.60:0/3552419534 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd8011790 con 0x7fcbe0152010 2023-10-08T16:14:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe5049700 1 -- 172.21.15.60:0/3552419534 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8011b10 con 0x7fcbe0152010 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 -- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 msgr2=0x7fcbe015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe015b810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80098e0 tx=0x7fcbd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 -- 172.21.15.60:0/3552419534 shutdown_connections 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 --2- 172.21.15.60:0/3552419534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe015b810 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 -- 172.21.15.60:0/3552419534 >> 172.21.15.60:0/3552419534 conn(0x7fcbe0069870 msgr2=0x7fcbe0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 -- 172.21.15.60:0/3552419534 shutdown_connections 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.357+0000 7fcbe82af700 1 -- 172.21.15.60:0/3552419534 wait complete. 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.358+0000 7fcbe82af700 1 Processor -- start 2023-10-08T16:14:45.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.358+0000 7fcbe82af700 1 -- start start 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe82af700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe00c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe82af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 0x7fcbe0145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe82af700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe82af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00b3220 con 0x7fcbe01523e0 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe82af700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00c71e0 con 0x7fcbe0152010 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe82af700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00c6130 con 0x7fcbe0158e50 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe584a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 0x7fcbe0145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe584a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 0x7fcbe0145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59502/0 (socket says 172.21.15.60:59502) 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe584a700 1 -- 172.21.15.60:0/2777091126 learned_addr learned my addr 172.21.15.60:0/2777091126 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.359+0000 7fcbe604b700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe00c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe684c700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe584a700 1 -- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 msgr2=0x7fcbe00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe584a700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe584a700 1 -- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 msgr2=0x7fcbe00c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe584a700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe00c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe584a700 1 -- 172.21.15.60:0/2777091126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd0009a20 con 0x7fcbe01523e0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe584a700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 0x7fcbe0145620 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40011e0 tx=0x7fcbd4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4005b30 con 0x7fcbe01523e0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4005c90 con 0x7fcbe01523e0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd8009420 con 0x7fcbe01523e0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40072e0 con 0x7fcbe01523e0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.360+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe00c63d0 con 0x7fcbe01523e0 2023-10-08T16:14:45.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.361+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe00c7350 con 0x7fcbe01523e0 2023-10-08T16:14:45.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.362+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbd4007650 con 0x7fcbe01523e0 2023-10-08T16:14:45.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.362+0000 7fcbde7fc700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbcc066f30 0x7fcbcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.362+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcbd4083950 con 0x7fcbe01523e0 2023-10-08T16:14:45.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.362+0000 7fcbe604b700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbcc066f30 0x7fcbcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.363+0000 7fcbe604b700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbcc066f30 0x7fcbcc0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80091e0 tx=0x7fcbd8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:45.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.367+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbd404b5a0 con 0x7fcbe01523e0 2023-10-08T16:14:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.555+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbe004c3c0 con 0x7fcbcc066f30 2023-10-08T16:14:45.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.563+0000 7fcbde7fc700 1 -- 172.21.15.60:0/2777091126 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285498 (secure 0 0 0) 0x7fcbe004c3c0 con 0x7fcbcc066f30 2023-10-08T16:14:45.567 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbcc066f30 msgr2=0x7fcbcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbcc066f30 0x7fcbcc0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80091e0 tx=0x7fcbd8017000 comp rx=0 tx=0).stop 2023-10-08T16:14:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 msgr2=0x7fcbe0145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 0x7fcbe0145620 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40011e0 tx=0x7fcbd4007df0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 shutdown_connections 2023-10-08T16:14:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcbcc066f30 0x7fcbcc0693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbe0158e50 0x7fcbe00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbe0152010 0x7fcbe00c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 --2- 172.21.15.60:0/2777091126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe01523e0 0x7fcbe0145620 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 >> 172.21.15.60:0/2777091126 conn(0x7fcbe0069870 msgr2=0x7fcbe0158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 shutdown_connections 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.566+0000 7fcbe82af700 1 -- 172.21.15.60:0/2777091126 wait complete. 2023-10-08T16:14:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:14:45.579 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2023-10-08T16:14:43.688220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554194,"statfs":{"total":1600000000,"available":1591494940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001916"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540689+0000","last_change":"2023-10-08T16:14:36.540610+0000","last_active":"2023-10-08T16:14:36.540689+0000","last_peered":"2023-10-08T16:14:36.540689+0000","last_clean":"2023-10-08T16:14:36.540689+0000","last_became_active":"2023-10-08T16:14:36.540316+0000","last_became_peered":"2023-10-08T16:14:36.540316+0000","last_unstale":"2023-10-08T16:14:36.540689+0000","last_undegraded":"2023-10-08T16:14:36.540689+0000","last_fullsized":"2023-10-08T16:14:36.540689+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534443+0000","last_change":"2023-10-08T16:14:36.534377+0000","last_active":"2023-10-08T16:14:36.534443+0000","last_peered":"2023-10-08T16:14:36.534443+0000","last_clean":"2023-10-08T16:14:36.534443+0000","last_became_active":"2023-10-08T16:14:36.534161+0000","last_became_peered":"2023-10-08T16:14:36.534161+0000","last_unstale":"2023-10-08T16:14:36.534443+0000","last_undegraded":"2023-10-08T16:14:36.534443+0000","last_fullsized":"2023-10-08T16:14:36.534443+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:51.926422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541240+0000","last_change":"2023-10-08T16:14:36.541158+0000","last_active":"2023-10-08T16:14:36.541240+0000","last_peered":"2023-10-08T16:14:36.541240+0000","last_clean":"2023-10-08T16:14:36.541240+0000","last_became_active":"2023-10-08T16:14:36.540395+0000","last_became_peered":"2023-10-08T16:14:36.540395+0000","last_unstale":"2023-10-08T16:14:36.541240+0000","last_undegraded":"2023-10-08T16:14:36.541240+0000","last_fullsized":"2023-10-08T16:14:36.541240+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534060+0000","last_change":"2023-10-08T16:14:36.533872+0000","last_active":"2023-10-08T16:14:36.534060+0000","last_peered":"2023-10-08T16:14:36.534060+0000","last_clean":"2023-10-08T16:14:36.534060+0000","last_became_active":"2023-10-08T16:14:36.533635+0000","last_became_peered":"2023-10-08T16:14:36.533635+0000","last_unstale":"2023-10-08T16:14:36.534060+0000","last_undegraded":"2023-10-08T16:14:36.534060+0000","last_fullsized":"2023-10-08T16:14:36.534060+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.542756+0000","last_change":"2023-10-08T16:14:36.542674+0000","last_active":"2023-10-08T16:14:36.542756+0000","last_peered":"2023-10-08T16:14:36.542756+0000","last_clean":"2023-10-08T16:14:36.542756+0000","last_became_active":"2023-10-08T16:14:36.542436+0000","last_became_peered":"2023-10-08T16:14:36.542436+0000","last_unstale":"2023-10-08T16:14:36.542756+0000","last_undegraded":"2023-10-08T16:14:36.542756+0000","last_fullsized":"2023-10-08T16:14:36.542756+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:52.264778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539685+0000","last_change":"2023-10-08T16:14:36.539629+0000","last_active":"2023-10-08T16:14:36.539685+0000","last_peered":"2023-10-08T16:14:36.539685+0000","last_clean":"2023-10-08T16:14:36.539685+0000","last_became_active":"2023-10-08T16:14:36.539226+0000","last_became_peered":"2023-10-08T16:14:36.539226+0000","last_unstale":"2023-10-08T16:14:36.539685+0000","last_undegraded":"2023-10-08T16:14:36.539685+0000","last_fullsized":"2023-10-08T16:14:36.539685+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535217+0000","last_change":"2023-10-08T16:14:36.535153+0000","last_active":"2023-10-08T16:14:36.535217+0000","last_peered":"2023-10-08T16:14:36.535217+0000","last_clean":"2023-10-08T16:14:36.535217+0000","last_became_active":"2023-10-08T16:14:36.534940+0000","last_became_peered":"2023-10-08T16:14:36.534940+0000","last_unstale":"2023-10-08T16:14:36.535217+0000","last_undegraded":"2023-10-08T16:14:36.535217+0000","last_fullsized":"2023-10-08T16:14:36.535217+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:54.534171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532171+0000","last_change":"2023-10-08T16:14:36.532107+0000","last_active":"2023-10-08T16:14:36.532171+0000","last_peered":"2023-10-08T16:14:36.532171+0000","last_clean":"2023-10-08T16:14:36.532171+0000","last_became_active":"2023-10-08T16:14:36.531856+0000","last_became_peered":"2023-10-08T16:14:36.531856+0000","last_unstale":"2023-10-08T16:14:36.532171+0000","last_undegraded":"2023-10-08T16:14:36.532171+0000","last_fullsized":"2023-10-08T16:14:36.532171+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:24.921512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533458+0000","last_change":"2023-10-08T16:14:36.533266+0000","last_active":"2023-10-08T16:14:36.533458+0000","last_peered":"2023-10-08T16:14:36.533458+0000","last_clean":"2023-10-08T16:14:36.533458+0000","last_became_active":"2023-10-08T16:14:36.533025+0000","last_became_peered":"2023-10-08T16:14:36.533025+0000","last_unstale":"2023-10-08T16:14:36.533458+0000","last_undegraded":"2023-10-08T16:14:36.533458+0000","last_fullsized":"2023-10-08T16:14:36.533458+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:11.958180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.548645+0000","last_change":"2023-10-08T16:14:36.548571+0000","last_active":"2023-10-08T16:14:36.548645+0000","last_peered":"2023-10-08T16:14:36.548645+0000","last_clean":"2023-10-08T16:14:36.548645+0000","last_became_active":"2023-10-08T16:14:36.548330+0000","last_became_peered":"2023-10-08T16:14:36.548330+0000","last_unstale":"2023-10-08T16:14:36.548645+0000","last_undegraded":"2023-10-08T16:14:36.548645+0000","last_fullsized":"2023-10-08T16:14:36.548645+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:56.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534752+0000","last_change":"2023-10-08T16:14:36.534682+0000","last_active":"2023-10-08T16:14:36.534752+0000","last_peered":"2023-10-08T16:14:36.534752+0000","last_clean":"2023-10-08T16:14:36.534752+0000","last_became_active":"2023-10-08T16:14:36.534233+0000","last_became_peered":"2023-10-08T16:14:36.534233+0000","last_unstale":"2023-10-08T16:14:36.534752+0000","last_undegraded":"2023-10-08T16:14:36.534752+0000","last_fullsized":"2023-10-08T16:14:36.534752+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543488+0000","last_change":"2023-10-08T16:14:36.543415+0000","last_active":"2023-10-08T16:14:36.543488+0000","last_peered":"2023-10-08T16:14:36.543488+0000","last_clean":"2023-10-08T16:14:36.543488+0000","last_became_active":"2023-10-08T16:14:36.540934+0000","last_became_peered":"2023-10-08T16:14:36.540934+0000","last_unstale":"2023-10-08T16:14:36.543488+0000","last_undegraded":"2023-10-08T16:14:36.543488+0000","last_fullsized":"2023-10-08T16:14:36.543488+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:31.281924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541628+0000","last_change":"2023-10-08T16:14:36.541013+0000","last_active":"2023-10-08T16:14:36.541628+0000","last_peered":"2023-10-08T16:14:36.541628+0000","last_clean":"2023-10-08T16:14:36.541628+0000","last_became_active":"2023-10-08T16:14:36.540478+0000","last_became_peered":"2023-10-08T16:14:36.540478+0000","last_unstale":"2023-10-08T16:14:36.541628+0000","last_undegraded":"2023-10-08T16:14:36.541628+0000","last_fullsized":"2023-10-08T16:14:36.541628+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:32:11.749887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543203+0000","last_change":"2023-10-08T16:14:36.543137+0000","last_active":"2023-10-08T16:14:36.543203+0000","last_peered":"2023-10-08T16:14:36.543203+0000","last_clean":"2023-10-08T16:14:36.543203+0000","last_became_active":"2023-10-08T16:14:36.542813+0000","last_became_peered":"2023-10-08T16:14:36.542813+0000","last_unstale":"2023-10-08T16:14:36.543203+0000","last_undegraded":"2023-10-08T16:14:36.543203+0000","last_fullsized":"2023-10-08T16:14:36.543203+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.544816+0000","last_change":"2023-10-08T16:14:36.544739+0000","last_active":"2023-10-08T16:14:36.544816+0000","last_peered":"2023-10-08T16:14:36.544816+0000","last_clean":"2023-10-08T16:14:36.544816+0000","last_became_active":"2023-10-08T16:14:36.543295+0000","last_became_peered":"2023-10-08T16:14:36.543295+0000","last_unstale":"2023-10-08T16:14:36.544816+0000","last_undegraded":"2023-10-08T16:14:36.544816+0000","last_fullsized":"2023-10-08T16:14:36.544816+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:51.926422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.531947+0000","last_change":"2023-10-08T16:14:36.531878+0000","last_active":"2023-10-08T16:14:36.531947+0000","last_peered":"2023-10-08T16:14:36.531947+0000","last_clean":"2023-10-08T16:14:36.531947+0000","last_became_active":"2023-10-08T16:14:36.531660+0000","last_became_peered":"2023-10-08T16:14:36.531660+0000","last_unstale":"2023-10-08T16:14:36.531947+0000","last_undegraded":"2023-10-08T16:14:36.531947+0000","last_fullsized":"2023-10-08T16:14:36.531947+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:07.526916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543815+0000","last_change":"2023-10-08T16:14:36.543573+0000","last_active":"2023-10-08T16:14:36.543815+0000","last_peered":"2023-10-08T16:14:36.543815+0000","last_clean":"2023-10-08T16:14:36.543815+0000","last_became_active":"2023-10-08T16:14:36.541180+0000","last_became_peered":"2023-10-08T16:14:36.541180+0000","last_unstale":"2023-10-08T16:14:36.543815+0000","last_undegraded":"2023-10-08T16:14:36.543815+0000","last_fullsized":"2023-10-08T16:14:36.543815+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:18.819178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541223+0000","last_change":"2023-10-08T16:14:36.540885+0000","last_active":"2023-10-08T16:14:36.541223+0000","last_peered":"2023-10-08T16:14:36.541223+0000","last_clean":"2023-10-08T16:14:36.541223+0000","last_became_active":"2023-10-08T16:14:36.540073+0000","last_became_peered":"2023-10-08T16:14:36.540073+0000","last_unstale":"2023-10-08T16:14:36.541223+0000","last_undegraded":"2023-10-08T16:14:36.541223+0000","last_fullsized":"2023-10-08T16:14:36.541223+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.528528+0000","last_change":"2023-10-08T16:14:36.528410+0000","last_active":"2023-10-08T16:14:36.528528+0000","last_peered":"2023-10-08T16:14:36.528528+0000","last_clean":"2023-10-08T16:14:36.528528+0000","last_became_active":"2023-10-08T16:14:36.528158+0000","last_became_peered":"2023-10-08T16:14:36.528158+0000","last_unstale":"2023-10-08T16:14:36.528528+0000","last_undegraded":"2023-10-08T16:14:36.528528+0000","last_fullsized":"2023-10-08T16:14:36.528528+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:35.374971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532360+0000","last_change":"2023-10-08T16:14:36.532255+0000","last_active":"2023-10-08T16:14:36.532360+0000","last_peered":"2023-10-08T16:14:36.532360+0000","last_clean":"2023-10-08T16:14:36.532360+0000","last_became_active":"2023-10-08T16:14:36.531724+0000","last_became_peered":"2023-10-08T16:14:36.531724+0000","last_unstale":"2023-10-08T16:14:36.532360+0000","last_undegraded":"2023-10-08T16:14:36.532360+0000","last_fullsized":"2023-10-08T16:14:36.532360+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:47.261566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543833+0000","last_change":"2023-10-08T16:14:36.543285+0000","last_active":"2023-10-08T16:14:36.543833+0000","last_peered":"2023-10-08T16:14:36.543833+0000","last_clean":"2023-10-08T16:14:36.543833+0000","last_became_active":"2023-10-08T16:14:36.542888+0000","last_became_peered":"2023-10-08T16:14:36.542888+0000","last_unstale":"2023-10-08T16:14:36.543833+0000","last_undegraded":"2023-10-08T16:14:36.543833+0000","last_fullsized":"2023-10-08T16:14:36.543833+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:12.709514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533246+0000","last_change":"2023-10-08T16:14:36.533175+0000","last_active":"2023-10-08T16:14:36.533246+0000","last_peered":"2023-10-08T16:14:36.533246+0000","last_clean":"2023-10-08T16:14:36.533246+0000","last_became_active":"2023-10-08T16:14:36.532815+0000","last_became_peered":"2023-10-08T16:14:36.532815+0000","last_unstale":"2023-10-08T16:14:36.533246+0000","last_undegraded":"2023-10-08T16:14:36.533246+0000","last_fullsized":"2023-10-08T16:14:36.533246+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538095+0000","last_change":"2023-10-08T16:14:36.537763+0000","last_active":"2023-10-08T16:14:36.538095+0000","last_peered":"2023-10-08T16:14:36.538095+0000","last_clean":"2023-10-08T16:14:36.538095+0000","last_became_active":"2023-10-08T16:14:36.537383+0000","last_became_peered":"2023-10-08T16:14:36.537383+0000","last_unstale":"2023-10-08T16:14:36.538095+0000","last_undegraded":"2023-10-08T16:14:36.538095+0000","last_fullsized":"2023-10-08T16:14:36.538095+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:50.360321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543135+0000","last_change":"2023-10-08T16:14:36.542607+0000","last_active":"2023-10-08T16:14:36.543135+0000","last_peered":"2023-10-08T16:14:36.543135+0000","last_clean":"2023-10-08T16:14:36.543135+0000","last_became_active":"2023-10-08T16:14:36.542077+0000","last_became_peered":"2023-10-08T16:14:36.542077+0000","last_unstale":"2023-10-08T16:14:36.543135+0000","last_undegraded":"2023-10-08T16:14:36.543135+0000","last_fullsized":"2023-10-08T16:14:36.543135+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:02.670806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532564+0000","last_change":"2023-10-08T16:14:36.532454+0000","last_active":"2023-10-08T16:14:36.532564+0000","last_peered":"2023-10-08T16:14:36.532564+0000","last_clean":"2023-10-08T16:14:36.532564+0000","last_became_active":"2023-10-08T16:14:36.531972+0000","last_became_peered":"2023-10-08T16:14:36.531972+0000","last_unstale":"2023-10-08T16:14:36.532564+0000","last_undegraded":"2023-10-08T16:14:36.532564+0000","last_fullsized":"2023-10-08T16:14:36.532564+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:06.910192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.529482+0000","last_change":"2023-10-08T16:14:36.529295+0000","last_active":"2023-10-08T16:14:36.529482+0000","last_peered":"2023-10-08T16:14:36.529482+0000","last_clean":"2023-10-08T16:14:36.529482+0000","last_became_active":"2023-10-08T16:14:36.528545+0000","last_became_peered":"2023-10-08T16:14:36.528545+0000","last_unstale":"2023-10-08T16:14:36.529482+0000","last_undegraded":"2023-10-08T16:14:36.529482+0000","last_fullsized":"2023-10-08T16:14:36.529482+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536943+0000","last_change":"2023-10-08T16:14:36.536877+0000","last_active":"2023-10-08T16:14:36.536943+0000","last_peered":"2023-10-08T16:14:36.536943+0000","last_clean":"2023-10-08T16:14:36.536943+0000","last_became_active":"2023-10-08T16:14:36.536282+0000","last_became_peered":"2023-10-08T16:14:36.536282+0000","last_unstale":"2023-10-08T16:14:36.536943+0000","last_undegraded":"2023-10-08T16:14:36.536943+0000","last_fullsized":"2023-10-08T16:14:36.536943+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:14.576667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540002+0000","last_change":"2023-10-08T16:14:36.539949+0000","last_active":"2023-10-08T16:14:36.540002+0000","last_peered":"2023-10-08T16:14:36.540002+0000","last_clean":"2023-10-08T16:14:36.540002+0000","last_became_active":"2023-10-08T16:14:36.539789+0000","last_became_peered":"2023-10-08T16:14:36.539789+0000","last_unstale":"2023-10-08T16:14:36.540002+0000","last_undegraded":"2023-10-08T16:14:36.540002+0000","last_fullsized":"2023-10-08T16:14:36.540002+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:51.320613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535418+0000","last_change":"2023-10-08T16:14:36.535347+0000","last_active":"2023-10-08T16:14:36.535418+0000","last_peered":"2023-10-08T16:14:36.535418+0000","last_clean":"2023-10-08T16:14:36.535418+0000","last_became_active":"2023-10-08T16:14:36.534994+0000","last_became_peered":"2023-10-08T16:14:36.534994+0000","last_unstale":"2023-10-08T16:14:36.535418+0000","last_undegraded":"2023-10-08T16:14:36.535418+0000","last_fullsized":"2023-10-08T16:14:36.535418+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:32.706222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536927+0000","last_change":"2023-10-08T16:14:36.535966+0000","last_active":"2023-10-08T16:14:36.536927+0000","last_peered":"2023-10-08T16:14:36.536927+0000","last_clean":"2023-10-08T16:14:36.536927+0000","last_became_active":"2023-10-08T16:14:36.535573+0000","last_became_peered":"2023-10-08T16:14:36.535573+0000","last_unstale":"2023-10-08T16:14:36.536927+0000","last_undegraded":"2023-10-08T16:14:36.536927+0000","last_fullsized":"2023-10-08T16:14:36.536927+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:47.119858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540014+0000","last_change":"2023-10-08T16:14:36.539508+0000","last_active":"2023-10-08T16:14:36.540014+0000","last_peered":"2023-10-08T16:14:36.540014+0000","last_clean":"2023-10-08T16:14:36.540014+0000","last_became_active":"2023-10-08T16:14:36.539224+0000","last_became_peered":"2023-10-08T16:14:36.539224+0000","last_unstale":"2023-10-08T16:14:36.540014+0000","last_undegraded":"2023-10-08T16:14:36.540014+0000","last_fullsized":"2023-10-08T16:14:36.540014+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:08.786869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533669+0000","last_change":"2023-10-08T16:14:36.533536+0000","last_active":"2023-10-08T16:14:36.533669+0000","last_peered":"2023-10-08T16:14:36.533669+0000","last_clean":"2023-10-08T16:14:36.533669+0000","last_became_active":"2023-10-08T16:14:36.532682+0000","last_became_peered":"2023-10-08T16:14:36.532682+0000","last_unstale":"2023-10-08T16:14:36.533669+0000","last_undegraded":"2023-10-08T16:14:36.533669+0000","last_fullsized":"2023-10-08T16:14:36.533669+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:52.264778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.542647+0000","last_change":"2023-10-08T16:14:36.542305+0000","last_active":"2023-10-08T16:14:36.542647+0000","last_peered":"2023-10-08T16:14:36.542647+0000","last_clean":"2023-10-08T16:14:36.542647+0000","last_became_active":"2023-10-08T16:14:36.540967+0000","last_became_peered":"2023-10-08T16:14:36.540967+0000","last_unstale":"2023-10-08T16:14:36.542647+0000","last_undegraded":"2023-10-08T16:14:36.542647+0000","last_fullsized":"2023-10-08T16:14:36.542647+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:33.592749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"163'4","reported_seq":14,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549305+0000","last_change":"2023-10-08T16:14:35.531016+0000","last_active":"2023-10-08T16:14:36.549305+0000","last_peered":"2023-10-08T16:14:36.549305+0000","last_clean":"2023-10-08T16:14:36.549305+0000","last_became_active":"2023-10-08T16:14:35.530283+0000","last_became_peered":"2023-10-08T16:14:35.530283+0000","last_unstale":"2023-10-08T16:14:36.549305+0000","last_undegraded":"2023-10-08T16:14:36.549305+0000","last_fullsized":"2023-10-08T16:14:36.549305+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535162+0000","last_change":"2023-10-08T16:14:36.535094+0000","last_active":"2023-10-08T16:14:36.535162+0000","last_peered":"2023-10-08T16:14:36.535162+0000","last_clean":"2023-10-08T16:14:36.535162+0000","last_became_active":"2023-10-08T16:14:36.534865+0000","last_became_peered":"2023-10-08T16:14:36.534865+0000","last_unstale":"2023-10-08T16:14:36.535162+0000","last_undegraded":"2023-10-08T16:14:36.535162+0000","last_fullsized":"2023-10-08T16:14:36.535162+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:30.911479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546686+0000","last_change":"2023-10-08T16:14:35.528823+0000","last_active":"2023-10-08T16:14:36.546686+0000","last_peered":"2023-10-08T16:14:36.546686+0000","last_clean":"2023-10-08T16:14:36.546686+0000","last_became_active":"2023-10-08T16:14:35.528277+0000","last_became_peered":"2023-10-08T16:14:35.528277+0000","last_unstale":"2023-10-08T16:14:36.546686+0000","last_undegraded":"2023-10-08T16:14:36.546686+0000","last_fullsized":"2023-10-08T16:14:36.546686+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:12:00.743629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.530362+0000","last_change":"2023-10-08T16:14:36.529416+0000","last_active":"2023-10-08T16:14:36.530362+0000","last_peered":"2023-10-08T16:14:36.530362+0000","last_clean":"2023-10-08T16:14:36.530362+0000","last_became_active":"2023-10-08T16:14:36.529003+0000","last_became_peered":"2023-10-08T16:14:36.529003+0000","last_unstale":"2023-10-08T16:14:36.530362+0000","last_undegraded":"2023-10-08T16:14:36.530362+0000","last_fullsized":"2023-10-08T16:14:36.530362+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550467+0000","last_change":"2023-10-08T16:14:35.534635+0000","last_active":"2023-10-08T16:14:36.550467+0000","last_peered":"2023-10-08T16:14:36.550467+0000","last_clean":"2023-10-08T16:14:36.550467+0000","last_became_active":"2023-10-08T16:14:35.534355+0000","last_became_peered":"2023-10-08T16:14:35.534355+0000","last_unstale":"2023-10-08T16:14:36.550467+0000","last_undegraded":"2023-10-08T16:14:36.550467+0000","last_fullsized":"2023-10-08T16:14:36.550467+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:39.851266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.544412+0000","last_change":"2023-10-08T16:14:36.544348+0000","last_active":"2023-10-08T16:14:36.544412+0000","last_peered":"2023-10-08T16:14:36.544412+0000","last_clean":"2023-10-08T16:14:36.544412+0000","last_became_active":"2023-10-08T16:14:36.543057+0000","last_became_peered":"2023-10-08T16:14:36.543057+0000","last_unstale":"2023-10-08T16:14:36.544412+0000","last_undegraded":"2023-10-08T16:14:36.544412+0000","last_fullsized":"2023-10-08T16:14:36.544412+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:20.659457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549210+0000","last_change":"2023-10-08T16:14:35.526756+0000","last_active":"2023-10-08T16:14:36.549210+0000","last_peered":"2023-10-08T16:14:36.549210+0000","last_clean":"2023-10-08T16:14:36.549210+0000","last_became_active":"2023-10-08T16:14:35.525963+0000","last_became_peered":"2023-10-08T16:14:35.525963+0000","last_unstale":"2023-10-08T16:14:36.549210+0000","last_undegraded":"2023-10-08T16:14:36.549210+0000","last_fullsized":"2023-10-08T16:14:36.549210+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:45.042175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.540023+0000","last_change":"2023-10-08T16:14:36.539954+0000","last_active":"2023-10-08T16:14:36.540023+0000","last_peered":"2023-10-08T16:14:36.540023+0000","last_clean":"2023-10-08T16:14:36.540023+0000","last_became_active":"2023-10-08T16:14:36.539789+0000","last_became_peered":"2023-10-08T16:14:36.539789+0000","last_unstale":"2023-10-08T16:14:36.540023+0000","last_undegraded":"2023-10-08T16:14:36.540023+0000","last_fullsized":"2023-10-08T16:14:36.540023+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:12.709514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.544582+0000","last_change":"2023-10-08T16:14:35.536224+0000","last_active":"2023-10-08T16:14:36.544582+0000","last_peered":"2023-10-08T16:14:36.544582+0000","last_clean":"2023-10-08T16:14:36.544582+0000","last_became_active":"2023-10-08T16:14:35.536000+0000","last_became_peered":"2023-10-08T16:14:35.536000+0000","last_unstale":"2023-10-08T16:14:36.544582+0000","last_undegraded":"2023-10-08T16:14:36.544582+0000","last_fullsized":"2023-10-08T16:14:36.544582+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:10.051744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535743+0000","last_change":"2023-10-08T16:14:36.535666+0000","last_active":"2023-10-08T16:14:36.535743+0000","last_peered":"2023-10-08T16:14:36.535743+0000","last_clean":"2023-10-08T16:14:36.535743+0000","last_became_active":"2023-10-08T16:14:36.535435+0000","last_became_peered":"2023-10-08T16:14:36.535435+0000","last_unstale":"2023-10-08T16:14:36.535743+0000","last_undegraded":"2023-10-08T16:14:36.535743+0000","last_fullsized":"2023-10-08T16:14:36.535743+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546272+0000","last_change":"2023-10-08T16:14:35.534559+0000","last_active":"2023-10-08T16:14:36.546272+0000","last_peered":"2023-10-08T16:14:36.546272+0000","last_clean":"2023-10-08T16:14:36.546272+0000","last_became_active":"2023-10-08T16:14:35.533456+0000","last_became_peered":"2023-10-08T16:14:35.533456+0000","last_unstale":"2023-10-08T16:14:36.546272+0000","last_undegraded":"2023-10-08T16:14:36.546272+0000","last_fullsized":"2023-10-08T16:14:36.546272+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:27.315679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532597+0000","last_change":"2023-10-08T16:14:36.532530+0000","last_active":"2023-10-08T16:14:36.532597+0000","last_peered":"2023-10-08T16:14:36.532597+0000","last_clean":"2023-10-08T16:14:36.532597+0000","last_became_active":"2023-10-08T16:14:36.532323+0000","last_became_peered":"2023-10-08T16:14:36.532323+0000","last_unstale":"2023-10-08T16:14:36.532597+0000","last_undegraded":"2023-10-08T16:14:36.532597+0000","last_fullsized":"2023-10-08T16:14:36.532597+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:49.933447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527485+0000","last_change":"2023-10-08T16:14:35.533435+0000","last_active":"2023-10-08T16:14:36.527485+0000","last_peered":"2023-10-08T16:14:36.527485+0000","last_clean":"2023-10-08T16:14:36.527485+0000","last_became_active":"2023-10-08T16:14:35.533127+0000","last_became_peered":"2023-10-08T16:14:35.533127+0000","last_unstale":"2023-10-08T16:14:36.527485+0000","last_undegraded":"2023-10-08T16:14:36.527485+0000","last_fullsized":"2023-10-08T16:14:36.527485+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:41.119530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.531963+0000","last_change":"2023-10-08T16:14:36.531863+0000","last_active":"2023-10-08T16:14:36.531963+0000","last_peered":"2023-10-08T16:14:36.531963+0000","last_clean":"2023-10-08T16:14:36.531963+0000","last_became_active":"2023-10-08T16:14:36.531590+0000","last_became_peered":"2023-10-08T16:14:36.531590+0000","last_unstale":"2023-10-08T16:14:36.531963+0000","last_undegraded":"2023-10-08T16:14:36.531963+0000","last_fullsized":"2023-10-08T16:14:36.531963+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:57.114558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527765+0000","last_change":"2023-10-08T16:14:35.527658+0000","last_active":"2023-10-08T16:14:36.527765+0000","last_peered":"2023-10-08T16:14:36.527765+0000","last_clean":"2023-10-08T16:14:36.527765+0000","last_became_active":"2023-10-08T16:14:35.527387+0000","last_became_peered":"2023-10-08T16:14:35.527387+0000","last_unstale":"2023-10-08T16:14:36.527765+0000","last_undegraded":"2023-10-08T16:14:36.527765+0000","last_fullsized":"2023-10-08T16:14:36.527765+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:38.892625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535430+0000","last_change":"2023-10-08T16:14:36.535261+0000","last_active":"2023-10-08T16:14:36.535430+0000","last_peered":"2023-10-08T16:14:36.535430+0000","last_clean":"2023-10-08T16:14:36.535430+0000","last_became_active":"2023-10-08T16:14:36.534901+0000","last_became_peered":"2023-10-08T16:14:36.534901+0000","last_unstale":"2023-10-08T16:14:36.535430+0000","last_undegraded":"2023-10-08T16:14:36.535430+0000","last_fullsized":"2023-10-08T16:14:36.535430+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:15.038742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527077+0000","last_change":"2023-10-08T16:14:35.534022+0000","last_active":"2023-10-08T16:14:36.527077+0000","last_peered":"2023-10-08T16:14:36.527077+0000","last_clean":"2023-10-08T16:14:36.527077+0000","last_became_active":"2023-10-08T16:14:35.533797+0000","last_became_peered":"2023-10-08T16:14:35.533797+0000","last_unstale":"2023-10-08T16:14:36.527077+0000","last_undegraded":"2023-10-08T16:14:36.527077+0000","last_fullsized":"2023-10-08T16:14:36.527077+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.543328+0000","last_change":"2023-10-08T16:14:36.543127+0000","last_active":"2023-10-08T16:14:36.543328+0000","last_peered":"2023-10-08T16:14:36.543328+0000","last_clean":"2023-10-08T16:14:36.543328+0000","last_became_active":"2023-10-08T16:14:36.542368+0000","last_became_peered":"2023-10-08T16:14:36.542368+0000","last_unstale":"2023-10-08T16:14:36.543328+0000","last_undegraded":"2023-10-08T16:14:36.543328+0000","last_fullsized":"2023-10-08T16:14:36.543328+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:30.911479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536687+0000","last_change":"2023-10-08T16:14:35.535905+0000","last_active":"2023-10-08T16:14:36.536687+0000","last_peered":"2023-10-08T16:14:36.536687+0000","last_clean":"2023-10-08T16:14:36.536687+0000","last_became_active":"2023-10-08T16:14:35.534121+0000","last_became_peered":"2023-10-08T16:14:35.534121+0000","last_unstale":"2023-10-08T16:14:36.536687+0000","last_undegraded":"2023-10-08T16:14:36.536687+0000","last_fullsized":"2023-10-08T16:14:36.536687+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:34.367653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534616+0000","last_change":"2023-10-08T16:14:36.534553+0000","last_active":"2023-10-08T16:14:36.534616+0000","last_peered":"2023-10-08T16:14:36.534616+0000","last_clean":"2023-10-08T16:14:36.534616+0000","last_became_active":"2023-10-08T16:14:36.534324+0000","last_became_peered":"2023-10-08T16:14:36.534324+0000","last_unstale":"2023-10-08T16:14:36.534616+0000","last_undegraded":"2023-10-08T16:14:36.534616+0000","last_fullsized":"2023-10-08T16:14:36.534616+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:58.523747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"163'6","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550310+0000","last_change":"2023-10-08T16:14:35.533438+0000","last_active":"2023-10-08T16:14:36.550310+0000","last_peered":"2023-10-08T16:14:36.550310+0000","last_clean":"2023-10-08T16:14:36.550310+0000","last_became_active":"2023-10-08T16:14:35.533222+0000","last_became_peered":"2023-10-08T16:14:35.533222+0000","last_unstale":"2023-10-08T16:14:36.550310+0000","last_undegraded":"2023-10-08T16:14:36.550310+0000","last_fullsized":"2023-10-08T16:14:36.550310+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:32.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539243+0000","last_change":"2023-10-08T16:14:36.539181+0000","last_active":"2023-10-08T16:14:36.539243+0000","last_peered":"2023-10-08T16:14:36.539243+0000","last_clean":"2023-10-08T16:14:36.539243+0000","last_became_active":"2023-10-08T16:14:36.538951+0000","last_became_peered":"2023-10-08T16:14:36.538951+0000","last_unstale":"2023-10-08T16:14:36.539243+0000","last_undegraded":"2023-10-08T16:14:36.539243+0000","last_fullsized":"2023-10-08T16:14:36.539243+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:23.353025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549949+0000","last_change":"2023-10-08T16:14:35.532231+0000","last_active":"2023-10-08T16:14:36.549949+0000","last_peered":"2023-10-08T16:14:36.549949+0000","last_clean":"2023-10-08T16:14:36.549949+0000","last_became_active":"2023-10-08T16:14:35.531990+0000","last_became_peered":"2023-10-08T16:14:35.531990+0000","last_unstale":"2023-10-08T16:14:36.549949+0000","last_undegraded":"2023-10-08T16:14:36.549949+0000","last_fullsized":"2023-10-08T16:14:36.549949+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:18.361008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.535252+0000","last_change":"2023-10-08T16:14:36.535153+0000","last_active":"2023-10-08T16:14:36.535252+0000","last_peered":"2023-10-08T16:14:36.535252+0000","last_clean":"2023-10-08T16:14:36.535252+0000","last_became_active":"2023-10-08T16:14:36.534916+0000","last_became_peered":"2023-10-08T16:14:36.534916+0000","last_unstale":"2023-10-08T16:14:36.535252+0000","last_undegraded":"2023-10-08T16:14:36.535252+0000","last_fullsized":"2023-10-08T16:14:36.535252+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:20.659457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534385+0000","last_change":"2023-10-08T16:14:35.530131+0000","last_active":"2023-10-08T16:14:36.534385+0000","last_peered":"2023-10-08T16:14:36.534385+0000","last_clean":"2023-10-08T16:14:36.534385+0000","last_became_active":"2023-10-08T16:14:35.529575+0000","last_became_peered":"2023-10-08T16:14:35.529575+0000","last_unstale":"2023-10-08T16:14:36.534385+0000","last_undegraded":"2023-10-08T16:14:36.534385+0000","last_fullsized":"2023-10-08T16:14:36.534385+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:31.698903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541612+0000","last_change":"2023-10-08T16:14:36.540870+0000","last_active":"2023-10-08T16:14:36.541612+0000","last_peered":"2023-10-08T16:14:36.541612+0000","last_clean":"2023-10-08T16:14:36.541612+0000","last_became_active":"2023-10-08T16:14:36.540181+0000","last_became_peered":"2023-10-08T16:14:36.540181+0000","last_unstale":"2023-10-08T16:14:36.541612+0000","last_undegraded":"2023-10-08T16:14:36.541612+0000","last_fullsized":"2023-10-08T16:14:36.541612+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:35.210868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.523932+0000","last_change":"2023-10-08T16:14:35.531745+0000","last_active":"2023-10-08T16:14:36.523932+0000","last_peered":"2023-10-08T16:14:36.523932+0000","last_clean":"2023-10-08T16:14:36.523932+0000","last_became_active":"2023-10-08T16:14:35.531492+0000","last_became_peered":"2023-10-08T16:14:35.531492+0000","last_unstale":"2023-10-08T16:14:36.523932+0000","last_undegraded":"2023-10-08T16:14:36.523932+0000","last_fullsized":"2023-10-08T16:14:36.523932+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:31.338071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536303+0000","last_change":"2023-10-08T16:14:36.536234+0000","last_active":"2023-10-08T16:14:36.536303+0000","last_peered":"2023-10-08T16:14:36.536303+0000","last_clean":"2023-10-08T16:14:36.536303+0000","last_became_active":"2023-10-08T16:14:36.535357+0000","last_became_peered":"2023-10-08T16:14:36.535357+0000","last_unstale":"2023-10-08T16:14:36.536303+0000","last_undegraded":"2023-10-08T16:14:36.536303+0000","last_fullsized":"2023-10-08T16:14:36.536303+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:00.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"163'8","reported_seq":18,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550089+0000","last_change":"2023-10-08T16:14:35.533894+0000","last_active":"2023-10-08T16:14:36.550089+0000","last_peered":"2023-10-08T16:14:36.550089+0000","last_clean":"2023-10-08T16:14:36.550089+0000","last_became_active":"2023-10-08T16:14:35.533668+0000","last_became_peered":"2023-10-08T16:14:35.533668+0000","last_unstale":"2023-10-08T16:14:36.550089+0000","last_undegraded":"2023-10-08T16:14:36.550089+0000","last_fullsized":"2023-10-08T16:14:36.550089+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:09.063993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546083+0000","last_change":"2023-10-08T16:14:36.545636+0000","last_active":"2023-10-08T16:14:36.546083+0000","last_peered":"2023-10-08T16:14:36.546083+0000","last_clean":"2023-10-08T16:14:36.546083+0000","last_became_active":"2023-10-08T16:14:36.545432+0000","last_became_peered":"2023-10-08T16:14:36.545432+0000","last_unstale":"2023-10-08T16:14:36.546083+0000","last_undegraded":"2023-10-08T16:14:36.546083+0000","last_fullsized":"2023-10-08T16:14:36.546083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:08.786869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546527+0000","last_change":"2023-10-08T16:14:35.529921+0000","last_active":"2023-10-08T16:14:36.546527+0000","last_peered":"2023-10-08T16:14:36.546527+0000","last_clean":"2023-10-08T16:14:36.546527+0000","last_became_active":"2023-10-08T16:14:35.529697+0000","last_became_peered":"2023-10-08T16:14:35.529697+0000","last_unstale":"2023-10-08T16:14:36.546527+0000","last_undegraded":"2023-10-08T16:14:36.546527+0000","last_fullsized":"2023-10-08T16:14:36.546527+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:19.553438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541827+0000","last_change":"2023-10-08T16:14:36.541776+0000","last_active":"2023-10-08T16:14:36.541827+0000","last_peered":"2023-10-08T16:14:36.541827+0000","last_clean":"2023-10-08T16:14:36.541827+0000","last_became_active":"2023-10-08T16:14:36.541543+0000","last_became_peered":"2023-10-08T16:14:36.541543+0000","last_unstale":"2023-10-08T16:14:36.541827+0000","last_undegraded":"2023-10-08T16:14:36.541827+0000","last_fullsized":"2023-10-08T16:14:36.541827+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:35.210868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546862+0000","last_change":"2023-10-08T16:14:35.528558+0000","last_active":"2023-10-08T16:14:36.546862+0000","last_peered":"2023-10-08T16:14:36.546862+0000","last_clean":"2023-10-08T16:14:36.546862+0000","last_became_active":"2023-10-08T16:14:35.528259+0000","last_became_peered":"2023-10-08T16:14:35.528259+0000","last_unstale":"2023-10-08T16:14:36.546862+0000","last_undegraded":"2023-10-08T16:14:36.546862+0000","last_fullsized":"2023-10-08T16:14:36.546862+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536519+0000","last_change":"2023-10-08T16:14:36.536389+0000","last_active":"2023-10-08T16:14:36.536519+0000","last_peered":"2023-10-08T16:14:36.536519+0000","last_clean":"2023-10-08T16:14:36.536519+0000","last_became_active":"2023-10-08T16:14:36.535687+0000","last_became_peered":"2023-10-08T16:14:36.535687+0000","last_unstale":"2023-10-08T16:14:36.536519+0000","last_undegraded":"2023-10-08T16:14:36.536519+0000","last_fullsized":"2023-10-08T16:14:36.536519+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:44:41.506073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.547060+0000","last_change":"2023-10-08T16:14:35.532095+0000","last_active":"2023-10-08T16:14:36.547060+0000","last_peered":"2023-10-08T16:14:36.547060+0000","last_clean":"2023-10-08T16:14:36.547060+0000","last_became_active":"2023-10-08T16:14:35.531857+0000","last_became_peered":"2023-10-08T16:14:35.531857+0000","last_unstale":"2023-10-08T16:14:36.547060+0000","last_undegraded":"2023-10-08T16:14:36.547060+0000","last_fullsized":"2023-10-08T16:14:36.547060+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:41.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539568+0000","last_change":"2023-10-08T16:14:36.539469+0000","last_active":"2023-10-08T16:14:36.539568+0000","last_peered":"2023-10-08T16:14:36.539568+0000","last_clean":"2023-10-08T16:14:36.539568+0000","last_became_active":"2023-10-08T16:14:36.538921+0000","last_became_peered":"2023-10-08T16:14:36.538921+0000","last_unstale":"2023-10-08T16:14:36.539568+0000","last_undegraded":"2023-10-08T16:14:36.539568+0000","last_fullsized":"2023-10-08T16:14:36.539568+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:24.757975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.527975+0000","last_change":"2023-10-08T16:14:35.532912+0000","last_active":"2023-10-08T16:14:36.527975+0000","last_peered":"2023-10-08T16:14:36.527975+0000","last_clean":"2023-10-08T16:14:36.527975+0000","last_became_active":"2023-10-08T16:14:35.532682+0000","last_became_peered":"2023-10-08T16:14:35.532682+0000","last_unstale":"2023-10-08T16:14:36.527975+0000","last_undegraded":"2023-10-08T16:14:36.527975+0000","last_fullsized":"2023-10-08T16:14:36.527975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.532191+0000","last_change":"2023-10-08T16:14:36.532113+0000","last_active":"2023-10-08T16:14:36.532191+0000","last_peered":"2023-10-08T16:14:36.532191+0000","last_clean":"2023-10-08T16:14:36.532191+0000","last_became_active":"2023-10-08T16:14:36.531848+0000","last_became_peered":"2023-10-08T16:14:36.531848+0000","last_unstale":"2023-10-08T16:14:36.532191+0000","last_undegraded":"2023-10-08T16:14:36.532191+0000","last_fullsized":"2023-10-08T16:14:36.532191+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:48.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.546538+0000","last_change":"2023-10-08T16:14:35.535396+0000","last_active":"2023-10-08T16:14:36.546538+0000","last_peered":"2023-10-08T16:14:36.546538+0000","last_clean":"2023-10-08T16:14:36.546538+0000","last_became_active":"2023-10-08T16:14:35.534500+0000","last_became_peered":"2023-10-08T16:14:35.534500+0000","last_unstale":"2023-10-08T16:14:36.546538+0000","last_undegraded":"2023-10-08T16:14:36.546538+0000","last_fullsized":"2023-10-08T16:14:36.546538+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:01.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533766+0000","last_change":"2023-10-08T16:14:36.533676+0000","last_active":"2023-10-08T16:14:36.533766+0000","last_peered":"2023-10-08T16:14:36.533766+0000","last_clean":"2023-10-08T16:14:36.533766+0000","last_became_active":"2023-10-08T16:14:36.533334+0000","last_became_peered":"2023-10-08T16:14:36.533334+0000","last_unstale":"2023-10-08T16:14:36.533766+0000","last_undegraded":"2023-10-08T16:14:36.533766+0000","last_fullsized":"2023-10-08T16:14:36.533766+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:36.617228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538344+0000","last_change":"2023-10-08T16:14:35.529219+0000","last_active":"2023-10-08T16:14:36.538344+0000","last_peered":"2023-10-08T16:14:36.538344+0000","last_clean":"2023-10-08T16:14:36.538344+0000","last_became_active":"2023-10-08T16:14:35.527917+0000","last_became_peered":"2023-10-08T16:14:35.527917+0000","last_unstale":"2023-10-08T16:14:36.538344+0000","last_undegraded":"2023-10-08T16:14:36.538344+0000","last_fullsized":"2023-10-08T16:14:36.538344+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:27.535442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539898+0000","last_change":"2023-10-08T16:14:36.539333+0000","last_active":"2023-10-08T16:14:36.539898+0000","last_peered":"2023-10-08T16:14:36.539898+0000","last_clean":"2023-10-08T16:14:36.539898+0000","last_became_active":"2023-10-08T16:14:36.537951+0000","last_became_peered":"2023-10-08T16:14:36.537951+0000","last_unstale":"2023-10-08T16:14:36.539898+0000","last_undegraded":"2023-10-08T16:14:36.539898+0000","last_fullsized":"2023-10-08T16:14:36.539898+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:20.634639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.539881+0000","last_change":"2023-10-08T16:14:35.530102+0000","last_active":"2023-10-08T16:14:36.539881+0000","last_peered":"2023-10-08T16:14:36.539881+0000","last_clean":"2023-10-08T16:14:36.539881+0000","last_became_active":"2023-10-08T16:14:35.529849+0000","last_became_peered":"2023-10-08T16:14:35.529849+0000","last_unstale":"2023-10-08T16:14:36.539881+0000","last_undegraded":"2023-10-08T16:14:36.539881+0000","last_fullsized":"2023-10-08T16:14:36.539881+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:47.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538081+0000","last_change":"2023-10-08T16:14:36.538015+0000","last_active":"2023-10-08T16:14:36.538081+0000","last_peered":"2023-10-08T16:14:36.538081+0000","last_clean":"2023-10-08T16:14:36.538081+0000","last_became_active":"2023-10-08T16:14:36.537777+0000","last_became_peered":"2023-10-08T16:14:36.537777+0000","last_unstale":"2023-10-08T16:14:36.538081+0000","last_undegraded":"2023-10-08T16:14:36.538081+0000","last_fullsized":"2023-10-08T16:14:36.538081+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:02.923751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.534481+0000","last_change":"2023-10-08T16:14:35.530286+0000","last_active":"2023-10-08T16:14:36.534481+0000","last_peered":"2023-10-08T16:14:36.534481+0000","last_clean":"2023-10-08T16:14:36.534481+0000","last_became_active":"2023-10-08T16:14:35.529911+0000","last_became_peered":"2023-10-08T16:14:35.529911+0000","last_unstale":"2023-10-08T16:14:36.534481+0000","last_undegraded":"2023-10-08T16:14:36.534481+0000","last_fullsized":"2023-10-08T16:14:36.534481+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:56.162565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541596+0000","last_change":"2023-10-08T16:14:36.540701+0000","last_active":"2023-10-08T16:14:36.541596+0000","last_peered":"2023-10-08T16:14:36.541596+0000","last_clean":"2023-10-08T16:14:36.541596+0000","last_became_active":"2023-10-08T16:14:36.539830+0000","last_became_peered":"2023-10-08T16:14:36.539830+0000","last_unstale":"2023-10-08T16:14:36.541596+0000","last_undegraded":"2023-10-08T16:14:36.541596+0000","last_fullsized":"2023-10-08T16:14:36.541596+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:47.261566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.549502+0000","last_change":"2023-10-08T16:14:35.534342+0000","last_active":"2023-10-08T16:14:36.549502+0000","last_peered":"2023-10-08T16:14:36.549502+0000","last_clean":"2023-10-08T16:14:36.549502+0000","last_became_active":"2023-10-08T16:14:35.530723+0000","last_became_peered":"2023-10-08T16:14:35.530723+0000","last_unstale":"2023-10-08T16:14:36.549502+0000","last_undegraded":"2023-10-08T16:14:36.549502+0000","last_fullsized":"2023-10-08T16:14:36.549502+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:23.750656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536671+0000","last_change":"2023-10-08T16:14:36.536605+0000","last_active":"2023-10-08T16:14:36.536671+0000","last_peered":"2023-10-08T16:14:36.536671+0000","last_clean":"2023-10-08T16:14:36.536671+0000","last_became_active":"2023-10-08T16:14:36.536007+0000","last_became_peered":"2023-10-08T16:14:36.536007+0000","last_unstale":"2023-10-08T16:14:36.536671+0000","last_undegraded":"2023-10-08T16:14:36.536671+0000","last_fullsized":"2023-10-08T16:14:36.536671+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:20.940450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.524342+0000","last_change":"2023-10-08T16:14:35.527491+0000","last_active":"2023-10-08T16:14:36.524342+0000","last_peered":"2023-10-08T16:14:36.524342+0000","last_clean":"2023-10-08T16:14:36.524342+0000","last_became_active":"2023-10-08T16:14:35.527217+0000","last_became_peered":"2023-10-08T16:14:35.527217+0000","last_unstale":"2023-10-08T16:14:36.524342+0000","last_undegraded":"2023-10-08T16:14:36.524342+0000","last_fullsized":"2023-10-08T16:14:36.524342+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:05.235391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.531227+0000","last_change":"2023-10-08T16:14:36.531163+0000","last_active":"2023-10-08T16:14:36.531227+0000","last_peered":"2023-10-08T16:14:36.531227+0000","last_clean":"2023-10-08T16:14:36.531227+0000","last_became_active":"2023-10-08T16:14:36.530944+0000","last_became_peered":"2023-10-08T16:14:36.530944+0000","last_unstale":"2023-10-08T16:14:36.531227+0000","last_undegraded":"2023-10-08T16:14:36.531227+0000","last_fullsized":"2023-10-08T16:14:36.531227+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:45.438879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.524646+0000","last_change":"2023-10-08T16:14:35.531679+0000","last_active":"2023-10-08T16:14:36.524646+0000","last_peered":"2023-10-08T16:14:36.524646+0000","last_clean":"2023-10-08T16:14:36.524646+0000","last_became_active":"2023-10-08T16:14:35.531244+0000","last_became_peered":"2023-10-08T16:14:35.531244+0000","last_unstale":"2023-10-08T16:14:36.524646+0000","last_undegraded":"2023-10-08T16:14:36.524646+0000","last_fullsized":"2023-10-08T16:14:36.524646+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:24.286147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.530390+0000","last_change":"2023-10-08T16:14:36.529722+0000","last_active":"2023-10-08T16:14:36.530390+0000","last_peered":"2023-10-08T16:14:36.530390+0000","last_clean":"2023-10-08T16:14:36.530390+0000","last_became_active":"2023-10-08T16:14:36.529070+0000","last_became_peered":"2023-10-08T16:14:36.529070+0000","last_unstale":"2023-10-08T16:14:36.530390+0000","last_undegraded":"2023-10-08T16:14:36.530390+0000","last_fullsized":"2023-10-08T16:14:36.530390+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:31.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.523981+0000","last_change":"2023-10-08T16:14:35.531624+0000","last_active":"2023-10-08T16:14:36.523981+0000","last_peered":"2023-10-08T16:14:36.523981+0000","last_clean":"2023-10-08T16:14:36.523981+0000","last_became_active":"2023-10-08T16:14:35.531392+0000","last_became_peered":"2023-10-08T16:14:35.531392+0000","last_unstale":"2023-10-08T16:14:36.523981+0000","last_undegraded":"2023-10-08T16:14:36.523981+0000","last_fullsized":"2023-10-08T16:14:36.523981+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:19.981981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533147+0000","last_change":"2023-10-08T16:14:36.532956+0000","last_active":"2023-10-08T16:14:36.533147+0000","last_peered":"2023-10-08T16:14:36.533147+0000","last_clean":"2023-10-08T16:14:36.533147+0000","last_became_active":"2023-10-08T16:14:36.532251+0000","last_became_peered":"2023-10-08T16:14:36.532251+0000","last_unstale":"2023-10-08T16:14:36.533147+0000","last_undegraded":"2023-10-08T16:14:36.533147+0000","last_fullsized":"2023-10-08T16:14:36.533147+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:55.904173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.530340+0000","last_change":"2023-10-08T16:14:35.534545+0000","last_active":"2023-10-08T16:14:36.530340+0000","last_peered":"2023-10-08T16:14:36.530340+0000","last_clean":"2023-10-08T16:14:36.530340+0000","last_became_active":"2023-10-08T16:14:35.534302+0000","last_became_peered":"2023-10-08T16:14:35.534302+0000","last_unstale":"2023-10-08T16:14:36.530340+0000","last_undegraded":"2023-10-08T16:14:36.530340+0000","last_fullsized":"2023-10-08T16:14:36.530340+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:52.491849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.541577+0000","last_change":"2023-10-08T16:14:36.540446+0000","last_active":"2023-10-08T16:14:36.541577+0000","last_peered":"2023-10-08T16:14:36.541577+0000","last_clean":"2023-10-08T16:14:36.541577+0000","last_became_active":"2023-10-08T16:14:36.540205+0000","last_became_peered":"2023-10-08T16:14:36.540205+0000","last_unstale":"2023-10-08T16:14:36.541577+0000","last_undegraded":"2023-10-08T16:14:36.541577+0000","last_fullsized":"2023-10-08T16:14:36.541577+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:55.904173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.536873+0000","last_change":"2023-10-08T16:14:35.534486+0000","last_active":"2023-10-08T16:14:36.536873+0000","last_peered":"2023-10-08T16:14:36.536873+0000","last_clean":"2023-10-08T16:14:36.536873+0000","last_became_active":"2023-10-08T16:14:35.531018+0000","last_became_peered":"2023-10-08T16:14:35.531018+0000","last_unstale":"2023-10-08T16:14:36.536873+0000","last_undegraded":"2023-10-08T16:14:36.536873+0000","last_fullsized":"2023-10-08T16:14:36.536873+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:02.974181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.542663+0000","last_change":"2023-10-08T16:14:36.542457+0000","last_active":"2023-10-08T16:14:36.542663+0000","last_peered":"2023-10-08T16:14:36.542663+0000","last_clean":"2023-10-08T16:14:36.542663+0000","last_became_active":"2023-10-08T16:14:36.541733+0000","last_became_peered":"2023-10-08T16:14:36.541733+0000","last_unstale":"2023-10-08T16:14:36.542663+0000","last_undegraded":"2023-10-08T16:14:36.542663+0000","last_fullsized":"2023-10-08T16:14:36.542663+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:53.499168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538022+0000","last_change":"2023-10-08T16:14:35.531614+0000","last_active":"2023-10-08T16:14:36.538022+0000","last_peered":"2023-10-08T16:14:36.538022+0000","last_clean":"2023-10-08T16:14:36.538022+0000","last_became_active":"2023-10-08T16:14:35.530968+0000","last_became_peered":"2023-10-08T16:14:35.530968+0000","last_unstale":"2023-10-08T16:14:36.538022+0000","last_undegraded":"2023-10-08T16:14:36.538022+0000","last_fullsized":"2023-10-08T16:14:36.538022+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:30.086232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533131+0000","last_change":"2023-10-08T16:14:36.533064+0000","last_active":"2023-10-08T16:14:36.533131+0000","last_peered":"2023-10-08T16:14:36.533131+0000","last_clean":"2023-10-08T16:14:36.533131+0000","last_became_active":"2023-10-08T16:14:36.532806+0000","last_became_peered":"2023-10-08T16:14:36.532806+0000","last_unstale":"2023-10-08T16:14:36.533131+0000","last_undegraded":"2023-10-08T16:14:36.533131+0000","last_fullsized":"2023-10-08T16:14:36.533131+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:08:44.370968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.526784+0000","last_change":"2023-10-08T16:14:35.528975+0000","last_active":"2023-10-08T16:14:36.526784+0000","last_peered":"2023-10-08T16:14:36.526784+0000","last_clean":"2023-10-08T16:14:36.526784+0000","last_became_active":"2023-10-08T16:14:35.528591+0000","last_became_peered":"2023-10-08T16:14:35.528591+0000","last_unstale":"2023-10-08T16:14:36.526784+0000","last_undegraded":"2023-10-08T16:14:36.526784+0000","last_fullsized":"2023-10-08T16:14:36.526784+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:43:23.914194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.533344+0000","last_change":"2023-10-08T16:14:36.533076+0000","last_active":"2023-10-08T16:14:36.533344+0000","last_peered":"2023-10-08T16:14:36.533344+0000","last_clean":"2023-10-08T16:14:36.533344+0000","last_became_active":"2023-10-08T16:14:36.532855+0000","last_became_peered":"2023-10-08T16:14:36.532855+0000","last_unstale":"2023-10-08T16:14:36.533344+0000","last_undegraded":"2023-10-08T16:14:36.533344+0000","last_fullsized":"2023-10-08T16:14:36.533344+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:35.516700+0000","last_clean_scrub_stamp":"2023-10-08T16:14:35.516700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:39.652090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"163'3","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.550336+0000","last_change":"2023-10-08T16:14:35.527422+0000","last_active":"2023-10-08T16:14:36.550336+0000","last_peered":"2023-10-08T16:14:36.550336+0000","last_clean":"2023-10-08T16:14:36.550336+0000","last_became_active":"2023-10-08T16:14:35.527182+0000","last_became_peered":"2023-10-08T16:14:35.527182+0000","last_unstale":"2023-10-08T16:14:36.550336+0000","last_undegraded":"2023-10-08T16:14:36.550336+0000","last_fullsized":"2023-10-08T16:14:36.550336+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:14:34.509381+0000","last_clean_scrub_stamp":"2023-10-08T16:14:34.509381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:36.820186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":295,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T16:14:36.538439+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:14:36.538439+0000","last_peered":"2023-10-08T16:14:36.538439+0000","last_clean":"2023-10-08T16:14:36.538439+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:14:36.538439+0000","last_undegraded":"2023-10-08T16:14:36.538439+0000","last_fullsized":"2023-10-08T16:14:36.538439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193841,"statfs":{"total":200000000,"available":198494044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84999999999999998,"15min":1.756},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":1.0089999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.69799999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48399999999999999,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60199999999999998,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61399999999999999,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.63200000000000001,"5min":11.891,"15min":11.891},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63300000000000001,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.57599999999999996,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.40300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":1.252},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":1.135,"15min":1.135},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":1.169,"15min":1.169},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33600000000000002,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":3.738,"15min":3.738},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.28999999999999998},"max":{"1min":0.75900000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.751}]},{"osd":2,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":1.103,"15min":1.103},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.69499999999999995,"5min":3.516,"15min":3.516},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":1.502,"15min":1.502},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.63,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.32300000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.92000000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59099999999999997,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.46100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.60499999999999998,"15min":3.593},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.435,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.76000000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.378,"15min":0.438},"min":{"1min":0.255,"5min":0.222,"15min":0.19700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.436},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.68600000000000005,"15min":0.80200000000000005},"last":0.42399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.36799999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.60499999999999998,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.68000000000000005},"min":{"1min":0.38300000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.87,"5min":0.92500000000000004,"15min":0.93200000000000005},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.50600000000000001,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":3.532},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.499},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.53400000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.91600000000000004,"15min":1.095},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63900000000000001,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193840,"statfs":{"total":200000000,"available":198493098,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57599999999999996,"5min":1.571,"15min":1.571},"last":0.224},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.60399999999999998,"5min":3.044,"15min":3.044},"last":0.28799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58199999999999996,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.308},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.35299999999999998,"5min":0.27800000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.33500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.379,"15min":0.379},"min":{"1min":0.30499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.63100000000000001,"5min":0.75800000000000001,"15min":0.86399999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.48199999999999998,"15min":0.44700000000000001},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.71499999999999997,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.48199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.401,"15min":1.401},"last":0.57599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.51400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.876,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81599999999999995,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.53900000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":3.665,"15min":3.665},"last":0.44}]},{"osd":7,"last update":"Sun Oct 8 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":895,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40300000000000002,"15min":0.437},"min":{"1min":0.36599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.501}]},{"osd":1,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.746},"last":0.371},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40799999999999997,"15min":0.39400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.20899999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.438},"min":{"1min":0.33400000000000002,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.63,"5min":0.71599999999999997,"15min":1.3260000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.40699999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.95899999999999996,"15min":0.97499999999999998},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.0700000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.92200000000000004,"15min":2.9319999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.64200000000000002,"15min":0.61299999999999999},"min":{"1min":0.54600000000000004,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.091},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.97599999999999998,"15min":0.98599999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.83599999999999997,"5min":1.042,"15min":3.0030000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.81200000000000006,"5min":1.073,"15min":1.073},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.34999999999999998,"15min":0.32700000000000001},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.63900000000000001},"last":0.25900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.58399999999999996,"5min":0.65500000000000003,"15min":0.65900000000000003},"last":0.218},{"interface":"front","average":{"1min":0.442,"5min":0.40799999999999997,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.26600000000000001,"15min":0.255},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.67800000000000005},"last":0.27600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.38100000000000001},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.40699999999999997},"min":{"1min":0.35299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.28799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":0.81799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.96899999999999997},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.026},"last":0.54900000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94399999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.94999999999999996},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199085036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.66500000000000004,"5min":0.82999999999999996,"15min":1.141},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":1.149},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":7.4749999999999996},"last":0.625},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.47199999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.65400000000000003,"5min":0.80400000000000005,"15min":3.8730000000000002},"last":0.434}]},{"osd":2,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.875,"15min":14.6},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":7.556},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.754},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.77200000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.35899999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199085014,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.46400000000000002,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.67100000000000004,"5min":0.77700000000000002,"15min":0.79000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76700000000000002,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.502},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.90400000000000003},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46000000000000002,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.73199999999999998,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.70199999999999996,"15min":0.80600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.68999999999999995,"15min":0.77700000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.73999999999999999,"15min":0.89400000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":0.59099999999999997,"5min":0.76100000000000001,"15min":0.84199999999999997},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.72499999999999998,"15min":0.77800000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.60299999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T16:14:45.586 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:14:45.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:14:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.745+0000 7f86f344e700 1 Processor -- start 2023-10-08T16:14:45.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.745+0000 7f86f344e700 1 -- start start 2023-10-08T16:14:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f344e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0678b0 0x7f86ec15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f344e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86ec0cbf10 0x7f86ec15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f344e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86ec0c9390 0x7f86ec15e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f344e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0cae70 con 0x7f86ec0cbf10 2023-10-08T16:14:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f344e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0cb150 con 0x7f86ec0c9390 2023-10-08T16:14:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f344e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0cb430 con 0x7f86ec0678b0 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f09e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86ec0cbf10 0x7f86ec15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f09e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86ec0cbf10 0x7f86ec15e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59510/0 (socket says 172.21.15.60:59510) 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.746+0000 7f86f09e9700 1 -- 172.21.15.60:0/1139351961 learned_addr learned my addr 172.21.15.60:0/1139351961 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f11ea700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0678b0 0x7f86ec15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f19eb700 1 --2- 172.21.15.60:0/1139351961 >> v2:172.21.15.144:3300/0 conn(0x7f86ec0c9390 0x7f86ec15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f09e9700 1 -- 172.21.15.60:0/1139351961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0678b0 msgr2=0x7f86ec15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f09e9700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0678b0 0x7f86ec15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f09e9700 1 -- 172.21.15.60:0/1139351961 >> v2:172.21.15.144:3300/0 conn(0x7f86ec0c9390 msgr2=0x7f86ec15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f09e9700 1 --2- 172.21.15.60:0/1139351961 >> v2:172.21.15.144:3300/0 conn(0x7f86ec0c9390 0x7f86ec15e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f09e9700 1 -- 172.21.15.60:0/1139351961 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0cb710 con 0x7f86ec0cbf10 2023-10-08T16:14:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f19eb700 1 --2- 172.21.15.60:0/1139351961 >> v2:172.21.15.144:3300/0 conn(0x7f86ec0c9390 0x7f86ec15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f11ea700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0678b0 0x7f86ec15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86f09e9700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0cbf10 0x7f86ec15e0c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e194acfa4981a7ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86e3fff700 1 -- 172.21.15.60:0/1139351961 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00b820 con 0x7f86ec0cbf10 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86e3fff700 1 -- 172.21.15.60:0/1139351961 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00b980 con 0x7f86ec0cbf10 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.747+0000 7f86e3fff700 1 -- 172.21.15.60:0/1139351961 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00bd20 con 0x7f86ec0cbf10 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 -- 172.21.15.60:0/1139351961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0cbf10 msgr2=0x7f86ec15e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0cbf10 0x7f86ec15e0c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc009250 comp rx=0 tx=0).stop 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 -- 172.21.15.60:0/1139351961 shutdown_connections 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 --2- 172.21.15.60:0/1139351961 >> v2:172.21.15.144:3300/0 conn(0x7f86ec0c9390 0x7f86ec15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0678b0 0x7f86ec15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 --2- 172.21.15.60:0/1139351961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0cbf10 0x7f86ec15e0c0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 -- 172.21.15.60:0/1139351961 >> 172.21.15.60:0/1139351961 conn(0x7f86ec069870 msgr2=0x7f86ec069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:45.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 -- 172.21.15.60:0/1139351961 shutdown_connections 2023-10-08T16:14:45.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.748+0000 7f86f344e700 1 -- 172.21.15.60:0/1139351961 wait complete. 2023-10-08T16:14:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.749+0000 7f86f344e700 1 Processor -- start 2023-10-08T16:14:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.749+0000 7f86f344e700 1 -- start start 2023-10-08T16:14:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f344e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 0x7f86ec0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f344e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86ec0c9390 0x7f86ec16d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f344e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0cbf10 0x7f86ec0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f344e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0b34f0 con 0x7f86ec0678b0 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f344e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0c61f0 con 0x7f86ec0c9390 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f344e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec16d8d0 con 0x7f86ec0cbf10 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 0x7f86ec0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 0x7f86ec0c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59526/0 (socket says 172.21.15.60:59526) 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 -- 172.21.15.60:0/2734368154 learned_addr learned my addr 172.21.15.60:0/2734368154 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f09e9700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86ec0c9390 0x7f86ec16d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f19eb700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0cbf10 0x7f86ec0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 -- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0cbf10 msgr2=0x7f86ec0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0cbf10 0x7f86ec0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 -- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86ec0c9390 msgr2=0x7f86ec16d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86ec0c9390 0x7f86ec16d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 -- 172.21.15.60:0/2734368154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094f0 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86f11ea700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 0x7f86ec0c5cb0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c8b0 tx=0x7f86e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.750+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011600 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.751+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8011760 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.751+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec16db50 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.751+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011b00 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.751+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec16e110 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.751+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec04c3c0 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.752+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86e8018350 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.752+0000 7f86e17fa700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86d0066f30 0x7f86d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.753+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86e80843f0 con 0x7f86ec0678b0 2023-10-08T16:14:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.753+0000 7f86f09e9700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86d0066f30 0x7f86d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.753+0000 7f86f09e9700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86d0066f30 0x7f86d00693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:45.757+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86e80550f0 con 0x7f86ec0678b0 2023-10-08T16:14:46.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.029+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f86ec068da0 con 0x7f86ec0678b0 2023-10-08T16:14:46.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.032+0000 7f86e17fa700 1 -- 172.21.15.60:0/2734368154 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f86e8054c80 con 0x7f86ec0678b0 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.034+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86d0066f30 msgr2=0x7f86d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.034+0000 7f86f344e700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86d0066f30 0x7f86d00693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc017000 comp rx=0 tx=0).stop 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.034+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 msgr2=0x7f86ec0c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.034+0000 7f86f344e700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 0x7f86ec0c5cb0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c8b0 tx=0x7f86e8008040 comp rx=0 tx=0).stop 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 shutdown_connections 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86d0066f30 0x7f86d00693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86ec0cbf10 0x7f86ec0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86ec0678b0 0x7f86ec0c5cb0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 --2- 172.21.15.60:0/2734368154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86ec0c9390 0x7f86ec16d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 >> 172.21.15.60:0/2734368154 conn(0x7f86ec069870 msgr2=0x7f86ec158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 shutdown_connections 2023-10-08T16:14:46.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.035+0000 7f86f344e700 1 -- 172.21.15.60:0/2734368154 wait complete. 2023-10-08T16:14:46.036 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:14:46.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.165+0000 7f6547b92700 1 Processor -- start 2023-10-08T16:14:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.165+0000 7f6547b92700 1 -- start start 2023-10-08T16:14:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f6547b92700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65401577d0 0x7f65400cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f6547b92700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f6547b92700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654015c360 con 0x7f6540157ba0 2023-10-08T16:14:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f6547b92700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654015b790 con 0x7f654006ac30 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f6547b92700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654015ba30 con 0x7f65401577d0 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f654612f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f654612f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59530/0 (socket says 172.21.15.60:59530) 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.166+0000 7f654612f700 1 -- 172.21.15.60:0/4064169993 learned_addr learned my addr 172.21.15.60:0/4064169993 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654612f700 1 -- 172.21.15.60:0/4064169993 >> v2:172.21.15.144:3300/0 conn(0x7f65401577d0 msgr2=0x7f65400cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654592e700 1 --2- 172.21.15.60:0/4064169993 >> v2:172.21.15.144:3300/0 conn(0x7f65401577d0 0x7f65400cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654612f700 1 --2- 172.21.15.60:0/4064169993 >> v2:172.21.15.144:3300/0 conn(0x7f65401577d0 0x7f65400cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654612f700 1 -- 172.21.15.60:0/4064169993 >> v1:172.21.15.144:6789/0 conn(0x7f6540157ba0 legacy=0x7f654006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654612f700 1 -- 172.21.15.60:0/4064169993 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654015bd10 con 0x7f654006ac30 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654612f700 1 --2- 172.21.15.60:0/4064169993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f65400b6dc0 tx=0x7f6530009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103e8a03b2b401d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654492c700 1 -- 172.21.15.60:0/4064169993 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653000b820 con 0x7f654006ac30 2023-10-08T16:14:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654492c700 1 -- 172.21.15.60:0/4064169993 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653000b980 con 0x7f654006ac30 2023-10-08T16:14:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f654492c700 1 -- 172.21.15.60:0/4064169993 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653000bd20 con 0x7f654006ac30 2023-10-08T16:14:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f6547b92700 1 -- 172.21.15.60:0/4064169993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 msgr2=0x7f654015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.167+0000 7f6547b92700 1 --2- 172.21.15.60:0/4064169993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f65400b6dc0 tx=0x7f6530009250 comp rx=0 tx=0).stop 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.168+0000 7f6547b92700 1 -- 172.21.15.60:0/4064169993 shutdown_connections 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.168+0000 7f6547b92700 1 --2- 172.21.15.60:0/4064169993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.168+0000 7f6547b92700 1 --2- 172.21.15.60:0/4064169993 >> v2:172.21.15.144:3300/0 conn(0x7f65401577d0 0x7f65400cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.168+0000 7f6547b92700 1 -- 172.21.15.60:0/4064169993 >> 172.21.15.60:0/4064169993 conn(0x7f6540068ce0 msgr2=0x7f65400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.168+0000 7f6547b92700 1 -- 172.21.15.60:0/4064169993 shutdown_connections 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.168+0000 7f6547b92700 1 -- 172.21.15.60:0/4064169993 wait complete. 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 Processor -- start 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 -- start start 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65401577d0 0x7f65400c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6540157ba0 0x7f654015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654015d020 con 0x7f654006ac30 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654015d300 con 0x7f6540157ba0 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.169+0000 7f6547b92700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654015d5e0 con 0x7f65401577d0 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59546/0 (socket says 172.21.15.60:59546) 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 -- 172.21.15.60:0/1561035246 learned_addr learned my addr 172.21.15.60:0/1561035246 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654612f700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6540157ba0 0x7f654015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654512d700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65401577d0 0x7f65400c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 -- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65401577d0 msgr2=0x7f65400c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65401577d0 0x7f65400c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 -- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6540157ba0 msgr2=0x7f654015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6540157ba0 0x7f654015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 -- 172.21.15.60:0/1561035246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300094f0 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654612f700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6540157ba0 0x7f654015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f654592e700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f653800cfc0 tx=0x7f65380078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538016430 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538016590 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538016930 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654015d8c0 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.170+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654015cd30 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.171+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654015dde0 con 0x7f654006ac30 2023-10-08T16:14:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.172+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6538003020 con 0x7f654006ac30 2023-10-08T16:14:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.172+0000 7f653dffb700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.172+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6538012070 con 0x7f654006ac30 2023-10-08T16:14:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.172+0000 7f654512d700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.172+0000 7f654512d700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6534006fd0 tx=0x7f6534008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.176+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f654015dde0 con 0x7f654006ac30 2023-10-08T16:14:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.410+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65400ce540 con 0x7f654006ac30 2023-10-08T16:14:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.410+0000 7f653dffb700 1 -- 172.21.15.60:0/1561035246 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f65380526f0 con 0x7f654006ac30 2023-10-08T16:14:46.411 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:46.411 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:14:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.412+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f652c066f30 msgr2=0x7f652c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6534006fd0 tx=0x7f6534008040 comp rx=0 tx=0).stop 2023-10-08T16:14:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 msgr2=0x7f654015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f653800cfc0 tx=0x7f65380078b0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 shutdown_connections 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6540157ba0 0x7f654015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654006ac30 0x7f654015c7f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 --2- 172.21.15.60:0/1561035246 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65401577d0 0x7f65400c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 >> 172.21.15.60:0/1561035246 conn(0x7f6540068ce0 msgr2=0x7f654006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 shutdown_connections 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.413+0000 7f6547b92700 1 -- 172.21.15.60:0/1561035246 wait complete. 2023-10-08T16:14:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:14:46.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:14:35.921732+0000', 'modified': '2023-10-08T16:14:39.556891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7824}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7824': {'gid': 7824, 'name': 'c', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/3393857134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6835', 'nonce': 3393857134}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3393857134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:14:46.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:14:46.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:14:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.951+0000 7f52755fe700 1 Processor -- start 2023-10-08T16:14:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.951+0000 7f52755fe700 1 -- start start 2023-10-08T16:14:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f52755fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52700cf1c0 0x7f527015e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f52755fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f527015a0c0 0x7f5270068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f52755fe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700cca20 con 0x7f5270159cf0 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f52755fe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527015ea40 con 0x7f52700cf1c0 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f52755fe700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5270067660 con 0x7f527015a0c0 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52700cf1c0 0x7f527015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5270159cf0 0x7f52700ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41612/0 (socket says 172.21.15.60:41612) 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526effd700 1 -- 172.21.15.60:0/3815769468 learned_addr learned my addr 172.21.15.60:0/3815769468 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526f7fe700 1 --2- 172.21.15.60:0/3815769468 >> v2:172.21.15.144:3300/0 conn(0x7f527015a0c0 0x7f5270068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526e7fc700 1 -- 172.21.15.60:0/3815769468 >> v2:172.21.15.144:3300/0 conn(0x7f527015a0c0 msgr2=0x7f5270068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526e7fc700 1 --2- 172.21.15.60:0/3815769468 >> v2:172.21.15.144:3300/0 conn(0x7f527015a0c0 0x7f5270068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526e7fc700 1 -- 172.21.15.60:0/3815769468 >> v1:172.21.15.60:6789/0 conn(0x7f5270159cf0 legacy=0x7f52700ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526e7fc700 1 -- 172.21.15.60:0/3815769468 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270067f00 con 0x7f52700cf1c0 2023-10-08T16:14:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526dffb700 1 -- 172.21.15.60:0/3815769468 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645406639 0 0) 0x7f52700cca20 con 0x7f5270159cf0 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526e7fc700 1 --2- 172.21.15.60:0/3815769468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52700cf1c0 0x7f527015e500 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f527006f260 tx=0x7f52580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b312aee152e6b68f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526dffb700 1 -- 172.21.15.60:0/3815769468 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800b6b0 con 0x7f52700cf1c0 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526dffb700 1 -- 172.21.15.60:0/3815769468 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800b810 con 0x7f52700cf1c0 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.952+0000 7f526dffb700 1 -- 172.21.15.60:0/3815769468 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800bbb0 con 0x7f52700cf1c0 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 -- 172.21.15.60:0/3815769468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52700cf1c0 msgr2=0x7f527015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 --2- 172.21.15.60:0/3815769468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52700cf1c0 0x7f527015e500 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f527006f260 tx=0x7f52580091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 -- 172.21.15.60:0/3815769468 shutdown_connections 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 --2- 172.21.15.60:0/3815769468 >> v2:172.21.15.144:3300/0 conn(0x7f527015a0c0 0x7f5270068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 --2- 172.21.15.60:0/3815769468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52700cf1c0 0x7f527015e500 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 -- 172.21.15.60:0/3815769468 >> 172.21.15.60:0/3815769468 conn(0x7f527006c6e0 msgr2=0x7f5270069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 -- 172.21.15.60:0/3815769468 shutdown_connections 2023-10-08T16:14:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.953+0000 7f52755fe700 1 -- 172.21.15.60:0/3815769468 wait complete. 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.954+0000 7f52755fe700 1 Processor -- start 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.954+0000 7f52755fe700 1 -- start start 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f52755fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52700cf1c0 0x7f52701555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f52755fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5270159cf0 0x7f52700acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f52755fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 0x7f52700c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f52755fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700adb90 con 0x7f527015a0c0 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f52755fe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700c8c30 con 0x7f52700cf1c0 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f52755fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700c8020 con 0x7f5270159cf0 2023-10-08T16:14:46.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f526f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 0x7f52700c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f526f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 0x7f52700c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59560/0 (socket says 172.21.15.60:59560) 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f526f7fe700 1 -- 172.21.15.60:0/4248693301 learned_addr learned my addr 172.21.15.60:0/4248693301 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f526effd700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52700cf1c0 0x7f52701555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.955+0000 7f526e7fc700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5270159cf0 0x7f52700acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526f7fe700 1 -- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5270159cf0 msgr2=0x7f52700acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526f7fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5270159cf0 0x7f52700acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526f7fe700 1 -- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52700cf1c0 msgr2=0x7f52701555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526f7fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52700cf1c0 0x7f52701555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526f7fe700 1 -- 172.21.15.60:0/4248693301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258009420 con 0x7f527015a0c0 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526e7fc700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5270159cf0 0x7f52700acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526effd700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52700cf1c0 0x7f52701555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:14:46.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f526f7fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 0x7f52700c4710 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5260007f50 tx=0x7f5260009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f5266ffd700 1 -- 172.21.15.60:0/4248693301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000ecd0 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f5266ffd700 1 -- 172.21.15.60:0/4248693301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000ee50 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52700c8300 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f5266ffd700 1 -- 172.21.15.60:0/4248693301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260014670 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.956+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700c88c0 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.957+0000 7f5266ffd700 1 -- 172.21.15.60:0/4248693301 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52600149e0 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.958+0000 7f5266ffd700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5250066f30 0x7f52500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.958+0000 7f5266ffd700 1 -- 172.21.15.60:0/4248693301 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5260084d00 con 0x7f527015a0c0 2023-10-08T16:14:46.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.958+0000 7f526effd700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5250066f30 0x7f52500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.958+0000 7f526effd700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5250066f30 0x7f52500693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f52680018d0 tx=0x7f5268009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.959+0000 7f527e8f6b80 1 Processor -- start 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 -- start start 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c0ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c35a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c08cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7b63a70 con 0x55ffc7c35f60 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7b61270 con 0x55ffc7c0ca50 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.960+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7b5d060 con 0x55ffc7c56d00 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c08cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c08cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59564/0 (socket says 172.21.15.60:59564) 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 -- 172.21.15.60:0/1547083944 learned_addr learned my addr 172.21.15.60:0/1547083944 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526effd700 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c0ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526e7fc700 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c35a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 -- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 msgr2=0x55ffc7c35a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c35a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 -- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 msgr2=0x55ffc7c0ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c0ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 -- 172.21.15.60:0/1547083944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc79f7270 con 0x55ffc7c35f60 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f526f7fe700 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c08cf0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f526000c040 tx=0x7f52600830e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4c321cd7ad1913 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f524ffff700 1 -- 172.21.15.60:0/1547083944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260058de0 con 0x55ffc7c35f60 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f524ffff700 1 -- 172.21.15.60:0/1547083944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526005cb30 con 0x55ffc7c35f60 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.961+0000 7f524ffff700 1 -- 172.21.15.60:0/1547083944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260053f30 con 0x55ffc7c35f60 2023-10-08T16:14:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 -- 172.21.15.60:0/1547083944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 msgr2=0x55ffc7c08cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c08cf0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f526000c040 tx=0x7f52600830e0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 -- 172.21.15.60:0/1547083944 shutdown_connections 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c08cf0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c0ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/1547083944 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c35a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 -- 172.21.15.60:0/1547083944 >> 172.21.15.60:0/1547083944 conn(0x55ffc7c0e370 msgr2=0x55ffc7c0e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 -- 172.21.15.60:0/1547083944 shutdown_connections 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.962+0000 7f527e8f6b80 1 -- 172.21.15.60:0/1547083944 wait complete. 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.963+0000 7f527e8f6b80 1 -- start start 2023-10-08T16:14:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.963+0000 7f527e8f6b80 1 Processor -- start 2023-10-08T16:14:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c53b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c55480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c07f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7b08890 con 0x55ffc7c0ca50 2023-10-08T16:14:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7b23ea0 con 0x55ffc7c56d00 2023-10-08T16:14:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffc79dfe30 con 0x55ffc7c35f60 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f527e8f6b80 10 client.0 _ll_register_callbacks cb 0x55ffc7bd0110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c53b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c53b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59572/0 (socket says 172.21.15.60:59572) 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 -- 172.21.15.60:0/3607011231 learned_addr learned my addr 172.21.15.60:0/3607011231 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526f7fe700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c07f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526e7fc700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c55480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 -- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 msgr2=0x55ffc7c55480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c55480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 -- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 msgr2=0x55ffc7c07f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c07f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 -- 172.21.15.60:0/3607011231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700c88c0 con 0x55ffc7c0ca50 2023-10-08T16:14:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526f7fe700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c07f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f526effd700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c53b50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5268007750 tx=0x7f5268012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c381e42dfc925f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f524d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.964+0000 7f524d7fa700 1 -- 172.21.15.60:0/3607011231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268007780 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f524d7fa700 1 -- 172.21.15.60:0/3607011231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5268022b10 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffc7c01b70 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f524d7fa700 1 -- 172.21.15.60:0/3607011231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5268007ac0 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 10 client.7998 fetch_fsmap learned FSMap version 85 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55ffc7999fe0 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f524d7fa700 1 -- 172.21.15.60:0/3607011231 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc7c01b70 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f524d7fa700 1 -- 172.21.15.60:0/3607011231 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f526801f070 con 0x55ffc7c0ca50 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 10 client.7998 fetch_fsmap finished waiting for FSMap version 85 2023-10-08T16:14:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 10 client.7998 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 20 client.7998 populate_metadata read hostname 'smithi060' 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c4d320 0x55ffc7c4d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 4 client.7998 mds_command: new command op to 7824 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 --> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ffc7bdeaa0 con 0x55ffc7c4d320 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f526e7fc700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c4d320 0x55ffc7c4d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f524d7fa700 10 client.7998 ms_handle_connect on v2:172.21.15.60:6835/3393857134 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.965+0000 7f526e7fc700 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c4d320 0x55ffc7c4d6f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b0f6dbdf7b5c73 server_cookie=9875a4f0456b26f3 in_seq=0 out_seq=0 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f524d7fa700 1 -- 172.21.15.60:0/3607011231 <== mds.0 v2:172.21.15.60:6835/3393857134 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ffc7bdeaa0 con 0x55ffc7c4d320 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f524d7fa700 10 client.7998 handle_command_reply: tid=0 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 client.7998 shutdown 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 msgr2=0x55ffc7c53b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c53b50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5268007750 tx=0x7f5268012000 comp rx=0 tx=0).stop 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 shutdown_connections 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c4d320 0x55ffc7c4d6f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c07f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f524d7fa700 0 client.7998 ms_handle_reset on v2:172.21.15.60:6835/3393857134 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c53b50 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/3607011231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c55480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 >> 172.21.15.60:0/3607011231 conn(0x55ffc7c0e370 msgr2=0x55ffc7c52550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 shutdown_connections 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 1 -- 172.21.15.60:0/3607011231 wait complete. 2023-10-08T16:14:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.966+0000 7f527e8f6b80 20 client.7998 trim_cache size 0 max 16384 2023-10-08T16:14:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.983+0000 7f527e8f6b80 1 Processor -- start 2023-10-08T16:14:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.983+0000 7f527e8f6b80 1 -- start start 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c32000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c62370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7c56280 con 0x55ffc7c0ca50 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7bec510 con 0x55ffc7c56d00 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7c01b30 con 0x55ffc7c35f60 2023-10-08T16:14:46.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f526effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f526effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c3c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59578/0 (socket says 172.21.15.60:59578) 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f526effd700 1 -- 172.21.15.60:0/57506585 learned_addr learned my addr 172.21.15.60:0/57506585 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f526e7fc700 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c32000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.984+0000 7f526f7fe700 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c62370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526effd700 1 -- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 msgr2=0x55ffc7c32000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526effd700 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c32000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526effd700 1 -- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 msgr2=0x55ffc7c62370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526effd700 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c62370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526effd700 1 -- 172.21.15.60:0/57506585 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc7b2b780 con 0x55ffc7c0ca50 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526e7fc700 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c32000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f526effd700 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c3c600 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f5268022fd0 tx=0x7f5268016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a67cfe3619d60b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f5264ff9700 1 -- 172.21.15.60:0/57506585 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800dc50 con 0x55ffc7c0ca50 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f5264ff9700 1 -- 172.21.15.60:0/57506585 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5268007780 con 0x55ffc7c0ca50 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f5264ff9700 1 -- 172.21.15.60:0/57506585 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268012a60 con 0x55ffc7c0ca50 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 -- 172.21.15.60:0/57506585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 msgr2=0x55ffc7c3c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c3c600 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f5268022fd0 tx=0x7f5268016000 comp rx=0 tx=0).stop 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 -- 172.21.15.60:0/57506585 shutdown_connections 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c56d00 0x55ffc7c62370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c3c600 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/57506585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c35f60 0x55ffc7c32000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 -- 172.21.15.60:0/57506585 >> 172.21.15.60:0/57506585 conn(0x55ffc7c0e370 msgr2=0x55ffc7c546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.985+0000 7f527e8f6b80 1 -- 172.21.15.60:0/57506585 shutdown_connections 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.986+0000 7f527e8f6b80 1 -- 172.21.15.60:0/57506585 wait complete. 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.986+0000 7f527e8f6b80 1 -- start start 2023-10-08T16:14:46.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.986+0000 7f527e8f6b80 1 Processor -- start 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c62370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c6c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7c4db70 con 0x55ffc7c35f60 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7cb8dc0 con 0x55ffc7c0ca50 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffc7c3c790 con 0x55ffc7c56d00 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f527e8f6b80 10 client.0 _ll_register_callbacks cb 0x55ffc7c51cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59580/0 (socket says 172.21.15.60:59580) 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 -- 172.21.15.60:0/2000715479 learned_addr learned my addr 172.21.15.60:0/2000715479 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526effd700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c62370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526f7fe700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c6c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 -- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 msgr2=0x55ffc7c6c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c6c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 -- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 msgr2=0x55ffc7c62370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c62370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526e7fc700 1 -- 172.21.15.60:0/2000715479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffc7999fe0 con 0x55ffc7c35f60 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.987+0000 7f526f7fe700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c6c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f526e7fc700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c628b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f527006de20 tx=0x7f525801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e860680c8133b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f524d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f524d7fa700 1 -- 172.21.15.60:0/2000715479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258022040 con 0x55ffc7c35f60 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f524d7fa700 1 -- 172.21.15.60:0/2000715479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f525801b740 con 0x55ffc7c35f60 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f526005cb30 con 0x55ffc7c35f60 2023-10-08T16:14:46.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f524d7fa700 1 -- 172.21.15.60:0/2000715479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525801bb10 con 0x55ffc7c35f60 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 10 client.8004 fetch_fsmap learned FSMap version 85 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55ffc7b12470 con 0x55ffc7c35f60 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f524d7fa700 1 -- 172.21.15.60:0/2000715479 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526005cb30 con 0x55ffc7c35f60 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f524d7fa700 1 -- 172.21.15.60:0/2000715479 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f525801bc70 con 0x55ffc7c35f60 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 10 client.8004 fetch_fsmap finished waiting for FSMap version 85 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 10 client.8004 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 20 client.8004 populate_metadata read hostname 'smithi060' 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c6d050 0x55ffc7c570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 4 client.8004 mds_command: new command op to 7824 tid=0[{"prefix": "status"}] 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 --> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ffc7affe00 con 0x55ffc7c6d050 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.988+0000 7f526effd700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c6d050 0x55ffc7c570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f524d7fa700 10 client.8004 ms_handle_connect on v2:172.21.15.60:6835/3393857134 2023-10-08T16:14:46.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f526effd700 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c6d050 0x55ffc7c570d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da3c3441e428516c server_cookie=a42bc4995a43d4d0 in_seq=0 out_seq=0 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f524d7fa700 1 -- 172.21.15.60:0/2000715479 <== mds.0 v2:172.21.15.60:6835/3393857134 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55ffc7affe00 con 0x55ffc7c6d050 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f524d7fa700 10 client.8004 handle_command_reply: tid=0 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 client.8004 shutdown 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 msgr2=0x55ffc7c628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c628b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f527006de20 tx=0x7f525801e040 comp rx=0 tx=0).stop 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 shutdown_connections 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:6835/3393857134,v1:172.21.15.60:6837/3393857134] conn(0x55ffc7c6d050 0x55ffc7c570d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55ffc7c56d00 0x55ffc7c6c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f524d7fa700 0 client.8004 ms_handle_reset on v2:172.21.15.60:6835/3393857134 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffc7c0ca50 0x55ffc7c62370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 --2- 172.21.15.60:0/2000715479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ffc7c35f60 0x55ffc7c628b0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 >> 172.21.15.60:0/2000715479 conn(0x55ffc7c0e370 msgr2=0x55ffc7c09710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:46.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 shutdown_connections 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 1 -- 172.21.15.60:0/2000715479 wait complete. 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.989+0000 7f527e8f6b80 20 client.8004 trim_cache size 0 max 16384 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 7824, 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:14:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:14:46.999 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 10.454204384000001, 2023-10-08T16:14:46.999 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 85, 2023-10-08T16:14:46.999 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 164, 2023-10-08T16:14:46.999 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 164, 2023-10-08T16:14:46.999 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15.537353955 2023-10-08T16:14:46.999 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5250066f30 msgr2=0x7f52500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5250066f30 0x7f52500693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f52680018d0 tx=0x7f5268009040 comp rx=0 tx=0).stop 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 msgr2=0x7f52700c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 0x7f52700c4710 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5260007f50 tx=0x7f5260009860 comp rx=0 tx=0).stop 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 shutdown_connections 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5250066f30 0x7f52500693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f527015a0c0 0x7f52700c4710 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52700cf1c0 0x7f52701555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 --2- 172.21.15.60:0/4248693301 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5270159cf0 0x7f52700acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 >> 172.21.15.60:0/4248693301 conn(0x7f527006c6e0 msgr2=0x7f5270068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:47.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 shutdown_connections 2023-10-08T16:14:47.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:46.990+0000 7f52755fe700 1 -- 172.21.15.60:0/4248693301 wait complete. 2023-10-08T16:14:47.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:14:47.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.121+0000 7f4f9a498700 1 Processor -- start 2023-10-08T16:14:47.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.121+0000 7f4f9a498700 1 -- start start 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f9a498700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f94157870 0x7f4f9415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f9a498700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9415cbb0 con 0x7f4f94157c40 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f9a498700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9415bfa0 con 0x7f4f9415a620 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f9a498700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9415c280 con 0x7f4f94157870 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f93fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f94157870 0x7f4f9415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f98a35700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4f94157c40 0x7f4f94158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41626/0 (socket says 172.21.15.60:41626) 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f98a35700 1 -- 172.21.15.60:0/773288059 learned_addr learned my addr 172.21.15.60:0/773288059 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f93fff700 1 -- 172.21.15.60:0/773288059 >> v1:172.21.15.144:6789/0 conn(0x7f4f9415a620 legacy=0x7f4f9415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f93fff700 1 -- 172.21.15.60:0/773288059 >> v1:172.21.15.60:6789/0 conn(0x7f4f94157c40 legacy=0x7f4f94158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f93fff700 1 -- 172.21.15.60:0/773288059 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9415c560 con 0x7f4f94157870 2023-10-08T16:14:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f92ffd700 1 -- 172.21.15.60:0/773288059 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117395237 0 0) 0x7f4f9415cbb0 con 0x7f4f94157c40 2023-10-08T16:14:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.122+0000 7f4f93fff700 1 --2- 172.21.15.60:0/773288059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f94157870 0x7f4f9415b6a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4f840098e0 tx=0x7f4f840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eaba533332989b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f92ffd700 1 -- 172.21.15.60:0/773288059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84009e80 con 0x7f4f94157870 2023-10-08T16:14:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f92ffd700 1 -- 172.21.15.60:0/773288059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400b860 con 0x7f4f94157870 2023-10-08T16:14:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f92ffd700 1 -- 172.21.15.60:0/773288059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400bbe0 con 0x7f4f94157870 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 -- 172.21.15.60:0/773288059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f94157870 msgr2=0x7f4f9415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 --2- 172.21.15.60:0/773288059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f94157870 0x7f4f9415b6a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4f840098e0 tx=0x7f4f840091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 -- 172.21.15.60:0/773288059 shutdown_connections 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 --2- 172.21.15.60:0/773288059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f94157870 0x7f4f9415b6a0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 -- 172.21.15.60:0/773288059 >> 172.21.15.60:0/773288059 conn(0x7f4f94068ce0 msgr2=0x7f4f940690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 -- 172.21.15.60:0/773288059 shutdown_connections 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.123+0000 7f4f9a498700 1 -- 172.21.15.60:0/773288059 wait complete. 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.124+0000 7f4f9a498700 1 Processor -- start 2023-10-08T16:14:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.124+0000 7f4f9a498700 1 -- start start 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f9a498700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f94157870 0x7f4f9413d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f9a498700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f94157c40 0x7f4f94153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f9a498700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 0x7f4f940b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f9a498700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94152b60 con 0x7f4f9415a620 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f9a498700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9413d610 con 0x7f4f94157c40 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f9a498700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94154500 con 0x7f4f94157870 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f98a35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 0x7f4f940b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f98a35700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 0x7f4f940b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59590/0 (socket says 172.21.15.60:59590) 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f98a35700 1 -- 172.21.15.60:0/2560316461 learned_addr learned my addr 172.21.15.60:0/2560316461 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f937fe700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f94157c40 0x7f4f94153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.125+0000 7f4f93fff700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f94157870 0x7f4f9413d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f98a35700 1 -- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f94157870 msgr2=0x7f4f9413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f98a35700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f94157870 0x7f4f9413d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f98a35700 1 -- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f94157c40 msgr2=0x7f4f94153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f98a35700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f94157c40 0x7f4f94153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f98a35700 1 -- 172.21.15.60:0/2560316461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f84009420 con 0x7f4f9415a620 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f93fff700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f94157870 0x7f4f9413d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f98a35700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 0x7f4f940b5f10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00ccf0 tx=0x7f4f8c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00a920 con 0x7f4f9415a620 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00aa80 con 0x7f4f9415a620 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9416b7d0 con 0x7f4f9415a620 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00ae20 con 0x7f4f9415a620 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.126+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94153b30 con 0x7f4f9415a620 2023-10-08T16:14:47.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.127+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9404c3c0 con 0x7f4f9415a620 2023-10-08T16:14:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.127+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f8c007300 con 0x7f4f9415a620 2023-10-08T16:14:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.128+0000 7f4f8bfff700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.128+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f8c0849b0 con 0x7f4f9415a620 2023-10-08T16:14:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.128+0000 7f4f93fff700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.128+0000 7f4f93fff700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4f74066f30 0x7f4f740693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4f840093f0 tx=0x7f4f84017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.132+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f8c051c20 con 0x7f4f9415a620 2023-10-08T16:14:47.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.372+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f9415c840 con 0x7f4f9415a620 2023-10-08T16:14:47.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.373+0000 7f4f8bfff700 1 -- 172.21.15.60:0/2560316461 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f8c055240 con 0x7f4f9415a620 2023-10-08T16:14:47.373 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:14:47.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4f74066f30 msgr2=0x7f4f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4f74066f30 0x7f4f740693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4f840093f0 tx=0x7f4f84017000 comp rx=0 tx=0).stop 2023-10-08T16:14:47.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 msgr2=0x7f4f940b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 0x7f4f940b5f10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00ccf0 tx=0x7f4f8c001a20 comp rx=0 tx=0).stop 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 shutdown_connections 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4f74066f30 0x7f4f740693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f94157870 0x7f4f9413d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f9415a620 0x7f4f940b5f10 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 --2- 172.21.15.60:0/2560316461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f94157c40 0x7f4f94153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 >> 172.21.15.60:0/2560316461 conn(0x7f4f94068ce0 msgr2=0x7f4f9414d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 shutdown_connections 2023-10-08T16:14:47.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:47.375+0000 7f4f9a498700 1 -- 172.21.15.60:0/2560316461 wait complete. 2023-10-08T16:14:47.387 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:14:47.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:14:47.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:14:47.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:14:47.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:14:47.388 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:14:47.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:14:47.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:14:47.388 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:14:47.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.388 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:47.404 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 41854sec preferred_lft 41854sec 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:14:47.405 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:14:47.407 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:14:47.407 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:14:47.407 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:47.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.407 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:14:47.468 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:14:47.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.470 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:14:47.526 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:14:47.527 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:14:47.527 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:14:47.527 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:14:47.527 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:14:47.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.528 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:14:47.528 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:14:47.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:14:47.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:14:47.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:14:47.528 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:14:47.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.629 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:14:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:14:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:14:47.644 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:14:47.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:14:47.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:14:47.709 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:14:47.764 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:14:47.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:14:47.764 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:14:47.819 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:14:47.819 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:14:47.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:47.900 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:47.900 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:14:47.919 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:47.919 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:14:47.919 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:14:47.919 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:14:47.920 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:14:47.920 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:14:47.920 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:14:47.920 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:14:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:14:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:14:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:14:47.943 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:14:47.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:47.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:14:48.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:14:48.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.168+0000 7f78cd4dd700 1 Processor -- start 2023-10-08T16:14:48.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.168+0000 7f78cd4dd700 1 -- start start 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cd4dd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80b1750 0x7f78c80681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cd4dd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78c80cef30 0x7f78c8159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cd4dd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80caf30 con 0x7f78c80ceb60 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cd4dd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c8069530 con 0x7f78c80cef30 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cd4dd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80ca8e0 con 0x7f78c80b1750 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78c80cef30 0x7f78c8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:48.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78c80cef30 0x7f78c8159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59606/0 (socket says 172.21.15.60:59606) 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 -- 172.21.15.60:0/328187685 learned_addr learned my addr 172.21.15.60:0/328187685 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78c77fe700 1 --2- 172.21.15.60:0/328187685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80b1750 0x7f78c80681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 -- 172.21.15.60:0/328187685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80b1750 msgr2=0x7f78c80681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 --2- 172.21.15.60:0/328187685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80b1750 0x7f78c80681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 -- 172.21.15.60:0/328187685 >> v1:172.21.15.144:6789/0 conn(0x7f78c80ceb60 legacy=0x7f78c8068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.169+0000 7f78cccdc700 1 -- 172.21.15.60:0/328187685 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c80cabc0 con 0x7f78c80cef30 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cccdc700 1 --2- 172.21.15.60:0/328187685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80cef30 0x7f78c8159820 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009f20 tx=0x7f78c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91237ee31e6b601 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78c6ffd700 1 -- 172.21.15.60:0/328187685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000e070 con 0x7f78c80cef30 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78c6ffd700 1 -- 172.21.15.60:0/328187685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c000ba80 con 0x7f78c80cef30 2023-10-08T16:14:48.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78c6ffd700 1 -- 172.21.15.60:0/328187685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c00092e0 con 0x7f78c80cef30 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 -- 172.21.15.60:0/328187685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80cef30 msgr2=0x7f78c8159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/328187685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80cef30 0x7f78c8159820 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009f20 tx=0x7f78c0009840 comp rx=0 tx=0).stop 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 -- 172.21.15.60:0/328187685 shutdown_connections 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/328187685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80cef30 0x7f78c8159820 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/328187685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80b1750 0x7f78c80681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 -- 172.21.15.60:0/328187685 >> 172.21.15.60:0/328187685 conn(0x7f78c806bc70 msgr2=0x7f78c806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 -- 172.21.15.60:0/328187685 shutdown_connections 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.170+0000 7f78cd4dd700 1 -- 172.21.15.60:0/328187685 wait complete. 2023-10-08T16:14:48.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 Processor -- start 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 -- start start 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 0x7f78c80c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80ceb60 0x7f78c81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c80cef30 0x7f78c81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8159f00 con 0x7f78c80b1750 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c816b5b0 con 0x7f78c80cef30 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.172+0000 7f78cd4dd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c816a7f0 con 0x7f78c80ceb60 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 0x7f78c80c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 0x7f78c80c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59608/0 (socket says 172.21.15.60:59608) 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 -- 172.21.15.60:0/4214378324 learned_addr learned my addr 172.21.15.60:0/4214378324 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78cccdc700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c80cef30 0x7f78c81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:48.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c77fe700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80ceb60 0x7f78c81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 -- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80ceb60 msgr2=0x7f78c81593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80ceb60 0x7f78c81593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 -- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c80cef30 msgr2=0x7f78c81598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c80cef30 0x7f78c81598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 -- 172.21.15.60:0/4214378324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0009ae0 con 0x7f78c80b1750 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78c7fff700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 0x7f78c80c81f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c590 tx=0x7f78b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8011590 con 0x7f78c80b1750 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8011710 con 0x7f78c80b1750 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c816aad0 con 0x7f78c80b1750 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8011ad0 con 0x7f78c80b1750 2023-10-08T16:14:48.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.173+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c816b090 con 0x7f78c80b1750 2023-10-08T16:14:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.174+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c806e3e0 con 0x7f78c80b1750 2023-10-08T16:14:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.175+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78b801b3b0 con 0x7f78c80b1750 2023-10-08T16:14:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.175+0000 7f78bffff700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a8066f30 0x7f78a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.175+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78b80839c0 con 0x7f78c80b1750 2023-10-08T16:14:48.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.175+0000 7f78c77fe700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a8066f30 0x7f78a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:48.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.175+0000 7f78c77fe700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a8066f30 0x7f78a80693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f78c8156ff0 tx=0x7f78b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:48.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.179+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78b8050c30 con 0x7f78c80b1750 2023-10-08T16:14:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.418+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f78c804bb80 con 0x7f78c80b1750 2023-10-08T16:14:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.418+0000 7f78bffff700 1 -- 172.21.15.60:0/4214378324 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f78b8017070 con 0x7f78c80b1750 2023-10-08T16:14:48.418 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:14:48.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a8066f30 msgr2=0x7f78a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a8066f30 0x7f78a80693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f78c8156ff0 tx=0x7f78b0008040 comp rx=0 tx=0).stop 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 msgr2=0x7f78c80c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 0x7f78c80c81f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c590 tx=0x7f78b800c8a0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 shutdown_connections 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f78a8066f30 0x7f78a80693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c80cef30 0x7f78c81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c80b1750 0x7f78c80c81f0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 --2- 172.21.15.60:0/4214378324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78c80ceb60 0x7f78c81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 >> 172.21.15.60:0/4214378324 conn(0x7f78c806bc70 msgr2=0x7f78c80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 shutdown_connections 2023-10-08T16:14:48.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:48.420+0000 7f78cd4dd700 1 -- 172.21.15.60:0/4214378324 wait complete. 2023-10-08T16:14:48.432 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:14:48.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:14:48.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:14:48.433 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:14:48.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:14:48.433 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:14:48.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:14:48.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:14:48.433 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:14:48.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.433 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:14:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41855sec preferred_lft 41855sec 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:14:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:14:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:14:48.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.455 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:14:48.519 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:14:48.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.520 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:14:48.579 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:14:48.579 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:14:48.579 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:14:48.579 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:14:48.579 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:14:48.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.579 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:14:48.580 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:14:48.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:14:48.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:14:48.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:14:48.580 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:14:48.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.685 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:14:48.700 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:14:48.700 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:14:48.700 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:14:48.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:14:48.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:14:48.765 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:14:48.820 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:14:48.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:14:48.820 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:14:48.874 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:14:48.875 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:14:48.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:48.955 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:48.955 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:14:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:14:48.996 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:14:48.997 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:14:48.998 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:14:48.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:14:48.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:14:49.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:14:49.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.187+0000 7ff2811f6700 1 Processor -- start 2023-10-08T16:14:49.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.187+0000 7ff2811f6700 1 -- start start 2023-10-08T16:14:49.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff2811f6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff27c0c8f10 0x7ff27c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff2811f6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c15c6e0 con 0x7ff27c070950 2023-10-08T16:14:49.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff2811f6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0c8150 con 0x7ff27c141760 2023-10-08T16:14:49.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff2811f6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c0c8430 con 0x7ff27c0c8f10 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff27ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff27c070950 0x7ff27c141050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41640/0 (socket says 172.21.15.60:41640) 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff27ad9d700 1 -- 172.21.15.60:0/938190774 learned_addr learned my addr 172.21.15.60:0/938190774 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.188+0000 7ff27a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff27c0c8f10 0x7ff27c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff27a59c700 1 -- 172.21.15.60:0/938190774 >> v1:172.21.15.144:6789/0 conn(0x7ff27c141760 legacy=0x7ff27c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff27a59c700 1 -- 172.21.15.60:0/938190774 >> v1:172.21.15.60:6789/0 conn(0x7ff27c070950 legacy=0x7ff27c141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff27a59c700 1 -- 172.21.15.60:0/938190774 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0c8710 con 0x7ff27c0c8f10 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff279d9b700 1 -- 172.21.15.60:0/938190774 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017471518 0 0) 0x7ff27c15c6e0 con 0x7ff27c070950 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff27a59c700 1 --2- 172.21.15.60:0/938190774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c0c8f10 0x7ff27c15b990 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ff2640098e0 tx=0x7ff2640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc01494f00fe8d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff279d9b700 1 -- 172.21.15.60:0/938190774 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264009e80 con 0x7ff27c0c8f10 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff279d9b700 1 -- 172.21.15.60:0/938190774 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26400b820 con 0x7ff27c0c8f10 2023-10-08T16:14:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff279d9b700 1 -- 172.21.15.60:0/938190774 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400bba0 con 0x7ff27c0c8f10 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff2811f6700 1 -- 172.21.15.60:0/938190774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c0c8f10 msgr2=0x7ff27c15b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff2811f6700 1 --2- 172.21.15.60:0/938190774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c0c8f10 0x7ff27c15b990 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ff2640098e0 tx=0x7ff2640091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.189+0000 7ff2811f6700 1 -- 172.21.15.60:0/938190774 shutdown_connections 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.190+0000 7ff2811f6700 1 --2- 172.21.15.60:0/938190774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c0c8f10 0x7ff27c15b990 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.190+0000 7ff2811f6700 1 -- 172.21.15.60:0/938190774 >> 172.21.15.60:0/938190774 conn(0x7ff27c06ad20 msgr2=0x7ff27c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.190+0000 7ff2811f6700 1 -- 172.21.15.60:0/938190774 shutdown_connections 2023-10-08T16:14:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.190+0000 7ff2811f6700 1 -- 172.21.15.60:0/938190774 wait complete. 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.191+0000 7ff2811f6700 1 Processor -- start 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.191+0000 7ff2811f6700 1 -- start start 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.191+0000 7ff2811f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 0x7ff27c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.191+0000 7ff2811f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27c0c8f10 0x7ff27c16afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.191+0000 7ff2811f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27c141760 0x7ff27c16b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.191+0000 7ff2811f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c16ab20 con 0x7ff27c070950 2023-10-08T16:14:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff2811f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0cbb90 con 0x7ff27c0c8f10 2023-10-08T16:14:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff2811f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0cbe70 con 0x7ff27c141760 2023-10-08T16:14:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 0x7ff27c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 0x7ff27c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59636/0 (socket says 172.21.15.60:59636) 2023-10-08T16:14:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 -- 172.21.15.60:0/1577536712 learned_addr learned my addr 172.21.15.60:0/1577536712 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27a59c700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27c0c8f10 0x7ff27c16afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27b59e700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27c141760 0x7ff27c16b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 -- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27c141760 msgr2=0x7ff27c16b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27c141760 0x7ff27c16b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 -- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27c0c8f10 msgr2=0x7ff27c16afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27c0c8f10 0x7ff27c16afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 -- 172.21.15.60:0/1577536712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264009420 con 0x7ff27c070950 2023-10-08T16:14:49.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff27ad9d700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 0x7ff27c0cce20 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ff27400cc70 tx=0x7ff274001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:49.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400a890 con 0x7ff27c070950 2023-10-08T16:14:49.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27400a9f0 con 0x7ff27c070950 2023-10-08T16:14:49.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c0cc150 con 0x7ff27c070950 2023-10-08T16:14:49.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400ad70 con 0x7ff27c070950 2023-10-08T16:14:49.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.192+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c0cd360 con 0x7ff27c070950 2023-10-08T16:14:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.193+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c16a950 con 0x7ff27c070950 2023-10-08T16:14:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.194+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff274007300 con 0x7ff27c070950 2023-10-08T16:14:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.194+0000 7ff272ffd700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff25c066f30 0x7ff25c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.194+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2740848a0 con 0x7ff27c070950 2023-10-08T16:14:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.194+0000 7ff27a59c700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff25c066f30 0x7ff25c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.195+0000 7ff27a59c700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff25c066f30 0x7ff25c0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0c9300 tx=0x7ff264016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:49.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.198+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff274051b90 con 0x7ff27c070950 2023-10-08T16:14:49.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.435+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff27c16ae00 con 0x7ff27c070950 2023-10-08T16:14:49.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.435+0000 7ff272ffd700 1 -- 172.21.15.60:0/1577536712 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7ff2740551b0 con 0x7ff27c070950 2023-10-08T16:14:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:14:49.436 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff25c066f30 msgr2=0x7ff25c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff25c066f30 0x7ff25c0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0c9300 tx=0x7ff264016000 comp rx=0 tx=0).stop 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 msgr2=0x7ff27c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 0x7ff27c0cce20 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ff27400cc70 tx=0x7ff274001a30 comp rx=0 tx=0).stop 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 shutdown_connections 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff25c066f30 0x7ff25c0693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27c141760 0x7ff27c16b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff27c070950 0x7ff27c0cce20 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 --2- 172.21.15.60:0/1577536712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27c0c8f10 0x7ff27c16afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 >> 172.21.15.60:0/1577536712 conn(0x7ff27c06ad20 msgr2=0x7ff27c0cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 shutdown_connections 2023-10-08T16:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.437+0000 7ff2811f6700 1 -- 172.21.15.60:0/1577536712 wait complete. 2023-10-08T16:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:14:49.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T16:14:49.588 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":7824,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.043070308000001,"mdsmap_epoch":85,"osdmap_epoch":164,"osdmap_epoch_barrier":164,"uptime":18.126222983000002} 2023-10-08T16:14:49.588 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 7824, "mdsmap_epoch": 85, "osdmap_epoch": 164, "osdmap_epoch_barrier": 164, "rank_uptime": 13.043070308, "state": "up:active", "uptime": 18.126222983, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:14:49.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-08T16:14:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.715+0000 7f843d52e700 1 Processor -- start 2023-10-08T16:14:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.715+0000 7f843d52e700 1 -- start start 2023-10-08T16:14:49.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843d52e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8438159d10 0x7f84380cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843d52e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84380cc190 0x7f843806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843d52e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843806aca0 con 0x7f843806a840 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843d52e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380d05b0 con 0x7f84380cc190 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843d52e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380cf510 con 0x7f8438159d10 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843cd2d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f843806a840 0x7f843815d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41642/0 (socket says 172.21.15.60:41642) 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f843cd2d700 1 -- 172.21.15.60:0/1940992592 learned_addr learned my addr 172.21.15.60:0/1940992592 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f8437fff700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8438159d10 0x7f84380cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.716+0000 7f84377fe700 1 --2- 172.21.15.60:0/1940992592 >> v2:172.21.15.144:3300/0 conn(0x7f84380cc190 0x7f843806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8436ffd700 1 -- 172.21.15.60:0/1940992592 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736320441 0 0) 0x7f8430001490 con 0x7f843806a840 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8436ffd700 1 -- 172.21.15.60:0/1940992592 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8420003570 con 0x7f843806a840 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8436ffd700 1 -- 172.21.15.60:0/1940992592 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893426886 0 0) 0x7f8420003570 con 0x7f843806a840 2023-10-08T16:14:49.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f84377fe700 1 -- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8438159d10 msgr2=0x7f84380cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f84377fe700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8438159d10 0x7f84380cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f84377fe700 1 -- 172.21.15.60:0/1940992592 >> v1:172.21.15.60:6789/0 conn(0x7f843806a840 legacy=0x7f843815d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f84377fe700 1 -- 172.21.15.60:0/1940992592 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380cf7f0 con 0x7f84380cc190 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8437fff700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8438159d10 0x7f84380cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f84377fe700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84380cc190 0x7f843806a300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f84280098e0 tx=0x7f84280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a23763d6bc1c5316 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8436ffd700 1 -- 172.21.15.60:0/1940992592 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430001980 con 0x7f84380cc190 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8436ffd700 1 -- 172.21.15.60:0/1940992592 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428011420 con 0x7f84380cc190 2023-10-08T16:14:49.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.717+0000 7f8436ffd700 1 -- 172.21.15.60:0/1940992592 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280117c0 con 0x7f84380cc190 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 -- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84380cc190 msgr2=0x7f843806a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84380cc190 0x7f843806a300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f84280098e0 tx=0x7f84280091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 -- 172.21.15.60:0/1940992592 shutdown_connections 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8438159d10 0x7f84380cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 --2- 172.21.15.60:0/1940992592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84380cc190 0x7f843806a300 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 -- 172.21.15.60:0/1940992592 >> 172.21.15.60:0/1940992592 conn(0x7f8438069640 msgr2=0x7f84380d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:49.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 -- 172.21.15.60:0/1940992592 shutdown_connections 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.718+0000 7f843d52e700 1 -- 172.21.15.60:0/1940992592 wait complete. 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.719+0000 7f843d52e700 1 Processor -- start 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.719+0000 7f843d52e700 1 -- start start 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843d52e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 0x7f843816e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843d52e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84380cc190 0x7f84380ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843d52e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8438159d10 0x7f84380b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843d52e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380b4900 con 0x7f843806a840 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843d52e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843816eca0 con 0x7f8438159d10 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843d52e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380cad70 con 0x7f84380cc190 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 0x7f843816e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 0x7f843816e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59650/0 (socket says 172.21.15.60:59650) 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 -- 172.21.15.60:0/3269013087 learned_addr learned my addr 172.21.15.60:0/3269013087 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f84377fe700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84380cc190 0x7f84380ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f843cd2d700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8438159d10 0x7f84380b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 -- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84380cc190 msgr2=0x7f84380ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84380cc190 0x7f84380ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 -- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8438159d10 msgr2=0x7f84380b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8438159d10 0x7f84380b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 -- 172.21.15.60:0/3269013087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c009420 con 0x7f843806a840 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.720+0000 7f8437fff700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 0x7f843816e760 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f842c00ec80 tx=0x7f842c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.721+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00c850 con 0x7f843806a840 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.721+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00c9b0 con 0x7f843806a840 2023-10-08T16:14:49.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.721+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00cd30 con 0x7f843806a840 2023-10-08T16:14:49.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.721+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8428009420 con 0x7f843806a840 2023-10-08T16:14:49.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.721+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84380b3fd0 con 0x7f843806a840 2023-10-08T16:14:49.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.721+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84380cfad0 con 0x7f843806a840 2023-10-08T16:14:49.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.722+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f842c013680 con 0x7f843806a840 2023-10-08T16:14:49.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.722+0000 7f841ffff700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8424066f30 0x7f84240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:14:49.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.723+0000 7f84377fe700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8424066f30 0x7f84240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:14:49.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.723+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f842c084770 con 0x7f843806a840 2023-10-08T16:14:49.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.723+0000 7f84377fe700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8424066f30 0x7f84240693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f84280093f0 tx=0x7f8428016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:14:49.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.727+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f842c055470 con 0x7f843806a840 2023-10-08T16:14:49.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:49.923+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f84380cbe20 con 0x7f843806a840 2023-10-08T16:14:50.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.399+0000 7f841ffff700 1 -- 172.21.15.60:0/3269013087 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v165) v1 ==== 181+0+0 (secure 0 0 0) 0x7f842c055000 con 0x7f843806a840 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8424066f30 msgr2=0x7f84240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8424066f30 0x7f84240693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f84280093f0 tx=0x7f8428016000 comp rx=0 tx=0).stop 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 msgr2=0x7f843816e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 0x7f843816e760 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f842c00ec80 tx=0x7f842c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 shutdown_connections 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8424066f30 0x7f84240693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8438159d10 0x7f84380b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f843806a840 0x7f843816e760 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:50.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 --2- 172.21.15.60:0/3269013087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f84380cc190 0x7f84380ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:14:50.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 >> 172.21.15.60:0/3269013087 conn(0x7f8438069640 msgr2=0x7f84381573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:14:50.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 shutdown_connections 2023-10-08T16:14:50.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:14:50.401+0000 7f843d52e700 1 -- 172.21.15.60:0/3269013087 wait complete. 2023-10-08T16:14:50.403 INFO:teuthology.orchestra.run.smithi060.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-08T16:14:50.415 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:14:50.552 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:14:50.553 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:14:50.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-08T16:14:50.680 INFO:teuthology.orchestra.run.smithi060.stdout:{"mon_tick_interval":"5"} 2023-10-08T16:14:50.681 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-08T16:14:50.681 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> import time 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> import datetime 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> # Write some buffered data through before going full, all should be well 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> print("writing some data through which we expect to succeed") 2023-10-08T16:14:50.681 DEBUG:teuthology.orchestra.run.smithi060:> bytes = 0 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> # buffered IO, the error should always only appear from fsync and not 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> # from write 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> full = False 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.682 DEBUG:teuthology.orchestra.run.smithi060:> for n in range(0, int(32 * 1.1)): 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> except OSError as e: 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> raise 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> full = True 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> break 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> try: 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f) 2023-10-08T16:14:50.683 DEBUG:teuthology.orchestra.run.smithi060:> print("fsync'"'"'ed successfully") 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> except OSError as e: 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> full = True 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> break 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> else: 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> if n > 32 * 0.9: 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> # Be cautious in the last region where we expect to hit 2023-10-08T16:14:50.684 DEBUG:teuthology.orchestra.run.smithi060:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(15.0) 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> if not full: 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> # close() should not raise an error because we already caught it in 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> # since then because all IOs got cancelled on the full flag. 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> print("calling close") 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> os.close(f) 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> print("close() did not raise error") 2023-10-08T16:14:50.685 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-08T16:14:50.686 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-08T16:14:50.686 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-08T16:15:03.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:03.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:33.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:33.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:writing some data through which we expect to succeed 2023-10-08T16:15:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-08T16:15:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 1.00 MB 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 2.00 MB 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 3.00 MB 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 4.00 MB 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 5.00 MB 2023-10-08T16:15:51.616 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 6.00 MB 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 7.00 MB 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 8.00 MB 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 9.00 MB 2023-10-08T16:15:51.617 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 10.00 MB 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 11.00 MB 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 12.00 MB 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 13.00 MB 2023-10-08T16:15:51.618 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 14.00 MB 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 15.00 MB 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 16.00 MB 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 17.00 MB 2023-10-08T16:15:51.619 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 18.00 MB 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 19.00 MB 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 20.00 MB 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 21.00 MB 2023-10-08T16:15:51.620 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 22.00 MB 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 23.00 MB 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 24.00 MB 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.621 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 25.00 MB 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 26.00 MB 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 27.00 MB 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 28.00 MB 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.622 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 29.00 MB 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 30.00 MB 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 31.00 MB 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.623 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 32.00 MB 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:fsync'ed successfully 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:Not full yet after 33.00 MB 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:Reached fullness after 33.00 MB 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:calling close 2023-10-08T16:15:51.624 INFO:teuthology.orchestra.run.smithi060.stdout:close() did not raise error 2023-10-08T16:15:51.628 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:15:51.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:15:51.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:15:51.723 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:15:51.723 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:15:51.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:15:51.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:15:51.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:15:51.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:51.764 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:15:51.821 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:15:51.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:15:51.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:15:51.864 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:15:51.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:15:51.865 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:15:51.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.047+0000 7f3e3892e700 1 Processor -- start 2023-10-08T16:15:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.047+0000 7f3e3892e700 1 -- start start 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e3892e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e3415cbd0 0x7f3e3415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e3892e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e340cb7c0 con 0x7f3e340cd6e0 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e3892e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3415e290 con 0x7f3e340cdab0 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e3892e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3415e850 con 0x7f3e3415cbd0 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e337fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3e340cd6e0 0x7f3e340cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35224/0 (socket says 172.21.15.60:35224) 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e337fe700 1 -- 172.21.15.60:0/2549489512 learned_addr learned my addr 172.21.15.60:0/2549489512 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e33fff700 1 --2- 172.21.15.60:0/2549489512 >> v2:172.21.15.144:3300/0 conn(0x7f3e3415cbd0 0x7f3e3415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003717806 0 0) 0x7f3e340cb7c0 con 0x7f3e340cd6e0 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.048+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e1c003570 con 0x7f3e340cd6e0 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2742964365 0 0) 0x7f3e1c003570 con 0x7f3e340cd6e0 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 >> v2:172.21.15.144:3300/0 conn(0x7f3e3415cbd0 msgr2=0x7f3e3415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 --2- 172.21.15.60:0/2549489512 >> v2:172.21.15.144:3300/0 conn(0x7f3e3415cbd0 0x7f3e3415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 >> v1:172.21.15.144:6789/0 conn(0x7f3e340cdab0 legacy=0x7f3e3415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3415e570 con 0x7f3e340cd6e0 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f3e24001470 con 0x7f3e340cd6e0 2023-10-08T16:15:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 >> v1:172.21.15.60:6789/0 conn(0x7f3e340cd6e0 legacy=0x7f3e340cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e1c003a60 0x7f3e1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0051c0 0x7f3e1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3415e850 con 0x7f3e1c004810 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c00c0d0 con 0x7f3e1c0051c0 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c00c290 con 0x7f3e1c003a60 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e337fe700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e1c003a60 0x7f3e1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e33fff700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0051c0 0x7f3e1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 -- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e1c003a60 msgr2=0x7f3e1c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e1c003a60 0x7f3e1c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 -- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0051c0 msgr2=0x7f3e1c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0051c0 0x7f3e1c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e33fff700 1 -- 172.21.15.60:0/2549489512 reap_dead start 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 -- 172.21.15.60:0/2549489512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c003570 con 0x7f3e1c004810 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e1c004c80 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3e280018b0 tx=0x7f3e28007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6bcd73614de9e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.049+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28012420 con 0x7f3e1c004810 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e280125a0 con 0x7f3e1c004810 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e327fc700 1 -- 172.21.15.60:0/2549489512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28012960 con 0x7f3e1c004810 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 -- 172.21.15.60:0/2549489512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 msgr2=0x7f3e1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e1c004c80 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3e280018b0 tx=0x7f3e28007d30 comp rx=0 tx=0).stop 2023-10-08T16:15:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 -- 172.21.15.60:0/2549489512 shutdown_connections 2023-10-08T16:15:52.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 --2- 172.21.15.60:0/2549489512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e1c004c80 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 -- 172.21.15.60:0/2549489512 >> 172.21.15.60:0/2549489512 conn(0x7f3e34067660 msgr2=0x7f3e34067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:52.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 -- 172.21.15.60:0/2549489512 shutdown_connections 2023-10-08T16:15:52.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.050+0000 7f3e3892e700 1 -- 172.21.15.60:0/2549489512 wait complete. 2023-10-08T16:15:52.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.051+0000 7f3e3892e700 1 Processor -- start 2023-10-08T16:15:52.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.051+0000 7f3e3892e700 1 -- start start 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e3892e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e3415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e3892e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3416b470 0x7f3e340c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e3892e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e340ca190 0x7f3e3416e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e3892e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340cc360 con 0x7f3e1c004810 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e3892e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3415c720 con 0x7f3e3416b470 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e3892e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340c8ca0 con 0x7f3e340ca190 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e3415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e3415c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37710/0 (socket says 172.21.15.60:37710) 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e337fe700 1 -- 172.21.15.60:0/1843358686 learned_addr learned my addr 172.21.15.60:0/1843358686 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3416b470 0x7f3e340c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e33fff700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e340ca190 0x7f3e3416e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.052+0000 7f3e337fe700 1 -- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e340ca190 msgr2=0x7f3e3416e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e337fe700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e340ca190 0x7f3e3416e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e337fe700 1 -- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3416b470 msgr2=0x7f3e340c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e337fe700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3416b470 0x7f3e340c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e337fe700 1 -- 172.21.15.60:0/1843358686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340ca5f0 con 0x7f3e1c004810 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3416b470 0x7f3e340c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e337fe700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e3415c1e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3e24007390 tx=0x7f3e24001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24018030 con 0x7f3e1c004810 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400f920 con 0x7f3e1c004810 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e340c89c0 con 0x7f3e1c004810 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400fcc0 con 0x7f3e1c004810 2023-10-08T16:15:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.053+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e340c8370 con 0x7f3e1c004810 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.054+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e340ccb60 con 0x7f3e1c004810 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.054+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e2401b070 con 0x7f3e1c004810 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.055+0000 7f3e1b7fe700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3e20066f30 0x7f3e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.055+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f3e24019070 con 0x7f3e1c004810 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.055+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3e20066f30 0x7f3e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.055+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f3e2006eab0 con 0x7f3e1c004810 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.055+0000 7f3e32ffd700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3e20066f30 0x7f3e200693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e280018b0 tx=0x7f3e28015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.059+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e24051530 con 0x7f3e1c004810 2023-10-08T16:15:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.293+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e340b3a10 con 0x7f3e1c004810 2023-10-08T16:15:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.294+0000 7f3e1b7fe700 1 -- 172.21.15.60:0/1843358686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f3e24054b50 con 0x7f3e1c004810 2023-10-08T16:15:52.295 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:52.295 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:15:52.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.295+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3e20066f30 msgr2=0x7f3e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.295+0000 7f3e3892e700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3e20066f30 0x7f3e200693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e280018b0 tx=0x7f3e28015000 comp rx=0 tx=0).stop 2023-10-08T16:15:52.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.295+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 msgr2=0x7f3e3415c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.295+0000 7f3e3892e700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e3415c1e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3e24007390 tx=0x7f3e24001e50 comp rx=0 tx=0).stop 2023-10-08T16:15:52.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.295+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 shutdown_connections 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3e20066f30 0x7f3e200693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e340ca190 0x7f3e3416e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e1c004810 0x7f3e3415c1e0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 --2- 172.21.15.60:0/1843358686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e3416b470 0x7f3e340c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 >> 172.21.15.60:0/1843358686 conn(0x7f3e34067660 msgr2=0x7f3e340c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 shutdown_connections 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.296+0000 7f3e3892e700 1 -- 172.21.15.60:0/1843358686 wait complete. 2023-10-08T16:15:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:15:52.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.427+0000 7f87073ea700 1 Processor -- start 2023-10-08T16:15:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.427+0000 7f87073ea700 1 -- start start 2023-10-08T16:15:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f87073ea700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f87000cdab0 0x7f870015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f87073ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f870015dda0 0x7f870015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f87073ea700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87000cb7c0 con 0x7f87000cd6e0 2023-10-08T16:15:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f87073ea700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870015e850 con 0x7f87000cdab0 2023-10-08T16:15:52.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f87073ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000cc360 con 0x7f870015dda0 2023-10-08T16:15:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f8706be9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f870015dda0 0x7f870015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.428+0000 7f8705be7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f87000cdab0 0x7f870015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f87063e8700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f87000cd6e0 0x7f87000cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:52568/0 (socket says 172.21.15.60:52568) 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f87063e8700 1 -- 172.21.15.60:0/1383446260 learned_addr learned my addr 172.21.15.60:0/1383446260 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f8705be7700 1 -- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f870015dda0 msgr2=0x7f870015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f8705be7700 1 --2- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f870015dda0 0x7f870015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f8705be7700 1 -- 172.21.15.60:0/1383446260 >> v1:172.21.15.144:6789/0 conn(0x7f87000cd6e0 legacy=0x7f87000cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f8705be7700 1 -- 172.21.15.60:0/1383446260 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870015e290 con 0x7f87000cdab0 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f87053e6700 1 -- 172.21.15.60:0/1383446260 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562913259 0 0) 0x7f87000cb7c0 con 0x7f87000cd6e0 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f8705be7700 1 --2- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87000cdab0 0x7f870015d860 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f86f40098e0 tx=0x7f86f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d014d509cf0d18d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f87053e6700 1 -- 172.21.15.60:0/1383446260 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400b640 con 0x7f87000cdab0 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f87053e6700 1 -- 172.21.15.60:0/1383446260 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f400b7a0 con 0x7f87000cdab0 2023-10-08T16:15:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.429+0000 7f87053e6700 1 -- 172.21.15.60:0/1383446260 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400bb40 con 0x7f87000cdab0 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 -- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87000cdab0 msgr2=0x7f870015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 --2- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87000cdab0 0x7f870015d860 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f86f40098e0 tx=0x7f86f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 -- 172.21.15.60:0/1383446260 shutdown_connections 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 --2- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f870015dda0 0x7f870015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 --2- 172.21.15.60:0/1383446260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87000cdab0 0x7f870015d860 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 -- 172.21.15.60:0/1383446260 >> 172.21.15.60:0/1383446260 conn(0x7f8700067660 msgr2=0x7f8700067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 -- 172.21.15.60:0/1383446260 shutdown_connections 2023-10-08T16:15:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.430+0000 7f87073ea700 1 -- 172.21.15.60:0/1383446260 wait complete. 2023-10-08T16:15:52.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.431+0000 7f87073ea700 1 Processor -- start 2023-10-08T16:15:52.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.431+0000 7f87073ea700 1 -- start start 2023-10-08T16:15:52.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87073ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 0x7f87000c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87073ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87000cdab0 0x7f87000c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87073ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f870015dda0 0x7f87000b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87073ea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87000c7ec0 con 0x7f87000cd6e0 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87073ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87000c81a0 con 0x7f870015dda0 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87073ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000c8480 con 0x7f87000cdab0 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 0x7f87000c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 0x7f87000c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34696/0 (socket says 172.21.15.60:34696) 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 -- 172.21.15.60:0/3635118328 learned_addr learned my addr 172.21.15.60:0/3635118328 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f8705be7700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87000cdab0 0x7f87000c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f8706be9700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f870015dda0 0x7f87000b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 -- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87000cdab0 msgr2=0x7f87000c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87000cdab0 0x7f87000c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 -- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f870015dda0 msgr2=0x7f87000b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f870015dda0 0x7f87000b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 -- 172.21.15.60:0/3635118328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4009420 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f87063e8700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 0x7f87000c9a30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f86f800c5b0 tx=0x7f86f8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.432+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8005b30 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.433+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8005c90 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.433+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87000c8760 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.433+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8007300 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.433+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870014ce50 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.434+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87000c8c80 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.434+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86f801b3b0 con 0x7f87000cd6e0 2023-10-08T16:15:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.434+0000 7f86fe7fc700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86ec066f30 0x7f86ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.435+0000 7f8705be7700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86ec066f30 0x7f86ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.435+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f86f8083980 con 0x7f87000cd6e0 2023-10-08T16:15:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.435+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f86ec06eab0 con 0x7f87000cd6e0 2023-10-08T16:15:52.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.435+0000 7f8705be7700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86ec066f30 0x7f86ec0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f86f40093f0 tx=0x7f86f4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.439+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86f8017060 con 0x7f87000cd6e0 2023-10-08T16:15:52.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.640+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87000c9810 con 0x7f87000cd6e0 2023-10-08T16:15:52.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.640+0000 7f86fe7fc700 1 -- 172.21.15.60:0/3635118328 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15441 (secure 0 0 0) 0x7f86f8050bd0 con 0x7f87000cd6e0 2023-10-08T16:15:52.642 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:52.642 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":168,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:15:28.399290+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:14:34.351205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T16:14:34.896986+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:52.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86ec066f30 msgr2=0x7f86ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86ec066f30 0x7f86ec0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f86f40093f0 tx=0x7f86f4017000 comp rx=0 tx=0).stop 2023-10-08T16:15:52.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 msgr2=0x7f87000c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 0x7f87000c9a30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f86f800c5b0 tx=0x7f86f8001070 comp rx=0 tx=0).stop 2023-10-08T16:15:52.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 shutdown_connections 2023-10-08T16:15:52.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f86ec066f30 0x7f86ec0693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f870015dda0 0x7f87000b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87000cd6e0 0x7f87000c9a30 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.642+0000 7f87073ea700 1 --2- 172.21.15.60:0/3635118328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87000cdab0 0x7f87000c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.643+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 >> 172.21.15.60:0/3635118328 conn(0x7f8700067660 msgr2=0x7f87000c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.643+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 shutdown_connections 2023-10-08T16:15:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.643+0000 7f87073ea700 1 -- 172.21.15.60:0/3635118328 wait complete. 2023-10-08T16:15:52.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:14:34.351205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:14:34.896986+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:15:52.656 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:15:52.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.777+0000 7f9f4b3a0700 1 Processor -- start 2023-10-08T16:15:52.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.778+0000 7f9f4b3a0700 1 -- start start 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.778+0000 7f9f4b3a0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9f44159c30 0x7f9f440711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.778+0000 7f9f4b3a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f4406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.778+0000 7f9f4b3a0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f44070d30 con 0x7f9f4406c380 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.778+0000 7f9f4b3a0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f44070700 con 0x7f9f44159c30 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.778+0000 7f9f4b3a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4406f710 con 0x7f9f4406ecc0 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f4406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f4406f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:49352/0 (socket says 172.21.15.60:49352) 2023-10-08T16:15:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 -- 172.21.15.60:0/2501080794 learned_addr learned my addr 172.21.15.60:0/2501080794 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:52.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4913c700 1 --2- 172.21.15.60:0/2501080794 >> v2:172.21.15.144:3300/0 conn(0x7f9f44159c30 0x7f9f440711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 -- 172.21.15.60:0/2501080794 >> v2:172.21.15.144:3300/0 conn(0x7f9f44159c30 msgr2=0x7f9f440711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:52.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 --2- 172.21.15.60:0/2501080794 >> v2:172.21.15.144:3300/0 conn(0x7f9f44159c30 0x7f9f440711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 -- 172.21.15.60:0/2501080794 >> v1:172.21.15.144:6789/0 conn(0x7f9f4406c380 legacy=0x7f9f44067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 -- 172.21.15.60:0/2501080794 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4406f9f0 con 0x7f9f4406ecc0 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4913c700 1 --2- 172.21.15.60:0/2501080794 >> v2:172.21.15.144:3300/0 conn(0x7f9f44159c30 0x7f9f440711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.779+0000 7f9f4893b700 1 --2- 172.21.15.60:0/2501080794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f4406f110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f380099b0 tx=0x7f9f38009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca4edfc957542cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f43fff700 1 -- 172.21.15.60:0/2501080794 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38009ea0 con 0x7f9f4406ecc0 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f43fff700 1 -- 172.21.15.60:0/2501080794 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3800b860 con 0x7f9f4406ecc0 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f43fff700 1 -- 172.21.15.60:0/2501080794 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800bc00 con 0x7f9f4406ecc0 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/2501080794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 msgr2=0x7f9f4406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/2501080794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f4406f110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f380099b0 tx=0x7f9f38009250 comp rx=0 tx=0).stop 2023-10-08T16:15:52.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/2501080794 shutdown_connections 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/2501080794 >> v2:172.21.15.144:3300/0 conn(0x7f9f44159c30 0x7f9f440711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/2501080794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f4406f110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/2501080794 >> 172.21.15.60:0/2501080794 conn(0x7f9f440cb030 msgr2=0x7f9f4406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/2501080794 shutdown_connections 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.780+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/2501080794 wait complete. 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.781+0000 7f9f4b3a0700 1 Processor -- start 2023-10-08T16:15:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.781+0000 7f9f4b3a0700 1 -- start start 2023-10-08T16:15:52.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4b3a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f4406c380 0x7f9f440b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4b3a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f440ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4b3a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 0x7f9f4415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4b3a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440adf70 con 0x7f9f44159c30 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4b3a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44153f60 con 0x7f9f4406c380 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4b3a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c4ba0 con 0x7f9f4406ecc0 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4993d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 0x7f9f4415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4993d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 0x7f9f4415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34710/0 (socket says 172.21.15.60:34710) 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.782+0000 7f9f4993d700 1 -- 172.21.15.60:0/1926168862 learned_addr learned my addr 172.21.15.60:0/1926168862 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4913c700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f4406c380 0x7f9f440b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4893b700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f440ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4993d700 1 -- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 msgr2=0x7f9f440ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4993d700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f440ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4993d700 1 -- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f4406c380 msgr2=0x7f9f440b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4993d700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f4406c380 0x7f9f440b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4993d700 1 -- 172.21.15.60:0/1926168862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009420 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4893b700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f440ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4993d700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 0x7f9f4415e9a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c8e0 tx=0x7f9f34001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34012630 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34012790 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f380094f0 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34012b50 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.783+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f440ae440 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.784+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f440c4d50 con 0x7f9f44159c30 2023-10-08T16:15:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.784+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f3400a3b0 con 0x7f9f44159c30 2023-10-08T16:15:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.785+0000 7f9f417fa700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f30066f30 0x7f9f300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.785+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f9f340847e0 con 0x7f9f44159c30 2023-10-08T16:15:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.785+0000 7f9f4913c700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f30066f30 0x7f9f300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.785+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f9f3006eab0 con 0x7f9f44159c30 2023-10-08T16:15:52.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.785+0000 7f9f4913c700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f30066f30 0x7f9f300693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b0230 tx=0x7f9f3c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:52.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.789+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f440c4d50 con 0x7f9f44159c30 2023-10-08T16:15:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.983+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f440c4d50 con 0x7f9f44159c30 2023-10-08T16:15:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.983+0000 7f9f417fa700 1 -- 172.21.15.60:0/1926168862 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f440c4d50 con 0x7f9f44159c30 2023-10-08T16:15:52.985 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f30066f30 msgr2=0x7f9f300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f30066f30 0x7f9f300693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b0230 tx=0x7f9f3c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 msgr2=0x7f9f4415e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 0x7f9f4415e9a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c8e0 tx=0x7f9f34001710 comp rx=0 tx=0).stop 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 shutdown_connections 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9f30066f30 0x7f9f300693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f44159c30 0x7f9f4415e9a0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f4406c380 0x7f9f440b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 --2- 172.21.15.60:0/1926168862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f4406ecc0 0x7f9f440ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 >> 172.21.15.60:0/1926168862 conn(0x7f9f440cb030 msgr2=0x7f9f440ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 shutdown_connections 2023-10-08T16:15:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:52.985+0000 7f9f4b3a0700 1 -- 172.21.15.60:0/1926168862 wait complete. 2023-10-08T16:15:52.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:15:53.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.119+0000 7fb84f59e700 1 Processor -- start 2023-10-08T16:15:53.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.119+0000 7fb84f59e700 1 -- start start 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8500cce30 0x7fb85015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8500b6580 0x7fb85006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85006ac90 con 0x7fb85006a830 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500b4d70 con 0x7fb8500b6580 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500cd8d0 con 0x7fb8500cce30 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8500b6580 0x7fb85006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb85006a830 0x7fb85015d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41886/0 (socket says 172.21.15.60:41886) 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84ed9d700 1 -- 172.21.15.60:0/2798658815 learned_addr learned my addr 172.21.15.60:0/2798658815 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:53.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84e59c700 1 --2- 172.21.15.60:0/2798658815 >> v2:172.21.15.144:3300/0 conn(0x7fb8500cce30 0x7fb85015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84dd9b700 1 -- 172.21.15.60:0/2798658815 >> v2:172.21.15.144:3300/0 conn(0x7fb8500cce30 msgr2=0x7fb85015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84dd9b700 1 --2- 172.21.15.60:0/2798658815 >> v2:172.21.15.144:3300/0 conn(0x7fb8500cce30 0x7fb85015aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84dd9b700 1 -- 172.21.15.60:0/2798658815 >> v1:172.21.15.60:6789/0 conn(0x7fb85006a830 legacy=0x7fb85015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84dd9b700 1 -- 172.21.15.60:0/2798658815 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500b4440 con 0x7fb8500b6580 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.120+0000 7fb84d59a700 1 -- 172.21.15.60:0/2798658815 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023641023 0 0) 0x7fb848001110 con 0x7fb85006a830 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84dd9b700 1 --2- 172.21.15.60:0/2798658815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500b6580 0x7fb85006a2f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb8500b3770 tx=0x7fb8380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38b500e703ff92c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84d59a700 1 -- 172.21.15.60:0/2798658815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011630 con 0x7fb8500b6580 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84d59a700 1 -- 172.21.15.60:0/2798658815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011790 con 0x7fb8500b6580 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84d59a700 1 -- 172.21.15.60:0/2798658815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011b30 con 0x7fb8500b6580 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 -- 172.21.15.60:0/2798658815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500b6580 msgr2=0x7fb85006a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2798658815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500b6580 0x7fb85006a2f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb8500b3770 tx=0x7fb8380091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 -- 172.21.15.60:0/2798658815 shutdown_connections 2023-10-08T16:15:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2798658815 >> v2:172.21.15.144:3300/0 conn(0x7fb8500cce30 0x7fb85015aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2798658815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500b6580 0x7fb85006a2f0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 -- 172.21.15.60:0/2798658815 >> 172.21.15.60:0/2798658815 conn(0x7fb850068cb0 msgr2=0x7fb8500690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 -- 172.21.15.60:0/2798658815 shutdown_connections 2023-10-08T16:15:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.121+0000 7fb84f59e700 1 -- 172.21.15.60:0/2798658815 wait complete. 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.122+0000 7fb84f59e700 1 Processor -- start 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.122+0000 7fb84f59e700 1 -- start start 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 0x7fb850158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8500b6580 0x7fb850154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8500cce30 0x7fb85015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85016a5e0 con 0x7fb85006a830 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85016a8c0 con 0x7fb8500cce30 2023-10-08T16:15:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85016aba0 con 0x7fb8500b6580 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 0x7fb850158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 0x7fb850158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34728/0 (socket says 172.21.15.60:34728) 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84e59c700 1 -- 172.21.15.60:0/2241050328 learned_addr learned my addr 172.21.15.60:0/2241050328 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84dd9b700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8500b6580 0x7fb850154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.123+0000 7fb84ed9d700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8500cce30 0x7fb85015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84e59c700 1 -- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8500b6580 msgr2=0x7fb850154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84e59c700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8500b6580 0x7fb850154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84e59c700 1 -- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8500cce30 msgr2=0x7fb85015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84e59c700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8500cce30 0x7fb85015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84e59c700 1 -- 172.21.15.60:0/2241050328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009420 con 0x7fb85006a830 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84ed9d700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8500cce30 0x7fb85015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84e59c700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 0x7fb850158f80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb840009e50 tx=0x7fb84000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000cb50 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000f040 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840014480 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85016ae80 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.124+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85014eca0 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.125+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850089550 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.125+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8400147f0 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.126+0000 7fb8467fc700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb830066f30 0x7fb8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.126+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fb840084e80 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.126+0000 7fb84dd9b700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb830066f30 0x7fb8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.126+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fb83006eab0 con 0x7fb85006a830 2023-10-08T16:15:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.126+0000 7fb84dd9b700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb830066f30 0x7fb8300693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb8380093f0 tx=0x7fb838017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.130+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8400520d0 con 0x7fb85006a830 2023-10-08T16:15:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.320+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8500b4720 con 0x7fb85006a830 2023-10-08T16:15:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.321+0000 7fb8467fc700 1 -- 172.21.15.60:0/2241050328 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v168) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8400556f0 con 0x7fb85006a830 2023-10-08T16:15:53.322 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:15:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb830066f30 msgr2=0x7fb8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb830066f30 0x7fb8300693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb8380093f0 tx=0x7fb838017000 comp rx=0 tx=0).stop 2023-10-08T16:15:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 msgr2=0x7fb850158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 0x7fb850158f80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb840009e50 tx=0x7fb84000b040 comp rx=0 tx=0).stop 2023-10-08T16:15:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 shutdown_connections 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb830066f30 0x7fb8300693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8500cce30 0x7fb85015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85006a830 0x7fb850158f80 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 --2- 172.21.15.60:0/2241050328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8500b6580 0x7fb850154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.322+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 >> 172.21.15.60:0/2241050328 conn(0x7fb850068cb0 msgr2=0x7fb8501507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.323+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 shutdown_connections 2023-10-08T16:15:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.323+0000 7fb84f59e700 1 -- 172.21.15.60:0/2241050328 wait complete. 2023-10-08T16:15:53.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:15:53.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.458+0000 7fcc5d52a700 1 Processor -- start 2023-10-08T16:15:53.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.458+0000 7fcc5d52a700 1 -- start start 2023-10-08T16:15:53.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.458+0000 7fcc5d52a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc580b4860 0x7fcc580b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc5d52a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc580b4c30 0x7fcc58159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc5d52a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580b14f0 con 0x7fcc58159fd0 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc5d52a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc580b17d0 con 0x7fcc580b4860 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc5d52a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580b1ab0 con 0x7fcc580b4c30 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc56ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc580b4860 0x7fcc580b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc577fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcc58159fd0 0x7fcc580cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41890/0 (socket says 172.21.15.60:41890) 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc577fe700 1 -- 172.21.15.60:0/1695281926 learned_addr learned my addr 172.21.15.60:0/1695281926 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc567fc700 1 --2- 172.21.15.60:0/1695281926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc580b4c30 0x7fcc58159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc56ffd700 1 -- 172.21.15.60:0/1695281926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc580b4c30 msgr2=0x7fcc58159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc56ffd700 1 --2- 172.21.15.60:0/1695281926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc580b4c30 0x7fcc58159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc56ffd700 1 -- 172.21.15.60:0/1695281926 >> v1:172.21.15.60:6789/0 conn(0x7fcc58159fd0 legacy=0x7fcc580cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc56ffd700 1 -- 172.21.15.60:0/1695281926 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc580b1d90 con 0x7fcc580b4860 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc56ffd700 1 --2- 172.21.15.60:0/1695281926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc580b6700 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcc500098d0 tx=0x7fcc50009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431ea84096f6ef97 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc55ffb700 1 -- 172.21.15.60:0/1695281926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50009e10 con 0x7fcc580b4860 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc55ffb700 1 -- 172.21.15.60:0/1695281926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5000b760 con 0x7fcc580b4860 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.459+0000 7fcc55ffb700 1 -- 172.21.15.60:0/1695281926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000bb00 con 0x7fcc580b4860 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 -- 172.21.15.60:0/1695281926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 msgr2=0x7fcc580b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/1695281926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc580b6700 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcc500098d0 tx=0x7fcc50009120 comp rx=0 tx=0).stop 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 -- 172.21.15.60:0/1695281926 shutdown_connections 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/1695281926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc580b6700 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/1695281926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc580b4c30 0x7fcc58159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 -- 172.21.15.60:0/1695281926 >> 172.21.15.60:0/1695281926 conn(0x7fcc5809a0f0 msgr2=0x7fcc58067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:53.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 -- 172.21.15.60:0/1695281926 shutdown_connections 2023-10-08T16:15:53.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.460+0000 7fcc5d52a700 1 -- 172.21.15.60:0/1695281926 wait complete. 2023-10-08T16:15:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.461+0000 7fcc5d52a700 1 Processor -- start 2023-10-08T16:15:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.461+0000 7fcc5d52a700 1 -- start start 2023-10-08T16:15:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc5d52a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc5814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc5d52a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc580b4c30 0x7fcc58155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc5d52a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc58159fd0 0x7fcc58155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc5d52a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5816a590 con 0x7fcc580b4860 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc5d52a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5816b3a0 con 0x7fcc580b4c30 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc5d52a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58150800 con 0x7fcc58159fd0 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc5814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc5814fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34756/0 (socket says 172.21.15.60:34756) 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 -- 172.21.15.60:0/3377061154 learned_addr learned my addr 172.21.15.60:0/3377061154 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc577fe700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc58159fd0 0x7fcc58155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc567fc700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc580b4c30 0x7fcc58155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 -- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc58159fd0 msgr2=0x7fcc58155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc58159fd0 0x7fcc58155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 -- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc580b4c30 msgr2=0x7fcc58155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc580b4c30 0x7fcc58155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc56ffd700 1 -- 172.21.15.60:0/3377061154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500093c0 con 0x7fcc580b4860 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc577fe700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc58159fd0 0x7fcc58155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.462+0000 7fcc567fc700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc580b4c30 0x7fcc58155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.463+0000 7fcc56ffd700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc5814fd80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c010 tx=0x7fcc50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.463+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50000d10 con 0x7fcc580b4860 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.463+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50011e30 con 0x7fcc580b4860 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.463+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5816a790 con 0x7fcc580b4860 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.463+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5001c8c0 con 0x7fcc580b4860 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.463+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5816b030 con 0x7fcc580b4860 2023-10-08T16:15:53.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.464+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5816ab80 con 0x7fcc580b4860 2023-10-08T16:15:53.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.464+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc5001cc30 con 0x7fcc580b4860 2023-10-08T16:15:53.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.465+0000 7fcc4effd700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc38066f30 0x7fcc380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.465+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fcc50086a90 con 0x7fcc580b4860 2023-10-08T16:15:53.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.465+0000 7fcc567fc700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc38066f30 0x7fcc380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.465+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fcc3806eab0 con 0x7fcc580b4860 2023-10-08T16:15:53.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.465+0000 7fcc567fc700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc38066f30 0x7fcc380693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcc5815bc80 tx=0x7fcc40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.469+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc50053ce0 con 0x7fcc580b4860 2023-10-08T16:15:53.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.663+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc5816ab80 con 0x7fcc580b4860 2023-10-08T16:15:53.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.663+0000 7fcc4effd700 1 -- 172.21.15.60:0/3377061154 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v168) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc50057300 con 0x7fcc580b4860 2023-10-08T16:15:53.665 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc38066f30 msgr2=0x7fcc380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc38066f30 0x7fcc380693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcc5815bc80 tx=0x7fcc40008040 comp rx=0 tx=0).stop 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 msgr2=0x7fcc5814fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc5814fd80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c010 tx=0x7fcc50016000 comp rx=0 tx=0).stop 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 shutdown_connections 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fcc38066f30 0x7fcc380693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc58159fd0 0x7fcc58155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc580b4860 0x7fcc5814fd80 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 --2- 172.21.15.60:0/3377061154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc580b4c30 0x7fcc58155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 >> 172.21.15.60:0/3377061154 conn(0x7fcc5809a0f0 msgr2=0x7fcc580b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:53.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 shutdown_connections 2023-10-08T16:15:53.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.665+0000 7fcc5d52a700 1 -- 172.21.15.60:0/3377061154 wait complete. 2023-10-08T16:15:53.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.796+0000 7f876bcd9700 1 Processor -- start 2023-10-08T16:15:53.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.796+0000 7f876bcd9700 1 -- start start 2023-10-08T16:15:53.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.797+0000 7f876bcd9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8764157ba0 0x7f876406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.797+0000 7f876bcd9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876415c360 con 0x7f876415b0d0 2023-10-08T16:15:53.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.797+0000 7f876bcd9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876415b790 con 0x7f87641577d0 2023-10-08T16:15:53.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.797+0000 7f876bcd9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876415ba30 con 0x7f8764157ba0 2023-10-08T16:15:53.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.797+0000 7f876a276700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f876415b0d0 0x7f876415c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41900/0 (socket says 172.21.15.60:41900) 2023-10-08T16:15:53.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.797+0000 7f876a276700 1 -- 172.21.15.60:0/2220646038 learned_addr learned my addr 172.21.15.60:0/2220646038 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:53.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769274700 1 --2- 172.21.15.60:0/2220646038 >> v2:172.21.15.144:3300/0 conn(0x7f8764157ba0 0x7f876406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671282808 0 0) 0x7f876415c360 con 0x7f876415b0d0 2023-10-08T16:15:53.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f874c003570 con 0x7f876415b0d0 2023-10-08T16:15:53.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2058953722 0 0) 0x7f874c003570 con 0x7f876415b0d0 2023-10-08T16:15:53.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 >> v2:172.21.15.144:3300/0 conn(0x7f8764157ba0 msgr2=0x7f876406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:53.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 --2- 172.21.15.60:0/2220646038 >> v2:172.21.15.144:3300/0 conn(0x7f8764157ba0 0x7f876406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 >> v1:172.21.15.144:6789/0 conn(0x7f87641577d0 legacy=0x7f87640cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876415bd10 con 0x7f876415b0d0 2023-10-08T16:15:53.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f87540017f0 con 0x7f876415b0d0 2023-10-08T16:15:53.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 >> v1:172.21.15.60:6789/0 conn(0x7f876415b0d0 legacy=0x7f876415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f874c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f874c004810 0x7f874c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f874c0051c0 0x7f874c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876415ba30 con 0x7f874c003a60 2023-10-08T16:15:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c00c160 con 0x7f874c004810 2023-10-08T16:15:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c00c320 con 0x7f874c0051c0 2023-10-08T16:15:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769a75700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f874c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769274700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f874c004810 0x7f874c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f876a276700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f874c0051c0 0x7f874c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769a75700 1 -- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f874c0051c0 msgr2=0x7f874c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769a75700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f874c0051c0 0x7f874c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769a75700 1 -- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f874c004810 msgr2=0x7f874c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769a75700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f874c004810 0x7f874c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f8769a75700 1 -- 172.21.15.60:0/2220646038 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c003570 con 0x7f874c003a60 2023-10-08T16:15:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f876a276700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f874c0051c0 0x7f874c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.798+0000 7f876a276700 1 -- 172.21.15.60:0/2220646038 reap_dead start 2023-10-08T16:15:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f8769a75700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f874c003e70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f875c0018b0 tx=0x7f875c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879a3d75a00b3b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c012420 con 0x7f874c003a60 2023-10-08T16:15:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0125a0 con 0x7f874c003a60 2023-10-08T16:15:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f8768a73700 1 -- 172.21.15.60:0/2220646038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c012960 con 0x7f874c003a60 2023-10-08T16:15:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 -- 172.21.15.60:0/2220646038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 msgr2=0x7f874c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f874c003e70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f875c0018b0 tx=0x7f875c007d30 comp rx=0 tx=0).stop 2023-10-08T16:15:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 -- 172.21.15.60:0/2220646038 shutdown_connections 2023-10-08T16:15:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 --2- 172.21.15.60:0/2220646038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f874c003e70 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 -- 172.21.15.60:0/2220646038 >> 172.21.15.60:0/2220646038 conn(0x7f8764068ce0 msgr2=0x7f87640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 -- 172.21.15.60:0/2220646038 shutdown_connections 2023-10-08T16:15:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.799+0000 7f876bcd9700 1 -- 172.21.15.60:0/2220646038 wait complete. 2023-10-08T16:15:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.800+0000 7f876bcd9700 1 Processor -- start 2023-10-08T16:15:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.800+0000 7f876bcd9700 1 -- start start 2023-10-08T16:15:53.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876bcd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f876414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876bcd9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f876414eff0 0x7f876415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876bcd9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f876415d5f0 0x7f876415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876bcd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b05c0 con 0x7f874c003a60 2023-10-08T16:15:53.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876bcd9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b0e60 con 0x7f876414eff0 2023-10-08T16:15:53.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876bcd9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876414cfc0 con 0x7f876415d5f0 2023-10-08T16:15:53.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f8769a75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f876414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f8769a75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f876414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34768/0 (socket says 172.21.15.60:34768) 2023-10-08T16:15:53.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f8769a75700 1 -- 172.21.15.60:0/3734335622 learned_addr learned my addr 172.21.15.60:0/3734335622 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:53.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f8769274700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f876414eff0 0x7f876415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.801+0000 7f876a276700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f876415d5f0 0x7f876415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769a75700 1 -- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f876415d5f0 msgr2=0x7f876415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769a75700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f876415d5f0 0x7f876415e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769a75700 1 -- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f876414eff0 msgr2=0x7f876415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:53.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769a75700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f876414eff0 0x7f876415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:53.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769a75700 1 -- 172.21.15.60:0/3734335622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876415dae0 con 0x7f874c003a60 2023-10-08T16:15:53.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769274700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f876414eff0 0x7f876415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:53.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8769a75700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f876414ca80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c3f0 tx=0x7f875c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00c800 con 0x7f874c003a60 2023-10-08T16:15:53.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00c960 con 0x7f874c003a60 2023-10-08T16:15:53.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640b0810 con 0x7f874c003a60 2023-10-08T16:15:53.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00cd00 con 0x7f874c003a60 2023-10-08T16:15:53.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.802+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87640b3030 con 0x7f874c003a60 2023-10-08T16:15:53.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.803+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87640b0cb0 con 0x7f874c003a60 2023-10-08T16:15:53.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.803+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f875c01f620 con 0x7f874c003a60 2023-10-08T16:15:53.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.804+0000 7f8761ffb700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8750066f30 0x7f87500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:53.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.804+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f875c085ec0 con 0x7f874c003a60 2023-10-08T16:15:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.804+0000 7f8769274700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8750066f30 0x7f87500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.804+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f875006eab0 con 0x7f874c003a60 2023-10-08T16:15:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.804+0000 7f8769274700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8750066f30 0x7f87500693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8758006dc0 tx=0x7f8758008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:53.808+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f875c017060 con 0x7f874c003a60 2023-10-08T16:15:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.047+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f876404c3c0 con 0x7f874c003a60 2023-10-08T16:15:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.048+0000 7f8761ffb700 1 -- 172.21.15.60:0/3734335622 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f875c02d020 con 0x7f874c003a60 2023-10-08T16:15:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:54.049 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8750066f30 msgr2=0x7f87500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8750066f30 0x7f87500693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8758006dc0 tx=0x7f8758008040 comp rx=0 tx=0).stop 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 msgr2=0x7f876414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f876414ca80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c3f0 tx=0x7f875c015000 comp rx=0 tx=0).stop 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 shutdown_connections 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8750066f30 0x7f87500693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f876415d5f0 0x7f876415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f874c003a60 0x7f876414ca80 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 --2- 172.21.15.60:0/3734335622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f876414eff0 0x7f876415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 >> 172.21.15.60:0/3734335622 conn(0x7f8764068ce0 msgr2=0x7f87640b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 shutdown_connections 2023-10-08T16:15:54.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.050+0000 7f876bcd9700 1 -- 172.21.15.60:0/3734335622 wait complete. 2023-10-08T16:15:54.053 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:15:54.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:54.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.181+0000 7f860ac86700 1 Processor -- start 2023-10-08T16:15:54.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.181+0000 7f860ac86700 1 -- start start 2023-10-08T16:15:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f860ac86700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f860415a620 0x7f860415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f860ac86700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860415cbb0 con 0x7f860415d580 2023-10-08T16:15:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f860ac86700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860415bfa0 con 0x7f8604157870 2023-10-08T16:15:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f860ac86700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860415bdb0 con 0x7f860415a620 2023-10-08T16:15:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f8603fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f860415a620 0x7f860415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f8609223700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f860415d580 0x7f8604158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41906/0 (socket says 172.21.15.60:41906) 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.182+0000 7f8609223700 1 -- 172.21.15.60:0/3456229997 learned_addr learned my addr 172.21.15.60:0/3456229997 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f8603fff700 1 -- 172.21.15.60:0/3456229997 >> v1:172.21.15.144:6789/0 conn(0x7f8604157870 legacy=0x7f860415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f8603fff700 1 -- 172.21.15.60:0/3456229997 >> v1:172.21.15.60:6789/0 conn(0x7f860415d580 legacy=0x7f8604158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f86037fe700 1 -- 172.21.15.60:0/3456229997 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442895768 0 0) 0x7f860415cbb0 con 0x7f860415d580 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f8603fff700 1 -- 172.21.15.60:0/3456229997 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860415c280 con 0x7f860415a620 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f8603fff700 1 --2- 172.21.15.60:0/3456229997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860415a620 0x7f860415d040 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009e60 tx=0x7f85f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e93e43284c023b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f86037fe700 1 -- 172.21.15.60:0/3456229997 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400e070 con 0x7f860415a620 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f86037fe700 1 -- 172.21.15.60:0/3456229997 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f400bc30 con 0x7f860415a620 2023-10-08T16:15:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.183+0000 7f86037fe700 1 -- 172.21.15.60:0/3456229997 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4012430 con 0x7f860415a620 2023-10-08T16:15:54.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 -- 172.21.15.60:0/3456229997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860415a620 msgr2=0x7f860415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 --2- 172.21.15.60:0/3456229997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860415a620 0x7f860415d040 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009e60 tx=0x7f85f4009780 comp rx=0 tx=0).stop 2023-10-08T16:15:54.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 -- 172.21.15.60:0/3456229997 shutdown_connections 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 --2- 172.21.15.60:0/3456229997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860415a620 0x7f860415d040 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 -- 172.21.15.60:0/3456229997 >> 172.21.15.60:0/3456229997 conn(0x7f8604068ce0 msgr2=0x7f86040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 -- 172.21.15.60:0/3456229997 shutdown_connections 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.184+0000 7f860ac86700 1 -- 172.21.15.60:0/3456229997 wait complete. 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.185+0000 7f860ac86700 1 Processor -- start 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.185+0000 7f860ac86700 1 -- start start 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 0x7f8604155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f860415a620 0x7f86040b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f860415d580 0x7f860414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041555b0 con 0x7f8604157870 2023-10-08T16:15:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040b6a00 con 0x7f860415a620 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8604154c80 con 0x7f860415d580 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 0x7f8604155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 0x7f8604155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34792/0 (socket says 172.21.15.60:34792) 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 -- 172.21.15.60:0/4047682871 learned_addr learned my addr 172.21.15.60:0/4047682871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8603fff700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f860415a620 0x7f86040b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8609223700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f860415d580 0x7f860414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 -- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f860415d580 msgr2=0x7f860414afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f860415d580 0x7f860414afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 -- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f860415a620 msgr2=0x7f86040b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f860415a620 0x7f86040b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 -- 172.21.15.60:0/4047682871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4009a20 con 0x7f8604157870 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8608a22700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 0x7f8604155a40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00c590 tx=0x7f85ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec011590 con 0x7f8604157870 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec011710 con 0x7f8604157870 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec011ad0 con 0x7f8604157870 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604154f60 con 0x7f8604157870 2023-10-08T16:15:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.186+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86040b64a0 con 0x7f8604157870 2023-10-08T16:15:54.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.187+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860404c3c0 con 0x7f8604157870 2023-10-08T16:15:54.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.188+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85ec01b3b0 con 0x7f8604157870 2023-10-08T16:15:54.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.188+0000 7f8600ff9700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f85e4066f30 0x7f85e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.188+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f85ec0839c0 con 0x7f8604157870 2023-10-08T16:15:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.188+0000 7f8603fff700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f85e4066f30 0x7f85e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.188+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f85e406eab0 con 0x7f8604157870 2023-10-08T16:15:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.189+0000 7f8603fff700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f85e4066f30 0x7f85e40693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009e60 tx=0x7f85f4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.192+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85ec017070 con 0x7f8604157870 2023-10-08T16:15:54.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.386+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8604155890 con 0x7f8604157870 2023-10-08T16:15:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.387+0000 7f8600ff9700 1 -- 172.21.15.60:0/4047682871 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15441 (secure 0 0 0) 0x7f85ec050c10 con 0x7f8604157870 2023-10-08T16:15:54.388 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:54.389 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":168,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:15:28.399290+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:14:34.351205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T16:14:34.896986+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:54.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f85e4066f30 msgr2=0x7f85e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f85e4066f30 0x7f85e40693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009e60 tx=0x7f85f4019000 comp rx=0 tx=0).stop 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 msgr2=0x7f8604155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 0x7f8604155a40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00c590 tx=0x7f85ec00c8a0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 shutdown_connections 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f85e4066f30 0x7f85e40693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f860415d580 0x7f860414afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8604157870 0x7f8604155a40 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 --2- 172.21.15.60:0/4047682871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f860415a620 0x7f86040b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 >> 172.21.15.60:0/4047682871 conn(0x7f8604068ce0 msgr2=0x7f860415ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:54.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 shutdown_connections 2023-10-08T16:15:54.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.389+0000 7f860ac86700 1 -- 172.21.15.60:0/4047682871 wait complete. 2023-10-08T16:15:54.402 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:15:54.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.521+0000 7f1a8759e700 1 Processor -- start 2023-10-08T16:15:54.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.521+0000 7f1a8759e700 1 -- start start 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a880cd6e0 0x7f1a880cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a880cb7c0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8759e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8815e290 con 0x7f1a880cdab0 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8815e850 con 0x7f1a880cd6e0 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a880cd6e0 0x7f1a880cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a86d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1a8815cbd0 0x7f1a8815d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41918/0 (socket says 172.21.15.60:41918) 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a86d9d700 1 -- 172.21.15.60:0/2304756899 learned_addr learned my addr 172.21.15.60:0/2304756899 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8659c700 1 -- 172.21.15.60:0/2304756899 >> v1:172.21.15.144:6789/0 conn(0x7f1a880cdab0 legacy=0x7f1a8815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8659c700 1 -- 172.21.15.60:0/2304756899 >> v1:172.21.15.60:6789/0 conn(0x7f1a8815cbd0 legacy=0x7f1a8815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8659c700 1 -- 172.21.15.60:0/2304756899 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8815e570 con 0x7f1a880cd6e0 2023-10-08T16:15:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.522+0000 7f1a8659c700 1 --2- 172.21.15.60:0/2304756899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a880cd6e0 0x7f1a880cbc50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1a800098e0 tx=0x7f1a800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06422a4daaf86e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8559a700 1 -- 172.21.15.60:0/2304756899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80009e80 con 0x7f1a880cd6e0 2023-10-08T16:15:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8559a700 1 -- 172.21.15.60:0/2304756899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8000b860 con 0x7f1a880cd6e0 2023-10-08T16:15:54.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8559a700 1 -- 172.21.15.60:0/2304756899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000bbe0 con 0x7f1a880cd6e0 2023-10-08T16:15:54.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 -- 172.21.15.60:0/2304756899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a880cd6e0 msgr2=0x7f1a880cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 --2- 172.21.15.60:0/2304756899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a880cd6e0 0x7f1a880cbc50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1a800098e0 tx=0x7f1a800091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 -- 172.21.15.60:0/2304756899 shutdown_connections 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 --2- 172.21.15.60:0/2304756899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a880cd6e0 0x7f1a880cbc50 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 -- 172.21.15.60:0/2304756899 >> 172.21.15.60:0/2304756899 conn(0x7f1a88067660 msgr2=0x7f1a88067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 -- 172.21.15.60:0/2304756899 shutdown_connections 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.523+0000 7f1a8759e700 1 -- 172.21.15.60:0/2304756899 wait complete. 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.524+0000 7f1a8759e700 1 Processor -- start 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.524+0000 7f1a8759e700 1 -- start start 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a880cd6e0 0x7f1a88153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a880cdab0 0x7f1a880c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 0x7f1a880c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8816a260 con 0x7f1a8815cbd0 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880b5880 con 0x7f1a880cd6e0 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88154010 con 0x7f1a880cdab0 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 0x7f1a880c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 0x7f1a880c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34808/0 (socket says 172.21.15.60:34808) 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 -- 172.21.15.60:0/1967182697 learned_addr learned my addr 172.21.15.60:0/1967182697 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a8659c700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a880cd6e0 0x7f1a88153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a85d9b700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a880cdab0 0x7f1a880c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 -- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a880cdab0 msgr2=0x7f1a880c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a880cdab0 0x7f1a880c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 -- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a880cd6e0 msgr2=0x7f1a88153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.525+0000 7f1a86d9d700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a880cd6e0 0x7f1a88153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a86d9d700 1 -- 172.21.15.60:0/1967182697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80009420 con 0x7f1a8815cbd0 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a8659c700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a880cd6e0 0x7f1a88153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a86d9d700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 0x7f1a880c8a90 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800cc40 tx=0x7f1a78001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800a9c0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7800ab20 con 0x7f1a8815cbd0 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a880b2840 con 0x7f1a8815cbd0 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780070f0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.526+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a880b4fe0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.527+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8816a3a0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.527+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a780074e0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.528+0000 7f1a7e7fc700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a68066f30 0x7f1a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.528+0000 7f1a8659c700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a68066f30 0x7f1a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.528+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1a78084970 con 0x7f1a8815cbd0 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.528+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f1a6806eab0 con 0x7f1a8815cbd0 2023-10-08T16:15:54.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.528+0000 7f1a8659c700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a68066f30 0x7f1a680693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1a80003080 tx=0x7f1a80017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.532+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a78051c40 con 0x7f1a8815cbd0 2023-10-08T16:15:54.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.769+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a8804bb80 con 0x7f1a8815cbd0 2023-10-08T16:15:54.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.769+0000 7f1a7e7fc700 1 -- 172.21.15.60:0/1967182697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f1a78055260 con 0x7f1a8815cbd0 2023-10-08T16:15:54.770 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:54.771 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a68066f30 msgr2=0x7f1a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a68066f30 0x7f1a680693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1a80003080 tx=0x7f1a80017000 comp rx=0 tx=0).stop 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 msgr2=0x7f1a880c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 0x7f1a880c8a90 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800cc40 tx=0x7f1a78001a50 comp rx=0 tx=0).stop 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 shutdown_connections 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a68066f30 0x7f1a680693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8815cbd0 0x7f1a880c8a90 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a880cd6e0 0x7f1a88153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 --2- 172.21.15.60:0/1967182697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a880cdab0 0x7f1a880c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 >> 172.21.15.60:0/1967182697 conn(0x7f1a88067660 msgr2=0x7f1a881572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 shutdown_connections 2023-10-08T16:15:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.771+0000 7f1a8759e700 1 -- 172.21.15.60:0/1967182697 wait complete. 2023-10-08T16:15:54.774 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:15:54.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:15:54.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.902+0000 7fdb125d6700 1 Processor -- start 2023-10-08T16:15:54.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.902+0000 7fdb125d6700 1 -- start start 2023-10-08T16:15:54.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb125d6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb0c159db0 0x7fdb0c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb125d6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb0c0b1f00 0x7fdb0c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb125d6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0b4bf0 con 0x7fdb0c068240 2023-10-08T16:15:54.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb125d6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0b5790 con 0x7fdb0c0b1f00 2023-10-08T16:15:54.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb125d6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0ae9b0 con 0x7fdb0c159db0 2023-10-08T16:15:54.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb11dd5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb0c0b1f00 0x7fdb0c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb10dd3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdb0c068240 0x7fdb0c0b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41928/0 (socket says 172.21.15.60:41928) 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb10dd3700 1 -- 172.21.15.60:0/1076580417 learned_addr learned my addr 172.21.15.60:0/1076580417 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb115d4700 1 --2- 172.21.15.60:0/1076580417 >> v2:172.21.15.144:3300/0 conn(0x7fdb0c159db0 0x7fdb0c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb11dd5700 1 -- 172.21.15.60:0/1076580417 >> v2:172.21.15.144:3300/0 conn(0x7fdb0c159db0 msgr2=0x7fdb0c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.903+0000 7fdb11dd5700 1 --2- 172.21.15.60:0/1076580417 >> v2:172.21.15.144:3300/0 conn(0x7fdb0c159db0 0x7fdb0c0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb11dd5700 1 -- 172.21.15.60:0/1076580417 >> v1:172.21.15.60:6789/0 conn(0x7fdb0c068240 legacy=0x7fdb0c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb11dd5700 1 -- 172.21.15.60:0/1076580417 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0b59e0 con 0x7fdb0c0b1f00 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb11dd5700 1 --2- 172.21.15.60:0/1076580417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c0b1f00 0x7fdb0c0aee40 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0899b0 tx=0x7fdafc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa1735070b14994 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb0bfff700 1 -- 172.21.15.60:0/1076580417 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00b6b0 con 0x7fdb0c0b1f00 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb0bfff700 1 -- 172.21.15.60:0/1076580417 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc00b810 con 0x7fdb0c0b1f00 2023-10-08T16:15:54.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb0bfff700 1 -- 172.21.15.60:0/1076580417 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00bbb0 con 0x7fdb0c0b1f00 2023-10-08T16:15:54.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb125d6700 1 -- 172.21.15.60:0/1076580417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c0b1f00 msgr2=0x7fdb0c0aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1076580417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c0b1f00 0x7fdb0c0aee40 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0899b0 tx=0x7fdafc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb125d6700 1 -- 172.21.15.60:0/1076580417 shutdown_connections 2023-10-08T16:15:54.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1076580417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c0b1f00 0x7fdb0c0aee40 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1076580417 >> v2:172.21.15.144:3300/0 conn(0x7fdb0c159db0 0x7fdb0c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.904+0000 7fdb125d6700 1 -- 172.21.15.60:0/1076580417 >> 172.21.15.60:0/1076580417 conn(0x7fdb0c067e40 msgr2=0x7fdb0c0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.905+0000 7fdb125d6700 1 -- 172.21.15.60:0/1076580417 shutdown_connections 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.905+0000 7fdb125d6700 1 -- 172.21.15.60:0/1076580417 wait complete. 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 Processor -- start 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 -- start start 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 0x7fdb0c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb0c0b1f00 0x7fdb0c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb0c159db0 0x7fdb0c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c153170 con 0x7fdb0c068240 2023-10-08T16:15:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1525a0 con 0x7fdb0c159db0 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.906+0000 7fdb125d6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c15a850 con 0x7fdb0c0b1f00 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 0x7fdb0c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 0x7fdb0c15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34826/0 (socket says 172.21.15.60:34826) 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 -- 172.21.15.60:0/1217432044 learned_addr learned my addr 172.21.15.60:0/1217432044 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb11dd5700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb0c159db0 0x7fdb0c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb10dd3700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb0c0b1f00 0x7fdb0c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 -- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb0c0b1f00 msgr2=0x7fdb0c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb0c0b1f00 0x7fdb0c15a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 -- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb0c159db0 msgr2=0x7fdb0c0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb0c159db0 0x7fdb0c0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 -- 172.21.15.60:0/1217432044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009420 con 0x7fdb0c068240 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb10dd3700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb0c0b1f00 0x7fdb0c15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb115d4700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 0x7fdb0c15c760 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009fa0 tx=0x7fdb04009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400ec70 con 0x7fdb0c068240 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400edd0 con 0x7fdb0c068240 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c152840 con 0x7fdb0c068240 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04014670 con 0x7fdb0c068240 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.907+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c152e00 con 0x7fdb0c068240 2023-10-08T16:15:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.908+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c06ace0 con 0x7fdb0c068240 2023-10-08T16:15:54.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.909+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb040149e0 con 0x7fdb0c068240 2023-10-08T16:15:54.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.909+0000 7fdb097fa700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaf8066f30 0x7fdaf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:54.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.909+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fdb04084bf0 con 0x7fdb0c068240 2023-10-08T16:15:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.909+0000 7fdb10dd3700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaf8066f30 0x7fdaf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.909+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fdaf806eab0 con 0x7fdb0c068240 2023-10-08T16:15:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.910+0000 7fdb10dd3700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaf8066f30 0x7fdaf80693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c13f210 tx=0x7fdb00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:54.914+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb04051e40 con 0x7fdb0c068240 2023-10-08T16:15:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.150+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb0c153500 con 0x7fdb0c068240 2023-10-08T16:15:55.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.151+0000 7fdb097fa700 1 -- 172.21.15.60:0/1217432044 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fdb04055460 con 0x7fdb0c068240 2023-10-08T16:15:55.152 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:14:35.921732+0000","modified":"2023-10-08T16:14:39.556891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7824":{"gid":7824,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/3393857134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3393857134},{"type":"v1","addr":"172.21.15.60:6837","nonce":3393857134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T16:15:55.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaf8066f30 msgr2=0x7fdaf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaf8066f30 0x7fdaf80693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c13f210 tx=0x7fdb00009040 comp rx=0 tx=0).stop 2023-10-08T16:15:55.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 msgr2=0x7fdb0c15c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 0x7fdb0c15c760 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009fa0 tx=0x7fdb04009880 comp rx=0 tx=0).stop 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 shutdown_connections 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaf8066f30 0x7fdaf80693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb0c159db0 0x7fdb0c0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb0c068240 0x7fdb0c15c760 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 --2- 172.21.15.60:0/1217432044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb0c0b1f00 0x7fdb0c15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 >> 172.21.15.60:0/1217432044 conn(0x7fdb0c067e40 msgr2=0x7fdb0c157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 shutdown_connections 2023-10-08T16:15:55.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.153+0000 7fdb125d6700 1 -- 172.21.15.60:0/1217432044 wait complete. 2023-10-08T16:15:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 85 2023-10-08T16:15:55.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:15:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.284+0000 7fdffad66700 1 Processor -- start 2023-10-08T16:15:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.284+0000 7fdffad66700 1 -- start start 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdffad66700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff41510f0 0x7fdff406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdffad66700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdff40c9af0 0x7fdff415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdffad66700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff415e280 con 0x7fdff4070700 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdffad66700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff40ca0b0 con 0x7fdff40c9af0 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdffad66700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4068a10 con 0x7fdff41510f0 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdff9303700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdff4070700 0x7fdff40afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41936/0 (socket says 172.21.15.60:41936) 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdff9303700 1 -- 172.21.15.60:0/2636767060 learned_addr learned my addr 172.21.15.60:0/2636767060 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdff8b02700 1 --2- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff41510f0 0x7fdff406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.285+0000 7fdff3fff700 1 --2- 172.21.15.60:0/2636767060 >> v2:172.21.15.144:3300/0 conn(0x7fdff40c9af0 0x7fdff415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff37fe700 1 -- 172.21.15.60:0/2636767060 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750143497 0 0) 0x7fdff415e280 con 0x7fdff4070700 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff37fe700 1 -- 172.21.15.60:0/2636767060 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe0003570 con 0x7fdff4070700 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff3fff700 1 -- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff41510f0 msgr2=0x7fdff406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff3fff700 1 --2- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff41510f0 0x7fdff406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff3fff700 1 -- 172.21.15.60:0/2636767060 >> v1:172.21.15.60:6789/0 conn(0x7fdff4070700 legacy=0x7fdff40afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff3fff700 1 -- 172.21.15.60:0/2636767060 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4068cf0 con 0x7fdff40c9af0 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff3fff700 1 --2- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff415dd40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098e0 tx=0x7fdfe40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e6ba0971e85f27 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff37fe700 1 -- 172.21.15.60:0/2636767060 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4011630 con 0x7fdff40c9af0 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff37fe700 1 -- 172.21.15.60:0/2636767060 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4011790 con 0x7fdff40c9af0 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.286+0000 7fdff37fe700 1 -- 172.21.15.60:0/2636767060 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4011b30 con 0x7fdff40c9af0 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 -- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 msgr2=0x7fdff415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 --2- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff415dd40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098e0 tx=0x7fdfe40091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 -- 172.21.15.60:0/2636767060 shutdown_connections 2023-10-08T16:15:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 --2- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff41510f0 0x7fdff406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 --2- 172.21.15.60:0/2636767060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff415dd40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 -- 172.21.15.60:0/2636767060 >> 172.21.15.60:0/2636767060 conn(0x7fdff40ca4f0 msgr2=0x7fdff40ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 -- 172.21.15.60:0/2636767060 shutdown_connections 2023-10-08T16:15:55.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.287+0000 7fdffad66700 1 -- 172.21.15.60:0/2636767060 wait complete. 2023-10-08T16:15:55.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.288+0000 7fdffad66700 1 Processor -- start 2023-10-08T16:15:55.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.288+0000 7fdffad66700 1 -- start start 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff4070700 0x7fdff40c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff41514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 0x7fdff4151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40b1980 con 0x7fdff41510f0 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40c7d50 con 0x7fdff40c9af0 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4154b80 con 0x7fdff4070700 2023-10-08T16:15:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 0x7fdff4151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 0x7fdff4151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34832/0 (socket says 172.21.15.60:34832) 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 -- 172.21.15.60:0/1992725398 learned_addr learned my addr 172.21.15.60:0/1992725398 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff8b02700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff4070700 0x7fdff40c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff3fff700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff41514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 -- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff4070700 msgr2=0x7fdff40c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff4070700 0x7fdff40c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 -- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 msgr2=0x7fdff41514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff41514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 -- 172.21.15.60:0/1992725398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4009420 con 0x7fdff41510f0 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff9303700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 0x7fdff4151a00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0010e0 tx=0x7fdfdc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc005c00 con 0x7fdff41510f0 2023-10-08T16:15:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc005d60 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0072e0 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.289+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff41542e0 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.290+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff41548a0 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.290+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff40b1af0 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.291+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfdc012400 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.291+0000 7fdff0ff9700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdfd4066f30 0x7fdfd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.291+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fdfdc083980 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.291+0000 7fdff8b02700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdfd4066f30 0x7fdfd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.291+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fdfd406eab0 con 0x7fdff41510f0 2023-10-08T16:15:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.292+0000 7fdff8b02700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdfd4066f30 0x7fdfd40693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009fd0 tx=0x7fdfec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:55.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.295+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfdc04b5a0 con 0x7fdff41510f0 2023-10-08T16:15:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.488+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdff404c3c0 con 0x7fdff41510f0 2023-10-08T16:15:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.488+0000 7fdff0ff9700 1 -- 172.21.15.60:0/1992725398 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15441 (secure 0 0 0) 0x7fdfdc017070 con 0x7fdff41510f0 2023-10-08T16:15:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:15:55.490 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":168,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:15:28.399290+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:14:34.351205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T16:14:34.896986+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:15:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdfd4066f30 msgr2=0x7fdfd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdfd4066f30 0x7fdfd40693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009fd0 tx=0x7fdfec00b040 comp rx=0 tx=0).stop 2023-10-08T16:15:55.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 msgr2=0x7fdff4151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 0x7fdff4151a00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0010e0 tx=0x7fdfdc007dd0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 shutdown_connections 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdfd4066f30 0x7fdfd40693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff4070700 0x7fdff40c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff41510f0 0x7fdff4151a00 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 --2- 172.21.15.60:0/1992725398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff40c9af0 0x7fdff41514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 >> 172.21.15.60:0/1992725398 conn(0x7fdff40ca4f0 msgr2=0x7fdff4069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 shutdown_connections 2023-10-08T16:15:55.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.491+0000 7fdffad66700 1 -- 172.21.15.60:0/1992725398 wait complete. 2023-10-08T16:15:55.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:15:55.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.625+0000 7f706162e700 1 Processor -- start 2023-10-08T16:15:55.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.625+0000 7f706162e700 1 -- start start 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f706162e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f705c0d1710 0x7f705c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f706162e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f705c06a830 0x7f705c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f706162e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c06ac90 con 0x7f705c159d50 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f706162e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0d1b60 con 0x7f705c06a830 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f706162e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0cf0e0 con 0x7f705c0d1710 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f705c06a830 0x7f705c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f705c159d50 0x7f705c0af790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41938/0 (socket says 172.21.15.60:41938) 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705affd700 1 -- 172.21.15.60:0/459090011 learned_addr learned my addr 172.21.15.60:0/459090011 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705a7fc700 1 --2- 172.21.15.60:0/459090011 >> v2:172.21.15.144:3300/0 conn(0x7f705c0d1710 0x7f705c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705b7fe700 1 -- 172.21.15.60:0/459090011 >> v2:172.21.15.144:3300/0 conn(0x7f705c0d1710 msgr2=0x7f705c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705b7fe700 1 --2- 172.21.15.60:0/459090011 >> v2:172.21.15.144:3300/0 conn(0x7f705c0d1710 0x7f705c06a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705b7fe700 1 -- 172.21.15.60:0/459090011 >> v1:172.21.15.60:6789/0 conn(0x7f705c159d50 legacy=0x7f705c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f7059ffb700 1 -- 172.21.15.60:0/459090011 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858359979 0 0) 0x7f704c001490 con 0x7f705c159d50 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.626+0000 7f705b7fe700 1 -- 172.21.15.60:0/459090011 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0ce820 con 0x7f705c06a830 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f705b7fe700 1 --2- 172.21.15.60:0/459090011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c06a830 0x7f705c0cf570 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f705c089d20 tx=0x7f70540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71152c3685f53b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f7059ffb700 1 -- 172.21.15.60:0/459090011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400b6b0 con 0x7f705c06a830 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f7059ffb700 1 -- 172.21.15.60:0/459090011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400b810 con 0x7f705c06a830 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f7059ffb700 1 -- 172.21.15.60:0/459090011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400bbb0 con 0x7f705c06a830 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 -- 172.21.15.60:0/459090011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c06a830 msgr2=0x7f705c0cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 --2- 172.21.15.60:0/459090011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c06a830 0x7f705c0cf570 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f705c089d20 tx=0x7f70540091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 -- 172.21.15.60:0/459090011 shutdown_connections 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 --2- 172.21.15.60:0/459090011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c06a830 0x7f705c0cf570 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 --2- 172.21.15.60:0/459090011 >> v2:172.21.15.144:3300/0 conn(0x7f705c0d1710 0x7f705c06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 -- 172.21.15.60:0/459090011 >> 172.21.15.60:0/459090011 conn(0x7f705c069630 msgr2=0x7f705c0d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 -- 172.21.15.60:0/459090011 shutdown_connections 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.627+0000 7f706162e700 1 -- 172.21.15.60:0/459090011 wait complete. 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 Processor -- start 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 -- start start 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f705c06a830 0x7f705c153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 0x7f705c0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c159d50 0x7f705c0cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b4620 con 0x7f705c0d1710 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b4900 con 0x7f705c159d50 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.629+0000 7f706162e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b4be0 con 0x7f705c06a830 2023-10-08T16:15:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 0x7f705c0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 0x7f705c0b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34860/0 (socket says 172.21.15.60:34860) 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 -- 172.21.15.60:0/738941645 learned_addr learned my addr 172.21.15.60:0/738941645 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705b7fe700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c159d50 0x7f705c0cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705affd700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f705c06a830 0x7f705c153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 -- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f705c06a830 msgr2=0x7f705c153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f705c06a830 0x7f705c153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 -- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c159d50 msgr2=0x7f705c0cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c159d50 0x7f705c0cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054009420 con 0x7f705c0d1710 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705affd700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f705c06a830 0x7f705c153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f705a7fc700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 0x7f705c0b3b60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f704400d890 tx=0x7f7044008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:55.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440125f0 con 0x7f705c0d1710 2023-10-08T16:15:55.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044012750 con 0x7f705c0d1710 2023-10-08T16:15:55.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c0b4ec0 con 0x7f705c0d1710 2023-10-08T16:15:55.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044012ad0 con 0x7f705c0d1710 2023-10-08T16:15:55.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.630+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c16dc90 con 0x7f705c0d1710 2023-10-08T16:15:55.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.631+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c0cea90 con 0x7f705c0d1710 2023-10-08T16:15:55.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.632+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f704401e460 con 0x7f705c0d1710 2023-10-08T16:15:55.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.632+0000 7f7052ffd700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:55.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.632+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f7044084b40 con 0x7f705c0d1710 2023-10-08T16:15:55.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.632+0000 7f705affd700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:55.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.632+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f703c06eab0 con 0x7f705c0d1710 2023-10-08T16:15:55.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.633+0000 7f705affd700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f703c066f30 0x7f703c0693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e280 tx=0x7f704c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:55.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.636+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7044055820 con 0x7f705c0d1710 2023-10-08T16:15:55.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.874+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f705c0ccfd0 con 0x7f705c0d1710 2023-10-08T16:15:55.875 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:15:55.874+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:15:55.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.877+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(169..169 src has 1..169) v4 ==== 366+0+0 (secure 0 0 0) 0x7f7044055a50 con 0x7f705c0d1710 2023-10-08T16:15:55.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.877+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7f703c06f3a0 con 0x7f705c0d1710 2023-10-08T16:15:55.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.879+0000 7f7052ffd700 1 -- 172.21.15.60:0/738941645 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70440553b0 con 0x7f705c0d1710 2023-10-08T16:15:55.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f703c066f30 msgr2=0x7f703c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f703c066f30 0x7f703c0693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e280 tx=0x7f704c009040 comp rx=0 tx=0).stop 2023-10-08T16:15:55.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 msgr2=0x7f705c0b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:55.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 0x7f705c0b3b60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f704400d890 tx=0x7f7044008040 comp rx=0 tx=0).stop 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 shutdown_connections 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f705c06a830 0x7f705c153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c159d50 0x7f705c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 --2- 172.21.15.60:0/738941645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f705c0d1710 0x7f705c0b3b60 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 >> 172.21.15.60:0/738941645 conn(0x7f705c069630 msgr2=0x7f705c0c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 shutdown_connections 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:55.882+0000 7f706162e700 1 -- 172.21.15.60:0/738941645 wait complete. 2023-10-08T16:15:55.884 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:15:55.885 INFO:tasks.ceph.mds.c.smithi060.stderr: -8473> 2023-10-08T16:14:41.847+0000 7fe3340d0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:15:55.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:15:55.913 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:15:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.017+0000 7fdacabca700 1 Processor -- start 2023-10-08T16:15:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.017+0000 7fdacabca700 1 -- start start 2023-10-08T16:15:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdacabca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac4159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdacabca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdac40c9c40 0x7fdac40ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdacabca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40ccf70 con 0x7fdac4159b90 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdacabca700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40ca5e0 con 0x7fdac40c9c40 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdacabca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415de10 con 0x7fdac406daa0 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdac40c9c40 0x7fdac40ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdac40c9c40 0x7fdac40ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34890/0 (socket says 172.21.15.60:34890) 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 -- 172.21.15.60:0/4063927421 learned_addr learned my addr 172.21.15.60:0/4063927421 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac3fff700 1 --2- 172.21.15.60:0/4063927421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac4159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 -- 172.21.15.60:0/4063927421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 msgr2=0x7fdac4159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 --2- 172.21.15.60:0/4063927421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac4159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 -- 172.21.15.60:0/4063927421 >> v1:172.21.15.144:6789/0 conn(0x7fdac4159b90 legacy=0x7fdac40cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 -- 172.21.15.60:0/4063927421 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac415e0f0 con 0x7fdac40c9c40 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.018+0000 7fdac9167700 1 --2- 172.21.15.60:0/4063927421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac40ca0a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009f20 tx=0x7fdabc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf1fac1a74482de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdac37fe700 1 -- 172.21.15.60:0/4063927421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00e070 con 0x7fdac40c9c40 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdac37fe700 1 -- 172.21.15.60:0/4063927421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00b9d0 con 0x7fdac40c9c40 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdac37fe700 1 -- 172.21.15.60:0/4063927421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0092e0 con 0x7fdac40c9c40 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 -- 172.21.15.60:0/4063927421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 msgr2=0x7fdac40ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 --2- 172.21.15.60:0/4063927421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac40ca0a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009f20 tx=0x7fdabc009840 comp rx=0 tx=0).stop 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 -- 172.21.15.60:0/4063927421 shutdown_connections 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 --2- 172.21.15.60:0/4063927421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac40ca0a0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 --2- 172.21.15.60:0/4063927421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac4159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 -- 172.21.15.60:0/4063927421 >> 172.21.15.60:0/4063927421 conn(0x7fdac4067660 msgr2=0x7fdac4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:56.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 -- 172.21.15.60:0/4063927421 shutdown_connections 2023-10-08T16:15:56.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.019+0000 7fdacabca700 1 -- 172.21.15.60:0/4063927421 wait complete. 2023-10-08T16:15:56.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.020+0000 7fdacabca700 1 Processor -- start 2023-10-08T16:15:56.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.020+0000 7fdacabca700 1 -- start start 2023-10-08T16:15:56.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdacabca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac41590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:56.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdacabca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac4099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdacabca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac4159b90 0x7fdac40b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdacabca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40b1670 con 0x7fdac40c9c40 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdacabca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac409a570 con 0x7fdac4159b90 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdacabca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac409a850 con 0x7fdac406daa0 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac4099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac4099b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34906/0 (socket says 172.21.15.60:34906) 2023-10-08T16:15:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdac3fff700 1 -- 172.21.15.60:0/118368185 learned_addr learned my addr 172.21.15.60:0/118368185 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdac9167700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac4159b90 0x7fdac40b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.021+0000 7fdac8966700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac41590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac3fff700 1 -- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 msgr2=0x7fdac41590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac3fff700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac41590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac3fff700 1 -- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac4159b90 msgr2=0x7fdac40b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac3fff700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac4159b90 0x7fdac40b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac3fff700 1 -- 172.21.15.60:0/118368185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc009ae0 con 0x7fdac40c9c40 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac8966700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac41590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac3fff700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac4099b40 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdab000e930 tx=0x7fdab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0013680 con 0x7fdac40c9c40 2023-10-08T16:15:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab00137e0 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac40b1300 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0013b80 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.022+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac415d090 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.023+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40b1820 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.023+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdab000c460 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.024+0000 7fdac0ff9700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.024+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5820+0+0 (secure 0 0 0) 0x7fdab0084730 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.024+0000 7fdac8966700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.024+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7fdaa806eb50 con 0x7fdac40c9c40 2023-10-08T16:15:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.024+0000 7fdac8966700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaa8066f30 0x7fdaa80693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdab8007fd0 tx=0x7fdab8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:56.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.028+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac40b1820 con 0x7fdac40c9c40 2023-10-08T16:15:56.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.267+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdac415d2b0 con 0x7fdac40c9c40 2023-10-08T16:15:56.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.879+0000 7fdac0ff9700 1 -- 172.21.15.60:0/118368185 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdab0051930 con 0x7fdac40c9c40 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.881+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaa8066f30 msgr2=0x7fdaa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.881+0000 7fdacabca700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaa8066f30 0x7fdaa80693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdab8007fd0 tx=0x7fdab8009040 comp rx=0 tx=0).stop 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.881+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 msgr2=0x7fdac4099b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.881+0000 7fdacabca700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac4099b40 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdab000e930 tx=0x7fdab00091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 shutdown_connections 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdac406daa0 0x7fdac41590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac4159b90 0x7fdac40b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 --2- 172.21.15.60:0/118368185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac40c9c40 0x7fdac4099b40 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 >> 172.21.15.60:0/118368185 conn(0x7fdac4067660 msgr2=0x7fdac40c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 shutdown_connections 2023-10-08T16:15:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:56.882+0000 7fdacabca700 1 -- 172.21.15.60:0/118368185 wait complete. 2023-10-08T16:15:56.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:15:57.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.063+0000 7efcb3f1b700 1 Processor -- start 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.063+0000 7efcb3f1b700 1 -- start start 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.064+0000 7efcb3f1b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcac157960 0x7efcac15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.064+0000 7efcb3f1b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0cfda0 con 0x7efcac06a5c0 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.064+0000 7efcb3f1b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0ce050 con 0x7efcac0cd7d0 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.064+0000 7efcb3f1b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac0d0940 con 0x7efcac157960 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.064+0000 7efcb24b8700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efcac06a5c0 0x7efcac15b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41942/0 (socket says 172.21.15.60:41942) 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.064+0000 7efcb24b8700 1 -- 172.21.15.60:0/2772211516 learned_addr learned my addr 172.21.15.60:0/2772211516 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb1cb7700 1 --2- 172.21.15.60:0/2772211516 >> v2:172.21.15.144:3300/0 conn(0x7efcac157960 0x7efcac15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492139722 0 0) 0x7efcac0cfda0 con 0x7efcac06a5c0 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc94003570 con 0x7efcac06a5c0 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2703515495 0 0) 0x7efc94003570 con 0x7efcac06a5c0 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 >> v2:172.21.15.144:3300/0 conn(0x7efcac157960 msgr2=0x7efcac15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 --2- 172.21.15.60:0/2772211516 >> v2:172.21.15.144:3300/0 conn(0x7efcac157960 0x7efcac15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 >> v1:172.21.15.144:6789/0 conn(0x7efcac0cd7d0 legacy=0x7efcac0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac0cf4b0 con 0x7efcac06a5c0 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7efc9c0017f0 con 0x7efcac06a5c0 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 >> v1:172.21.15.60:6789/0 conn(0x7efcac06a5c0 legacy=0x7efcac15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc94003a60 0x7efc94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc94004810 0x7efc94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efc9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0d0940 con 0x7efc940051c0 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9400c0d0 con 0x7efc94003a60 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9400c290 con 0x7efc94004810 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb24b8700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efc9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb1cb7700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc94003a60 0x7efc94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb14b6700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc94004810 0x7efc94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.065+0000 7efcb24b8700 1 -- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc94004810 msgr2=0x7efc94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb24b8700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc94004810 0x7efc94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb24b8700 1 -- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc94003a60 msgr2=0x7efc94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb24b8700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc94003a60 0x7efc94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb24b8700 1 -- 172.21.15.60:0/2772211516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94003570 con 0x7efc940051c0 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb24b8700 1 -- 172.21.15.60:0/2772211516 reap_dead start 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb24b8700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efc9400ba60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00a900 tx=0x7efcac15a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c0b89d5c2f0494 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0070d0 con 0x7efc940051c0 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c007230 con 0x7efc940051c0 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb0cb5700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0075f0 con 0x7efc940051c0 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 msgr2=0x7efc9400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efc9400ba60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00a900 tx=0x7efcac15a3e0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2772211516 shutdown_connections 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efc9400ba60 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2772211516 >> 172.21.15.60:0/2772211516 conn(0x7efcac0d18a0 msgr2=0x7efcac0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.066+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2772211516 shutdown_connections 2023-10-08T16:15:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.067+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2772211516 wait complete. 2023-10-08T16:15:57.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 Processor -- start 2023-10-08T16:15:57.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 -- start start 2023-10-08T16:15:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efcac14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcac0b47f0 0x7efcac0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcac15b070 0x7efcac15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0b51a0 con 0x7efc940051c0 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac16b6a0 con 0x7efcac0b47f0 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb3f1b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac16aa90 con 0x7efcac15b070 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.068+0000 7efcb1cb7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efcac14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efcac14f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34924/0 (socket says 172.21.15.60:34924) 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 -- 172.21.15.60:0/2590573055 learned_addr learned my addr 172.21.15.60:0/2590573055 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb14b6700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcac0b47f0 0x7efcac0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb24b8700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcac15b070 0x7efcac15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 -- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcac15b070 msgr2=0x7efcac15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcac15b070 0x7efcac15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 -- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcac0b47f0 msgr2=0x7efcac0b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcac0b47f0 0x7efcac0b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac16ad70 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb1cb7700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efcac14f7b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7efca4006ac0 tx=0x7efca40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4011ec0 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca400f940 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac16b050 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca400fcc0 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.069+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcac15ba50 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.070+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac04c3c0 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.071+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efca4014650 con 0x7efc940051c0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.071+0000 7efca9ffb700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc98066f30 0x7efc980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.071+0000 7efcb14b6700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc98066f30 0x7efc980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:57.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.071+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5820+0+0 (secure 0 0 0) 0x7efca4018030 con 0x7efc940051c0 2023-10-08T16:15:57.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.072+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7efc9806eb50 con 0x7efc940051c0 2023-10-08T16:15:57.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.072+0000 7efcb14b6700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc98066f30 0x7efc980693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efcac15f280 tx=0x7efca000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:57.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.076+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efca4022060 con 0x7efc940051c0 2023-10-08T16:15:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.270+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efcac0cdd70 con 0x7efc940051c0 2023-10-08T16:15:57.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.878+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(170..170 src has 1..170) v4 ==== 288+0+0 (secure 0 0 0) 0x7efca40563e0 con 0x7efc940051c0 2023-10-08T16:15:57.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.878+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7efc9806cf80 con 0x7efc940051c0 2023-10-08T16:15:57.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.881+0000 7efca9ffb700 1 -- 172.21.15.60:0/2590573055 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v170) v1 ==== 181+0+0 (secure 0 0 0) 0x7efca4055ab0 con 0x7efc940051c0 2023-10-08T16:15:57.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc98066f30 msgr2=0x7efc980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc98066f30 0x7efc980693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efcac15f280 tx=0x7efca000c040 comp rx=0 tx=0).stop 2023-10-08T16:15:57.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 msgr2=0x7efcac14f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:57.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efcac14f7b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7efca4006ac0 tx=0x7efca40091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 shutdown_connections 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efc98066f30 0x7efc980693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcac15b070 0x7efcac15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc940051c0 0x7efcac14f7b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 --2- 172.21.15.60:0/2590573055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcac0b47f0 0x7efcac0b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 >> 172.21.15.60:0/2590573055 conn(0x7efcac0d18a0 msgr2=0x7efcac157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 shutdown_connections 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:57.888+0000 7efcb3f1b700 1 -- 172.21.15.60:0/2590573055 wait complete. 2023-10-08T16:15:57.890 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:15:57.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:15:58.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.030+0000 7fc2d1087700 1 Processor -- start 2023-10-08T16:15:58.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.030+0000 7fc2d1087700 1 -- start start 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2d1087700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2cc0b11f0 0x7fc2cc0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2d1087700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc068cb0 0x7fc2cc069130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2d1087700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc0b0d60 con 0x7fc2cc159e50 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2d1087700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc069670 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2d1087700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0b3540 con 0x7fc2cc068cb0 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2cad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc2cc159e50 0x7fc2cc0b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41948/0 (socket says 172.21.15.60:41948) 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2cad9d700 1 -- 172.21.15.60:0/3438111760 learned_addr learned my addr 172.21.15.60:0/3438111760 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2ca59c700 1 --2- 172.21.15.60:0/3438111760 >> v2:172.21.15.60:3300/0 conn(0x7fc2cc0b11f0 0x7fc2cc0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2c9d9b700 1 -- 172.21.15.60:0/3438111760 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604875828 0 0) 0x7fc2cc0b0d60 con 0x7fc2cc159e50 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.031+0000 7fc2c9d9b700 1 -- 172.21.15.60:0/3438111760 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b8003570 con 0x7fc2cc159e50 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2cb59e700 1 --2- 172.21.15.60:0/3438111760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc068cb0 0x7fc2cc069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2ca59c700 1 -- 172.21.15.60:0/3438111760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc068cb0 msgr2=0x7fc2cc069130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2ca59c700 1 --2- 172.21.15.60:0/3438111760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc068cb0 0x7fc2cc069130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2ca59c700 1 -- 172.21.15.60:0/3438111760 >> v1:172.21.15.60:6789/0 conn(0x7fc2cc159e50 legacy=0x7fc2cc0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2ca59c700 1 -- 172.21.15.60:0/3438111760 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0d15b0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2ca59c700 1 --2- 172.21.15.60:0/3438111760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc0b1660 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40098e0 tx=0x7fc2b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1810aed77e5fb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2c9d9b700 1 -- 172.21.15.60:0/3438111760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400b640 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2c9d9b700 1 -- 172.21.15.60:0/3438111760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b400b7a0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2c9d9b700 1 -- 172.21.15.60:0/3438111760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400bb40 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2d1087700 1 -- 172.21.15.60:0/3438111760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 msgr2=0x7fc2cc0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2d1087700 1 --2- 172.21.15.60:0/3438111760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc0b1660 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40098e0 tx=0x7fc2b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2d1087700 1 -- 172.21.15.60:0/3438111760 shutdown_connections 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2d1087700 1 --2- 172.21.15.60:0/3438111760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc068cb0 0x7fc2cc069130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2d1087700 1 --2- 172.21.15.60:0/3438111760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc0b1660 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.032+0000 7fc2d1087700 1 -- 172.21.15.60:0/3438111760 >> 172.21.15.60:0/3438111760 conn(0x7fc2cc068130 msgr2=0x7fc2cc0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.033+0000 7fc2d1087700 1 -- 172.21.15.60:0/3438111760 shutdown_connections 2023-10-08T16:15:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.033+0000 7fc2d1087700 1 -- 172.21.15.60:0/3438111760 wait complete. 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 Processor -- start 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 -- start start 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2cc068cb0 0x7fc2cc157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc159e50 0x7fc2cc15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc16d870 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc16e110 con 0x7fc2cc068cb0 2023-10-08T16:15:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.034+0000 7fc2d1087700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc16b0c0 con 0x7fc2cc159e50 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc15eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34942/0 (socket says 172.21.15.60:34942) 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 -- 172.21.15.60:0/1912370241 learned_addr learned my addr 172.21.15.60:0/1912370241 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2cb59e700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc159e50 0x7fc2cc15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2cad9d700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2cc068cb0 0x7fc2cc157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 -- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc159e50 msgr2=0x7fc2cc15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc159e50 0x7fc2cc15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 -- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2cc068cb0 msgr2=0x7fc2cc157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2cc068cb0 0x7fc2cc157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4009420 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2cb59e700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc159e50 0x7fc2cc15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2ca59c700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc15eda0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0d0cd0 tx=0x7fc2b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b401bda0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4011420 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc16dac0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40117e0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.035+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc158500 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.036+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc04c3c0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.037+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2b4011b90 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.037+0000 7fc2c2ffd700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc2ac066f30 0x7fc2ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.037+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc2b4085ac0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.037+0000 7fc2cad9d700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc2ac066f30 0x7fc2ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.037+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7fc2ac06dd50 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.038+0000 7fc2cad9d700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc2ac066f30 0x7fc2ac0693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc15a820 tx=0x7fc2bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.042+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2b4015060 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.234+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2cc16df60 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.405+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 7 ==== osd_map(171..171 src has 1..171) v4 ==== 696+0+0 (secure 0 0 0) 0x7fc2b4011e40 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.405+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=172}) v3 -- 0x7fc2ac06cae0 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.409+0000 7fc2c2ffd700 1 -- 172.21.15.60:0/1912370241 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v171) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2b4085e60 con 0x7fc2cc0b11f0 2023-10-08T16:15:58.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc2ac066f30 msgr2=0x7fc2ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc2ac066f30 0x7fc2ac0693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc15a820 tx=0x7fc2bc009040 comp rx=0 tx=0).stop 2023-10-08T16:15:58.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 msgr2=0x7fc2cc15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc15eda0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0d0cd0 tx=0x7fc2b4017000 comp rx=0 tx=0).stop 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 shutdown_connections 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc2ac066f30 0x7fc2ac0693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2cc159e50 0x7fc2cc15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2cc068cb0 0x7fc2cc157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 --2- 172.21.15.60:0/1912370241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2cc0b11f0 0x7fc2cc15eda0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.413+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 >> 172.21.15.60:0/1912370241 conn(0x7fc2cc068130 msgr2=0x7fc2cc0b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:58.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.414+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 shutdown_connections 2023-10-08T16:15:58.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.414+0000 7fc2d1087700 1 -- 172.21.15.60:0/1912370241 wait complete. 2023-10-08T16:15:58.417 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:15:58.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:15:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.550+0000 7fba2377c700 1 Processor -- start 2023-10-08T16:15:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.550+0000 7fba2377c700 1 -- start start 2023-10-08T16:15:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba2377c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba1c06f5a0 0x7fba1c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba2377c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c15e1a0 con 0x7fba1c0c9c10 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba2377c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c15e9a0 con 0x7fba1c0c93d0 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba2377c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c15e3e0 con 0x7fba1c06f5a0 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba21d19700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fba1c0c9c10 0x7fba1c0cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41964/0 (socket says 172.21.15.60:41964) 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba21d19700 1 -- 172.21.15.60:0/494572235 learned_addr learned my addr 172.21.15.60:0/494572235 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba21518700 1 --2- 172.21.15.60:0/494572235 >> v2:172.21.15.144:3300/0 conn(0x7fba1c06f5a0 0x7fba1c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056794818 0 0) 0x7fba14001110 con 0x7fba1c0c9c10 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.551+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba08003570 con 0x7fba1c0c9c10 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091103478 0 0) 0x7fba1c15e9a0 con 0x7fba1c0c93d0 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba14001110 con 0x7fba1c0c93d0 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031310892 0 0) 0x7fba08003570 con 0x7fba1c0c9c10 2023-10-08T16:15:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 >> v2:172.21.15.144:3300/0 conn(0x7fba1c06f5a0 msgr2=0x7fba1c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 --2- 172.21.15.60:0/494572235 >> v2:172.21.15.144:3300/0 conn(0x7fba1c06f5a0 0x7fba1c06f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 >> v1:172.21.15.144:6789/0 conn(0x7fba1c0c93d0 legacy=0x7fba1c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c15e6c0 con 0x7fba1c0c9c10 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fba14001600 con 0x7fba1c0c9c10 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 >> v1:172.21.15.60:6789/0 conn(0x7fba1c0c9c10 legacy=0x7fba1c0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba08003bf0 0x7fba08003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba080051c0 0x7fba0800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15e3e0 con 0x7fba08004810 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0800c0b0 con 0x7fba080051c0 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0800c270 con 0x7fba08003bf0 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba21518700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba08003bf0 0x7fba08003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba21d19700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba080051c0 0x7fba0800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 -- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba08003bf0 msgr2=0x7fba08003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba08003bf0 0x7fba08003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 -- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba080051c0 msgr2=0x7fba0800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba080051c0 0x7fba0800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 -- 172.21.15.60:0/494572235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08003570 con 0x7fba08004810 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba21518700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba08003bf0 0x7fba08003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba21d19700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba080051c0 0x7fba0800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba21d19700 1 -- 172.21.15.60:0/494572235 reap_dead start 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba20d17700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba08004c80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0019e0 tx=0x7fba0c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc5e514b56e66a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.552+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00c5d0 con 0x7fba08004810 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00c730 con 0x7fba08004810 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba13fff700 1 -- 172.21.15.60:0/494572235 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00cad0 con 0x7fba08004810 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 -- 172.21.15.60:0/494572235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 msgr2=0x7fba08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba08004c80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0019e0 tx=0x7fba0c007d30 comp rx=0 tx=0).stop 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 -- 172.21.15.60:0/494572235 shutdown_connections 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 --2- 172.21.15.60:0/494572235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba08004c80 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 -- 172.21.15.60:0/494572235 >> 172.21.15.60:0/494572235 conn(0x7fba1c067660 msgr2=0x7fba1c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 -- 172.21.15.60:0/494572235 shutdown_connections 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.553+0000 7fba2377c700 1 -- 172.21.15.60:0/494572235 wait complete. 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.554+0000 7fba2377c700 1 Processor -- start 2023-10-08T16:15:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.554+0000 7fba2377c700 1 -- start start 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba2377c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba1c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba2377c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba1c0aeef0 0x7fba1c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba2377c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c0b1370 0x7fba1c0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba2377c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0cc680 con 0x7fba08004810 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba2377c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c098b00 con 0x7fba1c0b1370 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba2377c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0af8a0 con 0x7fba1c0aeef0 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba21518700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba1c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba21518700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba1c147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34952/0 (socket says 172.21.15.60:34952) 2023-10-08T16:15:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.555+0000 7fba21518700 1 -- 172.21.15.60:0/328615474 learned_addr learned my addr 172.21.15.60:0/328615474 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba20d17700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba1c0aeef0 0x7fba1c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21d19700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c0b1370 0x7fba1c0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21518700 1 -- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba1c0aeef0 msgr2=0x7fba1c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21518700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba1c0aeef0 0x7fba1c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21518700 1 -- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c0b1370 msgr2=0x7fba1c0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21518700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c0b1370 0x7fba1c0b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21518700 1 -- 172.21.15.60:0/328615474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0b2110 con 0x7fba08004810 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba20d17700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba1c0aeef0 0x7fba1c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21d19700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c0b1370 0x7fba1c0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba21518700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba1c147750 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fba180101c0 tx=0x7fba1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800e050 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800f040 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18015440 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c0b23f0 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.556+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c0b29b0 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.557+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c04c3c0 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.557+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba18003020 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.558+0000 7fba117fa700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba00066f30 0x7fba000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.558+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fba18084bd0 con 0x7fba08004810 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.558+0000 7fba20d17700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba00066f30 0x7fba000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.558+0000 7fba20d17700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba00066f30 0x7fba000693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0c8910 tx=0x7fba0c015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.562+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba18052140 con 0x7fba08004810 2023-10-08T16:15:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.755+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fba1c063d70 con 0x7fba08004810 2023-10-08T16:15:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.758+0000 7fba117fa700 1 -- 172.21.15.60:0/328615474 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fba18055760 con 0x7fba08004810 2023-10-08T16:15:58.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba00066f30 msgr2=0x7fba000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba00066f30 0x7fba000693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0c8910 tx=0x7fba0c015000 comp rx=0 tx=0).stop 2023-10-08T16:15:58.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 msgr2=0x7fba1c147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba1c147750 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fba180101c0 tx=0x7fba1800b040 comp rx=0 tx=0).stop 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 shutdown_connections 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba00066f30 0x7fba000693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c0b1370 0x7fba1c0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba08004810 0x7fba1c147750 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 --2- 172.21.15.60:0/328615474 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba1c0aeef0 0x7fba1c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 >> 172.21.15.60:0/328615474 conn(0x7fba1c067660 msgr2=0x7fba1c063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 shutdown_connections 2023-10-08T16:15:58.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.761+0000 7fba2377c700 1 -- 172.21.15.60:0/328615474 wait complete. 2023-10-08T16:15:58.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-08T16:15:58.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.892+0000 7f8676289700 1 Processor -- start 2023-10-08T16:15:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.892+0000 7f8676289700 1 -- start start 2023-10-08T16:15:58.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8676289700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8670159f10 0x7f86700c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8676289700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f867015a2e0 0x7f86700cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8676289700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700ae320 con 0x7f86700cc240 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8676289700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867015a760 con 0x7f867015a2e0 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8676289700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86700ad710 con 0x7f8670159f10 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8674a86700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f867015a2e0 0x7f86700cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8675a88700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f86700cc240 0x7f86700ae7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41966/0 (socket says 172.21.15.60:41966) 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.893+0000 7f8675a88700 1 -- 172.21.15.60:0/2577381541 learned_addr learned my addr 172.21.15.60:0/2577381541 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f8675287700 1 --2- 172.21.15.60:0/2577381541 >> v2:172.21.15.144:3300/0 conn(0x7f8670159f10 0x7f86700c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f8674a86700 1 -- 172.21.15.60:0/2577381541 >> v2:172.21.15.144:3300/0 conn(0x7f8670159f10 msgr2=0x7f86700c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f8674a86700 1 --2- 172.21.15.60:0/2577381541 >> v2:172.21.15.144:3300/0 conn(0x7f8670159f10 0x7f86700c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f8674a86700 1 -- 172.21.15.60:0/2577381541 >> v1:172.21.15.60:6789/0 conn(0x7f86700cc240 legacy=0x7f86700ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f866ffff700 1 -- 172.21.15.60:0/2577381541 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580140039 0 0) 0x7f86700ae320 con 0x7f86700cc240 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f8674a86700 1 -- 172.21.15.60:0/2577381541 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700ad9f0 con 0x7f867015a2e0 2023-10-08T16:15:58.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f8674a86700 1 --2- 172.21.15.60:0/2577381541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f867015a2e0 0x7f86700cbd00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f867008b3c0 tx=0x7f86640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c091a6f432a17bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f866ffff700 1 -- 172.21.15.60:0/2577381541 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400b6b0 con 0x7f867015a2e0 2023-10-08T16:15:58.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f866ffff700 1 -- 172.21.15.60:0/2577381541 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866400b810 con 0x7f867015a2e0 2023-10-08T16:15:58.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.894+0000 7f866ffff700 1 -- 172.21.15.60:0/2577381541 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400bbb0 con 0x7f867015a2e0 2023-10-08T16:15:58.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 -- 172.21.15.60:0/2577381541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f867015a2e0 msgr2=0x7f86700cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 --2- 172.21.15.60:0/2577381541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f867015a2e0 0x7f86700cbd00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f867008b3c0 tx=0x7f86640091a0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 -- 172.21.15.60:0/2577381541 shutdown_connections 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 --2- 172.21.15.60:0/2577381541 >> v2:172.21.15.144:3300/0 conn(0x7f8670159f10 0x7f86700c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 --2- 172.21.15.60:0/2577381541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f867015a2e0 0x7f86700cbd00 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 -- 172.21.15.60:0/2577381541 >> 172.21.15.60:0/2577381541 conn(0x7f8670067e40 msgr2=0x7f86700d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 -- 172.21.15.60:0/2577381541 shutdown_connections 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.895+0000 7f8676289700 1 -- 172.21.15.60:0/2577381541 wait complete. 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.896+0000 7f8676289700 1 Processor -- start 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.896+0000 7f8676289700 1 -- start start 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8676289700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86700cc240 0x7f86700c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8676289700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 0x7f8670154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8676289700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f867015a2e0 0x7f86700b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8676289700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700c8f90 con 0x7f8670159f10 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8676289700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670155cd0 con 0x7f86700cc240 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8676289700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86701552c0 con 0x7f867015a2e0 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 0x7f8670154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 0x7f8670154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34964/0 (socket says 172.21.15.60:34964) 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 -- 172.21.15.60:0/4016031603 learned_addr learned my addr 172.21.15.60:0/4016031603 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8675287700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86700cc240 0x7f86700c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8675a88700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f867015a2e0 0x7f86700b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 -- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f867015a2e0 msgr2=0x7f86700b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f867015a2e0 0x7f86700b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 -- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86700cc240 msgr2=0x7f86700c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:58.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86700cc240 0x7f86700c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 -- 172.21.15.60:0/4016031603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009420 con 0x7f8670159f10 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8675287700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86700cc240 0x7f86700c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f8674a86700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 0x7f8670154d80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f866400b0e0 tx=0x7f8664017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400bb90 con 0x7f8670159f10 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.897+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8664011420 con 0x7f8670159f10 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.898+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86700c8380 con 0x7f8670159f10 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.898+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640117a0 con 0x7f8670159f10 2023-10-08T16:15:58.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.898+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86700c8940 con 0x7f8670159f10 2023-10-08T16:15:58.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.899+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8670089300 con 0x7f8670159f10 2023-10-08T16:15:58.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.899+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8664011b90 con 0x7f8670159f10 2023-10-08T16:15:58.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.899+0000 7f866d7fa700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f865c066f30 0x7f865c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:15:58.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.899+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8664085b70 con 0x7f8670159f10 2023-10-08T16:15:58.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.899+0000 7f8675287700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f865c066f30 0x7f865c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:15:58.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.900+0000 7f8675287700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f865c066f30 0x7f865c0693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8660007540 tx=0x7f866000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:15:58.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:58.904+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86640530e0 con 0x7f8670159f10 2023-10-08T16:15:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.173+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f86700adcd0 con 0x7f8670159f10 2023-10-08T16:15:59.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.889+0000 7f866d7fa700 1 -- 172.21.15.60:0/4016031603 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v513) v1 ==== 131+0+0 (secure 0 0 0) 0x7f86640150c0 con 0x7f8670159f10 2023-10-08T16:15:59.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f865c066f30 msgr2=0x7f865c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:59.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f865c066f30 0x7f865c0693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8660007540 tx=0x7f866000b040 comp rx=0 tx=0).stop 2023-10-08T16:15:59.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 msgr2=0x7f8670154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 0x7f8670154d80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f866400b0e0 tx=0x7f8664017000 comp rx=0 tx=0).stop 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 shutdown_connections 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f865c066f30 0x7f865c0693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f867015a2e0 0x7f86700b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86700cc240 0x7f86700c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 --2- 172.21.15.60:0/4016031603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8670159f10 0x7f8670154d80 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 >> 172.21.15.60:0/4016031603 conn(0x7f8670067e40 msgr2=0x7f8670068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 shutdown_connections 2023-10-08T16:15:59.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:15:59.892+0000 7f8676289700 1 -- 172.21.15.60:0/4016031603 wait complete. 2023-10-08T16:15:59.908 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-08T16:15:59.908 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-08T16:15:59.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-08T16:16:00.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.034+0000 7f95a9803700 1 Processor -- start 2023-10-08T16:16:00.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.034+0000 7f95a9803700 1 -- start start 2023-10-08T16:16:00.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.034+0000 7f95a9803700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 0x7f95a40b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.034+0000 7f95a9803700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a409acf0 con 0x7f95a40b1610 2023-10-08T16:16:00.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a9803700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a415d9a0 con 0x7f95a40b2190 2023-10-08T16:16:00.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a9803700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40b4b20 con 0x7f95a415d5d0 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a27fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f95a40b1610 0x7f95a40b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41970/0 (socket says 172.21.15.60:41970) 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a27fc700 1 -- 172.21.15.60:0/1234624645 learned_addr learned my addr 172.21.15.60:0/1234624645 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710404120 0 0) 0x7f95a409acf0 con 0x7f95a40b1610 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a2ffd700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 0x7f95a40b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f958c003570 con 0x7f95a40b1610 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994834082 0 0) 0x7f958c003570 con 0x7f95a40b1610 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 msgr2=0x7f95a40b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 0x7f95a40b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 >> v1:172.21.15.144:6789/0 conn(0x7f95a40b2190 legacy=0x7f95a409b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40b4e00 con 0x7f95a40b1610 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f9598001470 con 0x7f95a40b1610 2023-10-08T16:16:00.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 >> v1:172.21.15.60:6789/0 conn(0x7f95a40b1610 legacy=0x7f95a40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 0x7f958c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f958c0040c0 0x7f958c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f958c004da0 0x7f958c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40b4b20 con 0x7f958c0040c0 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c00bc70 con 0x7f958c004da0 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c00be30 con 0x7f95a415d5d0 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.035+0000 7f95a27fc700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f958c0040c0 0x7f958c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a2ffd700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 0x7f958c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a37fe700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f958c004da0 0x7f958c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a27fc700 1 -- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 msgr2=0x7f958c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a27fc700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a415d5d0 0x7f958c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a27fc700 1 -- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f958c004da0 msgr2=0x7f958c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a27fc700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f958c004da0 0x7f958c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a27fc700 1 -- 172.21.15.60:0/1234624645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c003570 con 0x7f958c0040c0 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a27fc700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f958c0040c0 0x7f958c004810 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f959800c3c0 tx=0x7f9598001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadceff332aa15d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800cc90 con 0x7f958c0040c0 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800ce10 con 0x7f958c0040c0 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.036+0000 7f95a1ffb700 1 -- 172.21.15.60:0/1234624645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598005b70 con 0x7f958c0040c0 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a9803700 1 -- 172.21.15.60:0/1234624645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f958c0040c0 msgr2=0x7f958c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a9803700 1 --2- 172.21.15.60:0/1234624645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f958c0040c0 0x7f958c004810 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f959800c3c0 tx=0x7f9598001e50 comp rx=0 tx=0).stop 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a37fe700 1 -- 172.21.15.60:0/1234624645 reap_dead start 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a9803700 1 -- 172.21.15.60:0/1234624645 shutdown_connections 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a9803700 1 -- 172.21.15.60:0/1234624645 >> 172.21.15.60:0/1234624645 conn(0x7f95a4067e40 msgr2=0x7f95a40d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a9803700 1 -- 172.21.15.60:0/1234624645 shutdown_connections 2023-10-08T16:16:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.037+0000 7f95a9803700 1 -- 172.21.15.60:0/1234624645 wait complete. 2023-10-08T16:16:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.038+0000 7f95a9803700 1 Processor -- start 2023-10-08T16:16:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.038+0000 7f95a9803700 1 -- start start 2023-10-08T16:16:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f958c0040c0 0x7f95a4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a409cd90 0x7f95a415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 0x7f95a415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40abe90 con 0x7f95a409d200 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a409d700 con 0x7f95a409cd90 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a409d9e0 con 0x7f958c0040c0 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 0x7f95a415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 0x7f95a415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34984/0 (socket says 172.21.15.60:34984) 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 -- 172.21.15.60:0/4074049015 learned_addr learned my addr 172.21.15.60:0/4074049015 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a2ffd700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f958c0040c0 0x7f95a4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a27fc700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a409cd90 0x7f95a415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 -- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f958c0040c0 msgr2=0x7f95a4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f958c0040c0 0x7f95a4156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 -- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a409cd90 msgr2=0x7f95a415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a409cd90 0x7f95a415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 -- 172.21.15.60:0/4074049015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a409dcc0 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a37fe700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 0x7f95a415b0a0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f95a4089fa0 tx=0x7f959c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c018070 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c00ee70 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a4156e70 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c006dd0 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.039+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a40b0070 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.040+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40abc60 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.041+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f959c00c9c0 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.041+0000 7f958affd700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9590066f30 0x7f95900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.041+0000 7f95a2ffd700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9590066f30 0x7f95900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.041+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f959c083f00 con 0x7f95a409d200 2023-10-08T16:16:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.042+0000 7f95a2ffd700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9590066f30 0x7f95900693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f95a416d8e0 tx=0x7f9594008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.045+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95a40abc60 con 0x7f95a409d200 2023-10-08T16:16:00.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.316+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f95a40abc30 con 0x7f95a409d200 2023-10-08T16:16:00.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.891+0000 7f958affd700 1 -- 172.21.15.60:0/4074049015 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v514) v1 ==== 138+0+0 (secure 0 0 0) 0x7f959c051470 con 0x7f95a409d200 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.893+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9590066f30 msgr2=0x7f95900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.893+0000 7f95a9803700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9590066f30 0x7f95900693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f95a416d8e0 tx=0x7f9594008040 comp rx=0 tx=0).stop 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.893+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 msgr2=0x7f95a415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.893+0000 7f95a9803700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 0x7f95a415b0a0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f95a4089fa0 tx=0x7f959c001640 comp rx=0 tx=0).stop 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 shutdown_connections 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9590066f30 0x7f95900693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f958c0040c0 0x7f95a4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a409d200 0x7f95a415b0a0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 --2- 172.21.15.60:0/4074049015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a409cd90 0x7f95a415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 >> 172.21.15.60:0/4074049015 conn(0x7f95a4067e40 msgr2=0x7f95a415c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 shutdown_connections 2023-10-08T16:16:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:00.894+0000 7f95a9803700 1 -- 172.21.15.60:0/4074049015 wait complete. 2023-10-08T16:16:00.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:16:01.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.033+0000 7fe88f3ea700 1 Processor -- start 2023-10-08T16:16:01.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.033+0000 7fe88f3ea700 1 -- start start 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88f3ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 0x7fe88815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88f3ea700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8880b14f0 con 0x7fe8880b4860 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88f3ea700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8880b17d0 con 0x7fe8880b4c30 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88f3ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880b1ab0 con 0x7fe8880b3570 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88d186700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe8880b4860 0x7fe888159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41984/0 (socket says 172.21.15.60:41984) 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88d186700 1 -- 172.21.15.60:0/2475167719 learned_addr learned my addr 172.21.15.60:0/2475167719 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe88c985700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 0x7fe88815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499120741 0 0) 0x7fe8880b14f0 con 0x7fe8880b4860 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe874003570 con 0x7fe8880b4860 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356868707 0 0) 0x7fe8880b17d0 con 0x7fe8880b4c30 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8880b14f0 con 0x7fe8880b4c30 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3160943678 0 0) 0x7fe874003570 con 0x7fe8880b4860 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 msgr2=0x7fe88815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 0x7fe88815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 >> v1:172.21.15.144:6789/0 conn(0x7fe8880b4c30 legacy=0x7fe8880cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880b1d90 con 0x7fe8880b4860 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.034+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fe884001970 con 0x7fe8880b4860 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 >> v1:172.21.15.60:6789/0 conn(0x7fe8880b4860 legacy=0x7fe888159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 0x7fe874003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740041d0 0x7fe874004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe874004d50 0x7fe8740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880b1ab0 con 0x7fe8740041d0 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87400bbf0 con 0x7fe874004d50 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87400bdb0 con 0x7fe8880b3570 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740041d0 0x7fe874004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88d186700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 0x7fe874003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88d987700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe874004d50 0x7fe8740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 -- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 msgr2=0x7fe874003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8880b3570 0x7fe874003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 -- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe874004d50 msgr2=0x7fe8740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe874004d50 0x7fe8740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 -- 172.21.15.60:0/2475167719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874003570 con 0x7fe8740041d0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe88c985700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740041d0 0x7fe874004810 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe878009c00 tx=0x7fe8780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947439efe340f332 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800e710 con 0x7fe8740041d0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800e870 con 0x7fe8740041d0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.035+0000 7fe87ffff700 1 -- 172.21.15.60:0/2475167719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800ec30 con 0x7fe8740041d0 2023-10-08T16:16:01.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88f3ea700 1 -- 172.21.15.60:0/2475167719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740041d0 msgr2=0x7fe874004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/2475167719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740041d0 0x7fe874004810 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe878009c00 tx=0x7fe8780091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88d987700 1 -- 172.21.15.60:0/2475167719 reap_dead start 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88f3ea700 1 -- 172.21.15.60:0/2475167719 shutdown_connections 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88f3ea700 1 -- 172.21.15.60:0/2475167719 >> 172.21.15.60:0/2475167719 conn(0x7fe88809a0f0 msgr2=0x7fe888067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88f3ea700 1 -- 172.21.15.60:0/2475167719 shutdown_connections 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.036+0000 7fe88f3ea700 1 -- 172.21.15.60:0/2475167719 wait complete. 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.037+0000 7fe88f3ea700 1 Processor -- start 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.037+0000 7fe88f3ea700 1 -- start start 2023-10-08T16:16:01.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88f3ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8740041d0 0x7fe888159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88f3ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 0x7fe888154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88f3ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888158200 0x7fe888154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88f3ea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8881520e0 con 0x7fe888157d90 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88f3ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88816a010 con 0x7fe888158200 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88f3ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8881514d0 con 0x7fe8740041d0 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 0x7fe888154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 0x7fe888154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34998/0 (socket says 172.21.15.60:34998) 2023-10-08T16:16:01.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 -- 172.21.15.60:0/1148741630 learned_addr learned my addr 172.21.15.60:0/1148741630 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88d987700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888158200 0x7fe888154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88d186700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8740041d0 0x7fe888159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 -- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8740041d0 msgr2=0x7fe888159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8740041d0 0x7fe888159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 -- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888158200 msgr2=0x7fe888154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.038+0000 7fe88c985700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888158200 0x7fe888154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe88c985700 1 -- 172.21.15.60:0/1148741630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8881517b0 con 0x7fe888157d90 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe88d987700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888158200 0x7fe888154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe88c985700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 0x7fe888154a60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe8740057f0 tx=0x7fe87801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878022070 con 0x7fe888157d90 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800ebf0 con 0x7fe888157d90 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe888151a90 con 0x7fe888157d90 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87801c6a0 con 0x7fe888157d90 2023-10-08T16:16:01.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.039+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe888159970 con 0x7fe888157d90 2023-10-08T16:16:01.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.040+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe888151f30 con 0x7fe888157d90 2023-10-08T16:16:01.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.040+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe87801ca50 con 0x7fe888157d90 2023-10-08T16:16:01.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.041+0000 7fe87d7fa700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe86c066f60 0x7fe86c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.041+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe8780859a0 con 0x7fe888157d90 2023-10-08T16:16:01.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.041+0000 7fe88d186700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe86c066f60 0x7fe86c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.041+0000 7fe88d186700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe86c066f60 0x7fe86c069410 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe884001190 tx=0x7fe884009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.045+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe878052f10 con 0x7fe888157d90 2023-10-08T16:16:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.239+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe88816a1d0 con 0x7fe888157d90 2023-10-08T16:16:01.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.242+0000 7fe87d7fa700 1 -- 172.21.15.60:0/1148741630 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe87802b0c0 con 0x7fe888157d90 2023-10-08T16:16:01.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.244+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe86c066f60 msgr2=0x7fe86c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.244+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe86c066f60 0x7fe86c069410 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe884001190 tx=0x7fe884009040 comp rx=0 tx=0).stop 2023-10-08T16:16:01.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.244+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 msgr2=0x7fe888154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.244+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 0x7fe888154a60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe8740057f0 tx=0x7fe87801a000 comp rx=0 tx=0).stop 2023-10-08T16:16:01.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 shutdown_connections 2023-10-08T16:16:01.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe86c066f60 0x7fe86c069410 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8740041d0 0x7fe888159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888158200 0x7fe888154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 --2- 172.21.15.60:0/1148741630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe888157d90 0x7fe888154a60 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 >> 172.21.15.60:0/1148741630 conn(0x7fe88809a0f0 msgr2=0x7fe88815ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:01.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 shutdown_connections 2023-10-08T16:16:01.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.245+0000 7fe88f3ea700 1 -- 172.21.15.60:0/1148741630 wait complete. 2023-10-08T16:16:01.258 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:16:01.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:16:01.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:16:01.341 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:16:01.341 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:16:01.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:01.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.459+0000 7fc0a8d32700 1 Processor -- start 2023-10-08T16:16:01.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.459+0000 7fc0a8d32700 1 -- start start 2023-10-08T16:16:01.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a8d32700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc0a40b0890 0x7fc0a40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a8d32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a4159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a8d32700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40cb370 con 0x7fc0a40cbd40 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a8d32700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40b0c60 con 0x7fc0a40b0890 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a8d32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a406a1e0 con 0x7fc0a4067d70 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a1d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0a40cbd40 0x7fc0a4067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41986/0 (socket says 172.21.15.60:41986) 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a1d9b700 1 -- 172.21.15.60:0/1839465484 learned_addr learned my addr 172.21.15.60:0/1839465484 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a259c700 1 --2- 172.21.15.60:0/1839465484 >> v2:172.21.15.144:3300/0 conn(0x7fc0a40b0890 0x7fc0a40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a2d9d700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a4159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a159a700 1 -- 172.21.15.60:0/1839465484 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938413310 0 0) 0x7fc0a40cb370 con 0x7fc0a40cbd40 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a159a700 1 -- 172.21.15.60:0/1839465484 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc08c003570 con 0x7fc0a40cbd40 2023-10-08T16:16:01.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a259c700 1 -- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 msgr2=0x7fc0a4159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a259c700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a4159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a159a700 1 -- 172.21.15.60:0/1839465484 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283818939 0 0) 0x7fc08c003570 con 0x7fc0a40cbd40 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a259c700 1 -- 172.21.15.60:0/1839465484 >> v1:172.21.15.60:6789/0 conn(0x7fc0a40cbd40 legacy=0x7fc0a4067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a259c700 1 -- 172.21.15.60:0/1839465484 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a406cb80 con 0x7fc0a40b0890 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.460+0000 7fc0a2d9d700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a4159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a259c700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40b0890 0x7fc0a40cb800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0940098e0 tx=0x7fc0940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3ba212f72df8b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a159a700 1 -- 172.21.15.60:0/1839465484 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098001470 con 0x7fc0a40b0890 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a159a700 1 -- 172.21.15.60:0/1839465484 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094011420 con 0x7fc0a40b0890 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a159a700 1 -- 172.21.15.60:0/1839465484 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940117c0 con 0x7fc0a40b0890 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 -- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40b0890 msgr2=0x7fc0a40cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40b0890 0x7fc0a40cb800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0940098e0 tx=0x7fc0940091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 -- 172.21.15.60:0/1839465484 shutdown_connections 2023-10-08T16:16:01.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a4159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/1839465484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40b0890 0x7fc0a40cb800 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 -- 172.21.15.60:0/1839465484 >> 172.21.15.60:0/1839465484 conn(0x7fc0a406fe50 msgr2=0x7fc0a4069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:01.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 -- 172.21.15.60:0/1839465484 shutdown_connections 2023-10-08T16:16:01.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.461+0000 7fc0a8d32700 1 -- 172.21.15.60:0/1839465484 wait complete. 2023-10-08T16:16:01.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 Processor -- start 2023-10-08T16:16:01.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 -- start start 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a416b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 0x7fc0a415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40cbd40 0x7fc0a40c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c3700 con 0x7fc0a40b0890 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c3950 con 0x7fc0a40cbd40 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a8d32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c3c30 con 0x7fc0a4067d70 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 0x7fc0a415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 0x7fc0a415a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35012/0 (socket says 172.21.15.60:35012) 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.463+0000 7fc0a1d9b700 1 -- 172.21.15.60:0/2037655785 learned_addr learned my addr 172.21.15.60:0/2037655785 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:01.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a2d9d700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40cbd40 0x7fc0a40c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a259c700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a416b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a1d9b700 1 -- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 msgr2=0x7fc0a416b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a1d9b700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a416b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a1d9b700 1 -- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40cbd40 msgr2=0x7fc0a40c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a1d9b700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40cbd40 0x7fc0a40c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a1d9b700 1 -- 172.21.15.60:0/2037655785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009a20 con 0x7fc0a40b0890 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a1d9b700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 0x7fc0a415a330 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc09800cb90 tx=0x7fc098001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098007360 con 0x7fc0a40b0890 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980074e0 con 0x7fc0a40b0890 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094009420 con 0x7fc0a40b0890 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098004830 con 0x7fc0a40b0890 2023-10-08T16:16:01.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.464+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a40c41f0 con 0x7fc0a40b0890 2023-10-08T16:16:01.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.465+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a404c3c0 con 0x7fc0a40b0890 2023-10-08T16:16:01.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.466+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc098004bc0 con 0x7fc0a40b0890 2023-10-08T16:16:01.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.466+0000 7fc0927fc700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc084066f30 0x7fc0840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.466+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc0980839c0 con 0x7fc0a40b0890 2023-10-08T16:16:01.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.466+0000 7fc0a259c700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc084066f30 0x7fc0840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.467+0000 7fc0a259c700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc084066f30 0x7fc0840693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc0940093f0 tx=0x7fc094016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.470+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc098051070 con 0x7fc0a40b0890 2023-10-08T16:16:01.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.707+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0a40cde90 con 0x7fc0a40b0890 2023-10-08T16:16:01.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.708+0000 7fc0927fc700 1 -- 172.21.15.60:0/2037655785 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fc098018020 con 0x7fc0a40b0890 2023-10-08T16:16:01.709 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:01.709 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6362,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1394654587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1394654587},{"type":"v1","addr":"172.21.15.144:6834","nonce":1394654587}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3249533584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":3249533584},{"type":"v1","addr":"172.21.15.144:6835","nonce":3249533584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3646826060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3646826060},{"type":"v1","addr":"172.21.15.60:6836","nonce":3646826060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2529778644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2529778644},{"type":"v1","addr":"172.21.15.60:6837","nonce":2529778644}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-10-08T16:16:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc084066f30 msgr2=0x7fc0840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc084066f30 0x7fc0840693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc0940093f0 tx=0x7fc094016000 comp rx=0 tx=0).stop 2023-10-08T16:16:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 msgr2=0x7fc0a415a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 0x7fc0a415a330 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc09800cb90 tx=0x7fc098001b50 comp rx=0 tx=0).stop 2023-10-08T16:16:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 shutdown_connections 2023-10-08T16:16:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc084066f30 0x7fc0840693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0a4067d70 0x7fc0a416b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a40cbd40 0x7fc0a40c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 --2- 172.21.15.60:0/2037655785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a40b0890 0x7fc0a415a330 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 >> 172.21.15.60:0/2037655785 conn(0x7fc0a406fe50 msgr2=0x7fc0a40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 shutdown_connections 2023-10-08T16:16:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.710+0000 7fc0a8d32700 1 -- 172.21.15.60:0/2037655785 wait complete. 2023-10-08T16:16:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 87 2023-10-08T16:16:01.723 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:16:01.724 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:16:01.724 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:16:01.724 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:16:01.724 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:16:01.724 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:16:01.725 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:16:01.725 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:16:01.725 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:16:01.725 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:16:01.726 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:16:01.726 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:16:01.726 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:16:01.726 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:16:01.727 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:16:01.727 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:16:01.733 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:16:01.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:16:01.735 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:16:01.735 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:16:01.736 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:16:01.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:16:01.737 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:16:01.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:16:01.777 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:16:01.777 DEBUG:teuthology.parallel:result is None 2023-10-08T16:16:01.778 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:16:01.778 DEBUG:teuthology.parallel:result is None 2023-10-08T16:16:01.781 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:16:01.781 DEBUG:teuthology.parallel:result is None 2023-10-08T16:16:01.782 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:16:01.782 DEBUG:teuthology.parallel:result is None 2023-10-08T16:16:01.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:16:01.852 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-08T16:16:01.853 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-08T16:16:01.860 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-08T16:16:01.860 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:16:01.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.908+0000 7fe92afcf700 1 Processor -- start 2023-10-08T16:16:01.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.908+0000 7fe92afcf700 1 -- start start 2023-10-08T16:16:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe92afcf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9240d1160 0x7fe9240cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe92afcf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241579c0 0x7fe92415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe92afcf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9240d0540 con 0x7fe9241575f0 2023-10-08T16:16:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe92afcf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9240697b0 con 0x7fe9240d1160 2023-10-08T16:16:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe92afcf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92415b240 con 0x7fe9241579c0 2023-10-08T16:16:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe929fcd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9241575f0 0x7fe9240d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41990/0 (socket says 172.21.15.60:41990) 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe929fcd700 1 -- 172.21.15.60:0/2637873256 learned_addr learned my addr 172.21.15.60:0/2637873256 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe9297cc700 1 --2- 172.21.15.60:0/2637873256 >> v2:172.21.15.144:3300/0 conn(0x7fe9240d1160 0x7fe9240cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.909+0000 7fe92a7ce700 1 --2- 172.21.15.60:0/2637873256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241579c0 0x7fe92415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe928fcb700 1 -- 172.21.15.60:0/2637873256 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614655051 0 0) 0x7fe9240d0540 con 0x7fe9241575f0 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe928fcb700 1 -- 172.21.15.60:0/2637873256 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe910003570 con 0x7fe9241575f0 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2637873256 >> v2:172.21.15.144:3300/0 conn(0x7fe9240d1160 msgr2=0x7fe9240cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe92a7ce700 1 --2- 172.21.15.60:0/2637873256 >> v2:172.21.15.144:3300/0 conn(0x7fe9240d1160 0x7fe9240cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2637873256 >> v1:172.21.15.60:6789/0 conn(0x7fe9241575f0 legacy=0x7fe9240d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2637873256 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240cf930 con 0x7fe9241579c0 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe9297cc700 1 --2- 172.21.15.60:0/2637873256 >> v2:172.21.15.144:3300/0 conn(0x7fe9240d1160 0x7fe9240cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe92a7ce700 1 --2- 172.21.15.60:0/2637873256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241579c0 0x7fe92415ad00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009e60 tx=0x7fe91c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a4f79058624d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe928fcb700 1 -- 172.21.15.60:0/2637873256 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00e070 con 0x7fe9241579c0 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe928fcb700 1 -- 172.21.15.60:0/2637873256 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00bab0 con 0x7fe9241579c0 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.910+0000 7fe928fcb700 1 -- 172.21.15.60:0/2637873256 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00be70 con 0x7fe9241579c0 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 -- 172.21.15.60:0/2637873256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241579c0 msgr2=0x7fe92415ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2637873256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241579c0 0x7fe92415ad00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009e60 tx=0x7fe91c009780 comp rx=0 tx=0).stop 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 -- 172.21.15.60:0/2637873256 shutdown_connections 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2637873256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241579c0 0x7fe92415ad00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2637873256 >> v2:172.21.15.144:3300/0 conn(0x7fe9240d1160 0x7fe9240cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 -- 172.21.15.60:0/2637873256 >> 172.21.15.60:0/2637873256 conn(0x7fe924068130 msgr2=0x7fe924068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 -- 172.21.15.60:0/2637873256 shutdown_connections 2023-10-08T16:16:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.911+0000 7fe92afcf700 1 -- 172.21.15.60:0/2637873256 wait complete. 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.912+0000 7fe92afcf700 1 Processor -- start 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.912+0000 7fe92afcf700 1 -- start start 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92afcf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9240d1160 0x7fe9240ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92afcf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241575f0 0x7fe924143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92afcf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 0x7fe9240cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92afcf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240cdb70 con 0x7fe9241579c0 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92afcf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe924143dc0 con 0x7fe9240d1160 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92afcf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240ccc90 con 0x7fe9241575f0 2023-10-08T16:16:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 0x7fe9240cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 0x7fe9240cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35052/0 (socket says 172.21.15.60:35052) 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2315865093 learned_addr learned my addr 172.21.15.60:0/2315865093 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe929fcd700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9240d1160 0x7fe9240ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe9297cc700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241575f0 0x7fe924143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241575f0 msgr2=0x7fe924143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241575f0 0x7fe924143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9240d1160 msgr2=0x7fe9240ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9240d1160 0x7fe9240ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 -- 172.21.15.60:0/2315865093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920009420 con 0x7fe9241579c0 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.913+0000 7fe92a7ce700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 0x7fe9240cc750 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fe92415b380 tx=0x7fe91c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.914+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c012e10 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.914+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c027470 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.914+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c009a20 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.914+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c027830 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.914+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9240cd240 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.915+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9240891c0 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.915+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe91c024070 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.915+0000 7fe919ffb700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.916+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe91c086c90 con 0x7fe9241579c0 2023-10-08T16:16:01.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.916+0000 7fe929fcd700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:01.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.916+0000 7fe929fcd700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe914007fd0 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:01.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:01.920+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe91c054200 con 0x7fe9241579c0 2023-10-08T16:16:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.127+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe9240b6a90 con 0x7fe9241579c0 2023-10-08T16:16:02.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.913+0000 7fe919ffb700 1 -- 172.21.15.60:0/2315865093 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v176) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe91c057820 con 0x7fe9241579c0 2023-10-08T16:16:02.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 msgr2=0x7fe9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:02.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe914007fd0 tx=0x7fe914009040 comp rx=0 tx=0).stop 2023-10-08T16:16:02.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 msgr2=0x7fe9240cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 0x7fe9240cc750 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fe92415b380 tx=0x7fe91c019000 comp rx=0 tx=0).stop 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 shutdown_connections 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9241579c0 0x7fe9240cc750 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9240d1160 0x7fe9240ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 --2- 172.21.15.60:0/2315865093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9241575f0 0x7fe924143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 >> 172.21.15.60:0/2315865093 conn(0x7fe924068130 msgr2=0x7fe9241594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 shutdown_connections 2023-10-08T16:16:02.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:02.916+0000 7fe92afcf700 1 -- 172.21.15.60:0/2315865093 wait complete. 2023-10-08T16:16:02.919 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-08T16:16:02.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:16:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.053+0000 7fe48fe3d700 1 Processor -- start 2023-10-08T16:16:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.054+0000 7fe48fe3d700 1 -- start start 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.054+0000 7fe48fe3d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe4880cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.054+0000 7fe48fe3d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48815c360 con 0x7fe48806ac30 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.054+0000 7fe48fe3d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48815b790 con 0x7fe488157ba0 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.054+0000 7fe48fe3d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48815ba30 con 0x7fe4881577d0 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48e3da700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe48806ac30 0x7fe48815c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39940/0 (socket says 172.21.15.60:39940) 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48e3da700 1 -- 172.21.15.60:0/2890334994 learned_addr learned my addr 172.21.15.60:0/2890334994 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48dbd9700 1 --2- 172.21.15.60:0/2890334994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe4880cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698141047 0 0) 0x7fe48815c360 con 0x7fe48806ac30 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe474003570 con 0x7fe48806ac30 2023-10-08T16:16:03.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356592898 0 0) 0x7fe48815b790 con 0x7fe488157ba0 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe48815c360 con 0x7fe488157ba0 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417285002 0 0) 0x7fe474003570 con 0x7fe48806ac30 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48dbd9700 1 -- 172.21.15.60:0/2890334994 >> v1:172.21.15.144:6789/0 conn(0x7fe488157ba0 legacy=0x7fe48806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48dbd9700 1 -- 172.21.15.60:0/2890334994 >> v1:172.21.15.60:6789/0 conn(0x7fe48806ac30 legacy=0x7fe48815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48dbd9700 1 -- 172.21.15.60:0/2890334994 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48815bd10 con 0x7fe4881577d0 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.055+0000 7fe48dbd9700 1 --2- 172.21.15.60:0/2890334994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe4880cd770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe484009910 tx=0x7fe4840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bef4c0fe719811d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480001770 con 0x7fe4881577d0 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484011420 con 0x7fe4881577d0 2023-10-08T16:16:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48cbd7700 1 -- 172.21.15.60:0/2890334994 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840117c0 con 0x7fe4881577d0 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2890334994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 msgr2=0x7fe4880cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2890334994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe4880cd770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe484009910 tx=0x7fe4840091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2890334994 shutdown_connections 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2890334994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe4880cd770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2890334994 >> 172.21.15.60:0/2890334994 conn(0x7fe488068ce0 msgr2=0x7fe4880690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2890334994 shutdown_connections 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.056+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2890334994 wait complete. 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.057+0000 7fe48fe3d700 1 Processor -- start 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.057+0000 7fe48fe3d700 1 -- start start 2023-10-08T16:16:03.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48fe3d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48806ac30 0x7fe488151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48fe3d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe48814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48fe3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 0x7fe4880aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48fe3d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48816a4b0 con 0x7fe488157ba0 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48fe3d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488150000 con 0x7fe48806ac30 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48fe3d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48814ea80 con 0x7fe4881577d0 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 0x7fe4880aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 0x7fe4880aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51772/0 (socket says 172.21.15.60:51772) 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 -- 172.21.15.60:0/2273905154 learned_addr learned my addr 172.21.15.60:0/2273905154 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48dbd9700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48806ac30 0x7fe488151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48d3d8700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe48814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 -- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 msgr2=0x7fe48814e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe48814e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 -- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48806ac30 msgr2=0x7fe488151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48806ac30 0x7fe488151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.058+0000 7fe48e3da700 1 -- 172.21.15.60:0/2273905154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009420 con 0x7fe488157ba0 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.059+0000 7fe48e3da700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 0x7fe4880aee30 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fe48000cb60 tx=0x7fe480001920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.059+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480004dc0 con 0x7fe488157ba0 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.059+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000a670 con 0x7fe488157ba0 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.059+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48814ed60 con 0x7fe488157ba0 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.059+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000aa30 con 0x7fe488157ba0 2023-10-08T16:16:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.059+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4880af370 con 0x7fe488157ba0 2023-10-08T16:16:03.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.060+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48814f280 con 0x7fe488157ba0 2023-10-08T16:16:03.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.060+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe480007150 con 0x7fe488157ba0 2023-10-08T16:16:03.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.060+0000 7fe47dffb700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.061+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe480083d00 con 0x7fe488157ba0 2023-10-08T16:16:03.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.061+0000 7fe48dbd9700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.061+0000 7fe48dbd9700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe4840091e0 tx=0x7fe484016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.065+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe48814f280 con 0x7fe488157ba0 2023-10-08T16:16:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.333+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe48814fdd0 con 0x7fe488157ba0 2023-10-08T16:16:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.334+0000 7fe47dffb700 1 -- 172.21.15.60:0/2273905154 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe48814fdd0 con 0x7fe488157ba0 2023-10-08T16:16:03.335 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:03.335 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:03.335 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-08T16:16:03.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlH4BYJxAAd+EFq5PozXPMJFBZ+wGF+Q==", 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-08T16:16:03.336 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlme/NMhAArs/9tY1mGRoAFx1VTrx3mg==", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlr3lPLhAA+XLwiVGFrksOWB7Rq+oPEg==", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJl1PySORAAtvy1dyzmdRv8ynIkaJ3MAw==", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:16:03.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlN2DfIBAAnHHlUwO1zhHs3B9OBOraow==", 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJlLguAJxAAk69m5hBk/ZijcSyN11DgZg==", 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJldiKWMBAAn80cChvHGRRNyUzoHifyyg==", 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAU0yJl/c2qORAAGs3ZBdNOELX+s3DqTWwW6Q==", 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJla8tkCxAAxEAzuzgvV18imyqQ+KJ7MQ==", 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlpD9XEhAAg7VBS2zPgUHCRbCai5reww==", 2023-10-08T16:16:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJlm09JGxAAnTLbcnRStfIAga1mNXwpVg==", 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.343 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAY0yJl3qNoJBAA/mR5RKbGV2XwxsJXI3Vlbw==", 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlNzfkARAABSyi2wiMW2LsXAbrJyf2og==", 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl5BRgChAAHDd9LwSQ8nVohvjK1k5R/A==", 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJl4fFeBxAAlVhWswvoF7N/75h0duxGUA==", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:16:03.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAT0yJlZZexDxAAhWEVoE1ptQb+poK31EiMBQ==", 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly6KPDBAAI/7UiJhMMbu9X58qM0Xrkg==", 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-08T16:16:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJlSH0+JBAA9Vq21/mm712llUoiP6VYlg==", 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQAS0yJly2TeIBAAdyCYG+Yl+4VJrdlWgfQN/A==", 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-08T16:16:03.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-08T16:16:03.350 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-08T16:16:03.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:03.350 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:03.350 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 msgr2=0x7fe46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe4840091e0 tx=0x7fe484016000 comp rx=0 tx=0).stop 2023-10-08T16:16:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 msgr2=0x7fe4880aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 0x7fe4880aee30 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fe48000cb60 tx=0x7fe480001920 comp rx=0 tx=0).stop 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 shutdown_connections 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fe46c066f30 0x7fe46c0693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe488157ba0 0x7fe4880aee30 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48806ac30 0x7fe488151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 --2- 172.21.15.60:0/2273905154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4881577d0 0x7fe48814e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 >> 172.21.15.60:0/2273905154 conn(0x7fe488068ce0 msgr2=0x7fe4880690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 shutdown_connections 2023-10-08T16:16:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.336+0000 7fe48fe3d700 1 -- 172.21.15.60:0/2273905154 wait complete. 2023-10-08T16:16:03.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.471+0000 7f4ec73f5700 1 Processor -- start 2023-10-08T16:16:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.471+0000 7f4ec73f5700 1 -- start start 2023-10-08T16:16:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec73f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 0x7f4ec00b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec73f5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ec00cffa0 0x7f4ec006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec73f5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec00b3d40 con 0x7f4ec015a230 2023-10-08T16:16:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec73f5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec0069d70 con 0x7f4ec00cffa0 2023-10-08T16:16:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec73f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00b4300 con 0x7f4ec0159e60 2023-10-08T16:16:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec5992700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4ec015a230 0x7f4ec00b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39956/0 (socket says 172.21.15.60:39956) 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec5992700 1 -- 172.21.15.60:0/1937863560 learned_addr learned my addr 172.21.15.60:0/1937863560 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec4990700 1 --2- 172.21.15.60:0/1937863560 >> v2:172.21.15.144:3300/0 conn(0x7f4ec00cffa0 0x7f4ec006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4ec5191700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 0x7f4ec00b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589597301 0 0) 0x7f4ec00b3d40 con 0x7f4ec015a230 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eac003570 con 0x7f4ec015a230 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1055331760 0 0) 0x7f4eac003570 con 0x7f4ec015a230 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 msgr2=0x7f4ec00b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 0x7f4ec00b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 >> v2:172.21.15.144:3300/0 conn(0x7f4ec00cffa0 msgr2=0x7f4ec006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 --2- 172.21.15.60:0/1937863560 >> v2:172.21.15.144:3300/0 conn(0x7f4ec00cffa0 0x7f4ec006a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00d0480 con 0x7f4ec015a230 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f4eb80017f0 con 0x7f4ec015a230 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 >> v1:172.21.15.60:6789/0 conn(0x7f4ec015a230 legacy=0x7f4ec00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 0x7f4eac003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.472+0000 7f4eb7fff700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac003fe0 0x7f4eac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac004d50 0x7f4eac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0069d70 con 0x7f4eac003fe0 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00b4300 con 0x7f4eac004d50 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac00ba90 con 0x7f4ec0159e60 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac003fe0 0x7f4eac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec5191700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 0x7f4eac003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec5992700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac004d50 0x7f4eac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 -- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 msgr2=0x7f4eac003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec0159e60 0x7f4eac003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 -- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac004d50 msgr2=0x7f4eac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac004d50 0x7f4eac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 -- 172.21.15.60:0/1937863560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac003570 con 0x7f4eac003fe0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4ec4990700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac003fe0 0x7f4eac004810 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00d03b0 tx=0x7f4eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939ff9e489208c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb000e6b0 con 0x7f4eac003fe0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb000e810 con 0x7f4eac003fe0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.473+0000 7f4eb7fff700 1 -- 172.21.15.60:0/1937863560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb000ebd0 con 0x7f4eac003fe0 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec73f5700 1 -- 172.21.15.60:0/1937863560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac003fe0 msgr2=0x7f4eac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/1937863560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac003fe0 0x7f4eac004810 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00d03b0 tx=0x7f4eb00091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec5992700 1 -- 172.21.15.60:0/1937863560 reap_dead start 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec73f5700 1 -- 172.21.15.60:0/1937863560 shutdown_connections 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec73f5700 1 -- 172.21.15.60:0/1937863560 >> 172.21.15.60:0/1937863560 conn(0x7f4ec00d1a50 msgr2=0x7f4ec0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec73f5700 1 -- 172.21.15.60:0/1937863560 shutdown_connections 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.474+0000 7f4ec73f5700 1 -- 172.21.15.60:0/1937863560 wait complete. 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.475+0000 7f4ec73f5700 1 Processor -- start 2023-10-08T16:16:03.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.475+0000 7f4ec73f5700 1 -- start start 2023-10-08T16:16:03.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec73f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4eac003fe0 0x7f4ec014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec73f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec0150730 0x7f4ec014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec73f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 0x7f4ec00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec73f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0150340 con 0x7f4ec00b4690 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec73f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0151a70 con 0x7f4ec0150730 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec73f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00b5020 con 0x7f4eac003fe0 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 0x7f4ec00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 0x7f4ec00b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51786/0 (socket says 172.21.15.60:51786) 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 -- 172.21.15.60:0/2461677717 learned_addr learned my addr 172.21.15.60:0/2461677717 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec4990700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec0150730 0x7f4ec014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5191700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4eac003fe0 0x7f4ec014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 -- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4eac003fe0 msgr2=0x7f4ec014fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4eac003fe0 0x7f4ec014fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 -- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec0150730 msgr2=0x7f4ec014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec0150730 0x7f4ec014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 -- 172.21.15.60:0/2461677717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0150ba0 con 0x7f4ec00b4690 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5191700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4eac003fe0 0x7f4ec014fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec4990700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec0150730 0x7f4ec014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.476+0000 7f4ec5992700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 0x7f4ec00b4ae0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0071520 tx=0x7f4ec00d0a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.477+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800ae50 con 0x7f4ec00b4690 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.477+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80133f0 con 0x7f4ec00b4690 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.477+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec0150e60 con 0x7f4ec00b4690 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.477+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80137b0 con 0x7f4ec00b4690 2023-10-08T16:16:03.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.477+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec0151420 con 0x7f4ec00b4690 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.478+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec004c3c0 con 0x7f4ec00b4690 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.478+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4eb8013b60 con 0x7f4ec00b4690 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.478+0000 7f4eb57fa700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea4066f30 0x7f4ea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.479+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4eb8084c60 con 0x7f4ec00b4690 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.479+0000 7f4ec5191700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea4066f30 0x7f4ea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.479+0000 7f4ec5191700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea4066f30 0x7f4ea40693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006dc0 tx=0x7f4ebc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.483+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4eb8052220 con 0x7f4ec00b4690 2023-10-08T16:16:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.678+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ec00d0760 con 0x7f4ec00b4690 2023-10-08T16:16:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.678+0000 7f4eb57fa700 1 -- 172.21.15.60:0/2461677717 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f4eb8055840 con 0x7f4ec00b4690 2023-10-08T16:16:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:03.680 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":176,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:02.912288+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea4066f30 msgr2=0x7f4ea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea4066f30 0x7f4ea40693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006dc0 tx=0x7f4ebc008040 comp rx=0 tx=0).stop 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 msgr2=0x7f4ec00b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 0x7f4ec00b4ae0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0071520 tx=0x7f4ec00d0a40 comp rx=0 tx=0).stop 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 shutdown_connections 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4ea4066f30 0x7f4ea40693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4eac003fe0 0x7f4ec014fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00b4690 0x7f4ec00b4ae0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 --2- 172.21.15.60:0/2461677717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec0150730 0x7f4ec014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 >> 172.21.15.60:0/2461677717 conn(0x7f4ec00d1a50 msgr2=0x7f4ec00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 shutdown_connections 2023-10-08T16:16:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.680+0000 7f4ec73f5700 1 -- 172.21.15.60:0/2461677717 wait complete. 2023-10-08T16:16:03.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:16:03.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:16:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.815+0000 7fead763d700 1 Processor -- start 2023-10-08T16:16:03.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.816+0000 7fead763d700 1 -- start start 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.816+0000 7fead763d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fead00cd300 0x7fead015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.816+0000 7fead763d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.816+0000 7fead763d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead01513f0 con 0x7fead00b6760 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.816+0000 7fead763d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead015e7a0 con 0x7fead00cd300 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.816+0000 7fead763d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead015db20 con 0x7fead00d1470 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fead00cd300 0x7fead015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fead00cd300 0x7fead015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51796/0 (socket says 172.21.15.60:51796) 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 -- 172.21.15.60:0/63041198 learned_addr learned my addr 172.21.15.60:0/63041198 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead5bda700 1 --2- 172.21.15.60:0/63041198 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 -- 172.21.15.60:0/63041198 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 msgr2=0x7fead00cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 --2- 172.21.15.60:0/63041198 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead00cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 -- 172.21.15.60:0/63041198 >> v1:172.21.15.144:6789/0 conn(0x7fead00b6760 legacy=0x7fead00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 -- 172.21.15.60:0/63041198 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead015de00 con 0x7fead00cd300 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7fead53d9700 1 --2- 172.21.15.60:0/63041198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead015afb0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7feac80099b0 tx=0x7feac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d83c0b993ea696 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7feacffff700 1 -- 172.21.15.60:0/63041198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800b860 con 0x7fead00cd300 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7feacffff700 1 -- 172.21.15.60:0/63041198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800b9c0 con 0x7fead00cd300 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.817+0000 7feacffff700 1 -- 172.21.15.60:0/63041198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800bd60 con 0x7fead00cd300 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 -- 172.21.15.60:0/63041198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 msgr2=0x7fead015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 --2- 172.21.15.60:0/63041198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead015afb0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7feac80099b0 tx=0x7feac8009250 comp rx=0 tx=0).stop 2023-10-08T16:16:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 -- 172.21.15.60:0/63041198 shutdown_connections 2023-10-08T16:16:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 --2- 172.21.15.60:0/63041198 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead00cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 --2- 172.21.15.60:0/63041198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead015afb0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 -- 172.21.15.60:0/63041198 >> 172.21.15.60:0/63041198 conn(0x7fead0068d90 msgr2=0x7fead0069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 -- 172.21.15.60:0/63041198 shutdown_connections 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.818+0000 7fead763d700 1 -- 172.21.15.60:0/63041198 wait complete. 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.819+0000 7fead763d700 1 Processor -- start 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.819+0000 7fead763d700 1 -- start start 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead763d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fead00b6760 0x7fead016b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead763d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead763d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead763d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00b2320 con 0x7fead00cd300 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead763d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead016bca0 con 0x7fead00b6760 2023-10-08T16:16:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead763d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00b19f0 con 0x7fead00d1470 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead014c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51808/0 (socket says 172.21.15.60:51808) 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 -- 172.21.15.60:0/1988361524 learned_addr learned my addr 172.21.15.60:0/1988361524 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead5bda700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead53d9700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fead00b6760 0x7fead016b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 -- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 msgr2=0x7fead014fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead014fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 -- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fead00b6760 msgr2=0x7fead016b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fead00b6760 0x7fead016b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.820+0000 7fead4bd8700 1 -- 172.21.15.60:0/1988361524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac80094f0 con 0x7fead00cd300 2023-10-08T16:16:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.821+0000 7fead4bd8700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead014c0a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7feac400c590 tx=0x7feac400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.821+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4011590 con 0x7fead00cd300 2023-10-08T16:16:03.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.821+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4011710 con 0x7fead00cd300 2023-10-08T16:16:03.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.821+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead00b1cd0 con 0x7fead00cd300 2023-10-08T16:16:03.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.821+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4011ad0 con 0x7fead00cd300 2023-10-08T16:16:03.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.821+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead014c5e0 con 0x7fead00cd300 2023-10-08T16:16:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.822+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead00b24d0 con 0x7fead00cd300 2023-10-08T16:16:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.822+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feac401b3b0 con 0x7fead00cd300 2023-10-08T16:16:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.823+0000 7feacd7fa700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feabc066f30 0x7feabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.823+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feac4083610 con 0x7fead00cd300 2023-10-08T16:16:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.823+0000 7fead53d9700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feabc066f30 0x7feabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.823+0000 7fead53d9700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feabc066f30 0x7feabc0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feac80099b0 tx=0x7feac8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:03.827+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fead00b24d0 con 0x7fead00cd300 2023-10-08T16:16:03.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:03.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.021+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fead004c3c0 con 0x7fead00cd300 2023-10-08T16:16:04.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.021+0000 7feacd7fa700 1 -- 172.21.15.60:0/1988361524 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7feac4017020 con 0x7fead00cd300 2023-10-08T16:16:04.023 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:16:04.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.023+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feabc066f30 msgr2=0x7feabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.023+0000 7fead763d700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feabc066f30 0x7feabc0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feac80099b0 tx=0x7feac8017000 comp rx=0 tx=0).stop 2023-10-08T16:16:04.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.023+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 msgr2=0x7fead014c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.023+0000 7fead763d700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead014c0a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7feac400c590 tx=0x7feac400c8a0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.023+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 shutdown_connections 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.023+0000 7fead763d700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feabc066f30 0x7feabc0693e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.024+0000 7fead763d700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fead00d1470 0x7fead014fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.024+0000 7fead763d700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fead00b6760 0x7fead016b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.024+0000 7fead763d700 1 --2- 172.21.15.60:0/1988361524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead00cd300 0x7fead014c0a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.024+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 >> 172.21.15.60:0/1988361524 conn(0x7fead0068d90 msgr2=0x7fead014df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.024+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 shutdown_connections 2023-10-08T16:16:04.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.024+0000 7fead763d700 1 -- 172.21.15.60:0/1988361524 wait complete. 2023-10-08T16:16:04.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:16:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.155+0000 7fc7008d7700 1 Processor -- start 2023-10-08T16:16:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.155+0000 7fc7008d7700 1 -- start start 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc7008d7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6fc157870 0x7fc6fc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc7008d7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc15a620 0x7fc6fc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc7008d7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc15cbb0 con 0x7fc6fc15d580 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc7008d7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc15bfa0 con 0x7fc6fc157870 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc7008d7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc15c280 con 0x7fc6fc15a620 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc6fa59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6fc157870 0x7fc6fc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc6fa59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6fc157870 0x7fc6fc15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51812/0 (socket says 172.21.15.60:51812) 2023-10-08T16:16:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc6fa59c700 1 -- 172.21.15.60:0/198337163 learned_addr learned my addr 172.21.15.60:0/198337163 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.156+0000 7fc6f9d9b700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc15a620 0x7fc6fc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6fa59c700 1 -- 172.21.15.60:0/198337163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc15a620 msgr2=0x7fc6fc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6fa59c700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc15a620 0x7fc6fc15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6fa59c700 1 -- 172.21.15.60:0/198337163 >> v1:172.21.15.144:6789/0 conn(0x7fc6fc15d580 legacy=0x7fc6fc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6fa59c700 1 -- 172.21.15.60:0/198337163 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc15c560 con 0x7fc6fc157870 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6f9d9b700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc15a620 0x7fc6fc15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6fa59c700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc157870 0x7fc6fc15b6a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40099b0 tx=0x7fc6f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f05d157f1d44f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6f959a700 1 -- 172.21.15.60:0/198337163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400b860 con 0x7fc6fc157870 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6f959a700 1 -- 172.21.15.60:0/198337163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f400b9c0 con 0x7fc6fc157870 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc6f959a700 1 -- 172.21.15.60:0/198337163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400bd60 con 0x7fc6fc157870 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc7008d7700 1 -- 172.21.15.60:0/198337163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc157870 msgr2=0x7fc6fc15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.157+0000 7fc7008d7700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc157870 0x7fc6fc15b6a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40099b0 tx=0x7fc6f4009250 comp rx=0 tx=0).stop 2023-10-08T16:16:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.158+0000 7fc7008d7700 1 -- 172.21.15.60:0/198337163 shutdown_connections 2023-10-08T16:16:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.158+0000 7fc7008d7700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc157870 0x7fc6fc15b6a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.158+0000 7fc7008d7700 1 --2- 172.21.15.60:0/198337163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc15a620 0x7fc6fc15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.158+0000 7fc7008d7700 1 -- 172.21.15.60:0/198337163 >> 172.21.15.60:0/198337163 conn(0x7fc6fc068ce0 msgr2=0x7fc6fc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.158+0000 7fc7008d7700 1 -- 172.21.15.60:0/198337163 shutdown_connections 2023-10-08T16:16:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.158+0000 7fc7008d7700 1 -- 172.21.15.60:0/198337163 wait complete. 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 Processor -- start 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 -- start start 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc157870 0x7fc6fc16a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 0x7fc6fc16dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6fc15d580 0x7fc6fc0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0b0a20 con 0x7fc6fc15a620 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc16e560 con 0x7fc6fc15d580 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.159+0000 7fc7008d7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc16e840 con 0x7fc6fc157870 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 0x7fc6fc16dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 0x7fc6fc16dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51822/0 (socket says 172.21.15.60:51822) 2023-10-08T16:16:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 -- 172.21.15.60:0/2520796227 learned_addr learned my addr 172.21.15.60:0/2520796227 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6fa59c700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc157870 0x7fc6fc16a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6fad9d700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6fc15d580 0x7fc6fc0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 -- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc157870 msgr2=0x7fc6fc16a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc157870 0x7fc6fc16a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 -- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6fc15d580 msgr2=0x7fc6fc0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6fc15d580 0x7fc6fc0b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 -- 172.21.15.60:0/2520796227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40094f0 con 0x7fc6fc15a620 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6fa59c700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc157870 0x7fc6fc16a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f9d9b700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 0x7fc6fc16dc60 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e8a0 tx=0x7fc6e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400c430 con 0x7fc6fc15a620 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e400c590 con 0x7fc6fc15a620 2023-10-08T16:16:04.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc16eb20 con 0x7fc6fc15a620 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400c950 con 0x7fc6fc15a620 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.160+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc16ac20 con 0x7fc6fc15a620 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.161+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc0b0b90 con 0x7fc6fc15a620 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.162+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6e400cd00 con 0x7fc6fc15a620 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.162+0000 7fc6f27fc700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc6dc066f30 0x7fc6dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.162+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6e4083f90 con 0x7fc6fc15a620 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.162+0000 7fc6fa59c700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc6dc066f30 0x7fc6dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.162+0000 7fc6fa59c700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc6dc066f30 0x7fc6dc0693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40099b0 tx=0x7fc6f4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.166+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6e4054fe0 con 0x7fc6fc15a620 2023-10-08T16:16:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.362+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc6fc04c3c0 con 0x7fc6fc15a620 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.363+0000 7fc6f27fc700 1 -- 172.21.15.60:0/2520796227 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v176) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc6e4054b70 con 0x7fc6fc15a620 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:04.364 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.364+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc6dc066f30 msgr2=0x7fc6dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.364+0000 7fc7008d7700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc6dc066f30 0x7fc6dc0693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40099b0 tx=0x7fc6f4017000 comp rx=0 tx=0).stop 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.364+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 msgr2=0x7fc6fc16dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.364+0000 7fc7008d7700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 0x7fc6fc16dc60 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e8a0 tx=0x7fc6e4008040 comp rx=0 tx=0).stop 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 shutdown_connections 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fc6dc066f30 0x7fc6dc0693e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6fc157870 0x7fc6fc16a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6fc15d580 0x7fc6fc0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 --2- 172.21.15.60:0/2520796227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc15a620 0x7fc6fc16dc60 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 >> 172.21.15.60:0/2520796227 conn(0x7fc6fc068ce0 msgr2=0x7fc6fc155610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 shutdown_connections 2023-10-08T16:16:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.365+0000 7fc7008d7700 1 -- 172.21.15.60:0/2520796227 wait complete. 2023-10-08T16:16:04.378 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:16:04.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:16:04.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.500+0000 7f4b62e3f700 1 Processor -- start 2023-10-08T16:16:04.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.500+0000 7f4b62e3f700 1 -- start start 2023-10-08T16:16:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b62e3f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4b5c157960 0x7f4b5c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b62e3f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c0cd7d0 0x7f4b5c0d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b62e3f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b5c06a5c0 0x7f4b5c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b62e3f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c06af80 con 0x7f4b5c06a5c0 2023-10-08T16:16:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b62e3f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cfda0 con 0x7f4b5c157960 2023-10-08T16:16:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b62e3f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0ce050 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b613dc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b5c06a5c0 0x7f4b5c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b613dc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b5c06a5c0 0x7f4b5c06aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51834/0 (socket says 172.21.15.60:51834) 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.501+0000 7f4b613dc700 1 -- 172.21.15.60:0/2513550447 learned_addr learned my addr 172.21.15.60:0/2513550447 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b613dc700 1 -- 172.21.15.60:0/2513550447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c0cd7d0 msgr2=0x7f4b5c0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b613dc700 1 --2- 172.21.15.60:0/2513550447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c0cd7d0 0x7f4b5c0d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b60bdb700 1 --2- 172.21.15.60:0/2513550447 >> v2:172.21.15.144:3300/0 conn(0x7f4b5c157960 0x7f4b5c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b613dc700 1 -- 172.21.15.60:0/2513550447 >> v2:172.21.15.144:3300/0 conn(0x7f4b5c157960 msgr2=0x7f4b5c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b613dc700 1 --2- 172.21.15.60:0/2513550447 >> v2:172.21.15.144:3300/0 conn(0x7f4b5c157960 0x7f4b5c15ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b613dc700 1 -- 172.21.15.60:0/2513550447 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0cf4b0 con 0x7f4b5c06a5c0 2023-10-08T16:16:04.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b613dc700 1 --2- 172.21.15.60:0/2513550447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c06a5c0 0x7f4b5c06aa40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c06a2e0 tx=0x7f4b44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5948799be566c16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b5b7fe700 1 -- 172.21.15.60:0/2513550447 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400b860 con 0x7f4b5c06a5c0 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b5b7fe700 1 -- 172.21.15.60:0/2513550447 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400b9c0 con 0x7f4b5c06a5c0 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b5b7fe700 1 -- 172.21.15.60:0/2513550447 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400bd60 con 0x7f4b5c06a5c0 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 -- 172.21.15.60:0/2513550447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c06a5c0 msgr2=0x7f4b5c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/2513550447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c06a5c0 0x7f4b5c06aa40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c06a2e0 tx=0x7f4b44009250 comp rx=0 tx=0).stop 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 -- 172.21.15.60:0/2513550447 shutdown_connections 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/2513550447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c06a5c0 0x7f4b5c06aa40 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/2513550447 >> v2:172.21.15.144:3300/0 conn(0x7f4b5c157960 0x7f4b5c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/2513550447 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c0cd7d0 0x7f4b5c0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 -- 172.21.15.60:0/2513550447 >> 172.21.15.60:0/2513550447 conn(0x7f4b5c0d18a0 msgr2=0x7f4b5c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.502+0000 7f4b62e3f700 1 -- 172.21.15.60:0/2513550447 shutdown_connections 2023-10-08T16:16:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.503+0000 7f4b62e3f700 1 -- 172.21.15.60:0/2513550447 wait complete. 2023-10-08T16:16:04.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 Processor -- start 2023-10-08T16:16:04.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 -- start start 2023-10-08T16:16:04.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c06a5c0 0x7f4b5c15e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 0x7f4b5c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c157960 0x7f4b5c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c160710 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15fb00 con 0x7f4b5c157960 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.504+0000 7f4b62e3f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15fde0 con 0x7f4b5c06a5c0 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 0x7f4b5c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 0x7f4b5c1568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51838/0 (socket says 172.21.15.60:51838) 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 -- 172.21.15.60:0/3823444924 learned_addr learned my addr 172.21.15.60:0/3823444924 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b613dc700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c157960 0x7f4b5c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b60bdb700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c06a5c0 0x7f4b5c15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 -- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c06a5c0 msgr2=0x7f4b5c15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c06a5c0 0x7f4b5c15e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 -- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c157960 msgr2=0x7f4b5c159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c157960 0x7f4b5c159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 -- 172.21.15.60:0/3823444924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b440094f0 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b613dc700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c157960 0x7f4b5c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b5bfff700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 0x7f4b5c1568a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00bc30 tx=0x7f4b4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0092e0 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c00c7a0 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1600c0 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00cb80 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.505+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c15e8b0 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.506+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c16a310 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.507+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b4c012070 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.507+0000 7f4b58ff9700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4b3c066f30 0x7f4b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.507+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b4c083e40 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.507+0000 7f4b60bdb700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4b3c066f30 0x7f4b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:04.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.508+0000 7f4b60bdb700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4b3c066f30 0x7f4b3c0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4b54006fd0 tx=0x7f4b54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:04.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.511+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b4c051400 con 0x7f4b5c0cd7d0 2023-10-08T16:16:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:04.703+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4b5c04c3c0 con 0x7f4b5c0cd7d0 2023-10-08T16:16:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.410+0000 7f4b58ff9700 1 -- 172.21.15.60:0/3823444924 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v177) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4b4c054a20 con 0x7f4b5c0cd7d0 2023-10-08T16:16:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4b3c066f30 msgr2=0x7f4b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4b3c066f30 0x7f4b3c0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4b54006fd0 tx=0x7f4b54008040 comp rx=0 tx=0).stop 2023-10-08T16:16:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 msgr2=0x7f4b5c1568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 0x7f4b5c1568a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00bc30 tx=0x7f4b4c009840 comp rx=0 tx=0).stop 2023-10-08T16:16:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 shutdown_connections 2023-10-08T16:16:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4b3c066f30 0x7f4b3c0693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b5c06a5c0 0x7f4b5c15e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c157960 0x7f4b5c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 --2- 172.21.15.60:0/3823444924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c0cd7d0 0x7f4b5c1568a0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 >> 172.21.15.60:0/3823444924 conn(0x7f4b5c0d18a0 msgr2=0x7f4b5c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.414+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 shutdown_connections 2023-10-08T16:16:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.415+0000 7f4b62e3f700 1 -- 172.21.15.60:0/3823444924 wait complete. 2023-10-08T16:16:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-08T16:16:05.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:16:05.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.557+0000 7f336d983700 1 Processor -- start 2023-10-08T16:16:05.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.557+0000 7f336d983700 1 -- start start 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d983700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3368159ba0 0x7f3368159f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d983700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f336806f750 0x7f33680cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d983700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33680b2240 0x7f336806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d983700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680b1270 con 0x7f336806f750 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d983700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336806fbe0 con 0x7f3368159ba0 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d983700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680b1480 con 0x7f33680b2240 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f336806f750 0x7f33680cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f336806f750 0x7f33680cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51840/0 (socket says 172.21.15.60:51840) 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 -- 172.21.15.60:0/3032228523 learned_addr learned my addr 172.21.15.60:0/3032228523 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336c981700 1 --2- 172.21.15.60:0/3032228523 >> v2:172.21.15.144:3300/0 conn(0x7f3368159ba0 0x7f3368159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f336d182700 1 --2- 172.21.15.60:0/3032228523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33680b2240 0x7f336806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 -- 172.21.15.60:0/3032228523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33680b2240 msgr2=0x7f336806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 --2- 172.21.15.60:0/3032228523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33680b2240 0x7f336806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 -- 172.21.15.60:0/3032228523 >> v2:172.21.15.144:3300/0 conn(0x7f3368159ba0 msgr2=0x7f3368159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 --2- 172.21.15.60:0/3032228523 >> v2:172.21.15.144:3300/0 conn(0x7f3368159ba0 0x7f3368159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.558+0000 7f3367fff700 1 -- 172.21.15.60:0/3032228523 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680b1760 con 0x7f336806f750 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f3367fff700 1 --2- 172.21.15.60:0/3032228523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cdb70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f33680ac520 tx=0x7f3354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f73cbcfb8c6772b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f33677fe700 1 -- 172.21.15.60:0/3032228523 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400b640 con 0x7f336806f750 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f33677fe700 1 -- 172.21.15.60:0/3032228523 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400b7a0 con 0x7f336806f750 2023-10-08T16:16:05.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f33677fe700 1 -- 172.21.15.60:0/3032228523 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400bb60 con 0x7f336806f750 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 -- 172.21.15.60:0/3032228523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 msgr2=0x7f33680cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 --2- 172.21.15.60:0/3032228523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cdb70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f33680ac520 tx=0x7f3354009250 comp rx=0 tx=0).stop 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 -- 172.21.15.60:0/3032228523 shutdown_connections 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 --2- 172.21.15.60:0/3032228523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f33680b2240 0x7f336806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 --2- 172.21.15.60:0/3032228523 >> v2:172.21.15.144:3300/0 conn(0x7f3368159ba0 0x7f3368159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 --2- 172.21.15.60:0/3032228523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cdb70 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 -- 172.21.15.60:0/3032228523 >> 172.21.15.60:0/3032228523 conn(0x7f3368068120 msgr2=0x7f33680cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 -- 172.21.15.60:0/3032228523 shutdown_connections 2023-10-08T16:16:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.559+0000 7f336d983700 1 -- 172.21.15.60:0/3032228523 wait complete. 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.560+0000 7f336d983700 1 Processor -- start 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 -- start start 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33680b2240 0x7f3368160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3368159ba0 0x7f336809a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33681420c0 con 0x7f336806f750 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680cd750 con 0x7f33680b2240 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336d983700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33681414b0 con 0x7f3368159ba0 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336c981700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.561+0000 7f336c981700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51856/0 (socket says 172.21.15.60:51856) 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 -- 172.21.15.60:0/3867934742 learned_addr learned my addr 172.21.15.60:0/3867934742 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f3367fff700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33680b2240 0x7f3368160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336d182700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3368159ba0 0x7f336809a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 -- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3368159ba0 msgr2=0x7f336809a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3368159ba0 0x7f336809a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 -- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33680b2240 msgr2=0x7f3368160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33680b2240 0x7f3368160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 -- 172.21.15.60:0/3867934742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540094f0 con 0x7f336806f750 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336d182700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3368159ba0 0x7f336809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f3367fff700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33680b2240 0x7f3368160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336c981700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cd210 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e930 tx=0x7f335c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00eed0 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00c850 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3368141790 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00cbf0 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.562+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3368141d50 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.564+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f335c013470 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.564+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33681423a0 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.564+0000 7f3364ff9700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f334c066f30 0x7f334c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.564+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f335c0845e0 con 0x7f336806f750 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.564+0000 7f3367fff700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f334c066f30 0x7f334c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.565+0000 7f3367fff700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f334c066f30 0x7f334c0693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f33680ac520 tx=0x7f3354017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.569+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f335c051a30 con 0x7f336806f750 2023-10-08T16:16:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:05.762+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3368068520 con 0x7f336806f750 2023-10-08T16:16:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.418+0000 7f3364ff9700 1 -- 172.21.15.60:0/3867934742 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v178) v1 ==== 170+0+0 (secure 0 0 0) 0x7f335c055050 con 0x7f336806f750 2023-10-08T16:16:06.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.424+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f334c066f30 msgr2=0x7f334c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.424+0000 7f336d983700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f334c066f30 0x7f334c0693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f33680ac520 tx=0x7f3354017000 comp rx=0 tx=0).stop 2023-10-08T16:16:06.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.424+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 msgr2=0x7f33680cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.424+0000 7f336d983700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cd210 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e930 tx=0x7f335c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 shutdown_connections 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f334c066f30 0x7f334c0693e0 secure :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f33680ac520 tx=0x7f3354017000 comp rx=0 tx=0).stop 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3368159ba0 0x7f336809a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f336806f750 0x7f33680cd210 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 --2- 172.21.15.60:0/3867934742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33680b2240 0x7f3368160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 >> 172.21.15.60:0/3867934742 conn(0x7f3368068120 msgr2=0x7f33680ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 shutdown_connections 2023-10-08T16:16:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.425+0000 7f336d983700 1 -- 172.21.15.60:0/3867934742 wait complete. 2023-10-08T16:16:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-08T16:16:06.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:16:06.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.571+0000 7fd923d04700 1 Processor -- start 2023-10-08T16:16:06.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.572+0000 7fd923d04700 1 -- start start 2023-10-08T16:16:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.572+0000 7fd923d04700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd91c164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.572+0000 7fd923d04700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0b0790 con 0x7fd91c159ec0 2023-10-08T16:16:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.572+0000 7fd923d04700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0ce1f0 con 0x7fd91c15a290 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.572+0000 7fd923d04700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0b0b20 con 0x7fd91c0d05a0 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.572+0000 7fd921aa0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd91c159ec0 0x7fd91c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39960/0 (socket says 172.21.15.60:39960) 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd921aa0700 1 -- 172.21.15.60:0/282918929 learned_addr learned my addr 172.21.15.60:0/282918929 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd9222a1700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd91c164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84853871 0 0) 0x7fd91c0b0790 con 0x7fd91c159ec0 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd904003570 con 0x7fd91c159ec0 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448530513 0 0) 0x7fd91c0ce1f0 con 0x7fd91c15a290 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd91c0b0790 con 0x7fd91c15a290 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2743805086 0 0) 0x7fd904003570 con 0x7fd91c159ec0 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 msgr2=0x7fd91c164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd91c164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 >> v1:172.21.15.144:6789/0 conn(0x7fd91c15a290 legacy=0x7fd91c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0b04b0 con 0x7fd91c159ec0 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fd90c0017f0 con 0x7fd91c159ec0 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd9222a1700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd91c164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 >> v1:172.21.15.60:6789/0 conn(0x7fd91c159ec0 legacy=0x7fd91c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd904003c20 0x7fd904004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd904004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904004d50 0x7fd9040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0b0b20 con 0x7fd904003c20 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90400bb10 con 0x7fd904004d50 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90400bcd0 con 0x7fd91c0d05a0 2023-10-08T16:16:06.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd921aa0700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd904003c20 0x7fd904004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd9222a1700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904004d50 0x7fd9040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.573+0000 7fd92129f700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd904004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd921aa0700 1 -- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 msgr2=0x7fd904004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd921aa0700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c0d05a0 0x7fd904004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd921aa0700 1 -- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904004d50 msgr2=0x7fd9040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd921aa0700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904004d50 0x7fd9040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd921aa0700 1 -- 172.21.15.60:0/282918929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914009420 con 0x7fd904003c20 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd921aa0700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd904003c20 0x7fd904004010 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00a8d0 tx=0x7fd90c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e5c916d45455cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0070d0 con 0x7fd904003c20 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c007230 con 0x7fd904003c20 2023-10-08T16:16:06.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd920a9e700 1 -- 172.21.15.60:0/282918929 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0075f0 con 0x7fd904003c20 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd923d04700 1 -- 172.21.15.60:0/282918929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd904003c20 msgr2=0x7fd904004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd923d04700 1 --2- 172.21.15.60:0/282918929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd904003c20 0x7fd904004010 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00a8d0 tx=0x7fd90c002190 comp rx=0 tx=0).stop 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.574+0000 7fd9222a1700 1 -- 172.21.15.60:0/282918929 reap_dead start 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.575+0000 7fd923d04700 1 -- 172.21.15.60:0/282918929 shutdown_connections 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.575+0000 7fd923d04700 1 -- 172.21.15.60:0/282918929 >> 172.21.15.60:0/282918929 conn(0x7fd91c0d1880 msgr2=0x7fd91c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.575+0000 7fd923d04700 1 -- 172.21.15.60:0/282918929 shutdown_connections 2023-10-08T16:16:06.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.575+0000 7fd923d04700 1 -- 172.21.15.60:0/282918929 wait complete. 2023-10-08T16:16:06.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 Processor -- start 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 -- start start 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904003c20 0x7fd91c16d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 0x7fd91c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c15dca0 0x7fd91c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c15e650 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0caa70 con 0x7fd904003c20 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.576+0000 7fd923d04700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0cad50 con 0x7fd91c15dca0 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 0x7fd91c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 0x7fd91c0ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51874/0 (socket says 172.21.15.60:51874) 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 -- 172.21.15.60:0/4275442560 learned_addr learned my addr 172.21.15.60:0/4275442560 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd9222a1700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c15dca0 0x7fd91c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd921aa0700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904003c20 0x7fd91c16d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 -- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c15dca0 msgr2=0x7fd91c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c15dca0 0x7fd91c15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 -- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904003c20 msgr2=0x7fd91c16d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904003c20 0x7fd91c16d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 -- 172.21.15.60:0/4275442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0cb030 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd92129f700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 0x7fd91c0ca420 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fd910002b00 tx=0x7fd910007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910006a30 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910006bb0 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c0cb310 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910007050 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.577+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c16d570 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.578+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c0cb830 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.579+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd910007400 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.579+0000 7fd919ffb700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd908066f30 0x7fd9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.579+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd9100846f0 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.579+0000 7fd921aa0700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd908066f30 0x7fd9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.580+0000 7fd921aa0700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd908066f30 0x7fd9080693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00a6b0 tx=0x7fd90c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.584+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd91c0cb830 con 0x7fd91c0c9fb0 2023-10-08T16:16:06.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:06.821+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd91c0cb830 con 0x7fd91c0c9fb0 2023-10-08T16:16:07.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.419+0000 7fd919ffb700 1 -- 172.21.15.60:0/4275442560 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd91c0cb830 con 0x7fd91c0c9fb0 2023-10-08T16:16:07.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.433+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd908066f30 msgr2=0x7fd9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.433+0000 7fd923d04700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd908066f30 0x7fd9080693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00a6b0 tx=0x7fd90c016000 comp rx=0 tx=0).stop 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.433+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 msgr2=0x7fd91c0ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.433+0000 7fd923d04700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 0x7fd91c0ca420 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fd910002b00 tx=0x7fd910007d30 comp rx=0 tx=0).stop 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.434+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 shutdown_connections 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.434+0000 7fd923d04700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd908066f30 0x7fd9080693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.434+0000 7fd923d04700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd91c15dca0 0x7fd91c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.434+0000 7fd923d04700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd904003c20 0x7fd91c16d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.434+0000 7fd923d04700 1 --2- 172.21.15.60:0/4275442560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c0c9fb0 0x7fd91c0ca420 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.434+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 >> 172.21.15.60:0/4275442560 conn(0x7fd91c0d1880 msgr2=0x7fd91c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:07.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.435+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 shutdown_connections 2023-10-08T16:16:07.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.435+0000 7fd923d04700 1 -- 172.21.15.60:0/4275442560 wait complete. 2023-10-08T16:16:07.438 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 22 and data pool 23 2023-10-08T16:16:07.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:07.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.571+0000 7f351bca3700 1 Processor -- start 2023-10-08T16:16:07.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.571+0000 7f351bca3700 1 -- start start 2023-10-08T16:16:07.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351bca3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3514159cf0 0x7f351415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351bca3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35140cf1c0 0x7f3514068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351bca3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140cca20 con 0x7f351415a0c0 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351bca3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351415ea40 con 0x7f3514159cf0 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351bca3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3514067660 con 0x7f35140cf1c0 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f3519a3f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3514159cf0 0x7f351415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351923e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f351415a0c0 0x7f35140ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39968/0 (socket says 172.21.15.60:39968) 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f3519a3f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3514159cf0 0x7f351415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51878/0 (socket says 172.21.15.60:51878) 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351923e700 1 -- 172.21.15.60:0/1890924302 learned_addr learned my addr 172.21.15.60:0/1890924302 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:07.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f3519a3f700 1 -- 172.21.15.60:0/1890924302 >> v2:172.21.15.144:3300/0 conn(0x7f35140cf1c0 msgr2=0x7f3514068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.572+0000 7f351a240700 1 --2- 172.21.15.60:0/1890924302 >> v2:172.21.15.144:3300/0 conn(0x7f35140cf1c0 0x7f3514068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3519a3f700 1 --2- 172.21.15.60:0/1890924302 >> v2:172.21.15.144:3300/0 conn(0x7f35140cf1c0 0x7f3514068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3519a3f700 1 -- 172.21.15.60:0/1890924302 >> v1:172.21.15.60:6789/0 conn(0x7f351415a0c0 legacy=0x7f35140ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3518a3d700 1 -- 172.21.15.60:0/1890924302 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347330278 0 0) 0x7f35140cca20 con 0x7f351415a0c0 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3519a3f700 1 -- 172.21.15.60:0/1890924302 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514067f00 con 0x7f3514159cf0 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3519a3f700 1 --2- 172.21.15.60:0/1890924302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f351415e500 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f35140cc5d0 tx=0x7f350c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b568ea532368d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3518a3d700 1 -- 172.21.15.60:0/1890924302 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00b6b0 con 0x7f3514159cf0 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3518a3d700 1 -- 172.21.15.60:0/1890924302 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00b810 con 0x7f3514159cf0 2023-10-08T16:16:07.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f3518a3d700 1 -- 172.21.15.60:0/1890924302 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00bbb0 con 0x7f3514159cf0 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f351bca3700 1 -- 172.21.15.60:0/1890924302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 msgr2=0x7f351415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f351bca3700 1 --2- 172.21.15.60:0/1890924302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f351415e500 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f35140cc5d0 tx=0x7f350c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f351bca3700 1 -- 172.21.15.60:0/1890924302 shutdown_connections 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f351bca3700 1 --2- 172.21.15.60:0/1890924302 >> v2:172.21.15.144:3300/0 conn(0x7f35140cf1c0 0x7f3514068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f351bca3700 1 --2- 172.21.15.60:0/1890924302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f351415e500 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.573+0000 7f351bca3700 1 -- 172.21.15.60:0/1890924302 >> 172.21.15.60:0/1890924302 conn(0x7f351406c6e0 msgr2=0x7f3514069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.574+0000 7f351bca3700 1 -- 172.21.15.60:0/1890924302 shutdown_connections 2023-10-08T16:16:07.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.574+0000 7f351bca3700 1 -- 172.21.15.60:0/1890924302 wait complete. 2023-10-08T16:16:07.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.575+0000 7f351bca3700 1 Processor -- start 2023-10-08T16:16:07.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.575+0000 7f351bca3700 1 -- start start 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.575+0000 7f351bca3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35140cf1c0 0x7f351416a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.575+0000 7f351bca3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f35140c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351bca3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351415a0c0 0x7f35140c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351bca3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140b3780 con 0x7f3514159cf0 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351bca3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351416aee0 con 0x7f351415a0c0 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351bca3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3514157e20 con 0x7f35140cf1c0 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f35140c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f35140c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51880/0 (socket says 172.21.15.60:51880) 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 -- 172.21.15.60:0/2512321930 learned_addr learned my addr 172.21.15.60:0/2512321930 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:07.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f3519a3f700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35140cf1c0 0x7f351416a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351a240700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351415a0c0 0x7f35140c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 -- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35140cf1c0 msgr2=0x7f351416a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35140cf1c0 0x7f351416a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 -- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351415a0c0 msgr2=0x7f35140c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351415a0c0 0x7f35140c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 -- 172.21.15.60:0/2512321930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009420 con 0x7f3514159cf0 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351a240700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351415a0c0 0x7f35140c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351923e700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f35140c7310 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f350800c5b0 tx=0x7f3508001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:07.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508005b30 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508005c90 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3514158100 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.576+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508007300 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.577+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35141586c0 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.577+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351404c3c0 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.578+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f350801b3b0 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.578+0000 7f3511ffb700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3500066f30 0x7f35000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.578+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3508083a70 con 0x7f3514159cf0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.578+0000 7f3519a3f700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3500066f30 0x7f35000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.579+0000 7f3519a3f700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3500066f30 0x7f35000693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f350c0093f0 tx=0x7f350c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:07.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.583+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3508050ce0 con 0x7f3514159cf0 2023-10-08T16:16:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.777+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35140ce730 con 0x7f3514159cf0 2023-10-08T16:16:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.777+0000 7f3511ffb700 1 -- 172.21.15.60:0/2512321930 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f3508017090 con 0x7f3514159cf0 2023-10-08T16:16:07.779 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:07.779 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":179,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:06.823250+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:16:04.735531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T16:16:05.794306+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3500066f30 msgr2=0x7f35000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3500066f30 0x7f35000693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f350c0093f0 tx=0x7f350c017000 comp rx=0 tx=0).stop 2023-10-08T16:16:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 msgr2=0x7f35140c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f35140c7310 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f350800c5b0 tx=0x7f3508001070 comp rx=0 tx=0).stop 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 shutdown_connections 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3500066f30 0x7f35000693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35140cf1c0 0x7f351416a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351415a0c0 0x7f35140c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 --2- 172.21.15.60:0/2512321930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3514159cf0 0x7f35140c7310 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 >> 172.21.15.60:0/2512321930 conn(0x7f351406c6e0 msgr2=0x7f35140c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 shutdown_connections 2023-10-08T16:16:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.780+0000 7f351bca3700 1 -- 172.21.15.60:0/2512321930 wait complete. 2023-10-08T16:16:07.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:07.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.911+0000 7f656a839700 1 Processor -- start 2023-10-08T16:16:07.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.911+0000 7f656a839700 1 -- start start 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a839700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65640afc00 0x7f65640affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a839700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65640b3470 0x7f65640ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a839700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640b1ff0 con 0x7f65640ae2f0 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a839700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65641580e0 con 0x7f65640b3470 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a839700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65640b0510 con 0x7f65640afc00 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65640b3470 0x7f65640ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65640b3470 0x7f65640ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51890/0 (socket says 172.21.15.60:51890) 2023-10-08T16:16:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 -- 172.21.15.60:0/266960384 learned_addr learned my addr 172.21.15.60:0/266960384 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f6569837700 1 --2- 172.21.15.60:0/266960384 >> v2:172.21.15.144:3300/0 conn(0x7f65640afc00 0x7f65640affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 -- 172.21.15.60:0/266960384 >> v2:172.21.15.144:3300/0 conn(0x7f65640afc00 msgr2=0x7f65640affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 --2- 172.21.15.60:0/266960384 >> v2:172.21.15.144:3300/0 conn(0x7f65640afc00 0x7f65640affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 -- 172.21.15.60:0/266960384 >> v1:172.21.15.144:6789/0 conn(0x7f65640ae2f0 legacy=0x7f656415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.912+0000 7f656a038700 1 -- 172.21.15.60:0/266960384 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640aed70 con 0x7f65640b3470 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a038700 1 --2- 172.21.15.60:0/266960384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640b3470 0x7f65640ae790 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f656406cc50 tx=0x7f6554009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68030baa1fdb1013 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f6568835700 1 -- 172.21.15.60:0/266960384 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400e070 con 0x7f65640b3470 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f6568835700 1 -- 172.21.15.60:0/266960384 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400ba10 con 0x7f65640b3470 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f6568835700 1 -- 172.21.15.60:0/266960384 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540092e0 con 0x7f65640b3470 2023-10-08T16:16:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 -- 172.21.15.60:0/266960384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640b3470 msgr2=0x7f65640ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 --2- 172.21.15.60:0/266960384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640b3470 0x7f65640ae790 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f656406cc50 tx=0x7f6554009840 comp rx=0 tx=0).stop 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 -- 172.21.15.60:0/266960384 shutdown_connections 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 --2- 172.21.15.60:0/266960384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640b3470 0x7f65640ae790 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 --2- 172.21.15.60:0/266960384 >> v2:172.21.15.144:3300/0 conn(0x7f65640afc00 0x7f65640affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 -- 172.21.15.60:0/266960384 >> 172.21.15.60:0/266960384 conn(0x7f656406c700 msgr2=0x7f6564069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 -- 172.21.15.60:0/266960384 shutdown_connections 2023-10-08T16:16:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.913+0000 7f656a839700 1 -- 172.21.15.60:0/266960384 wait complete. 2023-10-08T16:16:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.914+0000 7f656a839700 1 Processor -- start 2023-10-08T16:16:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 -- start start 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65640ae2f0 0x7f656416acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 0x7f6564155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65640b3470 0x7f65640ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656416b210 con 0x7f65640afc00 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640ab8e0 con 0x7f65640b3470 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f656a839700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640abbc0 con 0x7f65640ae2f0 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f6569036700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 0x7f6564155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f6569036700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 0x7f6564155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51894/0 (socket says 172.21.15.60:51894) 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.915+0000 7f6569036700 1 -- 172.21.15.60:0/3027042643 learned_addr learned my addr 172.21.15.60:0/3027042643 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569837700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65640ae2f0 0x7f656416acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569036700 1 -- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65640ae2f0 msgr2=0x7f656416acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f656a038700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65640b3470 0x7f65640ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569036700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65640ae2f0 0x7f656416acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569036700 1 -- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65640b3470 msgr2=0x7f65640ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569036700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65640b3470 0x7f65640ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569036700 1 -- 172.21.15.60:0/3027042643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6554009ae0 con 0x7f65640afc00 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f656a038700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65640b3470 0x7f65640ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6569036700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 0x7f6564155c20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f655800b600 tx=0x7f65580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800f510 con 0x7f65640afc00 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655800f670 con 0x7f65640afc00 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800fa30 con 0x7f65640afc00 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65640abea0 con 0x7f65640afc00 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.916+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65640ac460 con 0x7f65640afc00 2023-10-08T16:16:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.917+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65640ac680 con 0x7f65640afc00 2023-10-08T16:16:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.917+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f655801a400 con 0x7f65640afc00 2023-10-08T16:16:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.918+0000 7f6561ffb700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6550066f30 0x7f65500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.918+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6558084060 con 0x7f65640afc00 2023-10-08T16:16:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.918+0000 7f6569837700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6550066f30 0x7f65500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.918+0000 7f6569837700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6550066f30 0x7f65500693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6564158da0 tx=0x7f655c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:07.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:07.922+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6558051350 con 0x7f65640afc00 2023-10-08T16:16:08.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.114+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65640ce9c0 con 0x7f65640afc00 2023-10-08T16:16:08.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.115+0000 7f6561ffb700 1 -- 172.21.15.60:0/3027042643 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f6558054970 con 0x7f65640afc00 2023-10-08T16:16:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":179,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:06.823250+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:16:04.735531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T16:16:05.794306+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6550066f30 msgr2=0x7f65500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6550066f30 0x7f65500693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6564158da0 tx=0x7f655c008040 comp rx=0 tx=0).stop 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 msgr2=0x7f6564155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 0x7f6564155c20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f655800b600 tx=0x7f65580091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 shutdown_connections 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6550066f30 0x7f65500693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65640ae2f0 0x7f656416acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65640b3470 0x7f65640ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 --2- 172.21.15.60:0/3027042643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65640afc00 0x7f6564155c20 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 >> 172.21.15.60:0/3027042643 conn(0x7f656406c700 msgr2=0x7f65640ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:08.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 shutdown_connections 2023-10-08T16:16:08.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.117+0000 7f656a839700 1 -- 172.21.15.60:0/3027042643 wait complete. 2023-10-08T16:16:08.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:16:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.252+0000 7fded0252700 1 Processor -- start 2023-10-08T16:16:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.252+0000 7fded0252700 1 -- start start 2023-10-08T16:16:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fded0252700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 0x7fdec8164f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fded0252700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec815e9a0 con 0x7fdec80678b0 2023-10-08T16:16:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fded0252700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec80cae70 con 0x7fdec80cbf10 2023-10-08T16:16:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fded0252700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80cb150 con 0x7fdec80c9390 2023-10-08T16:16:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fdecdfee700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdec80678b0 0x7fdec815db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39974/0 (socket says 172.21.15.60:39974) 2023-10-08T16:16:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fdecdfee700 1 -- 172.21.15.60:0/3201927174 learned_addr learned my addr 172.21.15.60:0/3201927174 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.253+0000 7fdece7ef700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 0x7fdec8164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228703013 0 0) 0x7fdec815e9a0 con 0x7fdec80678b0 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb0003570 con 0x7fdec80678b0 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437654004 0 0) 0x7fdec80cae70 con 0x7fdec80cbf10 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec815e9a0 con 0x7fdec80cbf10 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108731671 0 0) 0x7fdeb0003570 con 0x7fdec80678b0 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 msgr2=0x7fdec8164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 0x7fdec8164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 >> v1:172.21.15.144:6789/0 conn(0x7fdec80cbf10 legacy=0x7fdec815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec80cb430 con 0x7fdec80678b0 2023-10-08T16:16:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fdec00017f0 con 0x7fdec80678b0 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 >> v1:172.21.15.60:6789/0 conn(0x7fdec80678b0 legacy=0x7fdec815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdeb0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 0x7fdeb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb0004d50 0x7fdeb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80cb150 con 0x7fdeb0003c20 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000bb70 con 0x7fdeb0004d50 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000bd30 con 0x7fdec80c9390 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecdfee700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdeb0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdece7ef700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb0004d50 0x7fdeb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecd7ed700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 0x7fdeb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecdfee700 1 -- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 msgr2=0x7fdeb0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecdfee700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec80c9390 0x7fdeb0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecdfee700 1 -- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb0004d50 msgr2=0x7fdeb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecdfee700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb0004d50 0x7fdeb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.254+0000 7fdecdfee700 1 -- 172.21.15.60:0/3201927174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0003570 con 0x7fdeb0003c20 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fdecdfee700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdeb0004010 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fdec000a8f0 tx=0x7fdec0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753adb2c012c9f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00070d0 con 0x7fdeb0003c20 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0007250 con 0x7fdeb0003c20 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fdeccfec700 1 -- 172.21.15.60:0/3201927174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0007610 con 0x7fdeb0003c20 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fded0252700 1 -- 172.21.15.60:0/3201927174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 msgr2=0x7fdeb0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fded0252700 1 --2- 172.21.15.60:0/3201927174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdeb0004010 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fdec000a8f0 tx=0x7fdec0002190 comp rx=0 tx=0).stop 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fdece7ef700 1 -- 172.21.15.60:0/3201927174 reap_dead start 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fded0252700 1 -- 172.21.15.60:0/3201927174 shutdown_connections 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fded0252700 1 -- 172.21.15.60:0/3201927174 >> 172.21.15.60:0/3201927174 conn(0x7fdec8069870 msgr2=0x7fdec8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fded0252700 1 -- 172.21.15.60:0/3201927174 shutdown_connections 2023-10-08T16:16:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.255+0000 7fded0252700 1 -- 172.21.15.60:0/3201927174 wait complete. 2023-10-08T16:16:08.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.256+0000 7fded0252700 1 Processor -- start 2023-10-08T16:16:08.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.256+0000 7fded0252700 1 -- start start 2023-10-08T16:16:08.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fded0252700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdec816a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fded0252700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec80cd8b0 0x7fdec814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fded0252700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec816e4a0 0x7fdec80b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fded0252700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec816e010 con 0x7fdeb0003c20 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fded0252700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec816af80 con 0x7fdec80cd8b0 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fded0252700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec816b260 con 0x7fdec816e4a0 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fdecdfee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdec816a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fdecdfee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdec816a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51916/0 (socket says 172.21.15.60:51916) 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.257+0000 7fdecdfee700 1 -- 172.21.15.60:0/1955197192 learned_addr learned my addr 172.21.15.60:0/1955197192 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecd7ed700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec80cd8b0 0x7fdec814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecdfee700 1 -- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec816e4a0 msgr2=0x7fdec80b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecdfee700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec816e4a0 0x7fdec80b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecdfee700 1 -- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec80cd8b0 msgr2=0x7fdec814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecdfee700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec80cd8b0 0x7fdec814f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecdfee700 1 -- 172.21.15.60:0/1955197192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec816b540 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecd7ed700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec80cd8b0 0x7fdec814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdecdfee700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdec816a6c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fdec000a3b0 tx=0x7fdec0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00075d0 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0004bb0 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0004d40 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec816dca0 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.258+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec814fc00 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.259+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec804c3c0 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.260+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdec0024030 con 0x7fdeb0003c20 2023-10-08T16:16:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.260+0000 7fdec5ffb700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdeb4066f30 0x7fdeb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.260+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdec0086640 con 0x7fdeb0003c20 2023-10-08T16:16:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.260+0000 7fdecd7ed700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdeb4066f30 0x7fdeb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.260+0000 7fdecd7ed700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdeb4066f30 0x7fdeb40693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdec80b2570 tx=0x7fdebc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.264+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdec00538b0 con 0x7fdeb0003c20 2023-10-08T16:16:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:08.508+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdec8068da0 con 0x7fdeb0003c20 2023-10-08T16:16:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.437+0000 7fdec5ffb700 1 -- 172.21.15.60:0/1955197192 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdec0056ed0 con 0x7fdeb0003c20 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdeb4066f30 msgr2=0x7fdeb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdeb4066f30 0x7fdeb40693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdec80b2570 tx=0x7fdebc009040 comp rx=0 tx=0).stop 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 msgr2=0x7fdec816a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdec816a6c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fdec000a3b0 tx=0x7fdec0016000 comp rx=0 tx=0).stop 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 shutdown_connections 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fdeb4066f30 0x7fdeb40693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdec816e4a0 0x7fdec80b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0003c20 0x7fdec816a6c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 --2- 172.21.15.60:0/1955197192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec80cd8b0 0x7fdec814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 >> 172.21.15.60:0/1955197192 conn(0x7fdec8069870 msgr2=0x7fdec80c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:09.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 shutdown_connections 2023-10-08T16:16:09.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.440+0000 7fded0252700 1 -- 172.21.15.60:0/1955197192 wait complete. 2023-10-08T16:16:09.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:16:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.585+0000 7f9d9740f700 1 Processor -- start 2023-10-08T16:16:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.585+0000 7f9d9740f700 1 -- start start 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d9740f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d900c9390 0x7f9d90164f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d9740f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9015e9a0 con 0x7f9d900cbf10 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d9740f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900cae70 con 0x7f9d900678b0 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d9740f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900cb150 con 0x7f9d900c9390 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d959ac700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d900c9390 0x7f9d90164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d949aa700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9d900cbf10 0x7f9d9015e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39990/0 (socket says 172.21.15.60:39990) 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d949aa700 1 -- 172.21.15.60:0/958318557 learned_addr learned my addr 172.21.15.60:0/958318557 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d959ac700 1 -- 172.21.15.60:0/958318557 >> v1:172.21.15.144:6789/0 conn(0x7f9d900678b0 legacy=0x7f9d9015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d959ac700 1 -- 172.21.15.60:0/958318557 >> v1:172.21.15.60:6789/0 conn(0x7f9d900cbf10 legacy=0x7f9d9015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d959ac700 1 -- 172.21.15.60:0/958318557 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900cb430 con 0x7f9d900c9390 2023-10-08T16:16:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d87fff700 1 -- 172.21.15.60:0/958318557 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882519066 0 0) 0x7f9d9015e9a0 con 0x7f9d900cbf10 2023-10-08T16:16:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.586+0000 7f9d959ac700 1 --2- 172.21.15.60:0/958318557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900c9390 0x7f9d90164f20 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009e60 tx=0x7f9d88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4d52d175bb82b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d87fff700 1 -- 172.21.15.60:0/958318557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800e070 con 0x7f9d900c9390 2023-10-08T16:16:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d87fff700 1 -- 172.21.15.60:0/958318557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800bc30 con 0x7f9d900c9390 2023-10-08T16:16:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d87fff700 1 -- 172.21.15.60:0/958318557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88012430 con 0x7f9d900c9390 2023-10-08T16:16:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 -- 172.21.15.60:0/958318557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900c9390 msgr2=0x7f9d90164f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 --2- 172.21.15.60:0/958318557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900c9390 0x7f9d90164f20 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009e60 tx=0x7f9d88009780 comp rx=0 tx=0).stop 2023-10-08T16:16:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 -- 172.21.15.60:0/958318557 shutdown_connections 2023-10-08T16:16:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 --2- 172.21.15.60:0/958318557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900c9390 0x7f9d90164f20 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 -- 172.21.15.60:0/958318557 >> 172.21.15.60:0/958318557 conn(0x7f9d90069870 msgr2=0x7f9d90069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 -- 172.21.15.60:0/958318557 shutdown_connections 2023-10-08T16:16:09.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.587+0000 7f9d9740f700 1 -- 172.21.15.60:0/958318557 wait complete. 2023-10-08T16:16:09.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.588+0000 7f9d9740f700 1 Processor -- start 2023-10-08T16:16:09.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.588+0000 7f9d9740f700 1 -- start start 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d9740f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d900678b0 0x7f9d9014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d9740f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900c9390 0x7f9d900c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d9740f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 0x7f9d900c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d9740f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900c8f50 con 0x7f9d900cbf10 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d9740f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9016dbd0 con 0x7f9d900678b0 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d9740f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900c8c70 con 0x7f9d900c9390 2023-10-08T16:16:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d959ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 0x7f9d900c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d959ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 0x7f9d900c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51940/0 (socket says 172.21.15.60:51940) 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.589+0000 7f9d959ac700 1 -- 172.21.15.60:0/3256129964 learned_addr learned my addr 172.21.15.60:0/3256129964 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d951ab700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d900678b0 0x7f9d9014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d959ac700 1 -- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900c9390 msgr2=0x7f9d900c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d959ac700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900c9390 0x7f9d900c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d959ac700 1 -- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d900678b0 msgr2=0x7f9d9014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d959ac700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d900678b0 0x7f9d9014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d959ac700 1 -- 172.21.15.60:0/3256129964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009a20 con 0x7f9d900cbf10 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d959ac700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 0x7f9d900c8680 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9d88013000 tx=0x7f9d88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8801b630 con 0x7f9d900cbf10 2023-10-08T16:16:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8801b790 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9016d580 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8801bb10 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.590+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9014f930 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.591+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9014fb50 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.591+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d8801c400 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.592+0000 7f9d857fa700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.592+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d88086480 con 0x7f9d900cbf10 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.592+0000 7f9d951ab700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.592+0000 7f9d951ab700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d74066f30 0x7f9d740693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0016c0 tx=0x7f9d8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.596+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d880537a0 con 0x7f9d900cbf10 2023-10-08T16:16:09.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:09.836+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9d9004c3c0 con 0x7f9d900cbf10 2023-10-08T16:16:10.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.442+0000 7f9d857fa700 1 -- 172.21.15.60:0/3256129964 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d88056dc0 con 0x7f9d900cbf10 2023-10-08T16:16:10.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d74066f30 msgr2=0x7f9d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d74066f30 0x7f9d740693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0016c0 tx=0x7f9d8c009040 comp rx=0 tx=0).stop 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 msgr2=0x7f9d900c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 0x7f9d900c8680 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9d88013000 tx=0x7f9d88019000 comp rx=0 tx=0).stop 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 shutdown_connections 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d900cbf10 0x7f9d900c8680 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d900678b0 0x7f9d9014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 --2- 172.21.15.60:0/3256129964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d900c9390 0x7f9d900c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 >> 172.21.15.60:0/3256129964 conn(0x7f9d90069870 msgr2=0x7f9d90150560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 shutdown_connections 2023-10-08T16:16:10.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.445+0000 7f9d9740f700 1 -- 172.21.15.60:0/3256129964 wait complete. 2023-10-08T16:16:10.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.583+0000 7fba82460700 1 Processor -- start 2023-10-08T16:16:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.583+0000 7fba82460700 1 -- start start 2023-10-08T16:16:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba82460700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c15a1e0 0x7fba7c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba82460700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fba7c0b3430 0x7fba7c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba82460700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c15db80 con 0x7fba7c159e10 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba82460700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15e800 con 0x7fba7c0b3430 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba82460700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15de60 con 0x7fba7c15a1e0 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fba7c0b3430 0x7fba7c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fba7c0b3430 0x7fba7c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51942/0 (socket says 172.21.15.60:51942) 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 -- 172.21.15.60:0/2824989524 learned_addr learned my addr 172.21.15.60:0/2824989524 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba7b7fe700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c15a1e0 0x7fba7c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 -- 172.21.15.60:0/2824989524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c15a1e0 msgr2=0x7fba7c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c15a1e0 0x7fba7c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 -- 172.21.15.60:0/2824989524 >> v1:172.21.15.144:6789/0 conn(0x7fba7c159e10 legacy=0x7fba7c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 -- 172.21.15.60:0/2824989524 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c15e140 con 0x7fba7c0b3430 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba7b7fe700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c15a1e0 0x7fba7c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba809fd700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c0b3430 0x7fba7c0cdc80 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fba74009f20 tx=0x7fba74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65cd4a097a75653 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba7affd700 1 -- 172.21.15.60:0/2824989524 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400e070 con 0x7fba7c0b3430 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba7affd700 1 -- 172.21.15.60:0/2824989524 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400ba80 con 0x7fba7c0b3430 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.584+0000 7fba7affd700 1 -- 172.21.15.60:0/2824989524 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740092e0 con 0x7fba7c0b3430 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 -- 172.21.15.60:0/2824989524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c0b3430 msgr2=0x7fba7c0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c0b3430 0x7fba7c0cdc80 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fba74009f20 tx=0x7fba74009840 comp rx=0 tx=0).stop 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 -- 172.21.15.60:0/2824989524 shutdown_connections 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c0b3430 0x7fba7c0cdc80 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 --2- 172.21.15.60:0/2824989524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c15a1e0 0x7fba7c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 -- 172.21.15.60:0/2824989524 >> 172.21.15.60:0/2824989524 conn(0x7fba7c067660 msgr2=0x7fba7c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 -- 172.21.15.60:0/2824989524 shutdown_connections 2023-10-08T16:16:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.585+0000 7fba82460700 1 -- 172.21.15.60:0/2824989524 wait complete. 2023-10-08T16:16:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.586+0000 7fba82460700 1 Processor -- start 2023-10-08T16:16:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.586+0000 7fba82460700 1 -- start start 2023-10-08T16:16:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba82460700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c0b3430 0x7fba7c0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba82460700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c159e10 0x7fba7c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba82460700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 0x7fba7c0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba82460700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c6770 con 0x7fba7c15a1e0 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba82460700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0ca0c0 con 0x7fba7c159e10 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba82460700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c157250 con 0x7fba7c0b3430 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba809fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 0x7fba7c0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba809fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 0x7fba7c0c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51950/0 (socket says 172.21.15.60:51950) 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba809fd700 1 -- 172.21.15.60:0/4082665013 learned_addr learned my addr 172.21.15.60:0/4082665013 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba7b7fe700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c159e10 0x7fba7c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.587+0000 7fba7bfff700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c0b3430 0x7fba7c0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba809fd700 1 -- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c0b3430 msgr2=0x7fba7c0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba809fd700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c0b3430 0x7fba7c0c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba809fd700 1 -- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c159e10 msgr2=0x7fba7c0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba809fd700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c159e10 0x7fba7c0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba809fd700 1 -- 172.21.15.60:0/4082665013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74009ae0 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba809fd700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 0x7fba7c0c4ce0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fba7400b6c0 tx=0x7fba74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740032f0 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74008dc0 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74026690 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0ca320 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.588+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c0ca8e0 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.589+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c04c3c0 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.590+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba74003040 con 0x7fba7c15a1e0 2023-10-08T16:16:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.590+0000 7fba63fff700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba68066f30 0x7fba680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.590+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba74086710 con 0x7fba7c15a1e0 2023-10-08T16:16:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.590+0000 7fba7bfff700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba68066f30 0x7fba680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.591+0000 7fba7bfff700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba68066f30 0x7fba680693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0b08c0 tx=0x7fba6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:10.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.594+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba74053960 con 0x7fba7c15a1e0 2023-10-08T16:16:10.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.831+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba7c0cb520 con 0x7fba7c15a1e0 2023-10-08T16:16:10.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.831+0000 7fba63fff700 1 -- 172.21.15.60:0/4082665013 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fba74008f30 con 0x7fba7c15a1e0 2023-10-08T16:16:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:10.833 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba68066f30 msgr2=0x7fba680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba68066f30 0x7fba680693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0b08c0 tx=0x7fba6c009040 comp rx=0 tx=0).stop 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 msgr2=0x7fba7c0c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 0x7fba7c0c4ce0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fba7400b6c0 tx=0x7fba74018000 comp rx=0 tx=0).stop 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 shutdown_connections 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba68066f30 0x7fba680693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba7c0b3430 0x7fba7c0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba7c15a1e0 0x7fba7c0c4ce0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 --2- 172.21.15.60:0/4082665013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c159e10 0x7fba7c0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 >> 172.21.15.60:0/4082665013 conn(0x7fba7c067660 msgr2=0x7fba7c15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:10.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 shutdown_connections 2023-10-08T16:16:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.833+0000 7fba82460700 1 -- 172.21.15.60:0/4082665013 wait complete. 2023-10-08T16:16:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:10.847 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:10.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.964+0000 7f88f38af700 1 Processor -- start 2023-10-08T16:16:10.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.965+0000 7f88f38af700 1 -- start start 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.965+0000 7f88f38af700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 0x7f88ec158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.965+0000 7f88f38af700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec15cbb0 con 0x7f88ec157870 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.965+0000 7f88f38af700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec15bfa0 con 0x7f88ec15a620 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.965+0000 7f88f38af700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec15bdb0 con 0x7f88ec157c40 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88f164b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88ec157870 0x7f88ec15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39994/0 (socket says 172.21.15.60:39994) 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88f164b700 1 -- 172.21.15.60:0/1297250328 learned_addr learned my addr 172.21.15.60:0/1297250328 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88f1e4c700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 0x7f88ec158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968010533 0 0) 0x7f88ec15cbb0 con 0x7f88ec157870 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d4003570 con 0x7f88ec157870 2023-10-08T16:16:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1611265152 0 0) 0x7f88d4003570 con 0x7f88ec157870 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 msgr2=0x7f88ec158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 0x7f88ec158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 >> v1:172.21.15.144:6789/0 conn(0x7f88ec15a620 legacy=0x7f88ec15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec15c280 con 0x7f88ec157870 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f88e4001470 con 0x7f88ec157870 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 >> v1:172.21.15.60:6789/0 conn(0x7f88ec157870 legacy=0x7f88ec15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4003a90 0x7f88d4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88d4004810 0x7f88d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 0x7f88d40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d400bb30 con 0x7f88d4004810 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d400bca0 con 0x7f88d4003a90 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d400be60 con 0x7f88ec157c40 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88d4004810 0x7f88d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88f164b700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4003a90 0x7f88d4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.966+0000 7f88f1e4c700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 0x7f88d40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 msgr2=0x7f88d40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec157c40 0x7f88d40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4003a90 msgr2=0x7f88d4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4003a90 0x7f88d4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1297250328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4003570 con 0x7f88d4004810 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88d4004810 0x7f88d4004c80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f88e0001880 tx=0x7f88e0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5d72edced6765a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0012420 con 0x7f88d4004810 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0012580 con 0x7f88d4004810 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88ebfff700 1 -- 172.21.15.60:0/1297250328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0012920 con 0x7f88d4004810 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f38af700 1 -- 172.21.15.60:0/1297250328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88d4004810 msgr2=0x7f88d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f38af700 1 --2- 172.21.15.60:0/1297250328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88d4004810 0x7f88d4004c80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f88e0001880 tx=0x7f88e0007d30 comp rx=0 tx=0).stop 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f1e4c700 1 -- 172.21.15.60:0/1297250328 reap_dead start 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.967+0000 7f88f38af700 1 -- 172.21.15.60:0/1297250328 shutdown_connections 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.968+0000 7f88f38af700 1 -- 172.21.15.60:0/1297250328 >> 172.21.15.60:0/1297250328 conn(0x7f88ec068ce0 msgr2=0x7f88ec0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.968+0000 7f88f38af700 1 -- 172.21.15.60:0/1297250328 shutdown_connections 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.968+0000 7f88f38af700 1 -- 172.21.15.60:0/1297250328 wait complete. 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.969+0000 7f88f38af700 1 Processor -- start 2023-10-08T16:16:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.969+0000 7f88f38af700 1 -- start start 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4004810 0x7f88ec13f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 0x7f88ec151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec13f730 0x7f88ec15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec154360 con 0x7f88ec15f0a0 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec16a790 con 0x7f88d4004810 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec1520c0 con 0x7f88ec13f730 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 0x7f88ec151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 0x7f88ec151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51974/0 (socket says 172.21.15.60:51974) 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1170039053 learned_addr learned my addr 172.21.15.60:0/1170039053 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f164b700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4004810 0x7f88ec13f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f1e4c700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec13f730 0x7f88ec15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec13f730 msgr2=0x7f88ec15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec13f730 0x7f88ec15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4004810 msgr2=0x7f88ec13f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4004810 0x7f88ec13f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 -- 172.21.15.60:0/1170039053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec1522f0 con 0x7f88ec15f0a0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f0e4a700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 0x7f88ec151b80 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f88e0001e70 tx=0x7f88e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0012420 con 0x7f88ec15f0a0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0001200 con 0x7f88ec15f0a0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00126f0 con 0x7f88ec15f0a0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec16b2d0 con 0x7f88ec15f0a0 2023-10-08T16:16:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.970+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec16ac80 con 0x7f88ec15f0a0 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.971+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec15ac50 con 0x7f88ec15f0a0 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.972+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88e0019030 con 0x7f88ec15f0a0 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.972+0000 7f88e97fa700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f88d8066f60 0x7f88d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.972+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88e00856f0 con 0x7f88ec15f0a0 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.972+0000 7f88f164b700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f88d8066f60 0x7f88d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.973+0000 7f88f164b700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f88d8066f60 0x7f88d8069410 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007f70 tx=0x7f88e4001e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:10.976+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88e0052960 con 0x7f88ec15f0a0 2023-10-08T16:16:11.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.170+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88ec1522f0 con 0x7f88ec15f0a0 2023-10-08T16:16:11.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.171+0000 7f88e97fa700 1 -- 172.21.15.60:0/1170039053 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f88ec1522f0 con 0x7f88ec15f0a0 2023-10-08T16:16:11.173 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:11.173 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":180,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:08.417999+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:16:04.735531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T16:16:05.794306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f88d8066f60 msgr2=0x7f88d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f88d8066f60 0x7f88d8069410 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007f70 tx=0x7f88e4001e50 comp rx=0 tx=0).stop 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 msgr2=0x7f88ec151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 0x7f88ec151b80 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f88e0001e70 tx=0x7f88e0015000 comp rx=0 tx=0).stop 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 shutdown_connections 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f88d8066f60 0x7f88d8069410 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f88ec13f730 0x7f88ec15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d4004810 0x7f88ec13f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 --2- 172.21.15.60:0/1170039053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88ec15f0a0 0x7f88ec151b80 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 >> 172.21.15.60:0/1170039053 conn(0x7f88ec068ce0 msgr2=0x7f88ec0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 shutdown_connections 2023-10-08T16:16:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.173+0000 7f88f38af700 1 -- 172.21.15.60:0/1170039053 wait complete. 2023-10-08T16:16:11.187 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:16:11.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:16:11.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.304+0000 7f8925aa8700 1 Processor -- start 2023-10-08T16:16:11.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.304+0000 7f8925aa8700 1 -- start start 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f8925aa8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8920159e10 0x7f89200b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f8925aa8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f892015a1e0 0x7f89200b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f8925aa8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892015db80 con 0x7f89200b1610 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f8925aa8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892015e800 con 0x7f892015a1e0 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f8925aa8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892015de60 con 0x7f8920159e10 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f891effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f892015a1e0 0x7f89200b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f891effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f892015a1e0 0x7f89200b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51986/0 (socket says 172.21.15.60:51986) 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f891effd700 1 -- 172.21.15.60:0/3334991518 learned_addr learned my addr 172.21.15.60:0/3334991518 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.305+0000 7f891f7fe700 1 --2- 172.21.15.60:0/3334991518 >> v2:172.21.15.144:3300/0 conn(0x7f8920159e10 0x7f89200b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891effd700 1 -- 172.21.15.60:0/3334991518 >> v2:172.21.15.144:3300/0 conn(0x7f8920159e10 msgr2=0x7f89200b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891effd700 1 --2- 172.21.15.60:0/3334991518 >> v2:172.21.15.144:3300/0 conn(0x7f8920159e10 0x7f89200b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891effd700 1 -- 172.21.15.60:0/3334991518 >> v1:172.21.15.144:6789/0 conn(0x7f89200b1610 legacy=0x7f89200cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891effd700 1 -- 172.21.15.60:0/3334991518 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892015e140 con 0x7f892015a1e0 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891effd700 1 --2- 172.21.15.60:0/3334991518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f892015a1e0 0x7f89200b3260 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8920068a60 tx=0x7f8914009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b3e051f9cb36e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891e7fc700 1 -- 172.21.15.60:0/3334991518 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914009e70 con 0x7f892015a1e0 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891e7fc700 1 -- 172.21.15.60:0/3334991518 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891400b860 con 0x7f892015a1e0 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f891e7fc700 1 -- 172.21.15.60:0/3334991518 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891400bc00 con 0x7f892015a1e0 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 -- 172.21.15.60:0/3334991518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f892015a1e0 msgr2=0x7f89200b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 --2- 172.21.15.60:0/3334991518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f892015a1e0 0x7f89200b3260 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8920068a60 tx=0x7f8914009250 comp rx=0 tx=0).stop 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 -- 172.21.15.60:0/3334991518 shutdown_connections 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 --2- 172.21.15.60:0/3334991518 >> v2:172.21.15.144:3300/0 conn(0x7f8920159e10 0x7f89200b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 --2- 172.21.15.60:0/3334991518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f892015a1e0 0x7f89200b3260 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 -- 172.21.15.60:0/3334991518 >> 172.21.15.60:0/3334991518 conn(0x7f8920067660 msgr2=0x7f8920067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 -- 172.21.15.60:0/3334991518 shutdown_connections 2023-10-08T16:16:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.306+0000 7f8925aa8700 1 -- 172.21.15.60:0/3334991518 wait complete. 2023-10-08T16:16:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 Processor -- start 2023-10-08T16:16:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 -- start start 2023-10-08T16:16:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 0x7f892016b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920159e10 0x7f892016a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f892015a1e0 0x7f892016ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c6080 con 0x7f89200b1610 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c8fc0 con 0x7f8920159e10 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f8925aa8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c92a0 con 0x7f892015a1e0 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.308+0000 7f891f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 0x7f892016b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 0x7f892016b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51996/0 (socket says 172.21.15.60:51996) 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 -- 172.21.15.60:0/1727102569 learned_addr learned my addr 172.21.15.60:0/1727102569 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891effd700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920159e10 0x7f892016a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891ffff700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f892015a1e0 0x7f892016ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 -- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f892015a1e0 msgr2=0x7f892016ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f892015a1e0 0x7f892016ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 -- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920159e10 msgr2=0x7f892016a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920159e10 0x7f892016a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 -- 172.21.15.60:0/1727102569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140094f0 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891ffff700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f892015a1e0 0x7f892016ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f891f7fe700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 0x7f892016b640 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f891000ec80 tx=0x7f89100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000c850 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891000c9b0 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89200c9580 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000cd50 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.309+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892016acb0 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.310+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892004c3c0 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.311+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8910013680 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.311+0000 7f89077fe700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f890c066f30 0x7f890c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.311+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8910084b60 con 0x7f89200b1610 2023-10-08T16:16:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.311+0000 7f891effd700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f890c066f30 0x7f890c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.311+0000 7f891effd700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f890c066f30 0x7f890c0693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8920068a60 tx=0x7f8914017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:11.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.315+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8910051dd0 con 0x7f89200b1610 2023-10-08T16:16:11.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.504+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f892015e420 con 0x7f890c066f30 2023-10-08T16:16:11.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.512+0000 7f89077fe700 1 -- 172.21.15.60:0/1727102569 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276260 (secure 0 0 0) 0x7f892015e420 con 0x7f890c066f30 2023-10-08T16:16:11.517 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f890c066f30 msgr2=0x7f890c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f890c066f30 0x7f890c0693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8920068a60 tx=0x7f8914017000 comp rx=0 tx=0).stop 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 msgr2=0x7f892016b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 0x7f892016b640 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f891000ec80 tx=0x7f89100091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 shutdown_connections 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f890c066f30 0x7f890c0693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f892015a1e0 0x7f892016ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89200b1610 0x7f892016b640 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 --2- 172.21.15.60:0/1727102569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8920159e10 0x7f892016a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 >> 172.21.15.60:0/1727102569 conn(0x7f8920067660 msgr2=0x7f89200b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 shutdown_connections 2023-10-08T16:16:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.515+0000 7f8925aa8700 1 -- 172.21.15.60:0/1727102569 wait complete. 2023-10-08T16:16:11.520 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:16:11.529 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2023-10-08T16:16:09.707613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8839,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553660,"statfs":{"total":1600000000,"available":1590948051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.296969"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413127+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:15.058164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412956+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:03.170158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414768+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:14.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413553+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:41.290063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414526+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:50:30.848545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414112+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:28.459631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414889+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:39.693417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414176+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:31.696757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413124+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:37.485710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413124+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:49.087439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413384+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:39.693417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414332+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:26.604602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.416486+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:08.161237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414097+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:28.863657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413075+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:26.945014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414893+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:19:37.197256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414328+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:05.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412826+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:28.879048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412293+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:14.367839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413438+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:50.915250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412317+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:34.960321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413939+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:32.056558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412294+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:55.645157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.416524+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:01:35.774730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414524+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:06:09.640285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414500+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:26.945014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.416499+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:29.402462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412815+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:14.253650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.413520+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:57.145843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.414169+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:03.170158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412535+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:26.604602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:16:06.410770+0000","last_change":"2023-10-08T16:16:06.410770+0000","last_active":"2023-10-08T16:16:06.410770+0000","last_peered":"2023-10-08T16:16:06.410770+0000","last_clean":"2023-10-08T16:16:06.410770+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:06.410770+0000","last_undegraded":"2023-10-08T16:16:06.410770+0000","last_fullsized":"2023-10-08T16:16:06.410770+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:16:05.408758+0000","last_change":"2023-10-08T16:16:05.412391+0000","last_active":"2023-10-08T16:16:05.408758+0000","last_peered":"2023-10-08T16:16:05.408758+0000","last_clean":"2023-10-08T16:16:05.408758+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:16:05.408758+0000","last_undegraded":"2023-10-08T16:16:05.408758+0000","last_fullsized":"2023-10-08T16:16:05.408758+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:28.863657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":305,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-08T16:16:03.621204+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:16:03.621204+0000","last_peered":"2023-10-08T16:16:03.621204+0000","last_clean":"2023-10-08T16:16:03.621204+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:03.621204+0000","last_undegraded":"2023-10-08T16:16:03.621204+0000","last_fullsized":"2023-10-08T16:16:03.621204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193775,"statfs":{"total":200000000,"available":198426456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.77900000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.75},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74199999999999999,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69599999999999995,"5min":0.871,"15min":1.0089999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71099999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.44600000000000001,"15min":0.46800000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56599999999999995,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.497},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.60499999999999998,"15min":0.52100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":11.891,"15min":11.891},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.625,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72299999999999998,"5min":0.78000000000000003,"15min":1.252},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199016824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.135,"15min":1.135},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":1.169,"15min":1.169},"last":0.59299999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.27500000000000002},"max":{"1min":0.80800000000000005,"5min":3.738,"15min":3.738},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61799999999999999,"15min":0.57499999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.83099999999999996,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":1.103,"15min":1.103},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57199999999999995,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.67700000000000005,"5min":3.516,"15min":3.516},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57199999999999995,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":1.502,"15min":1.502},"last":0.623}]},{"osd":4,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.28899999999999998,"5min":0.26500000000000001,"15min":0.249},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.28799999999999998,"15min":0.27500000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.92000000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.67300000000000004,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194346,"statfs":{"total":200000000,"available":199011019,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.42899999999999999},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.182},"max":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":3.593},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.374}]},{"osd":3,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.312},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.61899999999999999,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.35999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63900000000000001,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.93200000000000005},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63600000000000001,"15min":0.61699999999999999},"min":{"1min":0.42599999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.82699999999999996,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63600000000000001,"15min":0.68700000000000006},"min":{"1min":0.49099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84299999999999997,"5min":1.0149999999999999,"15min":3.532},"last":0.57999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65400000000000003,"15min":0.69699999999999995},"min":{"1min":0.44,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91600000000000004,"15min":1.095},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.50600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193775,"statfs":{"total":200000000,"available":198426456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.372,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.224,"15min":0.20200000000000001},"max":{"1min":0.61499999999999999,"5min":0.76700000000000002,"15min":1.571},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.64300000000000002,"5min":0.879,"15min":3.044},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56599999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":0.754,"15min":3.1150000000000002},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.439}]},{"osd":4,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.68300000000000005},"min":{"1min":0.53700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":3.1589999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.401},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":1.046,"15min":1.4590000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.6459999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.38600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6919999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.66600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.92200000000000004,"15min":3.665},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":1.01,"15min":3.7160000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83399999999999996,"5min":1.123,"15min":1.5109999999999999},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199016824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.23200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40899999999999997,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.59899999999999998,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.746},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.20899999999999999},"max":{"1min":0.68100000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.35099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44600000000000001,"15min":0.441},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":1.3260000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.374,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.42299999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79200000000000004,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.97499999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.62,"15min":0.64600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84399999999999997,"5min":0.873,"15min":2.9319999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.091},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63800000000000001,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.073},"last":0.44}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199016824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.33200000000000002},"min":{"1min":0.216,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.628,"5min":0.628,"15min":0.63900000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38400000000000001,"15min":0.35999999999999999},"min":{"1min":0.218,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41399999999999998,"15min":0.39000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.623,"5min":0.623,"15min":0.67800000000000005},"last":0.39800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.434,"15min":0.41099999999999998},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.98499999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.38500000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.499,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.501,"5min":0.41699999999999998,"15min":0.41399999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.66700000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.46400000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199016824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":1.141},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.149},"last":0.58499999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":7.4749999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.60299999999999998},"min":{"1min":0.35499999999999998,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":14.6},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":7.556},"last":0.497},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.85899999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63800000000000001,"5min":0.66600000000000004,"15min":0.754},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83999999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.85799999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.379}]}]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":960,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199016824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72299999999999998,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.51500000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.80300000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64600000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.31,"15min":0.31},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.79000000000000004},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56699999999999995,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.56899999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.75}]},{"osd":3,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.72599999999999998,"5min":0.76700000000000002,"15min":0.86499999999999999},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.74199999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58599999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.34599999999999997,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.77700000000000002},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.89400000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84199999999999997},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.77800000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.35199999999999998,"15min":0.316},"max":{"1min":0.79800000000000004,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.82199999999999995}]}]}],"pool_statfs":[]}} 2023-10-08T16:16:11.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:16:11.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.687+0000 7f60986d2700 1 Processor -- start 2023-10-08T16:16:11.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.687+0000 7f60986d2700 1 -- start start 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f60986d2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f609015a2b0 0x7f60900b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f60986d2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900cfe20 0x7f60900ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f60986d2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60900c5d80 con 0x7f60900d1c30 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f60986d2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6090068470 con 0x7f609015a2b0 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f60986d2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900c6060 con 0x7f60900cfe20 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f609015a2b0 0x7f60900b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f609015a2b0 0x7f60900b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51998/0 (socket says 172.21.15.60:51998) 2023-10-08T16:16:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 -- 172.21.15.60:0/1310298089 learned_addr learned my addr 172.21.15.60:0/1310298089 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f6096c6f700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900cfe20 0x7f60900ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 -- 172.21.15.60:0/1310298089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900cfe20 msgr2=0x7f60900ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900cfe20 0x7f60900ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 -- 172.21.15.60:0/1310298089 >> v1:172.21.15.144:6789/0 conn(0x7f60900d1c30 legacy=0x7f60900cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 -- 172.21.15.60:0/1310298089 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900c6340 con 0x7f609015a2b0 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f6096c6f700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900cfe20 0x7f60900ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.688+0000 7f609646e700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f609015a2b0 0x7f60900b3da0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f608c009990 tx=0x7f608c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e9d55c9dc9c035 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f609546c700 1 -- 172.21.15.60:0/1310298089 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c005c10 con 0x7f609015a2b0 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f609546c700 1 -- 172.21.15.60:0/1310298089 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c005d70 con 0x7f609015a2b0 2023-10-08T16:16:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f609546c700 1 -- 172.21.15.60:0/1310298089 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00b880 con 0x7f609015a2b0 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 -- 172.21.15.60:0/1310298089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f609015a2b0 msgr2=0x7f60900b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f609015a2b0 0x7f60900b3da0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f608c009990 tx=0x7f608c009220 comp rx=0 tx=0).stop 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 -- 172.21.15.60:0/1310298089 shutdown_connections 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900cfe20 0x7f60900ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 --2- 172.21.15.60:0/1310298089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f609015a2b0 0x7f60900b3da0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 -- 172.21.15.60:0/1310298089 >> 172.21.15.60:0/1310298089 conn(0x7f6090067e40 msgr2=0x7f60900d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 -- 172.21.15.60:0/1310298089 shutdown_connections 2023-10-08T16:16:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.689+0000 7f60986d2700 1 -- 172.21.15.60:0/1310298089 wait complete. 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.690+0000 7f60986d2700 1 Processor -- start 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.690+0000 7f60986d2700 1 -- start start 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f60986d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 0x7f609015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f60986d2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900d1c30 0x7f60900ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f60986d2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f609015a2b0 0x7f6090159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f60986d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609016b080 con 0x7f60900cfe20 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f60986d2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609015b8c0 con 0x7f609015a2b0 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f60986d2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609016aa30 con 0x7f60900d1c30 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 0x7f609015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 0x7f609015b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52002/0 (socket says 172.21.15.60:52002) 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 -- 172.21.15.60:0/716409083 learned_addr learned my addr 172.21.15.60:0/716409083 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f6095c6d700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900d1c30 0x7f60900ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f6096c6f700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f609015a2b0 0x7f6090159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 -- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900d1c30 msgr2=0x7f60900ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900d1c30 0x7f60900ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 -- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f609015a2b0 msgr2=0x7f6090159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f609015a2b0 0x7f6090159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f609646e700 1 -- 172.21.15.60:0/716409083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009480 con 0x7f60900cfe20 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.691+0000 7f6096c6f700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f609015a2b0 0x7f6090159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.692+0000 7f609646e700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 0x7f609015b030 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f608c005d40 tx=0x7f608c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:11.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.692+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0116d0 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.692+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c020070 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.692+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609016ad10 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.692+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c011a60 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.692+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609015b570 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.693+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609016a8a0 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.693+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f608c022030 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.694+0000 7f60867fc700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.694+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f608c085f00 con 0x7f60900cfe20 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.694+0000 7f6095c6d700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.694+0000 7f6095c6d700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f60900d18a0 tx=0x7f6080009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.698+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f608c053170 con 0x7f60900cfe20 2023-10-08T16:16:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.884+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f609016b1c0 con 0x7f6074066f30 2023-10-08T16:16:11.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.893+0000 7f60867fc700 1 -- 172.21.15.60:0/716409083 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285475 (secure 0 0 0) 0x7f60800015b0 con 0x7f6074066f30 2023-10-08T16:16:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:11.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 msgr2=0x7f60740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f60900d18a0 tx=0x7f6080009040 comp rx=0 tx=0).stop 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 msgr2=0x7f609015b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 0x7f609015b030 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f608c005d40 tx=0x7f608c016000 comp rx=0 tx=0).stop 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 shutdown_connections 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6074066f30 0x7f60740693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f609015a2b0 0x7f6090159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60900cfe20 0x7f609015b030 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 --2- 172.21.15.60:0/716409083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60900d1c30 0x7f60900ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 >> 172.21.15.60:0/716409083 conn(0x7f6090067e40 msgr2=0x7f60900ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 shutdown_connections 2023-10-08T16:16:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:11.896+0000 7f60986d2700 1 -- 172.21.15.60:0/716409083 wait complete. 2023-10-08T16:16:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:16:11.909 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-10-08T16:16:11.707897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553465,"statfs":{"total":1600000000,"available":1590748292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000944"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.436431+0000","last_change":"2023-10-08T16:16:07.433911+0000","last_active":"2023-10-08T16:16:07.436431+0000","last_peered":"2023-10-08T16:16:07.436431+0000","last_clean":"2023-10-08T16:16:07.436431+0000","last_became_active":"2023-10-08T16:16:07.433661+0000","last_became_peered":"2023-10-08T16:16:07.433661+0000","last_unstale":"2023-10-08T16:16:07.436431+0000","last_undegraded":"2023-10-08T16:16:07.436431+0000","last_fullsized":"2023-10-08T16:16:07.436431+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:05.058968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431929+0000","last_change":"2023-10-08T16:16:07.431865+0000","last_active":"2023-10-08T16:16:07.431929+0000","last_peered":"2023-10-08T16:16:07.431929+0000","last_clean":"2023-10-08T16:16:07.431929+0000","last_became_active":"2023-10-08T16:16:07.431442+0000","last_became_peered":"2023-10-08T16:16:07.431442+0000","last_unstale":"2023-10-08T16:16:07.431929+0000","last_undegraded":"2023-10-08T16:16:07.431929+0000","last_fullsized":"2023-10-08T16:16:07.431929+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:32.698770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.443260+0000","last_change":"2023-10-08T16:16:07.443198+0000","last_active":"2023-10-08T16:16:07.443260+0000","last_peered":"2023-10-08T16:16:07.443260+0000","last_clean":"2023-10-08T16:16:07.443260+0000","last_became_active":"2023-10-08T16:16:07.442957+0000","last_became_peered":"2023-10-08T16:16:07.442957+0000","last_unstale":"2023-10-08T16:16:07.443260+0000","last_undegraded":"2023-10-08T16:16:07.443260+0000","last_fullsized":"2023-10-08T16:16:07.443260+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:15.255663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428012+0000","last_change":"2023-10-08T16:16:07.427942+0000","last_active":"2023-10-08T16:16:07.428012+0000","last_peered":"2023-10-08T16:16:07.428012+0000","last_clean":"2023-10-08T16:16:07.428012+0000","last_became_active":"2023-10-08T16:16:07.427674+0000","last_became_peered":"2023-10-08T16:16:07.427674+0000","last_unstale":"2023-10-08T16:16:07.428012+0000","last_undegraded":"2023-10-08T16:16:07.428012+0000","last_fullsized":"2023-10-08T16:16:07.428012+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:17.215343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.437250+0000","last_change":"2023-10-08T16:16:07.437189+0000","last_active":"2023-10-08T16:16:07.437250+0000","last_peered":"2023-10-08T16:16:07.437250+0000","last_clean":"2023-10-08T16:16:07.437250+0000","last_became_active":"2023-10-08T16:16:07.436961+0000","last_became_peered":"2023-10-08T16:16:07.436961+0000","last_unstale":"2023-10-08T16:16:07.437250+0000","last_undegraded":"2023-10-08T16:16:07.437250+0000","last_fullsized":"2023-10-08T16:16:07.437250+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:16.060176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.427371+0000","last_change":"2023-10-08T16:16:07.427289+0000","last_active":"2023-10-08T16:16:07.427371+0000","last_peered":"2023-10-08T16:16:07.427371+0000","last_clean":"2023-10-08T16:16:07.427371+0000","last_became_active":"2023-10-08T16:16:07.426936+0000","last_became_peered":"2023-10-08T16:16:07.426936+0000","last_unstale":"2023-10-08T16:16:07.427371+0000","last_undegraded":"2023-10-08T16:16:07.427371+0000","last_fullsized":"2023-10-08T16:16:07.427371+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:37.366830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.440140+0000","last_change":"2023-10-08T16:16:07.440093+0000","last_active":"2023-10-08T16:16:07.440140+0000","last_peered":"2023-10-08T16:16:07.440140+0000","last_clean":"2023-10-08T16:16:07.440140+0000","last_became_active":"2023-10-08T16:16:07.439957+0000","last_became_peered":"2023-10-08T16:16:07.439957+0000","last_unstale":"2023-10-08T16:16:07.440140+0000","last_undegraded":"2023-10-08T16:16:07.440140+0000","last_fullsized":"2023-10-08T16:16:07.440140+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:00.267222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.443250+0000","last_change":"2023-10-08T16:16:07.443183+0000","last_active":"2023-10-08T16:16:07.443250+0000","last_peered":"2023-10-08T16:16:07.443250+0000","last_clean":"2023-10-08T16:16:07.443250+0000","last_became_active":"2023-10-08T16:16:07.442953+0000","last_became_peered":"2023-10-08T16:16:07.442953+0000","last_unstale":"2023-10-08T16:16:07.443250+0000","last_undegraded":"2023-10-08T16:16:07.443250+0000","last_fullsized":"2023-10-08T16:16:07.443250+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:29.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430142+0000","last_change":"2023-10-08T16:16:07.430078+0000","last_active":"2023-10-08T16:16:07.430142+0000","last_peered":"2023-10-08T16:16:07.430142+0000","last_clean":"2023-10-08T16:16:07.430142+0000","last_became_active":"2023-10-08T16:16:07.429845+0000","last_became_peered":"2023-10-08T16:16:07.429845+0000","last_unstale":"2023-10-08T16:16:07.430142+0000","last_undegraded":"2023-10-08T16:16:07.430142+0000","last_fullsized":"2023-10-08T16:16:07.430142+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:31.708851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.425635+0000","last_change":"2023-10-08T16:16:07.425581+0000","last_active":"2023-10-08T16:16:07.425635+0000","last_peered":"2023-10-08T16:16:07.425635+0000","last_clean":"2023-10-08T16:16:07.425635+0000","last_became_active":"2023-10-08T16:16:07.425343+0000","last_became_peered":"2023-10-08T16:16:07.425343+0000","last_unstale":"2023-10-08T16:16:07.425635+0000","last_undegraded":"2023-10-08T16:16:07.425635+0000","last_fullsized":"2023-10-08T16:16:07.425635+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:35.720310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430717+0000","last_change":"2023-10-08T16:16:07.430659+0000","last_active":"2023-10-08T16:16:07.430717+0000","last_peered":"2023-10-08T16:16:07.430717+0000","last_clean":"2023-10-08T16:16:07.430717+0000","last_became_active":"2023-10-08T16:16:07.430430+0000","last_became_peered":"2023-10-08T16:16:07.430430+0000","last_unstale":"2023-10-08T16:16:07.430717+0000","last_undegraded":"2023-10-08T16:16:07.430717+0000","last_fullsized":"2023-10-08T16:16:07.430717+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:35.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431798+0000","last_change":"2023-10-08T16:16:07.431704+0000","last_active":"2023-10-08T16:16:07.431798+0000","last_peered":"2023-10-08T16:16:07.431798+0000","last_clean":"2023-10-08T16:16:07.431798+0000","last_became_active":"2023-10-08T16:16:07.431137+0000","last_became_peered":"2023-10-08T16:16:07.431137+0000","last_unstale":"2023-10-08T16:16:07.431798+0000","last_undegraded":"2023-10-08T16:16:07.431798+0000","last_fullsized":"2023-10-08T16:16:07.431798+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:17.215343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430084+0000","last_change":"2023-10-08T16:16:07.430028+0000","last_active":"2023-10-08T16:16:07.430084+0000","last_peered":"2023-10-08T16:16:07.430084+0000","last_clean":"2023-10-08T16:16:07.430084+0000","last_became_active":"2023-10-08T16:16:07.429864+0000","last_became_peered":"2023-10-08T16:16:07.429864+0000","last_unstale":"2023-10-08T16:16:07.430084+0000","last_undegraded":"2023-10-08T16:16:07.430084+0000","last_fullsized":"2023-10-08T16:16:07.430084+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:42.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432324+0000","last_change":"2023-10-08T16:16:07.432248+0000","last_active":"2023-10-08T16:16:07.432324+0000","last_peered":"2023-10-08T16:16:07.432324+0000","last_clean":"2023-10-08T16:16:07.432324+0000","last_became_active":"2023-10-08T16:16:07.432030+0000","last_became_peered":"2023-10-08T16:16:07.432030+0000","last_unstale":"2023-10-08T16:16:07.432324+0000","last_undegraded":"2023-10-08T16:16:07.432324+0000","last_fullsized":"2023-10-08T16:16:07.432324+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:51.917262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.437480+0000","last_change":"2023-10-08T16:16:07.437163+0000","last_active":"2023-10-08T16:16:07.437480+0000","last_peered":"2023-10-08T16:16:07.437480+0000","last_clean":"2023-10-08T16:16:07.437480+0000","last_became_active":"2023-10-08T16:16:07.436888+0000","last_became_peered":"2023-10-08T16:16:07.436888+0000","last_unstale":"2023-10-08T16:16:07.437480+0000","last_undegraded":"2023-10-08T16:16:07.437480+0000","last_fullsized":"2023-10-08T16:16:07.437480+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:32.034954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.440268+0000","last_change":"2023-10-08T16:16:07.440191+0000","last_active":"2023-10-08T16:16:07.440268+0000","last_peered":"2023-10-08T16:16:07.440268+0000","last_clean":"2023-10-08T16:16:07.440268+0000","last_became_active":"2023-10-08T16:16:07.439885+0000","last_became_peered":"2023-10-08T16:16:07.439885+0000","last_unstale":"2023-10-08T16:16:07.440268+0000","last_undegraded":"2023-10-08T16:16:07.440268+0000","last_fullsized":"2023-10-08T16:16:07.440268+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:46:15.311811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.427343+0000","last_change":"2023-10-08T16:16:07.426920+0000","last_active":"2023-10-08T16:16:07.427343+0000","last_peered":"2023-10-08T16:16:07.427343+0000","last_clean":"2023-10-08T16:16:07.427343+0000","last_became_active":"2023-10-08T16:16:07.426692+0000","last_became_peered":"2023-10-08T16:16:07.426692+0000","last_unstale":"2023-10-08T16:16:07.427343+0000","last_undegraded":"2023-10-08T16:16:07.427343+0000","last_fullsized":"2023-10-08T16:16:07.427343+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:12.495948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.434932+0000","last_change":"2023-10-08T16:16:07.434786+0000","last_active":"2023-10-08T16:16:07.434932+0000","last_peered":"2023-10-08T16:16:07.434932+0000","last_clean":"2023-10-08T16:16:07.434932+0000","last_became_active":"2023-10-08T16:16:07.434523+0000","last_became_peered":"2023-10-08T16:16:07.434523+0000","last_unstale":"2023-10-08T16:16:07.434932+0000","last_undegraded":"2023-10-08T16:16:07.434932+0000","last_fullsized":"2023-10-08T16:16:07.434932+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:27.457375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432589+0000","last_change":"2023-10-08T16:16:07.432480+0000","last_active":"2023-10-08T16:16:07.432589+0000","last_peered":"2023-10-08T16:16:07.432589+0000","last_clean":"2023-10-08T16:16:07.432589+0000","last_became_active":"2023-10-08T16:16:07.432266+0000","last_became_peered":"2023-10-08T16:16:07.432266+0000","last_unstale":"2023-10-08T16:16:07.432589+0000","last_undegraded":"2023-10-08T16:16:07.432589+0000","last_fullsized":"2023-10-08T16:16:07.432589+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:57.461655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.433437+0000","last_change":"2023-10-08T16:16:07.433382+0000","last_active":"2023-10-08T16:16:07.433437+0000","last_peered":"2023-10-08T16:16:07.433437+0000","last_clean":"2023-10-08T16:16:07.433437+0000","last_became_active":"2023-10-08T16:16:07.432510+0000","last_became_peered":"2023-10-08T16:16:07.432510+0000","last_unstale":"2023-10-08T16:16:07.433437+0000","last_undegraded":"2023-10-08T16:16:07.433437+0000","last_fullsized":"2023-10-08T16:16:07.433437+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:29.461643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.427357+0000","last_change":"2023-10-08T16:16:07.427151+0000","last_active":"2023-10-08T16:16:07.427357+0000","last_peered":"2023-10-08T16:16:07.427357+0000","last_clean":"2023-10-08T16:16:07.427357+0000","last_became_active":"2023-10-08T16:16:07.426615+0000","last_became_peered":"2023-10-08T16:16:07.426615+0000","last_unstale":"2023-10-08T16:16:07.427357+0000","last_undegraded":"2023-10-08T16:16:07.427357+0000","last_fullsized":"2023-10-08T16:16:07.427357+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:25.920198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.436299+0000","last_change":"2023-10-08T16:16:07.436231+0000","last_active":"2023-10-08T16:16:07.436299+0000","last_peered":"2023-10-08T16:16:07.436299+0000","last_clean":"2023-10-08T16:16:07.436299+0000","last_became_active":"2023-10-08T16:16:07.435976+0000","last_became_peered":"2023-10-08T16:16:07.435976+0000","last_unstale":"2023-10-08T16:16:07.436299+0000","last_undegraded":"2023-10-08T16:16:07.436299+0000","last_fullsized":"2023-10-08T16:16:07.436299+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:27.457375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431647+0000","last_change":"2023-10-08T16:16:07.431314+0000","last_active":"2023-10-08T16:16:07.431647+0000","last_peered":"2023-10-08T16:16:07.431647+0000","last_clean":"2023-10-08T16:16:07.431647+0000","last_became_active":"2023-10-08T16:16:07.431042+0000","last_became_peered":"2023-10-08T16:16:07.431042+0000","last_unstale":"2023-10-08T16:16:07.431647+0000","last_undegraded":"2023-10-08T16:16:07.431647+0000","last_fullsized":"2023-10-08T16:16:07.431647+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:09.232720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.425426+0000","last_change":"2023-10-08T16:16:07.425353+0000","last_active":"2023-10-08T16:16:07.425426+0000","last_peered":"2023-10-08T16:16:07.425426+0000","last_clean":"2023-10-08T16:16:07.425426+0000","last_became_active":"2023-10-08T16:16:07.425109+0000","last_became_peered":"2023-10-08T16:16:07.425109+0000","last_unstale":"2023-10-08T16:16:07.425426+0000","last_undegraded":"2023-10-08T16:16:07.425426+0000","last_fullsized":"2023-10-08T16:16:07.425426+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:26.433564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.440393+0000","last_change":"2023-10-08T16:16:07.440327+0000","last_active":"2023-10-08T16:16:07.440393+0000","last_peered":"2023-10-08T16:16:07.440393+0000","last_clean":"2023-10-08T16:16:07.440393+0000","last_became_active":"2023-10-08T16:16:07.440124+0000","last_became_peered":"2023-10-08T16:16:07.440124+0000","last_unstale":"2023-10-08T16:16:07.440393+0000","last_undegraded":"2023-10-08T16:16:07.440393+0000","last_fullsized":"2023-10-08T16:16:07.440393+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:04.172170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428304+0000","last_change":"2023-10-08T16:16:07.427765+0000","last_active":"2023-10-08T16:16:07.428304+0000","last_peered":"2023-10-08T16:16:07.428304+0000","last_clean":"2023-10-08T16:16:07.428304+0000","last_became_active":"2023-10-08T16:16:07.427538+0000","last_became_peered":"2023-10-08T16:16:07.427538+0000","last_unstale":"2023-10-08T16:16:07.428304+0000","last_undegraded":"2023-10-08T16:16:07.428304+0000","last_fullsized":"2023-10-08T16:16:07.428304+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:36.273538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.429369+0000","last_change":"2023-10-08T16:16:07.429299+0000","last_active":"2023-10-08T16:16:07.429369+0000","last_peered":"2023-10-08T16:16:07.429369+0000","last_clean":"2023-10-08T16:16:07.429369+0000","last_became_active":"2023-10-08T16:16:07.429148+0000","last_became_peered":"2023-10-08T16:16:07.429148+0000","last_unstale":"2023-10-08T16:16:07.429369+0000","last_undegraded":"2023-10-08T16:16:07.429369+0000","last_fullsized":"2023-10-08T16:16:07.429369+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.865670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.444430+0000","last_change":"2023-10-08T16:16:07.444365+0000","last_active":"2023-10-08T16:16:07.444430+0000","last_peered":"2023-10-08T16:16:07.444430+0000","last_clean":"2023-10-08T16:16:07.444430+0000","last_became_active":"2023-10-08T16:16:07.444183+0000","last_became_peered":"2023-10-08T16:16:07.444183+0000","last_unstale":"2023-10-08T16:16:07.444430+0000","last_undegraded":"2023-10-08T16:16:07.444430+0000","last_fullsized":"2023-10-08T16:16:07.444430+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:31.708851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430899+0000","last_change":"2023-10-08T16:16:07.430841+0000","last_active":"2023-10-08T16:16:07.430899+0000","last_peered":"2023-10-08T16:16:07.430899+0000","last_clean":"2023-10-08T16:16:07.430899+0000","last_became_active":"2023-10-08T16:16:07.430619+0000","last_became_peered":"2023-10-08T16:16:07.430619+0000","last_unstale":"2023-10-08T16:16:07.430899+0000","last_undegraded":"2023-10-08T16:16:07.430899+0000","last_fullsized":"2023-10-08T16:16:07.430899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:27.606615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.440846+0000","last_change":"2023-10-08T16:16:07.440182+0000","last_active":"2023-10-08T16:16:07.440846+0000","last_peered":"2023-10-08T16:16:07.440846+0000","last_clean":"2023-10-08T16:16:07.440846+0000","last_became_active":"2023-10-08T16:16:07.439947+0000","last_became_peered":"2023-10-08T16:16:07.439947+0000","last_unstale":"2023-10-08T16:16:07.440846+0000","last_undegraded":"2023-10-08T16:16:07.440846+0000","last_fullsized":"2023-10-08T16:16:07.440846+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:21.455359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.439643+0000","last_change":"2023-10-08T16:16:07.436137+0000","last_active":"2023-10-08T16:16:07.439643+0000","last_peered":"2023-10-08T16:16:07.439643+0000","last_clean":"2023-10-08T16:16:07.439643+0000","last_became_active":"2023-10-08T16:16:07.435485+0000","last_became_peered":"2023-10-08T16:16:07.435485+0000","last_unstale":"2023-10-08T16:16:07.439643+0000","last_undegraded":"2023-10-08T16:16:07.439643+0000","last_fullsized":"2023-10-08T16:16:07.439643+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:35.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428744+0000","last_change":"2023-10-08T16:16:07.428208+0000","last_active":"2023-10-08T16:16:07.428744+0000","last_peered":"2023-10-08T16:16:07.428744+0000","last_clean":"2023-10-08T16:16:07.428744+0000","last_became_active":"2023-10-08T16:16:07.427850+0000","last_became_peered":"2023-10-08T16:16:07.427850+0000","last_unstale":"2023-10-08T16:16:07.428744+0000","last_undegraded":"2023-10-08T16:16:07.428744+0000","last_fullsized":"2023-10-08T16:16:07.428744+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:31.789261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432045+0000","last_change":"2023-10-08T16:16:07.429972+0000","last_active":"2023-10-08T16:16:07.432045+0000","last_peered":"2023-10-08T16:16:07.432045+0000","last_clean":"2023-10-08T16:16:07.432045+0000","last_became_active":"2023-10-08T16:16:07.429546+0000","last_became_peered":"2023-10-08T16:16:07.429546+0000","last_unstale":"2023-10-08T16:16:07.432045+0000","last_undegraded":"2023-10-08T16:16:07.432045+0000","last_fullsized":"2023-10-08T16:16:07.432045+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:31.789261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"179'4","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.436953+0000","last_change":"2023-10-08T16:16:06.427001+0000","last_active":"2023-10-08T16:16:07.436953+0000","last_peered":"2023-10-08T16:16:07.436953+0000","last_clean":"2023-10-08T16:16:07.436953+0000","last_became_active":"2023-10-08T16:16:06.426776+0000","last_became_peered":"2023-10-08T16:16:06.426776+0000","last_unstale":"2023-10-08T16:16:07.436953+0000","last_undegraded":"2023-10-08T16:16:07.436953+0000","last_fullsized":"2023-10-08T16:16:07.436953+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:31.696757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.444562+0000","last_change":"2023-10-08T16:16:07.444501+0000","last_active":"2023-10-08T16:16:07.444562+0000","last_peered":"2023-10-08T16:16:07.444562+0000","last_clean":"2023-10-08T16:16:07.444562+0000","last_became_active":"2023-10-08T16:16:07.443593+0000","last_became_peered":"2023-10-08T16:16:07.443593+0000","last_unstale":"2023-10-08T16:16:07.444562+0000","last_undegraded":"2023-10-08T16:16:07.444562+0000","last_fullsized":"2023-10-08T16:16:07.444562+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:26.433564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.441013+0000","last_change":"2023-10-08T16:16:06.431597+0000","last_active":"2023-10-08T16:16:07.441013+0000","last_peered":"2023-10-08T16:16:07.441013+0000","last_clean":"2023-10-08T16:16:07.441013+0000","last_became_active":"2023-10-08T16:16:06.431349+0000","last_became_peered":"2023-10-08T16:16:06.431349+0000","last_unstale":"2023-10-08T16:16:07.441013+0000","last_undegraded":"2023-10-08T16:16:07.441013+0000","last_fullsized":"2023-10-08T16:16:07.441013+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:04.818670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.434229+0000","last_change":"2023-10-08T16:16:07.434171+0000","last_active":"2023-10-08T16:16:07.434229+0000","last_peered":"2023-10-08T16:16:07.434229+0000","last_clean":"2023-10-08T16:16:07.434229+0000","last_became_active":"2023-10-08T16:16:07.433981+0000","last_became_peered":"2023-10-08T16:16:07.433981+0000","last_unstale":"2023-10-08T16:16:07.434229+0000","last_undegraded":"2023-10-08T16:16:07.434229+0000","last_fullsized":"2023-10-08T16:16:07.434229+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:36.114392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.436021+0000","last_change":"2023-10-08T16:16:06.430524+0000","last_active":"2023-10-08T16:16:07.436021+0000","last_peered":"2023-10-08T16:16:07.436021+0000","last_clean":"2023-10-08T16:16:07.436021+0000","last_became_active":"2023-10-08T16:16:06.430184+0000","last_became_peered":"2023-10-08T16:16:06.430184+0000","last_unstale":"2023-10-08T16:16:07.436021+0000","last_undegraded":"2023-10-08T16:16:07.436021+0000","last_fullsized":"2023-10-08T16:16:07.436021+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:05.339287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.426431+0000","last_change":"2023-10-08T16:16:07.426364+0000","last_active":"2023-10-08T16:16:07.426431+0000","last_peered":"2023-10-08T16:16:07.426431+0000","last_clean":"2023-10-08T16:16:07.426431+0000","last_became_active":"2023-10-08T16:16:07.426106+0000","last_became_peered":"2023-10-08T16:16:07.426106+0000","last_unstale":"2023-10-08T16:16:07.426431+0000","last_undegraded":"2023-10-08T16:16:07.426431+0000","last_fullsized":"2023-10-08T16:16:07.426431+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:58.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.435733+0000","last_change":"2023-10-08T16:16:06.427311+0000","last_active":"2023-10-08T16:16:07.435733+0000","last_peered":"2023-10-08T16:16:07.435733+0000","last_clean":"2023-10-08T16:16:07.435733+0000","last_became_active":"2023-10-08T16:16:06.427045+0000","last_became_peered":"2023-10-08T16:16:06.427045+0000","last_unstale":"2023-10-08T16:16:07.435733+0000","last_undegraded":"2023-10-08T16:16:07.435733+0000","last_fullsized":"2023-10-08T16:16:07.435733+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:09.893034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.434973+0000","last_change":"2023-10-08T16:16:07.434908+0000","last_active":"2023-10-08T16:16:07.434973+0000","last_peered":"2023-10-08T16:16:07.434973+0000","last_clean":"2023-10-08T16:16:07.434973+0000","last_became_active":"2023-10-08T16:16:07.434675+0000","last_became_peered":"2023-10-08T16:16:07.434675+0000","last_unstale":"2023-10-08T16:16:07.434973+0000","last_undegraded":"2023-10-08T16:16:07.434973+0000","last_fullsized":"2023-10-08T16:16:07.434973+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:33.568309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.437447+0000","last_change":"2023-10-08T16:16:06.428069+0000","last_active":"2023-10-08T16:16:07.437447+0000","last_peered":"2023-10-08T16:16:07.437447+0000","last_clean":"2023-10-08T16:16:07.437447+0000","last_became_active":"2023-10-08T16:16:06.427828+0000","last_became_peered":"2023-10-08T16:16:06.427828+0000","last_unstale":"2023-10-08T16:16:07.437447+0000","last_undegraded":"2023-10-08T16:16:07.437447+0000","last_fullsized":"2023-10-08T16:16:07.437447+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:31.054607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.434864+0000","last_change":"2023-10-08T16:16:07.434093+0000","last_active":"2023-10-08T16:16:07.434864+0000","last_peered":"2023-10-08T16:16:07.434864+0000","last_clean":"2023-10-08T16:16:07.434864+0000","last_became_active":"2023-10-08T16:16:07.433556+0000","last_became_peered":"2023-10-08T16:16:07.433556+0000","last_unstale":"2023-10-08T16:16:07.434864+0000","last_undegraded":"2023-10-08T16:16:07.434864+0000","last_fullsized":"2023-10-08T16:16:07.434864+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:35.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432953+0000","last_change":"2023-10-08T16:16:06.421596+0000","last_active":"2023-10-08T16:16:07.432953+0000","last_peered":"2023-10-08T16:16:07.432953+0000","last_clean":"2023-10-08T16:16:07.432953+0000","last_became_active":"2023-10-08T16:16:06.421330+0000","last_became_peered":"2023-10-08T16:16:06.421330+0000","last_unstale":"2023-10-08T16:16:07.432953+0000","last_undegraded":"2023-10-08T16:16:07.432953+0000","last_fullsized":"2023-10-08T16:16:07.432953+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:26.945014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432262+0000","last_change":"2023-10-08T16:16:07.431877+0000","last_active":"2023-10-08T16:16:07.432262+0000","last_peered":"2023-10-08T16:16:07.432262+0000","last_clean":"2023-10-08T16:16:07.432262+0000","last_became_active":"2023-10-08T16:16:07.431425+0000","last_became_peered":"2023-10-08T16:16:07.431425+0000","last_unstale":"2023-10-08T16:16:07.432262+0000","last_undegraded":"2023-10-08T16:16:07.432262+0000","last_fullsized":"2023-10-08T16:16:07.432262+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:35.720310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.421030+0000","last_change":"2023-10-08T16:16:06.430616+0000","last_active":"2023-10-08T16:16:07.421030+0000","last_peered":"2023-10-08T16:16:07.421030+0000","last_clean":"2023-10-08T16:16:07.421030+0000","last_became_active":"2023-10-08T16:16:06.430086+0000","last_became_peered":"2023-10-08T16:16:06.430086+0000","last_unstale":"2023-10-08T16:16:07.421030+0000","last_undegraded":"2023-10-08T16:16:07.421030+0000","last_fullsized":"2023-10-08T16:16:07.421030+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:07.401665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428975+0000","last_change":"2023-10-08T16:16:07.428907+0000","last_active":"2023-10-08T16:16:07.428975+0000","last_peered":"2023-10-08T16:16:07.428975+0000","last_clean":"2023-10-08T16:16:07.428975+0000","last_became_active":"2023-10-08T16:16:07.428678+0000","last_became_peered":"2023-10-08T16:16:07.428678+0000","last_unstale":"2023-10-08T16:16:07.428975+0000","last_undegraded":"2023-10-08T16:16:07.428975+0000","last_fullsized":"2023-10-08T16:16:07.428975+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:08.902140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.424807+0000","last_change":"2023-10-08T16:16:06.425245+0000","last_active":"2023-10-08T16:16:07.424807+0000","last_peered":"2023-10-08T16:16:07.424807+0000","last_clean":"2023-10-08T16:16:07.424807+0000","last_became_active":"2023-10-08T16:16:06.425013+0000","last_became_peered":"2023-10-08T16:16:06.425013+0000","last_unstale":"2023-10-08T16:16:07.424807+0000","last_undegraded":"2023-10-08T16:16:07.424807+0000","last_fullsized":"2023-10-08T16:16:07.424807+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:16.213331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428764+0000","last_change":"2023-10-08T16:16:07.428502+0000","last_active":"2023-10-08T16:16:07.428764+0000","last_peered":"2023-10-08T16:16:07.428764+0000","last_clean":"2023-10-08T16:16:07.428764+0000","last_became_active":"2023-10-08T16:16:07.427951+0000","last_became_peered":"2023-10-08T16:16:07.427951+0000","last_unstale":"2023-10-08T16:16:07.428764+0000","last_undegraded":"2023-10-08T16:16:07.428764+0000","last_fullsized":"2023-10-08T16:16:07.428764+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:32.034954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.422264+0000","last_change":"2023-10-08T16:16:06.424769+0000","last_active":"2023-10-08T16:16:07.422264+0000","last_peered":"2023-10-08T16:16:07.422264+0000","last_clean":"2023-10-08T16:16:07.422264+0000","last_became_active":"2023-10-08T16:16:06.424511+0000","last_became_peered":"2023-10-08T16:16:06.424511+0000","last_unstale":"2023-10-08T16:16:07.422264+0000","last_undegraded":"2023-10-08T16:16:07.422264+0000","last_fullsized":"2023-10-08T16:16:07.422264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:46.550066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430294+0000","last_change":"2023-10-08T16:16:07.429954+0000","last_active":"2023-10-08T16:16:07.430294+0000","last_peered":"2023-10-08T16:16:07.430294+0000","last_clean":"2023-10-08T16:16:07.430294+0000","last_became_active":"2023-10-08T16:16:07.429266+0000","last_became_peered":"2023-10-08T16:16:07.429266+0000","last_unstale":"2023-10-08T16:16:07.430294+0000","last_undegraded":"2023-10-08T16:16:07.430294+0000","last_fullsized":"2023-10-08T16:16:07.430294+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:29.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"179'3","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.437896+0000","last_change":"2023-10-08T16:16:06.426990+0000","last_active":"2023-10-08T16:16:07.437896+0000","last_peered":"2023-10-08T16:16:07.437896+0000","last_clean":"2023-10-08T16:16:07.437896+0000","last_became_active":"2023-10-08T16:16:06.426687+0000","last_became_peered":"2023-10-08T16:16:06.426687+0000","last_unstale":"2023-10-08T16:16:07.437896+0000","last_undegraded":"2023-10-08T16:16:07.437896+0000","last_fullsized":"2023-10-08T16:16:07.437896+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:35.024857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.444303+0000","last_change":"2023-10-08T16:16:07.444248+0000","last_active":"2023-10-08T16:16:07.444303+0000","last_peered":"2023-10-08T16:16:07.444303+0000","last_clean":"2023-10-08T16:16:07.444303+0000","last_became_active":"2023-10-08T16:16:07.443184+0000","last_became_peered":"2023-10-08T16:16:07.443184+0000","last_unstale":"2023-10-08T16:16:07.444303+0000","last_undegraded":"2023-10-08T16:16:07.444303+0000","last_fullsized":"2023-10-08T16:16:07.444303+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:16.060176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"179'6","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.441813+0000","last_change":"2023-10-08T16:16:06.425957+0000","last_active":"2023-10-08T16:16:07.441813+0000","last_peered":"2023-10-08T16:16:07.441813+0000","last_clean":"2023-10-08T16:16:07.441813+0000","last_became_active":"2023-10-08T16:16:06.425296+0000","last_became_peered":"2023-10-08T16:16:06.425296+0000","last_unstale":"2023-10-08T16:16:07.441813+0000","last_undegraded":"2023-10-08T16:16:07.441813+0000","last_fullsized":"2023-10-08T16:16:07.441813+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:05.339287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428779+0000","last_change":"2023-10-08T16:16:07.428656+0000","last_active":"2023-10-08T16:16:07.428779+0000","last_peered":"2023-10-08T16:16:07.428779+0000","last_clean":"2023-10-08T16:16:07.428779+0000","last_became_active":"2023-10-08T16:16:07.428273+0000","last_became_peered":"2023-10-08T16:16:07.428273+0000","last_unstale":"2023-10-08T16:16:07.428779+0000","last_undegraded":"2023-10-08T16:16:07.428779+0000","last_fullsized":"2023-10-08T16:16:07.428779+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:43.863143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.436604+0000","last_change":"2023-10-08T16:16:06.424869+0000","last_active":"2023-10-08T16:16:07.436604+0000","last_peered":"2023-10-08T16:16:07.436604+0000","last_clean":"2023-10-08T16:16:07.436604+0000","last_became_active":"2023-10-08T16:16:06.424592+0000","last_became_peered":"2023-10-08T16:16:06.424592+0000","last_unstale":"2023-10-08T16:16:07.436604+0000","last_undegraded":"2023-10-08T16:16:07.436604+0000","last_fullsized":"2023-10-08T16:16:07.436604+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:04.818670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.435981+0000","last_change":"2023-10-08T16:16:07.435899+0000","last_active":"2023-10-08T16:16:07.435981+0000","last_peered":"2023-10-08T16:16:07.435981+0000","last_clean":"2023-10-08T16:16:07.435981+0000","last_became_active":"2023-10-08T16:16:07.435656+0000","last_became_peered":"2023-10-08T16:16:07.435656+0000","last_unstale":"2023-10-08T16:16:07.435981+0000","last_undegraded":"2023-10-08T16:16:07.435981+0000","last_fullsized":"2023-10-08T16:16:07.435981+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:19.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.425489+0000","last_change":"2023-10-08T16:16:06.429056+0000","last_active":"2023-10-08T16:16:07.425489+0000","last_peered":"2023-10-08T16:16:07.425489+0000","last_clean":"2023-10-08T16:16:07.425489+0000","last_became_active":"2023-10-08T16:16:06.428317+0000","last_became_peered":"2023-10-08T16:16:06.428317+0000","last_unstale":"2023-10-08T16:16:07.425489+0000","last_undegraded":"2023-10-08T16:16:07.425489+0000","last_fullsized":"2023-10-08T16:16:07.425489+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:05.478351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.424124+0000","last_change":"2023-10-08T16:16:07.423853+0000","last_active":"2023-10-08T16:16:07.424124+0000","last_peered":"2023-10-08T16:16:07.424124+0000","last_clean":"2023-10-08T16:16:07.424124+0000","last_became_active":"2023-10-08T16:16:07.423597+0000","last_became_peered":"2023-10-08T16:16:07.423597+0000","last_unstale":"2023-10-08T16:16:07.424124+0000","last_undegraded":"2023-10-08T16:16:07.424124+0000","last_fullsized":"2023-10-08T16:16:07.424124+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:26.433564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.419689+0000","last_change":"2023-10-08T16:16:06.433023+0000","last_active":"2023-10-08T16:16:07.419689+0000","last_peered":"2023-10-08T16:16:07.419689+0000","last_clean":"2023-10-08T16:16:07.419689+0000","last_became_active":"2023-10-08T16:16:06.432749+0000","last_became_peered":"2023-10-08T16:16:06.432749+0000","last_unstale":"2023-10-08T16:16:07.419689+0000","last_undegraded":"2023-10-08T16:16:07.419689+0000","last_fullsized":"2023-10-08T16:16:07.419689+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:07.401665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.437637+0000","last_change":"2023-10-08T16:16:07.437575+0000","last_active":"2023-10-08T16:16:07.437637+0000","last_peered":"2023-10-08T16:16:07.437637+0000","last_clean":"2023-10-08T16:16:07.437637+0000","last_became_active":"2023-10-08T16:16:07.437312+0000","last_became_peered":"2023-10-08T16:16:07.437312+0000","last_unstale":"2023-10-08T16:16:07.437637+0000","last_undegraded":"2023-10-08T16:16:07.437637+0000","last_fullsized":"2023-10-08T16:16:07.437637+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:26.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"179'8","reported_seq":18,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.444163+0000","last_change":"2023-10-08T16:16:06.429617+0000","last_active":"2023-10-08T16:16:07.444163+0000","last_peered":"2023-10-08T16:16:07.444163+0000","last_clean":"2023-10-08T16:16:07.444163+0000","last_became_active":"2023-10-08T16:16:06.428994+0000","last_became_peered":"2023-10-08T16:16:06.428994+0000","last_unstale":"2023-10-08T16:16:07.444163+0000","last_undegraded":"2023-10-08T16:16:07.444163+0000","last_fullsized":"2023-10-08T16:16:07.444163+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:58.733492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431797+0000","last_change":"2023-10-08T16:16:07.431662+0000","last_active":"2023-10-08T16:16:07.431797+0000","last_peered":"2023-10-08T16:16:07.431797+0000","last_clean":"2023-10-08T16:16:07.431797+0000","last_became_active":"2023-10-08T16:16:07.430646+0000","last_became_peered":"2023-10-08T16:16:07.430646+0000","last_unstale":"2023-10-08T16:16:07.431797+0000","last_undegraded":"2023-10-08T16:16:07.431797+0000","last_fullsized":"2023-10-08T16:16:07.431797+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:32.698770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431613+0000","last_change":"2023-10-08T16:16:06.431064+0000","last_active":"2023-10-08T16:16:07.431613+0000","last_peered":"2023-10-08T16:16:07.431613+0000","last_clean":"2023-10-08T16:16:07.431613+0000","last_became_active":"2023-10-08T16:16:06.430861+0000","last_became_peered":"2023-10-08T16:16:06.430861+0000","last_unstale":"2023-10-08T16:16:07.431613+0000","last_undegraded":"2023-10-08T16:16:07.431613+0000","last_fullsized":"2023-10-08T16:16:07.431613+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:11.493936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.437141+0000","last_change":"2023-10-08T16:16:07.437086+0000","last_active":"2023-10-08T16:16:07.437141+0000","last_peered":"2023-10-08T16:16:07.437141+0000","last_clean":"2023-10-08T16:16:07.437141+0000","last_became_active":"2023-10-08T16:16:07.436856+0000","last_became_peered":"2023-10-08T16:16:07.436856+0000","last_unstale":"2023-10-08T16:16:07.437141+0000","last_undegraded":"2023-10-08T16:16:07.437141+0000","last_fullsized":"2023-10-08T16:16:07.437141+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:05.058968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.433246+0000","last_change":"2023-10-08T16:16:06.431066+0000","last_active":"2023-10-08T16:16:07.433246+0000","last_peered":"2023-10-08T16:16:07.433246+0000","last_clean":"2023-10-08T16:16:07.433246+0000","last_became_active":"2023-10-08T16:16:06.430688+0000","last_became_peered":"2023-10-08T16:16:06.430688+0000","last_unstale":"2023-10-08T16:16:07.433246+0000","last_undegraded":"2023-10-08T16:16:07.433246+0000","last_fullsized":"2023-10-08T16:16:07.433246+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:08.230708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.434899+0000","last_change":"2023-10-08T16:16:07.434242+0000","last_active":"2023-10-08T16:16:07.434899+0000","last_peered":"2023-10-08T16:16:07.434899+0000","last_clean":"2023-10-08T16:16:07.434899+0000","last_became_active":"2023-10-08T16:16:07.433860+0000","last_became_peered":"2023-10-08T16:16:07.433860+0000","last_unstale":"2023-10-08T16:16:07.434899+0000","last_undegraded":"2023-10-08T16:16:07.434899+0000","last_fullsized":"2023-10-08T16:16:07.434899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:56.647170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"179'1","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.439987+0000","last_change":"2023-10-08T16:16:06.431011+0000","last_active":"2023-10-08T16:16:07.439987+0000","last_peered":"2023-10-08T16:16:07.439987+0000","last_clean":"2023-10-08T16:16:07.439987+0000","last_became_active":"2023-10-08T16:16:06.430471+0000","last_became_peered":"2023-10-08T16:16:06.430471+0000","last_unstale":"2023-10-08T16:16:07.439987+0000","last_undegraded":"2023-10-08T16:16:07.439987+0000","last_fullsized":"2023-10-08T16:16:07.439987+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:34.718297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432078+0000","last_change":"2023-10-08T16:16:07.430282+0000","last_active":"2023-10-08T16:16:07.432078+0000","last_peered":"2023-10-08T16:16:07.432078+0000","last_clean":"2023-10-08T16:16:07.432078+0000","last_became_active":"2023-10-08T16:16:07.430055+0000","last_became_peered":"2023-10-08T16:16:07.430055+0000","last_unstale":"2023-10-08T16:16:07.432078+0000","last_undegraded":"2023-10-08T16:16:07.432078+0000","last_fullsized":"2023-10-08T16:16:07.432078+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:49.695822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.425187+0000","last_change":"2023-10-08T16:16:06.431889+0000","last_active":"2023-10-08T16:16:07.425187+0000","last_peered":"2023-10-08T16:16:07.425187+0000","last_clean":"2023-10-08T16:16:07.425187+0000","last_became_active":"2023-10-08T16:16:06.431649+0000","last_became_peered":"2023-10-08T16:16:06.431649+0000","last_unstale":"2023-10-08T16:16:07.425187+0000","last_undegraded":"2023-10-08T16:16:07.425187+0000","last_fullsized":"2023-10-08T16:16:07.425187+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:16.213331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430779+0000","last_change":"2023-10-08T16:16:07.430738+0000","last_active":"2023-10-08T16:16:07.430779+0000","last_peered":"2023-10-08T16:16:07.430779+0000","last_clean":"2023-10-08T16:16:07.430779+0000","last_became_active":"2023-10-08T16:16:07.430428+0000","last_became_peered":"2023-10-08T16:16:07.430428+0000","last_unstale":"2023-10-08T16:16:07.430779+0000","last_undegraded":"2023-10-08T16:16:07.430779+0000","last_fullsized":"2023-10-08T16:16:07.430779+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:33.058570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431975+0000","last_change":"2023-10-08T16:16:06.428729+0000","last_active":"2023-10-08T16:16:07.431975+0000","last_peered":"2023-10-08T16:16:07.431975+0000","last_clean":"2023-10-08T16:16:07.431975+0000","last_became_active":"2023-10-08T16:16:06.428461+0000","last_became_peered":"2023-10-08T16:16:06.428461+0000","last_unstale":"2023-10-08T16:16:07.431975+0000","last_undegraded":"2023-10-08T16:16:07.431975+0000","last_fullsized":"2023-10-08T16:16:07.431975+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:03.170158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.439530+0000","last_change":"2023-10-08T16:16:07.439411+0000","last_active":"2023-10-08T16:16:07.439530+0000","last_peered":"2023-10-08T16:16:07.439530+0000","last_clean":"2023-10-08T16:16:07.439530+0000","last_became_active":"2023-10-08T16:16:07.439169+0000","last_became_peered":"2023-10-08T16:16:07.439169+0000","last_unstale":"2023-10-08T16:16:07.439530+0000","last_undegraded":"2023-10-08T16:16:07.439530+0000","last_fullsized":"2023-10-08T16:16:07.439530+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:45:16.834280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.427845+0000","last_change":"2023-10-08T16:16:06.428282+0000","last_active":"2023-10-08T16:16:07.427845+0000","last_peered":"2023-10-08T16:16:07.427845+0000","last_clean":"2023-10-08T16:16:07.427845+0000","last_became_active":"2023-10-08T16:16:06.428001+0000","last_became_peered":"2023-10-08T16:16:06.428001+0000","last_unstale":"2023-10-08T16:16:07.427845+0000","last_undegraded":"2023-10-08T16:16:07.427845+0000","last_fullsized":"2023-10-08T16:16:07.427845+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:25.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.432525+0000","last_change":"2023-10-08T16:16:07.432421+0000","last_active":"2023-10-08T16:16:07.432525+0000","last_peered":"2023-10-08T16:16:07.432525+0000","last_clean":"2023-10-08T16:16:07.432525+0000","last_became_active":"2023-10-08T16:16:07.431838+0000","last_became_peered":"2023-10-08T16:16:07.431838+0000","last_unstale":"2023-10-08T16:16:07.432525+0000","last_undegraded":"2023-10-08T16:16:07.432525+0000","last_fullsized":"2023-10-08T16:16:07.432525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:59.353120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.419976+0000","last_change":"2023-10-08T16:16:06.430332+0000","last_active":"2023-10-08T16:16:07.419976+0000","last_peered":"2023-10-08T16:16:07.419976+0000","last_clean":"2023-10-08T16:16:07.419976+0000","last_became_active":"2023-10-08T16:16:06.429155+0000","last_became_peered":"2023-10-08T16:16:06.429155+0000","last_unstale":"2023-10-08T16:16:07.419976+0000","last_undegraded":"2023-10-08T16:16:07.419976+0000","last_fullsized":"2023-10-08T16:16:07.419976+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:39.693417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.433804+0000","last_change":"2023-10-08T16:16:07.433629+0000","last_active":"2023-10-08T16:16:07.433804+0000","last_peered":"2023-10-08T16:16:07.433804+0000","last_clean":"2023-10-08T16:16:07.433804+0000","last_became_active":"2023-10-08T16:16:07.432987+0000","last_became_peered":"2023-10-08T16:16:07.432987+0000","last_unstale":"2023-10-08T16:16:07.433804+0000","last_undegraded":"2023-10-08T16:16:07.433804+0000","last_fullsized":"2023-10-08T16:16:07.433804+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:44.171824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.431549+0000","last_change":"2023-10-08T16:16:06.431162+0000","last_active":"2023-10-08T16:16:07.431549+0000","last_peered":"2023-10-08T16:16:07.431549+0000","last_clean":"2023-10-08T16:16:07.431549+0000","last_became_active":"2023-10-08T16:16:06.430772+0000","last_became_peered":"2023-10-08T16:16:06.430772+0000","last_unstale":"2023-10-08T16:16:07.431549+0000","last_undegraded":"2023-10-08T16:16:07.431549+0000","last_fullsized":"2023-10-08T16:16:07.431549+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:30.706839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430276+0000","last_change":"2023-10-08T16:16:07.429714+0000","last_active":"2023-10-08T16:16:07.430276+0000","last_peered":"2023-10-08T16:16:07.430276+0000","last_clean":"2023-10-08T16:16:07.430276+0000","last_became_active":"2023-10-08T16:16:07.429059+0000","last_became_peered":"2023-10-08T16:16:07.429059+0000","last_unstale":"2023-10-08T16:16:07.430276+0000","last_undegraded":"2023-10-08T16:16:07.430276+0000","last_fullsized":"2023-10-08T16:16:07.430276+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:50.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"179'2","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.435344+0000","last_change":"2023-10-08T16:16:06.432795+0000","last_active":"2023-10-08T16:16:07.435344+0000","last_peered":"2023-10-08T16:16:07.435344+0000","last_clean":"2023-10-08T16:16:07.435344+0000","last_became_active":"2023-10-08T16:16:06.432550+0000","last_became_peered":"2023-10-08T16:16:06.432550+0000","last_unstale":"2023-10-08T16:16:07.435344+0000","last_undegraded":"2023-10-08T16:16:07.435344+0000","last_fullsized":"2023-10-08T16:16:07.435344+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:20.453347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.435851+0000","last_change":"2023-10-08T16:16:07.435796+0000","last_active":"2023-10-08T16:16:07.435851+0000","last_peered":"2023-10-08T16:16:07.435851+0000","last_clean":"2023-10-08T16:16:07.435851+0000","last_became_active":"2023-10-08T16:16:07.435557+0000","last_became_peered":"2023-10-08T16:16:07.435557+0000","last_unstale":"2023-10-08T16:16:07.435851+0000","last_undegraded":"2023-10-08T16:16:07.435851+0000","last_fullsized":"2023-10-08T16:16:07.435851+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:49.765396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.423063+0000","last_change":"2023-10-08T16:16:06.428441+0000","last_active":"2023-10-08T16:16:07.423063+0000","last_peered":"2023-10-08T16:16:07.423063+0000","last_clean":"2023-10-08T16:16:07.423063+0000","last_became_active":"2023-10-08T16:16:06.427978+0000","last_became_peered":"2023-10-08T16:16:06.427978+0000","last_unstale":"2023-10-08T16:16:07.423063+0000","last_undegraded":"2023-10-08T16:16:07.423063+0000","last_fullsized":"2023-10-08T16:16:07.423063+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:07.900127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.433818+0000","last_change":"2023-10-08T16:16:07.433755+0000","last_active":"2023-10-08T16:16:07.433818+0000","last_peered":"2023-10-08T16:16:07.433818+0000","last_clean":"2023-10-08T16:16:07.433818+0000","last_became_active":"2023-10-08T16:16:07.433254+0000","last_became_peered":"2023-10-08T16:16:07.433254+0000","last_unstale":"2023-10-08T16:16:07.433818+0000","last_undegraded":"2023-10-08T16:16:07.433818+0000","last_fullsized":"2023-10-08T16:16:07.433818+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:34.856359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.421135+0000","last_change":"2023-10-08T16:16:06.431950+0000","last_active":"2023-10-08T16:16:07.421135+0000","last_peered":"2023-10-08T16:16:07.421135+0000","last_clean":"2023-10-08T16:16:07.421135+0000","last_became_active":"2023-10-08T16:16:06.431693+0000","last_became_peered":"2023-10-08T16:16:06.431693+0000","last_unstale":"2023-10-08T16:16:07.421135+0000","last_undegraded":"2023-10-08T16:16:07.421135+0000","last_fullsized":"2023-10-08T16:16:07.421135+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:58.733492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430310+0000","last_change":"2023-10-08T16:16:07.430109+0000","last_active":"2023-10-08T16:16:07.430310+0000","last_peered":"2023-10-08T16:16:07.430310+0000","last_clean":"2023-10-08T16:16:07.430310+0000","last_became_active":"2023-10-08T16:16:07.429720+0000","last_became_peered":"2023-10-08T16:16:07.429720+0000","last_unstale":"2023-10-08T16:16:07.430310+0000","last_undegraded":"2023-10-08T16:16:07.430310+0000","last_fullsized":"2023-10-08T16:16:07.430310+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:59.353120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.425712+0000","last_change":"2023-10-08T16:16:06.429871+0000","last_active":"2023-10-08T16:16:07.425712+0000","last_peered":"2023-10-08T16:16:07.425712+0000","last_clean":"2023-10-08T16:16:07.425712+0000","last_became_active":"2023-10-08T16:16:06.429274+0000","last_became_peered":"2023-10-08T16:16:06.429274+0000","last_unstale":"2023-10-08T16:16:07.425712+0000","last_undegraded":"2023-10-08T16:16:07.425712+0000","last_fullsized":"2023-10-08T16:16:07.425712+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:45.922270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428725+0000","last_change":"2023-10-08T16:16:07.428068+0000","last_active":"2023-10-08T16:16:07.428725+0000","last_peered":"2023-10-08T16:16:07.428725+0000","last_clean":"2023-10-08T16:16:07.428725+0000","last_became_active":"2023-10-08T16:16:07.427589+0000","last_became_peered":"2023-10-08T16:16:07.427589+0000","last_unstale":"2023-10-08T16:16:07.428725+0000","last_undegraded":"2023-10-08T16:16:07.428725+0000","last_fullsized":"2023-10-08T16:16:07.428725+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:26.595204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.429028+0000","last_change":"2023-10-08T16:16:06.430314+0000","last_active":"2023-10-08T16:16:07.429028+0000","last_peered":"2023-10-08T16:16:07.429028+0000","last_clean":"2023-10-08T16:16:07.429028+0000","last_became_active":"2023-10-08T16:16:06.429995+0000","last_became_peered":"2023-10-08T16:16:06.429995+0000","last_unstale":"2023-10-08T16:16:07.429028+0000","last_undegraded":"2023-10-08T16:16:07.429028+0000","last_fullsized":"2023-10-08T16:16:07.429028+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:08.161237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.439663+0000","last_change":"2023-10-08T16:16:07.436272+0000","last_active":"2023-10-08T16:16:07.439663+0000","last_peered":"2023-10-08T16:16:07.439663+0000","last_clean":"2023-10-08T16:16:07.439663+0000","last_became_active":"2023-10-08T16:16:07.435809+0000","last_became_peered":"2023-10-08T16:16:07.435809+0000","last_unstale":"2023-10-08T16:16:07.439663+0000","last_undegraded":"2023-10-08T16:16:07.439663+0000","last_fullsized":"2023-10-08T16:16:07.439663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:29.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.419791+0000","last_change":"2023-10-08T16:16:06.428076+0000","last_active":"2023-10-08T16:16:07.419791+0000","last_peered":"2023-10-08T16:16:07.419791+0000","last_clean":"2023-10-08T16:16:07.419791+0000","last_became_active":"2023-10-08T16:16:06.427849+0000","last_became_peered":"2023-10-08T16:16:06.427849+0000","last_unstale":"2023-10-08T16:16:07.419791+0000","last_undegraded":"2023-10-08T16:16:07.419791+0000","last_fullsized":"2023-10-08T16:16:07.419791+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:50:58.733492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.439553+0000","last_change":"2023-10-08T16:16:07.439458+0000","last_active":"2023-10-08T16:16:07.439553+0000","last_peered":"2023-10-08T16:16:07.439553+0000","last_clean":"2023-10-08T16:16:07.439553+0000","last_became_active":"2023-10-08T16:16:07.439239+0000","last_became_peered":"2023-10-08T16:16:07.439239+0000","last_unstale":"2023-10-08T16:16:07.439553+0000","last_undegraded":"2023-10-08T16:16:07.439553+0000","last_fullsized":"2023-10-08T16:16:07.439553+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:36.320767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.420914+0000","last_change":"2023-10-08T16:16:06.431927+0000","last_active":"2023-10-08T16:16:07.420914+0000","last_peered":"2023-10-08T16:16:07.420914+0000","last_clean":"2023-10-08T16:16:07.420914+0000","last_became_active":"2023-10-08T16:16:06.431661+0000","last_became_peered":"2023-10-08T16:16:06.431661+0000","last_unstale":"2023-10-08T16:16:07.420914+0000","last_undegraded":"2023-10-08T16:16:07.420914+0000","last_fullsized":"2023-10-08T16:16:07.420914+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:05.339287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.435156+0000","last_change":"2023-10-08T16:16:07.434965+0000","last_active":"2023-10-08T16:16:07.435156+0000","last_peered":"2023-10-08T16:16:07.435156+0000","last_clean":"2023-10-08T16:16:07.435156+0000","last_became_active":"2023-10-08T16:16:07.433987+0000","last_became_peered":"2023-10-08T16:16:07.433987+0000","last_unstale":"2023-10-08T16:16:07.435156+0000","last_undegraded":"2023-10-08T16:16:07.435156+0000","last_fullsized":"2023-10-08T16:16:07.435156+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:12.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.430333+0000","last_change":"2023-10-08T16:16:06.426102+0000","last_active":"2023-10-08T16:16:07.430333+0000","last_peered":"2023-10-08T16:16:07.430333+0000","last_clean":"2023-10-08T16:16:07.430333+0000","last_became_active":"2023-10-08T16:16:06.425670+0000","last_became_peered":"2023-10-08T16:16:06.425670+0000","last_unstale":"2023-10-08T16:16:07.430333+0000","last_undegraded":"2023-10-08T16:16:07.430333+0000","last_fullsized":"2023-10-08T16:16:07.430333+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:09.893034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.433710+0000","last_change":"2023-10-08T16:16:07.430719+0000","last_active":"2023-10-08T16:16:07.433710+0000","last_peered":"2023-10-08T16:16:07.433710+0000","last_clean":"2023-10-08T16:16:07.433710+0000","last_became_active":"2023-10-08T16:16:07.430493+0000","last_became_peered":"2023-10-08T16:16:07.430493+0000","last_unstale":"2023-10-08T16:16:07.433710+0000","last_undegraded":"2023-10-08T16:16:07.433710+0000","last_fullsized":"2023-10-08T16:16:07.433710+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:06.410770+0000","last_clean_scrub_stamp":"2023-10-08T16:16:06.410770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:33.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.428931+0000","last_change":"2023-10-08T16:16:06.429760+0000","last_active":"2023-10-08T16:16:07.428931+0000","last_peered":"2023-10-08T16:16:07.428931+0000","last_clean":"2023-10-08T16:16:07.428931+0000","last_became_active":"2023-10-08T16:16:06.429496+0000","last_became_peered":"2023-10-08T16:16:06.429496+0000","last_unstale":"2023-10-08T16:16:07.428931+0000","last_undegraded":"2023-10-08T16:16:07.428931+0000","last_fullsized":"2023-10-08T16:16:07.428931+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:16:05.408758+0000","last_clean_scrub_stamp":"2023-10-08T16:16:05.408758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:07.401665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":308,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T16:16:07.427940+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:16:07.427940+0000","last_peered":"2023-10-08T16:16:07.427940+0000","last_clean":"2023-10-08T16:16:07.427940+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:07.427940+0000","last_undegraded":"2023-10-08T16:16:07.427940+0000","last_fullsized":"2023-10-08T16:16:07.427940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1563,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193749,"statfs":{"total":200000000,"available":198399087,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.76700000000000002,"15min":0.78400000000000003},"last":0.505}]},{"osd":1,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74199999999999999,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69599999999999995,"5min":0.871,"15min":1.0089999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71099999999999997,"5min":0.83599999999999997,"15min":1.79},"last":0.59799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.44600000000000001,"15min":0.46800000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56599999999999995,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.60499999999999998,"15min":0.52100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":11.891,"15min":11.891},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.625,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72299999999999998,"5min":0.78000000000000003,"15min":1.252},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574986,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991683,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.53000000000000003},"min":{"1min":0.35599999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.135,"15min":1.135},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":1.169,"15min":1.169},"last":0.51600000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.27500000000000002},"max":{"1min":0.80800000000000005,"5min":3.738,"15min":3.738},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61799999999999999,"15min":0.57499999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.83099999999999996,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":1.103,"15min":1.103},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57199999999999995,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.67700000000000005,"5min":3.516,"15min":3.516},"last":0.436},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57199999999999995,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":1.502,"15min":1.502},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.28899999999999998,"5min":0.26500000000000001,"15min":0.249},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.76900000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.56799999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.28799999999999998,"15min":0.27500000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.92000000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":1.0089999999999999},"last":0.46000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.67300000000000004,"5min":0.76300000000000001,"15min":0.79300000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.58899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991671,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.42899999999999999},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.182},"max":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":3.593},"last":0.318},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.33100000000000002,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.36899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.245},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.28199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.22900000000000001},"max":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.61899999999999999,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.27100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63900000000000001,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":0.90600000000000003,"15min":3.5630000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.93200000000000005},"last":0.748}]},{"osd":5,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63600000000000001,"15min":0.61699999999999999},"min":{"1min":0.42599999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.82699999999999996,"5min":0.93700000000000006,"15min":1.7030000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63600000000000001,"15min":0.68700000000000006},"min":{"1min":0.49099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84299999999999997,"5min":1.0149999999999999,"15min":3.532},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65400000000000003,"15min":0.69699999999999995},"min":{"1min":0.44,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":3.4929999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91600000000000004,"15min":1.095},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574986,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1561,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193751,"statfs":{"total":200000000,"available":198401337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.372,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.224,"15min":0.20200000000000001},"max":{"1min":0.61499999999999999,"5min":0.76700000000000002,"15min":1.571},"last":0.318},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.64300000000000002,"5min":0.879,"15min":3.044},"last":0.35999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56599999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":0.754,"15min":3.1150000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.68300000000000005},"min":{"1min":0.53700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":3.1589999999999998},"last":0.626},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.401},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":1.046,"15min":1.4590000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.6459999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.38600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6919999999999999},"last":0.502},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.66600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.92200000000000004,"15min":3.665},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":1.01,"15min":3.7160000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83399999999999996,"5min":1.123,"15min":1.5109999999999999},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991615,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.23200000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.65500000000000003},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.40899999999999997,"15min":0.433},"min":{"1min":0.30399999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.59899999999999998,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.379}]},{"osd":1,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.219},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.746},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.20899999999999999},"max":{"1min":0.68100000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.315}]},{"osd":3,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44600000000000001,"15min":0.441},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":1.3260000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.374,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.42299999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79200000000000004,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.97499999999999998},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.62,"15min":0.64600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84399999999999997,"5min":0.873,"15min":2.9319999999999999},"last":0.496}]},{"osd":6,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":1.091},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63800000000000001,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.91000000000000003,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.439},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.63500000000000001},"min":{"1min":0.44500000000000001,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.073},"last":0.39400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991671,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.246},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.57399999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.67800000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.44400000000000001,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.63600000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.26400000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.98499999999999999,"15min":1.0640000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.29799999999999999},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.625}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68400000000000005,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.66500000000000004},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.83499999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":986,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990099,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":1.141},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.149},"last":0.66200000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":7.4749999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.33200000000000002},"max":{"1min":0.73099999999999998,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.60299999999999998},"min":{"1min":0.35499999999999998,"5min":0.33200000000000002,"15min":0.32100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":14.6},"last":0.68400000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.80000000000000004,"15min":7.556},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.85899999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.79400000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.46400000000000002},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63800000000000001,"5min":0.66600000000000004,"15min":0.754},"last":0.38200000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.83999999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.85799999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574986,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48499999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.54800000000000004},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.76400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.86499999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.71199999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.89400000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.84699999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.76000000000000001,"15min":0.77800000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82399999999999995},"last":0.74099999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:16:11.916 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:16:11.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:16:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.074+0000 7f58fa649700 1 Processor -- start 2023-10-08T16:16:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.074+0000 7f58fa649700 1 -- start start 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58fa649700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f41542a0 0x7f58f40b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58fa649700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f406b0a0 con 0x7f58f40cd630 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58fa649700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f415ad20 con 0x7f58f406aa00 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58fa649700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415b2e0 con 0x7f58f41542a0 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58f8e46700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f58f40cd630 0x7f58f406a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40008/0 (socket says 172.21.15.60:40008) 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58f8e46700 1 -- 172.21.15.60:0/1594708099 learned_addr learned my addr 172.21.15.60:0/1594708099 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58f9647700 1 --2- 172.21.15.60:0/1594708099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f41542a0 0x7f58f40b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.075+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677749320 0 0) 0x7f58f406b0a0 con 0x7f58f40cd630 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58dc003570 con 0x7f58f40cd630 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589606258 0 0) 0x7f58f415ad20 con 0x7f58f406aa00 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58f406b0a0 con 0x7f58f406aa00 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f9647700 1 -- 172.21.15.60:0/1594708099 >> v1:172.21.15.144:6789/0 conn(0x7f58f406aa00 legacy=0x7f58f415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f9647700 1 -- 172.21.15.60:0/1594708099 >> v1:172.21.15.60:6789/0 conn(0x7f58f40cd630 legacy=0x7f58f406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f9647700 1 -- 172.21.15.60:0/1594708099 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f415b000 con 0x7f58f41542a0 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f9647700 1 --2- 172.21.15.60:0/1594708099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f41542a0 0x7f58f40b65a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009900 tx=0x7f58ec009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19fcfc3ff860da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec005c10 con 0x7f58f41542a0 2023-10-08T16:16:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec005d70 con 0x7f58f41542a0 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58f3fff700 1 -- 172.21.15.60:0/1594708099 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec006260 con 0x7f58f41542a0 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58fa649700 1 -- 172.21.15.60:0/1594708099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f41542a0 msgr2=0x7f58f40b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.076+0000 7f58fa649700 1 --2- 172.21.15.60:0/1594708099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f41542a0 0x7f58f40b65a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009900 tx=0x7f58ec009120 comp rx=0 tx=0).stop 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.077+0000 7f58fa649700 1 -- 172.21.15.60:0/1594708099 shutdown_connections 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.077+0000 7f58fa649700 1 --2- 172.21.15.60:0/1594708099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f41542a0 0x7f58f40b65a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.077+0000 7f58fa649700 1 -- 172.21.15.60:0/1594708099 >> 172.21.15.60:0/1594708099 conn(0x7f58f4068cb0 msgr2=0x7f58f40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.077+0000 7f58fa649700 1 -- 172.21.15.60:0/1594708099 shutdown_connections 2023-10-08T16:16:12.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.077+0000 7f58fa649700 1 -- 172.21.15.60:0/1594708099 wait complete. 2023-10-08T16:16:12.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.078+0000 7f58fa649700 1 Processor -- start 2023-10-08T16:16:12.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.078+0000 7f58fa649700 1 -- start start 2023-10-08T16:16:12.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f406aa00 0x7f58f4159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58f40cd630 0x7f58f416e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 0x7f58f4169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f416e5a0 con 0x7f58f41542a0 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4159f10 con 0x7f58f40cd630 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f416a520 con 0x7f58f406aa00 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 0x7f58f4169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 0x7f58f4169fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52006/0 (socket says 172.21.15.60:52006) 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9647700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f406aa00 0x7f58f4159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 -- 172.21.15.60:0/850125914 learned_addr learned my addr 172.21.15.60:0/850125914 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f8e46700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58f40cd630 0x7f58f416e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 -- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f406aa00 msgr2=0x7f58f4159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f406aa00 0x7f58f4159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 -- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58f40cd630 msgr2=0x7f58f416e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58f40cd630 0x7f58f416e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 -- 172.21.15.60:0/850125914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec0093c0 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f9e48700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 0x7f58f4169fe0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f58e400c910 tx=0x7f58e4002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4012630 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e40127b0 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4012b70 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f4155af0 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.079+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f41560b0 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.080+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f4089550 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.081+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58e401b400 con 0x7f58f41542a0 2023-10-08T16:16:12.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.081+0000 7f58f17fa700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.081+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58e4084780 con 0x7f58f41542a0 2023-10-08T16:16:12.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.081+0000 7f58f9647700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.082+0000 7f58f9647700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f58e0066f30 0x7f58e00693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009160 tx=0x7f58ec016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:12.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.085+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58e4051aa0 con 0x7f58f41542a0 2023-10-08T16:16:12.254 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-10-08T16:16:12.253+0000 7f043a1ea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:16:12.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.359+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f58f415d610 con 0x7f58f41542a0 2023-10-08T16:16:12.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.362+0000 7f58f17fa700 1 -- 172.21.15.60:0/850125914 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f58e40550c0 con 0x7f58f41542a0 2023-10-08T16:16:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.364+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f58e0066f30 msgr2=0x7f58e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.364+0000 7f58fa649700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f58e0066f30 0x7f58e00693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009160 tx=0x7f58ec016000 comp rx=0 tx=0).stop 2023-10-08T16:16:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.364+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 msgr2=0x7f58f4169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.364+0000 7f58fa649700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 0x7f58f4169fe0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f58e400c910 tx=0x7f58e4002720 comp rx=0 tx=0).stop 2023-10-08T16:16:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 shutdown_connections 2023-10-08T16:16:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f58f406aa00 0x7f58f4159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f41542a0 0x7f58f4169fe0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 --2- 172.21.15.60:0/850125914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58f40cd630 0x7f58f416e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 >> 172.21.15.60:0/850125914 conn(0x7f58f4068cb0 msgr2=0x7f58f40b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 shutdown_connections 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.365+0000 7f58fa649700 1 -- 172.21.15.60:0/850125914 wait complete. 2023-10-08T16:16:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-08T16:16:12.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:12.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.496+0000 7fa893637700 1 Processor -- start 2023-10-08T16:16:12.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.496+0000 7fa893637700 1 -- start start 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.497+0000 7fa893637700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa88c157ba0 0x7fa88c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.497+0000 7fa893637700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 0x7fa88c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.497+0000 7fa893637700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c15c360 con 0x7fa88c1577d0 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.497+0000 7fa893637700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c15b790 con 0x7fa88c157ba0 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.497+0000 7fa893637700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c15d800 con 0x7fa88c15b0d0 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa891bd4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 0x7fa88c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa88c157ba0 0x7fa88c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa891bd4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 0x7fa88c06aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:35428/0 (socket says 172.21.15.60:35428) 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa891bd4700 1 -- 172.21.15.60:0/3984382024 learned_addr learned my addr 172.21.15.60:0/3984382024 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa88c157ba0 0x7fa88c06a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:39348/0 (socket says 172.21.15.60:39348) 2023-10-08T16:16:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 -- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 msgr2=0x7fa88c06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 --2- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 0x7fa88c06aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 -- 172.21.15.60:0/3984382024 >> v1:172.21.15.144:6789/0 conn(0x7fa88c1577d0 legacy=0x7fa88c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 -- 172.21.15.60:0/3984382024 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c15ba30 con 0x7fa88c157ba0 2023-10-08T16:16:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa88bfff700 1 -- 172.21.15.60:0/3984382024 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089119579 0 0) 0x7fa88c15c360 con 0x7fa88c1577d0 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa891bd4700 1 --2- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 0x7fa88c06aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa890bd2700 1 --2- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c157ba0 0x7fa88c06a520 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67b3ed730cae71b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa88bfff700 1 -- 172.21.15.60:0/3984382024 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000b640 con 0x7fa88c157ba0 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa88bfff700 1 -- 172.21.15.60:0/3984382024 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000b7a0 con 0x7fa88c157ba0 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.498+0000 7fa88bfff700 1 -- 172.21.15.60:0/3984382024 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bb40 con 0x7fa88c157ba0 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 -- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c157ba0 msgr2=0x7fa88c06a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 --2- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c157ba0 0x7fa88c06a520 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 -- 172.21.15.60:0/3984382024 shutdown_connections 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 --2- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c15b0d0 0x7fa88c06aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 --2- 172.21.15.60:0/3984382024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c157ba0 0x7fa88c06a520 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 -- 172.21.15.60:0/3984382024 >> 172.21.15.60:0/3984382024 conn(0x7fa88c068ce0 msgr2=0x7fa88c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 -- 172.21.15.60:0/3984382024 shutdown_connections 2023-10-08T16:16:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.499+0000 7fa893637700 1 -- 172.21.15.60:0/3984382024 wait complete. 2023-10-08T16:16:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.500+0000 7fa893637700 1 Processor -- start 2023-10-08T16:16:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.500+0000 7fa893637700 1 -- start start 2023-10-08T16:16:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa893637700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c1577d0 0x7fa88c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa893637700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c157ba0 0x7fa88c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa893637700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 0x7fa88c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa893637700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b1d30 con 0x7fa88c15b0d0 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa893637700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b2010 con 0x7fa88c1577d0 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa893637700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b22f0 con 0x7fa88c157ba0 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa891bd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 0x7fa88c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa891bd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 0x7fa88c158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52852/0 (socket says 172.21.15.60:52852) 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa891bd4700 1 -- 172.21.15.60:0/3706132963 learned_addr learned my addr 172.21.15.60:0/3706132963 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa8913d3700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c1577d0 0x7fa88c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.501+0000 7fa890bd2700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c157ba0 0x7fa88c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa891bd4700 1 -- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c157ba0 msgr2=0x7fa88c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa891bd4700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c157ba0 0x7fa88c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa891bd4700 1 -- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c1577d0 msgr2=0x7fa88c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa891bd4700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c1577d0 0x7fa88c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa891bd4700 1 -- 172.21.15.60:0/3706132963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0094f0 con 0x7fa88c15b0d0 2023-10-08T16:16:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa891bd4700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 0x7fa88c158fb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00ea40 tx=0x7fa87c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00c850 con 0x7fa88c15b0d0 2023-10-08T16:16:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00c9b0 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa880009420 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00cd50 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.502+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c14e1d0 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.503+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c0b2810 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.503+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa87c013680 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.504+0000 7fa8897fa700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa878066f30 0x7fa8780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.504+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa87c0847f0 con 0x7fa88c15b0d0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.504+0000 7fa8913d3700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa878066f30 0x7fa8780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.504+0000 7fa8913d3700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa878066f30 0x7fa8780693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa884001560 tx=0x7fa884009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.508+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa88c0b2810 con 0x7fa88c15b0d0 2023-10-08T16:16:12.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.745+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa88c0b2810 con 0x7fa88c15b0d0 2023-10-08T16:16:12.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.745+0000 7fa8897fa700 1 -- 172.21.15.60:0/3706132963 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fa88c0b2810 con 0x7fa88c15b0d0 2023-10-08T16:16:12.747 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:12.747 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa878066f30 msgr2=0x7fa8780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa878066f30 0x7fa8780693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa884001560 tx=0x7fa884009040 comp rx=0 tx=0).stop 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 msgr2=0x7fa88c158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 0x7fa88c158fb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00ea40 tx=0x7fa87c009250 comp rx=0 tx=0).stop 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 shutdown_connections 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa878066f30 0x7fa8780693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa88c15b0d0 0x7fa88c158fb0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa88c1577d0 0x7fa88c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 --2- 172.21.15.60:0/3706132963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa88c157ba0 0x7fa88c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.747+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 >> 172.21.15.60:0/3706132963 conn(0x7fa88c068ce0 msgr2=0x7fa88c14f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.748+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 shutdown_connections 2023-10-08T16:16:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:12.748+0000 7fa893637700 1 -- 172.21.15.60:0/3706132963 wait complete. 2023-10-08T16:16:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:13.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:16:06.823556+0000', 'modified': '2023-10-08T16:16:10.438211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8196}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8196': {'gid': 8196, 'name': 'd', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/4049453252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6833', 'nonce': 4049453252}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 4049453252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:16:13.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:16:13.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T16:16:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.285+0000 7fbfa8a45700 1 Processor -- start 2023-10-08T16:16:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.285+0000 7fbfa8a45700 1 -- start start 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa8a45700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40adfa0 0x7fbfa406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa8a45700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa40cf080 con 0x7fbfa4159e70 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa8a45700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa40cf890 con 0x7fbfa4159aa0 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa8a45700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40c9e60 con 0x7fbfa40adfa0 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbfa4159e70 0x7fbfa40cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58408/0 (socket says 172.21.15.60:58408) 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa3fff700 1 -- 172.21.15.60:0/1051223952 learned_addr learned my addr 172.21.15.60:0/1051223952 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/1051223952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40adfa0 0x7fbfa406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974381927 0 0) 0x7fbfa40cf080 con 0x7fbfa4159e70 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c003570 con 0x7fbfa4159e70 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187505828 0 0) 0x7fbfa40cf890 con 0x7fbfa4159aa0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa40cf080 con 0x7fbfa4159aa0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/1051223952 >> v1:172.21.15.144:6789/0 conn(0x7fbfa4159aa0 legacy=0x7fbfa40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/1051223952 >> v1:172.21.15.60:6789/0 conn(0x7fbfa4159e70 legacy=0x7fbfa40cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.286+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/1051223952 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40cf2d0 con 0x7fbfa40adfa0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/1051223952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40adfa0 0x7fbfa406f150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009910 tx=0x7fbf980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11706bf211bc5d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011630 con 0x7fbfa40adfa0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98011790 con 0x7fbfa40adfa0 2023-10-08T16:16:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa27fc700 1 -- 172.21.15.60:0/1051223952 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011b30 con 0x7fbfa40adfa0 2023-10-08T16:16:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 -- 172.21.15.60:0/1051223952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40adfa0 msgr2=0x7fbfa406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/1051223952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40adfa0 0x7fbfa406f150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009910 tx=0x7fbf980091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 -- 172.21.15.60:0/1051223952 shutdown_connections 2023-10-08T16:16:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/1051223952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40adfa0 0x7fbfa406f150 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 -- 172.21.15.60:0/1051223952 >> 172.21.15.60:0/1051223952 conn(0x7fbfa406c700 msgr2=0x7fbfa40ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 -- 172.21.15.60:0/1051223952 shutdown_connections 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.287+0000 7fbfa8a45700 1 -- 172.21.15.60:0/1051223952 wait complete. 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 Processor -- start 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 -- start start 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 0x7fbfa4153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa4159e70 0x7fbfa40c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40c6410 0x7fbfa40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40ac190 con 0x7fbfa4159aa0 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40c8840 con 0x7fbfa4159e70 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa8a45700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40ab580 con 0x7fbfa40c6410 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.289+0000 7fbfa37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 0x7fbfa4153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 0x7fbfa4153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52866/0 (socket says 172.21.15.60:52866) 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 -- 172.21.15.60:0/3089983096 learned_addr learned my addr 172.21.15.60:0/3089983096 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa4159e70 0x7fbfa40c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa3fff700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40c6410 0x7fbfa40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 -- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40c6410 msgr2=0x7fbfa40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40c6410 0x7fbfa40c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 -- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa4159e70 msgr2=0x7fbfa40c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa4159e70 0x7fbfa40c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 -- 172.21.15.60:0/3089983096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009420 con 0x7fbfa4159aa0 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa4159e70 0x7fbfa40c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa3fff700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40c6410 0x7fbfa40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 0x7fbfa4153120 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400c790 tx=0x7fbf94007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbf8b7fe700 1 -- 172.21.15.60:0/3089983096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94010510 con 0x7fbfa4159aa0 2023-10-08T16:16:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbf8b7fe700 1 -- 172.21.15.60:0/3089983096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94010670 con 0x7fbfa4159aa0 2023-10-08T16:16:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa40ab860 con 0x7fbfa4159aa0 2023-10-08T16:16:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbf8b7fe700 1 -- 172.21.15.60:0/3089983096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94010a10 con 0x7fbfa4159aa0 2023-10-08T16:16:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.290+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa40abe20 con 0x7fbfa4159aa0 2023-10-08T16:16:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.292+0000 7fbf8b7fe700 1 -- 172.21.15.60:0/3089983096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf9401b400 con 0x7fbfa4159aa0 2023-10-08T16:16:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.292+0000 7fbf8b7fe700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf90066f30 0x7fbf900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.292+0000 7fbf8b7fe700 1 -- 172.21.15.60:0/3089983096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf94084380 con 0x7fbfa4159aa0 2023-10-08T16:16:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.292+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf90066f30 0x7fbf900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.292+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf90066f30 0x7fbf900693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009860 tx=0x7fbf98017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.294+0000 7fbfb2f9fb80 1 Processor -- start 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.294+0000 7fbfb2f9fb80 1 -- start start 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e72fca70 con 0x55e9e73a5b80 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e72fa270 con 0x55e9e73a35f0 2023-10-08T16:16:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9e72f6060 con 0x55e9e73f0480 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52878/0 (socket says 172.21.15.60:52878) 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 -- 172.21.15.60:0/2883219810 learned_addr learned my addr 172.21.15.60:0/2883219810 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 -- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 msgr2=0x55e9e73cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 -- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 msgr2=0x55e9e73f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 -- 172.21.15.60:0/2883219810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9e7190270 con 0x55e9e73a5b80 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbfa3fff700 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a5ff0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c002080 tx=0x7fbf9c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab1c2828dec5470 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.295+0000 7fbf88ff9700 1 -- 172.21.15.60:0/2883219810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00b070 con 0x55e9e73a5b80 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbf88ff9700 1 -- 172.21.15.60:0/2883219810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00dcb0 con 0x55e9e73a5b80 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbf88ff9700 1 -- 172.21.15.60:0/2883219810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c013680 con 0x55e9e73a5b80 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2883219810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 msgr2=0x55e9e73a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a5ff0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c002080 tx=0x7fbf9c009040 comp rx=0 tx=0).stop 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2883219810 shutdown_connections 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a5ff0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2883219810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2883219810 >> 172.21.15.60:0/2883219810 conn(0x55e9e73a70c0 msgr2=0x55e9e73a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2883219810 shutdown_connections 2023-10-08T16:16:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.296+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2883219810 wait complete. 2023-10-08T16:16:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.297+0000 7fbfb2f9fb80 1 -- start start 2023-10-08T16:16:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.297+0000 7fbfb2f9fb80 1 Processor -- start 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73d4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73d5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e72a1890 con 0x55e9e73a5b80 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e72bcea0 con 0x55e9e73a35f0 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9e7178e30 con 0x55e9e73f0480 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 10 client.0 _ll_register_callbacks cb 0x55e9e73692c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73d4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73d4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52892/0 (socket says 172.21.15.60:52892) 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/343753411 learned_addr learned my addr 172.21.15.60:0/343753411 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 msgr2=0x55e9e73d5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73d5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 msgr2=0x55e9e73ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/343753411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c003570 con 0x55e9e73a5b80 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73d4e50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4072020 tx=0x7fbf98020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d415d21878ec87f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbf81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbf81ffb700 1 -- 172.21.15.60:0/343753411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98020070 con 0x55e9e73a5b80 2023-10-08T16:16:13.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbf81ffb700 1 -- 172.21.15.60:0/343753411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf9801ac10 con 0x55e9e73a5b80 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.298+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9e739acd0 con 0x55e9e73a5b80 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbf81ffb700 1 -- 172.21.15.60:0/343753411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf98026410 con 0x55e9e73a5b80 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 10 client.8319 fetch_fsmap learned FSMap version 92 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55e9e7132fe0 con 0x55e9e73a5b80 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbf81ffb700 1 -- 172.21.15.60:0/343753411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9e739acd0 con 0x55e9e73a5b80 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbf81ffb700 1 -- 172.21.15.60:0/343753411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbf98030070 con 0x55e9e73a5b80 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 10 client.8319 fetch_fsmap finished waiting for FSMap version 92 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 10 client.8319 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 20 client.8319 populate_metadata read hostname 'smithi060' 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e73d1310 0x55e9e7409ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 4 client.8319 mds_command: new command op to 8196 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:16:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 --> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9e7377aa0 con 0x55e9e73d1310 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.299+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e73d1310 0x55e9e7409ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbf81ffb700 10 client.8319 ms_handle_connect on v2:172.21.15.144:6833/4049453252 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e73d1310 0x55e9e7409ce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5890ed7ec36e0528 server_cookie=45a43e8b2d7c8336 in_seq=0 out_seq=0 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbf81ffb700 1 -- 172.21.15.60:0/343753411 <== mds.0 v2:172.21.15.144:6833/4049453252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e9e7377aa0 con 0x55e9e73d1310 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbf81ffb700 10 client.8319 handle_command_reply: tid=0 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbfb2f9fb80 1 client.8319 shutdown 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 msgr2=0x55e9e73d4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73d4e50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4072020 tx=0x7fbf98020000 comp rx=0 tx=0).stop 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.300+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 shutdown_connections 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e73d5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e73d1310 0x55e9e7409ce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/343753411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73d4e50 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbf81ffb700 0 client.8319 ms_handle_reset on v2:172.21.15.144:6833/4049453252 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 >> 172.21.15.60:0/343753411 conn(0x55e9e73a70c0 msgr2=0x55e9e73a9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 shutdown_connections 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/343753411 wait complete. 2023-10-08T16:16:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.301+0000 7fbfb2f9fb80 20 client.8319 trim_cache size 0 max 16384 2023-10-08T16:16:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 Processor -- start 2023-10-08T16:16:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 -- start start 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e739bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e73a1ed0 con 0x55e9e73a35f0 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e73d38a0 con 0x55e9e73a5b80 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9e73a23d0 con 0x55e9e73f0480 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfa37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.318+0000 7fbfa37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52902/0 (socket says 172.21.15.60:52902) 2023-10-08T16:16:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 -- 172.21.15.60:0/2830906274 learned_addr learned my addr 172.21.15.60:0/2830906274 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 -- 172.21.15.60:0/2830906274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 msgr2=0x55e9e739bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e739bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 -- 172.21.15.60:0/2830906274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a5b80 msgr2=0x55e9e73a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 -- 172.21.15.60:0/2830906274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9e72c4780 con 0x55e9e73a35f0 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fbf94054fb0 tx=0x7fbf94014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eaa08c21fa2d34d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbf897fa700 1 -- 172.21.15.60:0/2830906274 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf940829b0 con 0x55e9e73a35f0 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbf897fa700 1 -- 172.21.15.60:0/2830906274 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf940533f0 con 0x55e9e73a35f0 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbf897fa700 1 -- 172.21.15.60:0/2830906274 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94053650 con 0x55e9e73a35f0 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2830906274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 msgr2=0x55e9e73a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.319+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fbf94054fb0 tx=0x7fbf94014040 comp rx=0 tx=0).stop 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2830906274 shutdown_connections 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e739bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/2830906274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2830906274 >> 172.21.15.60:0/2830906274 conn(0x55e9e73a70c0 msgr2=0x55e9e73d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2830906274 shutdown_connections 2023-10-08T16:16:13.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/2830906274 wait complete. 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 -- start start 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.320+0000 7fbfb2f9fb80 1 Processor -- start 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e7407f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e7453760 con 0x55e9e73a5b80 2023-10-08T16:16:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9e744d240 con 0x55e9e73a35f0 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9e740a6a0 con 0x55e9e73f0480 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfb2f9fb80 10 client.0 _ll_register_callbacks cb 0x55e9e73692c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52910/0 (socket says 172.21.15.60:52910) 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/4253035023 learned_addr learned my addr 172.21.15.60:0/4253035023 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa3fff700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e7407f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 msgr2=0x55e9e7407f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e7407f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 msgr2=0x55e9e73a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 -- 172.21.15.60:0/4253035023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa40abe20 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbfa2ffd700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fbf98033bc0 tx=0x7fbf9802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b25924ad2ba713e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.321+0000 7fbf81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbf81ffb700 1 -- 172.21.15.60:0/4253035023 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98020040 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbf81ffb700 1 -- 172.21.15.60:0/4253035023 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf9801ab10 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf9c00dcb0 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbf81ffb700 1 -- 172.21.15.60:0/4253035023 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf9800b600 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 10 client.8325 fetch_fsmap learned FSMap version 92 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55e9e72ab470 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbf81ffb700 1 -- 172.21.15.60:0/4253035023 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00dcb0 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbf81ffb700 1 -- 172.21.15.60:0/4253035023 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbf9801a420 con 0x55e9e73a5b80 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 10 client.8325 fetch_fsmap finished waiting for FSMap version 92 2023-10-08T16:16:13.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 10 client.8325 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 20 client.8325 populate_metadata read hostname 'smithi060' 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e7408690 0x55e9e73cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 4 client.8325 mds_command: new command op to 8196 tid=0[{"prefix": "status"}] 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 --> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9e7298e00 con 0x55e9e7408690 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.322+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e7408690 0x55e9e73cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbf81ffb700 10 client.8325 ms_handle_connect on v2:172.21.15.144:6833/4049453252 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfa37fe700 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e7408690 0x55e9e73cdd80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1eb9feb810a8e1 server_cookie=eda9df44205e1b93 in_seq=0 out_seq=0 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbf81ffb700 1 -- 172.21.15.60:0/4253035023 <== mds.0 v2:172.21.15.144:6833/4049453252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55e9e7298e00 con 0x55e9e7408690 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbf81ffb700 10 client.8325 handle_command_reply: tid=0 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 client.8325 shutdown 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 msgr2=0x55e9e73a6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fbf98033bc0 tx=0x7fbf9802e000 comp rx=0 tx=0).stop 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 shutdown_connections 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55e9e73f0480 0x55e9e7407f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:6833/4049453252,v1:172.21.15.144:6835/4049453252] conn(0x55e9e7408690 0x55e9e73cdd80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e9e73a35f0 0x55e9e73a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbf81ffb700 0 client.8325 ms_handle_reset on v2:172.21.15.144:6833/4049453252 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 --2- 172.21.15.60:0/4253035023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9e73a5b80 0x55e9e73a6490 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 >> 172.21.15.60:0/4253035023 conn(0x55e9e73a70c0 msgr2=0x55e9e73ef9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 shutdown_connections 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.323+0000 7fbfb2f9fb80 1 -- 172.21.15.60:0/4253035023 wait complete. 2023-10-08T16:16:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfb2f9fb80 20 client.8325 trim_cache size 0 max 16384 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 8196, 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 5.9063909839999997, 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 92, 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 180, 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 180, 2023-10-08T16:16:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11.462515875999999 2023-10-08T16:16:13.333 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf90066f30 msgr2=0x7fbf900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf90066f30 0x7fbf900693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009860 tx=0x7fbf98017000 comp rx=0 tx=0).stop 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 msgr2=0x7fbfa4153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 0x7fbfa4153120 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400c790 tx=0x7fbf94007e10 comp rx=0 tx=0).stop 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 shutdown_connections 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbf90066f30 0x7fbf900693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbfa40c6410 0x7fbfa40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa4159aa0 0x7fbfa4153120 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 --2- 172.21.15.60:0/3089983096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa4159e70 0x7fbfa40c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 >> 172.21.15.60:0/3089983096 conn(0x7fbfa406c700 msgr2=0x7fbfa415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 shutdown_connections 2023-10-08T16:16:13.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.324+0000 7fbfa8a45700 1 -- 172.21.15.60:0/3089983096 wait complete. 2023-10-08T16:16:13.337 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:16:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.455+0000 7ff38f571700 1 Processor -- start 2023-10-08T16:16:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.456+0000 7ff38f571700 1 -- start start 2023-10-08T16:16:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.456+0000 7ff38f571700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff3880b1220 0x7ff3880c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.456+0000 7ff38f571700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3880cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.456+0000 7ff38f571700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38815de60 con 0x7ff3880b0e50 2023-10-08T16:16:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.456+0000 7ff38f571700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3880cbed0 con 0x7ff3880b1220 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.456+0000 7ff38f571700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38815e140 con 0x7ff3880cb4f0 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38d30d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff3880b0e50 0x7ff38806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58424/0 (socket says 172.21.15.60:58424) 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38d30d700 1 -- 172.21.15.60:0/304745821 learned_addr learned my addr 172.21.15.60:0/304745821 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38db0e700 1 --2- 172.21.15.60:0/304745821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3880cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38cb0c700 1 --2- 172.21.15.60:0/304745821 >> v2:172.21.15.144:3300/0 conn(0x7ff3880b1220 0x7ff3880c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff387fff700 1 -- 172.21.15.60:0/304745821 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105737607 0 0) 0x7ff38815de60 con 0x7ff3880b0e50 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff387fff700 1 -- 172.21.15.60:0/304745821 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff370003570 con 0x7ff3880b0e50 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38db0e700 1 -- 172.21.15.60:0/304745821 >> v2:172.21.15.144:3300/0 conn(0x7ff3880b1220 msgr2=0x7ff3880c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38db0e700 1 --2- 172.21.15.60:0/304745821 >> v2:172.21.15.144:3300/0 conn(0x7ff3880b1220 0x7ff3880c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38db0e700 1 -- 172.21.15.60:0/304745821 >> v1:172.21.15.60:6789/0 conn(0x7ff3880b0e50 legacy=0x7ff38806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38db0e700 1 -- 172.21.15.60:0/304745821 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38815e420 con 0x7ff3880cb4f0 2023-10-08T16:16:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38cb0c700 1 --2- 172.21.15.60:0/304745821 >> v2:172.21.15.144:3300/0 conn(0x7ff3880b1220 0x7ff3880c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff38db0e700 1 --2- 172.21.15.60:0/304745821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3880cb990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098e0 tx=0x7ff3780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=543980ce458a442f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.457+0000 7ff387fff700 1 -- 172.21.15.60:0/304745821 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378011630 con 0x7ff3880cb4f0 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff387fff700 1 -- 172.21.15.60:0/304745821 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378011790 con 0x7ff3880cb4f0 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff387fff700 1 -- 172.21.15.60:0/304745821 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378011b30 con 0x7ff3880cb4f0 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 -- 172.21.15.60:0/304745821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 msgr2=0x7ff3880cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 --2- 172.21.15.60:0/304745821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3880cb990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098e0 tx=0x7ff3780091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 -- 172.21.15.60:0/304745821 shutdown_connections 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 --2- 172.21.15.60:0/304745821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3880cb990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 --2- 172.21.15.60:0/304745821 >> v2:172.21.15.144:3300/0 conn(0x7ff3880b1220 0x7ff3880c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 -- 172.21.15.60:0/304745821 >> 172.21.15.60:0/304745821 conn(0x7ff388069870 msgr2=0x7ff388069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 -- 172.21.15.60:0/304745821 shutdown_connections 2023-10-08T16:16:13.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.458+0000 7ff38f571700 1 -- 172.21.15.60:0/304745821 wait complete. 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.459+0000 7ff38f571700 1 Processor -- start 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.459+0000 7ff38f571700 1 -- start start 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38f571700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3880b0e50 0x7ff388153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38f571700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 0x7ff3881553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38f571700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3881558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38f571700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388156b20 con 0x7ff3880b1220 2023-10-08T16:16:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38f571700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880b44a0 con 0x7ff3880b0e50 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38f571700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff388155f10 con 0x7ff3880cb4f0 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38cb0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 0x7ff3881553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38cb0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 0x7ff3881553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52914/0 (socket says 172.21.15.60:52914) 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38cb0c700 1 -- 172.21.15.60:0/3143587559 learned_addr learned my addr 172.21.15.60:0/3143587559 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38d30d700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3880b0e50 0x7ff388153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38db0e700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3881558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.460+0000 7ff38cb0c700 1 -- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 msgr2=0x7ff3881558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38cb0c700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3881558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38cb0c700 1 -- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3880b0e50 msgr2=0x7ff388153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38cb0c700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3880b0e50 0x7ff388153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38cb0c700 1 -- 172.21.15.60:0/3143587559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c009420 con 0x7ff3880b1220 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38d30d700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3880b0e50 0x7ff388153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38cb0c700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 0x7ff3881553a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00ec80 tx=0x7ff37c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00c9d0 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c00cb30 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c013470 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff378009420 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.461+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3881564d0 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.462+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388156c90 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.462+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff37c013820 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.463+0000 7ff3857fa700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff374066f30 0x7ff3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.463+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff37c084860 con 0x7ff3880b1220 2023-10-08T16:16:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.463+0000 7ff38d30d700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff374066f30 0x7ff3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.463+0000 7ff38d30d700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff374066f30 0x7ff3740693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff380005c50 tx=0x7ff380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.467+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff37c051a30 con 0x7ff3880b1220 2023-10-08T16:16:13.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.706+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff38804c3c0 con 0x7ff3880b1220 2023-10-08T16:16:13.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.706+0000 7ff3857fa700 1 -- 172.21.15.60:0/3143587559 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff37c055050 con 0x7ff3880b1220 2023-10-08T16:16:13.707 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff374066f30 msgr2=0x7ff3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff374066f30 0x7ff3740693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff380005c50 tx=0x7ff380009040 comp rx=0 tx=0).stop 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 msgr2=0x7ff3881553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 0x7ff3881553a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00ec80 tx=0x7ff37c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 shutdown_connections 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff374066f30 0x7ff3740693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3880cb4f0 0x7ff3881558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3880b0e50 0x7ff388153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 --2- 172.21.15.60:0/3143587559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3880b1220 0x7ff3881553a0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 >> 172.21.15.60:0/3143587559 conn(0x7ff388069870 msgr2=0x7ff3880678d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:13.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 shutdown_connections 2023-10-08T16:16:13.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:13.708+0000 7ff38f571700 1 -- 172.21.15.60:0/3143587559 wait complete. 2023-10-08T16:16:13.721 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:16:13.721 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:16:13.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:16:13.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:13.722 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-08T16:16:13.737 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:16:13.737 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:16:13.737 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:13.738 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 41767sec preferred_lft 41767sec 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.739 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e893:66ff:fed5:c2c/64 scope link 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether aa:75:8b:8b:36:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::a875:8bff:fe8b:3627/64 scope link 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 82:a8:28:83:aa:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::80a8:28ff:fe83:aa37/64 scope link 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:13.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:13.740 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:16:13.801 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-08T16:16:13.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:13.803 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-08T16:16:13.859 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-08T16:16:13.859 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:16:13.859 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:16:13.859 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:16:13.859 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:16:13.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:13.860 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-08T16:16:13.860 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-08T16:16:13.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:16:13.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:16:13.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:16:13.860 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-08T16:16:13.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:13.961 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:16:13.976 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:16:13.976 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:16:13.977 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:16:13.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:13.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-08T16:16:14.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:16:14.042 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:16:14.098 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:16:14.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:16:14.098 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:16:14.152 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:16:14.152 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:16:14.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:14.234 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:14.234 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:16:14.253 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:14.254 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:16:14.254 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:16:14.254 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:16:14.254 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:16:14.254 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:16:14.254 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:16:14.255 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:16:14.276 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:14.276 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:16:14.276 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:16:14.276 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:16:14.277 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:16:14.278 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:16:14.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:14.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:16:14.345 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:16:14.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.506+0000 7fba979f7700 1 Processor -- start 2023-10-08T16:16:14.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.506+0000 7fba979f7700 1 -- start start 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba979f7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba9006f1c0 0x7fba90161e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba979f7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900b26d0 con 0x7fba900a79f0 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba979f7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900aeab0 con 0x7fba900b15e0 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba979f7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900b2b60 con 0x7fba9006f1c0 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba95793700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fba900a79f0 0x7fba9006eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58440/0 (socket says 172.21.15.60:58440) 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba95793700 1 -- 172.21.15.60:0/1695491091 learned_addr learned my addr 172.21.15.60:0/1695491091 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba94f92700 1 --2- 172.21.15.60:0/1695491091 >> v2:172.21.15.144:3300/0 conn(0x7fba9006f1c0 0x7fba90161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389932296 0 0) 0x7fba900b26d0 con 0x7fba900a79f0 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.507+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba78003570 con 0x7fba900a79f0 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1773283875 0 0) 0x7fba78003570 con 0x7fba900a79f0 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 >> v2:172.21.15.144:3300/0 conn(0x7fba9006f1c0 msgr2=0x7fba90161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 --2- 172.21.15.60:0/1695491091 >> v2:172.21.15.144:3300/0 conn(0x7fba9006f1c0 0x7fba90161e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 >> v1:172.21.15.144:6789/0 conn(0x7fba900b15e0 legacy=0x7fba90164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900b1ac0 con 0x7fba900a79f0 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fba88001470 con 0x7fba900a79f0 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 >> v1:172.21.15.60:6789/0 conn(0x7fba900a79f0 legacy=0x7fba9006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba78003a60 0x7fba78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78004810 0x7fba78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900b2b60 con 0x7fba780051c0 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7800c0d0 con 0x7fba78003a60 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7800c290 con 0x7fba78004810 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95793700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba78003a60 0x7fba78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba94f92700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78004810 0x7fba78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 -- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78004810 msgr2=0x7fba78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba78004810 0x7fba78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 -- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba78003a60 msgr2=0x7fba78003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba78003a60 0x7fba78003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 -- 172.21.15.60:0/1695491091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78003570 con 0x7fba780051c0 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.508+0000 7fba95f94700 1 -- 172.21.15.60:0/1695491091 reap_dead start 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba95f94700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba7800ba60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fba80001f90 tx=0x7fba80001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604361de4ea0b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80001950 con 0x7fba780051c0 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000c8b0 con 0x7fba780051c0 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba8ffff700 1 -- 172.21.15.60:0/1695491091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000cc50 con 0x7fba780051c0 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 -- 172.21.15.60:0/1695491091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 msgr2=0x7fba7800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba7800ba60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fba80001f90 tx=0x7fba80001640 comp rx=0 tx=0).stop 2023-10-08T16:16:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 -- 172.21.15.60:0/1695491091 shutdown_connections 2023-10-08T16:16:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 --2- 172.21.15.60:0/1695491091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba7800ba60 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 -- 172.21.15.60:0/1695491091 >> 172.21.15.60:0/1695491091 conn(0x7fba900cd1e0 msgr2=0x7fba900cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 -- 172.21.15.60:0/1695491091 shutdown_connections 2023-10-08T16:16:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.509+0000 7fba979f7700 1 -- 172.21.15.60:0/1695491091 wait complete. 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.510+0000 7fba979f7700 1 Processor -- start 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.510+0000 7fba979f7700 1 -- start start 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba979f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba9015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba979f7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba9015b580 0x7fba900c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba979f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba9016aa20 0x7fba9016aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba979f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9015cff0 con 0x7fba780051c0 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba979f7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9015ba10 con 0x7fba9015b580 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba979f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9015bcf0 con 0x7fba9016aa20 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba95793700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba9015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba95793700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba9015cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52936/0 (socket says 172.21.15.60:52936) 2023-10-08T16:16:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba95793700 1 -- 172.21.15.60:0/3473568217 learned_addr learned my addr 172.21.15.60:0/3473568217 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba95f94700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba9016aa20 0x7fba9016aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.511+0000 7fba94f92700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba9015b580 0x7fba900c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba95793700 1 -- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba9016aa20 msgr2=0x7fba9016aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba95793700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba9016aa20 0x7fba9016aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba95793700 1 -- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba9015b580 msgr2=0x7fba900c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba95793700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba9015b580 0x7fba900c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba95793700 1 -- 172.21.15.60:0/3473568217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9015bfd0 con 0x7fba780051c0 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba94f92700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba9015b580 0x7fba900c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba95793700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba9015cab0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fba880073c0 tx=0x7fba88001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88018030 con 0x7fba780051c0 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8800f6c0 con 0x7fba780051c0 2023-10-08T16:16:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9015c2b0 con 0x7fba780051c0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800fa80 con 0x7fba780051c0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.512+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba90158d00 con 0x7fba780051c0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.513+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9015c7d0 con 0x7fba780051c0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.513+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba8801b070 con 0x7fba780051c0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.514+0000 7fba8d7fa700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba7c066f30 0x7fba7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.514+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba88019070 con 0x7fba780051c0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.514+0000 7fba94f92700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba7c066f30 0x7fba7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.514+0000 7fba94f92700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba7c066f30 0x7fba7c0693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fba84006f00 tx=0x7fba84008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.518+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba9015c7d0 con 0x7fba780051c0 2023-10-08T16:16:14.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.771+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba9015c7d0 con 0x7fba780051c0 2023-10-08T16:16:14.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.771+0000 7fba8d7fa700 1 -- 172.21.15.60:0/3473568217 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7fba9015c7d0 con 0x7fba780051c0 2023-10-08T16:16:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba7c066f30 msgr2=0x7fba7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba7c066f30 0x7fba7c0693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fba84006f00 tx=0x7fba84008040 comp rx=0 tx=0).stop 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 msgr2=0x7fba9015cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba9015cab0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fba880073c0 tx=0x7fba88001e50 comp rx=0 tx=0).stop 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 shutdown_connections 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fba7c066f30 0x7fba7c0693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba9016aa20 0x7fba9016aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba780051c0 0x7fba9015cab0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 --2- 172.21.15.60:0/3473568217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba9015b580 0x7fba900c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:14.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 >> 172.21.15.60:0/3473568217 conn(0x7fba900cd1e0 msgr2=0x7fba901596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:14.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 shutdown_connections 2023-10-08T16:16:14.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:14.773+0000 7fba979f7700 1 -- 172.21.15.60:0/3473568217 wait complete. 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:16:14.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:16:14.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:16:14.788 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:16:14.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:14.788 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:16:14.806 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:14.807 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41769sec preferred_lft 41769sec 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2023-10-08T16:16:14.808 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bcb8:62ff:fe13:4cfd/64 scope link 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:d5:b5:c8:56:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::30d5:b5ff:fec8:5606/64 scope link 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:16:14.809 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:24:2c:9a:00:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:16:14.810 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f024:2cff:fe9a:4c/64 scope link 2023-10-08T16:16:14.810 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:16:14.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:14.810 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:16:14.872 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T16:16:14.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:14.874 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-08T16:16:14.931 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-08T16:16:14.931 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:16:14.932 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T16:16:14.932 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T16:16:14.932 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:16:14.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:14.932 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-08T16:16:14.932 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-08T16:16:14.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T16:16:14.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T16:16:14.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T16:16:14.933 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-08T16:16:15.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:15.036 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:16:15.051 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:16:15.051 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:16:15.051 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:16:15.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:15.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-08T16:16:15.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:16:15.116 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:16:15.171 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:16:15.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:16:15.171 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:16:15.225 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:16:15.225 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:16:15.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:15.305 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:15.305 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:16:15.323 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:15.323 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:16:15.323 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:16:15.324 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:16:15.324 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:16:15.324 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:16:15.324 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:16:15.324 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:16:15.344 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:16:15.344 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@3b329f4b-ad99-45f4-afa4-bcf45c7e9d39.cephfs=/ 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-08T16:16:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=3b329f4b-ad99-45f4-afa4-bcf45c7e9d39" will pass to kernel 2023-10-08T16:16:15.346 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:16:15.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:15.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:16:15.411 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:15.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.538+0000 7f4ed0a5b700 1 Processor -- start 2023-10-08T16:16:15.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.538+0000 7f4ed0a5b700 1 -- start start 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ed0a5b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ecc068240 0x7f4ecc0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ed0a5b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0b4bf0 con 0x7f4ecc159db0 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ed0a5b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0b5790 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ed0a5b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0ae9b0 con 0x7f4ecc068240 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecb59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ecc068240 0x7f4ecc0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4ecc159db0 0x7f4ecc0b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58452/0 (socket says 172.21.15.60:58452) 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecad9d700 1 -- 172.21.15.60:0/2649506534 learned_addr learned my addr 172.21.15.60:0/2649506534 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:15.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecb59e700 1 -- 172.21.15.60:0/2649506534 >> v1:172.21.15.144:6789/0 conn(0x7f4ecc0b1f00 legacy=0x7f4ecc0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecb59e700 1 -- 172.21.15.60:0/2649506534 >> v1:172.21.15.60:6789/0 conn(0x7f4ecc159db0 legacy=0x7f4ecc0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecb59e700 1 -- 172.21.15.60:0/2649506534 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0b59e0 con 0x7f4ecc068240 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ec9d9b700 1 -- 172.21.15.60:0/2649506534 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885606080 0 0) 0x7f4ecc0b4bf0 con 0x7f4ecc159db0 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.539+0000 7f4ecb59e700 1 --2- 172.21.15.60:0/2649506534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc068240 0x7f4ecc0d13c0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009e60 tx=0x7f4ec4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f943c9bdc06b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ec9d9b700 1 -- 172.21.15.60:0/2649506534 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400e070 con 0x7f4ecc068240 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ec9d9b700 1 -- 172.21.15.60:0/2649506534 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec400bc30 con 0x7f4ecc068240 2023-10-08T16:16:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ec9d9b700 1 -- 172.21.15.60:0/2649506534 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4012430 con 0x7f4ecc068240 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2649506534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc068240 msgr2=0x7f4ecc0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2649506534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc068240 0x7f4ecc0d13c0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009e60 tx=0x7f4ec4009780 comp rx=0 tx=0).stop 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2649506534 shutdown_connections 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2649506534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc068240 0x7f4ecc0d13c0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2649506534 >> 172.21.15.60:0/2649506534 conn(0x7f4ecc067e40 msgr2=0x7f4ecc0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2649506534 shutdown_connections 2023-10-08T16:16:15.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.540+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2649506534 wait complete. 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.541+0000 7f4ed0a5b700 1 Processor -- start 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.541+0000 7f4ed0a5b700 1 -- start start 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ed0a5b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ecc068240 0x7f4ecc160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ed0a5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 0x7f4ecc1693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ed0a5b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ecc159db0 0x7f4ecc15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ed0a5b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc16ac10 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ed0a5b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc15ff10 con 0x7f4ecc159db0 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ed0a5b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc160870 con 0x7f4ecc068240 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4eca59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 0x7f4ecc1693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4eca59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 0x7f4ecc1693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52960/0 (socket says 172.21.15.60:52960) 2023-10-08T16:16:15.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4eca59c700 1 -- 172.21.15.60:0/2503816214 learned_addr learned my addr 172.21.15.60:0/2503816214 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ecb59e700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ecc159db0 0x7f4ecc15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.542+0000 7f4ecad9d700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ecc068240 0x7f4ecc160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4eca59c700 1 -- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ecc068240 msgr2=0x7f4ecc160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4eca59c700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ecc068240 0x7f4ecc160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4eca59c700 1 -- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ecc159db0 msgr2=0x7f4ecc15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4eca59c700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ecc159db0 0x7f4ecc15de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4eca59c700 1 -- 172.21.15.60:0/2503816214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009a20 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4eca59c700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 0x7f4ecc1693b0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c7c0 tx=0x7f4eb4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4011590 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40116f0 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4011ab0 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc15f570 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.543+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc15fb30 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.544+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc160050 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.544+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4eb401b3b0 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.545+0000 7f4ec2ffd700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4eac066f30 0x7f4eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:15.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.545+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4eb40838e0 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.545+0000 7f4ecad9d700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4eac066f30 0x7f4eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:15.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.545+0000 7f4ecad9d700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4eac066f30 0x7f4eac0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc007160 tx=0x7f4ebc007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:15.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.549+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ecc160050 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.791+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ecc160050 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.792+0000 7f4ec2ffd700 1 -- 172.21.15.60:0/2503816214 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f4ecc160050 con 0x7f4ecc0b1f00 2023-10-08T16:16:15.793 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:15.794 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4eac066f30 msgr2=0x7f4eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4eac066f30 0x7f4eac0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc007160 tx=0x7f4ebc007f50 comp rx=0 tx=0).stop 2023-10-08T16:16:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 msgr2=0x7f4ecc1693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 0x7f4ecc1693b0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c7c0 tx=0x7f4eb4007f50 comp rx=0 tx=0).stop 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 shutdown_connections 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4eac066f30 0x7f4eac0693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ecc068240 0x7f4ecc160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ecc159db0 0x7f4ecc15de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 --2- 172.21.15.60:0/2503816214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ecc0b1f00 0x7f4ecc1693b0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 >> 172.21.15.60:0/2503816214 conn(0x7f4ecc067e40 msgr2=0x7f4ecc0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 shutdown_connections 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:15.794+0000 7f4ed0a5b700 1 -- 172.21.15.60:0/2503816214 wait complete. 2023-10-08T16:16:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:15.807 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-08T16:16:15.942 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":8196,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5143599410000004,"mdsmap_epoch":92,"osdmap_epoch":180,"osdmap_epoch_barrier":180,"uptime":14.070481501} 2023-10-08T16:16:15.945 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 8196, "mdsmap_epoch": 92, "osdmap_epoch": 180, "osdmap_epoch_barrier": 180, "rank_uptime": 8.514359941, "state": "up:active", "uptime": 14.070481501, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:16:15.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-08T16:16:16.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.067+0000 7fbb8e5b5700 1 Processor -- start 2023-10-08T16:16:16.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb8e5b5700 1 -- start start 2023-10-08T16:16:16.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb8e5b5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb88159ef0 0x7fbb8815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb8e5b5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb880b46f0 0x7fbb880b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb8e5b5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb880b17b0 con 0x7fbb880b6a10 2023-10-08T16:16:16.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb8e5b5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb880b5020 con 0x7fbb88159ef0 2023-10-08T16:16:16.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb8e5b5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb880b1a60 con 0x7fbb880b46f0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.068+0000 7fbb87fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb88159ef0 0x7fbb8815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb88159ef0 0x7fbb8815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52968/0 (socket says 172.21.15.60:52968) 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 -- 172.21.15.60:0/3233336295 learned_addr learned my addr 172.21.15.60:0/3233336295 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb8cb52700 1 --2- 172.21.15.60:0/3233336295 >> v2:172.21.15.144:3300/0 conn(0x7fbb880b46f0 0x7fbb880b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 -- 172.21.15.60:0/3233336295 >> v2:172.21.15.144:3300/0 conn(0x7fbb880b46f0 msgr2=0x7fbb880b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 --2- 172.21.15.60:0/3233336295 >> v2:172.21.15.144:3300/0 conn(0x7fbb880b46f0 0x7fbb880b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 -- 172.21.15.60:0/3233336295 >> v1:172.21.15.144:6789/0 conn(0x7fbb880b6a10 legacy=0x7fbb880b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 -- 172.21.15.60:0/3233336295 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880b1d40 con 0x7fbb88159ef0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb87fff700 1 --2- 172.21.15.60:0/3233336295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb88159ef0 0x7fbb8815a2c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbb8815a800 tx=0x7fbb78009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9282dd08d0f1e16e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb86ffd700 1 -- 172.21.15.60:0/3233336295 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78005c10 con 0x7fbb88159ef0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb86ffd700 1 -- 172.21.15.60:0/3233336295 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb78005d70 con 0x7fbb88159ef0 2023-10-08T16:16:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.069+0000 7fbb86ffd700 1 -- 172.21.15.60:0/3233336295 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78006260 con 0x7fbb88159ef0 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/3233336295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb88159ef0 msgr2=0x7fbb8815a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/3233336295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb88159ef0 0x7fbb8815a2c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbb8815a800 tx=0x7fbb78009220 comp rx=0 tx=0).stop 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/3233336295 shutdown_connections 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/3233336295 >> v2:172.21.15.144:3300/0 conn(0x7fbb880b46f0 0x7fbb880b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/3233336295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb88159ef0 0x7fbb8815a2c0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/3233336295 >> 172.21.15.60:0/3233336295 conn(0x7fbb8809a0a0 msgr2=0x7fbb88067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/3233336295 shutdown_connections 2023-10-08T16:16:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.070+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/3233336295 wait complete. 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.071+0000 7fbb8e5b5700 1 Processor -- start 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.071+0000 7fbb8e5b5700 1 -- start start 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 0x7fbb880afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb880b6a10 0x7fbb8809c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb88159ef0 0x7fbb880acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8809bcc0 con 0x7fbb880b46f0 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8809b0b0 con 0x7fbb88159ef0 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8809b390 con 0x7fbb880b6a10 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 0x7fbb880afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 0x7fbb880afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52978/0 (socket says 172.21.15.60:52978) 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 -- 172.21.15.60:0/1367327458 learned_addr learned my addr 172.21.15.60:0/1367327458 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8cb52700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb88159ef0 0x7fbb880acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb877fe700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb880b6a10 0x7fbb8809c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 -- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb880b6a10 msgr2=0x7fbb8809c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb880b6a10 0x7fbb8809c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 -- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb88159ef0 msgr2=0x7fbb880acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb88159ef0 0x7fbb880acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 -- 172.21.15.60:0/1367327458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78009480 con 0x7fbb880b46f0 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb87fff700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 0x7fbb880afba0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800b0e0 tx=0x7fbb78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800b740 con 0x7fbb880b46f0 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb78020070 con 0x7fbb880b46f0 2023-10-08T16:16:16.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8809b670 con 0x7fbb880b46f0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800bb10 con 0x7fbb880b46f0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.072+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb880aeee0 con 0x7fbb880b46f0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.073+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8809bfa0 con 0x7fbb880b46f0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.074+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb78022030 con 0x7fbb880b46f0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.074+0000 7fbb7ffff700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb68066f30 0x7fbb680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.074+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb78086230 con 0x7fbb880b46f0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.074+0000 7fbb877fe700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb68066f30 0x7fbb680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.075+0000 7fbb877fe700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb68066f30 0x7fbb680693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbb8815b6b0 tx=0x7fbb70007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:16.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.078+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb780534a0 con 0x7fbb880b46f0 2023-10-08T16:16:16.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.272+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fbb8804c3c0 con 0x7fbb880b46f0 2023-10-08T16:16:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.459+0000 7fbb7ffff700 1 -- 172.21.15.60:0/1367327458 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v181) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb78056ac0 con 0x7fbb880b46f0 2023-10-08T16:16:16.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb68066f30 msgr2=0x7fbb680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb68066f30 0x7fbb680693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbb8815b6b0 tx=0x7fbb70007ec0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 msgr2=0x7fbb880afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 0x7fbb880afba0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800b0e0 tx=0x7fbb78016000 comp rx=0 tx=0).stop 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 shutdown_connections 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fbb68066f30 0x7fbb680693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb88159ef0 0x7fbb880acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb880b46f0 0x7fbb880afba0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 --2- 172.21.15.60:0/1367327458 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb880b6a10 0x7fbb8809c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 >> 172.21.15.60:0/1367327458 conn(0x7fbb8809a0a0 msgr2=0x7fbb880b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 shutdown_connections 2023-10-08T16:16:16.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.462+0000 7fbb8e5b5700 1 -- 172.21.15.60:0/1367327458 wait complete. 2023-10-08T16:16:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-08T16:16:16.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T16:16:16.611 INFO:teuthology.orchestra.run.smithi060.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T16:16:16.611 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T16:16:16.611 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-08T16:16:16.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:16.612 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-08T16:16:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:16+0 records in 2023-10-08T16:16:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:16+0 records out 2023-10-08T16:16:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0975727 s, 172 MB/s 2023-10-08T16:16:16.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:16.728 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-08T16:16:16.840 INFO:teuthology.orchestra.run.smithi060.stderr:17+0 records in 2023-10-08T16:16:16.840 INFO:teuthology.orchestra.run.smithi060.stderr:17+0 records out 2023-10-08T16:16:16.840 INFO:teuthology.orchestra.run.smithi060.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0952467 s, 187 MB/s 2023-10-08T16:16:16.841 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-08T16:16:16.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:16.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.958+0000 7ffbe55ab700 1 Processor -- start 2023-10-08T16:16:16.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.958+0000 7ffbe55ab700 1 -- start start 2023-10-08T16:16:16.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.959+0000 7ffbe55ab700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffbe0157ba0 0x7ffbe006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.959+0000 7ffbe55ab700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe015c360 con 0x7ffbe015b0d0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.959+0000 7ffbe55ab700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe015b790 con 0x7ffbe01577d0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.959+0000 7ffbe55ab700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe015ba30 con 0x7ffbe0157ba0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.959+0000 7ffbdf7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffbe015b0d0 0x7ffbe015c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58460/0 (socket says 172.21.15.60:58460) 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.959+0000 7ffbdf7fe700 1 -- 172.21.15.60:0/798586913 learned_addr learned my addr 172.21.15.60:0/798586913 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbde7fc700 1 --2- 172.21.15.60:0/798586913 >> v2:172.21.15.144:3300/0 conn(0x7ffbe0157ba0 0x7ffbe006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749250884 0 0) 0x7ffbe015c360 con 0x7ffbe015b0d0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbcc003570 con 0x7ffbe015b0d0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716766079 0 0) 0x7ffbe015b790 con 0x7ffbe01577d0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe015c360 con 0x7ffbe01577d0 2023-10-08T16:16:16.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459683400 0 0) 0x7ffbcc003570 con 0x7ffbe015b0d0 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbde7fc700 1 -- 172.21.15.60:0/798586913 >> v1:172.21.15.144:6789/0 conn(0x7ffbe01577d0 legacy=0x7ffbe00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbde7fc700 1 -- 172.21.15.60:0/798586913 >> v1:172.21.15.60:6789/0 conn(0x7ffbe015b0d0 legacy=0x7ffbe015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbde7fc700 1 -- 172.21.15.60:0/798586913 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe015bd10 con 0x7ffbe0157ba0 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbde7fc700 1 --2- 172.21.15.60:0/798586913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe006a520 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80098e0 tx=0x7ffbc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=785af644d65242a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0001470 con 0x7ffbe0157ba0 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8011420 con 0x7ffbe0157ba0 2023-10-08T16:16:16.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.960+0000 7ffbddffb700 1 -- 172.21.15.60:0/798586913 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc80117c0 con 0x7ffbe0157ba0 2023-10-08T16:16:16.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 -- 172.21.15.60:0/798586913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 msgr2=0x7ffbe006a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/798586913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe006a520 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80098e0 tx=0x7ffbc80091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 -- 172.21.15.60:0/798586913 shutdown_connections 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/798586913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe006a520 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 -- 172.21.15.60:0/798586913 >> 172.21.15.60:0/798586913 conn(0x7ffbe0068ce0 msgr2=0x7ffbe00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 -- 172.21.15.60:0/798586913 shutdown_connections 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.961+0000 7ffbe55ab700 1 -- 172.21.15.60:0/798586913 wait complete. 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.962+0000 7ffbe55ab700 1 Processor -- start 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.962+0000 7ffbe55ab700 1 -- start start 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbe55ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 0x7ffbe015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbe55ab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe0146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbe55ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffbe015b0d0 0x7ffbe015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbe55ab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe016a3e0 con 0x7ffbe01577d0 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbe55ab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015cc30 con 0x7ffbe0157ba0 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbe55ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00b09d0 con 0x7ffbe015b0d0 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 0x7ffbe015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 0x7ffbe015c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52980/0 (socket says 172.21.15.60:52980) 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 -- 172.21.15.60:0/1975846788 learned_addr learned my addr 172.21.15.60:0/1975846788 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbde7fc700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe0146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdf7fe700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffbe015b0d0 0x7ffbe015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 -- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffbe015b0d0 msgr2=0x7ffbe015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffbe015b0d0 0x7ffbe015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 -- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 msgr2=0x7ffbe0146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe0146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 -- 172.21.15.60:0/1975846788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009420 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdf7fe700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffbe015b0d0 0x7ffbe015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbdeffd700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 0x7ffbe015c6f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800cb10 tx=0x7ffbd8002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.963+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800a760 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.964+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd800a8c0 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.964+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe015e190 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.964+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800ac60 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.964+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe015deb0 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.965+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe004c3c0 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.965+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbd8012630 con 0x7ffbe01577d0 2023-10-08T16:16:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.965+0000 7ffbd6ffd700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffbc0066f30 0x7ffbc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:16.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.966+0000 7ffbde7fc700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffbc0066f30 0x7ffbc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:16.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.966+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffbd8084900 con 0x7ffbe01577d0 2023-10-08T16:16:16.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.966+0000 7ffbde7fc700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffbc0066f30 0x7ffbc00693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80093f0 tx=0x7ffbc8016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:16.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:16.970+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbd8051b70 con 0x7ffbe01577d0 2023-10-08T16:16:17.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.167+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffbe015bff0 con 0x7ffbe01577d0 2023-10-08T16:16:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.168+0000 7ffbd6ffd700 1 -- 172.21.15.60:0/1975846788 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v181) v1 ==== 81+0+32282 (secure 0 0 0) 0x7ffbd8055190 con 0x7ffbe01577d0 2023-10-08T16:16:17.169 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 181, 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:16.455025+0000", 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:17.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:17.171 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:17.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:17.176 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:17.177 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:17.179 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:17.180 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:17.181 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:17.182 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:17.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.184 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:17.185 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:17.186 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "181", 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:17.187 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:17.188 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:17.189 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:17.189 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:17.189 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:17.189 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:17.190 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:17.190 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:17.190 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:17.190 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:17.190 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:17.190 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:17.191 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:17.192 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:17.193 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.194 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.195 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.195 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.195 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.195 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.195 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.199 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:17.201 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.202 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.203 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:17.204 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.208 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:17.209 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.210 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:17.215 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:17.217 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.219 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.220 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:17.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.223 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.224 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.225 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.227 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:17.228 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.229 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.230 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.232 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:17.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.236 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.237 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.241 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:17.242 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:17.244 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.245 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.246 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:17.248 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.249 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.252 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.253 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.254 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:17.255 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:17.256 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:17.257 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:17.258 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:17.258 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:17.258 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:17.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:17.258 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:17.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffbc0066f30 msgr2=0x7ffbc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffbc0066f30 0x7ffbc00693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80093f0 tx=0x7ffbc8016000 comp rx=0 tx=0).stop 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 msgr2=0x7ffbe015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 0x7ffbe015c6f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800cb10 tx=0x7ffbd8002820 comp rx=0 tx=0).stop 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 shutdown_connections 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ffbc0066f30 0x7ffbc00693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffbe015b0d0 0x7ffbe015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe01577d0 0x7ffbe015c6f0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 --2- 172.21.15.60:0/1975846788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe0157ba0 0x7ffbe0146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 >> 172.21.15.60:0/1975846788 conn(0x7ffbe0068ce0 msgr2=0x7ffbe00b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 shutdown_connections 2023-10-08T16:16:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:17.170+0000 7ffbe55ab700 1 -- 172.21.15.60:0/1975846788 wait complete. 2023-10-08T16:16:17.261 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:16:22.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:22.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.393+0000 7f8b473a5700 1 Processor -- start 2023-10-08T16:16:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.393+0000 7f8b473a5700 1 -- start start 2023-10-08T16:16:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b473a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b4015a620 0x7f8b4015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b473a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b4015d580 0x7f8b40158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b473a5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4015cbb0 con 0x7f8b40157870 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b473a5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4015bdb0 con 0x7f8b4015d580 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b473a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4015bfa0 con 0x7f8b4015a620 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b45942700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b4015d580 0x7f8b40158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b45942700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b4015d580 0x7f8b40158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46286/0 (socket says 172.21.15.60:46286) 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.394+0000 7f8b45942700 1 -- 172.21.15.60:0/3560161715 learned_addr learned my addr 172.21.15.60:0/3560161715 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b44940700 1 --2- 172.21.15.60:0/3560161715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b4015a620 0x7f8b4015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b45942700 1 -- 172.21.15.60:0/3560161715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b4015a620 msgr2=0x7f8b4015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b45942700 1 --2- 172.21.15.60:0/3560161715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b4015a620 0x7f8b4015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b45942700 1 -- 172.21.15.60:0/3560161715 >> v1:172.21.15.144:6789/0 conn(0x7f8b40157870 legacy=0x7f8b4015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b45942700 1 -- 172.21.15.60:0/3560161715 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4015c280 con 0x7f8b4015d580 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b45942700 1 --2- 172.21.15.60:0/3560161715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015d580 0x7f8b40158110 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8b300099b0 tx=0x7f8b30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884f8d9c1c781a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b3ffff700 1 -- 172.21.15.60:0/3560161715 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000b820 con 0x7f8b4015d580 2023-10-08T16:16:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b3ffff700 1 -- 172.21.15.60:0/3560161715 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000b980 con 0x7f8b4015d580 2023-10-08T16:16:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.395+0000 7f8b3ffff700 1 -- 172.21.15.60:0/3560161715 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000bd20 con 0x7f8b4015d580 2023-10-08T16:16:22.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 -- 172.21.15.60:0/3560161715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015d580 msgr2=0x7f8b40158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:22.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 --2- 172.21.15.60:0/3560161715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015d580 0x7f8b40158110 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8b300099b0 tx=0x7f8b30009250 comp rx=0 tx=0).stop 2023-10-08T16:16:22.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 -- 172.21.15.60:0/3560161715 shutdown_connections 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 --2- 172.21.15.60:0/3560161715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015d580 0x7f8b40158110 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 --2- 172.21.15.60:0/3560161715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b4015a620 0x7f8b4015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 -- 172.21.15.60:0/3560161715 >> 172.21.15.60:0/3560161715 conn(0x7f8b40068ce0 msgr2=0x7f8b400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 -- 172.21.15.60:0/3560161715 shutdown_connections 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.396+0000 7f8b473a5700 1 -- 172.21.15.60:0/3560161715 wait complete. 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.397+0000 7f8b473a5700 1 Processor -- start 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.397+0000 7f8b473a5700 1 -- start start 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b473a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b40157870 0x7f8b400d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b473a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 0x7f8b40149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b473a5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b4015d580 0x7f8b400b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b473a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400d0bd0 con 0x7f8b4015a620 2023-10-08T16:16:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b473a5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400b1570 con 0x7f8b4015d580 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b473a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400d15a0 con 0x7f8b40157870 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 0x7f8b40149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 0x7f8b40149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46290/0 (socket says 172.21.15.60:46290) 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 -- 172.21.15.60:0/2995561934 learned_addr learned my addr 172.21.15.60:0/2995561934 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b45942700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b4015d580 0x7f8b400b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b45141700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b40157870 0x7f8b400d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 -- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b40157870 msgr2=0x7f8b400d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b40157870 0x7f8b400d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 -- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b4015d580 msgr2=0x7f8b400b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b4015d580 0x7f8b400b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 -- 172.21.15.60:0/2995561934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b300094f0 con 0x7f8b4015a620 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b45141700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b40157870 0x7f8b400d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.398+0000 7f8b44940700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 0x7f8b40149100 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d860 tx=0x7f8b34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.399+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340125f0 con 0x7f8b4015a620 2023-10-08T16:16:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.399+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34012750 con 0x7f8b4015a620 2023-10-08T16:16:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.399+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b400cffc0 con 0x7f8b4015a620 2023-10-08T16:16:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.399+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34012af0 con 0x7f8b4015a620 2023-10-08T16:16:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.399+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b400d0580 con 0x7f8b4015a620 2023-10-08T16:16:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.400+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b400d0d40 con 0x7f8b4015a620 2023-10-08T16:16:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.400+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b3401e460 con 0x7f8b4015a620 2023-10-08T16:16:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.401+0000 7f8b3d7fa700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8b2c066f30 0x7f8b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.401+0000 7f8b45141700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8b2c066f30 0x7f8b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.401+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b34084b10 con 0x7f8b4015a620 2023-10-08T16:16:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.401+0000 7f8b45141700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8b2c066f30 0x7f8b2c0693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8b38007fd0 tx=0x7f8b38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.405+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b34055810 con 0x7f8b4015a620 2023-10-08T16:16:22.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.601+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8b4004c3c0 con 0x7f8b4015a620 2023-10-08T16:16:22.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.602+0000 7f8b3d7fa700 1 -- 172.21.15.60:0/2995561934 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v181) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f8b340553a0 con 0x7f8b4015a620 2023-10-08T16:16:22.603 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:22.603 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 181, 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:16.455025+0000", 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:22.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:22.605 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:22.606 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:22.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:22.608 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:22.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:22.610 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:22.610 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:22.610 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:22.610 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:22.611 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:22.612 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:22.613 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:22.614 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:22.615 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:22.616 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:22.618 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:22.619 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:22.620 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:22.620 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:22.620 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:22.620 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:22.620 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:22.621 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:22.621 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:22.621 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:22.621 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:22.621 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:22.621 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:22.622 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:22.622 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:22.622 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:22.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.622 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:22.622 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:22.623 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:22.623 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:22.623 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:22.623 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:22.623 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:22.623 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:22.624 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:22.625 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:22.625 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:22.625 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:22.625 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:22.625 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:22.625 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:22.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.627 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:22.627 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:22.627 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:22.627 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:22.628 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:22.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:22.631 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:22.632 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:22.633 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "181", 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:22.634 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:22.635 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:22.636 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:22.637 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:22.638 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.640 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.641 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.642 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:22.644 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.647 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:22.649 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:22.650 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:22.650 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:22.650 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.650 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.650 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.650 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.651 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.652 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:22.660 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.661 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.665 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:22.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.668 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:22.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:22.673 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.674 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:22.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.678 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.680 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.681 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:22.686 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.687 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.691 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.692 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.693 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:22.694 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:22.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:22.699 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.700 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:22.701 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.703 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.704 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.705 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:22.706 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:22.707 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:22.708 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:22.709 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:22.709 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:22.709 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:22.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:22.709 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8b2c066f30 msgr2=0x7f8b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8b2c066f30 0x7f8b2c0693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8b38007fd0 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2023-10-08T16:16:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 msgr2=0x7f8b40149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 0x7f8b40149100 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d860 tx=0x7f8b34008040 comp rx=0 tx=0).stop 2023-10-08T16:16:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 shutdown_connections 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8b2c066f30 0x7f8b2c0693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b40157870 0x7f8b400d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b4015d580 0x7f8b400b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 --2- 172.21.15.60:0/2995561934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4015a620 0x7f8b40149100 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 >> 172.21.15.60:0/2995561934 conn(0x7f8b40068ce0 msgr2=0x7f8b400b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 shutdown_connections 2023-10-08T16:16:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:22.604+0000 7f8b473a5700 1 -- 172.21.15.60:0/2995561934 wait complete. 2023-10-08T16:16:22.713 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:16:27.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.842+0000 7f6db9f96700 1 Processor -- start 2023-10-08T16:16:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.842+0000 7f6db9f96700 1 -- start start 2023-10-08T16:16:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db9f96700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db4159f10 0x7f6db40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db9f96700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6db40cc410 0x7f6db40cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db9f96700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40ae320 con 0x7f6db415a2e0 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db9f96700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db415a760 con 0x7f6db4159f10 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db9f96700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40ad710 con 0x7f6db40cc410 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db8f94700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db4159f10 0x7f6db40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6db415a2e0 0x7f6db40cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55878/0 (socket says 172.21.15.60:55878) 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db3fff700 1 -- 172.21.15.60:0/3679036497 learned_addr learned my addr 172.21.15.60:0/3679036497 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.843+0000 7f6db9795700 1 --2- 172.21.15.60:0/3679036497 >> v2:172.21.15.144:3300/0 conn(0x7f6db40cc410 0x7f6db40cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db8f94700 1 -- 172.21.15.60:0/3679036497 >> v2:172.21.15.144:3300/0 conn(0x7f6db40cc410 msgr2=0x7f6db40cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db8f94700 1 --2- 172.21.15.60:0/3679036497 >> v2:172.21.15.144:3300/0 conn(0x7f6db40cc410 0x7f6db40cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db8f94700 1 -- 172.21.15.60:0/3679036497 >> v1:172.21.15.60:6789/0 conn(0x7f6db415a2e0 legacy=0x7f6db40cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db8f94700 1 -- 172.21.15.60:0/3679036497 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40ad9f0 con 0x7f6db4159f10 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9795700 1 --2- 172.21.15.60:0/3679036497 >> v2:172.21.15.144:3300/0 conn(0x7f6db40cc410 0x7f6db40cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db37fe700 1 -- 172.21.15.60:0/3679036497 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272362586 0 0) 0x7f6db40ae320 con 0x7f6db415a2e0 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db8f94700 1 --2- 172.21.15.60:0/3679036497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db40c59e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6db408a4f0 tx=0x7f6dac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fbc810a02ce50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db37fe700 1 -- 172.21.15.60:0/3679036497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00b6b0 con 0x7f6db4159f10 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db37fe700 1 -- 172.21.15.60:0/3679036497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00b810 con 0x7f6db4159f10 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db37fe700 1 -- 172.21.15.60:0/3679036497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00bbb0 con 0x7f6db4159f10 2023-10-08T16:16:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 -- 172.21.15.60:0/3679036497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 msgr2=0x7f6db40c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 --2- 172.21.15.60:0/3679036497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db40c59e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6db408a4f0 tx=0x7f6dac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 -- 172.21.15.60:0/3679036497 shutdown_connections 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 --2- 172.21.15.60:0/3679036497 >> v2:172.21.15.144:3300/0 conn(0x7f6db40cc410 0x7f6db40cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 --2- 172.21.15.60:0/3679036497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db40c59e0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 -- 172.21.15.60:0/3679036497 >> 172.21.15.60:0/3679036497 conn(0x7f6db4067e40 msgr2=0x7f6db40d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.844+0000 7f6db9f96700 1 -- 172.21.15.60:0/3679036497 shutdown_connections 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.845+0000 7f6db9f96700 1 -- 172.21.15.60:0/3679036497 wait complete. 2023-10-08T16:16:27.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.846+0000 7f6db9f96700 1 Processor -- start 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.846+0000 7f6db9f96700 1 -- start start 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.846+0000 7f6db9f96700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db40cc410 0x7f6db4157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db415a2e0 0x7f6db415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4160610 con 0x7f6db4159f10 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415fa00 con 0x7f6db40cc410 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415fce0 con 0x7f6db415a2e0 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db415ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46304/0 (socket says 172.21.15.60:46304) 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 -- 172.21.15.60:0/845537641 learned_addr learned my addr 172.21.15.60:0/845537641 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db8f94700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db40cc410 0x7f6db4157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9795700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db415a2e0 0x7f6db415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 -- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db415a2e0 msgr2=0x7f6db415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db415a2e0 0x7f6db415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 -- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db40cc410 msgr2=0x7f6db4157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db40cc410 0x7f6db4157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 -- 172.21.15.60:0/845537641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009420 con 0x7f6db4159f10 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db8f94700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db40cc410 0x7f6db4157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9795700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db415a2e0 0x7f6db415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db3fff700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db415ee40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f6da400cc70 tx=0x7f6da4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da400ce80 con 0x7f6db4159f10 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da400ab70 con 0x7f6db4159f10 2023-10-08T16:16:27.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40070f0 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db415ffc0 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.847+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db415bad0 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.848+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4160750 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.849+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6da40074e0 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.849+0000 7f6db0ff9700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d94066f30 0x7f6d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.849+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6da4084a00 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.849+0000 7f6db8f94700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d94066f30 0x7f6d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.849+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f6d9406ea50 con 0x7f6db4159f10 2023-10-08T16:16:27.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.850+0000 7f6db8f94700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d94066f30 0x7f6d940693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0093f0 tx=0x7f6dac017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:27.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:27.854+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6db4160750 con 0x7f6db4159f10 2023-10-08T16:16:28.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.047+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6db4160750 con 0x7f6db4159f10 2023-10-08T16:16:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.048+0000 7f6db0ff9700 1 -- 172.21.15.60:0/845537641 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f6db4160750 con 0x7f6db4159f10 2023-10-08T16:16:28.049 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:28.049 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:28.049 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 182, 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:23.410433+0000", 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:28.050 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:28.051 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:28.052 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:28.053 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:28.054 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:28.056 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:28.057 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:28.058 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:28.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:28.060 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:28.061 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:28.063 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:28.064 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:28.065 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:28.066 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:28.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:28.068 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "182", 2023-10-08T16:16:28.069 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:28.070 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:28.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:28.072 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:28.073 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:28.073 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:28.073 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:28.073 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:28.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.074 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:28.074 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:28.075 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.076 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.077 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:28.078 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.079 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.082 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.085 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.086 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:28.087 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.089 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.096 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.097 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.099 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.101 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:28.102 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.103 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.104 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.105 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:28.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.108 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.109 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.111 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.113 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.116 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:28.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.122 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.123 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:28.125 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:28.128 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.130 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.131 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:28.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:28.134 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.135 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:28.136 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:28.137 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.138 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:28.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d94066f30 msgr2=0x7f6d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d94066f30 0x7f6d940693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0093f0 tx=0x7f6dac017000 comp rx=0 tx=0).stop 2023-10-08T16:16:28.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 msgr2=0x7f6db415ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db415ee40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f6da400cc70 tx=0x7f6da4001a30 comp rx=0 tx=0).stop 2023-10-08T16:16:28.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 shutdown_connections 2023-10-08T16:16:28.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6d94066f30 0x7f6d940693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db415a2e0 0x7f6db415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db40cc410 0x7f6db4157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 --2- 172.21.15.60:0/845537641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db4159f10 0x7f6db415ee40 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 >> 172.21.15.60:0/845537641 conn(0x7f6db4067e40 msgr2=0x7f6db41595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 shutdown_connections 2023-10-08T16:16:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.050+0000 7f6db9f96700 1 -- 172.21.15.60:0/845537641 wait complete. 2023-10-08T16:16:28.141 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T16:16:28.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:28.142 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-08T16:16:28.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:16:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-08T16:16:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:16:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:16:28.395 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.233654 s, 224 MB/s 2023-10-08T16:16:28.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:28.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.518+0000 7f1722563700 1 Processor -- start 2023-10-08T16:16:28.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.518+0000 7f1722563700 1 -- start start 2023-10-08T16:16:28.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1722563700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f171c156ea0 0x7f171c0c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1722563700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 0x7f171c06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1722563700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171c0c42b0 con 0x7f171c06e2b0 2023-10-08T16:16:28.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1722563700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171c0c36a0 con 0x7f171c156ea0 2023-10-08T16:16:28.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1722563700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c3980 con 0x7f171c157270 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1720b00700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f171c06e2b0 0x7f171c15abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55892/0 (socket says 172.21.15.60:55892) 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.519+0000 7f1720b00700 1 -- 172.21.15.60:0/2499878760 learned_addr learned my addr 172.21.15.60:0/2499878760 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171b7fe700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 0x7f171c06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171bfff700 1 --2- 172.21.15.60:0/2499878760 >> v2:172.21.15.144:3300/0 conn(0x7f171c156ea0 0x7f171c0c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464820273 0 0) 0x7f171c0c42b0 con 0x7f171c06e2b0 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1704003570 con 0x7f171c06e2b0 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765803154 0 0) 0x7f1704003570 con 0x7f171c06e2b0 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 msgr2=0x7f171c06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 0x7f171c06f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 >> v2:172.21.15.144:3300/0 conn(0x7f171c156ea0 msgr2=0x7f171c0c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:28.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 --2- 172.21.15.60:0/2499878760 >> v2:172.21.15.144:3300/0 conn(0x7f171c156ea0 0x7f171c0c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c0c3c60 con 0x7f171c06e2b0 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f17140017f0 con 0x7f171c06e2b0 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 >> v1:172.21.15.60:6789/0 conn(0x7f171c06e2b0 legacy=0x7f171c15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1704003a60 0x7f1704003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1704004810 0x7f1704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 0x7f17040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c36a0 con 0x7f1704003a60 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c3980 con 0x7f1704004810 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170400ba60 con 0x7f171c157270 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171bfff700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1704003a60 0x7f1704003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f171b7fe700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1704004810 0x7f1704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.520+0000 7f1720b00700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 0x7f17040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171bfff700 1 -- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 msgr2=0x7f17040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171bfff700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f171c157270 0x7f17040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171bfff700 1 -- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1704004810 msgr2=0x7f1704004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171bfff700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1704004810 0x7f1704004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171bfff700 1 -- 172.21.15.60:0/2499878760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704003570 con 0x7f1704003a60 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171bfff700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1704003a60 0x7f1704003e70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f170c009c30 tx=0x7f170c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ea6f7d44d4eb00 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00e710 con 0x7f1704003a60 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c00e870 con 0x7f1704003a60 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f171affd700 1 -- 172.21.15.60:0/2499878760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00ec30 con 0x7f1704003a60 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f1722563700 1 -- 172.21.15.60:0/2499878760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1704003a60 msgr2=0x7f1704003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f1722563700 1 --2- 172.21.15.60:0/2499878760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1704003a60 0x7f1704003e70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f170c009c30 tx=0x7f170c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f1720b00700 1 -- 172.21.15.60:0/2499878760 reap_dead start 2023-10-08T16:16:28.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f1722563700 1 -- 172.21.15.60:0/2499878760 shutdown_connections 2023-10-08T16:16:28.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.521+0000 7f1722563700 1 -- 172.21.15.60:0/2499878760 >> 172.21.15.60:0/2499878760 conn(0x7f171c0ca4f0 msgr2=0x7f171c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:28.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.522+0000 7f1722563700 1 -- 172.21.15.60:0/2499878760 shutdown_connections 2023-10-08T16:16:28.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.522+0000 7f1722563700 1 -- 172.21.15.60:0/2499878760 wait complete. 2023-10-08T16:16:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.523+0000 7f1722563700 1 Processor -- start 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.523+0000 7f1722563700 1 -- start start 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.523+0000 7f1722563700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1704003a60 0x7f171c168a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.523+0000 7f1722563700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171c15af20 0x7f171c1494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1722563700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 0x7f171c0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1722563700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c15c420 con 0x7f171c0c52a0 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1722563700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c4b30 con 0x7f171c15af20 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1722563700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c4e10 con 0x7f1704003a60 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 0x7f171c0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 0x7f171c0c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46322/0 (socket says 172.21.15.60:46322) 2023-10-08T16:16:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 -- 172.21.15.60:0/3227424893 learned_addr learned my addr 172.21.15.60:0/3227424893 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f171bfff700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1704003a60 0x7f171c168a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f171b7fe700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171c15af20 0x7f171c1494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 -- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1704003a60 msgr2=0x7f171c168a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1704003a60 0x7f171c168a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 -- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171c15af20 msgr2=0x7f171c1494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171c15af20 0x7f171c1494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 -- 172.21.15.60:0/3227424893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c169320 con 0x7f171c0c52a0 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1720b00700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 0x7f171c0c5f30 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f171c0b0620 tx=0x7f171c0c4220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400ad00 con 0x7f171c0c52a0 2023-10-08T16:16:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171400ae60 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714013620 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c169600 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.524+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171c168fc0 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.525+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171c0c4fa0 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.526+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17140139d0 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.526+0000 7f1703fff700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1708066f30 0x7f17080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.526+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1714084e80 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.526+0000 7f171bfff700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1708066f30 0x7f17080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.526+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f170806ea50 con 0x7f171c0c52a0 2023-10-08T16:16:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.527+0000 7f171bfff700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1708066f30 0x7f17080693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f170c0091e0 tx=0x7f170c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.531+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17140520f0 con 0x7f171c0c52a0 2023-10-08T16:16:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.725+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f171c04c3c0 con 0x7f171c0c52a0 2023-10-08T16:16:28.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.726+0000 7f1703fff700 1 -- 172.21.15.60:0/3227424893 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f1714055710 con 0x7f171c0c52a0 2023-10-08T16:16:28.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 182, 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:23.410433+0000", 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:28.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:28.728 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:28.729 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:28.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:28.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:28.732 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:28.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:28.736 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:28.737 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:28.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:28.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:28.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:28.741 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:28.742 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:16:28.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:16:28.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:28.743 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:28.743 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:28.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "182", 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:28.746 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:28.747 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:28.748 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:28.749 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.750 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.753 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:28.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.757 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:28.762 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.763 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.764 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.764 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.764 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.764 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:28.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:28.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:28.769 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.770 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:28.771 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.776 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.783 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:28.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:28.788 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.789 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.792 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:28.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:28.796 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:28.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:28.801 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.802 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.805 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.806 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:28.808 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:28.809 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:28.810 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:28.811 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:28.811 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:28.811 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:28.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:28.811 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:28.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1708066f30 msgr2=0x7f17080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1708066f30 0x7f17080693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f170c0091e0 tx=0x7f170c01a000 comp rx=0 tx=0).stop 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 msgr2=0x7f171c0c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 0x7f171c0c5f30 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f171c0b0620 tx=0x7f171c0c4220 comp rx=0 tx=0).stop 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 shutdown_connections 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1708066f30 0x7f17080693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1704003a60 0x7f171c168a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f171c0c52a0 0x7f171c0c5f30 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 --2- 172.21.15.60:0/3227424893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171c15af20 0x7f171c1494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 >> 172.21.15.60:0/3227424893 conn(0x7f171c0ca4f0 msgr2=0x7f171c0689c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 shutdown_connections 2023-10-08T16:16:28.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.728+0000 7f1722563700 1 -- 172.21.15.60:0/3227424893 wait complete. 2023-10-08T16:16:28.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.933+0000 7f7b95999700 1 Processor -- start 2023-10-08T16:16:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.933+0000 7f7b95999700 1 -- start start 2023-10-08T16:16:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b95999700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b900b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b95999700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b900cfe20 0x7f7b900ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b95999700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b900c5d80 con 0x7f7b900d1c30 2023-10-08T16:16:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b95999700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b90068470 con 0x7f7b900cfe20 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b95999700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900c6060 con 0x7f7b9015a2b0 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b900b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8f7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b900cfe20 0x7f7b900ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8e7fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7b900d1c30 0x7f7b900cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:36354/0 (socket says 172.21.15.60:36354) 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8e7fc700 1 -- 172.21.15.60:0/1928873654 learned_addr learned my addr 172.21.15.60:0/1928873654 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8f7fe700 1 -- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 msgr2=0x7f7b900b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8f7fe700 1 --2- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b900b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8f7fe700 1 -- 172.21.15.60:0/1928873654 >> v1:172.21.15.144:6789/0 conn(0x7f7b900d1c30 legacy=0x7f7b900cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8dffb700 1 -- 172.21.15.60:0/1928873654 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45031434 0 0) 0x7f7b900c5d80 con 0x7f7b900d1c30 2023-10-08T16:16:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8f7fe700 1 -- 172.21.15.60:0/1928873654 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900c6340 con 0x7f7b900cfe20 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.934+0000 7f7b8effd700 1 --2- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b900b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b8f7fe700 1 --2- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b900ccdd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009e60 tx=0x7f7b88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b1cde815c606ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b8dffb700 1 -- 172.21.15.60:0/1928873654 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800e070 con 0x7f7b900cfe20 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b8dffb700 1 -- 172.21.15.60:0/1928873654 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8800bb60 con 0x7f7b900cfe20 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b8dffb700 1 -- 172.21.15.60:0/1928873654 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88012430 con 0x7f7b900cfe20 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 -- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 msgr2=0x7f7b900ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 --2- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b900ccdd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009e60 tx=0x7f7b88009780 comp rx=0 tx=0).stop 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 -- 172.21.15.60:0/1928873654 shutdown_connections 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 --2- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b900ccdd0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 --2- 172.21.15.60:0/1928873654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b900b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 -- 172.21.15.60:0/1928873654 >> 172.21.15.60:0/1928873654 conn(0x7f7b90067e40 msgr2=0x7f7b900d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:28.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 -- 172.21.15.60:0/1928873654 shutdown_connections 2023-10-08T16:16:28.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.935+0000 7f7b95999700 1 -- 172.21.15.60:0/1928873654 wait complete. 2023-10-08T16:16:28.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.936+0000 7f7b95999700 1 Processor -- start 2023-10-08T16:16:28.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 -- start start 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b9015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 0x7f7b9015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b9015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90158020 con 0x7f7b900d1c30 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9015b770 con 0x7f7b900cfe20 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b95999700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9015ab60 con 0x7f7b9015a2b0 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b8e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 0x7f7b9015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b8e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 0x7f7b9015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46336/0 (socket says 172.21.15.60:46336) 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.937+0000 7f7b8e7fc700 1 -- 172.21.15.60:0/2632184733 learned_addr learned my addr 172.21.15.60:0/2632184733 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8effd700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b9015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8f7fe700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b9015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8e7fc700 1 -- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 msgr2=0x7f7b9015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8e7fc700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b9015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8e7fc700 1 -- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 msgr2=0x7f7b9015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8e7fc700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b9015bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8e7fc700 1 -- 172.21.15.60:0/2632184733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800093c0 con 0x7f7b900d1c30 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b8e7fc700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 0x7f7b9015c140 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400c5e0 tx=0x7f7b84000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84005b30 con 0x7f7b900d1c30 2023-10-08T16:16:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84005cb0 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b88009a20 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84007320 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.938+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9015b1a0 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.939+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9015b920 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.939+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b8401b3b0 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.940+0000 7f7b76ffd700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7b7c066f30 0x7f7b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.940+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b840839d0 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.940+0000 7f7b8effd700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7b7c066f30 0x7f7b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.940+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f7b7c06ea50 con 0x7f7b900d1c30 2023-10-08T16:16:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.940+0000 7f7b8effd700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7b7c066f30 0x7f7b7c0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b80006ea0 tx=0x7f7b80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:28.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:28.944+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b84017020 con 0x7f7b900d1c30 2023-10-08T16:16:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.179+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b9015b520 con 0x7f7b900d1c30 2023-10-08T16:16:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.180+0000 7f7b76ffd700 1 -- 172.21.15.60:0/2632184733 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f7b9015b920 con 0x7f7b900d1c30 2023-10-08T16:16:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:29.180 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.181+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7b7c066f30 msgr2=0x7f7b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.181+0000 7f7b95999700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7b7c066f30 0x7f7b7c0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b80006ea0 tx=0x7f7b80008040 comp rx=0 tx=0).stop 2023-10-08T16:16:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.181+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 msgr2=0x7f7b9015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.181+0000 7f7b95999700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 0x7f7b9015c140 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400c5e0 tx=0x7f7b84000fe0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 shutdown_connections 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7b7c066f30 0x7f7b7c0693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b9015a2b0 0x7f7b9015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b900cfe20 0x7f7b9015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 --2- 172.21.15.60:0/2632184733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b900d1c30 0x7f7b9015c140 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 >> 172.21.15.60:0/2632184733 conn(0x7f7b90067e40 msgr2=0x7f7b90158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 shutdown_connections 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.182+0000 7f7b95999700 1 -- 172.21.15.60:0/2632184733 wait complete. 2023-10-08T16:16:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:29.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-08T16:16:29.338 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":8196,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.909910580999998,"mdsmap_epoch":92,"osdmap_epoch":182,"osdmap_epoch_barrier":182,"uptime":27.466035423000001} 2023-10-08T16:16:29.338 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 8196, "mdsmap_epoch": 92, "osdmap_epoch": 182, "osdmap_epoch_barrier": 182, "rank_uptime": 21.909910581, "state": "up:active", "uptime": 27.466035423, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:16:29.338 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:16:29.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:29.339 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-08T16:16:29.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:29.356 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-08T16:16:29.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:29.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 Processor -- start 2023-10-08T16:16:29.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 -- start start 2023-10-08T16:16:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe78157870 0x7efe7815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe7815a620 0x7efe7815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7815cbb0 con 0x7efe7815d580 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7815bfa0 con 0x7efe7815a620 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.577+0000 7efe7ebfa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7815c280 con 0x7efe78157870 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe7815a620 0x7efe7815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe7815a620 0x7efe7815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46342/0 (socket says 172.21.15.60:46342) 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 -- 172.21.15.60:0/3988728866 learned_addr learned my addr 172.21.15.60:0/3988728866 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe7c996700 1 --2- 172.21.15.60:0/3988728866 >> v2:172.21.15.144:3300/0 conn(0x7efe78157870 0x7efe7815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 -- 172.21.15.60:0/3988728866 >> v2:172.21.15.144:3300/0 conn(0x7efe78157870 msgr2=0x7efe7815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 --2- 172.21.15.60:0/3988728866 >> v2:172.21.15.144:3300/0 conn(0x7efe78157870 0x7efe7815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 -- 172.21.15.60:0/3988728866 >> v1:172.21.15.144:6789/0 conn(0x7efe7815d580 legacy=0x7efe78158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 -- 172.21.15.60:0/3988728866 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7815c560 con 0x7efe7815a620 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe77fff700 1 --2- 172.21.15.60:0/3988728866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe7815d040 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7efe78069d80 tx=0x7efe68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0c62fa1e3e5cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe777fe700 1 -- 172.21.15.60:0/3988728866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800e070 con 0x7efe7815a620 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe777fe700 1 -- 172.21.15.60:0/3988728866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800ba20 con 0x7efe7815a620 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.578+0000 7efe777fe700 1 -- 172.21.15.60:0/3988728866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680092e0 con 0x7efe7815a620 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 -- 172.21.15.60:0/3988728866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 msgr2=0x7efe7815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/3988728866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe7815d040 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7efe78069d80 tx=0x7efe68009840 comp rx=0 tx=0).stop 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 -- 172.21.15.60:0/3988728866 shutdown_connections 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/3988728866 >> v2:172.21.15.144:3300/0 conn(0x7efe78157870 0x7efe7815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/3988728866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe7815d040 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 -- 172.21.15.60:0/3988728866 >> 172.21.15.60:0/3988728866 conn(0x7efe78068ce0 msgr2=0x7efe780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 -- 172.21.15.60:0/3988728866 shutdown_connections 2023-10-08T16:16:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.579+0000 7efe7ebfa700 1 -- 172.21.15.60:0/3988728866 wait complete. 2023-10-08T16:16:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.580+0000 7efe7ebfa700 1 Processor -- start 2023-10-08T16:16:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.580+0000 7efe7ebfa700 1 -- start start 2023-10-08T16:16:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe7ebfa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe78157870 0x7efe780b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe7ebfa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe781445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe7ebfa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe7815d580 0x7efe78144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe7ebfa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780cd640 con 0x7efe7815a620 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe7ebfa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780cca30 con 0x7efe7815d580 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe7ebfa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780ccd10 con 0x7efe78157870 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe781445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe781445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46346/0 (socket says 172.21.15.60:46346) 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 -- 172.21.15.60:0/4123465449 learned_addr learned my addr 172.21.15.60:0/4123465449 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 -- 172.21.15.60:0/4123465449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe78157870 msgr2=0x7efe780b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe78157870 0x7efe780b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 -- 172.21.15.60:0/4123465449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe7815d580 msgr2=0x7efe78144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe7815d580 0x7efe78144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 -- 172.21.15.60:0/4123465449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009ae0 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.581+0000 7efe77fff700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe781445f0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efe68012000 tx=0x7efe68018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.582+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68008a80 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.582+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68008c00 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.582+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe780ccff0 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.582+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68026460 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.582+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe780b2fa0 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.582+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7804c3c0 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.583+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe68003040 con 0x7efe7815a620 2023-10-08T16:16:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.583+0000 7efe74ff9700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.583+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe68086290 con 0x7efe7815a620 2023-10-08T16:16:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.583+0000 7efe7c996700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.584+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7efe5806ea50 con 0x7efe7815a620 2023-10-08T16:16:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.584+0000 7efe7c996700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe58066f30 0x7efe580693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efe70009bb0 tx=0x7efe700091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:29.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.588+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe680535b0 con 0x7efe7815a620 2023-10-08T16:16:29.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.784+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efe780cd780 con 0x7efe7815a620 2023-10-08T16:16:29.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.785+0000 7efe74ff9700 1 -- 172.21.15.60:0/4123465449 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+32301 (secure 0 0 0) 0x7efe6802b070 con 0x7efe7815a620 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 182, 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:23.410433+0000", 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:16:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "182", 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:29.873 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:29.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe58066f30 msgr2=0x7efe580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe58066f30 0x7efe580693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efe70009bb0 tx=0x7efe700091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 msgr2=0x7efe781445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe781445f0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efe68012000 tx=0x7efe68018000 comp rx=0 tx=0).stop 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 shutdown_connections 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe78157870 0x7efe780b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe7815d580 0x7efe78144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 --2- 172.21.15.60:0/4123465449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe7815a620 0x7efe781445f0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.787+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 >> 172.21.15.60:0/4123465449 conn(0x7efe78068ce0 msgr2=0x7efe7815b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.788+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 shutdown_connections 2023-10-08T16:16:29.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:29.788+0000 7efe7ebfa700 1 -- 172.21.15.60:0/4123465449 wait complete. 2023-10-08T16:16:29.876 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:16:34.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:34.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:34.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.010+0000 7f7558c9a700 1 Processor -- start 2023-10-08T16:16:35.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.010+0000 7f7558c9a700 1 -- start start 2023-10-08T16:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7558c9a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 0x7f7554067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7558c9a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 0x7f7554159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7558c9a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7554068000 con 0x7f75540b0890 2023-10-08T16:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7558c9a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540cb370 con 0x7f7554067ba0 2023-10-08T16:16:35.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7558c9a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540b0c60 con 0x7f755406c630 2023-10-08T16:16:35.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7552d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 0x7f7554159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:35.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7551d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 0x7f7554067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:35.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f755259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f75540b0890 0x7f75540cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:49502/0 (socket says 172.21.15.60:49502) 2023-10-08T16:16:35.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7552d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 0x7f7554159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:60894/0 (socket says 172.21.15.60:60894) 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f7551d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 0x7f7554067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:55110/0 (socket says 172.21.15.60:55110) 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.011+0000 7f755259c700 1 -- 172.21.15.60:0/3983590965 learned_addr learned my addr 172.21.15.60:0/3983590965 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f7551d9b700 1 -- 172.21.15.60:0/3983590965 >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 msgr2=0x7f7554159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f7551d9b700 1 --2- 172.21.15.60:0/3983590965 >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 0x7f7554159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f7551d9b700 1 -- 172.21.15.60:0/3983590965 >> v1:172.21.15.144:6789/0 conn(0x7f75540b0890 legacy=0x7f75540cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f7551d9b700 1 -- 172.21.15.60:0/3983590965 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755406a1e0 con 0x7f755406c630 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f7552d9d700 1 --2- 172.21.15.60:0/3983590965 >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 0x7f7554159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f7551d9b700 1 --2- 172.21.15.60:0/3983590965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 0x7f7554067660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f753c0098e0 tx=0x7f753c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26ac6c55695d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f755159a700 1 -- 172.21.15.60:0/3983590965 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00b640 con 0x7f755406c630 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f755159a700 1 -- 172.21.15.60:0/3983590965 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c00b7a0 con 0x7f755406c630 2023-10-08T16:16:35.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.012+0000 7f755159a700 1 -- 172.21.15.60:0/3983590965 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00bb40 con 0x7f755406c630 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 -- 172.21.15.60:0/3983590965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 msgr2=0x7f7554067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 --2- 172.21.15.60:0/3983590965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 0x7f7554067660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f753c0098e0 tx=0x7f753c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 -- 172.21.15.60:0/3983590965 shutdown_connections 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 --2- 172.21.15.60:0/3983590965 >> v2:172.21.15.144:3300/0 conn(0x7f7554067ba0 0x7f7554159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 --2- 172.21.15.60:0/3983590965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f755406c630 0x7f7554067660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 -- 172.21.15.60:0/3983590965 >> 172.21.15.60:0/3983590965 conn(0x7f755406fe50 msgr2=0x7f7554069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 -- 172.21.15.60:0/3983590965 shutdown_connections 2023-10-08T16:16:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.013+0000 7f7558c9a700 1 -- 172.21.15.60:0/3983590965 wait complete. 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.014+0000 7f7558c9a700 1 Processor -- start 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.014+0000 7f7558c9a700 1 -- start start 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7558c9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7554067ba0 0x7f755416b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7558c9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 0x7f75540c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7558c9a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75540b0890 0x7f755415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7558c9a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540c6070 con 0x7f755406c630 2023-10-08T16:16:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7558c9a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755415a8e0 con 0x7f7554067ba0 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7558c9a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540c2c90 con 0x7f75540b0890 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7551d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 0x7f75540c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75540b0890 0x7f755415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f755259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7554067ba0 0x7f755416b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7551d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 0x7f75540c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35156/0 (socket says 172.21.15.60:35156) 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7551d9b700 1 -- 172.21.15.60:0/671756681 learned_addr learned my addr 172.21.15.60:0/671756681 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 -- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7554067ba0 msgr2=0x7f755416b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7554067ba0 0x7f755416b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 -- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 msgr2=0x7f75540c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 0x7f75540c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 -- 172.21.15.60:0/671756681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009420 con 0x7f75540b0890 2023-10-08T16:16:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7551d9b700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 0x7f75540c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f7552d9d700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75540b0890 0x7f755415a3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f754400e9a0 tx=0x7f75440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544013680 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.015+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440137e0 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.016+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c009420 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.016+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544013b60 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.016+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540c6280 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.016+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75540c2e00 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.017+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f754400c460 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.017+0000 7f754a7fc700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7534066f30 0x7f75340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.017+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7544084460 con 0x7f75540b0890 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.017+0000 7f755259c700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7534066f30 0x7f75340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:35.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.018+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=183}) v3 -- 0x7f753406ea50 con 0x7f75540b0890 2023-10-08T16:16:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.018+0000 7f755259c700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7534066f30 0x7f75340693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f75540cd450 tx=0x7f754c001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.022+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75440516d0 con 0x7f75540b0890 2023-10-08T16:16:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.216+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f755404c3c0 con 0x7f75540b0890 2023-10-08T16:16:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.217+0000 7f754a7fc700 1 -- 172.21.15.60:0/671756681 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v182) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f7544020090 con 0x7f75540b0890 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 182, 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:23.410433+0000", 2023-10-08T16:16:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1027, 2023-10-08T16:16:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "182", 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.265 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:35.266 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.269 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.271 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.273 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.274 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:35.277 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.278 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.282 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.283 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:35.284 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.285 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.286 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.290 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:35.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:35.292 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.293 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:35.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.299 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.300 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:35.301 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.302 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:35.303 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.304 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.308 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:35.311 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:35.312 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:35.318 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:35.319 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7534066f30 msgr2=0x7f75340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7534066f30 0x7f75340693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f75540cd450 tx=0x7f754c001a10 comp rx=0 tx=0).stop 2023-10-08T16:16:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75540b0890 msgr2=0x7f755415a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75540b0890 0x7f755415a3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f754400e9a0 tx=0x7f75440091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 shutdown_connections 2023-10-08T16:16:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f7534066f30 0x7f75340693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75540b0890 0x7f755415a3a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7554067ba0 0x7f755416b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 --2- 172.21.15.60:0/671756681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755406c630 0x7f75540c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 >> 172.21.15.60:0/671756681 conn(0x7f755406fe50 msgr2=0x7f7554068190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 shutdown_connections 2023-10-08T16:16:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:35.219+0000 7f7558c9a700 1 -- 172.21.15.60:0/671756681 wait complete. 2023-10-08T16:16:35.323 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T16:16:40.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.456+0000 7f3b9e165700 1 Processor -- start 2023-10-08T16:16:40.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.456+0000 7f3b9e165700 1 -- start start 2023-10-08T16:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9e165700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 0x7f3b980ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9e165700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980cf2a0 con 0x7f3b98159be0 2023-10-08T16:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9e165700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b98067800 con 0x7f3b980cee90 2023-10-08T16:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9e165700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980701f0 con 0x7f3b98159fb0 2023-10-08T16:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9d163700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3b98159be0 0x7f3b98068db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60524/0 (socket says 172.21.15.60:60524) 2023-10-08T16:16:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9d163700 1 -- 172.21.15.60:0/2836822369 learned_addr learned my addr 172.21.15.60:0/2836822369 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:40.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b9c962700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 0x7f3b980ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987849710 0 0) 0x7f3b980cf2a0 con 0x7f3b98159be0 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.457+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b84003570 con 0x7f3b98159be0 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2383404217 0 0) 0x7f3b84003570 con 0x7f3b98159be0 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 msgr2=0x7f3b980ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 0x7f3b980ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 >> v1:172.21.15.144:6789/0 conn(0x7f3b980cee90 legacy=0x7f3b980b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98067ae0 con 0x7f3b98159be0 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f3b94001470 con 0x7f3b98159be0 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 >> v1:172.21.15.60:6789/0 conn(0x7f3b98159be0 legacy=0x7f3b98068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b84003a90 0x7f3b84003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 0x7f3b84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b84004d50 0x7f3b840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980701f0 con 0x7f3b84004d50 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8400bb40 con 0x7f3b84003a90 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8400bd00 con 0x7f3b98159fb0 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d964700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b84004d50 0x7f3b840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d163700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b84003a90 0x7f3b84003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9c962700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 0x7f3b84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d964700 1 -- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 msgr2=0x7f3b84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d964700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b98159fb0 0x7f3b84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d964700 1 -- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b84003a90 msgr2=0x7f3b84003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d964700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b84003a90 0x7f3b84003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.458+0000 7f3b9d964700 1 -- 172.21.15.60:0/2836822369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84003570 con 0x7f3b84004d50 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9d964700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b84004d50 0x7f3b840051c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f3b900020a0 tx=0x7f3b900016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acea8f3a03326b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900019e0 con 0x7f3b84004d50 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9000c8b0 con 0x7f3b84004d50 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b8ffff700 1 -- 172.21.15.60:0/2836822369 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000cc50 con 0x7f3b84004d50 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9e165700 1 -- 172.21.15.60:0/2836822369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b84004d50 msgr2=0x7f3b840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9e165700 1 --2- 172.21.15.60:0/2836822369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b84004d50 0x7f3b840051c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f3b900020a0 tx=0x7f3b900016d0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9d964700 1 -- 172.21.15.60:0/2836822369 reap_dead start 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9e165700 1 -- 172.21.15.60:0/2836822369 shutdown_connections 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9e165700 1 -- 172.21.15.60:0/2836822369 >> 172.21.15.60:0/2836822369 conn(0x7f3b9806bc70 msgr2=0x7f3b9806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9e165700 1 -- 172.21.15.60:0/2836822369 shutdown_connections 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.459+0000 7f3b9e165700 1 -- 172.21.15.60:0/2836822369 wait complete. 2023-10-08T16:16:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.460+0000 7f3b9e165700 1 Processor -- start 2023-10-08T16:16:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 -- start start 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b84004d50 0x7f3b98146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 0x7f3b980c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b980c59d0 0x7f3b980c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981465b0 con 0x7f3b980c7910 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c6380 con 0x7f3b980c59d0 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9e165700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c3500 con 0x7f3b84004d50 2023-10-08T16:16:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.461+0000 7f3b9c962700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 0x7f3b980c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 0x7f3b980c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35176/0 (socket says 172.21.15.60:35176) 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 -- 172.21.15.60:0/3874581495 learned_addr learned my addr 172.21.15.60:0/3874581495 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9d163700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b84004d50 0x7f3b98146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9d964700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b980c59d0 0x7f3b980c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 -- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b84004d50 msgr2=0x7f3b98146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b84004d50 0x7f3b98146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 -- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b980c59d0 msgr2=0x7f3b980c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b980c59d0 0x7f3b980c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 -- 172.21.15.60:0/3874581495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980c8440 con 0x7f3b980c7910 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9d163700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b84004d50 0x7f3b98146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9c962700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 0x7f3b980c7d80 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f3b88011ba0 tx=0x7f3b880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800fac0 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8800fc20 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980c8720 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88014440 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.462+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980c8ce0 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.463+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9806e3e0 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.464+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b88014830 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.464+0000 7f3b8d7fa700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.464+0000 7f3b9d163700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.464+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b88018030 con 0x7f3b980c7910 2023-10-08T16:16:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.465+0000 7f3b9d163700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b7c066f30 0x7f3b7c0693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001d00 tx=0x7f3b94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.469+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b88052220 con 0x7f3b980c7910 2023-10-08T16:16:40.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.665+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3b980c3640 con 0x7f3b980c7910 2023-10-08T16:16:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.666+0000 7f3b8d7fa700 1 -- 172.21.15.60:0/3874581495 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f3b88022090 con 0x7f3b980c7910 2023-10-08T16:16:40.667 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:40.667 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:40.667 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 183, 2023-10-08T16:16:40.667 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:40.667 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:40.667 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:38.413596+0000", 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:40.668 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:40.669 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:40.670 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:40.670 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:40.670 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:40.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:40.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:40.676 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:40.677 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:40.678 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.679 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:40.680 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:40.681 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:40.682 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:40.683 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:40.684 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:40.686 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:40.687 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:40.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "183", 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:40.689 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:40.690 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:40.691 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.693 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.699 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:40.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.706 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:40.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.711 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.712 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.723 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:40.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:40.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:40.741 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:40.743 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.744 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.747 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.748 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:40.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:40.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:40.753 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b7c066f30 msgr2=0x7f3b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b7c066f30 0x7f3b7c0693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001d00 tx=0x7f3b94009040 comp rx=0 tx=0).stop 2023-10-08T16:16:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 msgr2=0x7f3b980c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 0x7f3b980c7d80 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f3b88011ba0 tx=0x7f3b880091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 shutdown_connections 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b84004d50 0x7f3b98146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b980c59d0 0x7f3b980c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 --2- 172.21.15.60:0/3874581495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b980c7910 0x7f3b980c7d80 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 >> 172.21.15.60:0/3874581495 conn(0x7f3b9806bc70 msgr2=0x7f3b98157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 shutdown_connections 2023-10-08T16:16:40.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.668+0000 7f3b9e165700 1 -- 172.21.15.60:0/3874581495 wait complete. 2023-10-08T16:16:40.756 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T16:16:40.756 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T16:16:40.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 Processor -- start 2023-10-08T16:16:40.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 -- start start 2023-10-08T16:16:40.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4df40abae0 0x7f4df40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df40c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df40c9cb0 con 0x7f4df40abeb0 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df40c90a0 con 0x7f4df40abae0 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.876+0000 7f4df8c72700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40c9380 con 0x7f4df40c8b10 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4df40abae0 0x7f4df40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4df40abae0 0x7f4df40c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35192/0 (socket says 172.21.15.60:35192) 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 -- 172.21.15.60:0/3808553351 learned_addr learned my addr 172.21.15.60:0/3808553351 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df2d9d700 1 --2- 172.21.15.60:0/3808553351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df40c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 -- 172.21.15.60:0/3808553351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 msgr2=0x7f4df40c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 --2- 172.21.15.60:0/3808553351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df40c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 -- 172.21.15.60:0/3808553351 >> v1:172.21.15.144:6789/0 conn(0x7f4df40abeb0 legacy=0x7f4df40c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 -- 172.21.15.60:0/3808553351 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df40c9660 con 0x7f4df40abae0 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df259c700 1 --2- 172.21.15.60:0/3808553351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df40c6eb0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00bc50 tx=0x7f4dec00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df80fc179c4e26a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df159a700 1 -- 172.21.15.60:0/3808553351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec00be60 con 0x7f4df40abae0 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df159a700 1 -- 172.21.15.60:0/3808553351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec00ddc0 con 0x7f4df40abae0 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.877+0000 7f4df159a700 1 -- 172.21.15.60:0/3808553351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0106a0 con 0x7f4df40abae0 2023-10-08T16:16:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 -- 172.21.15.60:0/3808553351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 msgr2=0x7f4df40c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3808553351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df40c6eb0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00bc50 tx=0x7f4dec00b4f0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 -- 172.21.15.60:0/3808553351 shutdown_connections 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3808553351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df40c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3808553351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df40c6eb0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 -- 172.21.15.60:0/3808553351 >> 172.21.15.60:0/3808553351 conn(0x7f4df4067660 msgr2=0x7f4df4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 -- 172.21.15.60:0/3808553351 shutdown_connections 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.878+0000 7f4df8c72700 1 -- 172.21.15.60:0/3808553351 wait complete. 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.879+0000 7f4df8c72700 1 Processor -- start 2023-10-08T16:16:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.879+0000 7f4df8c72700 1 -- start start 2023-10-08T16:16:40.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df8c72700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df4169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df8c72700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df40abeb0 0x7f4df4149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df8c72700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df4157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df8c72700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40b1000 con 0x7f4df40abae0 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df8c72700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40c0570 con 0x7f4df40abeb0 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df8c72700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40b0cd0 con 0x7f4df40c8b10 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df4169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df4169f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35202/0 (socket says 172.21.15.60:35202) 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 -- 172.21.15.60:0/3939528473 learned_addr learned my addr 172.21.15.60:0/3939528473 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 -- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 msgr2=0x7f4df4157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df2d9d700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df4157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df1d9b700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df40abeb0 0x7f4df4149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df4157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 -- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df40abeb0 msgr2=0x7f4df4149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df40abeb0 0x7f4df4149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 -- 172.21.15.60:0/3939528473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec00b790 con 0x7f4df40abae0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4df259c700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df4169f30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b530 tx=0x7f4dec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec018730 con 0x7f4df40abae0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.880+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec0188d0 con 0x7f4df40abae0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.881+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec018c90 con 0x7f4df40abae0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.881+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df40c1680 con 0x7f4df40abae0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.881+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df40ca440 con 0x7f4df40abae0 2023-10-08T16:16:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.881+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df40b0e10 con 0x7f4df40abae0 2023-10-08T16:16:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.882+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dec024640 con 0x7f4df40abae0 2023-10-08T16:16:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.882+0000 7f4dea7fc700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dd4066f30 0x7f4dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.882+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4dec014070 con 0x7f4df40abae0 2023-10-08T16:16:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.882+0000 7f4df1d9b700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dd4066f30 0x7f4dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.883+0000 7f4df1d9b700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dd4066f30 0x7f4dd40693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4df40ac350 tx=0x7f4ddc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:40.886+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dec055860 con 0x7f4df40abae0 2023-10-08T16:16:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.080+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4df404c3c0 con 0x7f4df40abae0 2023-10-08T16:16:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.081+0000 7f4dea7fc700 1 -- 172.21.15.60:0/3939528473 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f4dec058e80 con 0x7f4df40abae0 2023-10-08T16:16:41.082 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:41.082 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:41.082 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 183, 2023-10-08T16:16:41.082 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", 2023-10-08T16:16:41.082 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2023-10-08T16:04:43.526558+0000", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2023-10-08T16:16:38.413596+0000", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2023-10-08T16:04:48.908445+0000", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2023-10-08T16:04:45.897271+0000", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:41.083 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 23, 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "quincy", 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.084 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:04:49.613517+0000", 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:41.085 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:41.086 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "105", 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:41.087 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:41.088 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:41.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.090 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:04.735531+0000", 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:41.091 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 32, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 32, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 32, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 32, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 32, 2023-10-08T16:16:41.092 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "179", 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:41.093 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:41.094 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.095 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2023-10-08T16:16:41.096 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 23, 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2023-10-08T16:16:41.097 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2023-10-08T16:16:05.794306+0000", 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T16:16:41.098 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 64, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 64, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 64, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 64, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 64, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2023-10-08T16:16:41.099 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "183", 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2023-10-08T16:16:41.100 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 33554432, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2023-10-08T16:16:41.101 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2023-10-08T16:16:41.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 64, 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T16:16:41.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.104 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.106 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2023-10-08T16:16:41.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86354 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/86354", 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6814/86354", 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6822/86354", 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6818/86354", 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.110 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.111 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.113 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.114 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.115 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86353 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6810/86353", 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6815/86353", 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/86353", 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6819/86353", 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.117 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.118 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2023-10-08T16:16:41.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86352 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/86352", 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/86352", 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/86352", 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/86352", 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.123 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.124 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2023-10-08T16:16:41.126 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.128 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86357 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6824/86357", 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/86357", 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/86357", 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/86357", 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.130 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.131 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6803", 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6806", 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.132 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6810", 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6814", 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6826", 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.134 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6830", 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6818", 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6822", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86599 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6806/86599", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6814/86599", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6830/86599", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6822/86599", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.137 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6800", 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6802", 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6807", 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6811", 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6823", 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6827", 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6815", 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6819", 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86600 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.142 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6802/86600", 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6811/86600", 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6827/86600", 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6819/86600", 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:41.143 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.144 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6805", 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6808", 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6813", 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6816", 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.146 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6828", 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6831", 2023-10-08T16:16:41.147 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6820", 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6824", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86601 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6808/86601", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6816/86601", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86601", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6824/86601", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.149 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2023-10-08T16:16:41.150 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 178, 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6801", 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.151 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6804", 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6809", 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6812", 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6825", 2023-10-08T16:16:41.153 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6829", 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2023-10-08T16:16:41.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6817", 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.144:6821", 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 86602 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.144:6804/86602", 2023-10-08T16:16:41.155 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.144:6812/86602", 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.144:6829/86602", 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86602", 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2023-10-08T16:16:41.156 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.060798+0000", 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.157 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.081602+0000", 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.158 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.071001+0000", 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.159 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.051531+0000", 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043623+0000", 2023-10-08T16:16:41.161 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.043531+0000", 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:47.056119+0000", 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2023-10-08T16:16:41.163 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138320759226367, 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2023-10-08T16:04:46.978315+0000", 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2023-10-08T16:16:41.164 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T16:16:41.165 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T16:16:41.166 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dd4066f30 msgr2=0x7f4dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dd4066f30 0x7f4dd40693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4df40ac350 tx=0x7f4ddc009040 comp rx=0 tx=0).stop 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 msgr2=0x7f4df4169f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df4169f30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b530 tx=0x7f4dec01a000 comp rx=0 tx=0).stop 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 shutdown_connections 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f4dd4066f30 0x7f4dd40693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4df40c8b10 0x7f4df4157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df40abae0 0x7f4df4169f30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 --2- 172.21.15.60:0/3939528473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df40abeb0 0x7f4df4149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 >> 172.21.15.60:0/3939528473 conn(0x7f4df4067660 msgr2=0x7f4df40c3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:41.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 shutdown_connections 2023-10-08T16:16:41.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.083+0000 7f4df8c72700 1 -- 172.21.15.60:0/3939528473 wait complete. 2023-10-08T16:16:41.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.288+0000 7f82626a8700 1 Processor -- start 2023-10-08T16:16:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.288+0000 7f82626a8700 1 -- start start 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82626a8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f825c0abb20 0x7f825c0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82626a8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f825c155eb0 0x7f825c156330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82626a8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c06d3e0 con 0x7f825c0ac690 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82626a8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0aebf0 con 0x7f825c0abb20 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82626a8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0aee10 con 0x7f825c155eb0 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8260ea5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f825c0abb20 0x7f825c0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82616a6700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f825c0ac690 0x7f825c0ae4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60536/0 (socket says 172.21.15.60:60536) 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f82616a6700 1 -- 172.21.15.60:0/3632363592 learned_addr learned my addr 172.21.15.60:0/3632363592 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8260ea5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f825c0abb20 0x7f825c0aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35214/0 (socket says 172.21.15.60:35214) 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8261ea7700 1 --2- 172.21.15.60:0/3632363592 >> v2:172.21.15.144:3300/0 conn(0x7f825c155eb0 0x7f825c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8260ea5700 1 -- 172.21.15.60:0/3632363592 >> v2:172.21.15.144:3300/0 conn(0x7f825c155eb0 msgr2=0x7f825c156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8260ea5700 1 --2- 172.21.15.60:0/3632363592 >> v2:172.21.15.144:3300/0 conn(0x7f825c155eb0 0x7f825c156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8260ea5700 1 -- 172.21.15.60:0/3632363592 >> v1:172.21.15.60:6789/0 conn(0x7f825c0ac690 legacy=0x7f825c0ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.289+0000 7f8260ea5700 1 -- 172.21.15.60:0/3632363592 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c06d650 con 0x7f825c0abb20 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f8260ea5700 1 --2- 172.21.15.60:0/3632363592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c0aca60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f8250009910 tx=0x7f82500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425fa5df21885a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f825bfff700 1 -- 172.21.15.60:0/3632363592 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011630 con 0x7f825c0abb20 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f825bfff700 1 -- 172.21.15.60:0/3632363592 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250011790 con 0x7f825c0abb20 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f825bfff700 1 -- 172.21.15.60:0/3632363592 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011b50 con 0x7f825c0abb20 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 -- 172.21.15.60:0/3632363592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 msgr2=0x7f825c0aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 --2- 172.21.15.60:0/3632363592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c0aca60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f8250009910 tx=0x7f82500091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 -- 172.21.15.60:0/3632363592 shutdown_connections 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 --2- 172.21.15.60:0/3632363592 >> v2:172.21.15.144:3300/0 conn(0x7f825c155eb0 0x7f825c156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 --2- 172.21.15.60:0/3632363592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c0aca60 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 -- 172.21.15.60:0/3632363592 >> 172.21.15.60:0/3632363592 conn(0x7f825c0680e0 msgr2=0x7f825c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:41.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 -- 172.21.15.60:0/3632363592 shutdown_connections 2023-10-08T16:16:41.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.290+0000 7f82626a8700 1 -- 172.21.15.60:0/3632363592 wait complete. 2023-10-08T16:16:41.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.291+0000 7f82626a8700 1 Processor -- start 2023-10-08T16:16:41.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 -- start start 2023-10-08T16:16:41.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:41.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f825c0ac690 0x7f825c143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f825c155eb0 0x7f825c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c143b60 con 0x7f825c0abb20 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c14ece0 con 0x7f825c0ac690 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82626a8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c14e0d0 con 0x7f825c155eb0 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.292+0000 7f82616a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c14f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35222/0 (socket says 172.21.15.60:35222) 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 -- 172.21.15.60:0/2518961956 learned_addr learned my addr 172.21.15.60:0/2518961956 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f8260ea5700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f825c0ac690 0x7f825c143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f8261ea7700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f825c155eb0 0x7f825c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 -- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f825c155eb0 msgr2=0x7f825c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f825c155eb0 0x7f825c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 -- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f825c0ac690 msgr2=0x7f825c143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f825c0ac690 0x7f825c143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 -- 172.21.15.60:0/2518961956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009420 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82616a6700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c14f170 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f825400c7c0 tx=0x7f8254007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254005b30 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8254005c90 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254004a80 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c14e3b0 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.293+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c14e970 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.294+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c14efc0 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.295+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82540070d0 con 0x7f825c0abb20 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.295+0000 7f82597fa700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8248066f30 0x7f82480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.295+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8254083810 con 0x7f825c0abb20 2023-10-08T16:16:41.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.295+0000 7f8260ea5700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8248066f30 0x7f82480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:41.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.296+0000 7f8260ea5700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8248066f30 0x7f82480693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8250009860 tx=0x7f8250017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.299+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f825404b5a0 con 0x7f825c0abb20 2023-10-08T16:16:41.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.534+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f825c06f280 con 0x7f825c0abb20 2023-10-08T16:16:41.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.534+0000 7f82597fa700 1 -- 172.21.15.60:0/2518961956 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f8254050a80 con 0x7f825c0abb20 2023-10-08T16:16:41.535 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:41.535 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:41.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8248066f30 msgr2=0x7f82480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8248066f30 0x7f82480693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8250009860 tx=0x7f8250017000 comp rx=0 tx=0).stop 2023-10-08T16:16:41.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 msgr2=0x7f825c14f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c14f170 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f825400c7c0 tx=0x7f8254007f70 comp rx=0 tx=0).stop 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 shutdown_connections 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8248066f30 0x7f82480693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f825c155eb0 0x7f825c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825c0abb20 0x7f825c14f170 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 --2- 172.21.15.60:0/2518961956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f825c0ac690 0x7f825c143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 >> 172.21.15.60:0/2518961956 conn(0x7f825c0680e0 msgr2=0x7f825c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 shutdown_connections 2023-10-08T16:16:41.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:41.537+0000 7f82626a8700 1 -- 172.21.15.60:0/2518961956 wait complete. 2023-10-08T16:16:41.539 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:41.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-08T16:16:41.688 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","whoami":0,"id":8196,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.260372382,"mdsmap_epoch":92,"osdmap_epoch":183,"osdmap_epoch_barrier":182,"uptime":39.816496921000002} 2023-10-08T16:16:41.688 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "3b329f4b-ad99-45f4-afa4-bcf45c7e9d39", "fs_name": "cephfs", "id": 8196, "mdsmap_epoch": 92, "osdmap_epoch": 183, "osdmap_epoch_barrier": 182, "rank_uptime": 34.260372382, "state": "up:active", "uptime": 39.816496921, "want_state": "up:active", "whoami": 0 } 2023-10-08T16:16:41.688 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T16:16:41.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:41.689 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-08T16:16:41.978 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records in 2023-10-08T16:16:41.978 INFO:teuthology.orchestra.run.smithi060.stderr:50+0 records out 2023-10-08T16:16:41.978 INFO:teuthology.orchestra.run.smithi060.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.27181 s, 193 MB/s 2023-10-08T16:16:41.981 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:16:41.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:16:42.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:16:42.067 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:16:42.067 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:16:42.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:42.067 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:16:42.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:16:42.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:42.127 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:16:42.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:16:42.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:16:42.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T16:16:42.185 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:16:42.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:42.186 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:16:42.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:42.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.359+0000 7fd724ee1700 1 Processor -- start 2023-10-08T16:16:42.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.359+0000 7fd724ee1700 1 -- start start 2023-10-08T16:16:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd724ee1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd72015a2b0 0x7fd7200b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd724ee1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7200cfe20 0x7fd7200ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd724ee1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7200c5d80 con 0x7fd7200d1c30 2023-10-08T16:16:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd724ee1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd720068470 con 0x7fd72015a2b0 2023-10-08T16:16:42.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd724ee1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7200c6060 con 0x7fd7200cfe20 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd71e59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd72015a2b0 0x7fd7200b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd71e59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd72015a2b0 0x7fd7200b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60946/0 (socket says 172.21.15.60:60946) 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.360+0000 7fd71e59c700 1 -- 172.21.15.60:0/2150808852 learned_addr learned my addr 172.21.15.60:0/2150808852 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71ed9d700 1 --2- 172.21.15.60:0/2150808852 >> v2:172.21.15.144:3300/0 conn(0x7fd7200cfe20 0x7fd7200ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71e59c700 1 -- 172.21.15.60:0/2150808852 >> v2:172.21.15.144:3300/0 conn(0x7fd7200cfe20 msgr2=0x7fd7200ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71e59c700 1 --2- 172.21.15.60:0/2150808852 >> v2:172.21.15.144:3300/0 conn(0x7fd7200cfe20 0x7fd7200ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71e59c700 1 -- 172.21.15.60:0/2150808852 >> v1:172.21.15.144:6789/0 conn(0x7fd7200d1c30 legacy=0x7fd7200cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71e59c700 1 -- 172.21.15.60:0/2150808852 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7200c6340 con 0x7fd72015a2b0 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71ed9d700 1 --2- 172.21.15.60:0/2150808852 >> v2:172.21.15.144:3300/0 conn(0x7fd7200cfe20 0x7fd7200ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71e59c700 1 --2- 172.21.15.60:0/2150808852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72015a2b0 0x7fd7200b3da0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd720064970 tx=0x7fd718009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac055170f2391b4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:42.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71d59a700 1 -- 172.21.15.60:0/2150808852 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718005c10 con 0x7fd72015a2b0 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71d59a700 1 -- 172.21.15.60:0/2150808852 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718005d70 con 0x7fd72015a2b0 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd71d59a700 1 -- 172.21.15.60:0/2150808852 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800b840 con 0x7fd72015a2b0 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd724ee1700 1 -- 172.21.15.60:0/2150808852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72015a2b0 msgr2=0x7fd7200b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.361+0000 7fd724ee1700 1 --2- 172.21.15.60:0/2150808852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72015a2b0 0x7fd7200b3da0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd720064970 tx=0x7fd718009220 comp rx=0 tx=0).stop 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.362+0000 7fd724ee1700 1 -- 172.21.15.60:0/2150808852 shutdown_connections 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.362+0000 7fd724ee1700 1 --2- 172.21.15.60:0/2150808852 >> v2:172.21.15.144:3300/0 conn(0x7fd7200cfe20 0x7fd7200ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.362+0000 7fd724ee1700 1 --2- 172.21.15.60:0/2150808852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72015a2b0 0x7fd7200b3da0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.362+0000 7fd724ee1700 1 -- 172.21.15.60:0/2150808852 >> 172.21.15.60:0/2150808852 conn(0x7fd720067e40 msgr2=0x7fd7200d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.362+0000 7fd724ee1700 1 -- 172.21.15.60:0/2150808852 shutdown_connections 2023-10-08T16:16:42.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.362+0000 7fd724ee1700 1 -- 172.21.15.60:0/2150808852 wait complete. 2023-10-08T16:16:42.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 Processor -- start 2023-10-08T16:16:42.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 -- start start 2023-10-08T16:16:42.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 0x7fd7200c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7200d1c30 0x7fd72015d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72015a2b0 0x7fd72016a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200ca350 con 0x7fd7200cfe20 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200c9740 con 0x7fd72015a2b0 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.363+0000 7fd724ee1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200c9a20 con 0x7fd7200d1c30 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 0x7fd7200c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 0x7fd7200c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60950/0 (socket says 172.21.15.60:60950) 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 -- 172.21.15.60:0/36324753 learned_addr learned my addr 172.21.15.60:0/36324753 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71dd9b700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7200d1c30 0x7fd72015d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71ed9d700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72015a2b0 0x7fd72016a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 -- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7200d1c30 msgr2=0x7fd72015d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7200d1c30 0x7fd72015d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 -- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72015a2b0 msgr2=0x7fd72016a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72015a2b0 0x7fd72016a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 -- 172.21.15.60:0/36324753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718009480 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd71e59c700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 0x7fd7200c9060 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd718009260 tx=0x7fd718015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718011940 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718011aa0 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718011e40 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7200c9d00 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.364+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd720158710 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.365+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72004c3c0 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.366+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd71801c630 con 0x7fd7200cfe20 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.366+0000 7fd7167fc700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd700066f30 0x7fd7000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.366+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd718086080 con 0x7fd7200cfe20 2023-10-08T16:16:42.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.366+0000 7fd71dd9b700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd700066f30 0x7fd7000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.367+0000 7fd71dd9b700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd700066f30 0x7fd7000693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd72015c970 tx=0x7fd708009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:42.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.371+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd718053250 con 0x7fd7200cfe20 2023-10-08T16:16:42.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.608+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7200c6b40 con 0x7fd7200cfe20 2023-10-08T16:16:42.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.608+0000 7fd7167fc700 1 -- 172.21.15.60:0/36324753 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fd718056870 con 0x7fd7200cfe20 2023-10-08T16:16:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:42.609 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd700066f30 msgr2=0x7fd7000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd700066f30 0x7fd7000693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd72015c970 tx=0x7fd708009060 comp rx=0 tx=0).stop 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 msgr2=0x7fd7200c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 0x7fd7200c9060 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd718009260 tx=0x7fd718015000 comp rx=0 tx=0).stop 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 shutdown_connections 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd700066f30 0x7fd7000693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72015a2b0 0x7fd72016a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7200cfe20 0x7fd7200c9060 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 --2- 172.21.15.60:0/36324753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7200d1c30 0x7fd72015d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 >> 172.21.15.60:0/36324753 conn(0x7fd720067e40 msgr2=0x7fd720069460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 shutdown_connections 2023-10-08T16:16:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.610+0000 7fd724ee1700 1 -- 172.21.15.60:0/36324753 wait complete. 2023-10-08T16:16:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:42.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:42.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 Processor -- start 2023-10-08T16:16:42.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 -- start start 2023-10-08T16:16:42.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f43a00b0890 0x7f43a00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43a00cbd40 0x7f43a0067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a0067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00cb370 con 0x7f43a00cbd40 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00b0c60 con 0x7f43a00b0890 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.742+0000 7f43a77e1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a006a1e0 con 0x7f43a006c630 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43a00cbd40 0x7f43a0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43a00cbd40 0x7f43a0067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60952/0 (socket says 172.21.15.60:60952) 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 -- 172.21.15.60:0/4174806830 learned_addr learned my addr 172.21.15.60:0/4174806830 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a557d700 1 --2- 172.21.15.60:0/4174806830 >> v2:172.21.15.144:3300/0 conn(0x7f43a00b0890 0x7f43a00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a5d7e700 1 --2- 172.21.15.60:0/4174806830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a0067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 -- 172.21.15.60:0/4174806830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 msgr2=0x7f43a0067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 --2- 172.21.15.60:0/4174806830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a0067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 -- 172.21.15.60:0/4174806830 >> v2:172.21.15.144:3300/0 conn(0x7f43a00b0890 msgr2=0x7f43a00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 --2- 172.21.15.60:0/4174806830 >> v2:172.21.15.144:3300/0 conn(0x7f43a00b0890 0x7f43a00cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 -- 172.21.15.60:0/4174806830 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a006cb80 con 0x7f43a00cbd40 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f43a4d7c700 1 --2- 172.21.15.60:0/4174806830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00cbd40 0x7f43a0067660 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f43a006aae0 tx=0x7f4394009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f6914ca5a2dd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f439ffff700 1 -- 172.21.15.60:0/4174806830 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400b640 con 0x7f43a00cbd40 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f439ffff700 1 -- 172.21.15.60:0/4174806830 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439400b7a0 con 0x7f43a00cbd40 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.743+0000 7f439ffff700 1 -- 172.21.15.60:0/4174806830 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400bb60 con 0x7f43a00cbd40 2023-10-08T16:16:42.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 -- 172.21.15.60:0/4174806830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00cbd40 msgr2=0x7f43a0067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 --2- 172.21.15.60:0/4174806830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00cbd40 0x7f43a0067660 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f43a006aae0 tx=0x7f4394009250 comp rx=0 tx=0).stop 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 -- 172.21.15.60:0/4174806830 shutdown_connections 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 --2- 172.21.15.60:0/4174806830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a0067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 --2- 172.21.15.60:0/4174806830 >> v2:172.21.15.144:3300/0 conn(0x7f43a00b0890 0x7f43a00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 --2- 172.21.15.60:0/4174806830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00cbd40 0x7f43a0067660 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 -- 172.21.15.60:0/4174806830 >> 172.21.15.60:0/4174806830 conn(0x7f43a006fe50 msgr2=0x7f43a0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 -- 172.21.15.60:0/4174806830 shutdown_connections 2023-10-08T16:16:42.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.744+0000 7f43a77e1700 1 -- 172.21.15.60:0/4174806830 wait complete. 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.745+0000 7f43a77e1700 1 Processor -- start 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.745+0000 7f43a77e1700 1 -- start start 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a77e1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a00aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a77e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 0x7f43a00afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a77e1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43a00cbd40 0x7f43a015e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a77e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00aad60 con 0x7f43a00b0890 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a77e1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00ab040 con 0x7f43a00cbd40 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a77e1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00ab320 con 0x7f43a006c630 2023-10-08T16:16:42.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 0x7f43a00afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 0x7f43a00afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60954/0 (socket says 172.21.15.60:60954) 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 -- 172.21.15.60:0/1706154615 learned_addr learned my addr 172.21.15.60:0/1706154615 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a5d7e700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43a00cbd40 0x7f43a015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a557d700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a00aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 -- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 msgr2=0x7f43a00aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a00aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 -- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43a00cbd40 msgr2=0x7f43a015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43a00cbd40 0x7f43a015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.746+0000 7f43a4d7c700 1 -- 172.21.15.60:0/1706154615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940094f0 con 0x7f43a00b0890 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.747+0000 7f43a4d7c700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 0x7f43a00afa60 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f43a006ab60 tx=0x7f4394017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:42.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.747+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400b910 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.747+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439400ba70 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.747+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394011630 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.747+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a00ab600 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.747+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a00ad3f0 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.748+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a00b2240 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.748+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43940119a0 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.749+0000 7f439d7fa700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f438c066f30 0x7f438c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.749+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4394085b60 con 0x7f43a00b0890 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.749+0000 7f43a557d700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f438c066f30 0x7f438c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:42.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.749+0000 7f43a557d700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f438c066f30 0x7f438c0693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4398009db0 tx=0x7f43980091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:42.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.753+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43a00b2240 con 0x7f43a00b0890 2023-10-08T16:16:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.945+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a00b2620 con 0x7f43a00b0890 2023-10-08T16:16:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.945+0000 7f439d7fa700 1 -- 172.21.15.60:0/1706154615 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f43a00b2620 con 0x7f43a00b0890 2023-10-08T16:16:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:42.946 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":183,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:38.413596+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:16:04.735531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T16:16:05.794306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f438c066f30 msgr2=0x7f438c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f438c066f30 0x7f438c0693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4398009db0 tx=0x7f43980091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 msgr2=0x7f43a00afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 0x7f43a00afa60 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f43a006ab60 tx=0x7f4394017000 comp rx=0 tx=0).stop 2023-10-08T16:16:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 shutdown_connections 2023-10-08T16:16:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f438c066f30 0x7f438c0693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43a006c630 0x7f43a00aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43a00cbd40 0x7f43a015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 --2- 172.21.15.60:0/1706154615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43a00b0890 0x7f43a00afa60 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.947+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 >> 172.21.15.60:0/1706154615 conn(0x7f43a006fe50 msgr2=0x7f43a0067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.948+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 shutdown_connections 2023-10-08T16:16:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:42.948+0000 7f43a77e1700 1 -- 172.21.15.60:0/1706154615 wait complete. 2023-10-08T16:16:42.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:49.613517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:16:04.735531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:16:05.794306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:16:42.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:16:43.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 Processor -- start 2023-10-08T16:16:43.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 -- start start 2023-10-08T16:16:43.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d940b4860 0x7f8d940b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d940b4c30 0x7f8d94159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8d94159fd0 0x7f8d940cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d940b14f0 con 0x7f8d940b4c30 2023-10-08T16:16:43.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d940b17d0 con 0x7f8d94159fd0 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.082+0000 7f8d99102700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d940b1ab0 con 0x7f8d940b4860 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d940b4c30 0x7f8d94159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d940b4c30 0x7f8d94159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60962/0 (socket says 172.21.15.60:60962) 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 -- 172.21.15.60:0/2477209826 learned_addr learned my addr 172.21.15.60:0/2477209826 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9359e700 1 --2- 172.21.15.60:0/2477209826 >> v2:172.21.15.144:3300/0 conn(0x7f8d94159fd0 0x7f8d940cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d92d9d700 1 --2- 172.21.15.60:0/2477209826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d940b4860 0x7f8d940b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 -- 172.21.15.60:0/2477209826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d940b4860 msgr2=0x7f8d940b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 --2- 172.21.15.60:0/2477209826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d940b4860 0x7f8d940b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 -- 172.21.15.60:0/2477209826 >> v2:172.21.15.144:3300/0 conn(0x7f8d94159fd0 msgr2=0x7f8d940cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 --2- 172.21.15.60:0/2477209826 >> v2:172.21.15.144:3300/0 conn(0x7f8d94159fd0 0x7f8d940cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 -- 172.21.15.60:0/2477209826 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940b1d90 con 0x7f8d940b4c30 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9359e700 1 --2- 172.21.15.60:0/2477209826 >> v2:172.21.15.144:3300/0 conn(0x7f8d94159fd0 0x7f8d940cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d9259c700 1 --2- 172.21.15.60:0/2477209826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d94159a90 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8d940d1ed0 tx=0x7f8d88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3028745c9f7552b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d91d9b700 1 -- 172.21.15.60:0/2477209826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800b6d0 con 0x7f8d940b4c30 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d91d9b700 1 -- 172.21.15.60:0/2477209826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800b830 con 0x7f8d940b4c30 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.083+0000 7f8d91d9b700 1 -- 172.21.15.60:0/2477209826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800bbf0 con 0x7f8d940b4c30 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 -- 172.21.15.60:0/2477209826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 msgr2=0x7f8d94159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 --2- 172.21.15.60:0/2477209826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d94159a90 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8d940d1ed0 tx=0x7f8d88009250 comp rx=0 tx=0).stop 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 -- 172.21.15.60:0/2477209826 shutdown_connections 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 --2- 172.21.15.60:0/2477209826 >> v2:172.21.15.144:3300/0 conn(0x7f8d94159fd0 0x7f8d940cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 --2- 172.21.15.60:0/2477209826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d940b4860 0x7f8d940b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 --2- 172.21.15.60:0/2477209826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d94159a90 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 -- 172.21.15.60:0/2477209826 >> 172.21.15.60:0/2477209826 conn(0x7f8d9409a0f0 msgr2=0x7f8d94067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:43.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 -- 172.21.15.60:0/2477209826 shutdown_connections 2023-10-08T16:16:43.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.084+0000 7f8d99102700 1 -- 172.21.15.60:0/2477209826 wait complete. 2023-10-08T16:16:43.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.085+0000 7f8d99102700 1 Processor -- start 2023-10-08T16:16:43.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.085+0000 7f8d99102700 1 -- start start 2023-10-08T16:16:43.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d99102700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d940b4860 0x7f8d940af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d99102700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d940af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d99102700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d94159fd0 0x7f8d9415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d99102700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9409dce0 con 0x7f8d940b4c30 2023-10-08T16:16:43.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d99102700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9409e820 con 0x7f8d940b4860 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d99102700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d94156100 con 0x7f8d94159fd0 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d940af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d940af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60966/0 (socket says 172.21.15.60:60966) 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 -- 172.21.15.60:0/2975021566 learned_addr learned my addr 172.21.15.60:0/2975021566 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d92d9d700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d940b4860 0x7f8d940af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9359e700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d94159fd0 0x7f8d9415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 -- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d94159fd0 msgr2=0x7f8d9415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d94159fd0 0x7f8d9415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 -- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d940b4860 msgr2=0x7f8d940af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d940b4860 0x7f8d940af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 -- 172.21.15.60:0/2975021566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c009a20 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.086+0000 7f8d9259c700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d940af980 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f8d88006fd0 tx=0x7f8d88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.087+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88000d10 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.087+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800b9a0 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.087+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d880094f0 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.087+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88026430 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.087+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d940aee90 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.088+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9409e9d0 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.088+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d88023030 con 0x7f8d940b4c30 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.088+0000 7f8d7affd700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.089+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d88085c00 con 0x7f8d940b4c30 2023-10-08T16:16:43.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.089+0000 7f8d92d9d700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.089+0000 7f8d92d9d700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8d80066f30 0x7f8d800693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009da0 tx=0x7f8d84009120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.093+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d9409e9d0 con 0x7f8d940b4c30 2023-10-08T16:16:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.281+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d9409e9d0 con 0x7f8d940b4c30 2023-10-08T16:16:43.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.281+0000 7f8d7affd700 1 -- 172.21.15.60:0/2975021566 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d9409e9d0 con 0x7f8d940b4c30 2023-10-08T16:16:43.283 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-08T16:16:43.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8d80066f30 msgr2=0x7f8d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8d80066f30 0x7f8d800693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009da0 tx=0x7f8d84009120 comp rx=0 tx=0).stop 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 msgr2=0x7f8d940af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d940af980 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f8d88006fd0 tx=0x7f8d88017000 comp rx=0 tx=0).stop 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 shutdown_connections 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d94159fd0 0x7f8d9415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d940b4860 0x7f8d940af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 --2- 172.21.15.60:0/2975021566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940b4c30 0x7f8d940af980 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 >> 172.21.15.60:0/2975021566 conn(0x7f8d9409a0f0 msgr2=0x7f8d94158430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 shutdown_connections 2023-10-08T16:16:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.284+0000 7f8d99102700 1 -- 172.21.15.60:0/2975021566 wait complete. 2023-10-08T16:16:43.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:16:43.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.419+0000 7f5934919700 1 Processor -- start 2023-10-08T16:16:43.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.419+0000 7f5934919700 1 -- start start 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f5934919700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5930159bb0 0x7f59300aa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f5934919700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59300b03e0 0x7f59300b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f5934919700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593006a2b0 con 0x7f59300b17b0 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f5934919700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300b0d20 con 0x7f5930159bb0 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f5934919700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5930069040 con 0x7f59300b03e0 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5930159bb0 0x7f59300aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f59300b17b0 0x7f593015e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56650/0 (socket says 172.21.15.60:56650) 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592e59c700 1 -- 172.21.15.60:0/1715539289 learned_addr learned my addr 172.21.15.60:0/1715539289 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:43.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592f59e700 1 --2- 172.21.15.60:0/1715539289 >> v2:172.21.15.144:3300/0 conn(0x7f59300b03e0 0x7f59300b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592ed9d700 1 -- 172.21.15.60:0/1715539289 >> v2:172.21.15.144:3300/0 conn(0x7f59300b03e0 msgr2=0x7f59300b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592ed9d700 1 --2- 172.21.15.60:0/1715539289 >> v2:172.21.15.144:3300/0 conn(0x7f59300b03e0 0x7f59300b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592ed9d700 1 -- 172.21.15.60:0/1715539289 >> v1:172.21.15.60:6789/0 conn(0x7f59300b17b0 legacy=0x7f593015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592ed9d700 1 -- 172.21.15.60:0/1715539289 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930069320 con 0x7f5930159bb0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592f59e700 1 --2- 172.21.15.60:0/1715539289 >> v2:172.21.15.144:3300/0 conn(0x7f59300b03e0 0x7f59300b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.420+0000 7f592dd9b700 1 -- 172.21.15.60:0/1715539289 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449412108 0 0) 0x7f593006a2b0 con 0x7f59300b17b0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f592ed9d700 1 --2- 172.21.15.60:0/1715539289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5930159bb0 0x7f59300aa870 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f5930068ca0 tx=0x7f59200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e595a9e1f33be83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f592dd9b700 1 -- 172.21.15.60:0/1715539289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000b6b0 con 0x7f5930159bb0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f592dd9b700 1 -- 172.21.15.60:0/1715539289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000b810 con 0x7f5930159bb0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f592dd9b700 1 -- 172.21.15.60:0/1715539289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000bbb0 con 0x7f5930159bb0 2023-10-08T16:16:43.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 -- 172.21.15.60:0/1715539289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5930159bb0 msgr2=0x7f59300aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 --2- 172.21.15.60:0/1715539289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5930159bb0 0x7f59300aa870 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f5930068ca0 tx=0x7f59200091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 -- 172.21.15.60:0/1715539289 shutdown_connections 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 --2- 172.21.15.60:0/1715539289 >> v2:172.21.15.144:3300/0 conn(0x7f59300b03e0 0x7f59300b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 --2- 172.21.15.60:0/1715539289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5930159bb0 0x7f59300aa870 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 -- 172.21.15.60:0/1715539289 >> 172.21.15.60:0/1715539289 conn(0x7f593006c700 msgr2=0x7f5930069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 -- 172.21.15.60:0/1715539289 shutdown_connections 2023-10-08T16:16:43.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.421+0000 7f5934919700 1 -- 172.21.15.60:0/1715539289 wait complete. 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 Processor -- start 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 -- start start 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59300b03e0 0x7f593014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 0x7f593015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5930159bb0 0x7f593014dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593016a790 con 0x7f59300b17b0 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593016a440 con 0x7f59300b03e0 2023-10-08T16:16:43.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f5934919700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593014fde0 con 0x7f5930159bb0 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f592e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 0x7f593015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f592e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 0x7f593015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60978/0 (socket says 172.21.15.60:60978) 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.423+0000 7f592e59c700 1 -- 172.21.15.60:0/1437635701 learned_addr learned my addr 172.21.15.60:0/1437635701 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592ed9d700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59300b03e0 0x7f593014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592f59e700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5930159bb0 0x7f593014dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592e59c700 1 -- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5930159bb0 msgr2=0x7f593014dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592e59c700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5930159bb0 0x7f593014dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592e59c700 1 -- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59300b03e0 msgr2=0x7f593014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592e59c700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59300b03e0 0x7f593014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592e59c700 1 -- 172.21.15.60:0/1437635701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009420 con 0x7f59300b17b0 2023-10-08T16:16:43.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f592e59c700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 0x7f593015c9b0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f591800c810 tx=0x7f5918007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918005c00 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918005d60 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59301500c0 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918007300 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.424+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593015cef0 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.425+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593016a8d0 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.425+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f591801b3b0 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.426+0000 7f5926ffd700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5910066f30 0x7f59100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.426+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59180839f0 con 0x7f59300b17b0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.426+0000 7f592ed9d700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5910066f30 0x7f59100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.426+0000 7f592ed9d700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5910066f30 0x7f59100693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f59200093f0 tx=0x7f5920017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.430+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f593016a8d0 con 0x7f59300b17b0 2023-10-08T16:16:43.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.624+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f593016a8d0 con 0x7f59300b17b0 2023-10-08T16:16:43.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.624+0000 7f5926ffd700 1 -- 172.21.15.60:0/1437635701 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f593016a8d0 con 0x7f59300b17b0 2023-10-08T16:16:43.625 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-08T16:16:43.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.626+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5910066f30 msgr2=0x7f59100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.626+0000 7f5934919700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5910066f30 0x7f59100693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f59200093f0 tx=0x7f5920017000 comp rx=0 tx=0).stop 2023-10-08T16:16:43.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 msgr2=0x7f593015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 0x7f593015c9b0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f591800c810 tx=0x7f5918007db0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 shutdown_connections 2023-10-08T16:16:43.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5910066f30 0x7f59100693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5930159bb0 0x7f593014dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59300b03e0 0x7f593014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 --2- 172.21.15.60:0/1437635701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59300b17b0 0x7f593015c9b0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 >> 172.21.15.60:0/1437635701 conn(0x7f593006c700 msgr2=0x7f59301532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 shutdown_connections 2023-10-08T16:16:43.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.627+0000 7f5934919700 1 -- 172.21.15.60:0/1437635701 wait complete. 2023-10-08T16:16:43.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:16:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.760+0000 7f61f1357700 1 Processor -- start 2023-10-08T16:16:43.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.761+0000 7f61f1357700 1 -- start start 2023-10-08T16:16:43.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.761+0000 7f61f1357700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f61ec15b9a0 0x7f61ec0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.761+0000 7f61f1357700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61ec06d370 0x7f61ec06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.761+0000 7f61f1357700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec15c8d0 con 0x7f61ec152300 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.761+0000 7f61f1357700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec0b1400 con 0x7f61ec06d370 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.761+0000 7f61f1357700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec15be20 con 0x7f61ec15b9a0 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61ec06d370 0x7f61ec06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61ec06d370 0x7f61ec06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60984/0 (socket says 172.21.15.60:60984) 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 -- 172.21.15.60:0/2911371419 learned_addr learned my addr 172.21.15.60:0/2911371419 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61ea7fc700 1 --2- 172.21.15.60:0/2911371419 >> v2:172.21.15.144:3300/0 conn(0x7f61ec15b9a0 0x7f61ec0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 -- 172.21.15.60:0/2911371419 >> v2:172.21.15.144:3300/0 conn(0x7f61ec15b9a0 msgr2=0x7f61ec0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 --2- 172.21.15.60:0/2911371419 >> v2:172.21.15.144:3300/0 conn(0x7f61ec15b9a0 0x7f61ec0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 -- 172.21.15.60:0/2911371419 >> v1:172.21.15.144:6789/0 conn(0x7f61ec152300 legacy=0x7f61ec158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 -- 172.21.15.60:0/2911371419 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec0c9370 con 0x7f61ec06d370 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61eb7fe700 1 --2- 172.21.15.60:0/2911371419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec06d370 0x7f61ec06d790 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f61ec06e8d0 tx=0x7f61dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e76d7cc1ec86784 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61e9ffb700 1 -- 172.21.15.60:0/2911371419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00e070 con 0x7f61ec06d370 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61e9ffb700 1 -- 172.21.15.60:0/2911371419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc00ba10 con 0x7f61ec06d370 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.762+0000 7f61e9ffb700 1 -- 172.21.15.60:0/2911371419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0092e0 con 0x7f61ec06d370 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 -- 172.21.15.60:0/2911371419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec06d370 msgr2=0x7f61ec06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 --2- 172.21.15.60:0/2911371419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec06d370 0x7f61ec06d790 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f61ec06e8d0 tx=0x7f61dc009840 comp rx=0 tx=0).stop 2023-10-08T16:16:43.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 -- 172.21.15.60:0/2911371419 shutdown_connections 2023-10-08T16:16:43.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 --2- 172.21.15.60:0/2911371419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec06d370 0x7f61ec06d790 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 --2- 172.21.15.60:0/2911371419 >> v2:172.21.15.144:3300/0 conn(0x7f61ec15b9a0 0x7f61ec0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 -- 172.21.15.60:0/2911371419 >> 172.21.15.60:0/2911371419 conn(0x7f61ec069870 msgr2=0x7f61ec069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:43.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 -- 172.21.15.60:0/2911371419 shutdown_connections 2023-10-08T16:16:43.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.763+0000 7f61f1357700 1 -- 172.21.15.60:0/2911371419 wait complete. 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.764+0000 7f61f1357700 1 Processor -- start 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.764+0000 7f61f1357700 1 -- start start 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61f1357700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f61ec06d370 0x7f61ec0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61f1357700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 0x7f61ec0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61f1357700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61ec15b9a0 0x7f61ec0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61f1357700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0c6dc0 con 0x7f61ec152300 2023-10-08T16:16:43.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61f1357700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0c61b0 con 0x7f61ec15b9a0 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61f1357700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0c6490 con 0x7f61ec06d370 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 0x7f61ec0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 0x7f61ec0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60990/0 (socket says 172.21.15.60:60990) 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 -- 172.21.15.60:0/2277373753 learned_addr learned my addr 172.21.15.60:0/2277373753 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61eb7fe700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61ec15b9a0 0x7f61ec0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61eaffd700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f61ec06d370 0x7f61ec0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 -- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f61ec06d370 msgr2=0x7f61ec0c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f61ec06d370 0x7f61ec0c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 -- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61ec15b9a0 msgr2=0x7f61ec0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61ec15b9a0 0x7f61ec0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 -- 172.21.15.60:0/2277373753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc009ae0 con 0x7f61ec152300 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61eaffd700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f61ec06d370 0x7f61ec0c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61eb7fe700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61ec15b9a0 0x7f61ec0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.765+0000 7f61ea7fc700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 0x7f61ec0c7250 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f61d400d860 tx=0x7f61d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.766+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4009610 con 0x7f61ec152300 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.766+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4009770 con 0x7f61ec152300 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.766+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec0c6770 con 0x7f61ec152300 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.766+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4009b30 con 0x7f61ec152300 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.766+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec0c8980 con 0x7f61ec152300 2023-10-08T16:16:43.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.766+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec04c3c0 con 0x7f61ec152300 2023-10-08T16:16:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.767+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61d401e460 con 0x7f61ec152300 2023-10-08T16:16:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.767+0000 7f61e2ffd700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61cc066f30 0x7f61cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.767+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61d4084ba0 con 0x7f61ec152300 2023-10-08T16:16:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.767+0000 7f61eaffd700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61cc066f30 0x7f61cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.768+0000 7f61eaffd700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61cc066f30 0x7f61cc0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f61e4002880 tx=0x7f61e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.772+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61d4051e10 con 0x7f61ec152300 2023-10-08T16:16:43.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.964+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61ec0c6f00 con 0x7f61ec152300 2023-10-08T16:16:43.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.964+0000 7f61e2ffd700 1 -- 172.21.15.60:0/2277373753 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61d4055430 con 0x7f61ec152300 2023-10-08T16:16:43.964 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61cc066f30 msgr2=0x7f61cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61cc066f30 0x7f61cc0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f61e4002880 tx=0x7f61e4009040 comp rx=0 tx=0).stop 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 msgr2=0x7f61ec0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 0x7f61ec0c7250 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f61d400d860 tx=0x7f61d4008040 comp rx=0 tx=0).stop 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 shutdown_connections 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f61cc066f30 0x7f61cc0693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f61ec06d370 0x7f61ec0c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61ec15b9a0 0x7f61ec0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 --2- 172.21.15.60:0/2277373753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ec152300 0x7f61ec0c7250 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:43.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 >> 172.21.15.60:0/2277373753 conn(0x7f61ec069870 msgr2=0x7f61ec069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:43.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 shutdown_connections 2023-10-08T16:16:43.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:43.966+0000 7f61f1357700 1 -- 172.21.15.60:0/2277373753 wait complete. 2023-10-08T16:16:43.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:44.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.097+0000 7f6838232700 1 Processor -- start 2023-10-08T16:16:44.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.097+0000 7f6838232700 1 -- start start 2023-10-08T16:16:44.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6838232700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68301523e0 0x7f683006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6838232700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6830158e50 0x7f68300cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6838232700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683006c010 con 0x7f6830152010 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6838232700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683006bd10 con 0x7f6830158e50 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6838232700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683015c060 con 0x7f68301523e0 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6835fce700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6830152010 0x7f683015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:32960/0 (socket says 172.21.15.60:32960) 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f6835fce700 1 -- 172.21.15.60:0/2092808238 learned_addr learned my addr 172.21.15.60:0/2092808238 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f68367cf700 1 --2- 172.21.15.60:0/2092808238 >> v2:172.21.15.144:3300/0 conn(0x7f6830158e50 0x7f68300cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.098+0000 7f68357cd700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68301523e0 0x7f683006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f6834fcc700 1 -- 172.21.15.60:0/2092808238 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436361265 0 0) 0x7f683006c010 con 0x7f6830152010 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f6834fcc700 1 -- 172.21.15.60:0/2092808238 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6818003570 con 0x7f6830152010 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f68367cf700 1 -- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68301523e0 msgr2=0x7f683006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f68367cf700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68301523e0 0x7f683006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f68367cf700 1 -- 172.21.15.60:0/2092808238 >> v1:172.21.15.144:6789/0 conn(0x7f6830152010 legacy=0x7f683015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f68367cf700 1 -- 172.21.15.60:0/2092808238 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683015c340 con 0x7f6830158e50 2023-10-08T16:16:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f68357cd700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68301523e0 0x7f683006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f68367cf700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6830158e50 0x7f68300cdf30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6820009e60 tx=0x7f6820009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1260e984eaf239 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f6834fcc700 1 -- 172.21.15.60:0/2092808238 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000e070 con 0x7f6830158e50 2023-10-08T16:16:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f6834fcc700 1 -- 172.21.15.60:0/2092808238 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682000bab0 con 0x7f6830158e50 2023-10-08T16:16:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.099+0000 7f6834fcc700 1 -- 172.21.15.60:0/2092808238 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000be70 con 0x7f6830158e50 2023-10-08T16:16:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 -- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6830158e50 msgr2=0x7f68300cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6830158e50 0x7f68300cdf30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6820009e60 tx=0x7f6820009780 comp rx=0 tx=0).stop 2023-10-08T16:16:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 -- 172.21.15.60:0/2092808238 shutdown_connections 2023-10-08T16:16:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6830158e50 0x7f68300cdf30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 --2- 172.21.15.60:0/2092808238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68301523e0 0x7f683006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 -- 172.21.15.60:0/2092808238 >> 172.21.15.60:0/2092808238 conn(0x7f6830069870 msgr2=0x7f6830069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 -- 172.21.15.60:0/2092808238 shutdown_connections 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.100+0000 7f6838232700 1 -- 172.21.15.60:0/2092808238 wait complete. 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.101+0000 7f6838232700 1 Processor -- start 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.101+0000 7f6838232700 1 -- start start 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6838232700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6830152010 0x7f6830150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6838232700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68301523e0 0x7f683014c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6838232700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 0x7f68300c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6838232700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68301511d0 con 0x7f6830158e50 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6838232700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830068830 con 0x7f68301523e0 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6838232700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6830067c20 con 0x7f6830152010 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 0x7f68300c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 0x7f68300c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60996/0 (socket says 172.21.15.60:60996) 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 -- 172.21.15.60:0/1357918225 learned_addr learned my addr 172.21.15.60:0/1357918225 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f6835fce700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6830152010 0x7f6830150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68357cd700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68301523e0 0x7f683014c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 -- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6830152010 msgr2=0x7f6830150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6830152010 0x7f6830150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 -- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68301523e0 msgr2=0x7f683014c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68301523e0 0x7f683014c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 -- 172.21.15.60:0/1357918225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009420 con 0x7f6830158e50 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.102+0000 7f68367cf700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 0x7f68300c60b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f68300c59e0 tx=0x7f6820019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.103+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820012e10 con 0x7f6830158e50 2023-10-08T16:16:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.103+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6820009a20 con 0x7f6830158e50 2023-10-08T16:16:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.103+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820027470 con 0x7f6830158e50 2023-10-08T16:16:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.103+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820027830 con 0x7f6830158e50 2023-10-08T16:16:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.103+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68300681e0 con 0x7f6830158e50 2023-10-08T16:16:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.104+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68300689e0 con 0x7f6830158e50 2023-10-08T16:16:44.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.104+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6820024070 con 0x7f6830158e50 2023-10-08T16:16:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.104+0000 7f682dffb700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f681c066f30 0x7f681c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.104+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6820086e60 con 0x7f6830158e50 2023-10-08T16:16:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.105+0000 7f6835fce700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f681c066f30 0x7f681c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.105+0000 7f6835fce700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f681c066f30 0x7f681c0693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.109+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68300689e0 con 0x7f6830158e50 2023-10-08T16:16:44.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.343+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68300689a0 con 0x7f6830158e50 2023-10-08T16:16:44.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.344+0000 7f682dffb700 1 -- 172.21.15.60:0/1357918225 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f68200540d0 con 0x7f6830158e50 2023-10-08T16:16:44.344 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:44.344 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:44.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f681c066f30 msgr2=0x7f681c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f681c066f30 0x7f681c0693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009040 comp rx=0 tx=0).stop 2023-10-08T16:16:44.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 msgr2=0x7f68300c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 0x7f68300c60b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f68300c59e0 tx=0x7f6820019000 comp rx=0 tx=0).stop 2023-10-08T16:16:44.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 shutdown_connections 2023-10-08T16:16:44.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f681c066f30 0x7f681c0693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6830152010 0x7f6830150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6830158e50 0x7f68300c60b0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 --2- 172.21.15.60:0/1357918225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68301523e0 0x7f683014c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 >> 172.21.15.60:0/1357918225 conn(0x7f6830069870 msgr2=0x7f68300ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:44.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 shutdown_connections 2023-10-08T16:16:44.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.346+0000 7f6838232700 1 -- 172.21.15.60:0/1357918225 wait complete. 2023-10-08T16:16:44.349 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:44.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.478+0000 7f7706b3e700 1 Processor -- start 2023-10-08T16:16:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.478+0000 7f7706b3e700 1 -- start start 2023-10-08T16:16:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7706b3e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7706b3e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f770015dda0 0x7f770015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7706b3e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000cb7c0 con 0x7f77000cd6e0 2023-10-08T16:16:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7706b3e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770015e850 con 0x7f770015dda0 2023-10-08T16:16:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7706b3e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000cc360 con 0x7f77000cdab0 2023-10-08T16:16:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f770633d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f770015dda0 0x7f770015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f770533b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7705b3c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f77000cd6e0 0x7f77000cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:32962/0 (socket says 172.21.15.60:32962) 2023-10-08T16:16:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.479+0000 7f7705b3c700 1 -- 172.21.15.60:0/927812094 learned_addr learned my addr 172.21.15.60:0/927812094 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:44.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f770633d700 1 -- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 msgr2=0x7f770015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:44.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f770633d700 1 --2- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f770633d700 1 -- 172.21.15.60:0/927812094 >> v1:172.21.15.144:6789/0 conn(0x7f77000cd6e0 legacy=0x7f77000cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f770633d700 1 -- 172.21.15.60:0/927812094 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770015e290 con 0x7f770015dda0 2023-10-08T16:16:44.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f770633d700 1 --2- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770015dda0 0x7f770015cbd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f76f00098e0 tx=0x7f76f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c97a6ecde5f641 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f7704b3a700 1 -- 172.21.15.60:0/927812094 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000b640 con 0x7f770015dda0 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f7704b3a700 1 -- 172.21.15.60:0/927812094 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f000b7a0 con 0x7f770015dda0 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.480+0000 7f7704b3a700 1 -- 172.21.15.60:0/927812094 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000bb40 con 0x7f770015dda0 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 -- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770015dda0 msgr2=0x7f770015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 --2- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770015dda0 0x7f770015cbd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f76f00098e0 tx=0x7f76f00091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 -- 172.21.15.60:0/927812094 shutdown_connections 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 --2- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f770015dda0 0x7f770015cbd0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 --2- 172.21.15.60:0/927812094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 -- 172.21.15.60:0/927812094 >> 172.21.15.60:0/927812094 conn(0x7f7700067660 msgr2=0x7f7700067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 -- 172.21.15.60:0/927812094 shutdown_connections 2023-10-08T16:16:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.481+0000 7f7706b3e700 1 -- 172.21.15.60:0/927812094 wait complete. 2023-10-08T16:16:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 Processor -- start 2023-10-08T16:16:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 -- start start 2023-10-08T16:16:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77000cd6e0 0x7f770015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 0x7f77001571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000c97e0 con 0x7f770015dda0 2023-10-08T16:16:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770016a6f0 con 0x7f77000cd6e0 2023-10-08T16:16:44.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.482+0000 7f7706b3e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770016a9d0 con 0x7f77000cdab0 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 0x7f77001571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 0x7f77001571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32776/0 (socket says 172.21.15.60:32776) 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 -- 172.21.15.60:0/3532275483 learned_addr learned my addr 172.21.15.60:0/3532275483 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f7705b3c700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77000cd6e0 0x7f770015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770533b700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 -- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 msgr2=0x7f770015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 -- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77000cd6e0 msgr2=0x7f770015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77000cd6e0 0x7f770015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 -- 172.21.15.60:0/3532275483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009420 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f770633d700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 0x7f77001571b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f77000c7b10 tx=0x7f76f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0011420 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770016acb0 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f0011580 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.483+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0011940 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.484+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770015b570 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.485+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77000c9990 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.485+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76f0011cb0 con 0x7f770015dda0 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.485+0000 7f76fdffb700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76ec066f30 0x7f76ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.485+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76f0086050 con 0x7f770015dda0 2023-10-08T16:16:44.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.485+0000 7f7705b3c700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76ec066f30 0x7f76ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.486+0000 7f7705b3c700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76ec066f30 0x7f76ec0693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f76f80020c0 tx=0x7f76f8001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.489+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77000c9990 con 0x7f770015dda0 2023-10-08T16:16:44.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.687+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77000c9920 con 0x7f770015dda0 2023-10-08T16:16:44.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.688+0000 7f76fdffb700 1 -- 172.21.15.60:0/3532275483 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f76f00532c0 con 0x7f770015dda0 2023-10-08T16:16:44.688 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:44.689 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":183,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:38.413596+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:16:04.735531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T16:16:05.794306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:44.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76ec066f30 msgr2=0x7f76ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76ec066f30 0x7f76ec0693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f76f80020c0 tx=0x7f76f8001a10 comp rx=0 tx=0).stop 2023-10-08T16:16:44.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 msgr2=0x7f77001571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 0x7f77001571b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f77000c7b10 tx=0x7f76f0017000 comp rx=0 tx=0).stop 2023-10-08T16:16:44.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 shutdown_connections 2023-10-08T16:16:44.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f76ec066f30 0x7f76ec0693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f770015dda0 0x7f77001571b0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77000cd6e0 0x7f770015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 --2- 172.21.15.60:0/3532275483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77000cdab0 0x7f770015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 >> 172.21.15.60:0/3532275483 conn(0x7f7700067660 msgr2=0x7f770015d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:44.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.690+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 shutdown_connections 2023-10-08T16:16:44.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.691+0000 7f7706b3e700 1 -- 172.21.15.60:0/3532275483 wait complete. 2023-10-08T16:16:44.703 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:16:44.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:44.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.821+0000 7f0b397d7700 1 Processor -- start 2023-10-08T16:16:44.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.821+0000 7f0b397d7700 1 -- start start 2023-10-08T16:16:44.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b397d7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b3415a620 0x7f0b3415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b397d7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b3415d580 0x7f0b34158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b397d7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3415cbb0 con 0x7f0b34157870 2023-10-08T16:16:44.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b397d7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3415bdb0 con 0x7f0b3415d580 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b397d7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3415bfa0 con 0x7f0b3415a620 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b337fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b3415d580 0x7f0b34158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b337fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b3415d580 0x7f0b34158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32792/0 (socket says 172.21.15.60:32792) 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b337fe700 1 -- 172.21.15.60:0/2238401748 learned_addr learned my addr 172.21.15.60:0/2238401748 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.822+0000 7f0b327fc700 1 --2- 172.21.15.60:0/2238401748 >> v2:172.21.15.144:3300/0 conn(0x7f0b3415a620 0x7f0b3415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b337fe700 1 -- 172.21.15.60:0/2238401748 >> v2:172.21.15.144:3300/0 conn(0x7f0b3415a620 msgr2=0x7f0b3415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b337fe700 1 --2- 172.21.15.60:0/2238401748 >> v2:172.21.15.144:3300/0 conn(0x7f0b3415a620 0x7f0b3415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b337fe700 1 -- 172.21.15.60:0/2238401748 >> v1:172.21.15.144:6789/0 conn(0x7f0b34157870 legacy=0x7f0b3415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b337fe700 1 -- 172.21.15.60:0/2238401748 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3415c280 con 0x7f0b3415d580 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b337fe700 1 --2- 172.21.15.60:0/2238401748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415d580 0x7f0b34158110 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0b3415cb20 tx=0x7f0b24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd83b2ebccaea4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b31ffb700 1 -- 172.21.15.60:0/2238401748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400e070 con 0x7f0b3415d580 2023-10-08T16:16:44.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b31ffb700 1 -- 172.21.15.60:0/2238401748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2400ba20 con 0x7f0b3415d580 2023-10-08T16:16:44.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b31ffb700 1 -- 172.21.15.60:0/2238401748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240092e0 con 0x7f0b3415d580 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b397d7700 1 -- 172.21.15.60:0/2238401748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415d580 msgr2=0x7f0b34158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.823+0000 7f0b397d7700 1 --2- 172.21.15.60:0/2238401748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415d580 0x7f0b34158110 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0b3415cb20 tx=0x7f0b24009840 comp rx=0 tx=0).stop 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.824+0000 7f0b397d7700 1 -- 172.21.15.60:0/2238401748 shutdown_connections 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.824+0000 7f0b397d7700 1 --2- 172.21.15.60:0/2238401748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415d580 0x7f0b34158110 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.824+0000 7f0b397d7700 1 --2- 172.21.15.60:0/2238401748 >> v2:172.21.15.144:3300/0 conn(0x7f0b3415a620 0x7f0b3415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.824+0000 7f0b397d7700 1 -- 172.21.15.60:0/2238401748 >> 172.21.15.60:0/2238401748 conn(0x7f0b34068ce0 msgr2=0x7f0b340690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.824+0000 7f0b397d7700 1 -- 172.21.15.60:0/2238401748 shutdown_connections 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.824+0000 7f0b397d7700 1 -- 172.21.15.60:0/2238401748 wait complete. 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.825+0000 7f0b397d7700 1 Processor -- start 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.825+0000 7f0b397d7700 1 -- start start 2023-10-08T16:16:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.825+0000 7f0b397d7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b34157870 0x7f0b3416df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 0x7f0b3416af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b3415d580 0x7f0b340cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b2400 con 0x7f0b3415a620 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b2140 con 0x7f0b34157870 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3414d1b0 con 0x7f0b3415d580 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 0x7f0b3416af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 0x7f0b3416af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32808/0 (socket says 172.21.15.60:32808) 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 -- 172.21.15.60:0/1937521749 learned_addr learned my addr 172.21.15.60:0/1937521749 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b32ffd700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b34157870 0x7f0b3416df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b337fe700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b3415d580 0x7f0b340cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 -- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b3415d580 msgr2=0x7f0b340cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b3415d580 0x7f0b340cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 -- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b34157870 msgr2=0x7f0b3416df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b34157870 0x7f0b3416df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 -- 172.21.15.60:0/1937521749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24009ae0 con 0x7f0b3415a620 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b337fe700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b3415d580 0x7f0b340cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b327fc700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 0x7f0b3416af40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00ec50 tx=0x7f0b1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00c7f0 con 0x7f0b3415a620 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00c950 con 0x7f0b3415a620 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b340d03a0 con 0x7f0b3415a620 2023-10-08T16:16:44.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00cd10 con 0x7f0b3415a620 2023-10-08T16:16:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.826+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b340cfde0 con 0x7f0b3415a620 2023-10-08T16:16:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.827+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b340b2570 con 0x7f0b3415a620 2023-10-08T16:16:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.828+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b1c013680 con 0x7f0b3415a620 2023-10-08T16:16:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.828+0000 7f0b2affd700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b14066f30 0x7f0b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.828+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b1c084790 con 0x7f0b3415a620 2023-10-08T16:16:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.828+0000 7f0b32ffd700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b14066f30 0x7f0b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.829+0000 7f0b32ffd700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b14066f30 0x7f0b140693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c003a80 tx=0x7f0b2c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:44.832+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b340b2570 con 0x7f0b3415a620 2023-10-08T16:16:45.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.066+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b340b2540 con 0x7f0b3415a620 2023-10-08T16:16:45.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.067+0000 7f0b2affd700 1 -- 172.21.15.60:0/1937521749 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f0b1c051a00 con 0x7f0b3415a620 2023-10-08T16:16:45.067 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:45.067 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b14066f30 msgr2=0x7f0b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b14066f30 0x7f0b140693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c003a80 tx=0x7f0b2c007ec0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 msgr2=0x7f0b3416af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 0x7f0b3416af40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00ec50 tx=0x7f0b1c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 shutdown_connections 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0b14066f30 0x7f0b140693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b3415d580 0x7f0b340cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b34157870 0x7f0b3416df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 --2- 172.21.15.60:0/1937521749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b3415a620 0x7f0b3416af40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 >> 172.21.15.60:0/1937521749 conn(0x7f0b34068ce0 msgr2=0x7f0b340b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 shutdown_connections 2023-10-08T16:16:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.069+0000 7f0b397d7700 1 -- 172.21.15.60:0/1937521749 wait complete. 2023-10-08T16:16:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:45.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:16:45.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 Processor -- start 2023-10-08T16:16:45.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 -- start start 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb798157870 0x7fb79815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb79815a620 0x7fb79815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79815cbb0 con 0x7fb79815d580 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79815bfa0 con 0x7fb79815a620 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.200+0000 7fb79d191700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79815c280 con 0x7fb798157870 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb79815a620 0x7fb79815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb796d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb798157870 0x7fb79815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb796d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb798157870 0x7fb79815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:46518/0 (socket says 172.21.15.60:46518) 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb79815a620 0x7fb79815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37658/0 (socket says 172.21.15.60:37658) 2023-10-08T16:16:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb796d9d700 1 -- 172.21.15.60:0/2612476088 learned_addr learned my addr 172.21.15.60:0/2612476088 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79759e700 1 --1- 172.21.15.60:0/2612476088 >> v1:172.21.15.144:6789/0 conn(0x7fb79815d580 0x7fb798158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:32980/0 (socket says 172.21.15.60:32980) 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79659c700 1 -- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb798157870 msgr2=0x7fb79815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79659c700 1 --2- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb798157870 0x7fb79815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79659c700 1 -- 172.21.15.60:0/2612476088 >> v1:172.21.15.144:6789/0 conn(0x7fb79815d580 legacy=0x7fb798158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb795d9b700 1 -- 172.21.15.60:0/2612476088 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874490025 0 0) 0x7fb79815cbb0 con 0x7fb79815d580 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.201+0000 7fb79659c700 1 -- 172.21.15.60:0/2612476088 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79815c560 con 0x7fb79815a620 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79659c700 1 --2- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb79815a620 0x7fb79815d040 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb7800098e0 tx=0x7fb7800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f919e8f943b8d646 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb795d9b700 1 -- 172.21.15.60:0/2612476088 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000b640 con 0x7fb79815a620 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb795d9b700 1 -- 172.21.15.60:0/2612476088 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78000b7a0 con 0x7fb79815a620 2023-10-08T16:16:45.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb795d9b700 1 -- 172.21.15.60:0/2612476088 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000bb40 con 0x7fb79815a620 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 -- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb79815a620 msgr2=0x7fb79815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 --2- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb79815a620 0x7fb79815d040 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb7800098e0 tx=0x7fb7800091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 -- 172.21.15.60:0/2612476088 shutdown_connections 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 --2- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb798157870 0x7fb79815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 --2- 172.21.15.60:0/2612476088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb79815a620 0x7fb79815d040 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 -- 172.21.15.60:0/2612476088 >> 172.21.15.60:0/2612476088 conn(0x7fb798068ce0 msgr2=0x7fb7980690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 -- 172.21.15.60:0/2612476088 shutdown_connections 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.202+0000 7fb79d191700 1 -- 172.21.15.60:0/2612476088 wait complete. 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 Processor -- start 2023-10-08T16:16:45.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 -- start start 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb798157870 0x7fb7981479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 0x7fb79815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb79815d580 0x7fb79815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79816c0f0 con 0x7fb79815a620 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79816b490 con 0x7fb798157870 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79d191700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79816b7c0 con 0x7fb79815d580 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.204+0000 7fb79659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 0x7fb79815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 0x7fb79815e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32810/0 (socket says 172.21.15.60:32810) 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 -- 172.21.15.60:0/2004126261 learned_addr learned my addr 172.21.15.60:0/2004126261 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb796d9d700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb798157870 0x7fb7981479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79759e700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb79815d580 0x7fb79815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 -- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb79815d580 msgr2=0x7fb79815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb79815d580 0x7fb79815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 -- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb798157870 msgr2=0x7fb7981479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb798157870 0x7fb7981479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 -- 172.21.15.60:0/2004126261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780009420 con 0x7fb79815a620 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79759e700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb79815d580 0x7fb79815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79659c700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 0x7fb79815e9e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fb79806b530 tx=0x7fb780017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000bb20 con 0x7fb79815a620 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780011420 con 0x7fb79815a620 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79816baa0 con 0x7fb79815a620 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800117c0 con 0x7fb79815a620 2023-10-08T16:16:45.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.205+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79816a740 con 0x7fb79815a620 2023-10-08T16:16:45.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.206+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79816c260 con 0x7fb79815a620 2023-10-08T16:16:45.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.207+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb780011b70 con 0x7fb79815a620 2023-10-08T16:16:45.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.207+0000 7fb78effd700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb778066f30 0x7fb7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.207+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb780085c10 con 0x7fb79815a620 2023-10-08T16:16:45.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.207+0000 7fb796d9d700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb778066f30 0x7fb7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.208+0000 7fb796d9d700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb778066f30 0x7fb7780693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb788006fa0 tx=0x7fb788008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.212+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb780052e80 con 0x7fb79815a620 2023-10-08T16:16:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.445+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb79804c3c0 con 0x7fb79815a620 2023-10-08T16:16:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.446+0000 7fb78effd700 1 -- 172.21.15.60:0/2004126261 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fb7800564a0 con 0x7fb79815a620 2023-10-08T16:16:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:45.446 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:16:06.823556+0000","modified":"2023-10-08T16:16:10.438211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8196":{"gid":8196,"name":"d","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/4049453252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":4049453252},{"type":"v1","addr":"172.21.15.144:6835","nonce":4049453252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T16:16:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb778066f30 msgr2=0x7fb7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb778066f30 0x7fb7780693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb788006fa0 tx=0x7fb788008040 comp rx=0 tx=0).stop 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 msgr2=0x7fb79815e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 0x7fb79815e9e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fb79806b530 tx=0x7fb780017000 comp rx=0 tx=0).stop 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 shutdown_connections 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb778066f30 0x7fb7780693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb79815d580 0x7fb79815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb798157870 0x7fb7981479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 --2- 172.21.15.60:0/2004126261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb79815a620 0x7fb79815e9e0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 >> 172.21.15.60:0/2004126261 conn(0x7fb798068ce0 msgr2=0x7fb798155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 shutdown_connections 2023-10-08T16:16:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.448+0000 7fb79d191700 1 -- 172.21.15.60:0/2004126261 wait complete. 2023-10-08T16:16:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 92 2023-10-08T16:16:45.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.580+0000 7fa330ce2700 1 Processor -- start 2023-10-08T16:16:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.580+0000 7fa330ce2700 1 -- start start 2023-10-08T16:16:45.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa330ce2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cdab0 0x7fa32c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa330ce2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa32c15dda0 0x7fa32c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa330ce2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c0cb7c0 con 0x7fa32c0cd6e0 2023-10-08T16:16:45.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa330ce2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c15e850 con 0x7fa32c15dda0 2023-10-08T16:16:45.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa330ce2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0cc360 con 0x7fa32c0cdab0 2023-10-08T16:16:45.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa32c15dda0 0x7fa32c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa32c0cd6e0 0x7fa32c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56662/0 (socket says 172.21.15.60:56662) 2023-10-08T16:16:45.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32b7fe700 1 -- 172.21.15.60:0/4094553690 learned_addr learned my addr 172.21.15.60:0/4094553690 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:45.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32affd700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cdab0 0x7fa32c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32bfff700 1 -- 172.21.15.60:0/4094553690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cdab0 msgr2=0x7fa32c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:45.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32bfff700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cdab0 0x7fa32c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32bfff700 1 -- 172.21.15.60:0/4094553690 >> v1:172.21.15.60:6789/0 conn(0x7fa32c0cd6e0 legacy=0x7fa32c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32a7fc700 1 -- 172.21.15.60:0/4094553690 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053643230 0 0) 0x7fa32c0cb7c0 con 0x7fa32c0cd6e0 2023-10-08T16:16:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32bfff700 1 -- 172.21.15.60:0/4094553690 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c15e290 con 0x7fa32c15dda0 2023-10-08T16:16:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.581+0000 7fa32affd700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cdab0 0x7fa32c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa32bfff700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c15dda0 0x7fa32c15cbd0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa324009e60 tx=0x7fa324009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27b5004b19b39a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa32a7fc700 1 -- 172.21.15.60:0/4094553690 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400e070 con 0x7fa32c15dda0 2023-10-08T16:16:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa32a7fc700 1 -- 172.21.15.60:0/4094553690 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32400bc30 con 0x7fa32c15dda0 2023-10-08T16:16:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa32a7fc700 1 -- 172.21.15.60:0/4094553690 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324012430 con 0x7fa32c15dda0 2023-10-08T16:16:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 -- 172.21.15.60:0/4094553690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c15dda0 msgr2=0x7fa32c15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c15dda0 0x7fa32c15cbd0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa324009e60 tx=0x7fa324009780 comp rx=0 tx=0).stop 2023-10-08T16:16:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 -- 172.21.15.60:0/4094553690 shutdown_connections 2023-10-08T16:16:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c15dda0 0x7fa32c15cbd0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4094553690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cdab0 0x7fa32c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 -- 172.21.15.60:0/4094553690 >> 172.21.15.60:0/4094553690 conn(0x7fa32c067660 msgr2=0x7fa32c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 -- 172.21.15.60:0/4094553690 shutdown_connections 2023-10-08T16:16:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.582+0000 7fa330ce2700 1 -- 172.21.15.60:0/4094553690 wait complete. 2023-10-08T16:16:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.583+0000 7fa330ce2700 1 Processor -- start 2023-10-08T16:16:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 -- start start 2023-10-08T16:16:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cd6e0 0x7fa32c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 0x7fa32c0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa32c15dda0 0x7fa32c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c156aa0 con 0x7fa32c0cdab0 2023-10-08T16:16:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c156610 con 0x7fa32c15dda0 2023-10-08T16:16:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa330ce2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c155a00 con 0x7fa32c0cd6e0 2023-10-08T16:16:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa32affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 0x7fa32c0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa32affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 0x7fa32c0b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32838/0 (socket says 172.21.15.60:32838) 2023-10-08T16:16:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.584+0000 7fa32affd700 1 -- 172.21.15.60:0/4054610083 learned_addr learned my addr 172.21.15.60:0/4054610083 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32b7fe700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cd6e0 0x7fa32c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32bfff700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa32c15dda0 0x7fa32c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32affd700 1 -- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cd6e0 msgr2=0x7fa32c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32affd700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cd6e0 0x7fa32c14c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32affd700 1 -- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa32c15dda0 msgr2=0x7fa32c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32affd700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa32c15dda0 0x7fa32c0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32affd700 1 -- 172.21.15.60:0/4054610083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324009a20 con 0x7fa32c0cdab0 2023-10-08T16:16:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa32affd700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 0x7fa32c0b5600 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c830 tx=0x7fa320008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320011600 con 0x7fa32c0cdab0 2023-10-08T16:16:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320011760 con 0x7fa32c0cdab0 2023-10-08T16:16:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c155ce0 con 0x7fa32c0cdab0 2023-10-08T16:16:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320011b20 con 0x7fa32c0cdab0 2023-10-08T16:16:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.585+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c156320 con 0x7fa32c0cdab0 2023-10-08T16:16:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.586+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c1567c0 con 0x7fa32c0cdab0 2023-10-08T16:16:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.586+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa32001a450 con 0x7fa32c0cdab0 2023-10-08T16:16:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.587+0000 7fa3137fe700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.587+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa320084990 con 0x7fa32c0cdab0 2023-10-08T16:16:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.587+0000 7fa32b7fe700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.587+0000 7fa32b7fe700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa318066f30 0x7fa3180693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0011e0 tx=0x7fa31c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.591+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa32c1567c0 con 0x7fa32c0cdab0 2023-10-08T16:16:45.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.785+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa32c156780 con 0x7fa32c0cdab0 2023-10-08T16:16:45.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.786+0000 7fa3137fe700 1 -- 172.21.15.60:0/4054610083 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fa320015090 con 0x7fa32c0cdab0 2023-10-08T16:16:45.786 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:45.786 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":183,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:38.413596+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:16:04.735531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T16:16:05.794306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:45.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa318066f30 msgr2=0x7fa3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa318066f30 0x7fa3180693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0011e0 tx=0x7fa31c009040 comp rx=0 tx=0).stop 2023-10-08T16:16:45.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 msgr2=0x7fa32c0b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 0x7fa32c0b5600 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c830 tx=0x7fa320008040 comp rx=0 tx=0).stop 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 shutdown_connections 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa32c0cd6e0 0x7fa32c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa32c15dda0 0x7fa32c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 --2- 172.21.15.60:0/4054610083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa32c0cdab0 0x7fa32c0b5600 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 >> 172.21.15.60:0/4054610083 conn(0x7fa32c067660 msgr2=0x7fa32c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 shutdown_connections 2023-10-08T16:16:45.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.788+0000 7fa330ce2700 1 -- 172.21.15.60:0/4054610083 wait complete. 2023-10-08T16:16:45.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:16:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.920+0000 7fb910c34700 1 Processor -- start 2023-10-08T16:16:45.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.921+0000 7fb910c34700 1 -- start start 2023-10-08T16:16:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.921+0000 7fb910c34700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb90c0b0890 0x7fb90c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.921+0000 7fb910c34700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb90c0cbd40 0x7fb90c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb910c34700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0cb370 con 0x7fb90c06c630 2023-10-08T16:16:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb910c34700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c0b0c60 con 0x7fb90c0b0890 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb910c34700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c06a1e0 con 0x7fb90c0cbd40 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb90c0b0890 0x7fb90c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb90c06c630 0x7fb90c15dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56664/0 (socket says 172.21.15.60:56664) 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb90c0b0890 0x7fb90c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32852/0 (socket says 172.21.15.60:32852) 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90ad9d700 1 -- 172.21.15.60:0/2607668747 learned_addr learned my addr 172.21.15.60:0/2607668747 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb909d9b700 1 --2- 172.21.15.60:0/2607668747 >> v2:172.21.15.144:3300/0 conn(0x7fb90c0cbd40 0x7fb90c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 -- 172.21.15.60:0/2607668747 >> v2:172.21.15.144:3300/0 conn(0x7fb90c0cbd40 msgr2=0x7fb90c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 --2- 172.21.15.60:0/2607668747 >> v2:172.21.15.144:3300/0 conn(0x7fb90c0cbd40 0x7fb90c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 -- 172.21.15.60:0/2607668747 >> v1:172.21.15.60:6789/0 conn(0x7fb90c06c630 legacy=0x7fb90c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90959a700 1 -- 172.21.15.60:0/2607668747 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046197331 0 0) 0x7fb90c0cb370 con 0x7fb90c06c630 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 -- 172.21.15.60:0/2607668747 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c06cb80 con 0x7fb90c0b0890 2023-10-08T16:16:45.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90a59c700 1 --2- 172.21.15.60:0/2607668747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c0b0890 0x7fb90c0cb800 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fb90c064ae0 tx=0x7fb904009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7159f42dcc2cff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90959a700 1 -- 172.21.15.60:0/2607668747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90400e070 con 0x7fb90c0b0890 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90959a700 1 -- 172.21.15.60:0/2607668747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90400bc30 con 0x7fb90c0b0890 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.922+0000 7fb90959a700 1 -- 172.21.15.60:0/2607668747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904012430 con 0x7fb90c0b0890 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 -- 172.21.15.60:0/2607668747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c0b0890 msgr2=0x7fb90c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 --2- 172.21.15.60:0/2607668747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c0b0890 0x7fb90c0cb800 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fb90c064ae0 tx=0x7fb904009780 comp rx=0 tx=0).stop 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 -- 172.21.15.60:0/2607668747 shutdown_connections 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 --2- 172.21.15.60:0/2607668747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c0b0890 0x7fb90c0cb800 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 --2- 172.21.15.60:0/2607668747 >> v2:172.21.15.144:3300/0 conn(0x7fb90c0cbd40 0x7fb90c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 -- 172.21.15.60:0/2607668747 >> 172.21.15.60:0/2607668747 conn(0x7fb90c06fe50 msgr2=0x7fb90c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 -- 172.21.15.60:0/2607668747 shutdown_connections 2023-10-08T16:16:45.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.923+0000 7fb910c34700 1 -- 172.21.15.60:0/2607668747 wait complete. 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.924+0000 7fb910c34700 1 Processor -- start 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.924+0000 7fb910c34700 1 -- start start 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb910c34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 0x7fb90c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb910c34700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb90c0b0890 0x7fb90c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb910c34700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb90c0cbd40 0x7fb90c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb910c34700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b18d0 con 0x7fb90c06c630 2023-10-08T16:16:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb910c34700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b1b20 con 0x7fb90c0b0890 2023-10-08T16:16:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb910c34700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b1e00 con 0x7fb90c0cbd40 2023-10-08T16:16:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 0x7fb90c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 0x7fb90c159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32868/0 (socket says 172.21.15.60:32868) 2023-10-08T16:16:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 -- 172.21.15.60:0/3078920917 learned_addr learned my addr 172.21.15.60:0/3078920917 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb909d9b700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb90c0b0890 0x7fb90c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90ad9d700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb90c0cbd40 0x7fb90c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 -- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb90c0cbd40 msgr2=0x7fb90c0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb90c0cbd40 0x7fb90c0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 -- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb90c0b0890 msgr2=0x7fb90c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb90c0b0890 0x7fb90c0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 -- 172.21.15.60:0/3078920917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904009a20 con 0x7fb90c06c630 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.925+0000 7fb90a59c700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 0x7fb90c159d40 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fb9040099f0 tx=0x7fb904019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.926+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904012d70 con 0x7fb90c06c630 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.926+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904027470 con 0x7fb90c06c630 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.926+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c0b20e0 con 0x7fb90c06c630 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.926+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904027830 con 0x7fb90c06c630 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.926+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c0b26a0 con 0x7fb90c06c630 2023-10-08T16:16:45.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.926+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c04c3c0 con 0x7fb90c06c630 2023-10-08T16:16:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.927+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb904024070 con 0x7fb90c06c630 2023-10-08T16:16:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.927+0000 7fb9027fc700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.927+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb904086a60 con 0x7fb90c06c630 2023-10-08T16:16:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.927+0000 7fb909d9b700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.928+0000 7fb909d9b700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb90c16dba0 tx=0x7fb8f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:45.931+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb904053cd0 con 0x7fb90c06c630 2023-10-08T16:16:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.170+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb90c06cdc0 con 0x7fb90c06c630 2023-10-08T16:16:46.170 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-08T16:16:46.170+0000 7f9190968700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:16:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.174+0000 7fb9027fc700 1 -- 172.21.15.60:0/3078920917 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb90402c020 con 0x7fb90c06c630 2023-10-08T16:16:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8ec066f30 msgr2=0x7fb8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb90c16dba0 tx=0x7fb8f4008040 comp rx=0 tx=0).stop 2023-10-08T16:16:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 msgr2=0x7fb90c159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 0x7fb90c159d40 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fb9040099f0 tx=0x7fb904019000 comp rx=0 tx=0).stop 2023-10-08T16:16:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 shutdown_connections 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb90c0cbd40 0x7fb90c0b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb90c06c630 0x7fb90c159d40 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 --2- 172.21.15.60:0/3078920917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb90c0b0890 0x7fb90c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 >> 172.21.15.60:0/3078920917 conn(0x7fb90c06fe50 msgr2=0x7fb90c15c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 shutdown_connections 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.177+0000 7fb910c34700 1 -- 172.21.15.60:0/3078920917 wait complete. 2023-10-08T16:16:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:16:46.179 INFO:tasks.ceph.mds.d.smithi144.stderr: -7708> 2023-10-08T16:16:12.253+0000 7f043a1ea700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:16:46.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:16:46.208 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-08T16:16:46.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.310+0000 7f31cc92b700 1 Processor -- start 2023-10-08T16:16:46.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.310+0000 7f31cc92b700 1 -- start start 2023-10-08T16:16:46.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31cc92b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31c80b6580 0x7f31c806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:46.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31cc92b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c806a830 0x7f31c80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31cc92b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806ac90 con 0x7f31c80cce30 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31cc92b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80b4d70 con 0x7f31c80b6580 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31cc92b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c815b3b0 con 0x7f31c806a830 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31c80b6580 0x7f31c806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c806a830 0x7f31c80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31c80b6580 0x7f31c806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37696/0 (socket says 172.21.15.60:37696) 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c6d9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f31c80cce30 0x7f31c815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:32982/0 (socket says 172.21.15.60:32982) 2023-10-08T16:16:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 -- 172.21.15.60:0/2383939430 learned_addr learned my addr 172.21.15.60:0/2383939430 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 -- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c806a830 msgr2=0x7f31c80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 --2- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c806a830 0x7f31c80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 -- 172.21.15.60:0/2383939430 >> v1:172.21.15.144:6789/0 conn(0x7f31c80cce30 legacy=0x7f31c815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 -- 172.21.15.60:0/2383939430 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80cd8d0 con 0x7f31c80b6580 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c5d9b700 1 -- 172.21.15.60:0/2383939430 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363283952 0 0) 0x7f31b8001110 con 0x7f31c80cce30 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c759e700 1 --2- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c806a830 0x7f31c80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.311+0000 7f31c659c700 1 --2- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c80b6580 0x7f31c806a2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0099b0 tx=0x7f31bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77154502ce783e43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31c5d9b700 1 -- 172.21.15.60:0/2383939430 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009ea0 con 0x7f31c80b6580 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31c5d9b700 1 -- 172.21.15.60:0/2383939430 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00b860 con 0x7f31c80b6580 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31c5d9b700 1 -- 172.21.15.60:0/2383939430 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00bc00 con 0x7f31c80b6580 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 -- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c80b6580 msgr2=0x7f31c806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 --2- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c80b6580 0x7f31c806a2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0099b0 tx=0x7f31bc009250 comp rx=0 tx=0).stop 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 -- 172.21.15.60:0/2383939430 shutdown_connections 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 --2- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c806a830 0x7f31c80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 --2- 172.21.15.60:0/2383939430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c80b6580 0x7f31c806a2f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 -- 172.21.15.60:0/2383939430 >> 172.21.15.60:0/2383939430 conn(0x7f31c8068cb0 msgr2=0x7f31c80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 -- 172.21.15.60:0/2383939430 shutdown_connections 2023-10-08T16:16:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.312+0000 7f31cc92b700 1 -- 172.21.15.60:0/2383939430 wait complete. 2023-10-08T16:16:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.313+0000 7f31cc92b700 1 Processor -- start 2023-10-08T16:16:46.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.313+0000 7f31cc92b700 1 -- start start 2023-10-08T16:16:46.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31cc92b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c806a830 0x7f31c813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:46.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31cc92b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 0x7f31c80b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:46.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31cc92b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c80cce30 0x7f31c80b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:46.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31cc92b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8155f60 con 0x7f31c80b6580 2023-10-08T16:16:46.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31cc92b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8156240 con 0x7f31c806a830 2023-10-08T16:16:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31cc92b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8156520 con 0x7f31c80cce30 2023-10-08T16:16:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31c659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 0x7f31c80b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31c659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 0x7f31c80b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32870/0 (socket says 172.21.15.60:32870) 2023-10-08T16:16:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31c659c700 1 -- 172.21.15.60:0/1786229430 learned_addr learned my addr 172.21.15.60:0/1786229430 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31c759e700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c80cce30 0x7f31c80b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.314+0000 7f31c6d9d700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c806a830 0x7f31c813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31c659c700 1 -- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c80cce30 msgr2=0x7f31c80b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31c659c700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c80cce30 0x7f31c80b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31c659c700 1 -- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c806a830 msgr2=0x7f31c813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31c659c700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c806a830 0x7f31c813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31c659c700 1 -- 172.21.15.60:0/1786229430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0009a20 con 0x7f31c80b6580 2023-10-08T16:16:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31c659c700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 0x7f31c80b15a0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f31c806b300 tx=0x7f31bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00bbe0 con 0x7f31c80b6580 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc011420 con 0x7f31c80b6580 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0094f0 con 0x7f31c80b6580 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0117c0 con 0x7f31c80b6580 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.315+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c8156ae0 con 0x7f31c80b6580 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.316+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c8156cd0 con 0x7f31c80b6580 2023-10-08T16:16:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.316+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31bc011bf0 con 0x7f31c80b6580 2023-10-08T16:16:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.317+0000 7f31aeffd700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31b4066f30 0x7f31b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.317+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f31bc085b40 con 0x7f31c80b6580 2023-10-08T16:16:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.317+0000 7f31c6d9d700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31b4066f30 0x7f31b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.317+0000 7f31c6d9d700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31b4066f30 0x7f31b40693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f31b8007fd0 tx=0x7f31b8007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.321+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31bc052de0 con 0x7f31c80b6580 2023-10-08T16:16:46.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:46.561+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31c80b4440 con 0x7f31c80b6580 2023-10-08T16:16:47.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.175+0000 7f31aeffd700 1 -- 172.21.15.60:0/1786229430 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7f31bc056400 con 0x7f31c80b6580 2023-10-08T16:16:47.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31b4066f30 msgr2=0x7f31b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:47.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31b4066f30 0x7f31b40693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f31b8007fd0 tx=0x7f31b8007e10 comp rx=0 tx=0).stop 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 msgr2=0x7f31c80b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 0x7f31c80b15a0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f31c806b300 tx=0x7f31bc017000 comp rx=0 tx=0).stop 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 shutdown_connections 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f31b4066f30 0x7f31b40693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c80cce30 0x7f31c80b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c806a830 0x7f31c813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 --2- 172.21.15.60:0/1786229430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b6580 0x7f31c80b15a0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 >> 172.21.15.60:0/1786229430 conn(0x7f31c8068cb0 msgr2=0x7f31c815ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 shutdown_connections 2023-10-08T16:16:47.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.177+0000 7f31cc92b700 1 -- 172.21.15.60:0/1786229430 wait complete. 2023-10-08T16:16:47.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:16:47.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 Processor -- start 2023-10-08T16:16:47.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 -- start start 2023-10-08T16:16:47.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeb0157ac0 0x7fdeb00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:47.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdeb015ac90 0x7fdeb00d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00d08e0 con 0x7fdeb00d0d40 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb015b110 con 0x7fdeb0157ac0 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.319+0000 7fdeb6d3a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00d1700 con 0x7fdeb015ac90 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeb0157ac0 0x7fdeb00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeb0157ac0 0x7fdeb00d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32874/0 (socket says 172.21.15.60:32874) 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 -- 172.21.15.60:0/623546592 learned_addr learned my addr 172.21.15.60:0/623546592 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb52d7700 1 --2- 172.21.15.60:0/623546592 >> v2:172.21.15.144:3300/0 conn(0x7fdeb015ac90 0x7fdeb00d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 -- 172.21.15.60:0/623546592 >> v2:172.21.15.144:3300/0 conn(0x7fdeb015ac90 msgr2=0x7fdeb00d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 --2- 172.21.15.60:0/623546592 >> v2:172.21.15.144:3300/0 conn(0x7fdeb015ac90 0x7fdeb00d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 -- 172.21.15.60:0/623546592 >> v1:172.21.15.144:6789/0 conn(0x7fdeb00d0d40 legacy=0x7fdeb015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:47.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 -- 172.21.15.60:0/623546592 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0157e90 con 0x7fdeb0157ac0 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeb4ad6700 1 --2- 172.21.15.60:0/623546592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0157ac0 0x7fdeb00d03a0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00ce7d0 tx=0x7fdea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cf9066a4e4db36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeaf7fe700 1 -- 172.21.15.60:0/623546592 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000b820 con 0x7fdeb0157ac0 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeaf7fe700 1 -- 172.21.15.60:0/623546592 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000b980 con 0x7fdeb0157ac0 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.320+0000 7fdeaf7fe700 1 -- 172.21.15.60:0/623546592 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000bd20 con 0x7fdeb0157ac0 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/623546592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0157ac0 msgr2=0x7fdeb00d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/623546592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0157ac0 0x7fdeb00d03a0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00ce7d0 tx=0x7fdea0009250 comp rx=0 tx=0).stop 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/623546592 shutdown_connections 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/623546592 >> v2:172.21.15.144:3300/0 conn(0x7fdeb015ac90 0x7fdeb00d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/623546592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb0157ac0 0x7fdeb00d03a0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/623546592 >> 172.21.15.60:0/623546592 conn(0x7fdeb00680f0 msgr2=0x7fdeb00b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/623546592 shutdown_connections 2023-10-08T16:16:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.321+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/623546592 wait complete. 2023-10-08T16:16:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.322+0000 7fdeb6d3a700 1 Processor -- start 2023-10-08T16:16:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.322+0000 7fdeb6d3a700 1 -- start start 2023-10-08T16:16:47.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb6d3a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb00d0d40 0x7fdeb00b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:47.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb6d3a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb0157ac0 0x7fdeb0155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:47.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb6d3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 0x7fdeb01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:47.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb6d3a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0155ae0 con 0x7fdeb015ac90 2023-10-08T16:16:47.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb6d3a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb016b610 con 0x7fdeb00d0d40 2023-10-08T16:16:47.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb6d3a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb016aa20 con 0x7fdeb0157ac0 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 0x7fdeb01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 0x7fdeb01555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32878/0 (socket says 172.21.15.60:32878) 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 -- 172.21.15.60:0/326586192 learned_addr learned my addr 172.21.15.60:0/326586192 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb4ad6700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb00d0d40 0x7fdeb00b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeaffff700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb0157ac0 0x7fdeb0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 -- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb0157ac0 msgr2=0x7fdeb0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb0157ac0 0x7fdeb0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 -- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb00d0d40 msgr2=0x7fdeb00b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb00d0d40 0x7fdeb00b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 -- 172.21.15.60:0/326586192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00094f0 con 0x7fdeb015ac90 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeaffff700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb0157ac0 0x7fdeb0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:47.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.323+0000 7fdeb52d7700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 0x7fdeb01555a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009fa0 tx=0x7fdea8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.324+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800ec70 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.324+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800edd0 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.324+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb016ace0 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.324+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8014670 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.324+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb016b2a0 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.325+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb016b780 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.325+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdea80149e0 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.325+0000 7fdeacff9700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde9c066f30 0x7fde9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.325+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdea8084c60 con 0x7fdeb015ac90 2023-10-08T16:16:47.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.325+0000 7fdeb4ad6700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde9c066f30 0x7fde9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:47.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.326+0000 7fdeb4ad6700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde9c066f30 0x7fde9c0693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00ce7d0 tx=0x7fdea0016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:47.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.330+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdea8051e80 con 0x7fdeb015ac90 2023-10-08T16:16:47.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:47.524+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdeb004c3c0 con 0x7fdeb015ac90 2023-10-08T16:16:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.177+0000 7fdeacff9700 1 -- 172.21.15.60:0/326586192 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v185) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdea80554a0 con 0x7fdeb015ac90 2023-10-08T16:16:48.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde9c066f30 msgr2=0x7fde9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde9c066f30 0x7fde9c0693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00ce7d0 tx=0x7fdea0016000 comp rx=0 tx=0).stop 2023-10-08T16:16:48.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 msgr2=0x7fdeb01555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 0x7fdeb01555a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009fa0 tx=0x7fdea8009900 comp rx=0 tx=0).stop 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 shutdown_connections 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fde9c066f30 0x7fde9c0693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb015ac90 0x7fdeb01555a0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb00d0d40 0x7fdeb00b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 --2- 172.21.15.60:0/326586192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb0157ac0 0x7fdeb0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 >> 172.21.15.60:0/326586192 conn(0x7fdeb00680f0 msgr2=0x7fdeb00b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 shutdown_connections 2023-10-08T16:16:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.180+0000 7fdeb6d3a700 1 -- 172.21.15.60:0/326586192 wait complete. 2023-10-08T16:16:48.182 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:16:48.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:16:48.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.322+0000 7fa7f8344700 1 Processor -- start 2023-10-08T16:16:48.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.322+0000 7fa7f8344700 1 -- start start 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f8344700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 0x7fa7f015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f8344700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00b17b0 con 0x7fa7f0159ef0 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f8344700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00b1a60 con 0x7fa7f00b46f0 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f8344700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00b1d40 con 0x7fa7f00b6a10 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f60e0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa7f0159ef0 0x7fa7f00b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56672/0 (socket says 172.21.15.60:56672) 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f60e0700 1 -- 172.21.15.60:0/3280808636 learned_addr learned my addr 172.21.15.60:0/3280808636 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f58df700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 0x7fa7f015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.323+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510441202 0 0) 0x7fa7f00b17b0 con 0x7fa7f0159ef0 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d8003570 con 0x7fa7f0159ef0 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2067260556 0 0) 0x7fa7d8003570 con 0x7fa7f0159ef0 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 msgr2=0x7fa7f015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 0x7fa7f015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 >> v1:172.21.15.144:6789/0 conn(0x7fa7f00b46f0 legacy=0x7fa7f00cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00b2020 con 0x7fa7f0159ef0 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fa7e80015f0 con 0x7fa7f0159ef0 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 >> v1:172.21.15.60:6789/0 conn(0x7fa7f0159ef0 legacy=0x7fa7f00b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d8003a90 0x7fa7d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d8004810 0x7fa7d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 0x7fa7d80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00b1d40 con 0x7fa7d8004810 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d800bb60 con 0x7fa7d8003a90 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d800bd20 con 0x7fa7f00b6a10 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f58df700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d8004810 0x7fa7d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f60e0700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d8003a90 0x7fa7d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f68e1700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 0x7fa7d80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f58df700 1 -- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 msgr2=0x7fa7d80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f58df700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7f00b6a10 0x7fa7d80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f58df700 1 -- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d8003a90 msgr2=0x7fa7d8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f58df700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7d8003a90 0x7fa7d8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.324+0000 7fa7f58df700 1 -- 172.21.15.60:0/3280808636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8003570 con 0x7fa7d8004810 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f58df700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d8004810 0x7fa7d8004c80 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009c00 tx=0x7fa7e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f005b6f64f982f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:48.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400e710 con 0x7fa7d8004810 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400e870 con 0x7fa7d8004810 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f50de700 1 -- 172.21.15.60:0/3280808636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400ec30 con 0x7fa7d8004810 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f8344700 1 -- 172.21.15.60:0/3280808636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d8004810 msgr2=0x7fa7d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f8344700 1 --2- 172.21.15.60:0/3280808636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d8004810 0x7fa7d8004c80 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009c00 tx=0x7fa7e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f68e1700 1 -- 172.21.15.60:0/3280808636 reap_dead start 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f8344700 1 -- 172.21.15.60:0/3280808636 shutdown_connections 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f8344700 1 -- 172.21.15.60:0/3280808636 >> 172.21.15.60:0/3280808636 conn(0x7fa7f009a0a0 msgr2=0x7fa7f0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f8344700 1 -- 172.21.15.60:0/3280808636 shutdown_connections 2023-10-08T16:16:48.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.325+0000 7fa7f8344700 1 -- 172.21.15.60:0/3280808636 wait complete. 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.326+0000 7fa7f8344700 1 Processor -- start 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.326+0000 7fa7f8344700 1 -- start start 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f8344700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d8004810 0x7fa7f0155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f8344700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7f016b070 0x7fa7f006a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f8344700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 0x7fa7f00af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f8344700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f006aae0 con 0x7fa7f006a680 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f8344700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f00aece0 con 0x7fa7f016b070 2023-10-08T16:16:48.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f8344700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0155c70 con 0x7fa7d8004810 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 0x7fa7f00af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 0x7fa7f00af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32906/0 (socket says 172.21.15.60:32906) 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 -- 172.21.15.60:0/2476840953 learned_addr learned my addr 172.21.15.60:0/2476840953 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f60e0700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d8004810 0x7fa7f0155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f58df700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7f016b070 0x7fa7f006a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 -- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d8004810 msgr2=0x7fa7f0155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d8004810 0x7fa7f0155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 -- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7f016b070 msgr2=0x7fa7f006a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7f016b070 0x7fa7f006a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.327+0000 7fa7f68e1700 1 -- 172.21.15.60:0/2476840953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f009ba70 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.328+0000 7fa7f68e1700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 0x7fa7f00af170 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0007fd0 tx=0x7fa7e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.328+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00032e0 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.328+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0001580 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.328+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00ae690 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.328+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0001940 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.328+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f00ae340 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.329+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f004c3c0 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.329+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7e0001cb0 con 0x7fa7f006a680 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.330+0000 7fa7ee7fc700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7dc066f30 0x7fa7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.330+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fa7e0084320 con 0x7fa7f006a680 2023-10-08T16:16:48.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.330+0000 7fa7f60e0700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7dc066f30 0x7fa7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:48.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.330+0000 7fa7f60e0700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7dc066f30 0x7fa7dc0693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8000e10 tx=0x7fa7e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:48.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.334+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7e0051650 con 0x7fa7f006a680 2023-10-08T16:16:48.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:48.530+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7f015af70 con 0x7fa7f006a680 2023-10-08T16:16:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.543+0000 7fa7ee7fc700 1 -- 172.21.15.60:0/2476840953 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v187) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa7e0054c70 con 0x7fa7f006a680 2023-10-08T16:16:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.550+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7dc066f30 msgr2=0x7fa7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.550+0000 7fa7f8344700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7dc066f30 0x7fa7dc0693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8000e10 tx=0x7fa7e8009040 comp rx=0 tx=0).stop 2023-10-08T16:16:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.550+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 msgr2=0x7fa7f00af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.550+0000 7fa7f8344700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 0x7fa7f00af170 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0007fd0 tx=0x7fa7e0009040 comp rx=0 tx=0).stop 2023-10-08T16:16:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 shutdown_connections 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa7dc066f30 0x7fa7dc0693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7d8004810 0x7fa7f0155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f006a680 0x7fa7f00af170 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 --2- 172.21.15.60:0/2476840953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7f016b070 0x7fa7f006a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 >> 172.21.15.60:0/2476840953 conn(0x7fa7f009a0a0 msgr2=0x7fa7f0157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 shutdown_connections 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.551+0000 7fa7f8344700 1 -- 172.21.15.60:0/2476840953 wait complete. 2023-10-08T16:16:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-08T16:16:49.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:16:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.694+0000 7f450d238700 1 Processor -- start 2023-10-08T16:16:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.694+0000 7f450d238700 1 -- start start 2023-10-08T16:16:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f450d238700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45080b6580 0x7f450806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f450d238700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f450806a830 0x7f45080b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f450d238700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450806ac90 con 0x7f45080cce30 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f450d238700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080b4d70 con 0x7f45080b6580 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f450d238700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450815b3b0 con 0x7f450806a830 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f45077fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45080b6580 0x7f450806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f45077fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45080b6580 0x7f450806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32914/0 (socket says 172.21.15.60:32914) 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f45077fe700 1 -- 172.21.15.60:0/3078955419 learned_addr learned my addr 172.21.15.60:0/3078955419 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.695+0000 7f450ca37700 1 --2- 172.21.15.60:0/3078955419 >> v2:172.21.15.144:3300/0 conn(0x7f450806a830 0x7f45080b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f45077fe700 1 -- 172.21.15.60:0/3078955419 >> v2:172.21.15.144:3300/0 conn(0x7f450806a830 msgr2=0x7f45080b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:49.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f45077fe700 1 --2- 172.21.15.60:0/3078955419 >> v2:172.21.15.144:3300/0 conn(0x7f450806a830 0x7f45080b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f45077fe700 1 -- 172.21.15.60:0/3078955419 >> v1:172.21.15.144:6789/0 conn(0x7f45080cce30 legacy=0x7f450815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f45077fe700 1 -- 172.21.15.60:0/3078955419 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080cd8d0 con 0x7f45080b6580 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450ca37700 1 --2- 172.21.15.60:0/3078955419 >> v2:172.21.15.144:3300/0 conn(0x7f450806a830 0x7f45080b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f45077fe700 1 --2- 172.21.15.60:0/3078955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45080b6580 0x7f450806a2f0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f45080b4ce0 tx=0x7f44f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460f115b763e2569 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f4506ffd700 1 -- 172.21.15.60:0/3078955419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800b860 con 0x7f45080b6580 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f4506ffd700 1 -- 172.21.15.60:0/3078955419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800b9c0 con 0x7f45080b6580 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f4506ffd700 1 -- 172.21.15.60:0/3078955419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800bd60 con 0x7f45080b6580 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450d238700 1 -- 172.21.15.60:0/3078955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45080b6580 msgr2=0x7f450806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450d238700 1 --2- 172.21.15.60:0/3078955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45080b6580 0x7f450806a2f0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f45080b4ce0 tx=0x7f44f8009250 comp rx=0 tx=0).stop 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450d238700 1 -- 172.21.15.60:0/3078955419 shutdown_connections 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450d238700 1 --2- 172.21.15.60:0/3078955419 >> v2:172.21.15.144:3300/0 conn(0x7f450806a830 0x7f45080b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450d238700 1 --2- 172.21.15.60:0/3078955419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45080b6580 0x7f450806a2f0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.696+0000 7f450d238700 1 -- 172.21.15.60:0/3078955419 >> 172.21.15.60:0/3078955419 conn(0x7f4508068cb0 msgr2=0x7f45080690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.697+0000 7f450d238700 1 -- 172.21.15.60:0/3078955419 shutdown_connections 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.697+0000 7f450d238700 1 -- 172.21.15.60:0/3078955419 wait complete. 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.698+0000 7f450d238700 1 Processor -- start 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.698+0000 7f450d238700 1 -- start start 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.698+0000 7f450d238700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 0x7f4508151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.698+0000 7f450d238700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45080b6580 0x7f45081572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.698+0000 7f450d238700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45080cce30 0x7f45081405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.698+0000 7f450d238700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508154890 con 0x7f450806a830 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f450d238700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508154e50 con 0x7f45080cce30 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f450d238700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508157810 con 0x7f45080b6580 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 0x7f4508151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 0x7f4508151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32928/0 (socket says 172.21.15.60:32928) 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 -- 172.21.15.60:0/1759141346 learned_addr learned my addr 172.21.15.60:0/1759141346 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f45077fe700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45080b6580 0x7f45081572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f450ca37700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45080cce30 0x7f45081405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 -- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45080b6580 msgr2=0x7f45081572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45080b6580 0x7f45081572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 -- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45080cce30 msgr2=0x7f45081405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45080cce30 0x7f45081405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 -- 172.21.15.60:0/1759141346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094f0 con 0x7f450806a830 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f4507fff700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 0x7f4508151cf0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c510 tx=0x7f44f000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0011590 con 0x7f450806a830 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0011710 con 0x7f450806a830 2023-10-08T16:16:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4508152340 con 0x7f450806a830 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0011ad0 con 0x7f450806a830 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.699+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508154ae0 con 0x7f450806a830 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.700+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508089550 con 0x7f450806a830 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.701+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44f001b3b0 con 0x7f450806a830 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.701+0000 7f44fffff700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f44e8066f30 0x7f44e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.701+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f44f0083410 con 0x7f450806a830 2023-10-08T16:16:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.701+0000 7f45077fe700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f44e8066f30 0x7f44e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.702+0000 7f45077fe700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f44e8066f30 0x7f44e80693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f45080b4ce0 tx=0x7f44f8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.705+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f0050980 con 0x7f450806a830 2023-10-08T16:16:49.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.899+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f450806ac90 con 0x7f450806a830 2023-10-08T16:16:49.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.902+0000 7f44fffff700 1 -- 172.21.15.60:0/1759141346 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f450806ac90 con 0x7f450806a830 2023-10-08T16:16:49.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.904+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f44e8066f30 msgr2=0x7f44e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.904+0000 7f450d238700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f44e8066f30 0x7f44e80693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f45080b4ce0 tx=0x7f44f8017000 comp rx=0 tx=0).stop 2023-10-08T16:16:49.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.904+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 msgr2=0x7f4508151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:49.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.904+0000 7f450d238700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 0x7f4508151cf0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c510 tx=0x7f44f000c820 comp rx=0 tx=0).stop 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 shutdown_connections 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f44e8066f30 0x7f44e80693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45080cce30 0x7f45081405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450806a830 0x7f4508151cf0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 --2- 172.21.15.60:0/1759141346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45080b6580 0x7f45081572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 >> 172.21.15.60:0/1759141346 conn(0x7f4508068cb0 msgr2=0x7f4508150500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 shutdown_connections 2023-10-08T16:16:49.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:49.905+0000 7f450d238700 1 -- 172.21.15.60:0/1759141346 wait complete. 2023-10-08T16:16:49.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-08T16:16:50.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.036+0000 7f3a1082d700 1 Processor -- start 2023-10-08T16:16:50.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.036+0000 7f3a1082d700 1 -- start start 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a1082d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a0c068240 0x7f3a0c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a1082d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c0b4bf0 con 0x7f3a0c0b1f00 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a1082d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c0b5790 con 0x7f3a0c159db0 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a1082d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c0ae9b0 con 0x7f3a0c068240 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a0a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3a0c0b1f00 0x7f3a0c0aee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56688/0 (socket says 172.21.15.60:56688) 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a0a59c700 1 -- 172.21.15.60:0/2756365458 learned_addr learned my addr 172.21.15.60:0/2756365458 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a0b59e700 1 --2- 172.21.15.60:0/2756365458 >> v2:172.21.15.144:3300/0 conn(0x7f3a0c068240 0x7f3a0c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a09d9b700 1 -- 172.21.15.60:0/2756365458 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555317820 0 0) 0x7f3a0c0b4bf0 con 0x7f3a0c0b1f00 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.037+0000 7f3a09d9b700 1 -- 172.21.15.60:0/2756365458 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f8003570 con 0x7f3a0c0b1f00 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a09d9b700 1 -- 172.21.15.60:0/2756365458 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870333482 0 0) 0x7f39f8003570 con 0x7f3a0c0b1f00 2023-10-08T16:16:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a0b59e700 1 -- 172.21.15.60:0/2756365458 >> v1:172.21.15.144:6789/0 conn(0x7f3a0c159db0 legacy=0x7f3a0c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a0b59e700 1 -- 172.21.15.60:0/2756365458 >> v1:172.21.15.60:6789/0 conn(0x7f3a0c0b1f00 legacy=0x7f3a0c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a0b59e700 1 -- 172.21.15.60:0/2756365458 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0b59e0 con 0x7f3a0c068240 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a0b59e700 1 --2- 172.21.15.60:0/2756365458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c068240 0x7f3a0c0d13c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0098e0 tx=0x7f39fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b0f3b265de36d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a09d9b700 1 -- 172.21.15.60:0/2756365458 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4001470 con 0x7f3a0c068240 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a09d9b700 1 -- 172.21.15.60:0/2756365458 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc011420 con 0x7f3a0c068240 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a09d9b700 1 -- 172.21.15.60:0/2756365458 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0117c0 con 0x7f3a0c068240 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a1082d700 1 -- 172.21.15.60:0/2756365458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c068240 msgr2=0x7f3a0c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a1082d700 1 --2- 172.21.15.60:0/2756365458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c068240 0x7f3a0c0d13c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0098e0 tx=0x7f39fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a1082d700 1 -- 172.21.15.60:0/2756365458 shutdown_connections 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a1082d700 1 --2- 172.21.15.60:0/2756365458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c068240 0x7f3a0c0d13c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.038+0000 7f3a1082d700 1 -- 172.21.15.60:0/2756365458 >> 172.21.15.60:0/2756365458 conn(0x7f3a0c067e40 msgr2=0x7f3a0c0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.039+0000 7f3a1082d700 1 -- 172.21.15.60:0/2756365458 shutdown_connections 2023-10-08T16:16:50.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.039+0000 7f3a1082d700 1 -- 172.21.15.60:0/2756365458 wait complete. 2023-10-08T16:16:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.040+0000 7f3a1082d700 1 Processor -- start 2023-10-08T16:16:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.040+0000 7f3a1082d700 1 -- start start 2023-10-08T16:16:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.040+0000 7f3a1082d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 0x7f3a0c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c0b1f00 0x7f3a0c1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0c159db0 0x7f3a0c1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c153480 con 0x7f3a0c068240 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c152870 con 0x7f3a0c0b1f00 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c152b50 con 0x7f3a0c159db0 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 0x7f3a0c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 0x7f3a0c151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32930/0 (socket says 172.21.15.60:32930) 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 -- 172.21.15.60:0/3629490184 learned_addr learned my addr 172.21.15.60:0/3629490184 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0b59e700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0c159db0 0x7f3a0c1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0a59c700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c0b1f00 0x7f3a0c1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 -- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0c159db0 msgr2=0x7f3a0c1505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0c159db0 0x7f3a0c1505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 -- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c0b1f00 msgr2=0x7f3a0c1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c0b1f00 0x7f3a0c1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 -- 172.21.15.60:0/3629490184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc009420 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a0ad9d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 0x7f3a0c151fb0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cb90 tx=0x7f3a040017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040020b0 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400a7e0 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c152e30 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400abc0 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.041+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c1524f0 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.042+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c08a350 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.043+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a04003030 con 0x7f3a0c068240 2023-10-08T16:16:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.043+0000 7f3a02ffd700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39ec066f30 0x7f39ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.043+0000 7f3a0a59c700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39ec066f30 0x7f39ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.043+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3a04084270 con 0x7f3a0c068240 2023-10-08T16:16:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.044+0000 7f3a0a59c700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39ec066f30 0x7f39ec0693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f39f4001ed0 tx=0x7f39f4001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:50.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.048+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a040517e0 con 0x7f3a0c068240 2023-10-08T16:16:50.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.317+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f3a0c06ace0 con 0x7f3a0c068240 2023-10-08T16:16:50.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.534+0000 7f3a02ffd700 1 -- 172.21.15.60:0/3629490184 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v554) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3a04054e00 con 0x7f3a0c068240 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39ec066f30 msgr2=0x7f39ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39ec066f30 0x7f39ec0693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f39f4001ed0 tx=0x7f39f4001a20 comp rx=0 tx=0).stop 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 msgr2=0x7f3a0c151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 0x7f3a0c151fb0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cb90 tx=0x7f3a040017c0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 shutdown_connections 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f39ec066f30 0x7f39ec0693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0c159db0 0x7f3a0c1505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a0c068240 0x7f3a0c151fb0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 --2- 172.21.15.60:0/3629490184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a0c0b1f00 0x7f3a0c1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 >> 172.21.15.60:0/3629490184 conn(0x7f3a0c067e40 msgr2=0x7f3a0c06a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:50.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 shutdown_connections 2023-10-08T16:16:50.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:50.536+0000 7f3a1082d700 1 -- 172.21.15.60:0/3629490184 wait complete. 2023-10-08T16:16:50.549 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-08T16:16:50.549 INFO:tasks.cephfs_test_runner: 2023-10-08T16:16:50.550 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T16:16:50.550 INFO:tasks.cephfs_test_runner:Ran 10 tests in 676.481s 2023-10-08T16:16:50.550 INFO:tasks.cephfs_test_runner: 2023-10-08T16:16:50.550 INFO:tasks.cephfs_test_runner:OK 2023-10-08T16:16:50.550 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-08T16:16:50.559 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T16:16:50.600 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T16:16:50.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.600 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:16:50.616 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:16:50.616 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:16:50.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:16:50.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:16:50.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-08T16:16:50.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.884 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-08T16:16:50.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-08T16:16:50.968 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-08T16:16:50.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:16:50.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.970 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:16:50.986 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T16:16:50.986 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:16:50.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:50.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:16:51.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:51.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:16:51.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:51.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-08T16:16:51.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:51.259 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-08T16:16:51.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:16:51.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-08T16:16:51.341 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-10-08T16:16:51.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:16:51.343 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T16:16:51.351 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-08T16:16:51.351 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.474+0000 7feef6bae700 1 Processor -- start 2023-10-08T16:16:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef6bae700 1 -- start start 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef6bae700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feef00c75c0 0x7feef00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef6bae700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00c9cb0 con 0x7feef00abae0 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef6bae700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00c90a0 con 0x7feef00abeb0 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef6bae700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef00c9380 con 0x7feef00c75c0 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feeeffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feef00c75c0 0x7feef00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef494a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7feef00abae0 0x7feef00c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56690/0 (socket says 172.21.15.60:56690) 2023-10-08T16:16:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.475+0000 7feef494a700 1 -- 172.21.15.60:0/1939321557 learned_addr learned my addr 172.21.15.60:0/1939321557 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeeffff700 1 -- 172.21.15.60:0/1939321557 >> v1:172.21.15.144:6789/0 conn(0x7feef00abeb0 legacy=0x7feef00acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeeffff700 1 -- 172.21.15.60:0/1939321557 >> v1:172.21.15.60:6789/0 conn(0x7feef00abae0 legacy=0x7feef00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeef7fe700 1 -- 172.21.15.60:0/1939321557 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293254799 0 0) 0x7feef00c9cb0 con 0x7feef00abae0 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeeffff700 1 -- 172.21.15.60:0/1939321557 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00c9660 con 0x7feef00c75c0 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeeffff700 1 --2- 172.21.15.60:0/1939321557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00c75c0 0x7feef00c8400 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7feee40098e0 tx=0x7feee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6854ca0fa812 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeef7fe700 1 -- 172.21.15.60:0/1939321557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4009e80 con 0x7feef00c75c0 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeef7fe700 1 -- 172.21.15.60:0/1939321557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400b820 con 0x7feef00c75c0 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.476+0000 7feeef7fe700 1 -- 172.21.15.60:0/1939321557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400bba0 con 0x7feef00c75c0 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 -- 172.21.15.60:0/1939321557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00c75c0 msgr2=0x7feef00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 --2- 172.21.15.60:0/1939321557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00c75c0 0x7feef00c8400 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7feee40098e0 tx=0x7feee40091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 -- 172.21.15.60:0/1939321557 shutdown_connections 2023-10-08T16:16:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 --2- 172.21.15.60:0/1939321557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00c75c0 0x7feef00c8400 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 -- 172.21.15.60:0/1939321557 >> 172.21.15.60:0/1939321557 conn(0x7feef0067660 msgr2=0x7feef0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 -- 172.21.15.60:0/1939321557 shutdown_connections 2023-10-08T16:16:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.477+0000 7feef6bae700 1 -- 172.21.15.60:0/1939321557 wait complete. 2023-10-08T16:16:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.478+0000 7feef6bae700 1 Processor -- start 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.478+0000 7feef6bae700 1 -- start start 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 0x7feef0153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feef00abeb0 0x7feef00b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feef00c75c0 0x7feef01590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00af780 con 0x7feef00abae0 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00b1b20 con 0x7feef00c75c0 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef00b1e00 con 0x7feef00abeb0 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 0x7feef0153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 0x7feef0153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32938/0 (socket says 172.21.15.60:32938) 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 -- 172.21.15.60:0/2970241686 learned_addr learned my addr 172.21.15.60:0/2970241686 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feeeffff700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feef00abeb0 0x7feef00b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef514b700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feef00c75c0 0x7feef01590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 -- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feef00abeb0 msgr2=0x7feef00b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feef00abeb0 0x7feef00b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 -- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feef00c75c0 msgr2=0x7feef01590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feef00c75c0 0x7feef01590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 -- 172.21.15.60:0/2970241686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4009420 con 0x7feef00abae0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef514b700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feef00c75c0 0x7feef01590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef494a700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 0x7feef0153b70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7feee800cd80 tx=0x7feee8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800ab10 con 0x7feef00abae0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800ac70 con 0x7feef00abae0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef00b20e0 con 0x7feef00abae0 2023-10-08T16:16:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80070f0 con 0x7feef00abae0 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.479+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef00b23c0 con 0x7feef00abae0 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.480+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef00ab6d0 con 0x7feef00abae0 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.481+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feee80074e0 con 0x7feef00abae0 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.481+0000 7feeecff9700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feedc066f60 0x7feedc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.481+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7feee8084780 con 0x7feef00abae0 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.481+0000 7feeeffff700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feedc066f60 0x7feedc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.482+0000 7feeeffff700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feedc066f60 0x7feedc069410 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7feef00c79c0 tx=0x7feee4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.485+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feee8051d70 con 0x7feef00abae0 2023-10-08T16:16:51.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.681+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feef00c70c0 con 0x7feef00abae0 2023-10-08T16:16:51.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.682+0000 7feeecff9700 1 -- 172.21.15.60:0/2970241686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+12276 (secure 0 0 0) 0x7feee8055390 con 0x7feef00abae0 2023-10-08T16:16:51.682 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:51.682 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":187,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:49.530639+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/4049453252":"2023-10-09T16:16:46.171076+0000","172.21.15.144:6833/4049453252":"2023-10-09T16:16:46.171076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feedc066f60 msgr2=0x7feedc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feedc066f60 0x7feedc069410 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7feef00c79c0 tx=0x7feee4016000 comp rx=0 tx=0).stop 2023-10-08T16:16:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 msgr2=0x7feef0153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 0x7feef0153b70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7feee800cd80 tx=0x7feee8001ae0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 shutdown_connections 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7feedc066f60 0x7feedc069410 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feef00c75c0 0x7feef01590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef00abae0 0x7feef0153b70 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 --2- 172.21.15.60:0/2970241686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feef00abeb0 0x7feef00b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 >> 172.21.15.60:0/2970241686 conn(0x7feef0067660 msgr2=0x7feef00ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 shutdown_connections 2023-10-08T16:16:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.684+0000 7feef6bae700 1 -- 172.21.15.60:0/2970241686 wait complete. 2023-10-08T16:16:51.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:16:51.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:16:51.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.815+0000 7f0950b95700 1 Processor -- start 2023-10-08T16:16:51.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.815+0000 7f0950b95700 1 -- start start 2023-10-08T16:16:51.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f0950b95700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f094c06c630 0x7f094c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f0950b95700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f094c067ba0 0x7f094c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f0950b95700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0cb370 con 0x7f094c0b0890 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f0950b95700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c067fa0 con 0x7f094c067ba0 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f0950b95700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0b0c60 con 0x7f094c06c630 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f094ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f094c067ba0 0x7f094c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f094a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f094c0b0890 0x7f094c0cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56692/0 (socket says 172.21.15.60:56692) 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f094ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f094c067ba0 0x7f094c159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32942/0 (socket says 172.21.15.60:32942) 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f094a59c700 1 -- 172.21.15.60:0/4157779876 learned_addr learned my addr 172.21.15.60:0/4157779876 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.816+0000 7f0949d9b700 1 --2- 172.21.15.60:0/4157779876 >> v2:172.21.15.144:3300/0 conn(0x7f094c06c630 0x7f094c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094ad9d700 1 -- 172.21.15.60:0/4157779876 >> v2:172.21.15.144:3300/0 conn(0x7f094c06c630 msgr2=0x7f094c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094ad9d700 1 --2- 172.21.15.60:0/4157779876 >> v2:172.21.15.144:3300/0 conn(0x7f094c06c630 0x7f094c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094ad9d700 1 -- 172.21.15.60:0/4157779876 >> v1:172.21.15.60:6789/0 conn(0x7f094c0b0890 legacy=0x7f094c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094ad9d700 1 -- 172.21.15.60:0/4157779876 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c06a1e0 con 0x7f094c067ba0 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f0949d9b700 1 --2- 172.21.15.60:0/4157779876 >> v2:172.21.15.144:3300/0 conn(0x7f094c06c630 0x7f094c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094ad9d700 1 --2- 172.21.15.60:0/4157779876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c067ba0 0x7f094c159790 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f094c064ae0 tx=0x7f093c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9860ed3e256df76a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094959a700 1 -- 172.21.15.60:0/4157779876 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00b6b0 con 0x7f094c067ba0 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094959a700 1 -- 172.21.15.60:0/4157779876 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00b810 con 0x7f094c067ba0 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f094959a700 1 -- 172.21.15.60:0/4157779876 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00bbb0 con 0x7f094c067ba0 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f0950b95700 1 -- 172.21.15.60:0/4157779876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c067ba0 msgr2=0x7f094c159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.817+0000 7f0950b95700 1 --2- 172.21.15.60:0/4157779876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c067ba0 0x7f094c159790 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f094c064ae0 tx=0x7f093c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.818+0000 7f0950b95700 1 -- 172.21.15.60:0/4157779876 shutdown_connections 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.818+0000 7f0950b95700 1 --2- 172.21.15.60:0/4157779876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c067ba0 0x7f094c159790 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.818+0000 7f0950b95700 1 --2- 172.21.15.60:0/4157779876 >> v2:172.21.15.144:3300/0 conn(0x7f094c06c630 0x7f094c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.818+0000 7f0950b95700 1 -- 172.21.15.60:0/4157779876 >> 172.21.15.60:0/4157779876 conn(0x7f094c06fe50 msgr2=0x7f094c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:51.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.818+0000 7f0950b95700 1 -- 172.21.15.60:0/4157779876 shutdown_connections 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.818+0000 7f0950b95700 1 -- 172.21.15.60:0/4157779876 wait complete. 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.819+0000 7f0950b95700 1 Processor -- start 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.819+0000 7f0950b95700 1 -- start start 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.819+0000 7f0950b95700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f094c067ba0 0x7f094c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.819+0000 7f0950b95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094c06c630 0x7f094c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0950b95700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 0x7f094c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0950b95700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c4af0 con 0x7f094c0b0890 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0950b95700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c81a0 con 0x7f094c06c630 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0950b95700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c3ee0 con 0x7f094c067ba0 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 0x7f094c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 0x7f094c0c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32948/0 (socket says 172.21.15.60:32948) 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 -- 172.21.15.60:0/90824823 learned_addr learned my addr 172.21.15.60:0/90824823 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0949d9b700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094c06c630 0x7f094c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094a59c700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f094c067ba0 0x7f094c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 -- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f094c067ba0 msgr2=0x7f094c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f094c067ba0 0x7f094c15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 -- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094c06c630 msgr2=0x7f094c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094c06c630 0x7f094c0c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 -- 172.21.15.60:0/90824823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009420 con 0x7f094c0b0890 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094a59c700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f094c067ba0 0x7f094c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f094ad9d700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 0x7f094c0c38d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f094c06ab60 tx=0x7f093c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c026470 con 0x7f094c0b0890 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c0265d0 con 0x7f094c0b0890 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c0c41c0 con 0x7f094c0b0890 2023-10-08T16:16:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c026970 con 0x7f094c0b0890 2023-10-08T16:16:51.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.820+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c0c4780 con 0x7f094c0b0890 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.821+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c0c4ca0 con 0x7f094c0b0890 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.822+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f093c023070 con 0x7f094c0b0890 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.822+0000 7f09427fc700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f092c066f30 0x7f092c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.822+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f093c085ea0 con 0x7f094c0b0890 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.822+0000 7f094a59c700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f092c066f30 0x7f092c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.823+0000 7f094a59c700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f092c066f30 0x7f092c0693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0944002230 tx=0x7f0944009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:51.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:51.827+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f094c0c4ca0 con 0x7f094c0b0890 2023-10-08T16:16:52.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.014+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f094c0c4ca0 con 0x7f092c066f30 2023-10-08T16:16:52.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.016+0000 7f09427fc700 1 -- 172.21.15.60:0/90824823 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50155 (secure 0 0 0) 0x7f094c0c4ca0 con 0x7f092c066f30 2023-10-08T16:16:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:52.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f092c066f30 msgr2=0x7f092c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f092c066f30 0x7f092c0693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0944002230 tx=0x7f0944009040 comp rx=0 tx=0).stop 2023-10-08T16:16:52.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 msgr2=0x7f094c0c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 0x7f094c0c38d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f094c06ab60 tx=0x7f093c017000 comp rx=0 tx=0).stop 2023-10-08T16:16:52.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 shutdown_connections 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f092c066f30 0x7f092c0693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f094c067ba0 0x7f094c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f094c0b0890 0x7f094c0c38d0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 --2- 172.21.15.60:0/90824823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f094c06c630 0x7f094c0c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 >> 172.21.15.60:0/90824823 conn(0x7f094c06fe50 msgr2=0x7f094c0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 shutdown_connections 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.019+0000 7f0950b95700 1 -- 172.21.15.60:0/90824823 wait complete. 2023-10-08T16:16:52.020 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:16:52.031 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2023-10-08T16:16:51.717210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553138,"statfs":{"total":1600000000,"available":1590413600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544357"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":314,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T16:16:48.421034+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:16:48.421034+0000","last_peered":"2023-10-08T16:16:48.421034+0000","last_clean":"2023-10-08T16:16:48.421034+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:48.421034+0000","last_undegraded":"2023-10-08T16:16:48.421034+0000","last_fullsized":"2023-10-08T16:16:48.421034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78400000000000003},"last":0.60099999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.871,"15min":1.0089999999999999},"last":0.501},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.45600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83599999999999997,"15min":1.79},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.25700000000000001},"max":{"1min":0.60599999999999998,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.59399999999999997,"15min":0.51800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78300000000000003,"5min":11.891,"15min":11.891},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.61699999999999999,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77000000000000002,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":1.252},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79400000000000004,"15min":1.135},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.69499999999999995,"5min":0.78300000000000003,"15min":1.169},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.83499999999999996,"15min":3.738},"last":0.496},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.48599999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":3.6549999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.53100000000000003},"min":{"1min":0.42699999999999999,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":1.103},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":1.0920000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":3.516},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":1.502},"last":0.64800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76900000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":0.752,"15min":0.92000000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":1.0089999999999999},"last":0.32000000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79300000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.375,"15min":0.41899999999999998},"min":{"1min":0.23899999999999999,"5min":0.185,"15min":0.182},"max":{"1min":0.50600000000000001,"5min":0.60499999999999998,"15min":3.593},"last":0.375},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.42399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.61599999999999999,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.438,"15min":0.434},"min":{"1min":0.254,"5min":0.254,"15min":0.22900000000000001},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":3.5630000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":1.7030000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0149999999999999,"15min":3.532},"last":0.51600000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.36399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":3.4929999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91100000000000003,"15min":1.095},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.90700000000000003,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.372,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.224,"15min":0.20200000000000001},"max":{"1min":0.61499999999999999,"5min":0.76700000000000002,"15min":1.571},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.64300000000000002,"5min":0.879,"15min":3.044},"last":0.28299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56599999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":0.754,"15min":3.1150000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.68300000000000005},"min":{"1min":0.53700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":3.1589999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.401},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":1.046,"15min":1.4590000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.6459999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.38600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.66600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.92200000000000004,"15min":3.665},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":1.01,"15min":3.7160000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83399999999999996,"5min":1.123,"15min":1.5109999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41099999999999998,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.746},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45400000000000001,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":1.3260000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28100000000000003},"max":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77100000000000002,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.876,"15min":0.97499999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.873,"15min":2.9319999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.31900000000000001},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":1.091},"last":0.437},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.622,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.073},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.57399999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.67800000000000005},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.44400000000000001,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.63600000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.98499999999999999,"15min":1.0640000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.29799999999999999},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68400000000000005,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.754},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.66500000000000004},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.83499999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":1.141},"last":0.375},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":1.149},"last":0.55500000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":7.4749999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56200000000000006,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32100000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":14.6},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":7.556},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85899999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26200000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.438}]},{"osd":6,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.309},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.85799999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.621}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.54800000000000004},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.86499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.89400000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.76000000000000001,"15min":0.77800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:16:52.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:16:52.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.151+0000 7f66d62ce700 1 Processor -- start 2023-10-08T16:16:52.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.151+0000 7f66d62ce700 1 -- start start 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d62ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d62ce700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66d015c4f0 0x7f66d0070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d62ce700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0068a90 con 0x7f66d00cb000 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d62ce700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00ca330 con 0x7f66d015c4f0 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d62ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d015ca70 con 0x7f66d015b340 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d486b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66d015c4f0 0x7f66d0070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:46654/0 (socket says 172.21.15.60:46654) 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cf7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f66d00cb000 0x7f66d0067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:33044/0 (socket says 172.21.15.60:33044) 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66d486b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66d015c4f0 0x7f66d0070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:37794/0 (socket says 172.21.15.60:37794) 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 -- 172.21.15.60:0/895364012 learned_addr learned my addr 172.21.15.60:0/895364012 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 -- 172.21.15.60:0/895364012 >> v2:172.21.15.144:3300/0 conn(0x7f66d015c4f0 msgr2=0x7f66d0070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 --2- 172.21.15.60:0/895364012 >> v2:172.21.15.144:3300/0 conn(0x7f66d015c4f0 0x7f66d0070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 -- 172.21.15.60:0/895364012 >> v1:172.21.15.144:6789/0 conn(0x7f66d00cb000 legacy=0x7f66d0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.152+0000 7f66cffff700 1 -- 172.21.15.60:0/895364012 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0068f20 con 0x7f66d015b340 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66cffff700 1 --2- 172.21.15.60:0/895364012 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0070700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66c40099b0 tx=0x7f66c4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c59b219f010f7025 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66ceffd700 1 -- 172.21.15.60:0/895364012 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4009ea0 con 0x7f66d015b340 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66ceffd700 1 -- 172.21.15.60:0/895364012 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400b860 con 0x7f66d015b340 2023-10-08T16:16:52.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66ceffd700 1 -- 172.21.15.60:0/895364012 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400bc00 con 0x7f66d015b340 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 -- 172.21.15.60:0/895364012 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 msgr2=0x7f66d0070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 --2- 172.21.15.60:0/895364012 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0070700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66c40099b0 tx=0x7f66c4009250 comp rx=0 tx=0).stop 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 -- 172.21.15.60:0/895364012 shutdown_connections 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 --2- 172.21.15.60:0/895364012 >> v2:172.21.15.144:3300/0 conn(0x7f66d015c4f0 0x7f66d0070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 --2- 172.21.15.60:0/895364012 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0070700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 -- 172.21.15.60:0/895364012 >> 172.21.15.60:0/895364012 conn(0x7f66d00ca4f0 msgr2=0x7f66d00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 -- 172.21.15.60:0/895364012 shutdown_connections 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.153+0000 7f66d62ce700 1 -- 172.21.15.60:0/895364012 wait complete. 2023-10-08T16:16:52.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.154+0000 7f66d62ce700 1 Processor -- start 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 -- start start 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d00cb000 0x7f66d0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 0x7f66d00c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d01578d0 con 0x7f66d015c4f0 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c5650 con 0x7f66d00cb000 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d62ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c5930 con 0x7f66d015b340 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d486b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 0x7f66d00c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d486b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 0x7f66d00c64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32954/0 (socket says 172.21.15.60:32954) 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66d486b700 1 -- 172.21.15.60:0/2032010040 learned_addr learned my addr 172.21.15.60:0/2032010040 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66cf7fe700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.155+0000 7f66cffff700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d00cb000 0x7f66d0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d486b700 1 -- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 msgr2=0x7f66d0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d486b700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d486b700 1 -- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d00cb000 msgr2=0x7f66d0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d486b700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d00cb000 0x7f66d0153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d486b700 1 -- 172.21.15.60:0/2032010040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40094f0 con 0x7f66d015c4f0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d486b700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 0x7f66d00c64f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009df0 tx=0x7f66c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800caa0 con 0x7f66d015c4f0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c800f040 con 0x7f66d015c4f0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800ce50 con 0x7f66d015c4f0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d00c5c10 con 0x7f66d015c4f0 2023-10-08T16:16:52.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.156+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d00afd80 con 0x7f66d015c4f0 2023-10-08T16:16:52.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.157+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0157a40 con 0x7f66d015c4f0 2023-10-08T16:16:52.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.158+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66c8014690 con 0x7f66d015c4f0 2023-10-08T16:16:52.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.158+0000 7f66b7fff700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f66bc066f00 0x7f66bc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.158+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f66c8084d10 con 0x7f66d015c4f0 2023-10-08T16:16:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.158+0000 7f66cffff700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f66bc066f00 0x7f66bc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.158+0000 7f66cffff700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f66bc066f00 0x7f66bc0693b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f66c40099b0 tx=0x7f66c4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.162+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66d0157a40 con 0x7f66d015c4f0 2023-10-08T16:16:52.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.351+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66d0157a40 con 0x7f66bc066f00 2023-10-08T16:16:52.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.353+0000 7f66b7fff700 1 -- 172.21.15.60:0/2032010040 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50155 (secure 0 0 0) 0x7f66d0157a40 con 0x7f66bc066f00 2023-10-08T16:16:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f66bc066f00 msgr2=0x7f66bc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f66bc066f00 0x7f66bc0693b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f66c40099b0 tx=0x7f66c4017000 comp rx=0 tx=0).stop 2023-10-08T16:16:52.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 msgr2=0x7f66d00c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 0x7f66d00c64f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009df0 tx=0x7f66c800b040 comp rx=0 tx=0).stop 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 shutdown_connections 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f66bc066f00 0x7f66bc0693b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d015c4f0 0x7f66d00c64f0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66d00cb000 0x7f66d0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 --2- 172.21.15.60:0/2032010040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66d015b340 0x7f66d0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 >> 172.21.15.60:0/2032010040 conn(0x7f66d00ca4f0 msgr2=0x7f66d006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 shutdown_connections 2023-10-08T16:16:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.355+0000 7f66d62ce700 1 -- 172.21.15.60:0/2032010040 wait complete. 2023-10-08T16:16:52.357 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:16:52.367 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2023-10-08T16:16:51.717210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553138,"statfs":{"total":1600000000,"available":1590413600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544357"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":314,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T16:16:48.421034+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:16:48.421034+0000","last_peered":"2023-10-08T16:16:48.421034+0000","last_clean":"2023-10-08T16:16:48.421034+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:48.421034+0000","last_undegraded":"2023-10-08T16:16:48.421034+0000","last_fullsized":"2023-10-08T16:16:48.421034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78400000000000003},"last":0.60099999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.871,"15min":1.0089999999999999},"last":0.501},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.45600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83599999999999997,"15min":1.79},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.25700000000000001},"max":{"1min":0.60599999999999998,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.59399999999999997,"15min":0.51800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78300000000000003,"5min":11.891,"15min":11.891},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.61699999999999999,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77000000000000002,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":1.252},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79400000000000004,"15min":1.135},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.69499999999999995,"5min":0.78300000000000003,"15min":1.169},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.83499999999999996,"15min":3.738},"last":0.496},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.48599999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":3.6549999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.53100000000000003},"min":{"1min":0.42699999999999999,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":1.103},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":1.0920000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":3.516},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":1.502},"last":0.64800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76900000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":0.752,"15min":0.92000000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":1.0089999999999999},"last":0.32000000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79300000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.375,"15min":0.41899999999999998},"min":{"1min":0.23899999999999999,"5min":0.185,"15min":0.182},"max":{"1min":0.50600000000000001,"5min":0.60499999999999998,"15min":3.593},"last":0.375},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.42399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.61599999999999999,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.438,"15min":0.434},"min":{"1min":0.254,"5min":0.254,"15min":0.22900000000000001},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":3.5630000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":1.7030000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0149999999999999,"15min":3.532},"last":0.51600000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.36399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":3.4929999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91100000000000003,"15min":1.095},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.90700000000000003,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.372,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.224,"15min":0.20200000000000001},"max":{"1min":0.61499999999999999,"5min":0.76700000000000002,"15min":1.571},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.64300000000000002,"5min":0.879,"15min":3.044},"last":0.28299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56599999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":0.754,"15min":3.1150000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.68300000000000005},"min":{"1min":0.53700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":3.1589999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.401},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":1.046,"15min":1.4590000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.6459999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.38600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.66600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.92200000000000004,"15min":3.665},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":1.01,"15min":3.7160000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83399999999999996,"5min":1.123,"15min":1.5109999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41099999999999998,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.746},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45400000000000001,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":1.3260000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28100000000000003},"max":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77100000000000002,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.876,"15min":0.97499999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.873,"15min":2.9319999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.31900000000000001},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":1.091},"last":0.437},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.622,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.073},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.57399999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.67800000000000005},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.44400000000000001,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.63600000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.98499999999999999,"15min":1.0640000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.29799999999999999},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68400000000000005,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.754},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.66500000000000004},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.83499999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":1.141},"last":0.375},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":1.149},"last":0.55500000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":7.4749999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56200000000000006,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32100000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":14.6},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":7.556},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85899999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26200000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.438}]},{"osd":6,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.309},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.85799999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.621}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.54800000000000004},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.86499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.89400000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.76000000000000001,"15min":0.77800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:16:52.369 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:16:52.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:16:52.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.488+0000 7f51f5c50700 1 Processor -- start 2023-10-08T16:16:52.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.488+0000 7f51f5c50700 1 -- start start 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51f5c50700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51f00d1c30 0x7f51f00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51f5c50700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f015a680 0x7f51f00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51f5c50700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00c5d80 con 0x7f51f015a2b0 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51f5c50700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f0068470 con 0x7f51f00d1c30 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51f5c50700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00c6060 con 0x7f51f015a680 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51eeffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51f00d1c30 0x7f51f00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51ef7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f51f015a2b0 0x7f51f00b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56480/0 (socket says 172.21.15.60:56480) 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51ef7fe700 1 -- 172.21.15.60:0/3729929399 learned_addr learned my addr 172.21.15.60:0/3729929399 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51effff700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f015a680 0x7f51f00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51eeffd700 1 -- 172.21.15.60:0/3729929399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f015a680 msgr2=0x7f51f00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:52.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51eeffd700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f015a680 0x7f51f00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51eeffd700 1 -- 172.21.15.60:0/3729929399 >> v1:172.21.15.60:6789/0 conn(0x7f51f015a2b0 legacy=0x7f51f00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51eeffd700 1 -- 172.21.15.60:0/3729929399 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00c6340 con 0x7f51f00d1c30 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51ee7fc700 1 -- 172.21.15.60:0/3729929399 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694106539 0 0) 0x7f51f00c5d80 con 0x7f51f015a2b0 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51effff700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f015a680 0x7f51f00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.489+0000 7f51eeffd700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f00d1c30 0x7f51f00ccdd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f51e40098e0 tx=0x7f51e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f056f9c0faf5bd74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51ee7fc700 1 -- 172.21.15.60:0/3729929399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4009e80 con 0x7f51f00d1c30 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51ee7fc700 1 -- 172.21.15.60:0/3729929399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400b860 con 0x7f51f00d1c30 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51ee7fc700 1 -- 172.21.15.60:0/3729929399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400bbe0 con 0x7f51f00d1c30 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 -- 172.21.15.60:0/3729929399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f00d1c30 msgr2=0x7f51f00ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f00d1c30 0x7f51f00ccdd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f51e40098e0 tx=0x7f51e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 -- 172.21.15.60:0/3729929399 shutdown_connections 2023-10-08T16:16:52.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f015a680 0x7f51f00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 --2- 172.21.15.60:0/3729929399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f00d1c30 0x7f51f00ccdd0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 -- 172.21.15.60:0/3729929399 >> 172.21.15.60:0/3729929399 conn(0x7f51f0067e40 msgr2=0x7f51f00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:52.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 -- 172.21.15.60:0/3729929399 shutdown_connections 2023-10-08T16:16:52.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.490+0000 7f51f5c50700 1 -- 172.21.15.60:0/3729929399 wait complete. 2023-10-08T16:16:52.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.491+0000 7f51f5c50700 1 Processor -- start 2023-10-08T16:16:52.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 -- start start 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f00d1c30 0x7f51f016a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51f015a2b0 0x7f51f00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 0x7f51f016d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f015ee10 con 0x7f51f015a680 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f015d880 con 0x7f51f015a2b0 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51f5c50700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f015db60 con 0x7f51f00d1c30 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 0x7f51f016d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 0x7f51f016d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41762/0 (socket says 172.21.15.60:41762) 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.492+0000 7f51effff700 1 -- 172.21.15.60:0/2735250691 learned_addr learned my addr 172.21.15.60:0/2735250691 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51eeffd700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51f015a2b0 0x7f51f00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51ef7fe700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f00d1c30 0x7f51f016a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51effff700 1 -- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f00d1c30 msgr2=0x7f51f016a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51effff700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f00d1c30 0x7f51f016a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51effff700 1 -- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51f015a2b0 msgr2=0x7f51f00b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51effff700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51f015a2b0 0x7f51f00b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51effff700 1 -- 172.21.15.60:0/2735250691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4009420 con 0x7f51f015a680 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51ef7fe700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f00d1c30 0x7f51f016a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51effff700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 0x7f51f016d560 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009fc0 tx=0x7f51e80099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800dd40 con 0x7f51f015a680 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e800f040 con 0x7f51f015a680 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f016aed0 con 0x7f51f015a680 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8015690 con 0x7f51f015a680 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.493+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f015ea30 con 0x7f51f015a680 2023-10-08T16:16:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.494+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f015d6e0 con 0x7f51f015a680 2023-10-08T16:16:52.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.494+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51e801e3b0 con 0x7f51f015a680 2023-10-08T16:16:52.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.495+0000 7f51d77fe700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f51dc066f30 0x7f51dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.495+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f51e8084780 con 0x7f51f015a680 2023-10-08T16:16:52.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.495+0000 7f51ef7fe700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f51dc066f30 0x7f51dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.495+0000 7f51ef7fe700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f51dc066f30 0x7f51dc0693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f51e0001810 tx=0x7f51e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.499+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51f015d6e0 con 0x7f51f015a680 2023-10-08T16:16:52.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.689+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51f015d6e0 con 0x7f51dc066f30 2023-10-08T16:16:52.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.691+0000 7f51d77fe700 1 -- 172.21.15.60:0/2735250691 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50155 (secure 0 0 0) 0x7f51f015d6e0 con 0x7f51dc066f30 2023-10-08T16:16:52.692 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:52.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f51dc066f30 msgr2=0x7f51dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f51dc066f30 0x7f51dc0693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f51e0001810 tx=0x7f51e0009040 comp rx=0 tx=0).stop 2023-10-08T16:16:52.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 msgr2=0x7f51f016d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 0x7f51f016d560 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009fc0 tx=0x7f51e80099b0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 shutdown_connections 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f51dc066f30 0x7f51dc0693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51f00d1c30 0x7f51f016a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51f015a680 0x7f51f016d560 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 --2- 172.21.15.60:0/2735250691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51f015a2b0 0x7f51f00b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 >> 172.21.15.60:0/2735250691 conn(0x7f51f0067e40 msgr2=0x7f51f006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 shutdown_connections 2023-10-08T16:16:52.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.693+0000 7f51f5c50700 1 -- 172.21.15.60:0/2735250691 wait complete. 2023-10-08T16:16:52.695 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:16:52.705 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2023-10-08T16:16:51.717210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553138,"statfs":{"total":1600000000,"available":1590413600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544357"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":314,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T16:16:48.421034+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:16:48.421034+0000","last_peered":"2023-10-08T16:16:48.421034+0000","last_clean":"2023-10-08T16:16:48.421034+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:48.421034+0000","last_undegraded":"2023-10-08T16:16:48.421034+0000","last_fullsized":"2023-10-08T16:16:48.421034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78400000000000003},"last":0.60099999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.871,"15min":1.0089999999999999},"last":0.501},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.45600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83599999999999997,"15min":1.79},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.25700000000000001},"max":{"1min":0.60599999999999998,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.59399999999999997,"15min":0.51800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78300000000000003,"5min":11.891,"15min":11.891},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.61699999999999999,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77000000000000002,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":1.252},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79400000000000004,"15min":1.135},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.69499999999999995,"5min":0.78300000000000003,"15min":1.169},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.83499999999999996,"15min":3.738},"last":0.496},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.48599999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":3.6549999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.53100000000000003},"min":{"1min":0.42699999999999999,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":1.103},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":1.0920000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":3.516},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":1.502},"last":0.64800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76900000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":0.752,"15min":0.92000000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":1.0089999999999999},"last":0.32000000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79300000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.375,"15min":0.41899999999999998},"min":{"1min":0.23899999999999999,"5min":0.185,"15min":0.182},"max":{"1min":0.50600000000000001,"5min":0.60499999999999998,"15min":3.593},"last":0.375},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.42399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.61599999999999999,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.438,"15min":0.434},"min":{"1min":0.254,"5min":0.254,"15min":0.22900000000000001},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":3.5630000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":1.7030000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0149999999999999,"15min":3.532},"last":0.51600000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.36399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":3.4929999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91100000000000003,"15min":1.095},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.90700000000000003,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.372,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.224,"15min":0.20200000000000001},"max":{"1min":0.61499999999999999,"5min":0.76700000000000002,"15min":1.571},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.64300000000000002,"5min":0.879,"15min":3.044},"last":0.28299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56599999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":0.754,"15min":3.1150000000000002},"last":0.32700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.68300000000000005},"min":{"1min":0.53700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":3.1589999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.401},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":1.046,"15min":1.4590000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.6459999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.38600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.66600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.92200000000000004,"15min":3.665},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":1.01,"15min":3.7160000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83399999999999996,"5min":1.123,"15min":1.5109999999999999},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41099999999999998,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.746},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45400000000000001,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":1.3260000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28100000000000003},"max":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77100000000000002,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.876,"15min":0.97499999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.873,"15min":2.9319999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.31900000000000001},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":1.091},"last":0.437},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.622,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.073},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.57399999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.67800000000000005},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.44400000000000001,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.63600000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.98499999999999999,"15min":1.0640000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.29799999999999999},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68400000000000005,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.754},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.66500000000000004},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.83499999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":1.141},"last":0.375},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":1.149},"last":0.55500000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":7.4749999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.52700000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56200000000000006,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32100000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":14.6},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":7.556},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85899999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26200000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.438}]},{"osd":6,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.309},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.85799999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.621}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.54800000000000004},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.86499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.89400000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.76000000000000001,"15min":0.77800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]}]}],"pool_statfs":[]}} 2023-10-08T16:16:52.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:16:52.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.826+0000 7fd44ce10700 1 Processor -- start 2023-10-08T16:16:52.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.827+0000 7fd44ce10700 1 -- start start 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.827+0000 7fd44ce10700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 0x7fd44815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.827+0000 7fd44ce10700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd44815d580 0x7fd448158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.827+0000 7fd44ce10700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44815cbb0 con 0x7fd448157870 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.827+0000 7fd44ce10700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44815bdb0 con 0x7fd44815d580 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.827+0000 7fd44ce10700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44815bfa0 con 0x7fd44815a620 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd448157870 0x7fd44815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56484/0 (socket says 172.21.15.60:56484) 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44659c700 1 -- 172.21.15.60:0/1820613818 learned_addr learned my addr 172.21.15.60:0/1820613818 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd446d9d700 1 --2- 172.21.15.60:0/1820613818 >> v2:172.21.15.144:3300/0 conn(0x7fd44815d580 0x7fd448158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd445d9b700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 0x7fd44815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529428859 0 0) 0x7fd44815cbb0 con 0x7fd448157870 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd434003570 con 0x7fd448157870 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358245241 0 0) 0x7fd434003570 con 0x7fd448157870 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 msgr2=0x7fd44815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 0x7fd44815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 >> v2:172.21.15.144:3300/0 conn(0x7fd44815d580 msgr2=0x7fd448158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 --2- 172.21.15.60:0/1820613818 >> v2:172.21.15.144:3300/0 conn(0x7fd44815d580 0x7fd448158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44815c280 con 0x7fd448157870 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7fd4400017f0 con 0x7fd448157870 2023-10-08T16:16:52.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 >> v1:172.21.15.60:6789/0 conn(0x7fd448157870 legacy=0x7fd44815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 0x7fd434003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd434003fe0 0x7fd434004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd434004d50 0x7fd4340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44815bfa0 con 0x7fd434003fe0 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43400ba60 con 0x7fd434004d50 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43400bbd0 con 0x7fd44815a620 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd445d9b700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd434003fe0 0x7fd434004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.828+0000 7fd44659c700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 0x7fd434003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd446d9d700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd434004d50 0x7fd4340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd445d9b700 1 -- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 msgr2=0x7fd434003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd445d9b700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd44815a620 0x7fd434003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd445d9b700 1 -- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd434004d50 msgr2=0x7fd4340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd445d9b700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd434004d50 0x7fd4340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd445d9b700 1 -- 172.21.15.60:0/1820613818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434003570 con 0x7fd434003fe0 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd446d9d700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd434004d50 0x7fd4340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd445d9b700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd434003fe0 0x7fd434004810 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd44815aa20 tx=0x7fd4300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e899ee22815e3e33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000e6b0 con 0x7fd434003fe0 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000e810 con 0x7fd434003fe0 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd44559a700 1 -- 172.21.15.60:0/1820613818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000ebd0 con 0x7fd434003fe0 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd44ce10700 1 -- 172.21.15.60:0/1820613818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd434003fe0 msgr2=0x7fd434004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd44ce10700 1 --2- 172.21.15.60:0/1820613818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd434003fe0 0x7fd434004810 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd44815aa20 tx=0x7fd4300091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.829+0000 7fd446d9d700 1 -- 172.21.15.60:0/1820613818 reap_dead start 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.830+0000 7fd44ce10700 1 -- 172.21.15.60:0/1820613818 shutdown_connections 2023-10-08T16:16:52.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.830+0000 7fd44ce10700 1 -- 172.21.15.60:0/1820613818 >> 172.21.15.60:0/1820613818 conn(0x7fd448068ce0 msgr2=0x7fd4480690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:52.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.830+0000 7fd44ce10700 1 -- 172.21.15.60:0/1820613818 shutdown_connections 2023-10-08T16:16:52.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.830+0000 7fd44ce10700 1 -- 172.21.15.60:0/1820613818 wait complete. 2023-10-08T16:16:52.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 Processor -- start 2023-10-08T16:16:52.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 -- start start 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd434003fe0 0x7fd448147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 0x7fd4480b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4480b2db0 0x7fd4480a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44815e760 con 0x7fd448145000 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480b3560 con 0x7fd4480b2db0 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.831+0000 7fd44ce10700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480b3280 con 0x7fd434003fe0 2023-10-08T16:16:52.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 0x7fd4480b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 0x7fd4480b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41772/0 (socket says 172.21.15.60:41772) 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 -- 172.21.15.60:0/3837583920 learned_addr learned my addr 172.21.15.60:0/3837583920 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd44659c700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd434003fe0 0x7fd448147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd446d9d700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4480b2db0 0x7fd4480a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 -- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd434003fe0 msgr2=0x7fd448147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd434003fe0 0x7fd448147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 -- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4480b2db0 msgr2=0x7fd4480a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4480b2db0 0x7fd4480a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 -- 172.21.15.60:0/3837583920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44815e110 con 0x7fd448145000 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd445d9b700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 0x7fd4480b2870 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd434004730 tx=0x7fd43001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430022070 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000e980 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44815e3f0 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000e6b0 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.832+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4480b1840 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.833+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4480b4970 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.833+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd430027680 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.834+0000 7fd43e7fc700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.834+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd430085a40 con 0x7fd448145000 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.834+0000 7fd44659c700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.834+0000 7fd44659c700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd4400011d0 tx=0x7fd440006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:52.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:52.838+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd430087e60 con 0x7fd448145000 2023-10-08T16:16:53.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.032+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd44815e760 con 0x7fd448145000 2023-10-08T16:16:53.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.033+0000 7fd43e7fc700 1 -- 172.21.15.60:0/3837583920 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+12276 (secure 0 0 0) 0x7fd430017020 con 0x7fd448145000 2023-10-08T16:16:53.033 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:53.033 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":187,"fsid":"3b329f4b-ad99-45f4-afa4-bcf45c7e9d39","created":"2023-10-08T16:04:43.526558+0000","modified":"2023-10-08T16:16:49.530639+0000","last_up_change":"2023-10-08T16:04:48.908445+0000","last_in_change":"2023-10-08T16:04:45.897271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:49.613517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":86354},{"type":"v1","addr":"172.21.15.60:6811","nonce":86354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":86354},{"type":"v1","addr":"172.21.15.60:6814","nonce":86354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":86354},{"type":"v1","addr":"172.21.15.60:6822","nonce":86354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":86354},{"type":"v1","addr":"172.21.15.60:6818","nonce":86354}]},"public_addr":"172.21.15.60:6811/86354","cluster_addr":"172.21.15.60:6814/86354","heartbeat_back_addr":"172.21.15.60:6822/86354","heartbeat_front_addr":"172.21.15.60:6818/86354","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6809","nonce":86353},{"type":"v1","addr":"172.21.15.60:6810","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6813","nonce":86353},{"type":"v1","addr":"172.21.15.60:6815","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":86353},{"type":"v1","addr":"172.21.15.60:6825","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6817","nonce":86353},{"type":"v1","addr":"172.21.15.60:6819","nonce":86353}]},"public_addr":"172.21.15.60:6810/86353","cluster_addr":"172.21.15.60:6815/86353","heartbeat_back_addr":"172.21.15.60:6825/86353","heartbeat_front_addr":"172.21.15.60:6819/86353","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":86352},{"type":"v1","addr":"172.21.15.60:6801","nonce":86352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":86352},{"type":"v1","addr":"172.21.15.60:6803","nonce":86352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":86352},{"type":"v1","addr":"172.21.15.60:6807","nonce":86352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":86352},{"type":"v1","addr":"172.21.15.60:6805","nonce":86352}]},"public_addr":"172.21.15.60:6801/86352","cluster_addr":"172.21.15.60:6803/86352","heartbeat_back_addr":"172.21.15.60:6807/86352","heartbeat_front_addr":"172.21.15.60:6805/86352","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6823","nonce":86357},{"type":"v1","addr":"172.21.15.60:6824","nonce":86357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":86357},{"type":"v1","addr":"172.21.15.60:6827","nonce":86357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":86357},{"type":"v1","addr":"172.21.15.60:6831","nonce":86357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":86357},{"type":"v1","addr":"172.21.15.60:6829","nonce":86357}]},"public_addr":"172.21.15.60:6824/86357","cluster_addr":"172.21.15.60:6827/86357","heartbeat_back_addr":"172.21.15.60:6831/86357","heartbeat_front_addr":"172.21.15.60:6829/86357","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6803","nonce":86599},{"type":"v1","addr":"172.21.15.144:6806","nonce":86599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":86599},{"type":"v1","addr":"172.21.15.144:6814","nonce":86599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86599},{"type":"v1","addr":"172.21.15.144:6830","nonce":86599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86599},{"type":"v1","addr":"172.21.15.144:6822","nonce":86599}]},"public_addr":"172.21.15.144:6806/86599","cluster_addr":"172.21.15.144:6814/86599","heartbeat_back_addr":"172.21.15.144:6830/86599","heartbeat_front_addr":"172.21.15.144:6822/86599","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86600},{"type":"v1","addr":"172.21.15.144:6802","nonce":86600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6807","nonce":86600},{"type":"v1","addr":"172.21.15.144:6811","nonce":86600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":86600},{"type":"v1","addr":"172.21.15.144:6827","nonce":86600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":86600},{"type":"v1","addr":"172.21.15.144:6819","nonce":86600}]},"public_addr":"172.21.15.144:6802/86600","cluster_addr":"172.21.15.144:6811/86600","heartbeat_back_addr":"172.21.15.144:6827/86600","heartbeat_front_addr":"172.21.15.144:6819/86600","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6805","nonce":86601},{"type":"v1","addr":"172.21.15.144:6808","nonce":86601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":86601},{"type":"v1","addr":"172.21.15.144:6816","nonce":86601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86601},{"type":"v1","addr":"172.21.15.144:6831","nonce":86601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86601},{"type":"v1","addr":"172.21.15.144:6824","nonce":86601}]},"public_addr":"172.21.15.144:6808/86601","cluster_addr":"172.21.15.144:6816/86601","heartbeat_back_addr":"172.21.15.144:6831/86601","heartbeat_front_addr":"172.21.15.144:6824/86601","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":86602},{"type":"v1","addr":"172.21.15.144:6804","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86602},{"type":"v1","addr":"172.21.15.144:6812","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":86602},{"type":"v1","addr":"172.21.15.144:6821","nonce":86602}]},"public_addr":"172.21.15.144:6804/86602","cluster_addr":"172.21.15.144:6812/86602","heartbeat_back_addr":"172.21.15.144:6829/86602","heartbeat_front_addr":"172.21.15.144:6821/86602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.060798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.081602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.071001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.051531+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043623+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.043531+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:47.056119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:46.978315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/4049453252":"2023-10-09T16:16:46.171076+0000","172.21.15.144:6833/4049453252":"2023-10-09T16:16:46.171076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:16:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 msgr2=0x7fd4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd4400011d0 tx=0x7fd440006040 comp rx=0 tx=0).stop 2023-10-08T16:16:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 msgr2=0x7fd4480b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 0x7fd4480b2870 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd434004730 tx=0x7fd43001a000 comp rx=0 tx=0).stop 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 shutdown_connections 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fd428066f30 0x7fd4280693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd434003fe0 0x7fd448147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4480b2db0 0x7fd4480a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 --2- 172.21.15.60:0/3837583920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd448145000 0x7fd4480b2870 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 >> 172.21.15.60:0/3837583920 conn(0x7fd448068ce0 msgr2=0x7fd44815afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 shutdown_connections 2023-10-08T16:16:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:53.035+0000 7fd44ce10700 1 -- 172.21.15.60:0/3837583920 wait complete. 2023-10-08T16:16:54.048 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T16:16:54.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:54.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.186+0000 7f1ffbf03700 1 Processor -- start 2023-10-08T16:16:54.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.186+0000 7f1ffbf03700 1 -- start start 2023-10-08T16:16:54.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.186+0000 7f1ffbf03700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ff4159e50 0x7f1ff40b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffbf03700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ff4068cb0 0x7f1ff40690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffbf03700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff40b0d60 con 0x7f1ff40b3370 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffbf03700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff4069620 con 0x7f1ff4068cb0 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffbf03700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff40d15b0 con 0x7f1ff4159e50 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ff4068cb0 0x7f1ff40690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ff4068cb0 0x7f1ff40690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41780/0 (socket says 172.21.15.60:41780) 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 -- 172.21.15.60:0/2963550910 learned_addr learned my addr 172.21.15.60:0/2963550910 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ff9c9f700 1 --2- 172.21.15.60:0/2963550910 >> v2:172.21.15.144:3300/0 conn(0x7f1ff4159e50 0x7f1ff40b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 -- 172.21.15.60:0/2963550910 >> v2:172.21.15.144:3300/0 conn(0x7f1ff4159e50 msgr2=0x7f1ff40b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 --2- 172.21.15.60:0/2963550910 >> v2:172.21.15.144:3300/0 conn(0x7f1ff4159e50 0x7f1ff40b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 -- 172.21.15.60:0/2963550910 >> v1:172.21.15.144:6789/0 conn(0x7f1ff40b3370 legacy=0x7f1ff40b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 -- 172.21.15.60:0/2963550910 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40d1890 con 0x7f1ff4068cb0 2023-10-08T16:16:54.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ff9c9f700 1 --2- 172.21.15.60:0/2963550910 >> v2:172.21.15.144:3300/0 conn(0x7f1ff4159e50 0x7f1ff40b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ffa4a0700 1 --2- 172.21.15.60:0/2963550910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff4068cb0 0x7f1ff40690e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4072050 tx=0x7f1fec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eec81d096f013b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ff8c9d700 1 -- 172.21.15.60:0/2963550910 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00b860 con 0x7f1ff4068cb0 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ff8c9d700 1 -- 172.21.15.60:0/2963550910 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00b9c0 con 0x7f1ff4068cb0 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.187+0000 7f1ff8c9d700 1 -- 172.21.15.60:0/2963550910 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00bd60 con 0x7f1ff4068cb0 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 -- 172.21.15.60:0/2963550910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff4068cb0 msgr2=0x7f1ff40690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 --2- 172.21.15.60:0/2963550910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff4068cb0 0x7f1ff40690e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4072050 tx=0x7f1fec009250 comp rx=0 tx=0).stop 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 -- 172.21.15.60:0/2963550910 shutdown_connections 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 --2- 172.21.15.60:0/2963550910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff4068cb0 0x7f1ff40690e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 --2- 172.21.15.60:0/2963550910 >> v2:172.21.15.144:3300/0 conn(0x7f1ff4159e50 0x7f1ff40b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 -- 172.21.15.60:0/2963550910 >> 172.21.15.60:0/2963550910 conn(0x7f1ff4068130 msgr2=0x7f1ff40d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 -- 172.21.15.60:0/2963550910 shutdown_connections 2023-10-08T16:16:54.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.188+0000 7f1ffbf03700 1 -- 172.21.15.60:0/2963550910 wait complete. 2023-10-08T16:16:54.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.189+0000 7f1ffbf03700 1 Processor -- start 2023-10-08T16:16:54.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.189+0000 7f1ffbf03700 1 -- start start 2023-10-08T16:16:54.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffbf03700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff4068cb0 0x7f1ff40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffbf03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff40b3370 0x7f1ff4156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffbf03700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff4159e50 0x7f1ff415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffbf03700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4157470 con 0x7f1ff40b3370 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffbf03700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4169fe0 con 0x7f1ff4068cb0 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffbf03700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40d01e0 con 0x7f1ff4159e50 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff40b3370 0x7f1ff4156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff40b3370 0x7f1ff4156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41794/0 (socket says 172.21.15.60:41794) 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 -- 172.21.15.60:0/3609325761 learned_addr learned my addr 172.21.15.60:0/3609325761 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff9c9f700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff4068cb0 0x7f1ff40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ffa4a0700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff4159e50 0x7f1ff415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 -- 172.21.15.60:0/3609325761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff4159e50 msgr2=0x7f1ff415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ff4159e50 0x7f1ff415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 -- 172.21.15.60:0/3609325761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff4068cb0 msgr2=0x7f1ff40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ff4068cb0 0x7f1ff40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.190+0000 7f1ff949e700 1 -- 172.21.15.60:0/3609325761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0094f0 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.191+0000 7f1ff949e700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff40b3370 0x7f1ff4156f30 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c7c0 tx=0x7f1fe8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.191+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011590 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.191+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80116f0 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.191+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011ab0 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.191+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff416a270 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.191+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff40cfc20 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.192+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ff404c3c0 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.192+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fe801b3b0 con 0x7f1ff40b3370 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff1ffb700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1fe8083650 con 0x7f1ff40b3370 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff9c9f700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff1ffb700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7f1fe006cd80 0x7f1fe006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 --> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fe006f860 con 0x7f1fe006cd80 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fe8085c90 con 0x7f1ff40b3370 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ffa4a0700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7f1fe006cd80 0x7f1fe006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ff9c9f700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fe0066f30 0x7f1fe00693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4007740 tx=0x7f1fe40099d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.193+0000 7f1ffa4a0700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7f1fe006cd80 0x7f1fe006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.194+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== osd.0 v2:172.21.15.60:6808/86354 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1fe006f860 con 0x7f1fe006cd80 2023-10-08T16:16:54.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.206+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 --> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1ff40b55b0 con 0x7f1fe006cd80 2023-10-08T16:16:54.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ff1ffb700 1 -- 172.21.15.60:0/3609325761 <== osd.0 v2:172.21.15.60:6808/86354 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f1ff40b55b0 con 0x7f1fe006cd80 2023-10-08T16:16:54.207 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:54.207 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:54.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7f1fe006cd80 msgr2=0x7f1fe006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6808/86354,v1:172.21.15.60:6811/86354] conn(0x7f1fe006cd80 0x7f1fe006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fe0066f30 msgr2=0x7f1fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1fe0066f30 0x7f1fe00693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4007740 tx=0x7f1fe40099d0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff40b3370 msgr2=0x7f1ff4156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 --2- 172.21.15.60:0/3609325761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ff40b3370 0x7f1ff4156f30 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c7c0 tx=0x7f1fe8007f50 comp rx=0 tx=0).stop 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffa4a0700 1 -- 172.21.15.60:0/3609325761 reap_dead start 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 shutdown_connections 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 >> 172.21.15.60:0/3609325761 conn(0x7f1ff4068130 msgr2=0x7f1ff40cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 shutdown_connections 2023-10-08T16:16:54.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.207+0000 7f1ffbf03700 1 -- 172.21.15.60:0/3609325761 wait complete. 2023-10-08T16:16:54.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T16:16:54.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.338+0000 7fa7aeda1700 1 Processor -- start 2023-10-08T16:16:54.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.339+0000 7fa7aeda1700 1 -- start start 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.339+0000 7fa7aeda1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7a815a170 0x7fa7a8068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.339+0000 7fa7aeda1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80694a0 con 0x7fa7a8159da0 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.339+0000 7fa7aeda1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a815ea70 con 0x7fa7a8069040 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.339+0000 7fa7aeda1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80b34b0 con 0x7fa7a815a170 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7ad59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7a815a170 0x7fa7a8068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7add9f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa7a8159da0 0x7fa7a80b2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56496/0 (socket says 172.21.15.60:56496) 2023-10-08T16:16:54.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7ad59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7a815a170 0x7fa7a8068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41806/0 (socket says 172.21.15.60:41806) 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7add9f700 1 -- 172.21.15.60:0/3338174749 learned_addr learned my addr 172.21.15.60:0/3338174749 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7ad59e700 1 -- 172.21.15.60:0/3338174749 >> v1:172.21.15.144:6789/0 conn(0x7fa7a8069040 legacy=0x7fa7a80af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7ad59e700 1 -- 172.21.15.60:0/3338174749 >> v1:172.21.15.60:6789/0 conn(0x7fa7a8159da0 legacy=0x7fa7a80b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7ad59e700 1 -- 172.21.15.60:0/3338174749 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80b3990 con 0x7fa7a815a170 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7acd9d700 1 -- 172.21.15.60:0/3338174749 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40683413 0 0) 0x7fa7a0001110 con 0x7fa7a8159da0 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7ad59e700 1 --2- 172.21.15.60:0/3338174749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a815a170 0x7fa7a8068b00 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0098e0 tx=0x7fa79c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d2e071c403edb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7acd9d700 1 -- 172.21.15.60:0/3338174749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c009e80 con 0x7fa7a815a170 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7acd9d700 1 -- 172.21.15.60:0/3338174749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00b860 con 0x7fa7a815a170 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.340+0000 7fa7acd9d700 1 -- 172.21.15.60:0/3338174749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00bbe0 con 0x7fa7a815a170 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 -- 172.21.15.60:0/3338174749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a815a170 msgr2=0x7fa7a8068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/3338174749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a815a170 0x7fa7a8068b00 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0098e0 tx=0x7fa79c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 -- 172.21.15.60:0/3338174749 shutdown_connections 2023-10-08T16:16:54.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/3338174749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a815a170 0x7fa7a8068b00 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 -- 172.21.15.60:0/3338174749 >> 172.21.15.60:0/3338174749 conn(0x7fa7a80d0bc0 msgr2=0x7fa7a80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 -- 172.21.15.60:0/3338174749 shutdown_connections 2023-10-08T16:16:54.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.341+0000 7fa7aeda1700 1 -- 172.21.15.60:0/3338174749 wait complete. 2023-10-08T16:16:54.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.342+0000 7fa7aeda1700 1 Processor -- start 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.342+0000 7fa7aeda1700 1 -- start start 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7aeda1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 0x7fa7a81575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7aeda1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7a8159da0 0x7fa7a80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7aeda1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7a815a170 0x7fa7a80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7aeda1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c7c80 con 0x7fa7a8069040 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7aeda1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c7f20 con 0x7fa7a815a170 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7aeda1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a815ce60 con 0x7fa7a8159da0 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 0x7fa7a81575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 0x7fa7a81575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41814/0 (socket says 172.21.15.60:41814) 2023-10-08T16:16:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 -- 172.21.15.60:0/2216810512 learned_addr learned my addr 172.21.15.60:0/2216810512 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7ad59e700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7a8159da0 0x7fa7a80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7ae5a0700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7a815a170 0x7fa7a80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 -- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7a8159da0 msgr2=0x7fa7a80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7a8159da0 0x7fa7a80d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 -- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7a815a170 msgr2=0x7fa7a80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7a815a170 0x7fa7a80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 -- 172.21.15.60:0/2216810512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009420 con 0x7fa7a8069040 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7ad59e700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7a8159da0 0x7fa7a80d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7ae5a0700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7a815a170 0x7fa7a80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7add9f700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 0x7fa7a81575b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000c810 tx=0x7fa7a0007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0005b30 con 0x7fa7a8069040 2023-10-08T16:16:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.343+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0005cb0 con 0x7fa7a8069040 2023-10-08T16:16:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.344+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a815d140 con 0x7fa7a8069040 2023-10-08T16:16:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.344+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0007340 con 0x7fa7a8069040 2023-10-08T16:16:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.344+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8157af0 con 0x7fa7a8069040 2023-10-08T16:16:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.345+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a8089480 con 0x7fa7a8069040 2023-10-08T16:16:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.345+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7a001b400 con 0x7fa7a8069040 2023-10-08T16:16:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.346+0000 7fa7a5ffb700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa794066f30 0x7fa7940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.346+0000 7fa7ad59e700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa794066f30 0x7fa7940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.346+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa7a0083ab0 con 0x7fa7a8069040 2023-10-08T16:16:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.346+0000 7fa7ad59e700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa794066f30 0x7fa7940693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80c9a40 tx=0x7fa79c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.350+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a0051020 con 0x7fa7a8069040 2023-10-08T16:16:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.542+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a815d640 con 0x7fa794066f30 2023-10-08T16:16:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.542+0000 7fa7a5ffb700 1 -- 172.21.15.60:0/2216810512 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa7a815d640 con 0x7fa794066f30 2023-10-08T16:16:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa794066f30 msgr2=0x7fa7940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa794066f30 0x7fa7940693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80c9a40 tx=0x7fa79c017000 comp rx=0 tx=0).stop 2023-10-08T16:16:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 msgr2=0x7fa7a81575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 0x7fa7a81575b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000c810 tx=0x7fa7a0007c10 comp rx=0 tx=0).stop 2023-10-08T16:16:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 shutdown_connections 2023-10-08T16:16:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa794066f30 0x7fa7940693e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7a815a170 0x7fa7a80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7a8069040 0x7fa7a81575b0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 --2- 172.21.15.60:0/2216810512 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7a8159da0 0x7fa7a80d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 >> 172.21.15.60:0/2216810512 conn(0x7fa7a80d0bc0 msgr2=0x7fa7a80cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 shutdown_connections 2023-10-08T16:16:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.544+0000 7fa7aeda1700 1 -- 172.21.15.60:0/2216810512 wait complete. 2023-10-08T16:16:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T16:16:54.556 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T16:16:54.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.679+0000 7f14470c8700 1 Processor -- start 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.679+0000 7f14470c8700 1 -- start start 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f14470c8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1440152050 0x7f1440158230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f14470c8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1440152420 0x7f144015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f14470c8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1440158770 con 0x7f144006d6e0 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f14470c8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1440158a10 con 0x7f1440152050 2023-10-08T16:16:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f14470c8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1440158cf0 con 0x7f1440152420 2023-10-08T16:16:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f1444e64700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1440152050 0x7f1440158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f1445665700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f144006d6e0 0x7f14400cc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56502/0 (socket says 172.21.15.60:56502) 2023-10-08T16:16:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.680+0000 7f1445665700 1 -- 172.21.15.60:0/2259668668 learned_addr learned my addr 172.21.15.60:0/2259668668 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f143ffff700 1 --2- 172.21.15.60:0/2259668668 >> v2:172.21.15.144:3300/0 conn(0x7f1440152420 0x7f144015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f1444e64700 1 -- 172.21.15.60:0/2259668668 >> v2:172.21.15.144:3300/0 conn(0x7f1440152420 msgr2=0x7f144015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f1444e64700 1 --2- 172.21.15.60:0/2259668668 >> v2:172.21.15.144:3300/0 conn(0x7f1440152420 0x7f144015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f1444e64700 1 -- 172.21.15.60:0/2259668668 >> v1:172.21.15.60:6789/0 conn(0x7f144006d6e0 legacy=0x7f14400cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f1444e64700 1 -- 172.21.15.60:0/2259668668 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440158fd0 con 0x7f1440152050 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f1444e64700 1 --2- 172.21.15.60:0/2259668668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f1440158230 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f14400c5b50 tx=0x7f1434009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80947e4f27913f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f143f7fe700 1 -- 172.21.15.60:0/2259668668 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434011630 con 0x7f1440152050 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f143f7fe700 1 -- 172.21.15.60:0/2259668668 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434011790 con 0x7f1440152050 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.681+0000 7f143f7fe700 1 -- 172.21.15.60:0/2259668668 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434011b30 con 0x7f1440152050 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 -- 172.21.15.60:0/2259668668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 msgr2=0x7f1440158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 --2- 172.21.15.60:0/2259668668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f1440158230 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f14400c5b50 tx=0x7f1434009120 comp rx=0 tx=0).stop 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 -- 172.21.15.60:0/2259668668 shutdown_connections 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 --2- 172.21.15.60:0/2259668668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f1440158230 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 --2- 172.21.15.60:0/2259668668 >> v2:172.21.15.144:3300/0 conn(0x7f1440152420 0x7f144015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 -- 172.21.15.60:0/2259668668 >> 172.21.15.60:0/2259668668 conn(0x7f1440069870 msgr2=0x7f1440069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 -- 172.21.15.60:0/2259668668 shutdown_connections 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.682+0000 7f14470c8700 1 -- 172.21.15.60:0/2259668668 wait complete. 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.683+0000 7f14470c8700 1 Processor -- start 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.683+0000 7f14470c8700 1 -- start start 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144006d6e0 0x7f14400c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f14400c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1440152420 0x7f1440142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400b1b10 con 0x7f1440152050 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c6220 con 0x7f1440152420 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c88a0 con 0x7f144006d6e0 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f14400c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f14400c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41840/0 (socket says 172.21.15.60:41840) 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 -- 172.21.15.60:0/3492888655 learned_addr learned my addr 172.21.15.60:0/3492888655 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f1445665700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1440152420 0x7f1440142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 -- 172.21.15.60:0/3492888655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144006d6e0 msgr2=0x7f14400c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144006d6e0 0x7f14400c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 -- 172.21.15.60:0/3492888655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1440152420 msgr2=0x7f1440142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1440152420 0x7f1440142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 -- 172.21.15.60:0/3492888655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340093c0 con 0x7f1440152050 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f1445665700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1440152420 0x7f1440142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143ffff700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f14400c5ce0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f142c00d8c0 tx=0x7f142c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00de60 con 0x7f1440152050 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00b780 con 0x7f1440152050 2023-10-08T16:16:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.684+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400c8b80 con 0x7f1440152050 2023-10-08T16:16:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.685+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00bb20 con 0x7f1440152050 2023-10-08T16:16:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.685+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400b1d60 con 0x7f1440152050 2023-10-08T16:16:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.685+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f144004c3c0 con 0x7f1440152050 2023-10-08T16:16:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f142c01e460 con 0x7f1440152050 2023-10-08T16:16:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f143cff9700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1424066f30 0x7f14240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f142c0848e0 con 0x7f1440152050 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f1444e64700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1424066f30 0x7f14240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f143cff9700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f142406cd80 0x7f142406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 --> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f142406f860 con 0x7f142406cd80 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.686+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f142c089240 con 0x7f1440152050 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.687+0000 7f1445665700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f142406cd80 0x7f142406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.687+0000 7f1444e64700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1424066f30 0x7f14240693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f14400c5b50 tx=0x7f1434016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.687+0000 7f1445665700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f142406cd80 0x7f142406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.687+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== osd.1 v2:172.21.15.60:6809/86353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f142406f860 con 0x7f142406cd80 2023-10-08T16:16:54.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.700+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 --> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f14400cd450 con 0x7f142406cd80 2023-10-08T16:16:54.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.700+0000 7f143cff9700 1 -- 172.21.15.60:0/3492888655 <== osd.1 v2:172.21.15.60:6809/86353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f14400cd450 con 0x7f142406cd80 2023-10-08T16:16:54.701 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:54.701 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:54.701 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:54.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f142406cd80 msgr2=0x7f142406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6809/86353,v1:172.21.15.60:6810/86353] conn(0x7f142406cd80 0x7f142406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1424066f30 msgr2=0x7f14240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1424066f30 0x7f14240693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f14400c5b50 tx=0x7f1434016000 comp rx=0 tx=0).stop 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 msgr2=0x7f14400c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 --2- 172.21.15.60:0/3492888655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1440152050 0x7f14400c5ce0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f142c00d8c0 tx=0x7f142c008040 comp rx=0 tx=0).stop 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f1445665700 1 -- 172.21.15.60:0/3492888655 reap_dead start 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 shutdown_connections 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 >> 172.21.15.60:0/3492888655 conn(0x7f1440069870 msgr2=0x7f144014d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 shutdown_connections 2023-10-08T16:16:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.701+0000 7f14470c8700 1 -- 172.21.15.60:0/3492888655 wait complete. 2023-10-08T16:16:54.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T16:16:54.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.832+0000 7efee0866700 1 Processor -- start 2023-10-08T16:16:54.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.832+0000 7efee0866700 1 -- start start 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efee0866700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efedc157870 0x7efedc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efee0866700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc15cbb0 con 0x7efedc157c40 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efee0866700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc15bfa0 con 0x7efedc15a620 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efee0866700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc15c280 con 0x7efedc157870 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efedad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efedc157c40 0x7efedc158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56516/0 (socket says 172.21.15.60:56516) 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efedad9d700 1 -- 172.21.15.60:0/515717783 learned_addr learned my addr 172.21.15.60:0/515717783 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.833+0000 7efeda59c700 1 --2- 172.21.15.60:0/515717783 >> v2:172.21.15.144:3300/0 conn(0x7efedc157870 0x7efedc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158326162 0 0) 0x7efedc15cbb0 con 0x7efedc157c40 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec8003570 con 0x7efedc157c40 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2392549172 0 0) 0x7efec8003570 con 0x7efedc157c40 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 >> v2:172.21.15.144:3300/0 conn(0x7efedc157870 msgr2=0x7efedc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 --2- 172.21.15.60:0/515717783 >> v2:172.21.15.144:3300/0 conn(0x7efedc157870 0x7efedc15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 >> v1:172.21.15.144:6789/0 conn(0x7efedc15a620 legacy=0x7efedc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc15c560 con 0x7efedc157c40 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7efed40017f0 con 0x7efedc157c40 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 >> v1:172.21.15.60:6789/0 conn(0x7efedc157c40 legacy=0x7efedc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec8003a60 0x7efec8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efec8004810 0x7efec8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec80051c0 0x7efec800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc15c280 con 0x7efec8003a60 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec800c160 con 0x7efec80051c0 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec800c320 con 0x7efec8004810 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efeda59c700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec8003a60 0x7efec8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efedad9d700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec80051c0 0x7efec800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efed9d9b700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efec8004810 0x7efec8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efeda59c700 1 -- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efec8004810 msgr2=0x7efec8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efeda59c700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efec8004810 0x7efec8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efeda59c700 1 -- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec80051c0 msgr2=0x7efec800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efeda59c700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec80051c0 0x7efec800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efeda59c700 1 -- 172.21.15.60:0/515717783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8003570 con 0x7efec8003a60 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.834+0000 7efedad9d700 1 -- 172.21.15.60:0/515717783 reap_dead start 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efeda59c700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec8003a60 0x7efec8003e70 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7efecc009c00 tx=0x7efecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9feea8155b32bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00e710 con 0x7efec8003a60 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc00e870 con 0x7efec8003a60 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efed959a700 1 -- 172.21.15.60:0/515717783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00ec30 con 0x7efec8003a60 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 -- 172.21.15.60:0/515717783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec8003a60 msgr2=0x7efec8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec8003a60 0x7efec8003e70 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7efecc009c00 tx=0x7efecc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 -- 172.21.15.60:0/515717783 shutdown_connections 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 --2- 172.21.15.60:0/515717783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efec8003a60 0x7efec8003e70 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 -- 172.21.15.60:0/515717783 >> 172.21.15.60:0/515717783 conn(0x7efedc068ce0 msgr2=0x7efedc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:54.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 -- 172.21.15.60:0/515717783 shutdown_connections 2023-10-08T16:16:54.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.835+0000 7efee0866700 1 -- 172.21.15.60:0/515717783 wait complete. 2023-10-08T16:16:54.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.836+0000 7efee0866700 1 Processor -- start 2023-10-08T16:16:54.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.836+0000 7efee0866700 1 -- start start 2023-10-08T16:16:54.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efee0866700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec8003a60 0x7efedc14bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efee0866700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efedc153ee0 0x7efedc14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efee0866700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 0x7efedc150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efee0866700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc150160 con 0x7efedc14f060 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efee0866700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc14f550 con 0x7efec8003a60 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efee0866700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc14f830 con 0x7efedc153ee0 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efedad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 0x7efedc150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efedad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 0x7efedc150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41864/0 (socket says 172.21.15.60:41864) 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efedad9d700 1 -- 172.21.15.60:0/3881354697 learned_addr learned my addr 172.21.15.60:0/3881354697 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:54.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efed9d9b700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efedc153ee0 0x7efedc14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.837+0000 7efeda59c700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec8003a60 0x7efedc14bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efedad9d700 1 -- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efedc153ee0 msgr2=0x7efedc14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efedad9d700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efedc153ee0 0x7efedc14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efedad9d700 1 -- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec8003a60 msgr2=0x7efedc14bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efedad9d700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec8003a60 0x7efedc14bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efedad9d700 1 -- 172.21.15.60:0/3881354697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc14fb10 con 0x7efedc14f060 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efeda59c700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec8003a60 0x7efedc14bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efedad9d700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 0x7efedc150ec0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7efedc0b3830 tx=0x7efed4001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400ec30 con 0x7efedc14f060 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed400ed90 con 0x7efedc14f060 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc14fdf0 con 0x7efedc14f060 2023-10-08T16:16:54.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4013670 con 0x7efedc14f060 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.838+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc151400 con 0x7efedc14f060 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.839+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc15b1f0 con 0x7efedc14f060 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.839+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efed4013a20 con 0x7efedc14f060 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.840+0000 7efed27fc700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efebc066f30 0x7efebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.840+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efed4084910 con 0x7efedc14f060 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.840+0000 7efeda59c700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efebc066f30 0x7efebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.840+0000 7efeda59c700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efebc066f30 0x7efebc0693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efecc0091e0 tx=0x7efecc01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:54.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:54.844+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efed4051e80 con 0x7efedc14f060 2023-10-08T16:16:55.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.037+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7efedc04c3c0 con 0x7efebc066f30 2023-10-08T16:16:55.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.037+0000 7efed27fc700 1 -- 172.21.15.60:0/3881354697 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efedc04c3c0 con 0x7efebc066f30 2023-10-08T16:16:55.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efebc066f30 msgr2=0x7efebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efebc066f30 0x7efebc0693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efecc0091e0 tx=0x7efecc01a000 comp rx=0 tx=0).stop 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 msgr2=0x7efedc150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 0x7efedc150ec0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7efedc0b3830 tx=0x7efed4001330 comp rx=0 tx=0).stop 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 shutdown_connections 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7efebc066f30 0x7efebc0693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc14f060 0x7efedc150ec0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efec8003a60 0x7efedc14bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 --2- 172.21.15.60:0/3881354697 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efedc153ee0 0x7efedc14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 >> 172.21.15.60:0/3881354697 conn(0x7efedc068ce0 msgr2=0x7efedc0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 shutdown_connections 2023-10-08T16:16:55.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.039+0000 7efee0866700 1 -- 172.21.15.60:0/3881354697 wait complete. 2023-10-08T16:16:55.041 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T16:16:55.051 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T16:16:55.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:55.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.173+0000 7ff64d896700 1 Processor -- start 2023-10-08T16:16:55.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.173+0000 7ff64d896700 1 -- start start 2023-10-08T16:16:55.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64d896700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6480cd7f0 0x7ff64815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64d896700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff6481595f0 0x7ff648159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64d896700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64815e5b0 con 0x7ff6480cdbc0 2023-10-08T16:16:55.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64d896700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64815e890 con 0x7ff6480cd7f0 2023-10-08T16:16:55.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64d896700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6480ceea0 con 0x7ff6481595f0 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64c894700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6480cd7f0 0x7ff64815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64c894700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6480cd7f0 0x7ff64815d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41878/0 (socket says 172.21.15.60:41878) 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64c894700 1 -- 172.21.15.60:0/3474613865 learned_addr learned my addr 172.21.15.60:0/3474613865 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff647fff700 1 --1- 172.21.15.60:0/3474613865 >> v1:172.21.15.60:6789/0 conn(0x7ff6480cdbc0 0x7ff64815de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56526/0 (socket says 172.21.15.60:56526) 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.174+0000 7ff64d095700 1 --2- 172.21.15.60:0/3474613865 >> v2:172.21.15.144:3300/0 conn(0x7ff6481595f0 0x7ff648159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64c894700 1 -- 172.21.15.60:0/3474613865 >> v2:172.21.15.144:3300/0 conn(0x7ff6481595f0 msgr2=0x7ff648159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64c894700 1 --2- 172.21.15.60:0/3474613865 >> v2:172.21.15.144:3300/0 conn(0x7ff6481595f0 0x7ff648159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64c894700 1 -- 172.21.15.60:0/3474613865 >> v1:172.21.15.60:6789/0 conn(0x7ff6480cdbc0 legacy=0x7ff64815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64c894700 1 -- 172.21.15.60:0/3474613865 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480cf180 con 0x7ff6480cd7f0 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff6477fe700 1 -- 172.21.15.60:0/3474613865 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65776043 0 0) 0x7ff64815e5b0 con 0x7ff6480cdbc0 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d095700 1 --2- 172.21.15.60:0/3474613865 >> v2:172.21.15.144:3300/0 conn(0x7ff6481595f0 0x7ff648159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:55.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64c894700 1 --2- 172.21.15.60:0/3474613865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cd7f0 0x7ff64815d8c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff6480b3520 tx=0x7ff640009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67266b8afa24e93b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff6477fe700 1 -- 172.21.15.60:0/3474613865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000e070 con 0x7ff6480cd7f0 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff6477fe700 1 -- 172.21.15.60:0/3474613865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64000ba50 con 0x7ff6480cd7f0 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff6477fe700 1 -- 172.21.15.60:0/3474613865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400092e0 con 0x7ff6480cd7f0 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 -- 172.21.15.60:0/3474613865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cd7f0 msgr2=0x7ff64815d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 --2- 172.21.15.60:0/3474613865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cd7f0 0x7ff64815d8c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff6480b3520 tx=0x7ff640009840 comp rx=0 tx=0).stop 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 -- 172.21.15.60:0/3474613865 shutdown_connections 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 --2- 172.21.15.60:0/3474613865 >> v2:172.21.15.144:3300/0 conn(0x7ff6481595f0 0x7ff648159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 --2- 172.21.15.60:0/3474613865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cd7f0 0x7ff64815d8c0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 -- 172.21.15.60:0/3474613865 >> 172.21.15.60:0/3474613865 conn(0x7ff648068bf0 msgr2=0x7ff648068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 -- 172.21.15.60:0/3474613865 shutdown_connections 2023-10-08T16:16:55.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.175+0000 7ff64d896700 1 -- 172.21.15.60:0/3474613865 wait complete. 2023-10-08T16:16:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.177+0000 7ff64d896700 1 Processor -- start 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.177+0000 7ff64d896700 1 -- start start 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.177+0000 7ff64d896700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6480cd7f0 0x7ff648154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.177+0000 7ff64d896700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cdbc0 0x7ff6480c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.177+0000 7ff64d896700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6481595f0 0x7ff6480c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64d896700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648154da0 con 0x7ff6480cdbc0 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64d896700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6480b4650 con 0x7ff6480cd7f0 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64d896700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6480b3a40 con 0x7ff6481595f0 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cdbc0 0x7ff6480c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cdbc0 0x7ff6480c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41880/0 (socket says 172.21.15.60:41880) 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 -- 172.21.15.60:0/833610587 learned_addr learned my addr 172.21.15.60:0/833610587 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64c894700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6480cd7f0 0x7ff648154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 -- 172.21.15.60:0/833610587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6481595f0 msgr2=0x7ff6480c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64d095700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6481595f0 0x7ff6480c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6481595f0 0x7ff6480c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 -- 172.21.15.60:0/833610587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6480cd7f0 msgr2=0x7ff648154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6480cd7f0 0x7ff648154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 -- 172.21.15.60:0/833610587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640009ae0 con 0x7ff6480cdbc0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff647fff700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cdbc0 0x7ff6480c96b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0011e0 tx=0x7ff63c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c007300 con 0x7ff6480cdbc0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c007460 con 0x7ff6480cdbc0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6480b3d20 con 0x7ff6480cdbc0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c004830 con 0x7ff6480cdbc0 2023-10-08T16:16:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.178+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6480b42e0 con 0x7ff6480cdbc0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.179+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff648089520 con 0x7ff6480cdbc0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff63c004be0 con 0x7ff6480cdbc0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff644ff9700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff634066f30 0x7ff6340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff63c083f50 con 0x7ff6480cdbc0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff64c894700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff634066f30 0x7ff6340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff644ff9700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7ff63406cd80 0x7ff63406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 --> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff63406f860 con 0x7ff63406cd80 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.180+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c084240 con 0x7ff6480cdbc0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.181+0000 7ff64d095700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7ff63406cd80 0x7ff63406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.181+0000 7ff64c894700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff634066f30 0x7ff6340693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff640009880 tx=0x7ff640018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.181+0000 7ff64d095700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7ff63406cd80 0x7ff63406f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.181+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== osd.2 v2:172.21.15.60:6800/86352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff63406f860 con 0x7ff63406cd80 2023-10-08T16:16:55.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.194+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 --> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6480cf460 con 0x7ff63406cd80 2023-10-08T16:16:55.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.194+0000 7ff644ff9700 1 -- 172.21.15.60:0/833610587 <== osd.2 v2:172.21.15.60:6800/86352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7ff6480cf460 con 0x7ff63406cd80 2023-10-08T16:16:55.195 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:55.195 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:55.195 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.194+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7ff63406cd80 msgr2=0x7ff63406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.194+0000 7ff64d896700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6800/86352,v1:172.21.15.60:6801/86352] conn(0x7ff63406cd80 0x7ff63406f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff634066f30 msgr2=0x7ff6340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7ff634066f30 0x7ff6340693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff640009880 tx=0x7ff640018000 comp rx=0 tx=0).stop 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cdbc0 msgr2=0x7ff6480c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 --2- 172.21.15.60:0/833610587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6480cdbc0 0x7ff6480c96b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0011e0 tx=0x7ff63c007e10 comp rx=0 tx=0).stop 2023-10-08T16:16:55.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d095700 1 -- 172.21.15.60:0/833610587 reap_dead start 2023-10-08T16:16:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 shutdown_connections 2023-10-08T16:16:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 >> 172.21.15.60:0/833610587 conn(0x7ff648068bf0 msgr2=0x7ff6480b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 shutdown_connections 2023-10-08T16:16:55.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.195+0000 7ff64d896700 1 -- 172.21.15.60:0/833610587 wait complete. 2023-10-08T16:16:55.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T16:16:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.326+0000 7f9c1db24700 1 Processor -- start 2023-10-08T16:16:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.326+0000 7f9c1db24700 1 -- start start 2023-10-08T16:16:55.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.326+0000 7f9c1db24700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c18157870 0x7f9c1815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.326+0000 7f9c1db24700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1815cbb0 con 0x7f9c18157c40 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c1db24700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1815bfa0 con 0x7f9c1815a620 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c1db24700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1815c280 con 0x7f9c18157870 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c177fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c18157870 0x7f9c1815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c17fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9c18157c40 0x7f9c18158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56532/0 (socket says 172.21.15.60:56532) 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c17fff700 1 -- 172.21.15.60:0/1774240076 learned_addr learned my addr 172.21.15.60:0/1774240076 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c177fe700 1 -- 172.21.15.60:0/1774240076 >> v1:172.21.15.144:6789/0 conn(0x7f9c1815a620 legacy=0x7f9c1815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c177fe700 1 -- 172.21.15.60:0/1774240076 >> v1:172.21.15.60:6789/0 conn(0x7f9c18157c40 legacy=0x7f9c18158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c16ffd700 1 -- 172.21.15.60:0/1774240076 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168062128 0 0) 0x7f9c1815cbb0 con 0x7f9c18157c40 2023-10-08T16:16:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c177fe700 1 -- 172.21.15.60:0/1774240076 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1815c560 con 0x7f9c18157870 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c177fe700 1 --2- 172.21.15.60:0/1774240076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157870 0x7f9c1815b6a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c68c912f5308ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c16ffd700 1 -- 172.21.15.60:0/1774240076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08009e80 con 0x7f9c18157870 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c16ffd700 1 -- 172.21.15.60:0/1774240076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800b860 con 0x7f9c18157870 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.327+0000 7f9c16ffd700 1 -- 172.21.15.60:0/1774240076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800bbe0 con 0x7f9c18157870 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 -- 172.21.15.60:0/1774240076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157870 msgr2=0x7f9c1815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 --2- 172.21.15.60:0/1774240076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157870 0x7f9c1815b6a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 -- 172.21.15.60:0/1774240076 shutdown_connections 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 --2- 172.21.15.60:0/1774240076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157870 0x7f9c1815b6a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 -- 172.21.15.60:0/1774240076 >> 172.21.15.60:0/1774240076 conn(0x7f9c18068ce0 msgr2=0x7f9c180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 -- 172.21.15.60:0/1774240076 shutdown_connections 2023-10-08T16:16:55.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.328+0000 7f9c1db24700 1 -- 172.21.15.60:0/1774240076 wait complete. 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.329+0000 7f9c1db24700 1 Processor -- start 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.329+0000 7f9c1db24700 1 -- start start 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c1db24700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c18157870 0x7f9c1813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c1db24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 0x7f9c18153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c1db24700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c1815a620 0x7f9c180b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c1db24700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18152b60 con 0x7f9c18157c40 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c1db24700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1813d610 con 0x7f9c18157870 2023-10-08T16:16:55.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c1db24700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18154500 con 0x7f9c1815a620 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 0x7f9c18153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 0x7f9c18153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41896/0 (socket says 172.21.15.60:41896) 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 -- 172.21.15.60:0/4221226354 learned_addr learned my addr 172.21.15.60:0/4221226354 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c177fe700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c18157870 0x7f9c1813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c17fff700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c1815a620 0x7f9c180b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 -- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c1815a620 msgr2=0x7f9c180b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c1815a620 0x7f9c180b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 -- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c18157870 msgr2=0x7f9c1813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c18157870 0x7f9c1813d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c0effd700 1 -- 172.21.15.60:0/4221226354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08009420 con 0x7f9c18157c40 2023-10-08T16:16:55.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.330+0000 7f9c17fff700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c1815a620 0x7f9c180b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.331+0000 7f9c0effd700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 0x7f9c18153fc0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c5c0 tx=0x7f9c00007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.331+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011590 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.331+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00011710 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.331+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1816b7d0 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.331+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011ad0 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.331+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c181534e0 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.332+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804c3c0 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.332+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c0001b3b0 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.332+0000 7f9c0ffff700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bf8066f30 0x7f9bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.332+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9c00083570 con 0x7f9c18157c40 2023-10-08T16:16:55.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.333+0000 7f9c177fe700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bf8066f30 0x7f9bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.333+0000 7f9c177fe700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bf8066f30 0x7f9bf80693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9c080093f0 tx=0x7f9c08017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.337+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c00050ae0 con 0x7f9c18157c40 2023-10-08T16:16:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.530+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c1815c840 con 0x7f9bf8066f30 2023-10-08T16:16:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.530+0000 7f9c0ffff700 1 -- 172.21.15.60:0/4221226354 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9c1815c840 con 0x7f9bf8066f30 2023-10-08T16:16:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bf8066f30 msgr2=0x7f9bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bf8066f30 0x7f9bf80693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9c080093f0 tx=0x7f9c08017000 comp rx=0 tx=0).stop 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 msgr2=0x7f9c18153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 0x7f9c18153fc0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c5c0 tx=0x7f9c00007f50 comp rx=0 tx=0).stop 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 shutdown_connections 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9bf8066f30 0x7f9bf80693e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9c1815a620 0x7f9c180b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c18157870 0x7f9c1813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 --2- 172.21.15.60:0/4221226354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c18157c40 0x7f9c18153fc0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 >> 172.21.15.60:0/4221226354 conn(0x7f9c18068ce0 msgr2=0x7f9c1814d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 shutdown_connections 2023-10-08T16:16:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.532+0000 7f9c1db24700 1 -- 172.21.15.60:0/4221226354 wait complete. 2023-10-08T16:16:55.534 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T16:16:55.544 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T16:16:55.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:55.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.668+0000 7f3fa9863700 1 Processor -- start 2023-10-08T16:16:55.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.668+0000 7f3fa9863700 1 -- start start 2023-10-08T16:16:55.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa9863700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fa4157ac0 0x7f3fa40d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa9863700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa40d0d40 0x7f3fa40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa9863700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa40d08e0 con 0x7f3fa415a580 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa9863700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa415b0d0 con 0x7f3fa4157ac0 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa9863700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4157e90 con 0x7f3fa40d0d40 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fa4157ac0 0x7f3fa40d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3fa415a580 0x7f3fa415a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56546/0 (socket says 172.21.15.60:56546) 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa37fe700 1 -- 172.21.15.60:0/900954221 learned_addr learned my addr 172.21.15.60:0/900954221 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa27fc700 1 --2- 172.21.15.60:0/900954221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa40d0d40 0x7f3fa40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa2ffd700 1 -- 172.21.15.60:0/900954221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa40d0d40 msgr2=0x7f3fa40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa2ffd700 1 --2- 172.21.15.60:0/900954221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa40d0d40 0x7f3fa40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa2ffd700 1 -- 172.21.15.60:0/900954221 >> v1:172.21.15.60:6789/0 conn(0x7f3fa415a580 legacy=0x7f3fa415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa2ffd700 1 -- 172.21.15.60:0/900954221 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40d16d0 con 0x7f3fa4157ac0 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa1ffb700 1 -- 172.21.15.60:0/900954221 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793866778 0 0) 0x7f3f94001490 con 0x7f3fa415a580 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa2ffd700 1 --2- 172.21.15.60:0/900954221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa40d03a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0098e0 tx=0x7f3f9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a14c17c0910039 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa1ffb700 1 -- 172.21.15.60:0/900954221 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c009e80 con 0x7f3fa4157ac0 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa1ffb700 1 -- 172.21.15.60:0/900954221 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00b860 con 0x7f3fa4157ac0 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.669+0000 7f3fa1ffb700 1 -- 172.21.15.60:0/900954221 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00bbe0 con 0x7f3fa4157ac0 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 -- 172.21.15.60:0/900954221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 msgr2=0x7f3fa40d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 --2- 172.21.15.60:0/900954221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa40d03a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0098e0 tx=0x7f3f9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 -- 172.21.15.60:0/900954221 shutdown_connections 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 --2- 172.21.15.60:0/900954221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa40d03a0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 --2- 172.21.15.60:0/900954221 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa40d0d40 0x7f3fa40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 -- 172.21.15.60:0/900954221 >> 172.21.15.60:0/900954221 conn(0x7f3fa40680f0 msgr2=0x7f3fa40b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 -- 172.21.15.60:0/900954221 shutdown_connections 2023-10-08T16:16:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.670+0000 7f3fa9863700 1 -- 172.21.15.60:0/900954221 wait complete. 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.671+0000 7f3fa9863700 1 Processor -- start 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.671+0000 7f3fa9863700 1 -- start start 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa9863700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40d0d40 0x7f3fa40c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa9863700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa4155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa9863700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa415a580 0x7f3fa40c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa9863700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c5b70 con 0x7f3fa4157ac0 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa9863700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c5e50 con 0x7f3fa40d0d40 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa9863700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40c8080 con 0x7f3fa415a580 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa4155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa4155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41914/0 (socket says 172.21.15.60:41914) 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa27fc700 1 -- 172.21.15.60:0/1328886469 learned_addr learned my addr 172.21.15.60:0/1328886469 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa37fe700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa415a580 0x7f3fa40c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.672+0000 7f3fa2ffd700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40d0d40 0x7f3fa40c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa27fc700 1 -- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa415a580 msgr2=0x7f3fa40c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa27fc700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa415a580 0x7f3fa40c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa27fc700 1 -- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40d0d40 msgr2=0x7f3fa40c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa27fc700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40d0d40 0x7f3fa40c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa27fc700 1 -- 172.21.15.60:0/1328886469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009420 con 0x7f3fa4157ac0 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa2ffd700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40d0d40 0x7f3fa40c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa27fc700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa4155710 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00d860 tx=0x7f3f8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c009610 con 0x7f3fa4157ac0 2023-10-08T16:16:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c009770 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40c8360 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c009b30 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.673+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa40c7d30 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.674+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fa404c3c0 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.674+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f8c01e460 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3f9affd700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3f8c0848f0 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3fa2ffd700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3f9affd700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f3f8406cd80 0x7f3f8406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 --> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f8406f860 con 0x7f3f8406cd80 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f8c089220 con 0x7f3fa4157ac0 2023-10-08T16:16:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3fa37fe700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f3f8406cd80 0x7f3f8406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3fa2ffd700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3fa416b7f0 tx=0x7f3f9c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.675+0000 7f3fa37fe700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f3f8406cd80 0x7f3f8406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.676+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== osd.3 v2:172.21.15.60:6823/86357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f3f8406f860 con 0x7f3f8406cd80 2023-10-08T16:16:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.688+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 --> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fa40ce520 con 0x7f3f8406cd80 2023-10-08T16:16:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3f9affd700 1 -- 172.21.15.60:0/1328886469 <== osd.3 v2:172.21.15.60:6823/86357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f3fa40ce520 con 0x7f3f8406cd80 2023-10-08T16:16:55.689 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:55.689 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f3f8406cd80 msgr2=0x7f3f8406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6823/86357,v1:172.21.15.60:6824/86357] conn(0x7f3f8406cd80 0x7f3f8406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f84066f30 msgr2=0x7f3f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3fa416b7f0 tx=0x7f3f9c017000 comp rx=0 tx=0).stop 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 msgr2=0x7f3fa4155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 --2- 172.21.15.60:0/1328886469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fa4157ac0 0x7f3fa4155710 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00d860 tx=0x7f3f8c008040 comp rx=0 tx=0).stop 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa37fe700 1 -- 172.21.15.60:0/1328886469 reap_dead start 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 shutdown_connections 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 >> 172.21.15.60:0/1328886469 conn(0x7f3fa40680f0 msgr2=0x7f3fa415a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 shutdown_connections 2023-10-08T16:16:55.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.689+0000 7f3fa9863700 1 -- 172.21.15.60:0/1328886469 wait complete. 2023-10-08T16:16:55.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T16:16:55.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.820+0000 7f90bd0bf700 1 Processor -- start 2023-10-08T16:16:55.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.820+0000 7f90bd0bf700 1 -- start start 2023-10-08T16:16:55.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90bd0bf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90b8157870 0x7f90b815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90bd0bf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90b815a620 0x7f90b815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90bd0bf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b815cbb0 con 0x7f90b815d580 2023-10-08T16:16:55.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90bd0bf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b815bfa0 con 0x7f90b8157870 2023-10-08T16:16:55.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90bd0bf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b815c280 con 0x7f90b815a620 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90b6d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90b8157870 0x7f90b815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90b759e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f90b815d580 0x7f90b8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56550/0 (socket says 172.21.15.60:56550) 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.821+0000 7f90b759e700 1 -- 172.21.15.60:0/2989967044 learned_addr learned my addr 172.21.15.60:0/2989967044 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b659c700 1 --2- 172.21.15.60:0/2989967044 >> v2:172.21.15.144:3300/0 conn(0x7f90b815a620 0x7f90b815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b6d9d700 1 -- 172.21.15.60:0/2989967044 >> v2:172.21.15.144:3300/0 conn(0x7f90b815a620 msgr2=0x7f90b815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b6d9d700 1 --2- 172.21.15.60:0/2989967044 >> v2:172.21.15.144:3300/0 conn(0x7f90b815a620 0x7f90b815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b6d9d700 1 -- 172.21.15.60:0/2989967044 >> v1:172.21.15.60:6789/0 conn(0x7f90b815d580 legacy=0x7f90b8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b5d9b700 1 -- 172.21.15.60:0/2989967044 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296763961 0 0) 0x7f90b815cbb0 con 0x7f90b815d580 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b6d9d700 1 -- 172.21.15.60:0/2989967044 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b815c560 con 0x7f90b8157870 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b6d9d700 1 --2- 172.21.15.60:0/2989967044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b8157870 0x7f90b815b6a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f90b815cb20 tx=0x7f90b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5657c5d3e20ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b5d9b700 1 -- 172.21.15.60:0/2989967044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0011630 con 0x7f90b8157870 2023-10-08T16:16:55.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b5d9b700 1 -- 172.21.15.60:0/2989967044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b0011790 con 0x7f90b8157870 2023-10-08T16:16:55.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.822+0000 7f90b5d9b700 1 -- 172.21.15.60:0/2989967044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0011b30 con 0x7f90b8157870 2023-10-08T16:16:55.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 -- 172.21.15.60:0/2989967044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b8157870 msgr2=0x7f90b815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/2989967044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b8157870 0x7f90b815b6a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f90b815cb20 tx=0x7f90b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 -- 172.21.15.60:0/2989967044 shutdown_connections 2023-10-08T16:16:55.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/2989967044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b8157870 0x7f90b815b6a0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/2989967044 >> v2:172.21.15.144:3300/0 conn(0x7f90b815a620 0x7f90b815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 -- 172.21.15.60:0/2989967044 >> 172.21.15.60:0/2989967044 conn(0x7f90b8068ce0 msgr2=0x7f90b80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 -- 172.21.15.60:0/2989967044 shutdown_connections 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.823+0000 7f90bd0bf700 1 -- 172.21.15.60:0/2989967044 wait complete. 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.824+0000 7f90bd0bf700 1 Processor -- start 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.824+0000 7f90bd0bf700 1 -- start start 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90b8157870 0x7f90b814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b815a620 0x7f90b8144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 0x7f90b80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b816ab90 con 0x7f90b815d580 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80d0570 con 0x7f90b815a620 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80d1390 con 0x7f90b8157870 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 0x7f90b80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 0x7f90b80b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41930/0 (socket says 172.21.15.60:41930) 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 -- 172.21.15.60:0/549625150 learned_addr learned my addr 172.21.15.60:0/549625150 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b6d9d700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90b8157870 0x7f90b814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b659c700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b815a620 0x7f90b8144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 -- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90b8157870 msgr2=0x7f90b814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90b8157870 0x7f90b814a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 -- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b815a620 msgr2=0x7f90b8144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b815a620 0x7f90b8144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 -- 172.21.15.60:0/549625150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0009420 con 0x7f90b815d580 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90b759e700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 0x7f90b80b51b0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f90a800cbc0 tx=0x7f90a8001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800a7e0 con 0x7f90b815d580 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a800a940 con 0x7f90b815d580 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b80d0780 con 0x7f90b815d580 2023-10-08T16:16:55.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.825+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800ad00 con 0x7f90b815d580 2023-10-08T16:16:55.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.826+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b80d0dc0 con 0x7f90b815d580 2023-10-08T16:16:55.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.826+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b80d1140 con 0x7f90b815d580 2023-10-08T16:16:55.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.827+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90a8007300 con 0x7f90b815d580 2023-10-08T16:16:55.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.827+0000 7f90aeffd700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9098066f30 0x7f90980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:55.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.827+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f90a8084560 con 0x7f90b815d580 2023-10-08T16:16:55.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.827+0000 7f90b6d9d700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9098066f30 0x7f90980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:55.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.828+0000 7f90b6d9d700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9098066f30 0x7f90980693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f90b00093f0 tx=0x7f90b0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:55.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:55.831+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90a8051ab0 con 0x7f90b815d580 2023-10-08T16:16:56.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.024+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f90b80d1520 con 0x7f9098066f30 2023-10-08T16:16:56.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.024+0000 7f90aeffd700 1 -- 172.21.15.60:0/549625150 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90b80d1520 con 0x7f9098066f30 2023-10-08T16:16:56.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9098066f30 msgr2=0x7f90980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9098066f30 0x7f90980693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f90b00093f0 tx=0x7f90b0017000 comp rx=0 tx=0).stop 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 msgr2=0x7f90b80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 0x7f90b80b51b0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f90a800cbc0 tx=0x7f90a8001980 comp rx=0 tx=0).stop 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 shutdown_connections 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f9098066f30 0x7f90980693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90b8157870 0x7f90b814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b815d580 0x7f90b80b51b0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 --2- 172.21.15.60:0/549625150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b815a620 0x7f90b8144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 >> 172.21.15.60:0/549625150 conn(0x7f90b8068ce0 msgr2=0x7f90b80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 shutdown_connections 2023-10-08T16:16:56.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.026+0000 7f90bd0bf700 1 -- 172.21.15.60:0/549625150 wait complete. 2023-10-08T16:16:56.028 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T16:16:56.038 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T16:16:56.038 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.161+0000 7f5b849a1700 1 Processor -- start 2023-10-08T16:16:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.161+0000 7f5b849a1700 1 -- start start 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b849a1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b800cdbc0 0x7f5b8015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b849a1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b801595f0 0x7f5b80159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b849a1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8015e5b0 con 0x7f5b800cd7f0 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b849a1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8015e890 con 0x7f5b800cdbc0 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b849a1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800ceea0 con 0x7f5b801595f0 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b801595f0 0x7f5b80159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b800cdbc0 0x7f5b8015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b801595f0 0x7f5b80159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:52354/0 (socket says 172.21.15.60:52354) 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b800cdbc0 0x7f5b8015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:48690/0 (socket says 172.21.15.60:48690) 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7ffff700 1 -- 172.21.15.60:0/3187242167 learned_addr learned my addr 172.21.15.60:0/3187242167 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7effd700 1 -- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b801595f0 msgr2=0x7f5b80159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7effd700 1 --2- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b801595f0 0x7f5b80159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7effd700 1 -- 172.21.15.60:0/3187242167 >> v1:172.21.15.144:6789/0 conn(0x7f5b800cd7f0 legacy=0x7f5b8015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.162+0000 7f5b7effd700 1 -- 172.21.15.60:0/3187242167 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800cf180 con 0x7f5b800cdbc0 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b7effd700 1 --2- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b800cdbc0 0x7f5b8015dfd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5b740098e0 tx=0x7f5b740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c6d5d1f4e5f65f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b7e7fc700 1 -- 172.21.15.60:0/3187242167 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400b640 con 0x7f5b800cdbc0 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b7e7fc700 1 -- 172.21.15.60:0/3187242167 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400b7a0 con 0x7f5b800cdbc0 2023-10-08T16:16:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b7e7fc700 1 -- 172.21.15.60:0/3187242167 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400bb40 con 0x7f5b800cdbc0 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 -- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b800cdbc0 msgr2=0x7f5b8015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 --2- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b800cdbc0 0x7f5b8015dfd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5b740098e0 tx=0x7f5b740091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 -- 172.21.15.60:0/3187242167 shutdown_connections 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 --2- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b801595f0 0x7f5b80159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 --2- 172.21.15.60:0/3187242167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b800cdbc0 0x7f5b8015dfd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 -- 172.21.15.60:0/3187242167 >> 172.21.15.60:0/3187242167 conn(0x7f5b80068bf0 msgr2=0x7f5b80068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 -- 172.21.15.60:0/3187242167 shutdown_connections 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.163+0000 7f5b849a1700 1 -- 172.21.15.60:0/3187242167 wait complete. 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 Processor -- start 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 -- start start 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b800cd7f0 0x7f5b8016afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b800cdbc0 0x7f5b800b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b801595f0 0x7f5b800b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800b2e90 con 0x7f5b800cd7f0 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8016a940 con 0x7f5b801595f0 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b849a1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8016b4e0 con 0x7f5b800cdbc0 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.165+0000 7f5b7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b800cd7f0 0x7f5b8016afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b800cdbc0 0x7f5b800b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b800cd7f0 0x7f5b8016afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41944/0 (socket says 172.21.15.60:41944) 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 -- 172.21.15.60:0/1046274679 learned_addr learned my addr 172.21.15.60:0/1046274679 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7ffff700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b801595f0 0x7f5b800b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 -- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b800cdbc0 msgr2=0x7f5b800b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b800cdbc0 0x7f5b800b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 -- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b801595f0 msgr2=0x7f5b800b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b801595f0 0x7f5b800b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 -- 172.21.15.60:0/1046274679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009420 con 0x7f5b800cd7f0 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7effd700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b800cdbc0 0x7f5b800b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7ffff700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b801595f0 0x7f5b800b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:16:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b7f7fe700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b800cd7f0 0x7f5b8016afa0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000cb10 tx=0x7f5b700017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000ce20 con 0x7f5b800cd7f0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000a7e0 con 0x7f5b800cd7f0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b800b2210 con 0x7f5b800cd7f0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000aba0 con 0x7f5b800cd7f0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.166+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b800b27d0 con 0x7f5b800cd7f0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.167+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b80089520 con 0x7f5b800cd7f0 2023-10-08T16:16:56.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b70003030 con 0x7f5b800cd7f0 2023-10-08T16:16:56.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b677fe700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5b6c066f30 0x7f5b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5b70084950 con 0x7f5b800cd7f0 2023-10-08T16:16:56.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b7effd700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5b6c066f30 0x7f5b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b677fe700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7f5b6c06cd80 0x7f5b6c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 --> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b6c06f860 con 0x7f5b6c06cd80 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.168+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b70084d20 con 0x7f5b800cd7f0 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.169+0000 7f5b7ffff700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7f5b6c06cd80 0x7f5b6c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.169+0000 7f5b7effd700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5b6c066f30 0x7f5b6c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5b740093f0 tx=0x7f5b74017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.169+0000 7f5b7ffff700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7f5b6c06cd80 0x7f5b6c06f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.170+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== osd.4 v2:172.21.15.144:6803/86599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5b6c06f860 con 0x7f5b6c06cd80 2023-10-08T16:16:56.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.182+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 --> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5b800cf460 con 0x7f5b6c06cd80 2023-10-08T16:16:56.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b677fe700 1 -- 172.21.15.60:0/1046274679 <== osd.4 v2:172.21.15.144:6803/86599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f5b800cf460 con 0x7f5b6c06cd80 2023-10-08T16:16:56.183 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:56.183 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:56.183 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:56.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7f5b6c06cd80 msgr2=0x7f5b6c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.144:6803/86599,v1:172.21.15.144:6806/86599] conn(0x7f5b6c06cd80 0x7f5b6c06f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5b6c066f30 msgr2=0x7f5b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f5b6c066f30 0x7f5b6c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5b740093f0 tx=0x7f5b74017000 comp rx=0 tx=0).stop 2023-10-08T16:16:56.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b800cd7f0 msgr2=0x7f5b8016afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 --2- 172.21.15.60:0/1046274679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b800cd7f0 0x7f5b8016afa0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000cb10 tx=0x7f5b700017b0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b7ffff700 1 -- 172.21.15.60:0/1046274679 reap_dead start 2023-10-08T16:16:56.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 shutdown_connections 2023-10-08T16:16:56.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 >> 172.21.15.60:0/1046274679 conn(0x7f5b80068bf0 msgr2=0x7f5b801566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 shutdown_connections 2023-10-08T16:16:56.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.183+0000 7f5b849a1700 1 -- 172.21.15.60:0/1046274679 wait complete. 2023-10-08T16:16:56.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T16:16:56.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.314+0000 7f2b749c0700 1 Processor -- start 2023-10-08T16:16:56.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.314+0000 7f2b749c0700 1 -- start start 2023-10-08T16:16:56.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b749c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b7015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b749c0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b7015a620 0x7f2b7015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b749c0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7015cbb0 con 0x7f2b7015d580 2023-10-08T16:16:56.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b749c0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7015bfa0 con 0x7f2b7015a620 2023-10-08T16:16:56.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b749c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7015c280 con 0x7f2b70157870 2023-10-08T16:16:56.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b6dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b7015a620 0x7f2b7015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b6dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b7015a620 0x7f2b7015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41950/0 (socket says 172.21.15.60:41950) 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/1053357454 learned_addr learned my addr 172.21.15.60:0/1053357454 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.315+0000 7f2b6e59c700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b7015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/1053357454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 msgr2=0x7f2b7015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6dd9b700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b7015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/1053357454 >> v1:172.21.15.144:6789/0 conn(0x7f2b7015d580 legacy=0x7f2b70158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/1053357454 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7015c560 con 0x7f2b7015a620 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6e59c700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b7015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6dd9b700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b7015d040 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f2b580099b0 tx=0x7f2b58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d6a2c39958747c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6d59a700 1 -- 172.21.15.60:0/1053357454 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5800b860 con 0x7f2b7015a620 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6d59a700 1 -- 172.21.15.60:0/1053357454 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5800b9c0 con 0x7f2b7015a620 2023-10-08T16:16:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b6d59a700 1 -- 172.21.15.60:0/1053357454 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5800bd60 con 0x7f2b7015a620 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b749c0700 1 -- 172.21.15.60:0/1053357454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 msgr2=0x7f2b7015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.316+0000 7f2b749c0700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b7015d040 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f2b580099b0 tx=0x7f2b58009250 comp rx=0 tx=0).stop 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.317+0000 7f2b749c0700 1 -- 172.21.15.60:0/1053357454 shutdown_connections 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.317+0000 7f2b749c0700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b7015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.317+0000 7f2b749c0700 1 --2- 172.21.15.60:0/1053357454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b7015d040 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.317+0000 7f2b749c0700 1 -- 172.21.15.60:0/1053357454 >> 172.21.15.60:0/1053357454 conn(0x7f2b70068ce0 msgr2=0x7f2b700690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.317+0000 7f2b749c0700 1 -- 172.21.15.60:0/1053357454 shutdown_connections 2023-10-08T16:16:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.317+0000 7f2b749c0700 1 -- 172.21.15.60:0/1053357454 wait complete. 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 Processor -- start 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 -- start start 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b700b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b70153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b7015d580 0x7f2b70154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7015e340 con 0x7f2b7015a620 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700cf8b0 con 0x7f2b7015d580 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b749c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700cf580 con 0x7f2b70157870 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b6dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b70153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b6dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b70153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41952/0 (socket says 172.21.15.60:41952) 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.318+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/320821020 learned_addr learned my addr 172.21.15.60:0/320821020 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6e59c700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b700b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6ed9d700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b7015d580 0x7f2b70154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 msgr2=0x7f2b700b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6dd9b700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b700b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b7015d580 msgr2=0x7f2b70154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6dd9b700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b7015d580 0x7f2b70154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6dd9b700 1 -- 172.21.15.60:0/320821020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580094f0 con 0x7f2b7015a620 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b6dd9b700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b70153b10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009290 tx=0x7f2b58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58011e00 con 0x7f2b7015a620 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5801f070 con 0x7f2b7015a620 2023-10-08T16:16:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580266d0 con 0x7f2b7015a620 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7014adb0 con 0x7f2b7015a620 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.319+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b701549e0 con 0x7f2b7015a620 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.320+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b70154ca0 con 0x7f2b7015a620 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.321+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b58026a40 con 0x7f2b7015a620 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.321+0000 7f2b667fc700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b50066f30 0x7f2b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.321+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2b58021070 con 0x7f2b7015a620 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.321+0000 7f2b6e59c700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b50066f30 0x7f2b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.321+0000 7f2b6e59c700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b50066f30 0x7f2b500693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2b68006f00 tx=0x7f2b68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.325+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b58053560 con 0x7f2b7015a620 2023-10-08T16:16:56.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.519+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b7004c3c0 con 0x7f2b50066f30 2023-10-08T16:16:56.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.520+0000 7f2b667fc700 1 -- 172.21.15.60:0/320821020 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b7004c3c0 con 0x7f2b50066f30 2023-10-08T16:16:56.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b50066f30 msgr2=0x7f2b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b50066f30 0x7f2b500693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2b68006f00 tx=0x7f2b68008040 comp rx=0 tx=0).stop 2023-10-08T16:16:56.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 msgr2=0x7f2b70153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b70153b10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009290 tx=0x7f2b58017000 comp rx=0 tx=0).stop 2023-10-08T16:16:56.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 shutdown_connections 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f2b50066f30 0x7f2b500693e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b70157870 0x7f2b700b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b7015d580 0x7f2b70154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 --2- 172.21.15.60:0/320821020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b7015a620 0x7f2b70153b10 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 >> 172.21.15.60:0/320821020 conn(0x7f2b70068ce0 msgr2=0x7f2b7014fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 shutdown_connections 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.522+0000 7f2b749c0700 1 -- 172.21.15.60:0/320821020 wait complete. 2023-10-08T16:16:56.524 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T16:16:56.534 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T16:16:56.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:56.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.657+0000 7f089ebcc700 1 Processor -- start 2023-10-08T16:16:56.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.657+0000 7f089ebcc700 1 -- start start 2023-10-08T16:16:56.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089ebcc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08980cdbc0 0x7f089815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089ebcc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f0898159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089ebcc700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089815e5b0 con 0x7f08980cd7f0 2023-10-08T16:16:56.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089ebcc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089815e890 con 0x7f08980cdbc0 2023-10-08T16:16:56.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089ebcc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980ceea0 con 0x7f08981595f0 2023-10-08T16:16:56.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089d3c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08980cdbc0 0x7f089815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089dbca700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08980cd7f0 0x7f089815d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56560/0 (socket says 172.21.15.60:56560) 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089dbca700 1 -- 172.21.15.60:0/929400070 learned_addr learned my addr 172.21.15.60:0/929400070 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089cbc8700 1 -- 172.21.15.60:0/929400070 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962439279 0 0) 0x7f089815e5b0 con 0x7f08980cd7f0 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.658+0000 7f089cbc8700 1 -- 172.21.15.60:0/929400070 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0880003570 con 0x7f08980cd7f0 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089e3cb700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f0898159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089d3c9700 1 -- 172.21.15.60:0/929400070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 msgr2=0x7f0898159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089d3c9700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f0898159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089d3c9700 1 -- 172.21.15.60:0/929400070 >> v1:172.21.15.60:6789/0 conn(0x7f08980cd7f0 legacy=0x7f089815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089d3c9700 1 -- 172.21.15.60:0/929400070 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980cf180 con 0x7f08980cdbc0 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089e3cb700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f0898159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089d3c9700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cdbc0 0x7f089815dfd0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f088c0098e0 tx=0x7f088c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823e83d42389e86c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089cbc8700 1 -- 172.21.15.60:0/929400070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00b640 con 0x7f08980cdbc0 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089cbc8700 1 -- 172.21.15.60:0/929400070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c00b7a0 con 0x7f08980cdbc0 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089cbc8700 1 -- 172.21.15.60:0/929400070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00bb40 con 0x7f08980cdbc0 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089ebcc700 1 -- 172.21.15.60:0/929400070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cdbc0 msgr2=0x7f089815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089ebcc700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cdbc0 0x7f089815dfd0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f088c0098e0 tx=0x7f088c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089ebcc700 1 -- 172.21.15.60:0/929400070 shutdown_connections 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089ebcc700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f0898159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089ebcc700 1 --2- 172.21.15.60:0/929400070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cdbc0 0x7f089815dfd0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.659+0000 7f089ebcc700 1 -- 172.21.15.60:0/929400070 >> 172.21.15.60:0/929400070 conn(0x7f0898068bf0 msgr2=0x7f0898068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.660+0000 7f089ebcc700 1 -- 172.21.15.60:0/929400070 shutdown_connections 2023-10-08T16:16:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.660+0000 7f089ebcc700 1 -- 172.21.15.60:0/929400070 wait complete. 2023-10-08T16:16:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.661+0000 7f089ebcc700 1 Processor -- start 2023-10-08T16:16:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.661+0000 7f089ebcc700 1 -- start start 2023-10-08T16:16:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cd7f0 0x7f08980b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08980cdbc0 0x7f089815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f089814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089815d9f0 con 0x7f08980cd7f0 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0898159ad0 con 0x7f08980cdbc0 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089816a450 con 0x7f08981595f0 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cd7f0 0x7f08980b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cd7f0 0x7f08980b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41974/0 (socket says 172.21.15.60:41974) 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 -- 172.21.15.60:0/1780748832 learned_addr learned my addr 172.21.15.60:0/1780748832 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089e3cb700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f089814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089d3c9700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08980cdbc0 0x7f089815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 -- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 msgr2=0x7f089814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f089814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 -- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08980cdbc0 msgr2=0x7f089815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08980cdbc0 0x7f089815d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 -- 172.21.15.60:0/1780748832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c009420 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089d3c9700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08980cdbc0 0x7f089815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089e3cb700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08981595f0 0x7f089814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089dbca700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cd7f0 0x7f08980b39a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f089000c7c0 tx=0x7f0890007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890005b30 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0890005c90 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089816a730 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.662+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890007340 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.663+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089816acf0 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.663+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0898089520 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.664+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f089001b400 con 0x7f08980cd7f0 2023-10-08T16:16:56.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.664+0000 7f0895ffb700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0884066f30 0x7f08840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.664+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0890083de0 con 0x7f08980cd7f0 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.664+0000 7f089d3c9700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0884066f30 0x7f08840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.664+0000 7f0895ffb700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7f088406cd80 0x7f088406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.665+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 --> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f088406f860 con 0x7f088406cd80 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.665+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0890086340 con 0x7f08980cd7f0 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.665+0000 7f089d3c9700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0884066f30 0x7f08840693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f088c0093f0 tx=0x7f088c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.665+0000 7f089e3cb700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7f088406cd80 0x7f088406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.665+0000 7f089e3cb700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7f088406cd80 0x7f088406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.666+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== osd.5 v2:172.21.15.144:6800/86600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f088406f860 con 0x7f088406cd80 2023-10-08T16:16:56.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.679+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 --> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f089816aeb0 con 0x7f088406cd80 2023-10-08T16:16:56.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.679+0000 7f0895ffb700 1 -- 172.21.15.60:0/1780748832 <== osd.5 v2:172.21.15.144:6800/86600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f088800e500 con 0x7f088406cd80 2023-10-08T16:16:56.680 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:56.680 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:56.680 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7f088406cd80 msgr2=0x7f088406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.144:6800/86600,v1:172.21.15.144:6802/86600] conn(0x7f088406cd80 0x7f088406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0884066f30 msgr2=0x7f08840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0884066f30 0x7f08840693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f088c0093f0 tx=0x7f088c017000 comp rx=0 tx=0).stop 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cd7f0 msgr2=0x7f08980b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 --2- 172.21.15.60:0/1780748832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08980cd7f0 0x7f08980b39a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f089000c7c0 tx=0x7f0890007e00 comp rx=0 tx=0).stop 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089e3cb700 1 -- 172.21.15.60:0/1780748832 reap_dead start 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 shutdown_connections 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 >> 172.21.15.60:0/1780748832 conn(0x7f0898068bf0 msgr2=0x7f08981589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 shutdown_connections 2023-10-08T16:16:56.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.680+0000 7f089ebcc700 1 -- 172.21.15.60:0/1780748832 wait complete. 2023-10-08T16:16:56.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T16:16:56.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.811+0000 7f1a8b310700 1 Processor -- start 2023-10-08T16:16:56.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.811+0000 7f1a8b310700 1 -- start start 2023-10-08T16:16:56.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a8b310700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a841523e0 0x7f1a8406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a8b310700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8406c010 con 0x7f1a84152010 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a8b310700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8406bd10 con 0x7f1a84158e50 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a8b310700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8415c060 con 0x7f1a841523e0 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a890ac700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1a84152010 0x7f1a8415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56572/0 (socket says 172.21.15.60:56572) 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a890ac700 1 -- 172.21.15.60:0/1098642453 learned_addr learned my addr 172.21.15.60:0/1098642453 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a888ab700 1 --2- 172.21.15.60:0/1098642453 >> v2:172.21.15.144:3300/0 conn(0x7f1a841523e0 0x7f1a8406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910745196 0 0) 0x7f1a8406c010 con 0x7f1a84152010 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.812+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a6c003570 con 0x7f1a84152010 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333773576 0 0) 0x7f1a6c003570 con 0x7f1a84152010 2023-10-08T16:16:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 >> v2:172.21.15.144:3300/0 conn(0x7f1a841523e0 msgr2=0x7f1a8406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 --2- 172.21.15.60:0/1098642453 >> v2:172.21.15.144:3300/0 conn(0x7f1a841523e0 0x7f1a8406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 >> v1:172.21.15.144:6789/0 conn(0x7f1a84158e50 legacy=0x7f1a840cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8415c340 con 0x7f1a84152010 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1168804515 0 0) 0x7f1a7c0017f0 con 0x7f1a84152010 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 >> v1:172.21.15.60:6789/0 conn(0x7f1a84152010 legacy=0x7f1a8415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a6c003ab0 0x7f1a6c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c004810 0x7f1a6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c005210 0x7f1a6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8415c060 con 0x7f1a6c005210 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c00c130 con 0x7f1a6c004810 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c00c2f0 con 0x7f1a6c003ab0 2023-10-08T16:16:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c005210 0x7f1a6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a890ac700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a6c003ab0 0x7f1a6c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a888ab700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c004810 0x7f1a6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 -- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a6c003ab0 msgr2=0x7f1a6c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a6c003ab0 0x7f1a6c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 -- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c004810 msgr2=0x7f1a6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c004810 0x7f1a6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 -- 172.21.15.60:0/1098642453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c003570 con 0x7f1a6c005210 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 -- 172.21.15.60:0/1098642453 reap_dead start 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a898ad700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c005210 0x7f1a6c00ba60 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1a740018b0 tx=0x7f1a74007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb63e8322adcadb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74012420 con 0x7f1a6c005210 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74012580 con 0x7f1a6c005210 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.813+0000 7f1a83fff700 1 -- 172.21.15.60:0/1098642453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74012920 con 0x7f1a6c005210 2023-10-08T16:16:56.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 -- 172.21.15.60:0/1098642453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c005210 msgr2=0x7f1a6c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c005210 0x7f1a6c00ba60 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1a740018b0 tx=0x7f1a74007d30 comp rx=0 tx=0).stop 2023-10-08T16:16:56.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 -- 172.21.15.60:0/1098642453 shutdown_connections 2023-10-08T16:16:56.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 --2- 172.21.15.60:0/1098642453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c005210 0x7f1a6c00ba60 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 -- 172.21.15.60:0/1098642453 >> 172.21.15.60:0/1098642453 conn(0x7f1a84069870 msgr2=0x7f1a84069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:56.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 -- 172.21.15.60:0/1098642453 shutdown_connections 2023-10-08T16:16:56.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.814+0000 7f1a8b310700 1 -- 172.21.15.60:0/1098642453 wait complete. 2023-10-08T16:16:56.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.815+0000 7f1a8b310700 1 Processor -- start 2023-10-08T16:16:56.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.815+0000 7f1a8b310700 1 -- start start 2023-10-08T16:16:56.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a8b310700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c005210 0x7f1a840c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a8b310700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a840ca740 0x7f1a841597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a8b310700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 0x7f1a8414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a8b310700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840cb2d0 con 0x7f1a84159ce0 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a8b310700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840cb570 con 0x7f1a6c005210 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a8b310700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840cb850 con 0x7f1a840ca740 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a898ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 0x7f1a8414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a898ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 0x7f1a8414f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41992/0 (socket says 172.21.15.60:41992) 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a898ad700 1 -- 172.21.15.60:0/2453660533 learned_addr learned my addr 172.21.15.60:0/2453660533 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a898ad700 1 -- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a840ca740 msgr2=0x7f1a841597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a888ab700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a840ca740 0x7f1a841597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a890ac700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c005210 0x7f1a840c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.816+0000 7f1a898ad700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a840ca740 0x7f1a841597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a898ad700 1 -- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c005210 msgr2=0x7f1a840c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a898ad700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c005210 0x7f1a840c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a898ad700 1 -- 172.21.15.60:0/2453660533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840cbb30 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a898ad700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 0x7f1a8414f6c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1a8406edb0 tx=0x7f1a74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74012900 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74001200 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74006a50 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840c6130 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.817+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840c8810 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.818+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8404c3c0 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.818+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a74007030 con 0x7f1a84159ce0 2023-10-08T16:16:56.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.819+0000 7f1a817fa700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a70066f30 0x7f1a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:56.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.819+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1a74084d30 con 0x7f1a84159ce0 2023-10-08T16:16:56.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.819+0000 7f1a890ac700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a70066f30 0x7f1a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:56.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.819+0000 7f1a890ac700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a70066f30 0x7f1a700693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c001f90 tx=0x7f1a7c006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:56.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:56.823+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a74052350 con 0x7f1a84159ce0 2023-10-08T16:16:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.013+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a840cb6e0 con 0x7f1a70066f30 2023-10-08T16:16:57.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.013+0000 7f1a817fa700 1 -- 172.21.15.60:0/2453660533 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a840cb6e0 con 0x7f1a70066f30 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.015+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a70066f30 msgr2=0x7f1a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.015+0000 7f1a8b310700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a70066f30 0x7f1a700693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c001f90 tx=0x7f1a7c006040 comp rx=0 tx=0).stop 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.015+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 msgr2=0x7f1a8414f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.015+0000 7f1a8b310700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 0x7f1a8414f6c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1a8406edb0 tx=0x7f1a74015000 comp rx=0 tx=0).stop 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 shutdown_connections 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1a70066f30 0x7f1a700693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84159ce0 0x7f1a8414f6c0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6c005210 0x7f1a840c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 --2- 172.21.15.60:0/2453660533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a840ca740 0x7f1a841597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 >> 172.21.15.60:0/2453660533 conn(0x7f1a84069870 msgr2=0x7f1a8406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 shutdown_connections 2023-10-08T16:16:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.016+0000 7f1a8b310700 1 -- 172.21.15.60:0/2453660533 wait complete. 2023-10-08T16:16:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T16:16:57.028 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T16:16:57.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.150+0000 7f15bda57700 1 Processor -- start 2023-10-08T16:16:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.150+0000 7f15bda57700 1 -- start start 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bda57700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15b815d240 0x7f15b80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bda57700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b80ce810 0x7f15b80cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bda57700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b80cd4f0 con 0x7f15b80cc940 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bda57700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b80b3f40 con 0x7f15b815d240 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bda57700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80cbb80 con 0x7f15b80ce810 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bca55700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15b815d240 0x7f15b80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bca55700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15b815d240 0x7f15b80b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42004/0 (socket says 172.21.15.60:42004) 2023-10-08T16:16:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.151+0000 7f15bca55700 1 -- 172.21.15.60:0/4268966363 learned_addr learned my addr 172.21.15.60:0/4268966363 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15bd256700 1 --2- 172.21.15.60:0/4268966363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b80ce810 0x7f15b80cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15bca55700 1 -- 172.21.15.60:0/4268966363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b80ce810 msgr2=0x7f15b80cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15bca55700 1 --2- 172.21.15.60:0/4268966363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b80ce810 0x7f15b80cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15bca55700 1 -- 172.21.15.60:0/4268966363 >> v1:172.21.15.144:6789/0 conn(0x7f15b80cc940 legacy=0x7f15b80ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15bca55700 1 -- 172.21.15.60:0/4268966363 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80cbe60 con 0x7f15b815d240 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15bca55700 1 --2- 172.21.15.60:0/4268966363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b815d240 0x7f15b80b3a00 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009990 tx=0x7f15a8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db5152f402fce5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15b77fe700 1 -- 172.21.15.60:0/4268966363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8005c10 con 0x7f15b815d240 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15b77fe700 1 -- 172.21.15.60:0/4268966363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8005d70 con 0x7f15b815d240 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.152+0000 7f15b77fe700 1 -- 172.21.15.60:0/4268966363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800b880 con 0x7f15b815d240 2023-10-08T16:16:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 -- 172.21.15.60:0/4268966363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b815d240 msgr2=0x7f15b80b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 --2- 172.21.15.60:0/4268966363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b815d240 0x7f15b80b3a00 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009990 tx=0x7f15a8009220 comp rx=0 tx=0).stop 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 -- 172.21.15.60:0/4268966363 shutdown_connections 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 --2- 172.21.15.60:0/4268966363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b80ce810 0x7f15b80cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 --2- 172.21.15.60:0/4268966363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b815d240 0x7f15b80b3a00 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 -- 172.21.15.60:0/4268966363 >> 172.21.15.60:0/4268966363 conn(0x7f15b8067e40 msgr2=0x7f15b80d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 -- 172.21.15.60:0/4268966363 shutdown_connections 2023-10-08T16:16:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.153+0000 7f15bda57700 1 -- 172.21.15.60:0/4268966363 wait complete. 2023-10-08T16:16:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.154+0000 7f15bda57700 1 Processor -- start 2023-10-08T16:16:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.154+0000 7f15bda57700 1 -- start start 2023-10-08T16:16:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b80cc940 0x7f15b80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b80ce810 0x7f15b8157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b815d240 0x7f15b809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b809d4b0 con 0x7f15b80cc940 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8157fa0 con 0x7f15b80ce810 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80c8140 con 0x7f15b815d240 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b80cc940 0x7f15b80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b80cc940 0x7f15b80c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42008/0 (socket says 172.21.15.60:42008) 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 -- 172.21.15.60:0/138918620 learned_addr learned my addr 172.21.15.60:0/138918620 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bd256700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b815d240 0x7f15b809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15b7fff700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b80ce810 0x7f15b8157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 -- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b815d240 msgr2=0x7f15b809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15b815d240 0x7f15b809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 -- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b80ce810 msgr2=0x7f15b8157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b80ce810 0x7f15b8157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 -- 172.21.15.60:0/138918620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009480 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bca55700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b80cc940 0x7f15b80c9020 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f15a8005d40 tx=0x7f15a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8006b60 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80118c0 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b80c8420 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8011c40 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.155+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b80c89e0 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.156+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15b806ac60 con 0x7f15b80cc940 2023-10-08T16:16:57.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15a801b640 con 0x7f15b80cc940 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b4ff9700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f15a4066f30 0x7f15a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f15a8085b50 con 0x7f15b80cc940 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b7fff700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f15a4066f30 0x7f15a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b4ff9700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7f15a406cc10 0x7f15a406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 --> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15a406f6f0 con 0x7f15a406cc10 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.157+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15a808a220 con 0x7f15b80cc940 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.158+0000 7f15bd256700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7f15a406cc10 0x7f15a406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.158+0000 7f15b7fff700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f15a4066f30 0x7f15a40693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f15b80b37a0 tx=0x7f15ac007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.158+0000 7f15bd256700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7f15a406cc10 0x7f15a406f020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.159+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== osd.6 v2:172.21.15.144:6805/86601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f15a406f6f0 con 0x7f15a406cc10 2023-10-08T16:16:57.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.171+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 --> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15b80cc140 con 0x7f15a406cc10 2023-10-08T16:16:57.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15b4ff9700 1 -- 172.21.15.60:0/138918620 <== osd.6 v2:172.21.15.144:6805/86601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f15b80cc140 con 0x7f15a406cc10 2023-10-08T16:16:57.172 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:57.172 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:57.173 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7f15a406cc10 msgr2=0x7f15a406f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bda57700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.144:6805/86601,v1:172.21.15.144:6808/86601] conn(0x7f15a406cc10 0x7f15a406f020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f15a4066f30 msgr2=0x7f15a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bda57700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f15a4066f30 0x7f15a40693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f15b80b37a0 tx=0x7f15ac007ec0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b80cc940 msgr2=0x7f15b80c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bda57700 1 --2- 172.21.15.60:0/138918620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15b80cc940 0x7f15b80c9020 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f15a8005d40 tx=0x7f15a8016000 comp rx=0 tx=0).stop 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.172+0000 7f15bd256700 1 -- 172.21.15.60:0/138918620 reap_dead start 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.173+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 shutdown_connections 2023-10-08T16:16:57.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.173+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 >> 172.21.15.60:0/138918620 conn(0x7f15b8067e40 msgr2=0x7f15b81581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.173+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 shutdown_connections 2023-10-08T16:16:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.173+0000 7f15bda57700 1 -- 172.21.15.60:0/138918620 wait complete. 2023-10-08T16:16:57.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T16:16:57.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.305+0000 7fb4422ce700 1 Processor -- start 2023-10-08T16:16:57.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.305+0000 7fb4422ce700 1 -- start start 2023-10-08T16:16:57.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb4422ce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb43c15a2b0 0x7fb43c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb4422ce700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb43c0cfe20 0x7fb43c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb4422ce700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0c5d80 con 0x7fb43c0d1c30 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb4422ce700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c068470 con 0x7fb43c15a2b0 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb4422ce700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0c6060 con 0x7fb43c0cfe20 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb43bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb43c15a2b0 0x7fb43c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb43bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb43c15a2b0 0x7fb43c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42016/0 (socket says 172.21.15.60:42016) 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.306+0000 7fb43bfff700 1 -- 172.21.15.60:0/2768437424 learned_addr learned my addr 172.21.15.60:0/2768437424 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43bfff700 1 -- 172.21.15.60:0/2768437424 >> v2:172.21.15.144:3300/0 conn(0x7fb43c0cfe20 msgr2=0x7fb43c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:57.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb44086b700 1 --2- 172.21.15.60:0/2768437424 >> v2:172.21.15.144:3300/0 conn(0x7fb43c0cfe20 0x7fb43c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43bfff700 1 --2- 172.21.15.60:0/2768437424 >> v2:172.21.15.144:3300/0 conn(0x7fb43c0cfe20 0x7fb43c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43bfff700 1 -- 172.21.15.60:0/2768437424 >> v1:172.21.15.144:6789/0 conn(0x7fb43c0d1c30 legacy=0x7fb43c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43bfff700 1 -- 172.21.15.60:0/2768437424 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0c6340 con 0x7fb43c15a2b0 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43bfff700 1 --2- 172.21.15.60:0/2768437424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c15a2b0 0x7fb43c0b3da0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb43c064970 tx=0x7fb42c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebc9732e3e53c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43affd700 1 -- 172.21.15.60:0/2768437424 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c005c10 con 0x7fb43c15a2b0 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43affd700 1 -- 172.21.15.60:0/2768437424 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c005d70 con 0x7fb43c15a2b0 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb43affd700 1 -- 172.21.15.60:0/2768437424 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00b840 con 0x7fb43c15a2b0 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb4422ce700 1 -- 172.21.15.60:0/2768437424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c15a2b0 msgr2=0x7fb43c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb4422ce700 1 --2- 172.21.15.60:0/2768437424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c15a2b0 0x7fb43c0b3da0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb43c064970 tx=0x7fb42c009220 comp rx=0 tx=0).stop 2023-10-08T16:16:57.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb4422ce700 1 -- 172.21.15.60:0/2768437424 shutdown_connections 2023-10-08T16:16:57.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb4422ce700 1 --2- 172.21.15.60:0/2768437424 >> v2:172.21.15.144:3300/0 conn(0x7fb43c0cfe20 0x7fb43c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb4422ce700 1 --2- 172.21.15.60:0/2768437424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c15a2b0 0x7fb43c0b3da0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.307+0000 7fb4422ce700 1 -- 172.21.15.60:0/2768437424 >> 172.21.15.60:0/2768437424 conn(0x7fb43c067e40 msgr2=0x7fb43c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.308+0000 7fb4422ce700 1 -- 172.21.15.60:0/2768437424 shutdown_connections 2023-10-08T16:16:57.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.308+0000 7fb4422ce700 1 -- 172.21.15.60:0/2768437424 wait complete. 2023-10-08T16:16:57.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.309+0000 7fb4422ce700 1 Processor -- start 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.309+0000 7fb4422ce700 1 -- start start 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.309+0000 7fb4422ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 0x7fb43c0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.309+0000 7fb4422ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0d1c30 0x7fb43c09e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb4422ce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c15a2b0 0x7fb43c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb4422ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c16a090 con 0x7fb43c0cfe20 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb4422ce700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0cace0 con 0x7fb43c15a2b0 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb4422ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c16a5d0 con 0x7fb43c0d1c30 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 0x7fb43c0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 0x7fb43c0ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42024/0 (socket says 172.21.15.60:42024) 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 -- 172.21.15.60:0/391388760 learned_addr learned my addr 172.21.15.60:0/391388760 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb44086b700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c15a2b0 0x7fb43c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43b7fe700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0d1c30 0x7fb43c09e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 -- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0d1c30 msgr2=0x7fb43c09e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0d1c30 0x7fb43c09e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 -- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c15a2b0 msgr2=0x7fb43c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c15a2b0 0x7fb43c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 -- 172.21.15.60:0/391388760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c009480 con 0x7fb43c0cfe20 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb44086b700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c15a2b0 0x7fb43c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb43bfff700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 0x7fb43c0ca090 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb42c003080 tx=0x7fb42c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011aa0 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c011c40 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c01c420 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c09eca0 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.310+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c159c60 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.311+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c04c3c0 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.312+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb42c01c7d0 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.312+0000 7fb423fff700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb428066f30 0x7fb4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.312+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb42c085da0 con 0x7fb43c0cfe20 2023-10-08T16:16:57.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.312+0000 7fb43b7fe700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb428066f30 0x7fb4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.313+0000 7fb43b7fe700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb428066f30 0x7fb4280693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0d2000 tx=0x7fb430008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.316+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb42c053310 con 0x7fb43c0cfe20 2023-10-08T16:16:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.507+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb43c16a710 con 0x7fb428066f30 2023-10-08T16:16:57.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.508+0000 7fb423fff700 1 -- 172.21.15.60:0/391388760 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb430011410 con 0x7fb428066f30 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb428066f30 msgr2=0x7fb4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb428066f30 0x7fb4280693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0d2000 tx=0x7fb430008040 comp rx=0 tx=0).stop 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 msgr2=0x7fb43c0ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 0x7fb43c0ca090 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb42c003080 tx=0x7fb42c015000 comp rx=0 tx=0).stop 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 shutdown_connections 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fb428066f30 0x7fb4280693e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c15a2b0 0x7fb43c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43c0cfe20 0x7fb43c0ca090 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 --2- 172.21.15.60:0/391388760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0d1c30 0x7fb43c09e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.509+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 >> 172.21.15.60:0/391388760 conn(0x7fb43c067e40 msgr2=0x7fb43c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.510+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 shutdown_connections 2023-10-08T16:16:57.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.510+0000 7fb4422ce700 1 -- 172.21.15.60:0/391388760 wait complete. 2023-10-08T16:16:57.511 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T16:16:57.522 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T16:16:57.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:16:57.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.645+0000 7f1f1b9e4700 1 Processor -- start 2023-10-08T16:16:57.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.645+0000 7f1f1b9e4700 1 -- start start 2023-10-08T16:16:57.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f1b9e4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f14156210 0x7f1f1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f1b9e4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f141565e0 0x7f1f140cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f1b9e4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f140c6f20 con 0x7f1f140af8f0 2023-10-08T16:16:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f1b9e4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140c7200 con 0x7f1f141565e0 2023-10-08T16:16:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f1b9e4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c74e0 con 0x7f1f14156210 2023-10-08T16:16:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f19f81700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f141565e0 0x7f1f140cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f18f7f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1f140af8f0 0x7f1f140cb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56574/0 (socket says 172.21.15.60:56574) 2023-10-08T16:16:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f18f7f700 1 -- 172.21.15.60:0/145417453 learned_addr learned my addr 172.21.15.60:0/145417453 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.646+0000 7f1f19780700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f14156210 0x7f1f1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f19f81700 1 -- 172.21.15.60:0/145417453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f14156210 msgr2=0x7f1f1406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f19f81700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f14156210 0x7f1f1406d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f19f81700 1 -- 172.21.15.60:0/145417453 >> v1:172.21.15.60:6789/0 conn(0x7f1f140af8f0 legacy=0x7f1f140cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f13fff700 1 -- 172.21.15.60:0/145417453 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210465359 0 0) 0x7f1f140c6f20 con 0x7f1f140af8f0 2023-10-08T16:16:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f19f81700 1 -- 172.21.15.60:0/145417453 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140c77c0 con 0x7f1f141565e0 2023-10-08T16:16:57.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f19780700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f14156210 0x7f1f1406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f19f81700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f141565e0 0x7f1f140cbe80 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009e60 tx=0x7f1f04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1e8c89c2c1a993 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f13fff700 1 -- 172.21.15.60:0/145417453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400bc30 con 0x7f1f141565e0 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f13fff700 1 -- 172.21.15.60:0/145417453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400bd90 con 0x7f1f141565e0 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f13fff700 1 -- 172.21.15.60:0/145417453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04011650 con 0x7f1f141565e0 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/145417453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f141565e0 msgr2=0x7f1f140cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.647+0000 7f1f1b9e4700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f141565e0 0x7f1f140cbe80 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009e60 tx=0x7f1f04009780 comp rx=0 tx=0).stop 2023-10-08T16:16:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.648+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/145417453 shutdown_connections 2023-10-08T16:16:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.648+0000 7f1f1b9e4700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f141565e0 0x7f1f140cbe80 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.648+0000 7f1f1b9e4700 1 --2- 172.21.15.60:0/145417453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f14156210 0x7f1f1406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.648+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/145417453 >> 172.21.15.60:0/145417453 conn(0x7f1f140cd450 msgr2=0x7f1f140c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.648+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/145417453 shutdown_connections 2023-10-08T16:16:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.648+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/145417453 wait complete. 2023-10-08T16:16:57.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.649+0000 7f1f1b9e4700 1 Processor -- start 2023-10-08T16:16:57.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.649+0000 7f1f1b9e4700 1 -- start start 2023-10-08T16:16:57.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f140af8f0 0x7f1f14154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f14156210 0x7f1f14165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f141565e0 0x7f1f140c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414dde0 con 0x7f1f14156210 2023-10-08T16:16:57.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14150c80 con 0x7f1f140af8f0 2023-10-08T16:16:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14166320 con 0x7f1f141565e0 2023-10-08T16:16:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f14156210 0x7f1f14165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f14156210 0x7f1f14165de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42040/0 (socket says 172.21.15.60:42040) 2023-10-08T16:16:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 -- 172.21.15.60:0/1966312181 learned_addr learned my addr 172.21.15.60:0/1966312181 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:57.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f19f81700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f141565e0 0x7f1f140c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f19780700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f140af8f0 0x7f1f14154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 -- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f141565e0 msgr2=0x7f1f140c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f141565e0 0x7f1f140c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 -- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f140af8f0 msgr2=0x7f1f14154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f140af8f0 0x7f1f14154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 -- 172.21.15.60:0/1966312181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04009a20 con 0x7f1f14156210 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f18f7f700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f14156210 0x7f1f14165de0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c7e0 tx=0x7f1f08007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08005b30 con 0x7f1f14156210 2023-10-08T16:16:57.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08005c90 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.650+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f140c6270 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.651+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08007300 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.651+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f14150630 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.651+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f1404c3c0 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f0801b3b0 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f117fa700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f00066f30 0x7f1f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1f08083e60 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f19780700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f00066f30 0x7f1f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f117fa700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f1f0006cd80 0x7f1f0006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 --> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f0006f860 con 0x7f1f0006cd80 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.652+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=187) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f08084230 con 0x7f1f14156210 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.653+0000 7f1f19f81700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f1f0006cd80 0x7f1f0006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.653+0000 7f1f19780700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f00066f30 0x7f1f000693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1f14153ba0 tx=0x7f1f0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.653+0000 7f1f19f81700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f1f0006cd80 0x7f1f0006f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.654+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== osd.7 v2:172.21.15.144:6801/86602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1f0006f860 con 0x7f1f0006cd80 2023-10-08T16:16:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.666+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 --> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1f14063e80 con 0x7f1f0006cd80 2023-10-08T16:16:57.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f117fa700 1 -- 172.21.15.60:0/1966312181 <== osd.7 v2:172.21.15.144:6801/86602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f1f14063e80 con 0x7f1f0006cd80 2023-10-08T16:16:57.667 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T16:16:57.667 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T16:16:57.668 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T16:16:57.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f1f0006cd80 msgr2=0x7f1f0006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f1b9e4700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.144:6801/86602,v1:172.21.15.144:6804/86602] conn(0x7f1f0006cd80 0x7f1f0006f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f00066f30 msgr2=0x7f1f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f1b9e4700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f1f00066f30 0x7f1f000693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1f14153ba0 tx=0x7f1f0c008040 comp rx=0 tx=0).stop 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f14156210 msgr2=0x7f1f14165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f1b9e4700 1 --2- 172.21.15.60:0/1966312181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f14156210 0x7f1f14165de0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c7e0 tx=0x7f1f08007df0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.667+0000 7f1f19f81700 1 -- 172.21.15.60:0/1966312181 reap_dead start 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.668+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 shutdown_connections 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.668+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 >> 172.21.15.60:0/1966312181 conn(0x7f1f140cd450 msgr2=0x7f1f140b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.668+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 shutdown_connections 2023-10-08T16:16:57.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.668+0000 7f1f1b9e4700 1 -- 172.21.15.60:0/1966312181 wait complete. 2023-10-08T16:16:57.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T16:16:57.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.799+0000 7f6e1ff5a700 1 Processor -- start 2023-10-08T16:16:57.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.799+0000 7f6e1ff5a700 1 -- start start 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1ff5a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e18159e10 0x7f6e180b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1ff5a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e1815a1e0 0x7f6e180b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1ff5a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1815db80 con 0x7f6e180b1610 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1ff5a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1815e800 con 0x7f6e1815a1e0 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1ff5a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1815de60 con 0x7f6e18159e10 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e1815a1e0 0x7f6e180b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1e4f7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e180b1610 0x7f6e180cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56586/0 (socket says 172.21.15.60:56586) 2023-10-08T16:16:57.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e1815a1e0 0x7f6e180b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42048/0 (socket says 172.21.15.60:42048) 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1e4f7700 1 -- 172.21.15.60:0/3983391085 learned_addr learned my addr 172.21.15.60:0/3983391085 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1dcf6700 1 --2- 172.21.15.60:0/3983391085 >> v2:172.21.15.144:3300/0 conn(0x7f6e18159e10 0x7f6e180b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 -- 172.21.15.60:0/3983391085 >> v2:172.21.15.144:3300/0 conn(0x7f6e18159e10 msgr2=0x7f6e180b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 --2- 172.21.15.60:0/3983391085 >> v2:172.21.15.144:3300/0 conn(0x7f6e18159e10 0x7f6e180b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 -- 172.21.15.60:0/3983391085 >> v1:172.21.15.60:6789/0 conn(0x7f6e180b1610 legacy=0x7f6e180cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 -- 172.21.15.60:0/3983391085 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1815e140 con 0x7f6e1815a1e0 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1ccf4700 1 -- 172.21.15.60:0/3983391085 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972641334 0 0) 0x7f6e1815db80 con 0x7f6e180b1610 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.800+0000 7f6e1d4f5700 1 --2- 172.21.15.60:0/3983391085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180b3260 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f6e18068a60 tx=0x7f6e0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10560cf0417f216e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ccf4700 1 -- 172.21.15.60:0/3983391085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c011630 con 0x7f6e1815a1e0 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ccf4700 1 -- 172.21.15.60:0/3983391085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c011790 con 0x7f6e1815a1e0 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ccf4700 1 -- 172.21.15.60:0/3983391085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c011b30 con 0x7f6e1815a1e0 2023-10-08T16:16:57.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/3983391085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 msgr2=0x7f6e180b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/3983391085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180b3260 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f6e18068a60 tx=0x7f6e0c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/3983391085 shutdown_connections 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/3983391085 >> v2:172.21.15.144:3300/0 conn(0x7f6e18159e10 0x7f6e180b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/3983391085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180b3260 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/3983391085 >> 172.21.15.60:0/3983391085 conn(0x7f6e18067660 msgr2=0x7f6e18067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/3983391085 shutdown_connections 2023-10-08T16:16:57.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.801+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/3983391085 wait complete. 2023-10-08T16:16:57.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.802+0000 7f6e1ff5a700 1 Processor -- start 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.802+0000 7f6e1ff5a700 1 -- start start 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1ff5a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e180b1610 0x7f6e1814a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1ff5a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e18159e10 0x7f6e180c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1ff5a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1ff5a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1814a730 con 0x7f6e1815a1e0 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1ff5a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1816b4c0 con 0x7f6e18159e10 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1ff5a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180ce870 con 0x7f6e180b1610 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42050/0 (socket says 172.21.15.60:42050) 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 -- 172.21.15.60:0/1356723218 learned_addr learned my addr 172.21.15.60:0/1356723218 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1dcf6700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e180b1610 0x7f6e1814a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1d4f5700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e18159e10 0x7f6e180c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 -- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e180b1610 msgr2=0x7f6e1814a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e180b1610 0x7f6e1814a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 -- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e18159e10 msgr2=0x7f6e180c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e18159e10 0x7f6e180c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1e4f7700 1 -- 172.21.15.60:0/1356723218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009420 con 0x7f6e1815a1e0 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1dcf6700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e180b1610 0x7f6e1814a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.803+0000 7f6e1d4f5700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e18159e10 0x7f6e180c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.804+0000 7f6e1e4f7700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180c5f10 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c7e0 tx=0x7f6e10007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.804+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10005c00 con 0x7f6e1815a1e0 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.804+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10005d60 con 0x7f6e1815a1e0 2023-10-08T16:16:57.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.804+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e180cf6d0 con 0x7f6e1815a1e0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.804+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10004a80 con 0x7f6e1815a1e0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.804+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e180ceda0 con 0x7f6e1815a1e0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.805+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1804c3c0 con 0x7f6e1815a1e0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.805+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e10005030 con 0x7f6e1815a1e0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.806+0000 7f6e15ffb700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e04066f30 0x7f6e040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.806+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6e100836a0 con 0x7f6e1815a1e0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.806+0000 7f6e1dcf6700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e04066f30 0x7f6e040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:57.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.806+0000 7f6e1dcf6700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e04066f30 0x7f6e040693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6e080094d0 tx=0x7f6e0800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:57.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:57.810+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e1004b5a0 con 0x7f6e1815a1e0 2023-10-08T16:16:58.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.001+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e1815e420 con 0x7f6e04066f30 2023-10-08T16:16:58.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.001+0000 7f6e15ffb700 1 -- 172.21.15.60:0/1356723218 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6e1815e420 con 0x7f6e04066f30 2023-10-08T16:16:58.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e04066f30 msgr2=0x7f6e040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e04066f30 0x7f6e040693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6e080094d0 tx=0x7f6e0800b040 comp rx=0 tx=0).stop 2023-10-08T16:16:58.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 msgr2=0x7f6e180c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180c5f10 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c7e0 tx=0x7f6e10007d90 comp rx=0 tx=0).stop 2023-10-08T16:16:58.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 shutdown_connections 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f6e04066f30 0x7f6e040693e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e180b1610 0x7f6e1814a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1815a1e0 0x7f6e180c5f10 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.003+0000 7f6e1ff5a700 1 --2- 172.21.15.60:0/1356723218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e18159e10 0x7f6e180c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.004+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 >> 172.21.15.60:0/1356723218 conn(0x7f6e18067660 msgr2=0x7f6e181592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.004+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 shutdown_connections 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.004+0000 7f6e1ff5a700 1 -- 172.21.15.60:0/1356723218 wait complete. 2023-10-08T16:16:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T16:16:58.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:16:58.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.134+0000 7f74cfcc5700 1 Processor -- start 2023-10-08T16:16:58.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.134+0000 7f74cfcc5700 1 -- start start 2023-10-08T16:16:58.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cfcc5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c815a0c0 0x7f74c815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:58.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cfcc5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c80cca20 con 0x7f74c8159cf0 2023-10-08T16:16:58.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cfcc5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c815ea40 con 0x7f74c80cf1c0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cfcc5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8067660 con 0x7f74c815a0c0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cda61700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f74c8159cf0 0x7f74c80ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56588/0 (socket says 172.21.15.60:56588) 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cda61700 1 -- 172.21.15.60:0/2426983629 learned_addr learned my addr 172.21.15.60:0/2426983629 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74ce262700 1 --2- 172.21.15.60:0/2426983629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c815a0c0 0x7f74c815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46894055 0 0) 0x7f74c80cca20 con 0x7f74c8159cf0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.135+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b0003570 con 0x7f74c8159cf0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322702609 0 0) 0x7f74bc001110 con 0x7f74c80cf1c0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c80cca20 con 0x7f74c80cf1c0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74ce262700 1 -- 172.21.15.60:0/2426983629 >> v1:172.21.15.144:6789/0 conn(0x7f74c80cf1c0 legacy=0x7f74c8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74ce262700 1 -- 172.21.15.60:0/2426983629 >> v1:172.21.15.60:6789/0 conn(0x7f74c8159cf0 legacy=0x7f74c80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894805566 0 0) 0x7f74b0003570 con 0x7f74c8159cf0 2023-10-08T16:16:58.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74ce262700 1 -- 172.21.15.60:0/2426983629 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8067f00 con 0x7f74c815a0c0 2023-10-08T16:16:58.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74ce262700 1 --2- 172.21.15.60:0/2426983629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c815a0c0 0x7f74c815e500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009910 tx=0x7f74b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7cc4bc2ac0738f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:58.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00017f0 con 0x7f74c815a0c0 2023-10-08T16:16:58.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8011420 con 0x7f74c815a0c0 2023-10-08T16:16:58.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.136+0000 7f74cca5f700 1 -- 172.21.15.60:0/2426983629 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80117c0 con 0x7f74c815a0c0 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 -- 172.21.15.60:0/2426983629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c815a0c0 msgr2=0x7f74c815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/2426983629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c815a0c0 0x7f74c815e500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009910 tx=0x7f74b80091a0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 -- 172.21.15.60:0/2426983629 shutdown_connections 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/2426983629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c815a0c0 0x7f74c815e500 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 -- 172.21.15.60:0/2426983629 >> 172.21.15.60:0/2426983629 conn(0x7f74c806c6e0 msgr2=0x7f74c8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 -- 172.21.15.60:0/2426983629 shutdown_connections 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.137+0000 7f74cfcc5700 1 -- 172.21.15.60:0/2426983629 wait complete. 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.138+0000 7f74cfcc5700 1 Processor -- start 2023-10-08T16:16:58.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.138+0000 7f74cfcc5700 1 -- start start 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.138+0000 7f74cfcc5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c80cf1c0 0x7f74c80c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cfcc5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c8159cf0 0x7f74c80b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cfcc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 0x7f74c80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cfcc5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80b48d0 con 0x7f74c815a0c0 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cfcc5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80b3ae0 con 0x7f74c80cf1c0 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cfcc5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80b3d50 con 0x7f74c8159cf0 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 0x7f74c80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 0x7f74c80b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42062/0 (socket says 172.21.15.60:42062) 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 -- 172.21.15.60:0/3572078632 learned_addr learned my addr 172.21.15.60:0/3572078632 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cda61700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c80cf1c0 0x7f74c80c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:58.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cd260700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c8159cf0 0x7f74c80b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 -- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c8159cf0 msgr2=0x7f74c80b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c8159cf0 0x7f74c80b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 -- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c80cf1c0 msgr2=0x7f74c80c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c80cf1c0 0x7f74c80c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 -- 172.21.15.60:0/3572078632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009420 con 0x7f74c815a0c0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74ce262700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 0x7f74c80b35a0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f74b80030c0 tx=0x7f74b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b801cd10 con 0x7f74c815a0c0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b801ce70 con 0x7f74c815a0c0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80b4030 con 0x7f74c815a0c0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.139+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b801a660 con 0x7f74c815a0c0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.140+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80b45f0 con 0x7f74c815a0c0 2023-10-08T16:16:58.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.140+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c804c3c0 con 0x7f74c815a0c0 2023-10-08T16:16:58.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.141+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74b801aa50 con 0x7f74c815a0c0 2023-10-08T16:16:58.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.141+0000 7f74c5ffb700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74b4066f30 0x7f74b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:16:58.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.142+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f74b8085f60 con 0x7f74c815a0c0 2023-10-08T16:16:58.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.142+0000 7f74cda61700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74b4066f30 0x7f74b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:16:58.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.142+0000 7f74cda61700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74b4066f30 0x7f74b40693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f74c0001920 tx=0x7f74c0000f40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:16:58.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.146+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74b8053430 con 0x7f74c815a0c0 2023-10-08T16:16:58.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.334+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74c80ce730 con 0x7f74b4066f30 2023-10-08T16:16:58.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.337+0000 7f74c5ffb700 1 -- 172.21.15.60:0/3572078632 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50075 (secure 0 0 0) 0x7f74c80ce730 con 0x7f74b4066f30 2023-10-08T16:16:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74b4066f30 msgr2=0x7f74b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74b4066f30 0x7f74b40693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f74c0001920 tx=0x7f74c0000f40 comp rx=0 tx=0).stop 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 msgr2=0x7f74c80b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 0x7f74c80b35a0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f74b80030c0 tx=0x7f74b8016000 comp rx=0 tx=0).stop 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 shutdown_connections 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f74b4066f30 0x7f74b40693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74c815a0c0 0x7f74c80b35a0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c80cf1c0 0x7f74c80c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 --2- 172.21.15.60:0/3572078632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f74c8159cf0 0x7f74c80b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:16:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 >> 172.21.15.60:0/3572078632 conn(0x7f74c806c6e0 msgr2=0x7f74c8155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:16:58.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 shutdown_connections 2023-10-08T16:16:58.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:16:58.339+0000 7f74cfcc5700 1 -- 172.21.15.60:0/3572078632 wait complete. 2023-10-08T16:16:58.341 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:16:58.351 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2023-10-08T16:16:57.718389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553138,"statfs":{"total":1600000000,"available":1590413600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.301060"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":314,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T16:16:48.421034+0000","last_change":"2023-10-08T16:04:51.117308+0000","last_active":"2023-10-08T16:16:48.421034+0000","last_peered":"2023-10-08T16:16:48.421034+0000","last_clean":"2023-10-08T16:16:48.421034+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:48.421034+0000","last_undegraded":"2023-10-08T16:16:48.421034+0000","last_fullsized":"2023-10-08T16:16:48.421034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:49.916317+0000","last_clean_scrub_stamp":"2023-10-08T16:04:49.916317+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:11.506872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78400000000000003},"last":0.502}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.54800000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.871,"15min":1.0089999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.45600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83599999999999997,"15min":1.79},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.25700000000000001},"max":{"1min":0.60599999999999998,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.40999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.59399999999999997,"15min":0.51800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78300000000000003,"5min":11.891,"15min":11.891},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.61699999999999999,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77000000000000002,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":1.252},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79400000000000004,"15min":1.135},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.69499999999999995,"5min":0.78300000000000003,"15min":1.169},"last":0.629}]},{"osd":1,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.83499999999999996,"15min":3.738},"last":0.496},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.48599999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":3.6549999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.53100000000000003},"min":{"1min":0.42699999999999999,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":0.755,"15min":1.103},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.80400000000000005,"15min":1.0920000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":3.516},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":1.502},"last":0.64800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.76900000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.753,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":0.752,"15min":0.92000000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":1.0089999999999999},"last":0.32000000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79300000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.375,"15min":0.41899999999999998},"min":{"1min":0.23899999999999999,"5min":0.185,"15min":0.182},"max":{"1min":0.50600000000000001,"5min":0.60499999999999998,"15min":3.593},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.42399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.61599999999999999,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.438,"15min":0.434},"min":{"1min":0.254,"5min":0.254,"15min":0.22900000000000001},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.33200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":3.5630000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70899999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":1.7030000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0149999999999999,"15min":3.532},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.36399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":3.4929999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91100000000000003,"15min":1.095},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.90700000000000003,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.372,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.224,"15min":0.20200000000000001},"max":{"1min":0.61499999999999999,"5min":0.76700000000000002,"15min":1.571},"last":0.246},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.44800000000000001},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":0.64300000000000002,"5min":0.879,"15min":3.044},"last":0.375}]},{"osd":2,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.307,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56599999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59999999999999998,"5min":0.754,"15min":3.1150000000000002},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.35499999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.68300000000000005},"min":{"1min":0.53700000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":3.1589999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.53400000000000003,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.401},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":1.046,"15min":1.4590000000000001},"last":0.503},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.6459999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.38600000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.6919999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.66600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.92200000000000004,"15min":3.665},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":1.01,"15min":3.7160000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83399999999999996,"5min":1.123,"15min":1.5109999999999999},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41099999999999998,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.315}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.746},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45400000000000001,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":1.3260000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28100000000000003},"max":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.372}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77100000000000002,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.876,"15min":0.97499999999999998},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.873,"15min":2.9319999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.31900000000000001},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":1.091},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.622,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.073},"last":0.65000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.33700000000000002},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.253},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38300000000000001,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.216,"15min":0.20899999999999999},"max":{"1min":0.57399999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.67800000000000005},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.39100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.64100000000000001,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.44400000000000001,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.248,"15min":0.23200000000000001},"max":{"1min":0.63600000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.98499999999999999,"15min":1.0640000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.29799999999999999},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.435}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68400000000000005,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.503}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95199999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.66500000000000004},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.39400000000000002},"max":{"1min":0.83499999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":1.141},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":1.149},"last":0.46899999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":7.4749999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56200000000000006,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32100000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":14.6},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":7.556},"last":0.495},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85899999999999999},"last":0.39600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26200000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.79400000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.379}]},{"osd":6,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41899999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.309},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.85799999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.35299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.54800000000000004},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81200000000000006},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.33300000000000002},"max":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.68600000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.86499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.45200000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.89400000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.501}]},{"osd":7,"last update":"Sun Oct 8 16:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.76000000000000001,"15min":0.77800000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82399999999999995},"last":0.54400000000000004}]}]}],"pool_statfs":[]}} 2023-10-08T16:16:58.356 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T16:04:49.916317+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=49, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=16, tm_sec=53, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:16:58.356 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T16:17:04.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:04.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:18.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:17:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.488+0000 7f0d9221c700 1 Processor -- start 2023-10-08T16:17:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.488+0000 7f0d9221c700 1 -- start start 2023-10-08T16:17:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.489+0000 7f0d9221c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 0x7f0d8c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.489+0000 7f0d9221c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 0x7f0d8c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.489+0000 7f0d9221c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c15c360 con 0x7f0d8c157ba0 2023-10-08T16:17:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.489+0000 7f0d9221c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c15b790 con 0x7f0d8c1577d0 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.489+0000 7f0d9221c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c15ba30 con 0x7f0d8c06ac30 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8b7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 0x7f0d8c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 0x7f0d8c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8affd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0d8c157ba0 0x7f0d8c06a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.60:50890/0 (socket says 172.21.15.60:50890) 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8b7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 0x7f0d8c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.60:33442/0 (socket says 172.21.15.60:33442) 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8affd700 1 -- 172.21.15.60:0/3463355234 learned_addr learned my addr 172.21.15.60:0/3463355234 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 0x7f0d8c15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.60:48454/0 (socket says 172.21.15.60:48454) 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8a7fc700 1 -- 172.21.15.60:0/3463355234 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922814466 0 0) 0x7f0d8c15c360 con 0x7f0d8c157ba0 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 -- 172.21.15.60:0/3463355234 >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 msgr2=0x7f0d8c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 --2- 172.21.15.60:0/3463355234 >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 0x7f0d8c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 -- 172.21.15.60:0/3463355234 >> v1:172.21.15.144:6789/0 conn(0x7f0d8c157ba0 legacy=0x7f0d8c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 -- 172.21.15.60:0/3463355234 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c15bd10 con 0x7f0d8c06ac30 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8b7fe700 1 --2- 172.21.15.60:0/3463355234 >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 0x7f0d8c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.490+0000 7f0d8bfff700 1 --2- 172.21.15.60:0/3463355234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 0x7f0d8c15c7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009e60 tx=0x7f0d84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389320b3a4444d5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d8a7fc700 1 -- 172.21.15.60:0/3463355234 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400e070 con 0x7f0d8c06ac30 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d8a7fc700 1 -- 172.21.15.60:0/3463355234 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400bb60 con 0x7f0d8c06ac30 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d8a7fc700 1 -- 172.21.15.60:0/3463355234 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84012430 con 0x7f0d8c06ac30 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 -- 172.21.15.60:0/3463355234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 msgr2=0x7f0d8c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 --2- 172.21.15.60:0/3463355234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 0x7f0d8c15c7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009e60 tx=0x7f0d84009780 comp rx=0 tx=0).stop 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 -- 172.21.15.60:0/3463355234 shutdown_connections 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 --2- 172.21.15.60:0/3463355234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c06ac30 0x7f0d8c15c7f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 --2- 172.21.15.60:0/3463355234 >> v2:172.21.15.144:3300/0 conn(0x7f0d8c1577d0 0x7f0d8c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 -- 172.21.15.60:0/3463355234 >> 172.21.15.60:0/3463355234 conn(0x7f0d8c068ce0 msgr2=0x7f0d8c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:17:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 -- 172.21.15.60:0/3463355234 shutdown_connections 2023-10-08T16:17:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.491+0000 7f0d9221c700 1 -- 172.21.15.60:0/3463355234 wait complete. 2023-10-08T16:17:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.492+0000 7f0d9221c700 1 Processor -- start 2023-10-08T16:17:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.492+0000 7f0d9221c700 1 -- start start 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d9221c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 0x7f0d8c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d9221c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8c1577d0 0x7f0d8c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d9221c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c157ba0 0x7f0d8c0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d9221c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c6850 con 0x7f0d8c06ac30 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d9221c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0cd9b0 con 0x7f0d8c1577d0 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d9221c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c5c40 con 0x7f0d8c157ba0 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d8b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 0x7f0d8c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d8b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 0x7f0d8c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39348/0 (socket says 172.21.15.60:39348) 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.493+0000 7f0d8b7fe700 1 -- 172.21.15.60:0/896750777 learned_addr learned my addr 172.21.15.60:0/896750777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8affd700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8c1577d0 0x7f0d8c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8bfff700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c157ba0 0x7f0d8c0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8b7fe700 1 -- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c157ba0 msgr2=0x7f0d8c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8b7fe700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c157ba0 0x7f0d8c0d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8b7fe700 1 -- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8c1577d0 msgr2=0x7f0d8c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8b7fe700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8c1577d0 0x7f0d8c15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8b7fe700 1 -- 172.21.15.60:0/896750777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009420 con 0x7f0d8c06ac30 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d8b7fe700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 0x7f0d8c0cd470 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00ec80 tx=0x7f0d7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00c850 con 0x7f0d8c06ac30 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84009a20 con 0x7f0d8c06ac30 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00c9b0 con 0x7f0d8c06ac30 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00cd30 con 0x7f0d8c06ac30 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.494+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c0c6200 con 0x7f0d8c06ac30 2023-10-08T16:17:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.495+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c0c6b30 con 0x7f0d8c06ac30 2023-10-08T16:17:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.496+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d7c013680 con 0x7f0d8c06ac30 2023-10-08T16:17:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.496+0000 7f0d737fe700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0d78066f30 0x7f0d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.496+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0d7c0845d0 con 0x7f0d8c06ac30 2023-10-08T16:17:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.496+0000 7f0d8affd700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0d78066f30 0x7f0d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.496+0000 7f0d8affd700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0d78066f30 0x7f0d780693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0cf630 tx=0x7f0d80007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.500+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d7c0555d0 con 0x7f0d8c06ac30 2023-10-08T16:17:18.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.690+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 --> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d8c0c6990 con 0x7f0d78066f30 2023-10-08T16:17:18.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.692+0000 7f0d737fe700 1 -- 172.21.15.60:0/896750777 <== mgr.4110 v2:172.21.15.60:6832/86121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50125 (secure 0 0 0) 0x7f0d800058a0 con 0x7f0d78066f30 2023-10-08T16:17:18.693 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:17:18.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0d78066f30 msgr2=0x7f0d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0d78066f30 0x7f0d780693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0cf630 tx=0x7f0d80007f50 comp rx=0 tx=0).stop 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 msgr2=0x7f0d8c0cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 0x7f0d8c0cd470 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00ec80 tx=0x7f0d7c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 shutdown_connections 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f0d78066f30 0x7f0d780693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8c157ba0 0x7f0d8c0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c06ac30 0x7f0d8c0cd470 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 --2- 172.21.15.60:0/896750777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8c1577d0 0x7f0d8c15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 >> 172.21.15.60:0/896750777 conn(0x7f0d8c068ce0 msgr2=0x7f0d8c156350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 shutdown_connections 2023-10-08T16:17:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.694+0000 7f0d9221c700 1 -- 172.21.15.60:0/896750777 wait complete. 2023-10-08T16:17:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-08T16:17:18.706 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2023-10-08T16:17:17.722426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553138,"statfs":{"total":1600000000,"available":1590413600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002379"},"pg_stats":[{"pgid":"1.0","version":"187'119","reported_seq":327,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-10-08T16:16:58.315224+0000","last_change":"2023-10-08T16:16:58.315196+0000","last_active":"2023-10-08T16:16:58.315224+0000","last_peered":"2023-10-08T16:16:58.315224+0000","last_clean":"2023-10-08T16:16:58.315224+0000","last_became_active":"2023-10-08T16:04:51.116678+0000","last_became_peered":"2023-10-08T16:04:51.116678+0000","last_unstale":"2023-10-08T16:16:58.315224+0000","last_undegraded":"2023-10-08T16:16:58.315224+0000","last_fullsized":"2023-10-08T16:16:58.315224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"187'119","last_scrub_stamp":"2023-10-08T16:16:58.315137+0000","last_deep_scrub":"187'119","last_deep_scrub_stamp":"2023-10-08T16:16:58.315137+0000","last_clean_scrub_stamp":"2023-10-08T16:16:58.315137+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:14.012020+0000","scrub_duration":0.002662668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.83499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.78400000000000003},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.30499999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.83099999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70299999999999996,"5min":0.85299999999999998,"15min":1.6919999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.77700000000000002,"15min":1.0780000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40000000000000002,"5min":0.33300000000000002,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":1.756},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.871,"15min":1.0089999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.45600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83599999999999997,"15min":1.79},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.25700000000000001},"max":{"1min":0.60599999999999998,"5min":0.81000000000000005,"15min":1.1919999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":1.8620000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.59399999999999997,"15min":0.51800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78300000000000003,"5min":11.891,"15min":11.891},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.61699999999999999,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77000000000000002,"5min":11.907999999999999,"15min":11.907999999999999},"last":0.502}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.436},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":1.252},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56000000000000005,"15min":0.53500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69199999999999995,"5min":0.79400000000000004,"15min":1.135},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58499999999999996,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.78300000000000003,"15min":1.169},"last":0.61199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59299999999999997,"15min":0.57399999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74199999999999999,"5min":0.83499999999999996,"15min":3.738},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.28999999999999998},"max":{"1min":0.73399999999999999,"5min":0.83099999999999996,"15min":3.6549999999999998},"last":0.45400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.66100000000000003,"5min":0.755,"15min":1.103},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.80400000000000005,"15min":1.0920000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.73699999999999999,"15min":3.516},"last":0.504},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.78700000000000003,"15min":1.502},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44,"15min":0.439},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.249},"max":{"1min":0.60999999999999999,"5min":0.68000000000000005,"15min":0.76900000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.84299999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.752,"15min":0.92000000000000004},"last":0.379},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":1.0089999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.48199999999999998},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.28499999999999998},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.79300000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39800000000000002},"max":{"1min":0.81599999999999995,"5min":0.85799999999999998,"15min":0.90600000000000003},"last":0.51700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.375,"15min":0.41899999999999998},"min":{"1min":0.23899999999999999,"5min":0.185,"15min":0.182},"max":{"1min":0.50600000000000001,"5min":0.60499999999999998,"15min":3.593},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68000000000000005,"15min":0.76000000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.42399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":0.64900000000000002,"15min":3.6259999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.61599999999999999,"5min":0.76200000000000001,"15min":0.80200000000000005},"last":0.40100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.438,"15min":0.434},"min":{"1min":0.254,"5min":0.254,"15min":0.22900000000000001},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.80400000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":0.67000000000000004,"15min":1.1100000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.32700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":3.5630000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.35099999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70199999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":1.7030000000000001},"last":0.626},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0149999999999999,"15min":3.532},"last":0.66300000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.97699999999999998,"15min":1.6699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.36399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":3.4929999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.91100000000000003,"15min":1.095},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":0.90700000000000003,"5min":0.94399999999999995,"15min":1.6279999999999999},"last":0.58099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38,"15min":0.371},"min":{"1min":0.22,"5min":0.22,"15min":0.20200000000000001},"max":{"1min":0.54100000000000004,"5min":0.76700000000000002,"15min":1.571},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.442},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.879,"15min":3.044},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":1.6080000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46600000000000003,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69499999999999995,"5min":0.754,"15min":3.1150000000000002},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40500000000000003,"15min":0.38400000000000001},"min":{"1min":0.22800000000000001,"5min":0.222,"15min":0.218},"max":{"1min":0.53400000000000003,"5min":0.63100000000000001,"15min":0.86399999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.32500000000000001,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.67700000000000005,"5min":0.79100000000000004,"15min":1.7490000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66400000000000003,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.96699999999999997,"5min":1.095,"15min":3.1589999999999998},"last":0.871},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.65700000000000003},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":1.401},"last":0.745}]},{"osd":5,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.36399999999999999},"max":{"1min":0.92800000000000005,"5min":1.046,"15min":1.4590000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":1.6459999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.38600000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.6919999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92200000000000004,"15min":3.665},"last":0.76100000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40400000000000003},"max":{"1min":0.96199999999999997,"5min":1.01,"15min":3.7160000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.65000000000000002,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89600000000000002,"5min":1.123,"15min":1.5109999999999999},"last":0.83899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41099999999999998,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":2.7109999999999999},"last":0.377}]},{"osd":1,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.746},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45400000000000001,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":1.3260000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28100000000000003},"max":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":1.2549999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77100000000000002,"5min":0.86599999999999999,"15min":2.8980000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.624,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":0.876,"15min":0.97499999999999998},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.89800000000000002,"15min":1.0700000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.873,"15min":2.9319999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.31900000000000001},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":1.091},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":0.93200000000000005,"15min":0.98599999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.622,"15min":0.64400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.89900000000000002,"15min":3.0030000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.073},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.373,"15min":0.34300000000000003},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19900000000000001},"max":{"1min":0.53400000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.378},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.222},"max":{"1min":0.58799999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.35099999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.218,"15min":0.20899999999999999},"max":{"1min":0.55400000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.434,"15min":0.40100000000000002},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.67800000000000005},"last":0.44}]},{"osd":2,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.39500000000000002},"min":{"1min":0.317,"5min":0.23599999999999999,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":0.67100000000000004,"15min":0.67200000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45200000000000001,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.23200000000000001},"max":{"1min":0.626,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64300000000000002,"15min":0.60899999999999999},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.89700000000000002,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.81799999999999995,"5min":0.98499999999999999,"15min":1.0640000000000001},"last":0.81599999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.89700000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65700000000000003,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.85999999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.65000000000000002},"min":{"1min":0.45900000000000002,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.86899999999999999,"5min":1.05,"15min":1.05},"last":0.83099999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.35099999999999998},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69299999999999995,"15min":0.66700000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.39400000000000002},"max":{"1min":0.95299999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.29599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":1.141},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":1.149},"last":0.51400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":7.4749999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.81100000000000005,"15min":3.8730000000000002},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.374,"15min":0.33200000000000002},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.95999999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56200000000000006,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.32100000000000001},"max":{"1min":0.71799999999999997,"5min":0.82899999999999996,"15min":14.6},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.33300000000000002},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":7.556},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.36599999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85899999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26200000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.79400000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.23699999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.502}]},{"osd":6,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.309},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.85799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.32500000000000001,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63300000000000001,"5min":0.77200000000000002,"15min":0.91600000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.31},"max":{"1min":0.751,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.314,"5min":0.31,"15min":0.31},"max":{"1min":0.68700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.76700000000000002,"15min":0.81200000000000006},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.37},{"interface":"front","average":{"1min":0.627,"5min":0.623,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.90400000000000003},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.86499999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.75800000000000001,"15min":0.81699999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.80600000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.29199999999999998},"max":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.77700000000000002},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.89400000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.41099999999999998,"5min":0.33600000000000002,"15min":0.26500000000000001},"max":{"1min":0.80000000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.62}]},{"osd":7,"last update":"Sun Oct 8 16:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.30299999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.45400000000000001,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55300000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T16:17:18.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T16:17:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.827+0000 7fa8f65f4700 1 Processor -- start 2023-10-08T16:17:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.827+0000 7fa8f65f4700 1 -- start start 2023-10-08T16:17:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8f65f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8f65f4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f015ea90 con 0x7fa8f0159e60 2023-10-08T16:17:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8f65f4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f00b3100 con 0x7fa8f015a230 2023-10-08T16:17:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8f65f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00d1cf0 con 0x7fa8f00697c0 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8effff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8f0159e60 0x7fa8f00690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60518/0 (socket says 172.21.15.60:60518) 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8effff700 1 -- 172.21.15.60:0/3578562866 learned_addr learned my addr 172.21.15.60:0/3578562866 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.828+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/3578562866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8eeffd700 1 -- 172.21.15.60:0/3578562866 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499575710 0 0) 0x7fa8f015ea90 con 0x7fa8f0159e60 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8eeffd700 1 -- 172.21.15.60:0/3578562866 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d8003570 con 0x7fa8f0159e60 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/3578562866 >> v1:172.21.15.144:6789/0 conn(0x7fa8f015a230 legacy=0x7fa8f00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/3578562866 >> v1:172.21.15.60:6789/0 conn(0x7fa8f0159e60 legacy=0x7fa8f00690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8eeffd700 1 -- 172.21.15.60:0/3578562866 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032113863 0 0) 0x7fa8f00b3100 con 0x7fa8f015a230 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/3578562866 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f00d10e0 con 0x7fa8f00697c0 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/3578562866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f015e550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009910 tx=0x7fa8e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e00790f8a3b4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8eeffd700 1 -- 172.21.15.60:0/3578562866 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400b680 con 0x7fa8f00697c0 2023-10-08T16:17:18.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8eeffd700 1 -- 172.21.15.60:0/3578562866 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e400b7e0 con 0x7fa8f00697c0 2023-10-08T16:17:18.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.829+0000 7fa8eeffd700 1 -- 172.21.15.60:0/3578562866 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400bba0 con 0x7fa8f00697c0 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 -- 172.21.15.60:0/3578562866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 msgr2=0x7fa8f015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/3578562866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f015e550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009910 tx=0x7fa8e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 -- 172.21.15.60:0/3578562866 shutdown_connections 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/3578562866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f015e550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 -- 172.21.15.60:0/3578562866 >> 172.21.15.60:0/3578562866 conn(0x7fa8f0070700 msgr2=0x7fa8f0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 -- 172.21.15.60:0/3578562866 shutdown_connections 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.830+0000 7fa8f65f4700 1 -- 172.21.15.60:0/3578562866 wait complete. 2023-10-08T16:17:18.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.831+0000 7fa8f65f4700 1 Processor -- start 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.831+0000 7fa8f65f4700 1 -- start start 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f00c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 0x7fa8f00c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f015a230 0x7fa8f00c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00cafa0 con 0x7fa8f0159e60 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00ca390 con 0x7fa8f015a230 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00ca670 con 0x7fa8f00697c0 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 0x7fa8f00c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 0x7fa8f00c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39354/0 (socket says 172.21.15.60:39354) 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2781472471 learned_addr learned my addr 172.21.15.60:0/2781472471 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8effff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f00c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f4b91700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f015a230 0x7fa8f00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 msgr2=0x7fa8f00c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f00c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f015a230 msgr2=0x7fa8f00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f015a230 0x7fa8f00c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 -- 172.21.15.60:0/2781472471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4009420 con 0x7fa8f0159e60 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8ef7fe700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 0x7fa8f00c6fc0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0069e20 tx=0x7fa8e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400bb60 con 0x7fa8f0159e60 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f00ca950 con 0x7fa8f0159e60 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4000c90 con 0x7fa8f0159e60 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.832+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4027680 con 0x7fa8f0159e60 2023-10-08T16:17:18.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.833+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f00c7500 con 0x7fa8f0159e60 2023-10-08T16:17:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.833+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f004c3c0 con 0x7fa8f0159e60 2023-10-08T16:17:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.834+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8e401a430 con 0x7fa8f0159e60 2023-10-08T16:17:18.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.834+0000 7fa8d7fff700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8dc066f60 0x7fa8dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.834+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa8e4086050 con 0x7fa8f0159e60 2023-10-08T16:17:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.834+0000 7fa8effff700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8dc066f60 0x7fa8dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:18.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.835+0000 7fa8effff700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8dc066f60 0x7fa8dc069410 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0007fd0 tx=0x7fa8e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:18.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:18.838+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8e40535c0 con 0x7fa8f0159e60 2023-10-08T16:17:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.030+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fa8f00cb590 con 0x7fa8f0159e60 2023-10-08T16:17:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.033+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa8e40092a0 con 0x7fa8f0159e60 2023-10-08T16:17:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.034+0000 7fa8d7fff700 1 -- 172.21.15.60:0/2781472471 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa8e4056be0 con 0x7fa8f0159e60 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8dc066f60 msgr2=0x7fa8dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8dc066f60 0x7fa8dc069410 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0007fd0 tx=0x7fa8e0009040 comp rx=0 tx=0).stop 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 msgr2=0x7fa8f00c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 0x7fa8f00c6fc0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0069e20 tx=0x7fa8e4017000 comp rx=0 tx=0).stop 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 shutdown_connections 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7fa8dc066f60 0x7fa8dc069410 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa8f00697c0 0x7fa8f00c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f015a230 0x7fa8f00c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 --2- 172.21.15.60:0/2781472471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8f0159e60 0x7fa8f00c6fc0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.036+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 >> 172.21.15.60:0/2781472471 conn(0x7fa8f0070700 msgr2=0x7fa8f00d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:17:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.037+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 shutdown_connections 2023-10-08T16:17:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.037+0000 7fa8f65f4700 1 -- 172.21.15.60:0/2781472471 wait complete. 2023-10-08T16:17:19.049 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:17:19.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:17:19.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.168+0000 7f78c1558700 1 Processor -- start 2023-10-08T16:17:19.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.168+0000 7f78c1558700 1 -- start start 2023-10-08T16:17:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78c1558700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78bc1510f0 0x7f78bc06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78c1558700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0ca0b0 con 0x7f78bc0c9af0 2023-10-08T16:17:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78c1558700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc068a10 con 0x7f78bc070700 2023-10-08T16:17:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78c1558700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc068cf0 con 0x7f78bc1510f0 2023-10-08T16:17:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78baffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78bc1510f0 0x7f78bc06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78ba7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f78bc0c9af0 0x7f78bc15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60528/0 (socket says 172.21.15.60:60528) 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78baffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78bc1510f0 0x7f78bc06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39358/0 (socket says 172.21.15.60:39358) 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.169+0000 7f78ba7fc700 1 -- 172.21.15.60:0/2655039840 learned_addr learned my addr 172.21.15.60:0/2655039840 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78baffd700 1 -- 172.21.15.60:0/2655039840 >> v1:172.21.15.144:6789/0 conn(0x7f78bc070700 legacy=0x7f78bc070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78baffd700 1 -- 172.21.15.60:0/2655039840 >> v1:172.21.15.60:6789/0 conn(0x7f78bc0c9af0 legacy=0x7f78bc15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78baffd700 1 -- 172.21.15.60:0/2655039840 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0cb230 con 0x7f78bc1510f0 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78b9ffb700 1 -- 172.21.15.60:0/2655039840 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665248174 0 0) 0x7f78bc0ca0b0 con 0x7f78bc0c9af0 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78baffd700 1 --2- 172.21.15.60:0/2655039840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc06ecc0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009e60 tx=0x7f78ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bee89fd0392b536 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78b9ffb700 1 -- 172.21.15.60:0/2655039840 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00e070 con 0x7f78bc1510f0 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78b9ffb700 1 -- 172.21.15.60:0/2655039840 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78ac00bbf0 con 0x7f78bc1510f0 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78b9ffb700 1 -- 172.21.15.60:0/2655039840 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac012430 con 0x7f78bc1510f0 2023-10-08T16:17:19.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78c1558700 1 -- 172.21.15.60:0/2655039840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 msgr2=0x7f78bc06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78c1558700 1 --2- 172.21.15.60:0/2655039840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc06ecc0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009e60 tx=0x7f78ac009780 comp rx=0 tx=0).stop 2023-10-08T16:17:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.170+0000 7f78c1558700 1 -- 172.21.15.60:0/2655039840 shutdown_connections 2023-10-08T16:17:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.171+0000 7f78c1558700 1 --2- 172.21.15.60:0/2655039840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc06ecc0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.171+0000 7f78c1558700 1 -- 172.21.15.60:0/2655039840 >> 172.21.15.60:0/2655039840 conn(0x7f78bc0ca4f0 msgr2=0x7f78bc0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:17:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.171+0000 7f78c1558700 1 -- 172.21.15.60:0/2655039840 shutdown_connections 2023-10-08T16:17:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.171+0000 7f78c1558700 1 -- 172.21.15.60:0/2655039840 wait complete. 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.172+0000 7f78c1558700 1 Processor -- start 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.172+0000 7f78c1558700 1 -- start start 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78bc070700 0x7f78bc16a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78bc0c9af0 0x7f78bc150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc16e110 con 0x7f78bc1510f0 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc16adf0 con 0x7f78bc070700 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc150b80 con 0x7f78bc0c9af0 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc0b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39360/0 (socket says 172.21.15.60:39360) 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 -- 172.21.15.60:0/3075606605 learned_addr learned my addr 172.21.15.60:0/3075606605 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78baffd700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78bc070700 0x7f78bc16a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78ba7fc700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78bc0c9af0 0x7f78bc150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 -- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78bc0c9af0 msgr2=0x7f78bc150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78bc0c9af0 0x7f78bc150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 -- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78bc070700 msgr2=0x7f78bc16a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78bc070700 0x7f78bc16a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 -- 172.21.15.60:0/3075606605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009a20 con 0x7f78bc1510f0 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78bb7fe700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc0b2260 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f78b400b5e0 tx=0x7f78b4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400f510 con 0x7f78bc1510f0 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78b400f670 con 0x7f78bc1510f0 2023-10-08T16:17:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc0b27a0 con 0x7f78bc1510f0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.173+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400fa50 con 0x7f78bc1510f0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.174+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc16b330 con 0x7f78bc1510f0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.175+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc16e2c0 con 0x7f78bc1510f0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.175+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78b401a400 con 0x7f78bc1510f0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.175+0000 7f78b2ffd700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f789c066f30 0x7f789c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.175+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f78b4083b80 con 0x7f78bc1510f0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.175+0000 7f78baffd700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f789c066f30 0x7f789c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:17:19.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.176+0000 7f78baffd700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f789c066f30 0x7f789c0693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f78bc154d60 tx=0x7f78ac009780 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:17:19.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.179+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78bc16e2c0 con 0x7f78bc1510f0 2023-10-08T16:17:19.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.416+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78bc04c3c0 con 0x7f78bc1510f0 2023-10-08T16:17:19.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.417+0000 7f78b2ffd700 1 -- 172.21.15.60:0/3075606605 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f78b4051250 con 0x7f78bc1510f0 2023-10-08T16:17:19.417 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T16:17:19.417 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2207223337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":2207223337},{"type":"v1","addr":"172.21.15.60:6837","nonce":2207223337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1056675208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":1056675208},{"type":"v1","addr":"172.21.15.144:6835","nonce":1056675208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":7495,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1715362215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1715362215},{"type":"v1","addr":"172.21.15.144:6834","nonce":1715362215}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/788327488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":788327488},{"type":"v1","addr":"172.21.15.60:6836","nonce":788327488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[]} 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f789c066f30 msgr2=0x7f789c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f789c066f30 0x7f789c0693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f78bc154d60 tx=0x7f78ac009780 comp rx=0 tx=0).stop 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 msgr2=0x7f78bc0b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc0b2260 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f78b400b5e0 tx=0x7f78b4009060 comp rx=0 tx=0).stop 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 shutdown_connections 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:6832/86121,v1:172.21.15.60:6833/86121] conn(0x7f789c066f30 0x7f789c0693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc1510f0 0x7f78bc0b2260 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78bc070700 0x7f78bc16a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 --2- 172.21.15.60:0/3075606605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78bc0c9af0 0x7f78bc150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:17:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 >> 172.21.15.60:0/3075606605 conn(0x7f78bc0ca4f0 msgr2=0x7f78bc0cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:17:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 shutdown_connections 2023-10-08T16:17:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T16:17:19.419+0000 7f78c1558700 1 -- 172.21.15.60:0/3075606605 wait complete. 2023-10-08T16:17:19.421 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 94 2023-10-08T16:17:19.431 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-08T16:17:19.432 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T16:17:19.432 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:17:19.432 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.440 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:17:19.440 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:17:19.441 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.490 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:17:19.490 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:17:19.490 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.501 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:17:19.501 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:17:19.501 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.551 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:17:19.551 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T16:17:19.552 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T16:17:19.552 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.572 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T16:17:19.572 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T16:17:19.572 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.635 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T16:17:19.657 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T16:17:19.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.702 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T16:17:19.702 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T16:17:19.702 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.762 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T16:17:19.762 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T16:17:19.762 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.784 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T16:17:19.784 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T16:17:19.784 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.843 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T16:17:19.844 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T16:17:19.844 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.908 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T16:17:19.909 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T16:17:19.909 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.970 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T16:17:19.970 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T16:17:19.970 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T16:17:19.971 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:19.996 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T16:17:19.996 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T16:17:19.996 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:20.035 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T16:17:20.035 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T16:17:20.035 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T16:17:20.035 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:20.047 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T16:17:20.047 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T16:17:20.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:20.086 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T16:17:20.086 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T16:17:20.086 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:17:20.137 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T16:17:20.137 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T16:17:20.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-08T16:17:20.169 INFO:teuthology.orchestra.run.smithi060.stdout:1696781087.9182277 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 222829.556558 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-08T16:17:20.170 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-08T16:17:20.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-08T16:17:20.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-08T16:17:20.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-08T16:17:20.388 INFO:teuthology.orchestra.run.smithi060.stdout:1696781087.9182277 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 222829.556558 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-08T16:17:20.389 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:17:20.389 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T16:17:20.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:17:20.663 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T16:17:20.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:17:20.786 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T16:17:20.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:17:20.858 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T16:17:20.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:17:20.967 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T16:17:21.106 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:17:21.106 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T16:17:21.194 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:17:21.194 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T16:17:21.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:17:21.261 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T16:17:21.361 INFO:tasks.ceph:Archiving mon data... 2023-10-08T16:17:21.362 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/data/mon.a.tgz 2023-10-08T16:17:21.362 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2023-10-08T16:17:21.381 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.NCC6SHvGDk 2023-10-08T16:17:21.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NCC6SHvGDk 2023-10-08T16:17:21.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.NCC6SHvGDk 2023-10-08T16:17:21.628 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.NCC6SHvGDk is 378KB 2023-10-08T16:17:21.725 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.NCC6SHvGDk 2023-10-08T16:17:21.740 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/data/mon.b.tgz 2023-10-08T16:17:21.740 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-10-08T16:17:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.x9tvZJIjgJ 2023-10-08T16:17:21.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.x9tvZJIjgJ 2023-10-08T16:17:21.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.x9tvZJIjgJ 2023-10-08T16:17:21.983 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.x9tvZJIjgJ is 384KB 2023-10-08T16:17:22.078 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.x9tvZJIjgJ 2023-10-08T16:17:22.092 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/data/mon.c.tgz 2023-10-08T16:17:22.092 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-10-08T16:17:22.146 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.0fK1dLs9Z1 2023-10-08T16:17:22.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0fK1dLs9Z1 2023-10-08T16:17:22.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.0fK1dLs9Z1 2023-10-08T16:17:22.360 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.0fK1dLs9Z1 is 384KB 2023-10-08T16:17:22.456 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.0fK1dLs9Z1 2023-10-08T16:17:22.470 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T16:17:22.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T16:17:22.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T16:17:22.534 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T16:17:22.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T16:17:22.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T16:17:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T16:17:22.599 INFO:teuthology.orchestra.run.smithi144.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T16:17:22.604 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T16:17:22.606 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/remote/smithi060/crash 2023-10-08T16:17:22.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T16:17:22.644 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/remote/smithi144/crash 2023-10-08T16:17:22.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T16:17:22.668 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T16:17:22.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:22.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:22.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:22.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:22.815 INFO:tasks.ceph:Compressing logs... 2023-10-08T16:17:22.815 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T16:17:22.823 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T16:17:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105847.log 2023-10-08T16:17:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110418.log 2023-10-08T16:17:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87481.log 2023-10-08T16:17:22.849 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105847.log.gz 2023-10-08T16:17:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110993.log 2023-10-08T16:17:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92314.log 2023-10-08T16:17:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91962.log 2023-10-08T16:17:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88189.log 2023-10-08T16:17:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86419.log 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91962.log.gz 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89868.log 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86330.log 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88189.log: gzip -5 /var/log/ceph/ceph-client.admin.86419.log: --verbose -- /var/log/ceph/ceph-client.admin.86372.log 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88189.log.gz 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89868.log.gz 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89444.log 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86330.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86419.log.gz 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86372.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86330.log.gz 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89448.log 2023-10-08T16:17:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89444.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86372.log.gz 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89444.log.gz 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86503.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89448.log.gz 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88566.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86503.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86503.log.gz 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86460.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88566.log.gz 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88570.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86460.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86460.log.gz 2023-10-08T16:17:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88570.log.gz 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89026.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90244.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89026.log.gz 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90244.log.gz 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.4.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89022.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91958.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91542.log 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89022.log.gz 2023-10-08T16:17:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91958.log.gz 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91542.log: 0.0% 93.7% -- replaced with /var/log/ceph/ceph-client.1.91542.log.gz -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr: 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87430.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88185.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.87430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91098.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87430.log.gz 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88185.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88185.log.gz 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90248.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91098.log.gz 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86287.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91546.log 2023-10-08T16:17:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90248.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86287.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86287.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91546.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87422.log 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90631.log 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.87422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87422.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90631.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89872.log 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89872.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.6.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T16:17:22.906 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86246.log 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86206.log 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86246.log: /var/log/ceph/ceph-client.admin.86206.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86246.log.gz 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86206.log.gz 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87788.log 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.3.87788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87788.log.gz 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87792.log 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.3.87792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87792.log.gz 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91094.log 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91094.log.gz 2023-10-08T16:17:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T16:17:22.916 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90627.log 2023-10-08T16:17:22.928 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90627.log.gz 2023-10-08T16:17:22.971 INFO:teuthology.orchestra.run.smithi144.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.87481.log: -- /var/log/ceph/ceph-client.2.90624.log 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110993.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110418.log.gz 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92314.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.87481.log.gz--verbose 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.113349.log 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110993.log.gz 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92314.log.gz 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.2.90624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95627.log 2023-10-08T16:17:22.982 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90624.log.gz 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118707.log 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113349.log.gz 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112586.log 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118707.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95627.log.gz 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116330.log 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118707.log.gz 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109500.log 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112586.log.gz 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110808.log 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116330.log.gz 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92111.log 2023-10-08T16:17:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105235.log 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109500.log.gz 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92111.log: gzip -5 89.3%--verbose -- replaced with /var/log/ceph/ceph-client.admin.110808.log.gz-- 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118006.log 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92111.log.gz 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100886.log 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118006.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.105235.log.gz--verbose 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.89127.log 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100886.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118006.log.gz 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102494.log 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89127.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100886.log.gz 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109458.log 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89127.log.gz 2023-10-08T16:17:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100283.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102494.log.gz 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92608.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100283.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109458.log.gz 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114891.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.100283.log.gz 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101783.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92608.log.gz 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93353.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101783.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114891.log.gz 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113393.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101783.log.gz 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103975.log 2023-10-08T16:17:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97457.log 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93353.log.gz 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103975.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113393.log.gz 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92650.log 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97457.log: gzip 88.9%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103975.log.gz/var/log/ceph/ceph-client.admin.103530.log 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92650.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97457.log.gz 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118833.log 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92650.log.gz 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93616.log 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118833.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103530.log.gz 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118581.log 2023-10-08T16:17:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.93616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118833.log.gz 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99874.log 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93616.log.gz 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116768.log 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118581.log.gz 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89253.log 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108665.log 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99874.log.gz 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105933.log 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116768.log.gz 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108665.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89253.log.gz 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109759.log 2023-10-08T16:17:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105933.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108665.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110376.log 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109759.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105933.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98994.log 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109759.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91355.log 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6%/var/log/ceph/ceph-client.0.98994.log: -- replaced with /var/log/ceph/ceph-client.admin.110376.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99035.log 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98994.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113783.log 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2%/var/log/ceph/ceph-client.admin.99035.log: -- replaced with /var/log/ceph/ceph-client.admin.91355.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107927.log 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99035.log.gz 2023-10-08T16:17:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115952.log 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107927.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113783.log.gz 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115101.log 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107927.log.gz/var/log/ceph/ceph-client.admin.115952.log: 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88449.log 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115952.log.gz 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119238.log 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112460.log 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115101.log.gz 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.119238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104880.log 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88449.log.gz 2023-10-08T16:17:22.989 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119238.log.gz 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90959.log 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104880.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112460.log.gz 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94606.log 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90959.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104880.log.gz 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111215.log 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90959.log.gz 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91673.log 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94606.log: /var/log/ceph/ceph-client.admin.111215.log: gzip 89.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.94606.log.gz--verbose 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.109400.log 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91673.log: gzip 87.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.111215.log.gz-- 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91757.log 2023-10-08T16:17:22.990 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91673.log.gz 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109400.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109400.log.gz 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99645.log 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mds.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91757.log.gz 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107302.log 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99645.log.gz 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107176.log 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107302.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100590.log 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107176.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107302.log.gz 2023-10-08T16:17:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91799.log 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107176.log.gz 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96736.log 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100590.log.gz 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103723.log 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96736.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.91799.log.gz--verbose 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.106593.log 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96736.log.gz 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.103723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102306.log 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103723.log.gz 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99393.log 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106593.log.gz 2023-10-08T16:17:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100970.log 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102306.log.gz 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108707.log 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99393.log: /var/log/ceph/ceph-client.admin.100970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92776.log 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99393.log.gz 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108707.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100970.log.gz 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99561.log 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108707.log.gz 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103106.log 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106919.log 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92776.log.gz 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103106.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99561.log.gz 2023-10-08T16:17:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100540.log 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103106.log.gz 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109180.log 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97016.log 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106919.log.gz 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109180.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100540.log.gz 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99077.log 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109180.log.gz 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108455.log 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95371.log 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97016.log.gz 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108455.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99077.log.gz 2023-10-08T16:17:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95003.log 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108455.log.gz 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98689.log 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94690.log 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95371.log.gz 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98689.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95003.log.gz 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89807.log 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98689.log.gz 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86350.log 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88118.log 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94690.log.gz 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.86350.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89807.log.gz 2023-10-08T16:17:22.995 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114681.log 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86350.log.gz 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113437.log 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88118.log: /var/log/ceph/ceph-client.admin.114681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107842.log 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88118.log.gz 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113437.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114681.log.gz 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97314.log 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113437.log.gz 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106531.log 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97314.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.107842.log.gz--verbose 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.118623.log 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106531.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97314.log.gz 2023-10-08T16:17:22.996 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114035.log 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106531.log.gz 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97835.log 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87030.log 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118623.log.gz 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114035.log.gz 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112857.log 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97835.log.gz 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100325.log 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112857.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87030.log.gz 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87286.log 2023-10-08T16:17:22.997 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112857.log.gz 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117964.log 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5%/var/log/ceph/ceph-client.admin.87286.log: -- replaced with /var/log/ceph/ceph-client.admin.100325.log.gz 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113657.log 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115161.log 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87286.log.gz 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113657.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117964.log.gz 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115822.log 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113657.log.gz 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111519.log 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115822.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115161.log.gz 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112418.log 2023-10-08T16:17:22.998 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111519.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115822.log.gz 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89001.log 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111519.log.gz 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103064.log 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89001.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112418.log.gz 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105193.log 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103064.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89001.log.gz 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116684.log 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103064.log.gz 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115288.log 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116684.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105193.log.gz 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111385.log 2023-10-08T16:17:22.999 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116684.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88758.log 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103727.log 89.2% 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115288.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88758.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111385.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87242.log 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.103727.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88758.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89421.log 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103727.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87565.log 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89421.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.87242.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:--verbose -- /var/log/ceph/ceph-client.admin.99309.log 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87565.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89421.log.gz 2023-10-08T16:17:23.000 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91313.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99309.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87565.log.gz 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107428.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99309.log.gz 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108833.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107428.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.91313.log.gz 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107673.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107428.log.gz 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90220.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108833.log.gz 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94346.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.90220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112941.log 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107673.log.gz 2023-10-08T16:17:23.001 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90220.log.gz 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119156.log 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112941.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.94346.log.gz-5 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:--verbose -- /var/log/ceph/ceph-client.admin.87775.log 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.119156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116078.log 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112941.log.gz 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87775.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119156.log.gz 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117796.log 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87775.log.gz 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117418.log 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116078.log.gz 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102077.log 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117796.log.gz 2023-10-08T16:17:23.002 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97668.log 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90791.log 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117418.log.gz 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.102077.log.gz 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108413.log 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97668.log.gz 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106101.log 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114975.log 88.4% 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90791.log.gz 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106101.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108413.log.gz 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99435.log 2023-10-08T16:17:23.003 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114975.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106101.log.gzgzip 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.114077.log 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99435.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114975.log.gz 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86864.log 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114077.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99435.log.gz 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93700.log 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.86864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98351.log 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93700.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.114077.log.gz 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86864.log.gz 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108623.log 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93700.log.gz 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93084.log 2023-10-08T16:17:23.004 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98351.log.gz 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108623.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100802.log 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108623.log.gz 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93084.log.gz 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115246.log 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96546.log 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115246.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100802.log.gz 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105151.log 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115246.log.gz 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92051.log 2023-10-08T16:17:23.005 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96546.log: /var/log/ceph/ceph-client.admin.105151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116120.log 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96546.log.gz 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92051.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105151.log.gz 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94732.log 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92196.log 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116120.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92051.log.gz 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94732.log: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.116120.log.gz 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:--verbose -- /var/log/ceph/ceph-client.admin.113741.log 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94732.log.gz 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108791.log 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92196.log: /var/log/ceph/ceph-client.admin.113741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118875.log 2023-10-08T16:17:23.006 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92196.log.gz 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113741.log.gz 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95711.log 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108791.log.gz 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118791.log 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118875.log.gz 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114423.log 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95711.log.gz 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113993.log 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114423.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.118791.log.gz--verbose 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.102035.log 2023-10-08T16:17:23.007 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113993.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114423.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89631.log 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113993.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112815.log 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102035.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98309.log 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112815.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89631.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93269.log 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112815.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116246.log 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97415.log 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98309.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116246.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93269.log.gz 2023-10-08T16:17:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99603.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116246.log.gz 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88757.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99603.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97415.log.gz 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87114.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88757.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99603.log.gz 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106017.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88757.log.gz 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103321.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106017.log: gzip 88.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.87114.log.gz-- /var/log/ceph/ceph-client.admin.111627.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103321.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106017.log.gz 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87733.log 2023-10-08T16:17:23.009 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103321.log.gz 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95541.log 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87733.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.111627.log.gz--verbose 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.113082.log 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95541.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87733.log.gz 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94564.log 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95541.log.gz 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117544.log 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94564.log: gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.113082.log.gz/var/log/ceph/ceph-client.admin.104922.log 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117544.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94564.log.gz 2023-10-08T16:17:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110040.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117544.log.gz 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118245.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110040.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104922.log.gz 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105297.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.110040.log.gz 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105583.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118245.log.gz 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110586.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116288.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105297.log.gz 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110586.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105583.log.gz 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118539.log 2023-10-08T16:17:23.011 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110586.log.gz 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103022.log 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118539.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.116288.log.gz-5 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:--verbose -- /var/log/ceph/ceph-client.admin.93419.log 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118539.log.gz 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91169.log 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103022.log.gz 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87943.log 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93419.log.gz 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110460.log 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91169.log.gz 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103279.log 2023-10-08T16:17:23.012 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87943.log.gz 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97711.log 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100496.log 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110460.log.gz 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97711.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103279.log.gz 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106756.log 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97711.log.gz 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110082.log 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106756.log: gzip -5 --verbose -- 89.1%/var/log/ceph/ceph-client.admin.103811.log 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100496.log.gz 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110082.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106756.log.gz 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110502.log 2023-10-08T16:17:23.013 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110082.log.gz 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99519.log 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110502.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103811.log.gz 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108067.log 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110502.log.gz 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112376.log 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99519.log.gz 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100124.log 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112376.log: gzip -5 --verbose 87.8%-- /var/log/ceph/ceph-client.admin.92154.log 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108067.log.gz 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100124.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112376.log.gz 2023-10-08T16:17:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116643.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100124.log.gz 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101909.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.116643.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92154.log.gz 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103464.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116643.log.gz 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106059.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101909.log.gz 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91439.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100062.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91439.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106059.log.gz 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.103464.log.gz 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111173.log 2023-10-08T16:17:23.015 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91439.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111301.log 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111173.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100062.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102972.log 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101456.log 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111173.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111301.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104353.log 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102972.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.101456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101460.log 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101456.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106143.log 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.101460.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104353.log.gz 2023-10-08T16:17:23.016 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91001.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101460.log.gz 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108275.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91001.log: gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.106143.log.gz-- 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.audit.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91001.log.gz 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118048.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108275.log.gz 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105109.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110648.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118048.log.gz 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91841.log 2023-10-08T16:17:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 88.7%--verbose -- /var/log/ceph/ceph-client.admin.99958.log -- replaced with /var/log/ceph/ceph-client.admin.105109.log.gz 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110648.log: /var/log/ceph/ceph-client.admin.91841.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110648.log.gz 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114143.log 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105541.log 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99958.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91841.log.gz 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114143.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99958.log.gz 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114485.log 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104982.log 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105541.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114143.log.gz 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T16:17:23.018 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114485.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105541.log.gz 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93883.log 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107260.log 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104982.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114485.log.gz 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89295.log 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104982.log.gz 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93883.log.gz 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88441.log 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89295.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107260.log.gz 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117221.log 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89295.log.gz 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95413.log 2023-10-08T16:17:23.019 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88441.log.gz 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104527.log 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98259.log 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117221.log.gz 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95413.log.gz 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101825.log 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104527.log.gz 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109717.log 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101825.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.98259.log.gz 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.109633.log 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101825.log.gz 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92692.log 2023-10-08T16:17:23.020 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109717.log.gz 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102556.log 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92692.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.109633.log.gz--verbose 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.94834.log 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92692.log.gz 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93042.log 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94834.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102556.log.gz 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94919.log 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93042.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94834.log.gz 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89169.log 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94919.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93042.log.gz 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92734.log 2023-10-08T16:17:23.021 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94919.log.gz 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101951.log 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92734.log: gzip 87.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.89169.log.gz-- 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112899.log 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92734.log.gz 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96862.log 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101951.log.gz 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116446.log 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96862.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.112899.log.gz-5 --verbose 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.100674.log 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96862.log.gz 2023-10-08T16:17:23.022 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89379.log 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116446.log.gz 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100452.log 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89379.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100674.log.gz 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110544.log 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89379.log.gz 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91967.log 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110544.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100452.log.gz 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102119.log 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91967.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.110544.log.gz--verbose -- 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88452.log 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102119.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91967.log.gz 2023-10-08T16:17:23.023 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88751.log 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102119.log.gz 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112773.log 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88751.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88452.log.gz 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106251.log 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88751.log.gz 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88116.log 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112773.log.gz 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106251.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106251.log.gz 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97773.log 2023-10-08T16:17:23.024 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mds.c.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88116.log.gz 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87072.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98990.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87072.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97773.log.gz 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102799.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87072.log.gz 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106185.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.98990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98990.log.gz 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88107.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106185.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102799.log.gz 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110766.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87649.log 2023-10-08T16:17:23.025 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88107.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.106185.log.gz 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112731.log 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88107.log.gz 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110766.log.gz 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90707.log 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97541.log 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112731.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87649.log.gz 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87859.log 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112731.log.gz 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90707.log.gz 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109914.log 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97541.log: /var/log/ceph/ceph-client.admin.87859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98479.log 2023-10-08T16:17:23.026 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97541.log.gz 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109914.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87859.log.gz 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112208.log 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109914.log.gz 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113487.log 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98479.log.gz 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101263.log 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112208.log: /var/log/ceph/ceph-client.admin.113487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111969.log 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112208.log.gz 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101263.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113487.log.gz 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105805.log 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115477.log 2023-10-08T16:17:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111969.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101263.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108233.log 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111969.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105805.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91271.log 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115477.log: /var/log/ceph/ceph-client.admin.108233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88799.log 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115477.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91271.log: gzip -5 89.1%--verbose -- /var/log/ceph/ceph-client.admin.118413.log -- replaced with /var/log/ceph/ceph-client.admin.108233.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91271.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113909.log 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88799.log.gz 2023-10-08T16:17:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88111.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118413.log: /var/log/ceph/ceph-client.admin.113909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95669.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118413.log.gz 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113909.log.gz 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90833.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117880.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95669.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88111.log.gz 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116946.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95669.log.gz 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90833.log.gz 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117880.log: /var/log/ceph/ceph-client.admin.89043.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110292.log 2023-10-08T16:17:23.029 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117880.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89043.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116946.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95329.log 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89043.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111865.log 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110292.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92914.log 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95329.log: /var/log/ceph/ceph-client.admin.111865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101155.log 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95329.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92914.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111865.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91085.log 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100632.log 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101155.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92914.log.gz 2023-10-08T16:17:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91085.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101155.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95169.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91085.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101113.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100632.log: /var/log/ceph/ceph-client.admin.95169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99729.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100632.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95169.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100410.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101113.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113529.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99729.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100844.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100410.log: /var/log/ceph/ceph-client.admin.113529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95753.log 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100410.log.gz 2023-10-08T16:17:23.031 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113529.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115330.log 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99687.log 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100844.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110250.log 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95753.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115330.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88797.log 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99687.log: /var/log/ceph/ceph-client.admin.110250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96604.log 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99687.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88797.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110250.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99351.log 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88797.log.gz 2023-10-08T16:17:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112292.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113164.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99351.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96604.log.gz 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115059.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99351.log.gz 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112292.log.gz 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115910.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113164.log: /var/log/ceph/ceph-client.admin.115059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101867.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113164.log.gz 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115059.log.gz 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115780.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115910.log.gz 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95837.log 2023-10-08T16:17:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109872.log 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115780.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101867.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118665.log 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115780.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95837.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88665.log 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109872.log: /var/log/ceph/ceph-client.admin.118665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113825.log 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109872.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88665.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118665.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90665.log 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88665.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102264.log 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113825.log.gz 2023-10-08T16:17:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88454.log 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90665.log: /var/log/ceph/ceph-client.admin.102264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93762.log 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90665.log.gz 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102264.log.gz 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105025.log 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113699.log 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93762.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88454.log.gz 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110892.log 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93762.log.gz 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105025.log.gz 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88446.log 2023-10-08T16:17:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113699.log: /var/log/ceph/ceph-client.admin.110892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88117.log 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113699.log.gz 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88446.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110892.log.gz 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99477.log 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88446.log.gz 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97499.log 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92566.log 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99477.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88117.log.gz 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96504.log 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99477.log.gz 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97499.log.gz 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104821.log 2023-10-08T16:17:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92566.log: /var/log/ceph/ceph-client.admin.96504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109574.log 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92566.log.gz 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104821.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96504.log.gz 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101197.log 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104821.log.gz 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105891.log 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117004.log 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101197.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109574.log.gz 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94774.log 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105891.log.gz 2023-10-08T16:17:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113867.log 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.101197.log.gz 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88451.log 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94774.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117004.log.gz 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111820.log 87.4% 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94774.log.gz 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88451.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113867.log.gz 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105975.log 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88451.log.gz 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.111820.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.102928.log -- replaced with /var/log/ceph/ceph-client.0.111820.log.gz 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98077.log 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102928.log: gzip -5 --verbose 87.6%-- /var/log/ceph/ceph-client.admin.91925.log 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105975.log.gz 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102928.log.gz 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88114.log 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91925.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98077.log.gz 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102715.log 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91925.log.gz 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108361.log 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88114.log.gz 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109264.log 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102715.log.gz 2023-10-08T16:17:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106489.log 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104611.log 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109264.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108361.log.gz 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100760.log 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109264.log.gz 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115204.log 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104611.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106489.log.gz 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100760.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104611.log.gz 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98563.log 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115204.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100760.log.gz 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91631.log 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115204.log.gz 2023-10-08T16:17:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107344.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111343.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91631.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98563.log.gz 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107596.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91631.log.gz 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104485.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111343.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107344.log.gz 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107596.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111343.log.gz 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114849.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102842.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104485.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107596.log.gz 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102390.log 2023-10-08T16:17:23.041 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104485.log.gz 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106798.log 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102842.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114849.log.gz 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102390.log: gzip -5 89.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102842.log.gz/var/log/ceph/ceph-client.admin.101993.log 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93658.log 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106798.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102390.log.gz 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101993.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.106798.log.gz--verbose 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.0.109138.log 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98121.log 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93658.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101993.log.gz 2023-10-08T16:17:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.109138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95497.log 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93658.log.gz 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109138.log.gz 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90212.log 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98121.log: /var/log/ceph/ceph-client.admin.95497.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98121.log.gz 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90261.log 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104075.log 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.90212.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95497.log.gz 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90212.log.gz 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91715.log 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115721.log 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7%/var/log/ceph/ceph-client.admin.104075.log: -- replaced with /var/log/ceph/ceph-client.admin.90261.log.gz 2023-10-08T16:17:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108191.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104075.log.gz 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96904.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91715.log.gz 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115721.log.gz 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108191.log.gz 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107758.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96904.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97913.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96904.log.gz 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97188.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97913.log: gzip -5 --verbose 87.6%-- /var/log/ceph/ceph-client.admin.94430.log 2023-10-08T16:17:23.044 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107758.log.gz 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117460.log 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97913.log.gz 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94430.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97188.log.gz 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90875.log 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117460.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.94430.log.gz-5 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:--verbose -- /var/log/ceph/ceph-client.admin.101741.log 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.117460.log.gz 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96368.log 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101741.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90875.log.gz 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88439.log 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101543.log 2023-10-08T16:17:23.045 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101741.log.gz 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96368.log.gz 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92820.log 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115372.log 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101543.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88439.log.gz 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92820.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101543.log.gz 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 /var/log/ceph/ceph-client.admin.115372.log: --verbose -- /var/log/ceph/ceph-client.admin.117628.log 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92820.log.gz 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.1.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115372.log.gz 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114723.log 2023-10-08T16:17:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105499.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2%/var/log/ceph/ceph-client.admin.114723.log: -- replaced with /var/log/ceph/ceph-client.admin.117628.log.gz 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105499.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114723.log.gz 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105499.log.gz 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90917.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109956.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.90917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103422.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.90917.log.gz 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114336.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99916.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103422.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109956.log.gz 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.114336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105763.log 2023-10-08T16:17:23.047 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103422.log.gz 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114336.log.gz 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99916.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99916.log.gz 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105763.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105763.log.gz 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95107.log 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118329.log 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88759.log 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89589.log 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95107.log.gz 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107386.log 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118329.log.gz 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97272.log 2023-10-08T16:17:23.048 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88759.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91127.log 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89589.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100367.log 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107386.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91127.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97272.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112502.log 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100367.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91127.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100367.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112502.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112502.log.gz 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108875.log 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119001.log 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98207.log 2023-10-08T16:17:23.049 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.119001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116862.log 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98207.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119001.log.gz 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.108875.log.gz 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116862.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98207.log.gz 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116862.log.gz 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109998.log 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107470.log 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:gzip /var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100718.log 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109998.log.gz 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113206.log 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100718.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107470.log.gz 2023-10-08T16:17:23.050 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113206.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100718.log.gz 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113206.log.gz 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116639.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117263.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.116639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88453.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116639.log.gz 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114933.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88453.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117263.log.gz 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88453.log.gz 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114933.log.gz 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114807.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115555.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87336.log 2023-10-08T16:17:23.051 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115555.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114807.log.gz 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87336.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115555.log.gz 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87336.log.gz 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116036.log 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105625.log 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95879.log 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116036.log.gz 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95879.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105625.log.gz 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95879.log.gz 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104033.log 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87156.log 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90620.log 2023-10-08T16:17:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87156.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104033.log.gz 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.2.90620.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87156.log.gz 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90620.log.gz 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94480.log 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107989.log 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99789.log 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107989.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94480.log.gz 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99789.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107989.log.gz 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99789.log.gz 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102757.log 2023-10-08T16:17:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86082.log 2023-10-08T16:17:23.054 INFO:teuthology.orchestra.run.smithi144.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117305.log 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.86082.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102757.log.gz 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117305.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86082.log.gz 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117305.log.gz 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87378.log 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105713.log 2023-10-08T16:17:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111907.log 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87378.log.gz 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111907.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105713.log.gz 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111907.log.gz 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117179.log 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95795.log 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115866.log 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95795.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117179.log.gz 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115866.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95795.log.gz 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115866.log.gz 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117712.log 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100000.log 2023-10-08T16:17:23.080 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105669.log 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117712.log.gz 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100000.log: /var/log/ceph/ceph-client.admin.105669.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100000.log.gz 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105669.log.gz 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117586.log 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118917.log 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118371.log 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118917.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117586.log.gz 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118917.log.gz 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118371.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118371.log.gz 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118287.log 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103195.log 2023-10-08T16:17:23.081 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89337.log 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103195.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118287.log.gz 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89337.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103195.log.gz 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89337.log.gz 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86771.log 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91883.log 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.86771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87691.log 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91883.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86771.log.gz 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87691.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91883.log.gz 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87691.log.gz 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111427.log 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104311.log 2023-10-08T16:17:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:gzip /var/log/ceph/ceph-client.admin.111427.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.91397.log 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104311.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111427.log.gz 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104311.log.gz 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91397.log.gz 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115994.log 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100928.log 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104779.log 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100928.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115994.log.gz 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104779.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100928.log.gz 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104779.log.gz 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111037.log 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117120.log 2023-10-08T16:17:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114765.log 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117120.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111037.log.gz 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114765.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117120.log.gz 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114765.log.gz 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87817.log 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116726.log 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107800.log 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116726.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87817.log.gz 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116726.log.gz 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107800.log.gz 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93967.log 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90749.log 2023-10-08T16:17:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93967.log: /var/log/ceph/ceph-client.admin.90749.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93967.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90749.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87607.log 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108317.log 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103237.log 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108317.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87607.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103237.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108317.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103237.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111824.log 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95247.log 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.111824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111824.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91228.log 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95247.log.gz 2023-10-08T16:17:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102221.log 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96410.log 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102221.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91228.log.gz 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96410.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102221.log.gz 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96410.log.gz 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117046.log 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97993.log 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94961.log 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97993.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117046.log.gz 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94961.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97993.log.gz 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94961.log.gz 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86987.log 2023-10-08T16:17:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.86987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116204.log 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96820.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86987.log.gz 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116204.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116204.log.gz 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88103.log 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100202.log 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95963.log 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.100202.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88103.log.gz 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95963.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100202.log.gz 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95963.log.gz 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87901.log 2023-10-08T16:17:23.087 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111561.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117670.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111561.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87901.log.gz 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117670.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117670.log.gz 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr: 91.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.111561.log.gz--verbose 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:-- /var/log/ceph/ceph-client.admin.88760.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109358.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88760.log: /var/log/ceph/ceph-client.admin.109358.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88760.log.gz 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109358.log.gz 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98163.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98797.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93168.log 2023-10-08T16:17:23.088 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98797.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98163.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93168.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98797.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93168.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94522.log 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94877.log 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96327.log 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94877.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94522.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.96327.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94877.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96327.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118959.log 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111477.log 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111259.log 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111477.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118959.log.gz 2023-10-08T16:17:23.089 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111477.log.gz 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111259.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111259.log.gz 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113290.log 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109134.log 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89505.log 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.109134.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113290.log.gz 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109134.log.gz 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89505.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89505.log.gz 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97230.log 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110208.log 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97230.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84632.log 2023-10-08T16:17:23.090 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110208.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97230.log.gz 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.tmp-client.admin.84632.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110208.log.gz 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84632.log.gz 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92009.log 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119196.log 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112250.log 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.119196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92009.log.gz 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112250.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119196.log.gz 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112250.log.gz 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116162.log 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112628.log 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111131.log 2023-10-08T16:17:23.091 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112628.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116162.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.111131.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112628.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111131.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97146.log 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115017.log 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97146.log: /var/log/ceph/ceph-client.admin.115017.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97146.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115017.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92398.log 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117754.log 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92398.log: /var/log/ceph/ceph-client.admin.117754.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92398.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117754.log.gz 2023-10-08T16:17:23.092 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116380.log 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97583.log 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116380.log: /var/log/ceph/ceph-client.admin.97583.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97583.log.gz 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.116380.log.gz 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93227.log 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96022.log 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93227.log: /var/log/ceph/ceph-client.admin.96022.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93227.log.gz 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96022.log.gz 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104695.log 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113004.log 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104695.log: /var/log/ceph/ceph-client.admin.113004.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104695.log.gz 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113004.log.gz 2023-10-08T16:17:23.093 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95455.log 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98605.log 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95455.log: /var/log/ceph/ceph-client.admin.98605.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95455.log.gz 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98605.log.gz 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108149.log 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110124.log 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108149.log: /var/log/ceph/ceph-client.admin.110124.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108149.log.gz 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110124.log.gz 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91043.log 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92956.log 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91043.log: /var/log/ceph/ceph-client.admin.92956.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91043.log.gz 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92956.log.gz 2023-10-08T16:17:23.094 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105457.log 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101501.log 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.105457.log: /var/log/ceph/ceph-client.admin.101501.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105457.log.gz 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.101501.log.gz 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115414.log 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97059.log 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115414.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115414.log.gz 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102432.log 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97059.log: /var/log/ceph/ceph-client.admin.102432.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97059.log.gz 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102432.log.gz 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113615.log 2023-10-08T16:17:23.095 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105375.log 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113615.log: /var/log/ceph/ceph-client.admin.105375.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113615.log.gz 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105375.log.gz 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92356.log 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86601.log 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92356.log: /var/log/ceph/ceph-client.admin.86601.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92356.log.gz 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86601.log.gz 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92440.log 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95921.log 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92440.log: /var/log/ceph/ceph-client.admin.95921.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92440.log.gz 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95921.log.gz 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106444.log 2023-10-08T16:17:23.096 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94388.log 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.106444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106444.log.gz 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94388.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94388.log.gz 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108497.log 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107716.log 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108497.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108497.log.gz 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97356.log 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107716.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107716.log.gz/var/log/ceph/ceph-client.admin.97356.log: 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97356.log.gz 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101012.log 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110850.log 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101012.log: /var/log/ceph/ceph-client.admin.110850.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101012.log.gz 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110850.log.gz 2023-10-08T16:17:23.097 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118203.log 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87523.log 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118203.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118203.log.gz 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87523.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87523.log.gz 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114381.log 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96646.log 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.114381.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114381.log.gz 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96646.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96646.log.gz 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118455.log 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98647.log 2023-10-08T16:17:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118455.log: /var/log/ceph/ceph-client.admin.98647.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118455.log.gz 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98647.log.gz 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86945.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.86945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93612.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86945.log.gz 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.0.93612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93612.log.gz 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96130.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106714.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.96130.log: /var/log/ceph/ceph-client.admin.106714.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96130.log.gz 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106714.log.gz 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108749.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112688.log 2023-10-08T16:17:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108749.log: /var/log/ceph/ceph-client.admin.112688.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108749.log.gz 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112688.log.gz 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113571.log 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102884.log 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113571.log: /var/log/ceph/ceph-client.admin.102884.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113571.log.gz 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102884.log.gz 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92998.log 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119043.log 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92998.log: /var/log/ceph/ceph-client.admin.119043.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92998.log.gz 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119043.log.gz 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108539.log 2023-10-08T16:17:23.100 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95045.log 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108539.log: /var/log/ceph/ceph-client.admin.95045.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108539.log.gz 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95045.log.gz 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109222.log 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110951.log 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109222.log: /var/log/ceph/ceph-client.admin.110951.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109222.log.gz 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110951.log.gz 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118497.log 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104653.log 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118497.log: /var/log/ceph/ceph-client.admin.104653.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118497.log.gz 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104653.log.gz 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103925.log 2023-10-08T16:17:23.101 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103925.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103925.log.gz 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98521.log 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111081.log 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98521.log: /var/log/ceph/ceph-client.admin.111081.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98521.log.gz 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111081.log.gz 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102161.log 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89463.log 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102161.log: /var/log/ceph/ceph-client.admin.89463.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102161.log.gz 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89463.log.gz 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117922.log 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94648.log 2023-10-08T16:17:23.102 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117922.log: /var/log/ceph/ceph-client.admin.94648.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117922.log.gz 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94648.log.gz 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104269.log 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89085.log 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104269.log: /var/log/ceph/ceph-client.admin.89085.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104269.log.gz 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89085.log.gz 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106448.log 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115679.log 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.106448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106448.log.gz 2023-10-08T16:17:23.103 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115679.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115679.log.gz 2023-10-08T16:17:23.112 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88115.log 2023-10-08T16:17:23.112 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117838.log 2023-10-08T16:17:23.112 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88115.log: /var/log/ceph/ceph-client.admin.117838.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88115.log.gz 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117838.log.gz 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101071.log 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96323.log 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101071.log: /var/log/ceph/ceph-client.0.96323.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101071.log.gz 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96323.log.gz 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97104.log 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96064.log 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97104.log: /var/log/ceph/ceph-client.admin.96064.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97104.log.gz 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.96064.log.gz 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112544.log 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118749.log 2023-10-08T16:17:23.113 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112544.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112544.log.gz 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.118749.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118749.log.gz 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92482.log 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92864.log 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92482.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92482.log.gz 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108581.log 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92864.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92864.log.gz 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103363.log 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108581.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108581.log.gz 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99832.log 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103363.log: /var/log/ceph/ceph-client.admin.99832.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103363.log.gz 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95585.log 2023-10-08T16:17:23.114 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99832.log.gz 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102348.log 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.95585.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95585.log.gz 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91501.log 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102348.log.gz 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117502.log 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91501.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91501.log.gz 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.117502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114340.log 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117502.log.gz 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104569.log 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.114340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114340.log.gz 2023-10-08T16:17:23.115 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104737.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104569.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104569.log.gz 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98437.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104737.log.gz 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107218.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98437.log: 88.3%/var/log/ceph/ceph-client.admin.107218.log: -- replaced with /var/log/ceph/ceph-client.admin.98437.log.gz 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93311.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107218.log.gz 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105067.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93311.log: 88.7%/var/log/ceph/ceph-client.admin.105067.log: -- replaced with /var/log/ceph/ceph-client.admin.93311.log.gz 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113951.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105067.log.gz 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104185.log 2023-10-08T16:17:23.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113951.log: /var/log/ceph/ceph-client.admin.104185.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113951.log.gz 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87437.log 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104185.log.gz 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107885.log 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87437.log: /var/log/ceph/ceph-client.admin.107885.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87437.log.gz 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108941.log 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107885.log.gz 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89673.log 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108941.log: /var/log/ceph/ceph-client.admin.89673.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.108941.log.gz 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103152.log 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89673.log.gz 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116904.log 2023-10-08T16:17:23.117 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103152.log.gz 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87198.log 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.116904.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116904.log.gz 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115637.log 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87198.log.gz 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104227.log 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.115637.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115637.log.gz 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107512.log 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104227.log.gz 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112334.log 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107512.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107512.log.gz 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.112334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98035.log 2023-10-08T16:17:23.118 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112334.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107554.log 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98035.log: /var/log/ceph/ceph-client.admin.107554.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.98035.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109675.log 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107554.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98731.log 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.109675.log: /var/log/ceph/ceph-client.admin.98731.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109675.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89211.log 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.98731.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119085.log 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89211.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97626.log 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.119085.log: /var/log/ceph/ceph-client.admin.97626.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119085.log.gz 2023-10-08T16:17:23.119 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113248.log 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97626.log.gz 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110166.log 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.113248.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113248.log.gz 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93126.log 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110166.log.gz 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102634.log 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93126.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93126.log.gz 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102634.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102634.log.gz 2023-10-08T16:17:23.120 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89547.log 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.89547.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89547.log.gz 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98393.log 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98393.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98393.log.gz 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93925.log 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93925.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93925.log.gz 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103769.log 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103769.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103769.log.gz 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110334.log 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.110334.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110334.log.gz 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94088.log 2023-10-08T16:17:23.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94088.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94088.log.gz 2023-10-08T16:17:23.122 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92524.log 2023-10-08T16:17:23.122 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92524.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92524.log.gz 2023-10-08T16:17:23.155 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T16:17:23.220 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T16:17:23.246 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T16:17:23.255 INFO:teuthology.orchestra.run.smithi060.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-08T16:17:23.530 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T16:17:23.645 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T16:17:23.697 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T16:17:23.745 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T16:17:23.747 INFO:teuthology.orchestra.run.smithi144.stderr: 2023-10-08T16:17:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m0.877s 2023-10-08T16:17:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m3.763s 2023-10-08T16:17:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m0.177s 2023-10-08T16:17:23.756 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T16:17:23.792 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T16:17:23.813 INFO:teuthology.orchestra.run.smithi060.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T16:17:23.911 INFO:teuthology.orchestra.run.smithi060.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T16:17:24.019 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T16:17:24.021 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T16:17:24.021 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m1.185s 2023-10-08T16:17:24.021 INFO:teuthology.orchestra.run.smithi060.stderr:user 0m5.069s 2023-10-08T16:17:24.021 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m0.505s 2023-10-08T16:17:24.021 INFO:tasks.ceph:Archiving logs... 2023-10-08T16:17:24.022 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/remote/smithi060/log 2023-10-08T16:17:24.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T16:17:25.179 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/remote/smithi144/log 2023-10-08T16:17:25.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T16:17:25.746 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T16:17:25.754 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T16:17:25.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T16:17:25.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T16:17:25.842 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T16:17:25.851 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T16:17:25.851 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:17:25.854 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:17:25.867 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-08T16:17:25.868 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-08T16:17:25.871 INFO:teuthology.orchestra.run.smithi144.stdout:210 Number of sources = 4 2023-10-08T16:17:25.871 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T16:17:25.871 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-08T16:17:25.871 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 +174us[ +178us] +/- 76ms 2023-10-08T16:17:25.871 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -453us[ -448us] +/- 61ms 2023-10-08T16:17:25.871 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +433us[ +433us] +/- 76ms 2023-10-08T16:17:25.872 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:17:25.872 INFO:teuthology.orchestra.run.smithi060.stdout:210 Number of sources = 4 2023-10-08T16:17:25.873 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T16:17:25.873 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-08T16:17:25.873 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 21 +166us[ +173us] +/- 76ms 2023-10-08T16:17:25.873 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -452us[ -445us] +/- 61ms 2023-10-08T16:17:25.873 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +419us[ +426us] +/- 76ms 2023-10-08T16:17:25.873 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:17:25.873 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T16:17:25.882 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T16:17:25.882 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T16:17:25.918 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T16:17:26.039 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T16:17:26.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T16:17:26.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:17:26.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T16:17:26.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:17:26.198 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T16:17:26.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T16:17:26.236 INFO:teuthology.task.internal:Duration was 1469.857007 seconds 2023-10-08T16:17:26.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T16:17:26.275 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T16:17:26.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T16:17:26.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T16:17:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T16:17:26.322 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T16:17:26.473 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T16:17:26.473 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T16:17:26.473 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T16:17:26.493 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T16:17:26.493 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T16:17:26.512 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T16:17:26.512 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T16:17:26.536 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T16:17:26.591 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T16:17:26.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T16:17:26.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T16:17:26.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T16:17:26.718 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T16:17:26.718 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T16:17:26.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T16:17:26.768 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T16:17:26.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:17:26.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:17:26.809 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2023-10-08T16:17:26.831 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2023-10-08T16:17:26.845 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:17:26.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:17:26.877 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:17:26.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:17:26.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T16:17:26.909 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T16:17:26.909 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/remote/smithi060 2023-10-08T16:17:26.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T16:17:26.956 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296/remote/smithi144 2023-10-08T16:17:26.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T16:17:26.991 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T16:17:26.991 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T16:17:26.993 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T16:17:27.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T16:17:27.051 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T16:17:27.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T16:17:27.070 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T16:17:27.070 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T16:17:27.072 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T16:17:27.085 INFO:teuthology.orchestra.run.smithi060.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 16:17 /home/ubuntu/cephtest 2023-10-08T16:17:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: 262149 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 16:17 /home/ubuntu/cephtest 2023-10-08T16:17:27.094 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T16:17:27.103 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T16:17:27.171 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T16:17:27.197 DEBUG:teuthology.nuke:shortname: smithi060 2023-10-08T16:17:27.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T16:17:27.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:38.733444', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPT663e9x64MqPNsDtBIeP4pQjApomtwEAEDjcOwK6uzLr+9Y8osJxUM98XN81R6pXv0j9ra7FxlKOo3luZSai0='} 2023-10-08T16:17:27.221 DEBUG:teuthology.nuke:shortname: smithi144 2023-10-08T16:17:27.221 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T16:17:27.241 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418296', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:38.731920', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEUWLvO62dedOFoii/ylNqnMTpBeEXAKNz0y5yCs41erjFIXclQ94mg22jEaSKcbi8TdFd/3tQSo5CWFOrWkaQ='} 2023-10-08T16:17:27.268 INFO:teuthology.orchestra.console.smithi060:Power off 2023-10-08T16:17:27.268 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T16:17:27.289 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-10-08T16:17:27.289 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:27.302 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-08T16:17:27.302 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T16:17:27.320 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-08T16:17:27.322 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-08T16:17:27.323 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:27.353 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T16:17:31.322 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:31.354 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:31.431 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-08T16:17:31.465 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T16:17:35.433 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:35.466 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:35.543 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-10-08T16:17:35.576 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T16:17:35.645 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-10-08T16:17:39.577 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:17:39.687 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-08T16:17:39.788 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-08T16:17:39.893 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1469.8570065498352 failure_reason: '"1696781087.9182277 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 222829.556558 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-08T16:17:39.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T16:17:39.970 INFO:teuthology.run:FAIL